Example with dummy data

This notebook shows a simplified use case utilizing a dummy set of randomly generated particle data. It is by default set to simulate a catalog of stars with Gaia DR2 astrometry & photometry, but you may change the parameters defined below to your liking. In short, the pipeline is accessible via the class Ananke, which method run can eventually be called after creation of an Ananke object to run the full ananke pipeline. The method run is designed to returns the catalog in the form of an Output object of the submodule Galaxia_ananke which can be used as a vaex dataframe.

Below are the packages that this notebook must import:

import numpy as np
import ananke as an
an.__version__

'0.2.0'

We define here some dummy input data. Ananke has a method make_dummy_particles_input to produce such data in a dictionary formatted output. Below we show how to call it and the keys that compose that dictionary.

np.random.seed(0)
p = an.Ananke.make_dummy_particles_input()
p.keys()

dict_keys(['pos3', 'vel3', 'mass', 'age', 'feh', 'helium', 'carbon', 'nitrogen', 'oxygen', 'neon', 'magnesium', 'silicon', 'sulphur', 'calcium', 'alpha', 'parentid', 'partitionid', 'dform', 'id', 'log10_NH'])

The input data must be formatted as a dictionary of equal-length arrays. The dictionary must have the following entries:

• key pos3: particle position coordinates in \(kpc\) (shape Nx3)

• key vel3: particle velocity coordinates in \(km.s^{-1}\) (shape Nx3)

• key mass: particle stellar mass in solar masses

• key age: particle log10 stellar age in years

• key feh: particle stellar metallicity [Fe/H] in dex relative to solar

Additionally, the following entries can optionally be added:

• key parentid: index to give to the parent particle

• key id: additional index to classify the parent particle

• key log10_NH: log10 hydrogen column densities between Observer position and particle in \(cm^{-2}\) - must be provided to estimate extinctions

• key dform: particle formation distance

• keys helium, carbon, nitrogen, oxygen, neon, magnesium, silicon, sulphur, calcium: particle various chemical abundances [X/H]

• key alpha: particle alpha chemical abundances [Mg/Fe]

Ananke will compute the phase space densities that are used to determine particle smoothing lengths, but one can include pre-computed densities with the following entries:

• key rho_pos: particle density in position space in \(kpc^{-3}\)

• key rho_vel: particle density in velocity space in \(km^{-3}.s^{3}\)

At any time, you may access this format via the helper of the Ananke.make_dummy_particles_input method using

help(an.Ananke.make_dummy_particles_input)

We define below some parameters for Ananke such as

• the observer position observer

• the shell of particles to mask rshell

• the sampling factor fsample

• the photometric system of choice photo_sys (in our case Gaia DR2)

• the CMD cmd_magnames and its box limits cmd_box

D = 200 # *units.kpc

observer = np.nan*np.ones(3)
while not np.linalg.norm(observer)<1:
    observer = 2*np.random.rand(3)-1

observer *= D/np.linalg.norm(observer)

rshell = [0, 2*D]

fsample = 0.01

photo_sys = 'padova/GAIA__DR2'

cmd_magnames = {'magnitude': 'G',
                'color_minuend': 'Gbp',
                'color_subtrahend': 'Grp'}

cmd_box = {
           'abs_mag_lim_lo': -1000,
           'abs_mag_lim_hi': 1000,
        #    'app_mag_lim_lo' : -1000,
           'app_mag_lim_hi': 30,
        #    'color_lim_lo' : -1000,
        #    'color_lim_hi' : 1000
           }

For more details regarding these parameters and more, you may consult the docstring associated to the class Ananke via the lines:

help(an.Ananke.__init__)

or

help(an.Ananke)

Note that among those are 3 special parameters, d_params, e_params and err_params, which receive dictionaries of subparameters to configure the sub-steps of the pipeline corresponding respectively to the phase space density estimation, the extinction mapping and the instrument error modeling. Each have further documentation that can be accessed calling the following methods:

an.display_density_docs() for d_params

an.display_extinction_docs() for e_params

an.display_errormodel_docs() for err_params

We show below how to create the Ananke pipeline object before calling run, using the parameters we defined above.

name = 'sim'
ananke = an.Ananke(p, name, fsample=fsample,
                   observer=observer, rshell=rshell,
                   photo_sys=photo_sys, cmd_magnames=cmd_magnames,
                   **cmd_box)

/home/docs/checkouts/readthedocs.org/user_builds/py-ananke/envs/v0.2.0/lib/python3.9/site-packages/ananke/utils.py:26: UserWarning: Pandas doesn't allow columns to be created via a new attribute name - see https://pandas.pydata.org/pandas-docs/stable/indexing.html#attribute-access
  self._record_of_all_used_keys = set()
/home/docs/checkouts/readthedocs.org/user_builds/py-ananke/envs/v0.2.0/lib/python3.9/site-packages/ananke/utils.py:26: UserWarning: Pandas doesn't allow columns to be created via a new attribute name - see https://pandas.pydata.org/pandas-docs/stable/indexing.html#attribute-access
  self._record_of_all_used_keys = set()

As mentioned above, the Ananke method run runs the pipeline once it has been created. Some additional parameters can be provided to this method, which are listed in its docstring (accessible by calling help(ananke.run)). Those include:

• input_dir, output_dir, i_o_dir - Optional arguments to specify paths for the directories where ananke should generate input and output data. If the i_o_dir keyword argument is provided, it overrides any path given to the input_dir and output_dir keyword arguments.

• k_factor – Scaling factor applied to the kernels lengths to adjust all the kernels sizes uniformly. Lower values reduces the kernels extents, while higher values increases them. Default to 1 (no adjustment).

• surveyname – Optional name Galaxia should use for the output files. Default to 'survey'.

• n_jobs – Number of independent catalog generations ran in parallel. Default to 1.

• verbose – Verbose boolean flag to allow pipeline to print what it’s doing to stdout. Default to True.

• rand_seed – Seed to be used by Galaxia’s pseudorandom number generator. Default to 17052

• nstart – Index at which to start indexing synthetic stars. Default to 0 For our example however, we will use the method as it is.

Warning

Some of the run method parameters are currently not properly implemented, using them may lead to unexpected results

survey = ananke.run()

Dimensions = 3
Normalization constant of Kernel type 3: 0.596831
Reading ASCII format file: to_enbid 
Read 300000 records

Allocated 3.8147 MByte for particle storage.
Type = 1 Particles = 100000
Total particles = 100000
Allocated 22.1252 MByte for Binary-Tree and Entropy bins.

Scaling Co-ordinates as x[i]=x[i]/h[i] with h[i]->
1 1 1 

Starting to Build Tree .......
Particle Type = 1 First node number = 1
                  Last node number  = 199999
Total number of nodes = 199999
Treebuild time = 0.188458 s 

Density Calculation. Smoothing .....

Evaluated =   1 % Time Left = 1.179573 s of 1.191500 s Par no = 96805 Density = 4.540411e-02 
Evaluated =   2 % Time Left = 1.108957 s of 1.131600 s Par no = 55454 Density = 4.964532e-03 
Evaluated =   3 % Time Left = 1.121470 s of 1.156167 s Par no = 27717 Density = 1.827217e-01 
Evaluated =   4 % Time Left = 1.116660 s of 1.163200 s Par no = 42234 Density = 2.712376e-02 
Evaluated =   5 % Time Left = 1.093609 s of 1.151180 s Par no = 99785 Density = 2.988043e-01 
Evaluated =   6 % Time Left = 1.085438 s of 1.154733 s Par no = 88021 Density = 1.791133e-01 
Evaluated =   7 % Time Left = 1.092712 s of 1.174971 s Par no = 75708 Density = 1.165058e-01 
Evaluated =   8 % Time Left = 1.073640 s of 1.167013 s Par no = 45579 Density = 7.255407e-02 
Evaluated =   9 % Time Left = 1.043516 s of 1.146733 s Par no = 30351 Density = 8.828938e-02 
Evaluated =  10 % Time Left = 1.038048 s of 1.153400 s Par no = 89176 Density = 1.775999e-01 
Evaluated =  11 % Time Left = 1.028100 s of 1.155182 s Par no = 60361 Density = 8.299880e-02 
Evaluated =  12 % Time Left = 1.022035 s of 1.161417 s Par no = 90082 Density = 2.203585e-01 
Evaluated =  13 % Time Left = 1.014141 s of 1.165692 s Par no = 26814 Density = 1.910994e-02 
Evaluated =  14 % Time Left = 0.998092 s of 1.160586 s Par no = 74297 Density = 2.157650e-02 
Evaluated =  15 % Time Left = 0.994930 s of 1.170520 s Par no = 94905 Density = 9.119637e-02 
Evaluated =  16 % Time Left = 0.987156 s of 1.175200 s Par no = 51653 Density = 9.666827e-02 
Evaluated =  17 % Time Left = 0.974115 s of 1.173647 s Par no = 39308 Density = 1.287774e-01 
Evaluated =  18 % Time Left = 0.964408 s of 1.176122 s Par no = 7800 Density = 4.130107e-02 

Evaluated =  19 % Time Left = 0.955532 s of 1.179684 s Par no = 42838 Density = 5.914271e-02 
Evaluated =  20 % Time Left = 0.944084 s of 1.180120 s Par no = 49016 Density = 1.554842e-01 
Evaluated =  21 % Time Left = 0.933016 s of 1.181048 s Par no = 29173 Density = 5.981785e-02 
Evaluated =  22 % Time Left = 0.916868 s of 1.175486 s Par no = 14018 Density = 4.713366e-02 
Evaluated =  23 % Time Left = 0.904738 s of 1.175000 s Par no = 90617 Density = 4.088210e-02 
Evaluated =  24 % Time Left = 0.895129 s of 1.177817 s Par no = 20588 Density = 1.273882e-01 
Evaluated =  25 % Time Left = 0.883476 s of 1.177984 s Par no = 15465 Density = 1.274245e-01 
Evaluated =  26 % Time Left = 0.875735 s of 1.183442 s Par no = 99360 Density = 2.044210e-01 
Evaluated =  27 % Time Left = 0.864097 s of 1.183711 s Par no = 71132 Density = 2.079416e-02 
Evaluated =  28 % Time Left = 0.849071 s of 1.179282 s Par no = 6665 Density = 4.366049e-03 
Evaluated =  29 % Time Left = 0.839526 s of 1.182448 s Par no = 44439 Density = 1.463732e-01 
Evaluated =  30 % Time Left = 0.827472 s of 1.182120 s Par no = 6386 Density = 1.825200e-01 
Evaluated =  31 % Time Left = 0.816592 s of 1.183484 s Par no = 2716 Density = 1.495580e-01 
Evaluated =  32 % Time Left = 0.804819 s of 1.183575 s Par no = 69470 Density = 6.785184e-02 
Evaluated =  33 % Time Left = 0.794218 s of 1.185418 s Par no = 95884 Density = 1.793627e-01 
Evaluated =  34 % Time Left = 0.781710 s of 1.184426 s Par no = 73768 Density = 1.295312e-02 
Evaluated =  35 % Time Left = 0.770725 s of 1.185749 s Par no = 47898 Density = 1.088661e-01 

Evaluated =  36 % Time Left = 0.758943 s of 1.185867 s Par no = 66396 Density = 3.959183e-02 
Evaluated =  37 % Time Left = 0.747235 s of 1.186105 s Par no = 16463 Density = 1.572218e-01 
Evaluated =  38 % Time Left = 0.737770 s of 1.189971 s Par no = 55669 Density = 1.712036e-01 
Evaluated =  39 % Time Left = 0.728413 s of 1.194138 s Par no = 97705 Density = 1.234432e-01 
Evaluated =  40 % Time Left = 0.715568 s of 1.192633 s Par no = 43442 Density = 6.719712e-02 
Evaluated =  41 % Time Left = 0.704129 s of 1.193459 s Par no = 10242 Density = 2.102901e-01 
Evaluated =  42 % Time Left = 0.694809 s of 1.197967 s Par no = 40929 Density = 1.391802e-01 
Evaluated =  43 % Time Left = 0.683779 s of 1.199633 s Par no = 5720 Density = 6.551559e-02 
Evaluated =  44 % Time Left = 0.670883 s of 1.198027 s Par no = 66730 Density = 9.093650e-02 
Evaluated =  45 % Time Left = 0.659778 s of 1.199618 s Par no = 48819 Density = 2.248662e-01 
Evaluated =  46 % Time Left = 0.649514 s of 1.202826 s Par no = 32014 Density = 9.211309e-02 
Evaluated =  47 % Time Left = 0.637869 s of 1.203549 s Par no = 31533 Density = 2.932795e-02 
Evaluated =  48 % Time Left = 0.625287 s of 1.202498 s Par no = 86677 Density = 1.263195e-01 
Evaluated =  49 % Time Left = 0.614099 s of 1.204139 s Par no = 81951 Density = 8.802204e-02 
Evaluated =  50 % Time Left = 0.602509 s of 1.205042 s Par no = 80149 Density = 1.559104e-01 
Evaluated =  51 % Time Left = 0.590145 s of 1.204402 s Par no = 25229 Density = 5.093939e-02 
Evaluated =  52 % Time Left = 0.578737 s of 1.205727 s Par no = 89731 Density = 4.987880e-02 

Evaluated =  53 % Time Left = 0.566535 s of 1.205419 s Par no = 76366 Density = 1.511494e-01 
Evaluated =  54 % Time Left = 0.554504 s of 1.205470 s Par no = 73159 Density = 1.548675e-02 
Evaluated =  55 % Time Left = 0.542672 s of 1.205965 s Par no = 54007 Density = 8.763470e-02 
Evaluated =  56 % Time Left = 0.530203 s of 1.205034 s Par no = 36235 Density = 5.465964e-02 
Evaluated =  57 % Time Left = 0.518520 s of 1.205889 s Par no = 62068 Density = 4.050222e-02 
Evaluated =  58 % Time Left = 0.505231 s of 1.202960 s Par no = 37661 Density = 2.656841e-02 
Evaluated =  59 % Time Left = 0.493857 s of 1.204558 s Par no = 67914 Density = 1.940649e-01 
Evaluated =  60 % Time Left = 0.482416 s of 1.206070 s Par no = 64732 Density = 5.859731e-02 
Evaluated =  61 % Time Left = 0.469081 s of 1.202803 s Par no = 88788 Density = 7.161247e-03 
Evaluated =  62 % Time Left = 0.456918 s of 1.202448 s Par no = 44083 Density = 2.877787e-02 
Evaluated =  63 % Time Left = 0.444354 s of 1.200990 s Par no = 14045 Density = 3.265437e-02 
Evaluated =  64 % Time Left = 0.431338 s of 1.198195 s Par no = 93621 Density = 5.216302e-02 
Evaluated =  65 % Time Left = 0.418662 s of 1.196212 s Par no = 9132 Density = 8.411557e-02 
Evaluated =  66 % Time Left = 0.406940 s of 1.196918 s Par no = 702 Density = 1.110411e-02 
Evaluated =  67 % Time Left = 0.395278 s of 1.197848 s Par no = 45670 Density = 2.465222e-02 
Evaluated =  68 % Time Left = 0.382745 s of 1.196116 s Par no = 53860 Density = 1.580593e-02 
Evaluated =  69 % Time Left = 0.370220 s of 1.194297 s Par no = 79719 Density = 4.454536e-02 
Evaluated =  70 % Time Left = 0.357561 s of 1.191910 s Par no = 96401 Density = 1.035200e-02 

Evaluated =  71 % Time Left = 0.345309 s of 1.190761 s Par no = 48105 Density = 3.704987e-02 
Evaluated =  72 % Time Left = 0.332912 s of 1.189015 s Par no = 75056 Density = 2.642116e-02 
Evaluated =  73 % Time Left = 0.320656 s of 1.187660 s Par no = 97912 Density = 1.775965e-01 
Evaluated =  74 % Time Left = 0.308424 s of 1.186291 s Par no = 87879 Density = 7.451773e-02 
Evaluated =  75 % Time Left = 0.296575 s of 1.186349 s Par no = 85159 Density = 1.462781e-02 
Evaluated =  76 % Time Left = 0.284940 s of 1.187300 s Par no = 78132 Density = 5.302110e-02 
Evaluated =  77 % Time Left = 0.272774 s of 1.186026 s Par no = 21990 Density = 3.497640e-03 
Evaluated =  78 % Time Left = 0.260379 s of 1.183594 s Par no = 16462 Density = 2.482335e-02 
Evaluated =  79 % Time Left = 0.248317 s of 1.182520 s Par no = 22311 Density = 3.571432e-02 
Evaluated =  80 % Time Left = 0.236140 s of 1.180758 s Par no = 43269 Density = 1.776266e-02 
Evaluated =  81 % Time Left = 0.224450 s of 1.181379 s Par no = 43142 Density = 1.532303e-02 
Evaluated =  82 % Time Left = 0.212581 s of 1.181071 s Par no = 52197 Density = 3.049044e-02 
Evaluated =  83 % Time Left = 0.200519 s of 1.179592 s Par no = 74476 Density = 1.449572e-01 
Evaluated =  84 % Time Left = 0.188723 s of 1.179592 s Par no = 8891 Density = 1.050831e-02 
Evaluated =  85 % Time Left = 0.176857 s of 1.179125 s Par no = 1559 Density = 1.452041e-03 
Evaluated =  86 % Time Left = 0.164986 s of 1.178555 s Par no = 20602 Density = 2.028735e-01 
Evaluated =  87 % Time Left = 0.153273 s of 1.179116 s Par no = 54383 Density = 2.137116e-01 
Evaluated =  88 % Time Left = 0.141717 s of 1.181073 s Par no = 70246 Density = 2.757094e-03 

Evaluated =  89 % Time Left = 0.130078 s of 1.182639 s Par no = 51472 Density = 5.058417e-04 
Evaluated =  90 % Time Left = 0.118131 s of 1.181423 s Par no = 66269 Density = 3.630537e-02 
Evaluated =  91 % Time Left = 0.106452 s of 1.182935 s Par no = 62858 Density = 1.776033e-01 
Evaluated =  92 % Time Left = 0.094786 s of 1.184967 s Par no = 84061 Density = 1.439860e-01 
Evaluated =  93 % Time Left = 0.083010 s of 1.186027 s Par no = 78610 Density = 4.029672e-03 
Evaluated =  94 % Time Left = 0.071206 s of 1.186965 s Par no = 3871 Density = 1.597447e-01 
Evaluated =  95 % Time Left = 0.059437 s of 1.188968 s Par no = 68736 Density = 1.582606e-01 
Evaluated =  96 % Time Left = 0.047632 s of 1.191097 s Par no = 30472 Density = 6.743145e-02 
Evaluated =  97 % Time Left = 0.035731 s of 1.191441 s Par no = 86838 Density = 1.353215e-03 
Evaluated =  98 % Time Left = 0.023832 s of 1.192219 s Par no = 92913 Density = 5.211162e-02 
Evaluated =  99 % Time Left = 0.011927 s of 1.193865 s Par no = 30015 Density = 9.179291e-04 
Evaluated = 100 % Time Left = -0.000012 s of 1.196175 s Par no = 86525 Density = 1.579017e-04 

Total Smoothing Time = 1.19619 s
1 3

writing snapshot file ....
to_enbid_d3n64.est

done with snapshot.

Total Time = 1.85316 s 

/home/docs/checkouts/readthedocs.org/user_builds/py-ananke/envs/v0.2.0/lib/python3.9/site-packages/EnBiD_ananke/__init__.py:237: FutureWarning: The 'delim_whitespace' keyword in pd.read_table is deprecated and will be removed in a future version. Use ``sep='\s+'`` instead
  usedvals = pd.read_table(path / CONSTANTS.usedvalues, header=None, delim_whitespace=True,

Dimensions = 3
Normalization constant of Kernel type 3: 0.596831
Reading ASCII format file: to_enbid 
Read 300000 records

Allocated 3.8147 MByte for particle storage.
Type = 1 Particles = 100000
Total particles = 100000
Allocated 22.1252 MByte for Binary-Tree and Entropy bins.

Scaling Co-ordinates as x[i]=x[i]/h[i] with h[i]->
1 1 1 

Starting to Build Tree .......
Particle Type = 1 First node number = 1

                  Last node number  = 199999
Total number of nodes = 199999
Treebuild time = 0.201564 s 

Density Calculation. Smoothing .....
Evaluated =   1 % Time Left = 1.122451 s of 1.133800 s Par no = 3379 Density = 1.586355e-02 
Evaluated =   2 % Time Left = 1.103763 s of 1.126300 s Par no = 75725 Density = 4.756319e-02 
Evaluated =   3 % Time Left = 1.121082 s of 1.155767 s Par no = 95160 Density = 6.928090e-03 
Evaluated =   4 % Time Left = 1.095829 s of 1.141500 s Par no = 40983 Density = 2.235913e-02 
Evaluated =   5 % Time Left = 1.099860 s of 1.157760 s Par no = 79587 Density = 2.321368e-02 
Evaluated =   6 % Time Left = 1.110410 s of 1.181300 s Par no = 62143 Density = 2.106821e-02 
Evaluated =   7 % Time Left = 1.088141 s of 1.170057 s Par no = 48098 Density = 2.322558e-02 
Evaluated =   8 % Time Left = 1.080390 s of 1.174350 s Par no = 73424 Density = 1.566558e-02 
Evaluated =   9 % Time Left = 1.072039 s of 1.178078 s Par no = 41738 Density = 1.527212e-02 
Evaluated =  10 % Time Left = 1.061781 s of 1.179770 s Par no = 34821 Density = 3.462067e-02 
Evaluated =  11 % Time Left = 1.062146 s of 1.193436 s Par no = 99566 Density = 5.806165e-02 
Evaluated =  12 % Time Left = 1.051837 s of 1.195283 s Par no = 59443 Density = 1.071449e-02 
Evaluated =  13 % Time Left = 1.030704 s of 1.184731 s Par no = 7663 Density = 2.551240e-03 
Evaluated =  14 % Time Left = 1.026699 s of 1.193850 s Par no = 69540 Density = 2.717029e-02 
Evaluated =  15 % Time Left = 1.011760 s of 1.190320 s Par no = 28859 Density = 1.270314e-02 
Evaluated =  16 % Time Left = 0.991199 s of 1.180013 s Par no = 77774 Density = 2.211896e-02 

Evaluated =  17 % Time Left = 0.987234 s of 1.189453 s Par no = 65109 Density = 3.644556e-03 
Evaluated =  18 % Time Left = 0.972490 s of 1.185978 s Par no = 17146 Density = 6.157028e-03 
Evaluated =  19 % Time Left = 0.965615 s of 1.192132 s Par no = 79145 Density = 2.474514e-02 
Evaluated =  20 % Time Left = 0.953652 s of 1.192080 s Par no = 84563 Density = 3.054690e-02 
Evaluated =  21 % Time Left = 0.940912 s of 1.191043 s Par no = 35101 Density = 3.370794e-02 
Evaluated =  22 % Time Left = 0.928316 s of 1.190164 s Par no = 31911 Density = 1.401559e-03 
Evaluated =  23 % Time Left = 0.916482 s of 1.190252 s Par no = 96514 Density = 1.869492e-02 
Evaluated =  24 % Time Left = 0.904265 s of 1.189838 s Par no = 41208 Density = 4.063115e-02 
Evaluated =  25 % Time Left = 0.892017 s of 1.189372 s Par no = 50899 Density = 1.130457e-03 
Evaluated =  26 % Time Left = 0.878929 s of 1.187758 s Par no = 25354 Density = 2.573581e-02 
Evaluated =  27 % Time Left = 0.867074 s of 1.187789 s Par no = 38397 Density = 1.824382e-02 
Evaluated =  28 % Time Left = 0.860496 s of 1.195150 s Par no = 99925 Density = 5.098955e-02 
Evaluated =  29 % Time Left = 0.852823 s of 1.201176 s Par no = 67233 Density = 3.835664e-02 
Evaluated =  30 % Time Left = 0.842919 s of 1.204187 s Par no = 21415 Density = 1.821073e-02 
Evaluated =  31 % Time Left = 0.828658 s of 1.200971 s Par no = 39830 Density = 5.986182e-03 
Evaluated =  32 % Time Left = 0.813483 s of 1.196316 s Par no = 62656 Density = 1.851001e-03 
Evaluated =  33 % Time Left = 0.804159 s of 1.200255 s Par no = 48049 Density = 1.832367e-02 

Evaluated =  34 % Time Left = 0.795129 s of 1.204759 s Par no = 71467 Density = 3.566542e-02 
Evaluated =  35 % Time Left = 0.784079 s of 1.206294 s Par no = 94467 Density = 8.080338e-03 
Evaluated =  36 % Time Left = 0.769618 s of 1.202547 s Par no = 24663 Density = 3.556317e-02 
Evaluated =  37 % Time Left = 0.756919 s of 1.201478 s Par no = 55355 Density = 2.436876e-02 
Evaluated =  38 % Time Left = 0.746313 s of 1.203750 s Par no = 77628 Density = 3.192216e-02 
Evaluated =  39 % Time Left = 0.735357 s of 1.205523 s Par no = 6428 Density = 3.955819e-02 
Evaluated =  40 % Time Left = 0.723336 s of 1.205580 s Par no = 29219 Density = 3.686058e-04 
Evaluated =  41 % Time Left = 0.710813 s of 1.204788 s Par no = 11475 Density = 1.075123e-02 
Evaluated =  42 % Time Left = 0.701415 s of 1.209357 s Par no = 25064 Density = 3.927625e-02 
Evaluated =  43 % Time Left = 0.690017 s of 1.210577 s Par no = 14672 Density = 1.066699e-02 
Evaluated =  44 % Time Left = 0.676911 s of 1.208791 s Par no = 46917 Density = 2.114631e-02 
Evaluated =  45 % Time Left = 0.663993 s of 1.207282 s Par no = 35522 Density = 9.714150e-03 
Evaluated =  46 % Time Left = 0.652780 s of 1.208874 s Par no = 10564 Density = 2.478037e-03 
Evaluated =  47 % Time Left = 0.640428 s of 1.208377 s Par no = 90836 Density = 3.490644e-02 
Evaluated =  48 % Time Left = 0.628636 s of 1.208940 s Par no = 91231 Density = 8.647473e-03 
Evaluated =  49 % Time Left = 0.617234 s of 1.210286 s Par no = 16819 Density = 9.508127e-03 
Evaluated =  50 % Time Left = 0.603621 s of 1.207266 s Par no = 30766 Density = 4.927925e-03 

Evaluated =  51 % Time Left = 0.592301 s of 1.208802 s Par no = 9459 Density = 7.940475e-03 
Evaluated =  52 % Time Left = 0.579490 s of 1.207296 s Par no = 76505 Density = 8.072356e-03 
Evaluated =  53 % Time Left = 0.566444 s of 1.205226 s Par no = 52019 Density = 3.462386e-03 
Evaluated =  54 % Time Left = 0.554080 s of 1.204548 s Par no = 56938 Density = 1.337130e-02 
Evaluated =  55 % Time Left = 0.540747 s of 1.201687 s Par no = 33321 Density = 2.006831e-02 
Evaluated =  56 % Time Left = 0.528961 s of 1.202212 s Par no = 4046 Density = 2.271462e-02 
Evaluated =  57 % Time Left = 0.517676 s of 1.203926 s Par no = 68529 Density = 3.147267e-02 
Evaluated =  58 % Time Left = 0.507992 s of 1.209534 s Par no = 23845 Density = 3.357711e-02 
Evaluated =  59 % Time Left = 0.497029 s of 1.212297 s Par no = 57420 Density = 3.986822e-02 
Evaluated =  60 % Time Left = 0.484877 s of 1.212223 s Par no = 89896 Density = 3.369183e-03 
Evaluated =  61 % Time Left = 0.472791 s of 1.212316 s Par no = 39610 Density = 1.535302e-03 
Evaluated =  62 % Time Left = 0.459599 s of 1.209503 s Par no = 26107 Density = 4.015532e-03 
Evaluated =  63 % Time Left = 0.447334 s of 1.209043 s Par no = 98943 Density = 1.799383e-03 
Evaluated =  64 % Time Left = 0.434578 s of 1.207195 s Par no = 99085 Density = 1.412553e-02 
Evaluated =  65 % Time Left = 0.422223 s of 1.206385 s Par no = 17 Density = 1.179375e-02 
Evaluated =  66 % Time Left = 0.409385 s of 1.204108 s Par no = 3087 Density = 1.429490e-02 
Evaluated =  67 % Time Left = 0.398312 s of 1.207043 s Par no = 86468 Density = 2.256122e-02 

Evaluated =  68 % Time Left = 0.386407 s of 1.207560 s Par no = 52080 Density = 4.635496e-03 
Evaluated =  69 % Time Left = 0.373625 s of 1.205280 s Par no = 26417 Density = 1.433997e-02 
Evaluated =  70 % Time Left = 0.361539 s of 1.205171 s Par no = 79634 Density = 7.429452e-03 
Evaluated =  71 % Time Left = 0.349663 s of 1.205777 s Par no = 97643 Density = 2.184668e-04 
Evaluated =  72 % Time Left = 0.337755 s of 1.206311 s Par no = 78794 Density = 5.369595e-03 
Evaluated =  73 % Time Left = 0.325150 s of 1.204304 s Par no = 45708 Density = 1.294336e-02 
Evaluated =  74 % Time Left = 0.312659 s of 1.202580 s Par no = 66525 Density = 2.125199e-03 
Evaluated =  75 % Time Left = 0.300288 s of 1.201201 s Par no = 21984 Density = 8.619656e-04 
Evaluated =  76 % Time Left = 0.288121 s of 1.200555 s Par no = 43799 Density = 2.740289e-03 
Evaluated =  77 % Time Left = 0.275686 s of 1.198686 s Par no = 63854 Density = 3.854665e-03 
Evaluated =  78 % Time Left = 0.263292 s of 1.196837 s Par no = 91160 Density = 2.256671e-03 
Evaluated =  79 % Time Left = 0.251243 s of 1.196454 s Par no = 1891 Density = 1.555006e-04 
Evaluated =  80 % Time Left = 0.239345 s of 1.196782 s Par no = 17306 Density = 9.342227e-04 
Evaluated =  81 % Time Left = 0.227344 s of 1.196610 s Par no = 83119 Density = 2.469888e-02 
Evaluated =  82 % Time Left = 0.215455 s of 1.197041 s Par no = 73346 Density = 1.956386e-03 
Evaluated =  83 % Time Left = 0.203248 s of 1.195646 s Par no = 98412 Density = 4.288590e-03 
Evaluated =  84 % Time Left = 0.191517 s of 1.197054 s Par no = 52509 Density = 8.264857e-03 
Evaluated =  85 % Time Left = 0.179918 s of 1.199534 s Par no = 76716 Density = 3.547589e-02 

Evaluated =  86 % Time Left = 0.168398 s of 1.202931 s Par no = 95957 Density = 2.923764e-02 
Evaluated =  87 % Time Left = 0.156374 s of 1.202969 s Par no = 3295 Density = 1.361911e-02 
Evaluated =  88 % Time Left = 0.144366 s of 1.203150 s Par no = 4026 Density = 3.781490e-02 
Evaluated =  89 % Time Left = 0.132435 s of 1.204063 s Par no = 78656 Density = 6.492402e-02 
Evaluated =  90 % Time Left = 0.120687 s of 1.206994 s Par no = 9255 Density = 4.661644e-02 
Evaluated =  91 % Time Left = 0.108780 s of 1.208797 s Par no = 89389 Density = 2.612382e-03 
Evaluated =  92 % Time Left = 0.096544 s of 1.206951 s Par no = 91357 Density = 1.136847e-02 
Evaluated =  93 % Time Left = 0.084581 s of 1.208469 s Par no = 75212 Density = 1.186542e-02 
Evaluated =  94 % Time Left = 0.072674 s of 1.211431 s Par no = 79246 Density = 4.605766e-02 
Evaluated =  95 % Time Left = 0.060654 s of 1.213318 s Par no = 93038 Density = 2.164083e-02 
Evaluated =  96 % Time Left = 0.048533 s of 1.213617 s Par no = 65384 Density = 2.308048e-02 
Evaluated =  97 % Time Left = 0.036367 s of 1.212628 s Par no = 32352 Density = 1.225704e-03 
Evaluated =  98 % Time Left = 0.024261 s of 1.213670 s Par no = 16971 Density = 3.436726e-02 
Evaluated =  99 % Time Left = 0.012138 s of 1.215058 s Par no = 22517 Density = 2.430708e-02 
Evaluated = 100 % Time Left = -0.000012 s of 1.217025 s Par no = 42877 Density = 2.940734e-06 

Total Smoothing Time = 1.21704 s
1 3

writing snapshot file ....
to_enbid_d3n64.est

done with snapshot.

Total Time = 1.87931 s 

Executing JOB 1/1 = /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/envs/v0.2.0/.cache/Galaxia_ananke/bin/galaxia -r --hdim=6 --nfile=sim --ngen=0 /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/checkouts/v0.2.0/docs/source/temp/jupyter/survey_params
JOB 1/1 | CODEDATAPATH=/home/docs/checkouts/readthedocs.org/user_builds/py-ananke/envs/v0.2.0/.cache/Galaxia_ananke/GalaxiaData/
JOB 1/1 | Reading Parameter file-             /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/checkouts/v0.2.0/docs/source/temp/jupyter/survey_params
JOB 1/1 | --------------------------------------------------------
JOB 1/1 | outputFile               survey                  
JOB 1/1 | outputDir                /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/checkouts/v0.2.0/docs/source/temp/jupyter
JOB 1/1 | photoCateg               padova                  
JOB 1/1 | photoSys                 GAIA__DR2               
JOB 1/1 | magcolorNames            G,Gbp-Grp               
JOB 1/1 | appMagLimits[0]          -1000                   
JOB 1/1 | appMagLimits[1]          30                      
JOB 1/1 | absMagLimits[0]          -1000                   
JOB 1/1 | absMagLimits[1]          1000                    
JOB 1/1 | colorLimits[0]           -1000                   
JOB 1/1 | colorLimits[1]           1000                    
JOB 1/1 | geometryOption           0                       
JOB 1/1 | surveyArea               207.455                 
JOB 1/1 | fSample                  0.01                    
JOB 1/1 | popID                    10                      
JOB 1/1 | warpFlareOn              0                       
JOB 1/1 | longitude                76.273                  
JOB 1/1 | latitude                 13.4725                 
JOB 1/1 | starType                 0                       
JOB 1/1 | photoError               0                       
JOB 1/1 | seed                     17052                   
JOB 1/1 | r_max                    400                     
JOB 1/1 | r_min                    0                       
JOB 1/1 | nres                     64                      
JOB 1/1 | nstart                   0                       
JOB 1/1 | rSun[0]                  194.95682580382552      
JOB 1/1 | rSun[1]                  -34.20370085093144      
JOB 1/1 | rSun[2]                  28.669546919977957      
JOB 1/1 | vSun[0]                  12.9                    
JOB 1/1 | vSun[1]                  245.6                   
JOB 1/1 | vSun[2]                  7.78                    
JOB 1/1 | --------------------------------------------------------
JOB 1/1 | Reading Halo Sat File=/home/docs/checkouts/readthedocs.org/user_builds/py-ananke/envs/v0.2.0/.cache/Galaxia_ananke/GalaxiaData/nbody1/filenames/sim.txt
JOB 1/1 | nbody1/sim/
JOB 1/1 | 
JOB 1/1 | 	1	1
JOB 1/1 | 
JOB 1/1 | path nbody1/sim/ sats 1 x[0] 1
JOB 1/1 | Halo 1 Sat 0 fname nbody1/sim/sim.ebf 0
JOB 1/1 | nbody1/sim/sim.ebf 0
JOB 1/1 | No of Satellites   =1
JOB 1/1 | Generating catalog. Max allowed stars is 18446744073709551615
JOB 1/1 | Source numbering will start at 0
JOB 1/1 | Writing to /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/checkouts/v0.2.0/docs/source/temp/jupyter/survey.sim.0.ebf
JOB 1/1 | Using geometry:                     All Sky
JOB 1/1 | setting center to 194.957 -34.2037 28.6695 12.9 245.6 7.78
JOB 1/1 | Reading Isochrones from dir-        /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/envs/v0.2.0/.cache/Galaxia_ananke/GalaxiaData/Isochrones/padova/GAIA__DR2

/home/docs/checkouts/readthedocs.org/user_builds/py-ananke/envs/v0.2.0/lib/python3.9/site-packages/EnBiD_ananke/__init__.py:237: FutureWarning: The 'delim_whitespace' keyword in pd.read_table is deprecated and will be removed in a future version. Use ``sep='\s+'`` instead
  usedvals = pd.read_table(path / CONSTANTS.usedvalues, header=None, delim_whitespace=True,

JOB 1/1 | Isochrone Grid Size:                (Age bins=71,Feh bins=34,Alpha bins=1)
JOB 1/1 | Time Isochrone Reading              4.65993     
JOB 1/1 | ------------------------------
JOB 1/1 | nbody1/sim/sim.ebf  Sat No=0
JOB 1/1 | Particles=100000
JOB 1/1 | Satellite Info
JOB 1/1 | Particles=100000 Mass=5.49989e+08 0.379706

JOB 1/1 | Total Stars=2280137 accepted=1614163 rejected=665974
JOB 1/1 | -----------Done---------------
JOB 1/1 | Total stars written                 1614163                 
JOB 1/1 | 31

JOB 1/1 | File written-                       /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/checkouts/v0.2.0/docs/source/temp/jupyter/survey.sim.0.ebf
JOB 1/1 | Calculating magnitudes in GAIA__DR2 system................
JOB 1/1 | initializing isochrone data
JOB 1/1 | interpolating on isochrone tables

JOB 1/1 | Appending spherical coordinates................

JOB 1/1 | Total Time=                         9.5245      

Exported the following quantities from /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/checkouts/v0.2.0/docs/source/temp/jupyter/survey.sim.0.ebf to /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/checkouts/v0.2.0/docs/source/temp/jupyter/survey.sim.0.h5 for partition 0
['age', 'alpha', 'calcium', 'carbon', 'dec', 'dform', 'dmod', 'feh', 'gaia__dr2_g', 'gaia__dr2_gbp', 'gaia__dr2_grp', 'glat', 'glon', 'grav', 'helium', 'lum', 'mact', 'magnesium', 'mtip', 'neon', 'nitrogen', 'oxygen', 'parentid', 'partid', 'partitionid', 'px', 'py', 'pz', 'ra', 'rad', 'satid', 'silicon', 'smass', 'sulphur', 'teff', 'vx', 'vy', 'vz']
Running convert_cartesian_to_galactic post-processing pipeline

Exported the following quantities to /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/checkouts/v0.2.0/docs/source/temp/jupyter/survey.sim.0.h5
['mub', 'vr', 'mul']
Overwritten the following quantities to /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/checkouts/v0.2.0/docs/source/temp/jupyter/survey.sim.0.h5
('glon', 'glat', 'rad')
Running convert_galactic_to_icrs post-processing pipeline

Exported the following quantities to /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/checkouts/v0.2.0/docs/source/temp/jupyter/survey.sim.0.h5
['mudec', 'mura']
Overwritten the following quantities to /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/checkouts/v0.2.0/docs/source/temp/jupyter/survey.sim.0.h5
('ra', 'dec')
Running last_conversions post-processing pipeline

Exported the following quantities to /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/checkouts/v0.2.0/docs/source/temp/jupyter/survey.sim.0.h5
['pi']
Overwritten the following quantities to /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/checkouts/v0.2.0/docs/source/temp/jupyter/survey.sim.0.h5
('teff', 'lum')
Running observed_magnitudes post-processing pipeline

Exported the following quantities to /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/checkouts/v0.2.0/docs/source/temp/jupyter/survey.sim.0.h5
['gaia__dr2_g_Intrinsic', 'gaia__dr2_gbp_Intrinsic', 'gaia__dr2_grp_Intrinsic']
Overwritten the following quantities to /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/checkouts/v0.2.0/docs/source/temp/jupyter/survey.sim.0.h5
('gaia__dr2_g', 'gaia__dr2_gbp', 'gaia__dr2_grp')
Running extinctions post-processing pipeline

Exported the following quantities to /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/checkouts/v0.2.0/docs/source/temp/jupyter/survey.sim.0.h5
['A_0', 'E(B-V)', 'log10_NH', 'A_gaia__dr2_g', 'A_gaia__dr2_gbp', 'A_gaia__dr2_grp']
Overwritten the following quantities to /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/checkouts/v0.2.0/docs/source/temp/jupyter/survey.sim.0.h5
('gaia__dr2_g', 'gaia__dr2_gbp', 'gaia__dr2_grp')
Running error_modeling post-processing pipeline

/home/docs/checkouts/readthedocs.org/user_builds/py-ananke/envs/v0.2.0/lib/python3.9/site-packages/ananke/utils.py:26: UserWarning: Pandas doesn't allow columns to be created via a new attribute name - see https://pandas.pydata.org/pandas-docs/stable/indexing.html#attribute-access
  self._record_of_all_used_keys = set()
/home/docs/checkouts/readthedocs.org/user_builds/py-ananke/envs/v0.2.0/lib/python3.9/site-packages/ananke/_default_error_model.py:37: RuntimeWarning: overflow encountered in power
  grvs = rpmag + 132.32 - 377.28*ggrp + 402.32*ggrp**2 - 190.97*ggrp**3 + 34.026*ggrp**4
/home/docs/checkouts/readthedocs.org/user_builds/py-ananke/envs/v0.2.0/lib/python3.9/site-packages/ananke/_default_error_model.py:37: RuntimeWarning: overflow encountered in multiply
  grvs = rpmag + 132.32 - 377.28*ggrp + 402.32*ggrp**2 - 190.97*ggrp**3 + 34.026*ggrp**4

Exported the following quantities to /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/checkouts/v0.2.0/docs/source/temp/jupyter/survey.sim.0.h5
['gaia__dr2_grp_Err', 'dec_Sig', 'gaia__dr2_gbp_Sig', 'mudec_Sig', 'mudec_Err', 'gaia__dr2_grp_Sig', 'gaia__dr2_gbp_Err', 'gaia__dr2_g_Err', 'vr_Err', 'mura_Sig', 'vr_Sig', 'dec_Err', 'pi_Err', 'pi_Sig', 'gaia__dr2_g_Sig', 'mura_Err', 'ra_Sig', 'ra_Err']

Overwritten the following quantities to /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/checkouts/v0.2.0/docs/source/temp/jupyter/survey.sim.0.h5
('dec', 'pi', 'gaia__dr2_grp', 'vr', 'gaia__dr2_g', 'ra', 'mura', 'mudec', 'gaia__dr2_gbp')
Running convert_icrs_to_galactic post-processing pipeline

Overwritten the following quantities to /home/docs/checkouts/readthedocs.org/user_builds/py-ananke/checkouts/v0.2.0/docs/source/temp/jupyter/survey.sim.0.h5
('glon', 'glat', 'mul', 'mub')

The output is saved as a vaex dataframe, with its columns organized in alphabetical order. The photometry is stored in columns that are named according to their associated photometric system and filter name. The keys are in the lowercase format photosys_filtername where photo_sys is the photometric system and filtername is the filter name. In this example, the apparent photometry in filters gbp, grp & g of the Gaia DR2 system (identified as GAIA__DR2 in Galaxia) are respectively under keys gaia__dr2_gbp, gaia__dr2_grp & gaia__dr2_g. Beside these, the columns include:

• key A_0 for the reference extinction which extinction coefficients are based on (at \(\lambda = 550 \, nm\) in the case of Gaia DR2)

• key A_{filter_name} for the extinction value in each filter designated by filter_name (here A_gaia__dr2_g, A_gaia__dr2_gbp & A_gaia__dr2_grp)

• key E(B-V) for the reddening index

• key age for the \(log_{10}\) stellar age in years

• key alpha, calcium, carbon, helium, magnesium, neon, nitrogen, oxygen, silicon, sulphur for the various chemical abundances as given as input

• key dec, ra for the astrometric declination and right ascension celestial coordinates in degrees

• key dform for the formation distance as given as input

• key dmod for the distance modulus

• key feh for the stellar metallicity [Fe/H] in dex relative to solar

• key {filter_name}_Intrinsic for the intrinsic stellar photometry in each filter designated by filter_name (here gaia__dr2_g_Intrinsic, gaia__dr2_gbp_Intrinsic & gaia__dr2_grp_Intrinsic)

• key glat, glon for the astrometric galactic latitude and longitude celestrial coordinates in degrees

• key grav for the \(log_{10}\) surface gravity in CGS units

• key log10_NH for the \(log_{10}\) hydrogen column density between Observer position and star in \(cm^{-2}\)

• key lum for the stellar luminosity in solar luminosities

• key mact, mtip, smass for respectively the current stellar mass, the mass of that same star at tip of giant branch for its given age & metallicity and its stellar mass on zero-age main sequence, all in solar masses

• key mub, mudec, mul, mura for the astrometric proper motions, respectively in the direction of the galactic latitude, declination, galactic longitude and right ascension, all in milliarcseconds per year

• key parentid for the parent particle index as given as input

• key partid for the flag that identifies stars that are not central relatively to their parent particle

• key pi for the star parallax in milliarcseconds

• key px, py, pz for the star position cartesian coordinates in \(kpc\) relative to the Observer’s position

• key rad for the star distance to the Observer in \(kpc\)

• key satid for the index id the population the parent particle is part of

• key teff for the star effective temperature in Kelvin

• key vr for the star astrometric radial velocity in \(km.s^{-1}\)

• key vx, vy, vz for the star velocity cartesian coordinates in \(km.s^{-1}\) relative to the Observer’s velocity

Additionally, astrometric and photometric quantities X all have associated columns identified as:

• key {X}_Sig for the standard error on the quantity X

• key {X}_Err for the actual drawn gaussian error on the quantity X

Taking the photometry as an example of the latter, the standard errors are stored under gaia__dr2_g_Sig, gaia__dr2_gbp_Sig & gaia__dr2_grp_Sig, while the drawn errors are under gaia__dr2_g_Err, gaia__dr2_gbp_Err & gaia__dr2_grp_Err.

survey

#	A_0	A_gaia__dr2_g	A_gaia__dr2_gbp	A_gaia__dr2_grp	E(B-V)	age	alpha	calcium	carbon	dec	dec_Err	dec_Sig	dform	dmod	feh	gaia__dr2_g	gaia__dr2_g_Err	gaia__dr2_g_Intrinsic	gaia__dr2_g_Sig	gaia__dr2_gbp	gaia__dr2_gbp_Err	gaia__dr2_gbp_Intrinsic	gaia__dr2_gbp_Sig	gaia__dr2_grp	gaia__dr2_grp_Err	gaia__dr2_grp_Intrinsic	gaia__dr2_grp_Sig	glat	glon	grav	helium	log10_NH	lum	mact	magnesium	mtip	mub	mudec	mudec_Err	mudec_Sig	mul	mura	mura_Err	mura_Sig	neon	nitrogen	oxygen	parentid	partid	partitionid	pi	pi_Err	pi_Sig	px	py	pz	ra	ra_Err	ra_Sig	rad	satid	silicon	smass	sulphur	teff	vr	vr_Err	vr_Sig	vx	vy	vz
0	0.7093970129666665	0.5278885380814727	0.7125676091560126	0.4070167834122857	0.2288377461182795	10.016325950622559	0.3380742371082306	-1.1830222606658936	-0.39430123567581177	nan	nan	nan	0.0	20.87123488088669	-0.8867433071136475	nan	nan	7.6075797	nan	nan	nan	8.22037	nan	nan	nan	6.875088	nan	nan	nan	4.7529893	-0.7315406799316406	21.757467670308866	0.08502915	0.52380776	-0.5486690402030945	0.886202	nan	nan	nan	nan	nan	nan	nan	nan	-0.7326117157936096	-0.652482807636261	-0.6697278618812561	0	0	0	nan	nan	nan	-142.03525597960677	46.20841677042607	0.692591828190988	nan	nan	nan	149.36435788052748	0	-0.7563512325286865	0.5240775107307198	-1.0924330949783325	4399.992	nan	nan	nan	67.38685760498046	-300.3354850769043	55.13861343383789
1	0.3913526151493549	0.29144945079467655	0.3932110342103401	0.22456925568778976	0.12624277908043705	10.016325950622559	0.3380742371082306	-1.1830222606658936	-0.39430123567581177	nan	nan	nan	0.0	20.87527071994942	-0.8867433071136475	nan	nan	7.8151436	nan	nan	nan	8.465081	nan	nan	nan	7.0564466	nan	nan	nan	4.767861	-0.7315406799316406	21.499146555104666	0.07226164	0.507031	-0.5486690402030945	0.886202	nan	nan	nan	nan	nan	nan	nan	nan	-0.7326117157936096	-0.652482807636261	-0.6697278618812561	0	1	0	nan	nan	nan	-142.2608617629229	46.417971376138425	-0.11534282804241303	nan	nan	nan	149.64222051337467	0	-0.7563512325286865	0.5073366488986605	-1.0924330949783325	4295.4644	nan	nan	nan	67.7484200428451	-298.29957314526564	52.69162146715175
2	7.392986027528272	4.395135897711333	6.739848191949818	3.857969371581923	2.3848342024284745	10.016325950622559	0.3380742371082306	-1.1830222606658936	-0.39430123567581177	nan	nan	nan	0.0	20.888157433594138	-0.8867433071136475	nan	nan	8.512117	nan	nan	nan	9.277008	nan	nan	nan	7.679845	nan	nan	nan	4.8335814	-0.7315406799316406	22.775398200235458	0.040845018	0.44261116	-0.5486690402030945	0.886202	nan	nan	nan	nan	nan	nan	nan	nan	-0.7326117157936096	-0.652482807636261	-0.6697278618812561	0	1	0	nan	nan	nan	-142.9270461828407	47.20842184009032	1.8396875936103703	nan	nan	nan	150.5329202321734	0	-0.7563512325286865	0.4436048636953867	-1.0924330949783325	4001.0637	nan	nan	nan	68.03093236871236	-301.4758806839234	56.09200627357448
3	3.6129888513390713	2.281829762523366	3.403318153996309	1.9506143576453987	1.1654802746255069	10.016325950622559	0.3380742371082306	-1.1830222606658936	-0.39430123567581177	nan	nan	nan	0.0	20.867217518655195	-0.8867433071136475	nan	nan	9.037168	nan	nan	nan	9.901029	nan	nan	nan	8.152237	nan	nan	nan	4.8903975	-0.7315406799316406	22.464444936298012	0.027340515	0.39295405	-0.5486690402030945	0.886202	nan	nan	nan	nan	nan	nan	nan	nan	-0.7326117157936096	-0.652482807636261	-0.6697278618812561	0	1	0	nan	nan	nan	-141.293458764168	47.56378569643568	1.0770165239203284	nan	nan	nan	149.0882797670927	0	-0.7563512325286865	0.39350367992526536	-1.0924330949783325	3854.4998	nan	nan	nan	69.12724120992327	-301.73920387771557	55.1029961513569
4	0.7014795175813543	0.5867886042288581	0.7483665104609659	0.4149519539856739	0.22628371534882397	10.016325950622559	0.3380742371082306	-1.1830222606658936	-0.39430123567581177	nan	nan	nan	0.0	20.86868071849355	-0.8867433071136475	nan	nan	4.9383516	nan	nan	nan	5.201803	nan	nan	nan	4.5038996	nan	nan	nan	4.4819903	-0.7315406799316406	21.752593309473333	0.8118422	0.7637918	-0.5486690402030945	0.886202	nan	nan	nan	nan	nan	nan	nan	nan	-0.7326117157936096	-0.652482807636261	-0.6697278618812561	0	1	0	nan	nan	nan	-141.88055546200977	46.1152954631301	0.7600375956495637	nan	nan	nan	149.18877354213694	0	-0.7563512325286865	0.7644402589837288	-1.0924330949783325	6018.2197	nan	nan	nan	67.38594209547328	-300.6020691055117	52.577100775679746
...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...
1,614,158	14.060044512202722	8.423013661152801	12.868806573414634	7.057230806575605	4.535498229742814	9.99021053314209	0.7036365270614624	-0.8931915760040283	0.053123194724321365	nan	nan	nan	0.0	21.61548082188761	-0.8060703873634338	nan	nan	5.2621174	nan	nan	nan	5.553659	nan	nan	nan	4.7985764	nan	nan	nan	4.550951	-0.05126773566007614	23.054565010441443	0.59976685	0.74945873	-0.10243386775255203	0.92552537	nan	nan	nan	nan	nan	nan	nan	nan	-0.5620968341827393	0.0669776126742363	-1.2146226167678833	99999	1	0	nan	nan	nan	-186.47851700510245	97.15110580779618	8.11585399110565	nan	nan	nan	210.42443239820045	0	-1.247308373451233	0.7500223134586655	-0.9955946803092957	5835.22	nan	nan	nan	15.3421637420611	-165.14197870135874	-22.75520995737303
1,614,159	11.063923128969243	6.45510528739357	9.91050274374604	5.5781547672436895	3.5690074609578204	9.99021053314209	0.7036365270614624	-0.8931915760040283	0.053123194724321365	nan	nan	nan	0.0	21.61577240657062	-0.8060703873634338	nan	nan	7.930956	nan	nan	nan	8.61342	nan	nan	nan	7.150438	nan	nan	nan	4.7677984	-0.05126773566007614	22.9504874645149	0.066442534	0.5040816	-0.10243386775255203	0.92552537	nan	nan	nan	nan	nan	nan	nan	nan	-0.5620968341827393	0.0669776126742363	-1.2146226167678833	99999	1	0	nan	nan	nan	-186.1230486764739	97.82701074897133	8.855589130749117	nan	nan	nan	210.4526900268967	0	-1.247308373451233	0.504675216060176	-0.9955946803092957	4213.1426	nan	nan	nan	14.420329840561417	-164.29459688870557	-23.616658988980973
1,614,160	2.6202151095083157	1.9979343957376579	2.682412465734748	1.5085576559312066	0.8452306804865534	9.99021053314209	0.7036365270614624	-0.8931915760040283	0.053123194724321365	nan	nan	nan	0.0	21.60797143158025	-0.8060703873634338	nan	nan	5.420544	nan	nan	nan	5.727753	nan	nan	nan	4.9413347	nan	nan	nan	4.574493	-0.05126773566007614	22.32491526151538	0.51845455	0.7332436	-0.10243386775255203	0.92552537	nan	nan	nan	nan	nan	nan	nan	nan	-0.5620968341827393	0.0669776126742363	-1.2146226167678833	99999	1	0	nan	nan	nan	-185.41554070188917	97.54207904767259	8.937050140256147	nan	nan	nan	209.69799899838287	0	-1.247308373451233	0.7337202617485947	-0.9955946803092957	5735.347	nan	nan	nan	15.215907684749888	-163.1710353003309	-24.28579876779026
1,614,161	20.110530225320243	12.915669131356056	18.55864938118822	9.438526458834993	6.487267814619433	9.99021053314209	0.7036365270614624	-0.8931915760040283	0.053123194724321365	nan	nan	nan	0.0	21.62280870754291	-0.8060703873634338	nan	nan	4.007981	nan	nan	nan	4.2347775	nan	nan	nan	3.6183882	nan	nan	nan	4.2465305	-0.05126773566007614	23.210001836001144	1.9032125	0.86141604	-0.10243386775255203	0.92552537	nan	nan	nan	nan	nan	nan	nan	nan	-0.5620968341827393	0.0669776126742363	-1.2146226167678833	99999	1	0	nan	nan	nan	-187.148672847189	97.44088694333617	7.677616529567157	nan	nan	nan	211.1357335752129	0	-1.247308373451233	0.8632034883204436	-0.9955946803092957	6314.5522	nan	nan	nan	14.154347672917513	-163.58046604010096	-22.627405955186447
1,614,162	6.453998533061608	4.090151594340529	6.058586091870591	3.4826187148728667	2.0819350106650347	9.99021053314209	0.7036365270614624	-0.8931915760040283	0.053123194724321365	nan	nan	nan	0.0	21.61092186109904	-0.8060703873634338	nan	nan	-0.38972253	nan	nan	nan	0.14156544	nan	nan	nan	-1.0621885	nan	nan	nan	1.9115392	-0.05126773566007614	22.71640717719426	126.867645	0.918	-0.10243386775255203	0.92552537	nan	nan	nan	nan	nan	nan	nan	nan	-0.5620968341827393	0.0669776126742363	-1.2146226167678833	99999	1	0	nan	nan	nan	-185.7446220327249	97.5570866189969	8.628931734904032	nan	nan	nan	209.98311414623777	0	-1.247308373451233	0.9262041245678233	-0.9955946803092957	4627.436	nan	nan	nan	14.454929312951862	-163.59304101770525	-24.333362842441787

Please refer to vaex’s documentation for further help on how to use vaex dataframes: the following line for example isolate only the rows with non-NaN photometry.

survey[~survey.gaia__dr2_g.isna()]

#	A_0	A_gaia__dr2_g	A_gaia__dr2_gbp	A_gaia__dr2_grp	E(B-V)	age	alpha	calcium	carbon	dec	dec_Err	dec_Sig	dform	dmod	feh	gaia__dr2_g	gaia__dr2_g_Err	gaia__dr2_g_Intrinsic	gaia__dr2_g_Sig	gaia__dr2_gbp	gaia__dr2_gbp_Err	gaia__dr2_gbp_Intrinsic	gaia__dr2_gbp_Sig	gaia__dr2_grp	gaia__dr2_grp_Err	gaia__dr2_grp_Intrinsic	gaia__dr2_grp_Sig	glat	glon	grav	helium	log10_NH	lum	mact	magnesium	mtip	mub	mudec	mudec_Err	mudec_Sig	mul	mura	mura_Err	mura_Sig	neon	nitrogen	oxygen	parentid	partid	partitionid	pi	pi_Err	pi_Sig	px	py	pz	ra	ra_Err	ra_Sig	rad	satid	silicon	smass	sulphur	teff	vr	vr_Err	vr_Sig	vx	vy	vz
0	0.05681650709265505	0.046713423918591325	0.05985558882052296	0.033535779349265264	0.018327905513759693	8.97172737121582	-0.6125200986862183	-0.12460324913263321	-0.36052706837654114	41.517887	-4.3651322762456503e-07	3.7339328e-07	0.0	20.938860082853388	-0.5348672270774841	20.610794	-0.013108958690914031	-0.36166972	0.014190837	20.934616	-0.09105875752639689	0.026959075	0.32711947	20.067835	0.010476073807142064	-0.9150356	0.32711947	-6.450095	159.08374	2.5680106	-0.6886086463928223	20.66105284593159	108.469864	2.1231031	-1.1473873853683472	1.9929105	1.9060571825344517	-0.49039800495707714	-0.15208820165614972	2.1212947	2.637362501364926	3.216868859449929	3.107170100412025	2.1212947	-0.44875627756118774	-1.4166113138198853	-0.40134233236312866	138	1	0	0.0047001384188920066	-0.0017896118250197454	1.3442158	-143.02405261900316	54.66209816691588	-17.31002173887193	64.385994	7.738775790567222e-07	3.7339328e-07	154.08913477650898	0	-0.4361392557621002	2.123614686399606	-1.2804145812988281	5266.821	nan	nan	nan	-13.980939858346646	-241.322783466562	-112.49946999755836
1	0.30908957284836286	0.22611708693766502	0.3084225987731178	0.17628026359430846	0.09970631382205253	10.069992065429688	0.5896989703178406	-0.9664415121078491	-0.9518471360206604	37.240967	-2.2831375342149955e-07	2.49317e-07	0.0	21.769605166840982	-0.801622748374939	20.222652	-0.013217448221518976	-1.7598503	0.011413363	21.307426	0.2680249694291372	-1.0386255	0.24083452	19.243824	-0.13966843269274323	-2.5623941	0.24083452	-0.91259795	169.44246	1.0347817	-0.32748517394065857	21.39666266920291	558.4033	0.8450456	-0.21192379295825958	0.86665446	-3.1047273926896426	-2.7124202720419555	-2.542487626107496	1.4928615	1.1050811506348799	-1.871713888922517	-2.04588855812214	1.4928615	-0.3413775563240051	-0.13905183970928192	-0.8814153671264648	212	1	0	-1.1660510794203147	-1.1704777679639904	0.89754117	-222.05011278974717	41.38527019482137	-3.5979765713472047	78.53204	4.2180988179474246e-07	2.49317e-07	225.90249802613025	0	-0.7138696312904358	0.8677262727803007	-1.077961802482605	4132.9897	nan	nan	nan	-64.76429401098572	-249.0524176755581	44.549935511279955
2	0.04065386377065892	0.031888683601719876	0.041802807229243184	0.02370060669920257	0.01311414960343836	9.613767623901367	-0.1432933509349823	-1.0196176767349243	-0.6505561470985413	27.468527	9.93141102529504e-07	5.270746e-07	0.0	21.241844522741097	-0.5965235829353333	20.921713	-0.029182178287689993	-0.3228382	0.01705969	21.876608	0.38537958340209455	0.20757976	0.4235812	21.28318	1.0115375512029108	-0.99390167	0.4235812	-8.830861	175.76826	2.0586061	-0.7592963576316833	20.51568014237017	118.69824	1.196	-0.7398169040679932	1.1982795	-1.6438476299687612	-2.044957683093608	-1.7305400665725954	2.8642974	1.322617557411089	-0.519326655124296	-0.5989357582041593	2.8642974	-1.3291157484054565	-0.7577531337738037	-0.45060980319976807	252	1	0	1.5601152190393899	1.554470646021109	1.8974684	-174.58395850876303	12.917886544408068	-27.19747265375267	75.42295	-1.738821925276305e-07	5.270746e-07	177.16131880327407	0	-0.6941993832588196	1.2002945213596574	-0.5894879698753357	4637.9014	nan	nan	nan	31.915626870159116	-254.29642034774957	-98.61775218664684
3	0.7877962999054843	0.572678183184173	0.7836102802989954	0.4485485017244638	0.2541278386791885	9.8711519241333	1.162867546081543	-0.7159809470176697	-0.6287623643875122	34.62386	6.854075293976649e-08	7.639342e-08	0.0	20.79343262014924	-1.236360788345337	19.04199	0.00854874852791074	-2.3326683	0.005850956	19.920134	-0.005622249308989237	-1.6512849	0.09372754	18.088743	-0.04331449085765518	-3.1099238	0.09372754	-14.482033	160.58708	0.94072235	0.7711513042449951	21.80299225153632	876.2868	0.92662406	-0.07349321991205215	0.95272523	0.054731965395575	-0.38297541218169917	-0.12157731062280257	0.53407407	0.6418210512826115	0.5179379203937898	0.16962703533504497	0.53407407	-0.9232337474822998	-0.6347827315330505	-1.0434234142303467	281	1	0	-0.24483446567030384	-0.25177373072009146	0.2750163	-131.59610686320974	46.37566245119917	-36.03787463886429	58.814594	3.7359391102072234e-08	7.639342e-08	144.1074800897836	0	0.010916919447481632	0.9538811072032849	-1.0917985439300537	4282.4487	nan	nan	nan	-43.91235726362427	-298.99747247914627	38.90182804530409
4	0.13204413245379218	0.10562465807915	0.13715348267910565	0.07738767519745388	0.04259488143670716	9.037848472595215	-0.20741142332553864	-0.2963399291038513	0.24989141523838043	27.754452	3.672289535219167e-07	4.3264754e-07	0.0	21.63436699581625	-0.9348768591880798	20.762663	-0.0013426168529036332	-0.9759861	0.015354784	21.672022	0.4177469420941861	-0.51724565	0.36540693	20.407366	0.2875173851348014	-1.5919065	0.36540693	-6.714385	176.97495	2.1116366	-0.6755844354629517	21.02729742239088	203.31184	1.8348202	-1.142288327217102	1.8366443	0.2197378023917316	-1.2259053978924448	-1.02247116836483	2.41159	1.66267235620017	1.144517339975177	1.067175358322312	2.41159	-0.6697758436203003	-0.6329840421676636	-1.5521866083145142	343	1	0	2.2433125652881225	2.238601418881787	1.5575311	-210.51297254829453	11.124849238363767	-24.81775149965351	78.14718	-7.645186432301977e-08	4.3264754e-07	212.26256069122005	0	-0.3810194134712219	1.8352900976292204	-0.6407454609870911	4914.3687	nan	nan	nan	-8.48732751191461	-211.68435438026214	-55.59752034953253
...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...	...
1,164	0.019025284676617567	0.01511721103115259	0.019686932095393826	0.011131666999151546	0.006137188605360506	10.373172760009766	1.5368380546569824	-1.5263926982879639	-0.673753559589386	39.989857	-2.514573920310201e-07	4.0399456e-07	0.0	21.230698985230248	-1.2268792390823364	20.69277	-0.006136069764179247	-0.54691136	0.014802344	22.025711	0.8299667035764402	-0.054642305	0.3470864	20.100964	0.04999640531206987	-1.1908631	0.3470864	-10.55544	156.8341	1.8550684	-0.6782917976379395	20.185909478706613	141.69197	0.798	0.3099588453769684	0.80682814	1.8727959735562254	0.3528067027517523	0.5241191460758158	2.2718804	1.6571408570150306	2.4756833447558058	2.3005029186373935	2.2718804	-0.6692771315574646	0.04717090725898743	-1.0167276859283447	99731	1	0	-1.8038561145794871	-1.80952973403217	1.4543804	-159.30081213760621	68.16420594881328	-32.287480777554315	58.55993	-8.166342547243272e-07	4.0399456e-07	176.2543308270582	0	-0.643153190612793	0.8070930497545803	-0.7373723983764648	4771.282	nan	nan	nan	78.74606945448743	-255.83754148145218	17.808940561402192
1,165	0.11785906487249849	0.08847483112602038	0.11882245467275085	0.06779467873028416	0.03801905318467693	9.395322799682617	-0.3845840394496918	-0.28358957171440125	-0.48085200786590576	34.802338	9.918108029871799e-08	1.2833371e-07	0.0	21.730687168195804	-0.7610273361206055	19.584963	0.0065751865905664285	-2.2407725	0.007908253	20.062742	-0.20591638105879556	-1.5808507	0.1435723	19.184309	0.3899514815920368	-3.0041256	0.1435723	-11.4430685	163.64268	1.1658815	-0.9921388030052185	20.977941305794037	803.1406	1.433	-1.1456114053726196	1.4167645	-0.7985102470481145	-1.2350411854691319	-1.0666535865725877	0.83854187	0.9481371511247441	0.10609397613329813	-0.014613976378601738	0.83854187	-0.9093115329742432	-0.06070816144347191	-0.573256254196167	99823	1	0	0.6270305330302727	0.6225237923805556	0.46200135	-208.67652152432524	61.24792880191641	-44.021647514337545	63.986168	-1.9273868544824463e-07	1.2833371e-07	221.88984850121776	0	-0.5603996515274048	1.446258238190986	-0.6158600449562073	4276.7935	nan	nan	nan	6.244157910757682	-225.91754656015348	-22.142693836095198
1,166	1.9178776046340098	1.3702206129213481	1.8937630206087204	1.085983320180919	0.618670195043229	9.400785446166992	0.5861782431602478	-0.661990225315094	-0.446218341588974	28.715738	-4.908052626167452e-07	4.5137742e-07	0.0	21.56765254830313	-1.0741389989852905	20.798689	-0.005518799886512156	-2.133665	0.015706312	22.023201	0.09706545298345842	-1.5352793	0.3772023	20.511465	0.7137742476844009	-2.8559453	0.3772023	-10.957019	172.46034	1.279352	-0.9261223077774048	22.18939920269422	671.83466	1.323	-0.4879607856273651	1.3253865	5.462758179344159	5.667542559168328	5.871416168223197	2.502292	-2.843550123947125	2.409661008791584	2.2750541663028017	2.502292	0.23867693543434143	-1.0438926219940186	-1.0675371885299683	99881	1	0	-1.883078373748392	-1.8879365077565704	1.6249586	-200.3407015330409	26.516403301143548	-39.12458260932041	71.24494	1.7179552430969074e-07	4.5137742e-07	205.84034905511945	0	-0.30648577213287354	1.3302323661360405	0.5969148278236389	4453.5386	nan	nan	nan	45.99363716354691	-245.2196565089809	-10.463755036288688
1,167	0.3890935817655473	0.3459109855134188	0.42844236806758407	0.2332652879275749	0.12551405863404752	8.76700210571289	1.2602565288543701	-0.6482102274894714	-0.646274745464325	18.708971	-1.1252965856256632e-07	4.4515681e-07	0.0	21.967123504012505	-1.1567636728286743	20.788153	-0.0028946091431594823	-1.521986	0.015590355	20.725286	-0.3056262783830847	-1.3646538	0.3733	20.2418	-0.16204777931782613	-1.7965397	0.3733	-19.303923	178.78328	2.6245642	-0.3065233826637268	21.496632381861513	296.85895	2.3255537	0.10349282622337341	2.2348108	-0.9703733499833618	-1.8985779016318194	-1.6164166274595297	2.4722178	1.6569354981820585	0.2871613865872235	0.15742234829525623	2.4722178	-0.09991137683391571	0.01162821426987648	-0.6298919320106506	99944	1	0	-1.469024973955347	-1.4730667784191478	1.6025645	-233.45155866798228	4.958240307345907	-81.78993982121428	68.41039	-8.61161514396646e-07	4.4515681e-07	247.41424503737375	0	-0.13593457639217377	2.32588572372793	-0.7227007746696472	6840.3525	nan	nan	nan	65.61290171740593	-354.48857930707965	-69.47010348297734
1,168	0.13128025060982543	0.10877511186828855	0.13892906409656194	0.07761901232932818	0.042348467938653364	8.829378128051758	0.945320188999176	-1.3487151861190796	-0.32563573122024536	35.68073	-6.829164901717445e-08	5.0387865e-07	0.0	21.449059479615702	-1.5585298538208008	20.904022	-0.004349176003901913	-0.6494634	0.01665563	21.971952	0.678119222946501	-0.29415557	0.40957612	20.778925	0.42905685318463965	-1.1768098	0.40957612	-13.799286	159.73665	2.465999	-0.06979773193597794	21.024777711937954	144.35234	2.104846	-0.6132096648216248	2.0921621	-2.4980094064001293	-2.2022274170596026	-1.9733394462256058	2.7541013	0.4840052154049758	-1.2745613005915613	-1.501391448026907	2.7541013	-0.40418189764022827	-0.7111912369728088	-0.6041487455368042	99991	1	0	-0.46944864982128426	-0.4745794854764945	1.8139632	-177.56058760928534	65.5525804310451	-46.48781414288353	58.605503	4.792514094889688e-07	5.0387865e-07	194.90002549283213	0	-0.5130423903465271	2.1051179373093634	-0.10513915121555328	5345.2173	nan	nan	nan	-31.301481977818145	-304.94776329404436	-3.899390631479074