Open clusters are key targets for both Galaxy structure and evolution and stellar physics studies. Since \textit{Gaia} DR2 publication, the discovery of undetected clusters has proven that our samples were not complete. Our aim is to exploit the Big Data capabilities of machine learning to detect new open clusters in \textit{Gaia} DR2, and to complete the open cluster sample to enable further studies on the Galactic disc. We use a machine learning based methodology to systematically search in the Galactic disc, looking for overdensities in the astrometric space and identifying them as open clusters using photometric information. First, we use an unsupervised clustering algorithm, DBSCAN, to blindly search for these overdensities in \textit{Gaia} DR2 $(l,b,\varpi,\mu_{\alpha^*},\mu_\delta)$. After that, we use a deep learning artificial neural network trained on colour-magnitude diagrams to identify isochrone patterns in these overdensities, and to confirm them as open clusters. We find $582$ new open clusters distributed along the Galactic disc, in the region $|b| < 20$. We can detect substructure in complex regions, and identify the tidal tails of a disrupting cluster UBC~$274$ of $\sim 3$ Gyr located at $\sim 2$ kpc. Adapting the methodology into a Big Data environment allows us to target the search driven by physical properties of the open clusters, instead of being driven by its computational requirements. This blind search for open clusters in the Galactic disc increases in a $45\%$ the number of known open clusters.

The Gaia Data Release 2 (DR2) provided an unprecedented volume of precise astrometric and excellent photometric data. In terms of data mining the Gaia catalogue, machine learning methods have shown to be a powerful tool, for instance in the search for unknown stellar structures. Particularly, supervised and unsupervised learning methods combined together significantly improves the detection rate of open clusters. We systematically scan Gaia DR2 in a region covering the Galactic anticentre and the Perseus arm $(120 \leq l \leq 205$ and $-10 \leq b \leq 10)$, with the goal of finding any open clusters that may exist in this region, and fine tuning a previously proposed methodology successfully applied to TGAS data, adapting it to different density regions. Our methodology uses an unsupervised, density-based, clustering algorithm, DBSCAN, that identifies overdensities in the five-dimensional astrometric parameter space $(l,b,\varpi,\mu_{\alpha^*},\mu_{\delta})$ that may correspond to physical clusters. The overdensities are separated into physical clusters (open clusters) or random statistical clusters using an artificial neural network to recognise the isochrone pattern that open clusters show in a colour magnitude diagram. The method is able to recover more than 75% of the open clusters confirmed in the search area. Moreover, we detected 53 open clusters unknown previous to Gaia DR2, which represents an increase of more than 22% with respect to the already catalogued clusters in this region. We find that the census of nearby open clusters is not complete. Different machine learning methodologies for a blind search of open clusters are complementary to each other; no single method is able to detect 100% of the existing groups. Our methodology has shown to be a reliable tool for the automatic detection of open clusters, designed to be applied to the full Gaia DR2 catalogue.

We use Gaia DR2 magnitudes, colours and parallaxes for stars with G<12 to explore a 15-dimensional space that includes simultaneously the initial mass function (IMF) and a non-parametric star formation history (SFH) for the Galactic disc. This inference is performed by combining the Besancon Galaxy Model fast approximate simulations (BGM FASt) and an approximate Bayesian computation algorithm. We find in Gaia DR2 data an imprint of a star formation burst 2-3 Gyr ago, in the Galactic thin disc domain, and a present star formation rate (SFR) of about 1 Msun. Our results show a decreasing trend of the SFR from 9-10 Gyr to 6-7 Gyr ago. This is consistent with the cosmological star formation quenching observed at redshifts z<1.8. This decreasing trend is followed by a SFR enhancement starting at about 5 Gyr ago and continuing until about 1 Gyr ago which is detected with high statistical significance by discarding the null hypothesis of an exponential SFH with a p-value=0.002. We estimate, from our best fit model, that about the 50% of the mass used to generate stars, along the thin disc life, was expended in the period from 5 to 1 Gyr ago. The timescale and the amount of stellar mass generated during the SFR enhancement event lead us to hypothesise that its origin, currently under investigation, is not intrinsic to the disc. Thus, an external perturbation is needed for its explanation. Additionally we find, for the thin disc, a slope of the IMF of $\alpha_3 \approx 2$ for masses M>1.53 Msun and $\alpha_2 \approx 1.3$ for the mass range between 0,5 and 1,53 Msun. This is the first time that we consider a non-parametric SFH for the thin disc in the Besancon Galaxy Model. This new step, together with the capabilities of the Gaia DR2 parallaxes to break degeneracies between different stellar populations, allow us to better constrain the SFH and the IMF.

We highlight the power of the Gaia DR2 in studying many fine structures of the Hertzsprung-Russell diagram (HRD). Gaia allows us to present many different HRDs, depending in particular on stellar population selections. We do not aim here for completeness in terms of types of stars or stellar evolutionary aspects. Instead, we have chosen several illustrative examples. We describe some of the selections that can be made in Gaia DR2 to highlight the main structures of the Gaia HRDs. We select both field and cluster (open and globular) stars, compare the observations with previous classifications and with stellar evolutionary tracks, and we present variations of the Gaia HRD with age, metallicity, and kinematics. Late stages of stellar evolution such as hot subdwarfs, post-AGB stars, planetary nebulae, and white dwarfs are also analysed, as well as low-mass brown dwarf objects. The Gaia HRDs are unprecedented in both precision and coverage of the various Milky Way stellar populations and stellar evolutionary phases. Many fine structures of the HRDs are presented. The clear split of the white dwarf sequence into hydrogen and helium white dwarfs is presented for the first time in an HRD. The relation between kinematics and the HRD is nicely illustrated. Two different populations in a classical kinematic selection of the halo are unambiguously identified in the HRD. Membership and mean parameters for a selected list of open clusters are provided. They allow drawing very detailed cluster sequences, highlighting fine structures, and providing extremely precise empirical isochrones that will lead to more insight in stellar physics. Gaia DR2 demonstrates the potential of combining precise astrometry and photometry for large samples for studies in stellar evolution and stellar population and opens an entire new area for HRD-based studies.

The publication of the Gaia Data Release 2 (Gaia DR2) opens a new era in Astronomy. It includes precise astrometric data (positions, proper motions and parallaxes) for more than $1.3$ billion sources, mostly stars. To analyse such a vast amount of new data, the use of data mining techniques and machine learning algorithms are mandatory. The search for Open Clusters, groups of stars that were born and move together, located in the disk, is a great example for the application of these techniques. Our aim is to develop a method to automatically explore the data space, requiring minimal manual intervention. We explore the performance of a density based clustering algorithm, DBSCAN, to find clusters in the data together with a supervised learning method such as an Artificial Neural Network (ANN) to automatically distinguish between real Open Clusters and statistical clusters. The development and implementation of this method to a $5$-Dimensional space ($l$, $b$, $\varpi$, $\mu_{\alpha^*}$, $\mu_\delta$) to the Tycho-Gaia Astrometric Solution (TGAS) data, and a posterior validation using Gaia DR2 data, lead to the proposal of a set of new nearby Open Clusters. We have developed a method to find OCs in astrometric data, designed to be applied to the full Gaia DR2 archive.

The second Gaia data release (GDR2) provides precise five-parameter astrometric data (positions, proper motions and parallaxes) for an unprecedented amount of sources (more than $1.3$ billion, mostly stars). The use of this wealth of astrometric data comes with a specific challenge: how does one properly infer from these data the astrophysical parameters of interest? The main - but not only - focus of this paper is the issue of the estimation of distances from parallaxes, possibly combined with other information. We start with a critical review of the methods traditionally used to obtain distances from parallaxes and their shortcomings. Then we provide guidelines on how to use parallaxes more efficiently to estimate distances by using Bayesian methods. In particular also we show that negative parallaxes, or parallaxes with relatively larger uncertainties still contain valuable information. Finally, we provide examples that show more generally how to use astrometric data for parameter estimation, including the combination of proper motions and parallaxes and the handling of covariances in the uncertainties. The paper contains examples based on simulated Gaia data to illustrate the problems and the solutions proposed. Furthermore, the developments and methods proposed in the paper are linked to a set of tutorials included in the Gaia archive documentation that provide practical examples and a good starting point for the application of the recommendations to actual problems. In all cases the source code for the analysis methods is provided. Our main recommendation is to always treat the derivation of (astro-) physical parameters from astrometric data, in particular when parallaxes are involved, as an inference problem which should preferably be handled with a full Bayesian approach.

The European Space Agency Gaia satellite was launched into orbit around L2 in December 2013. This ambitious mission has strict requirements on residual systematic errors resulting from instrumental corrections in order to meet a design goal of sub-10 microarcsecond astrometry. During the design and build phase of the science instruments, various critical calibrations were studied in detail to ensure that this goal could be met in orbit. In particular, it was determined that the video-chain offsets on the analogue side of the analogue-to-digital conversion electronics exhibited instabilities that could not be mitigated fully by modifications to the flight hardware. We provide a detailed description of the behaviour of the electronic offset levels on microsecond timescales, identifying various systematic effects that are known collectively as offset non-uniformities. The effects manifest themselves as transient perturbations on the gross zero-point electronic offset level that is routinely monitored as part of the overall calibration process. Using in-orbit special calibration sequences along with simple parametric models, we show how the effects can be calibrated, and how these calibrations are applied to the science data. While the calibration part of the process is relatively straightforward, the application of the calibrations during science data processing requires a detailed on-ground reconstruction of the readout timing of each charge-coupled device (CCD) sample on each device in order to predict correctly the highly time-dependent nature of the corrections. We demonstrate the effectiveness of our offset non-uniformity models in mitigating the effects in Gaia data. We demonstrate for all CCDs and operating instrument and modes on board Gaia that the video-chain noise-limited performance is recovered in the vast majority of science samples.

The second Gaia data release (DR2), contains very precise astrometric and photometric properties for more than one billion sources, astrophysical parameters for dozens of millions, radial velocities for millions, variability information for half a million of stellar sources and orbits for thousands of solar system objects. Before the Catalogue publication, these data have undergone dedicated validation processes. The goal of this paper is to describe the validation results in terms of completeness, accuracy and precision of the various Gaia DR2 data. The validation processes include a systematic analysis of the Catalogue content to detect anomalies, either individual errors or statistical properties, using statistical analysis, and comparisons to external data or to models. Although the astrometric, photometric and spectroscopic data are of unprecedented quality and quantity, it is shown that the data cannot be used without a dedicated attention to the limitations described here, in the Catalogue documentation and in accompanying papers. A particular emphasis is put on the caveats for the statistical use of the data in scientific exploitation.

Context: The first Gaia data release (DR1) delivered a catalogue of astrometry and photometry for over a billion astronomical sources. Within the panoply of methods used for data exploration, visualisation is often the starting point and even the guiding reference for scientific thought. However, this is a volume of data that cannot be efficiently explored using traditional tools, techniques, and habits. Aims: We aim to provide a global visual exploration service for the Gaia archive, something that is not possible out of the box for most people. The service has two main goals. The first is to provide a software platform for interactive visual exploration of the archive contents, using common personal computers and mobile devices available to most users. The second aim is to produce intelligible and appealing visual representations of the enormous information content of the archive. Methods: The interactive exploration service follows a client-server design. The server runs close to the data, at the archive, and is responsible for hiding as far as possible the complexity and volume of the Gaia data from the client. This is achieved by serving visual detail on demand. Levels of detail are pre-computed using data aggregation and subsampling techniques. For DR1, the client is a web application that provides an interactive multi-panel visualisation workspace as well as a graphical user interface. Results: The Gaia archive Visualisation Service offers a web-based multi-panel interactive visualisation desktop in a browser tab. It currently provides highly configurable 1D histograms and 2D scatter plots of Gaia DR1 and the Tycho-Gaia Astrometric Solution (TGAS) with linked views. An innovative feature is the creation of ADQL queries from visually defined regions in plots. [abridged]

In the context of the ESA M5 (medium mission) call we proposed a new satellite mission, Theia, based on relative astrometry and extreme precision to study the motion of very faint objects in the Universe. Theia is primarily designed to study the local dark matter properties, the existence of Earth-like exoplanets in our nearest star systems and the physics of compact objects. Furthermore, about 15 $\%$ of the mission time was dedicated to an open observatory for the wider community to propose complementary science cases. With its unique metrology system and "point and stare" strategy, Theia's precision would have reached the sub micro-arcsecond level. This is about 1000 times better than ESA/Gaia's accuracy for the brightest objects and represents a factor 10-30 improvement for the faintest stars (depending on the exact observational program). In the version submitted to ESA, we proposed an optical (350-1000nm) on-axis TMA telescope. Due to ESA Technology readiness level, the camera's focal plane would have been made of CCD detectors but we anticipated an upgrade with CMOS detectors. Photometric measurements would have been performed during slew time and stabilisation phases needed for reaching the required astrometric precision.

Parallaxes for 331 classical Cepheids, 31 Type II Cepheids and 364 RR Lyrae stars in common between Gaia and the Hipparcos and Tycho-2 catalogues are published in Gaia Data Release 1 (DR1) as part of the Tycho-Gaia Astrometric Solution (TGAS). In order to test these first parallax measurements of the primary standard candles of the cosmological distance ladder, that involve astrometry collected by Gaia during the initial 14 months of science operation, we compared them with literature estimates and derived new period-luminosity ($PL$), period-Wesenheit ($PW$) relations for classical and Type II Cepheids and infrared $PL$, $PL$-metallicity ($PLZ$) and optical luminosity-metallicity ($M_V$-[Fe/H]) relations for the RR Lyrae stars, with zero points based on TGAS. The new relations were computed using multi-band ($V,I,J,K_{\mathrm{s}},W_{1}$) photometry and spectroscopic metal abundances available in the literature, and applying three alternative approaches: (i) by linear least squares fitting the absolute magnitudes inferred from direct transformation of the TGAS parallaxes, (ii) by adopting astrometric-based luminosities, and (iii) using a Bayesian fitting approach. TGAS parallaxes bring a significant added value to the previous Hipparcos estimates. The relations presented in this paper represent first Gaia-calibrated relations and form a "work-in-progress" milestone report in the wait for Gaia-only parallaxes of which a first solution will become available with Gaia's Data Release 2 (DR2) in 2018.

Gaia Data Release 1 contains parallaxes for more than 700 Galactic Cepheids and RR Lyrae stars, computed as part of the Tycho-Gaia Astrometric Solution (TGAS). We have used TGAS parallaxes, along with literature ($V, I, J, {K_\mathrm{s}}, W_1$) photometry and spectroscopy, to calibrate the zero point of the Period-Luminosity and Period-Wesenheit relations of classical and type II Cepheids, and the near-infrared Period-Luminosity, Period-Luminosity-Metallicity and optical Luminosity-Metallicity relations of RR Lyrae stars. In this contribution we briefly summarise results obtained by fitting these basic relations adopting different techniques that operate either in parallax or distance (absolute magnitude) space.

Context. The first Gaia Data Release contains the Tycho-Gaia Astrometric Solution (TGAS). This is a subset of about 2 million stars for which, besides the position and photometry, the proper motion and parallax are calculated using Hipparcos and Tycho-2 positions in 1991.25 as prior information. Aims. We investigate the scientific potential and limitations of the TGAS component by means of the astrometric data for open clusters. Methods. Mean cluster parallax and proper motion values are derived taking into account the error correlations within the astrometric solutions for individual stars, an estimate of the internal velocity dispersion in the cluster, and, where relevant, the effects of the depth of the cluster along the line of sight. Internal consistency of the TGAS data is assessed. Results. Values given for standard uncertainties are still inaccurate and may lead to unrealistic unit-weight standard deviations of least squares solutions for cluster parameters. Reconstructed mean cluster parallax and proper motion values are generally in very good agreement with earlier Hipparcos-based determination, although the Gaia mean parallax for the Pleiades is a significant exception. We have no current explanation for that discrepancy. Most clusters are observed to extend to nearly 15 pc from the cluster centre, and it will be up to future Gaia releases to establish whether those potential cluster-member stars are still dynamically bound to the clusters. Conclusions. The Gaia DR1 provides the means to examine open clusters far beyond their more easily visible cores, and can provide membership assessments based on proper motions and parallaxes. A combined HR diagram shows the same features as observed before using the Hipparcos data, with clearly increased luminosities for older A and F dwarfs.

Before the publication of the Gaia Catalogue, the contents of the first data release have undergone multiple dedicated validation tests. These tests aim at analysing in-depth the Catalogue content to detect anomalies, individual problems in specific objects or in overall statistical properties, either to filter them before the public release, or to describe the different caveats of the release for an optimal exploitation of the data. Dedicated methods using either Gaia internal data, external catalogues or models have been developed for the validation processes. They are testing normal stars as well as various populations like open or globular clusters, double stars, variable stars, quasars. Properties of coverage, accuracy and precision of the data are provided by the numerous tests presented here and jointly analysed to assess the data release content. This independent validation confirms the quality of the published data, Gaia DR1 being the most precise all-sky astrometric and photometric catalogue to-date. However, several limitations in terms of completeness, astrometric and photometric quality are identified and described. Figures describing the relevant properties of the release are shown and the testing activities carried out validating the user interfaces are also described. A particular emphasis is made on the statistical use of the data in scientific exploitation.

We present results of the analysis of 70 RR Lyrae stars located in the bar of the Large Magellanic Cloud (LMC). Combining spectroscopically determined metallicity of these stars from the literature with precise periods from the OGLE III catalogue and multi-epoch $K_{\rm s}$ photometry from the VISTA survey of the Magellanic Clouds system (VMC), we derive a new near-infrared period-luminosity-metallicity (${\rm PL_{K_{\rm s}}Z}$) relation for RR Lyrae variables. In order to fit the relation we use a fitting method developed specifically for this study. The zero-point of the relation is estimated in two different ways: by assuming the value of the distance to the LMC and by using Hubble Space Telescope (HST) parallaxes of five RR Lyrae stars in the Milky Way (MW). The difference in distance moduli derived by applying these two approaches is $\sim0.2$ mag. To investigate this point further we derive the ${\rm PL_{K_{\rm s}}Z}$ relation based on 23 MW RR Lyrae stars which had been analysed in Baade-Wesselink studies. We compared the derived ${\rm PL_{K_{\rm s}}Z}$ relations for RR Lyrae stars in the MW and LMC. Slopes and zero-points are different, but still consistent within the errors. The shallow slope of the metallicity term is confirmed by both LMC and MW variables. The astrometric space mission Gaia is expected to provide a huge contribution to the determination of the RR Lyrae ${\rm PL_{K_{\rm s}}Z}$ relation, however, calculating an absolute magnitude from the trigonometric parallax of each star and fitting a ${\rm PL_{K_{\rm s}}Z}$ relation directly to period and absolute magnitude leads to biased results. We present a tool to achieve an unbiased solution by modelling the data and inferring the slope and zero-point of the relation via statistical methods.

Aims: An effort has been undertaken to simulate the expected Gaia Catalogue, including the effect of observational errors. A statistical analysis of this simulated Gaia data is performed in order to better understand what can be obtained from the Gaia astrometric mission. This catalogue is used in order to investigate the potential yield in astrometric, photometric and spectroscopic information, and the extent and effect of observational errors on the true Gaia Catalogue. This article is a follow-up to Robin et. al. (2012), where the expected Gaia Catalogue content was reviewed but without the simulation of observational errors. Methods: The Gaia Object Generator (GOG) catalogue is analysed using the Gaia Analysis Tool (GAT), producing a number of statistics on the catalogue. Results: A simulated catalogue of one billion objects is presented, with detailed information on the 523 million individual single stars it contains. Detailed information is provided for the expected errors in parallax, position, proper motion, radial velocity, photometry in the four Gaia bands, and physical parameter determination including temperature, metallicity and line of sight extinction.

An improved method for estimating distances to open clusters is presented and applied to Hipparcos data for the Pleiades and the Hyades. The method is applied in the context of the historic Pleiades distance problem, with a discussion of previous criticisms of Hipparcos parallaxes. This is followed by an outlook for Gaia, where the improved method could be especially useful. Based on maximum likelihood estimation, the method combines parallax, position, apparent magnitude, colour, proper motion, and radial velocity information to estimate the parameters describing an open cluster precisely and without bias. We find the distance to the Pleiades to be $120.3 \pm 1.5$ pc, in accordance with previously published work using the same dataset. We find that error correlations cannot be responsible for the still present discrepancy between Hipparcos and photometric methods. Additionally, the three-dimensional space velocity and physical structure of Pleiades is parametrised, where we find strong evidence of mass segregation. The distance to the Hyades is found to be $46.35\pm 0.35$ pc, also in accordance with previous results. Through the use of simulations, we confirm that the method is unbiased, so will be useful for accurate open cluster parameter estimation with Gaia at distances up to several thousand parsec.

Context. White dwarfs can be used to study the structure and evolution of the Galaxy by analysing their luminosity function and initial mass function. Among them, the very cool white dwarfs provide the information for the early ages of each population. Because white dwarfs are intrinsically faint only the nearby (about 20 pc) sample is reasonably complete. The Gaia space mission will drastically increase the sample of known white dwarfs through its 5-6 years survey of the whole sky up to magnitude V = 20-25. Aims. We provide a characterisation of Gaia photometry for white dwarfs to better prepare for the analysis of the scientific output of the mission. Transformations between some of the most common photometric systems and Gaia passbands are derived. We also give estimates of the number of white dwarfs of the different galactic populations that will be observed. Methods. Using synthetic spectral energy distributions and the most recent Gaia transmission curves, we computed colours of three different types of white dwarfs (pure hydrogen, pure helium, and mixed composition with H/He= 0.1). With these colours we derived transformations to other common photometric systems (Johnson-Cousins, Sloan Digital Sky Survey, and 2MASS). We also present numbers of white dwarfs predicted to be observed by Gaia. Results. We provide relationships and colour-colour diagrams among different photometric systems to allow the prediction and/or study of the Gaia white dwarf colours. We also include estimates of the number of sources expected in every galactic population and with a maximum parallax error. Gaia will increase the sample of known white dwarfs tenfold to about 200 000. Gaia will be able to observe thousands of very cool white dwarfs for the first time, which will greatly improve our understanding of these stars and early phases of star formation in our Galaxy.

The understanding of Galaxy evolution can be facilitated by the use of population synthesis models, which allows us to test hypotheses on the star formation history, star evolution, and chemical and dynamical evolution of the Galaxy. The new version of the Besancon Galaxy model (hereafter BGM) aims to provide a more flexible and powerful tool to investigate the initial mass function (IMF) and star formation rate (SFR) of the Galactic disc. We present a new strategy for the generation of thin disc stars, which assumes the IMF, SFR and evolutionary tracks as free parameters. We have updated most of the ingredients for the star count production and, for the first time, binary stars are generated in a consistent way. The local dynamical self-consistency is maintained in this new scheme. We then compare simulations from the new model with Tycho-2 data and the local luminosity function, as a first test to verify and constrain the new ingredients. The effects of changing thirteen different ingredients of the model are systematically studied. For the first time, a full sky comparison is performed between BGM and data. This strategy allows us to constrain the IMF slope at high masses, which is found to be close to 3.0 and excludes a shallower slope such as Salpeter's one. The SFR is found decreasing whatever IMF is assumed. The model is compatible with a local dark matter density of 0.011 Mo/pc^3 implying that there is no compelling evidence for the significant amount of dark matter in the disc. While the model is fitted to Tycho-2 data, which is a magnitude limited sample with V<11, we check that it is still consistent with fainter stars. The new model constitutes a new basis for further comparisons with large scale surveys and is being prepared to become a powerful tool for the analysis of the Gaia mission data.

Gaia will obtain astrometry and spectrophotometry for essentially all sources in the sky down to a broad band magnitude limit of G=20, an expected yield of 10^9 stars. Its main scientific objective is to reveal the formation and evolution of our Galaxy through chemo-dynamical analysis. In addition to inferring positions, parallaxes and proper motions from the astrometry, we must also infer the astrophysical parameters of the stars from the spectrophotometry, the BP/RP spectrum. Here we investigate the performance of three different algorithms (SVM, ILIUM, Aeneas) for estimating the effective temperature, line-of-sight interstellar extinction, metallicity and surface gravity of A-M stars over a wide range of these parameters and over the full magnitude range Gaia will observe (G=6-20mag). One of the algorithms, Aeneas, infers the posterior probability density function over all parameters, and can optionally take into account the parallax and the Hertzsprung-Russell diagram to improve the estimates. For all algorithms the accuracy of estimation depends on G and on the value of the parameters themselves, so a broad summary of performance is only approximate. For stars at G=15 with less than two magnitudes extinction, we expect to be able to estimate Teff to within 1%, logg to 0.1-0.2dex, and [Fe/H] (for FGKM stars) to 0.1-0.2dex, just using the BP/RP spectrum (mean absolute error statistics are quoted). Performance degrades at larger extinctions, but not always by a large amount. Extinction can be estimated to an accuracy of 0.05-0.2mag for stars across the full parameter range with a priori unknown extinction between 0 and 10mag. Performance degrades at fainter magnitudes, but even at G=19 we can estimate logg to better than 0.2dex for all spectral types, and [Fe/H] to within 0.35dex for FGKM stars, for extinctions below 1mag.

Hipparcos, the first ever experiment of global astrometry, was launched by ESA in 1989 and its results published in 1997 (Perryman et al., Astron. Astrophys. 323, L49, 1997; Perryman & ESA (eds), The Hipparcos and Tycho catalogues, ESA SP-1200, 1997). A new reduction was later performed using an improved satellite attitude reconstruction leading to an improved accuracy for stars brighter than 9th magnitude (van Leeuwen & Fantino, Astron. Astrophys. 439, 791, 2005; van Leeuwen, Astron. Astrophys. 474, 653, 2007). The Hipparcos Catalogue provided an extended dataset of very accurate astrometric data (positions, trigonometric parallaxes and proper motions), enlarging by two orders of magnitude the quantity and quality of distance determinations and luminosity calibrations. The availability of more than 20000 stars with a trigonometric parallax known to better than 10% opened the way to a drastic revision of our 3-D knowledge of the solar neighbourhood and to a renewal of the calibration of many distance indicators and age estimations. The prospects opened by Gaia, the next ESA cornerstone, planned for launch in June 2013 (Perryman et al., Astron. Astrophys. 369, 339, 2001), are still much more dramatic: a billion objects with systematic and quasi simultaneous astrometric, spectrophotometric and spectroscopic observations, about 150 million stars with expected distances to better than 10%, all over the Galaxy. All stellar distance indicators, in very large numbers, will be directly measured, providing a direct calibration of their luminosity and making possible detailed studies of the impacts of various effects linked to chemical element abundances, age or cluster membership. With the help of simulations of the data expected from Gaia, obtained from the mission simulator developed by DPAC, we will illustrate what Gaia can provide with some selected examples.

Context. This study has been developed in the framework of the computational simulations executed for the preparation of the ESA Gaia astrometric mission. Aims. We focus on describing the objects and characteristics that Gaia will potentially observe without taking into consideration instrumental effects (detection efficiency, observing errors). Methods. The theoretical Universe Model prepared for the Gaia simulation has been statistically analyzed at a given time. Ingredients of the model are described, giving most attention to the stellar content, the double and multiple stars, and variability. Results. In this simulation the errors have not been included yet. Hence we estimate the number of objects and their theoretical photometric, astrometric and spectroscopic characteristics in the case that they are perfectly detected. We show that Gaia will be able to potentially observe 1.1 billion of stars (single or part of multiple star systems) of which about 2% are variable stars, 3% have one or two exoplanets. At the extragalactic level, observations will be potentially composed by several millions of galaxies, half million to 1 million of quasars and about 50,000 supernovas that will occur during the 5 years of mission. The simulated catalogue will be made publicly available by the DPAC on the Gaia portal of the ESA web site http://www.rssd.esa.int/gaia/.

In recent years Java has matured to a stable easy-to-use language with the flexibility of an interpreter (for reflection etc.) but the performance and type checking of a compiled language. When we started using Java for astronomical applications around 1999 they were the first of their kind in astronomy. Now a great deal of astronomy software is written in Java as are many business applications. We discuss the current environment and trends concerning the language and present an actual example of scientific use of Java for high-performance distributed computing: ESA's mission Gaia. The Gaia scanning satellite will perform a galactic census of about 1000 million objects in our galaxy. The Gaia community has chosen to write its processing software in Java. We explore the manifold reasons for choosing Java for this large science collaboration. Gaia processing is numerically complex but highly distributable, some parts being embarrassingly parallel. We describe the Gaia processing architecture and its realisation in Java. We delve into the astrometric solution which is the most advanced and most complex part of the processing. The Gaia simulator is also written in Java and is the most mature code in the system. This has been successfully running since about 2005 on the supercomputer "Marenostrum" in Barcelona. We relate experiences of using Java on a large shared machine. Finally we discuss Java, including some of its problems, for scientific computing.

Gaia is an ambitious space astrometry mission of ESA with a main objective to map the sky in astrometry and photometry down to a magnitude 20 by the end of the next decade. While the mission is built and operated by ESA and an industrial consortium, the data processing is entrusted to a consortium formed by the scientific community, which was formed in 2006 and formally selected by ESA one year later. The satellite will downlink around 100 TB of raw telemetry data over a mission duration of 5 years from which a very complex iterative processing will lead to the final science output: astrometry with a final accuracy of a few tens of microarcseconds, epoch photometry in wide and narrow bands, radial velocity and spectra for the stars brighter than 17 mag. We discuss the general principles and main difficulties of this very large data processing and present the organisation of the European Consortium responsible for its design and implementation.

Gaia is ESA's ambitious space astrometry mission the main objective of which is to astrometrically and spectro-photometrically map 1000 Million celestial objects (mostly in our galaxy) with unprecedented accuracy. The announcement of opportunity for the data processing will be issued by ESA late in 2006. The Gaia Data Processing and Analysis Consortium (DPAC) has been formed recently and is preparing an answer. The satellite will downlink close to 100 TB of raw telemetry data over 5 years. To achieve its required accuracy of a few 10s of Microarcsecond astrometry, a highly involved processing of this data is required. In addition to the main astrometric instrument Gaia will host a Radial Velocity instrument, two low-resolution dispersers for multi-color photometry and two Star Mappers. Gaia is a flying Giga Pixel camera. The various instruments each require relatively complex processing while at the same time being interdependent. We describe the overall composition of the DPAC and the envisaged overall architecture of the Gaia data processing system. We shall delve further into the core processing - one of the nine, so-called, coordination units comprising the Gaia processing system.

The nature of the Hyades stream, or Hyades moving group, is a long-standing question of Galactic Astronomy. Is this stream caused by non-axisymmetric perturbations of the galactic potential, such as transient or quasi-stationary spiral waves, or by the on-going evaporation of the Hyades cluster? A simple observational test has been designed to answer that question. Using the Geneva-Copenhagen survey of F and G dwarfs, we compare the mass distribution and metallicity of the stream to those of field disk stars. If the Hyades stream is composed of stars trapped at resonance, its mass distribution should obey the present-day mass function (PDMF) of the disk, and its metallicity should reflect its origin in the inner regions of the Galaxy. On the other hand, if it is an evaporated cluster, we expect a different mass distribution, depending on the inital mass function (IMF) of the cluster, and on the proportion of evaporated stars as a function of mass. We find that extreme conditions have to be adopted for the selective evaporation and IMF of the cluster to make the observed mass ditribution of the stream only roughly consistent (at a one-sigma level) with the coeval evaporated cluster scenario. The observed mass distribution is in much better agreement with the PDMF of the field. We also note that the peculiar metallicity of the stream is inconsistent with that of a field population from the solar neighbourhood trapped in the primordial cluster during its formation process and subsequently evaporated. These observations thus favour a resonant origin for the Hyades stream.

Gaia is an ambitious space observatory devoted to obtain the largest and most precise astrometric catalogue of astronomical objects from our Galaxy and beyond. On-board processing and transmission of the huge amount of data generated by the instruments is one of its several technological challenges. The measurement time tags are critical for the scientific results of the mission, so they must be measured and transmitted with the highest precision - leading to an important telemetry channel occupation. In this paper we present the optimisation of time data, which has resulted in a useful software tool. We also present how time data is adapted to the Packet Telemetry standard. The several communication layers are illustrated and a method for coding and transmitting the relevant data is described as well. Although our work is focused on Gaia, the timing scheme and the corresponding tools can be applied to any other instrument or mission with similar operational principles.

Gaia will perform astrometric measurements with an unprecedented resolution. Consequently, the electronics of the Astro instrument must time tag every measurement with a precision of a few nanoseconds. Hence, it requires a high stability clock signal, for which a Rb-type spacecraft master clock has been baselined. The distribution of its signal and the generation of clock subproducts must maintain these high accuracy requirements. We have developed a software application to simulate generic clock frameworks. The most critical clock structures for Gaia have also been identified, and its master clock has been parameterised.

The Payload Data Handling System (PDHS) of Gaia is a technological challenge, since it will have to process a huge amount of data with limited resources. Its main tasks include the optimal codification of science data, its packetisation and its compression, before being stored on-board ready to be transmitted. Here we describe a set of proposals for its design, as well as some simulators developed to optimise and test these proposals.

The true nature of the Hyades and Sirius superclusters is still an open question. In this contribution, we confront Eggen's hypothesis that they are cluster remnants with the results of a kinematic analysis of more than 6000 K and M giants in the solar neighbourhood. This analysis includes new radial velocity data from a large survey performed with the Coravel spectrometer, complemented by Hipparcos parallaxes and Tycho-2 proper motions (Famaey et al. 2004). A maximum-likelihood method, based on a bayesian approach, has been applied to the data, in order to make full use of all the available data (including less precise parallaxes) and to derive the properties of the different kinematic subgroups. Two such subgroups can be identified with the Hyades and Sirius superclusters. Stars belonging to them span a very wide range of age, which is difficult to account for in Eggen's scenario. These groups are thus most probably "dynamical streams" related to the dynamical perturbation by spiral waves rather than to cluster remnants. In this scenario, the Hyades and Ursa Major clusters just happen to be in the Hyades and Sirius streams, which are purely dynamical features that have nothing to do with the remnants of more massive primordial clusters. This mechanism could be the key to understanding the presence of an old metal-rich population, and of many exoplanetary systems in our neighbourhood. Moreover, a strong spiral pattern seems to be needed in order to yield such prominent streams. Since spiral structure is usually baryonic, this would leave very little room for dark matter. This may be an indication that the era of the dark-matter paradigm explaining the dynamics of the Galaxy may come to an end, and is being superseded by modified gravity.

The availability of the Hipparcos Catalogue triggered many kinematic and dynamical studies of the solar neighbourhood. Nevertheless, those studies generally lacked the third component of the space velocities, i.e., the radial velocities. This work presents the kinematic analysis of 5952 K and 739 M giants in the solar neighbourhood which includes for the first time radial velocity data from a large survey performed with the CORAVEL spectrovelocimeter. It also uses proper motions from the Tycho-2 catalogue, which are expected to be more accurate than the Hipparcos ones. The UV-plane constructed from these data for the stars with precise parallaxes reveals a rich small-scale structure, with several clumps corresponding to the Hercules stream, the Sirius moving group, and the Hyades and Pleiades superclusters. A maximum-likelihood method, based on a bayesian approach, has been applied to the data, in order to make full use of all the available stars and to derive the kinematic properties of these subgroups. Isochrones in the Hertzsprung-Russell diagram reveal a very wide range of ages for stars belonging to these groups. These groups are most probably related to the dynamical perturbation by transient spiral waves rather than to cluster remnants. A possible explanation for the presence of young clusters in the same area of the UV-plane is that they have been put there by the spiral wave associated with their formation, while the kinematics of the older stars of our sample has also been disturbed by the same wave. The term "dynamical stream" for the kinematic groups is thus more appropriate than the traditional term "supercluster" since it involves stars of different ages, not born at the same place nor at the same time.

In a first paper, HIPPARCOS astrometric and kinematic data were used to calibrate both infrared K and IRAS luminosities at the same time as kinematic parameters of Long Period Variable stars (LPVs). Individual estimated absolute magnitudes and a probabilistic assignation to galactic populations were deduced from these calibrations for each LPV of our sample. Here we propose a scenario of simultaneous stellar and circumstellar evolution according to the galactic populations. The transitory states of S and Tc stars allow us to confirm the location of the first dredge-up at $M_{bol}=-3.5$. There is also evidence suggesting that a previous enrichment in s-elements from a more evolved companion may accelerate the evolution along the AGB. The possible evolution to OH LPVs is included in this scenario, and any of these stars may have a mass at the limit of the capability for a C enrichment up to C/O > 1. A list of bright massive LPVs with peculiar envelope and luminosity properties is proposed as Hot Bottom Burning candidates. The He-shell flash star, R Cen, is found to be exceptionally bright and could become, before leaving the AGB, a C-rich LPV brighter than the usual luminosity limit of carbon stars.

In this paper HIPPARCOS astrometric and kinematic data are used to calibrate both infrared luminosities and kinematical parameters of Long Period Variable stars (LPVs). Individual absolute K and IRAS 12 and 25 luminosities of 800 LPVs are determined and made available in electronic form. The estimated mean kinematics is analyzed in terms of galactic populations. LPVs are found to belong to galactic populations ranging from the thin disk to the extended disk. An age range and a lower limit of the initial mass is given for stars of each population. A difference of 1.3mag in K for the upper limit of the Asymptotic Giant Branch is found between the disk and old disk galactic populations, confirming its dependence on the mass in the main sequence. LPVs with a thin envelope are distinguished using the estimated mean IRAS luminosities. The level of attraction (in the classification sense) of each group for the usual classifying parameters of LPVs (variability and spectral types) is examined.

The GAIA astrometric mission has recently been approved as one of the next two `cornerstones' of ESA's science programme, with a launch date target of not later than mid-2012. GAIA will provide positional and radial velocity measurements with the accuracies needed to produce a stereoscopic and kinematic census of about one billion stars throughout our Galaxy (and into the Local Group), amounting to about 1 per cent of the Galactic stellar population. GAIA's main scientific goal is to clarify the origin and history of our Galaxy, from a quantitative census of the stellar populations. It will advance questions such as when the stars in our Galaxy formed, when and how it was assembled, and its distribution of dark matter. The survey aims for completeness to V=20 mag, with accuracies of about 10 microarcsec at 15 mag. Combined with astrophysical information for each star, provided by on-board multi-colour photometry and (limited) spectroscopy, these data will have the precision necessary to quantify the early formation, and subsequent dynamical, chemical and star formation evolution of our Galaxy. Additional products include detection and orbital classification of tens of thousands of extra-Solar planetary systems, and a comprehensive survey of some 10^5-10^6 minor bodies in our Solar System, through galaxies in the nearby Universe, to some 500,000 distant quasars. It will provide a number of stringent new tests of general relativity and cosmology. The complete satellite system was evaluated as part of a detailed technology study, including a detailed payload design, corresponding accuracy assesments, and results from a prototype data reduction development.

The kinematic and Period-Luminosity-Colour distribution of O-rich Long-Period Variable stars of the solar neighbourhood is interpreted in terms of pulsation modes, masses and metallicities. It is first shown that, because of input physics imperfections, the periods and mean colours derived from the existing linear and nonlinear nonadiabatic models must significantly depart from the actual behaviour of the stars. As a consequence systematic corrections have to be applied, as a first approximation, to our linear model grid. These free parameters, as well as the mixing length, are calibrated on the LPVs of the LMC and of some globular clusters, assuming a mean mass of one solar mass for the LMC Mira-like stars. Then, the masses and metallicities corresponding to the four kinematic/photometric populations of local LPVs are evaluated. The possibility of a varying mixing-length parameter is discussed and taken into account.

Two samples of O- and B-type stars and Cepheids with Hipparcos data have been used to characterize galactic rotation and spiral arm kinematics in the solar neighbourhood. An extensive set of simulations has been performed in order to assess the capabilities of the method and its sensitivity to sample errors and biases in the adopted parameters.

The ESA HIPPARCOS satellite has provided astrometry of unprecedented accuracy, allowing to reassess, improve and refine the pre-HIPPARCOS luminosity calibrations. We review the "classical" absolute magnitude calibrations with the Stroemgren-Crawford intermediate-band photometric system. A small zero point correction of about 2-4% seems necessary, as well as to refine the dependences on metallicity and projected rotational velocity. The need of a rigorous statistical treatment of the extremely precise HIPPARCOS to derive definite dependences of the luminosity on physical stellar parameters is emphasized.

The absolute K magnitudes and kinematic parameters of about 350 oxygen-rich Long-Period Variable stars are calibrated, by means of an up-to-date maximum-likelihood method, using Hipparcos parallaxes and proper motions together with radial velocities and, as additional data, periods and V-K colour indices. Four groups, differing by their kinematics and mean magnitudes, are found. For each of them, we also obtain the distributions of magnitude, period and de-reddened colour of the base population, as well as de-biased period-luminosity-colour relations and their two-dimensional projections. The SRa semiregulars do not seem to constitute a separate class of LPVs. The SRb appear to belong to two populations of different ages. In a PL diagram, they constitute two evolutionary sequences towards the Mira stage. The Miras of the disk appear to pulsate on a lower-order mode. The slopes of their de-biased PL and PC relations are found to be very different from the ones of the Oxygen Miras of the LMC. This suggests that a significant number of so-called Miras of the LMC are misclassified. This also suggests that the Miras of the LMC do not constitute a homogeneous group, but include a significant proportion of metal-deficient stars, suggesting a relatively smooth star formation history. As a consequence, one may not trivially transpose the LMC period-luminosity relation from one galaxy to the other.

The distance modulus of the Large Magellanic Cloud (LMC) is the first step on the determination of the cosmic distance scale. In this paper it is obtained from a new calibration of the classical Cepheid Period-Luminosity (PL) relation. Our new calibration is obtained by applying the LM method -- a parametric method designed to obtain luminosity calibrations from astrometric information -- to the Hipparcos data for Classical Cepheids. The resulting distance modulus is $18.35^{m}\pm 0.13$.

We first review the current knowledge of Hipparcos systematic and random errors, in particular small-scale correlations. Then, assuming Gaussian parallax errors and using examples from the recent Hipparcos literature, we show how random errors may be misinterpreted as systematic errors, or transformed into systematic errors. Finally we summarise how to get unbiased estimates of absolute magnitudes and distances, using either Bayesian or non-parametrical methods. These methods may be applied to get either mean quantities or individual estimates. In particular, we underline the notion of astrometry-based luminosity, which avoids the truncation biases and allows a full use of Hipparcos samples.

The LM method, designed to exploit the Hipparcos data to obtain luminosity calibrations, is applied to derive luminosity calibrations for RR Lyrae and classical Cepheids. From these calibrations the distance to the Large Magellanic Cloud (LMC) is estimated. The distance moduli provided by the two calibrations are in good agreement, giving a value of 18.3m, while several previous calibrations using Hipparcos data provided inconsistent results between both types of stars. This result suggests that the Hubble constant should have a value of H_0 = 79 km s-1 Mpc-1.

GAIA is a short-listed candidate for the ESA Cornerstone mission C5, meeting the ESA Survey Committee requirement for an observatory mission, dedicated to astrometry, providing 10 micro-arcsecond accuracy at 15th magnitude. The GAIA mission concept follows the dramatic success of the ESA HIPPARCOS mission, utilising a continuously scanning spacecraft, accurately measuring 1-D coordinates along great circles, in (at least) two simultaneous fields of view, separated by a known angle. These 1-D relative coordinates are later converted to the five astrometric parameters of position and motions in a global analysis. GAIA will provide precise astrometry and multi-colour photometry for all the one billion stars, quasars, and compact galaxies to I=20 on the sky. GAIA will additionally provide the sixth phase-space parameter, radial velocity, from a slitless spectroscopic survey of most stars brighter than about magnitude 17. The technical challenges are considerable, but achievable. The scientific returns are spectacular, with greatest impact in the study of stellar populations and dynamical structure of the galaxies of our Local Group, and in providing the first complete census of the stars and massive planets in the Solar neighbourhood. GAIA will revolutionise our knowledge of the origin and evolution of our Milky Way Galaxy, and of the distribution of planetary systems around other stars.

The application of the Stromgren photometric luminosity calibrations to different types of CP stars is reexamined in the light of the new Hipparcos data. A first attempt is made to use the LM statistical parallax method (Luri et al., 1996) -- based on the maximum likelihood principle -- to obtain a calibration of the absolute magnitude as a function of two Stromgren colour indices, thus reflecting effective temperature and evolution. Its application to a sample of Si stars and to a sample of normal main sequence stars in the same spectral range allows us to compare the calibrations obtained and to discuss the position of Si stars in the HR diagram. Additionally, a sample of bonafide, spectroscopically selected Am stars together with normal main sequence stars are used to derive a new absolute magnitude calibration for late A-type main sequence stars, taking into account the effects of evolution, metallicity and stellar rotation.

The position in the HR diagram and the kinematic characteristics of different kinds of CP stars of the upper main sequence are obtained using the LM method (Luri et al., 1996). Most of the CP stars are main sequence stars occupying the whole width of the sequence. From a kinematic point of view, they belong to the young disk population (ages < 1.5 Gyr). It has also been found that, on kinematic grounds, the behaviour of lambda Bootis stars is similar to the one observed for normal stars of the same spectral range. On the other hand, roAp and noAp stars show the same kinematic characteristics. The peculiar velocity distribution function has been decomposed into a sum of three dimensional gaussians and the presence of Pleiades, Sirius and Hyades moving groups has been clearly established. Finally, a small number of CP stars are found to be high-velocity objects.

HIPPARCOS astrometric and kinematical data of oxygen-rich Mira variables are used to calibrate absolute near-infrared magnitudes and kinematic parameters. Two sets of near-infrared magnitudes compiled from different authors are used: broad-band K and narrow-band photometric measurements at 1.04 micron (104 filter). Three distinct classes of stars with different kinematics and scale height have been identified. The two most significant groups present characteristics close to the ones usually assigned to extended/thick disk-halo population and old disk population respectively, and thus they might differ by their metallicity abundance. They exhibit different period distributions, as expected if these two groups actually correspond to populations of distinct initial masses, ages and metallicities. Two parallel period-luminosity relations are found in K as well as in 104, one for each significant population. The shift between these relations is interpreted as the consequence of the effects of metallicity abundance on the luminosity.

This contribution is intended as a `rough guide' to the Hipparcos Catalogue for the non-expert user. Some general aspects of the use of astrometric data are discussed as well as Hipparcos-specific applications. We discuss when and at what level one may expect systematic errors to occur in the Hipparcos Catalogue. Next we discuss the question of the interpretation of the measured parallaxes in terms of distances and luminosities of stars. What are the biases one should be aware of and how can these be corrected? When using the astrometric data to study the statistics of stars one should take the full covariance matrix of the errors on the astrometric parameters into account. We explain how to do this and discuss the specific case of a moving cluster. Finally, we address the question of the correlation of astrometric parameters over a given region of the sky. At present the Hipparcos Catalogue contains no identified systematic errors.