RR Lyrae stars are an important and widely used tracer of the most ancient populations of our Galaxy, mainly due to their standard candle nature. The availability of large scale surveys of variable stars is allowing us to trace the structure of our entire Galaxy, even in previously inaccessible areas like the Galactic disc. In this work we aim to provide an empirical assessment of the completeness of the three largest RR Lyrae catalogues available: Gaia DR2, PanSTARRS-1 and ASAS-SN-II. Using a joint probabilistic analysis of the three surveys we compute 2D and 3D completeness maps in each survey's full magnitude range. At the bright end (G<13) we find ASAS-SN-II and Gaia are near 100% complete in RRab at high latitude (|b|>20deg); ASAS-SN-II has the best completeness at low latitude for RRab and at all latitudes for RRc. At the faint end (G>13), Gaia DR2 is the most complete catalogue for both RR Lyrae types, at any latitude, with median completeness rates of 95% (RRab) and >85% (RRc) outside the ecliptic plane (|\beta|>25deg). We confirm a high and uniform completeness of PanSTARRS-1 RR Lyrae at 91% (RRab) and 82% (RRc) down to G~18, and provide the first estimate of its completeness at low galactic latitude (|b|<20deg) at an estimated median 65% (RRab) and 50-60% (RRc). Our results are publicly available as 2D and 3D completeness maps, and as functions to evaluate each survey's completeness versus distance or per line-of sight.

The ESA Gaia mission provides a unique time-domain survey for more than 1.6 billion sources with G ~ 21 mag. We showcase stellar variability across the Galactic colour-absolute magnitude diagram (CaMD), focusing on pulsating, eruptive, and cataclysmic variables, as well as on stars exhibiting variability due to rotation and eclipses. We illustrate the locations of variable star classes, variable object fractions, and typical variability amplitudes throughout the CaMD and illustrate how variability-related changes in colour and brightness induce `motions' using 22 months worth of calibrated photometric, spectro-photometric, and astrometric Gaia data of stars with significant parallax. To ensure a large variety of variable star classes to populate the CaMD, we crossmatch Gaia sources with known variable stars. We also used the statistics and variability detection modules of the Gaia variability pipeline. Corrections for interstellar extinction are not implemented in this article. Gaia enables the first investigation of Galactic variable star populations across the CaMD on a similar, if not larger, scale than previously done in the Magellanic Clouds. Despite observed colours not being reddening corrected, we clearly see distinct regions where variable stars occur and determine variable star fractions to within Gaia's current detection thresholds. Finally, we show the most complete description of variability-induced motion within the CaMD to date. Gaia enables novel insights into variability phenomena for an unprecedented number of stars, which will benefit the understanding of stellar astrophysics. The CaMD of Galactic variable stars provides crucial information on physical origins of variability in a way previously accessible only for Galactic star clusters or external galaxies.

Stellar variability studies are now reaching a completely new level thanks to ESA's Gaia mission, which enables us to locate many variable stars in the Hertzsprung-Russell diagram and determine the various instability strips/bands. Furthermore, this mission also allows us to detect, characterise and classify many millions of new variable stars thanks to its very unique nearly simultaneous multi-epoch survey with different instruments (photometer, spectro-photometer, radial velocity spectrometer). An overview of what can be found in literature in terms of mostly data products by the Gaia consortium is given. This concerns the various catalogues of variable stars derived from the Gaia time series and also the location and motion of variable stars in the observational Hertzsprung-Russell diagram. In addition, we provide a list of a few thousands of variable white dwarf candidates derived from the DR2 published data, among them probably many hundreds of new pulsating white dwarfs. On a very different topic, we also show how Gaia allows us to reveal the 3D structures of and around the Milky Way thanks to the RR Lyrae stars.

In astronomy, we are witnessing an enormous increase in the number of source detections, precision, and diversity of measurements. Additionally, multi-epoch data is becoming the norm, making time-series analyses an important aspect of current astronomy. The Gaia mission is an outstanding example of a multi-epoch survey that provides measurements in a large diversity of domains, with its broad-band photometry; spectrophotometry in blue and red (used to derive astrophysical parameters); spectroscopy (employed to infer radial velocities, v sin(i), and other astrophysical parameters); and its extremely precise astrometry. Most of all that information is provided for sources covering the entire sky. Here, we present several properties related to the Gaia time series, such as the time sampling; the different types of measurements; the Gaia G, G BP and G RP-band photometry; and Gaia-inspired studies using the CORrelation-RAdial-VELocities data to assess the potential of the information on the radial velocity, the FWHM, and the contrast of the cross-correlation function. We also present techniques (which are used or are under development) that optimize the extraction of astrophysical information from the different instruments of Gaia, such as the principal component analysis and the multi-response regression. The detailed understanding of the behavior of the observed phenomena in the various measurement domains can lead to richer and more precise characterization of the Gaia data, including the definition of more informative attributes that serve as input to (our) machine-learning algorithms.

More than half a million of the 1.69 billion sources in Gaia Data Release 2 (DR2) are published with photometric time series that exhibit light variations during the 22 months of observation. An all-sky classification of common high-amplitude pulsators (Cepheids, long-period variables, Delta Scuti / SX Phoenicis, and RR Lyrae stars) is provided for stars with brightness variations greater than 0.1 mag in G band. A semi-supervised classification approach was employed, firstly training multi-stage random forest classifiers with sources of known types in the literature, followed by a preliminary classification of the Gaia data and a second training phase that included a selection of the first classification results to improve the representation of some classes, before the improved classifiers were applied to the Gaia data. Dedicated validation classifiers were used to reduce the level of contamination in the published results. A relevant fraction of objects were not yet sufficiently sampled for reliable Fourier series decomposition, consequently classifiers were based on features derived from statistics of photometric time series in the G, BP, and RP bands, as well as from some astrometric parameters. The published classification results include 195,780 RR Lyrae stars, 150,757 long-period variables, 8550 Cepheids, and 8882 Delta Scuti / SX Phoenicis stars. All of these results represent candidates whose completeness and contamination are described as a function of variability type and classification reliability. Results are expressed in terms of class labels and classification scores, which are available in the vari_classifier_result table of the Gaia archive.

The Gaia second Data Release (DR2) presents a first mapping of full-sky RR Lyrae stars and Cepheids observed by the spacecraft during the initial 22 months of science operations. The Specific Object Study (SOS) pipeline, developed to validate and fully characterise Cepheids and RR Lyrae stars (SOS Cep&RRL) observed by Gaia, has been presented in the documentation and papers accompanying the Gaia first Data Release. Here we describe how the SOS pipeline was modified to allow for processing the Gaia multiband (G, G_BP and G_RP) time series photometry of all-sky candidate variables and produce specific results for confirmed RR Lyrae stars and Cepheids that are published in the DR2 catalogue. The SOS Cep&RRL processing uses tools such as the period-amplitude and the period-luminosity relations in the G band. For the analysis of the Gaia DR2 candidates we also used tools based on the G_BP and G_RP photometry, such as the period-Wesenheit relation in (G,G_RP). Multiband time series photometry and characterisation by the SOS Cep&RRL pipeline are published in Gaia DR2 for 150,359 such variables (9,575 classified as Cepheids and 140,784 as RR Lyrae stars) distributed all over the sky. The sample includes variables in 87 globular clusters and 14 dwarf galaxies. To the best of our knowledge, as of 25 April 2018, variability of 50,570 of these sources (350 Cepheids and 50,220 RR Lyrae stars) is not known in the literature, hence likely they are new discoveries by Gaia. An estimate of the interstellar absorption is published for 54,272 fundamental-mode RR Lyrae stars from a relation based on the G-band amplitude and the pulsation period. Metallicities derived from the Fourier parameters of the light curves are also released for 64,932 RR Lyrae stars and 3,738 fundamental-mode classical Cepheids with period shorter than 6.3 days.

The second data release of the Gaia mission includes an advance catalog of variable stars. The classification of these stars are based on sparse photometry from the first 22 months of the mission. We set out to investigate the purity and completeness of the all-sky Gaia classification results with the help of the continuous light curves of the observed targets from the Kepler and K2 missions, focusing specifically on RR Lyrae and Cepheid pulsators, outside the Galactic Bulge region. We crossmatched the Gaia identifications with the observations collected by the Kepler space telescope. We inspected the light curves visually, then calculated the relative Fourier coefficients and period ratios for the single- and double-mode K2 RR Lyrae stars to further classify them. We identified 1443 and 41 stars classified as RR Lyrae or Cepheid variables in Gaia DR2 in the targeted observations of the two missions and 263 more RR Lyre targets in the Full-Frame Images (FFI) of the original mission. We provide the crossmatch of these sources. We conclude that the RR Lyrae catalog has a completeness between 70-78%, and provide a purity estimate between 92-98% (targeted observations) with lower limits of 75% (FFI stars) and 51% (K2 worst-case scenario). The low number of Cepheids prevents us from drawing detailed conclusions but the purity of the DR2 sample is estimated to be around 66%.

The Gaia DR2 sample of short-timescale variable candidates results from the investigation of the first 22 months of Gaia photometry for a subsample of sources at the Gaia faint end. For this exercise, we limited ourselves to the case of suspected rapid periodic variability. Our study combines fast-variability detection through variogram analysis, high-frequency search by means of least-squares periodograms, and empirical selection based on the investigation of specific sources seen through the Gaia eyes (e.g. known variables or visually identified objects with peculiar features in their light curves). The progressive definition and validation of this selection criterion also benefited from supplementary ground-based photometric monitoring of a few preliminary candidates, performed at the Flemish Mercator telescope (Canary Islands, Spain) between August and November 2017. We publish a list of 3,018 short-timescale variable candidates, spread throughout the sky, with a false-positive rate up to 10-20% in the Magellanic Clouds, and a more significant but justifiable contamination from longer-period variables between 19% and 50%, depending on the area of the sky. Although its completeness is limited to about 0.05%, this first sample of Gaia short-timescale variables recovers some very interesting known short-period variables, such as post-common envelope binaries or cataclysmic variables, and brings to light some fascinating, newly discovered variable sources. In the perspective of future Gaia data releases, several improvements of the short-timescale variability processing are considered, by enhancing the existing variogram and period-search algorithms or by classifying the identified candidates. Nonetheless, the encouraging outcome of our Gaia DR2 analysis demonstrates the power of this mission for such fast-variability studies, and opens great perspectives for this domain of astrophysics.

We highlight the power of the Gaia DR2 in studying many fine structures of the Hertzsprung-Russell diagram (HRD). Gaia allows us to present many different HRDs, depending in particular on stellar population selections. We do not aim here for completeness in terms of types of stars or stellar evolutionary aspects. Instead, we have chosen several illustrative examples. We describe some of the selections that can be made in Gaia DR2 to highlight the main structures of the Gaia HRDs. We select both field and cluster (open and globular) stars, compare the observations with previous classifications and with stellar evolutionary tracks, and we present variations of the Gaia HRD with age, metallicity, and kinematics. Late stages of stellar evolution such as hot subdwarfs, post-AGB stars, planetary nebulae, and white dwarfs are also analysed, as well as low-mass brown dwarf objects. The Gaia HRDs are unprecedented in both precision and coverage of the various Milky Way stellar populations and stellar evolutionary phases. Many fine structures of the HRDs are presented. The clear split of the white dwarf sequence into hydrogen and helium white dwarfs is presented for the first time in an HRD. The relation between kinematics and the HRD is nicely illustrated. Two different populations in a classical kinematic selection of the halo are unambiguously identified in the HRD. Membership and mean parameters for a selected list of open clusters are provided. They allow drawing very detailed cluster sequences, highlighting fine structures, and providing extremely precise empirical isochrones that will lead to more insight in stellar physics. Gaia DR2 demonstrates the potential of combining precise astrometry and photometry for large samples for studies in stellar evolution and stellar population and opens an entire new area for HRD-based studies.

Gaia DR2 provides a unique all-sky catalogue of 550'737 variable stars, of which 151'761 are long-period variable (LPV) candidates with G variability amplitudes larger than 0.2 mag (5-95% quantile range). About one-fifth of the LPV candidates are Mira candidates, the majority of the rest are semi-regular variable candidates. For each source, G, BP , and RP photometric time-series are published, together with some LPV-specific attributes for the subset of 89'617 candidates with periods in G longer than 60 days. We describe this first Gaia catalogue of LPV candidates, and present various validation checks. Various samples of LPVs were used to validate the catalogue: a sample of well-studied very bright LPVs with light curves from the AAVSO that are partly contemporaneous with Gaia light curves, a sample of Gaia LPV candidates with good parallaxes, the ASAS_SN catalogue of LPVs, and the OGLE catalogues of LPVs towards the Magellanic Clouds and the Galactic bulge. The analyses of these samples show a good agreement between Gaia DR2 and literature periods. The same is globally true for bolometric corrections of M-type stars. The main contaminant of our DR2 catalogue comes from young stellar objects (YSOs) in the solar vicinity (within ~1 kpc), although their number in the whole catalogue is only at the percent level. A cautionary note is provided about parallax-dependent LPV attributes published in the catalogue. This first Gaia catalogue of LPVs approximately doubles the number of known LPVs with amplitudes larger than 0.2 mag, despite the conservative candidate selection criteria that prioritise low contamination over high completeness, and despite the limited DR2 time coverage compared to the long periods characteristic of LPVs. It also contains a small set of YSO candidates, which offers the serendipitous opportunity to study these objects at an early stage of the Gaia data releases.

The Gaia Data Release 2 (DR2): we summarise the processing and results of the identification of variable source candidates of RR Lyrae stars, Cepheids, long period variables (LPVs), rotation modulation (BY Dra-type) stars, delta Scuti & SX Phoenicis stars, and short-timescale variables. In this release we aim to provide useful but not necessarily complete samples of candidates. The processed Gaia data consist of the G, BP, and RP photometry during the first 22 months of operations as well as positions and parallaxes. Various methods from classical statistics, data mining and time series analysis were applied and tailored to the specific properties of Gaia data, as well as various visualisation tools. The DR2 variability release contains: 228'904 RR Lyrae stars, 11'438 Cepheids, 151'761 LPVs, 147'535 stars with rotation modulation, 8'882 delta Scuti & SX Phoenicis stars, and 3'018 short-timescale variables. These results are distributed over a classification and various Specific Object Studies (SOS) tables in the Gaia archive, along with the three-band time series and associated statistics for the underlying 550'737 unique sources. We estimate that about half of them are newly identified variables. The variability type completeness varies strongly as function of sky position due to the non-uniform sky coverage and intermediate calibration level of this data. The probabilistic and automated nature of this work implies certain completeness and contamination rates which are quantified so that users can anticipate their effects. This means that even well-known variable sources can be missed or misidentified in the published data. The DR2 variability release only represents a small subset of the processed data. Future releases will include more variable sources and data products; however, DR2 shows the (already) very high quality of the data and great promise for variability studies.

We present the methods devised to identify the BY Dra variables candidates in Gaia DR2 and infer their variability parameters. BY Dra candidates are pre-selected from their position in the HR diagram, built from Gaia parallaxes, $G$ magnitudes, and $(G_{BP} - G_{RP})$ colours. Since the time evolution of the stellar active region can disrupt the coherence of the signal, segments not much longer than their expected evolution timescale are extracted from the entire photometric time-series and period search algorithms are applied to each segment. For the Gaia DR2, we select sources having similar period in at least two segments as candidates BY Dra. Results are further filtered considering the time series phase coverage and the expected approximate light curve shape. Gaia DR2 includes rotational periods and modulation amplitudes of 147 535 BY Dra candidates. The data unveil the existence of two populations with distinctive period and amplitude distributions. The sample covers 38% of the whole sky when divided in bins (HEALPix) of $\approx$0.84 square degrees and we estimate that represents 0.7 -- 5 % of all BY Dra stars potentially detectable by Gaia. The preliminary data contained in Gaia DR2 illustrate the vast and unique information that the mission is going to provide on stellar rotation and magnetic activity. This information, complemented by Gaia exquisite parallaxes, proper motions, and astrophysical parameter, is opening new and unique perspectives for our understanding of the evolution of stellar angular momentum and dynamo action.

The second Gaia data release is expected to contain data products from about 22 months of observation. Based on these data, we aim to provide an advance publication of a full-sky Gaia map of RR Lyrae stars. Although comprehensive, these data still contain a significant fraction of sources which are insufficiently sampled for Fourier series decomposition of the periodic light variations. The challenges in the identification of RR Lyrae candidates with (much) fewer than 20 field-of-view transits are described. General considerations of the results, their limitations, and interpretation are presented together with prospects for improvement in subsequent Gaia data releases.

We investigate the capabilities of the ESA Gaia mission for detecting and character- izing short timescale variability, from tens of seconds to a dozen hours. We assess the efficiency of the variogram analysis, for both detecting short timescale variability and estimating the underlying characteristic timescales from Gaia photometry, through extensive light-curve simulations for various periodic and transient short timescale variable types. We show that, with this approach, we can detect fast periodic variabil- ity, with amplitudes down to a few millimagnitudes, as well as some M dwarf flares and supernovae explosions, with limited contamination from longer timescale variables or constant sources. Timescale estimates from the variogram give valuable informa- tion on the rapidity of the underlying variation, which could complement timescale estimates from other methods, like Fourier-based periodograms, and be reinvested in preparation of ground-based photometric follow-up of short timescale candidates evi- denced by Gaia. The next step will be to find new short timescale variable candidates from real Gaia data, and to further characterize them using all the Gaia information, including color and spectrum.

Parallaxes for 331 classical Cepheids, 31 Type II Cepheids and 364 RR Lyrae stars in common between Gaia and the Hipparcos and Tycho-2 catalogues are published in Gaia Data Release 1 (DR1) as part of the Tycho-Gaia Astrometric Solution (TGAS). In order to test these first parallax measurements of the primary standard candles of the cosmological distance ladder, that involve astrometry collected by Gaia during the initial 14 months of science operation, we compared them with literature estimates and derived new period-luminosity ($PL$), period-Wesenheit ($PW$) relations for classical and Type II Cepheids and infrared $PL$, $PL$-metallicity ($PLZ$) and optical luminosity-metallicity ($M_V$-[Fe/H]) relations for the RR Lyrae stars, with zero points based on TGAS. The new relations were computed using multi-band ($V,I,J,K_{\mathrm{s}},W_{1}$) photometry and spectroscopic metal abundances available in the literature, and applying three alternative approaches: (i) by linear least squares fitting the absolute magnitudes inferred from direct transformation of the TGAS parallaxes, (ii) by adopting astrometric-based luminosities, and (iii) using a Bayesian fitting approach. TGAS parallaxes bring a significant added value to the previous Hipparcos estimates. The relations presented in this paper represent first Gaia-calibrated relations and form a "work-in-progress" milestone report in the wait for Gaia-only parallaxes of which a first solution will become available with Gaia's Data Release 2 (DR2) in 2018.

Gaia Data Release 1 contains parallaxes for more than 700 Galactic Cepheids and RR Lyrae stars, computed as part of the Tycho-Gaia Astrometric Solution (TGAS). We have used TGAS parallaxes, along with literature ($V, I, J, {K_\mathrm{s}}, W_1$) photometry and spectroscopy, to calibrate the zero point of the Period-Luminosity and Period-Wesenheit relations of classical and type II Cepheids, and the near-infrared Period-Luminosity, Period-Luminosity-Metallicity and optical Luminosity-Metallicity relations of RR Lyrae stars. In this contribution we briefly summarise results obtained by fitting these basic relations adopting different techniques that operate either in parallax or distance (absolute magnitude) space.

In this article we present an overview of the ESA Gaia mission and of the unprecedented impact that Gaia will have on the field of variable star research. We summarise the contents and impact of the first Gaia data release on the description of variability phenomena, with particular emphasis on pulsating star research. The Tycho-Gaia astrometric solution, although limited to 2.1 million stars, has been used in many studies related to pulsating stars. Furthermore a set of 3,194 Cepheids and RR Lyrae stars with their times series have been released. Finally we present the plans for the ongoing study of variable phenomena with Gaia and highlight some of the possible impacts of the second data release on variable, and specifically, pulsating stars.

The advent of large scale multi-epoch surveys raises the need for automated light curve (LC) processing. This is particularly true for eclipsing binaries (EBs), which form one of the most populated types of variable objects. The Gaia mission, launched at the end of 2013, is expected to detect of the order of few million EBs over a 5-year mission. We present an automated procedure to characterize EBs based on the geometric morphology of their LCs with two aims: first to study an ensemble of EBs on a statistical ground without the need to model the binary system, and second to enable the automated identification of EBs that display atypical LCs. We model the folded LC geometry of EBs using up to two Gaussian functions for the eclipses and a cosine function for any ellipsoidal-like variability that may be present between the eclipses. The procedure is applied to the OGLE-III data set of EBs in the Large Magellanic Cloud (LMC) as a proof of concept. The bayesian information criterion is used to select the best model among models containing various combinations of those components, as well as to estimate the significance of the components. Based on the two-Gaussian models, EBs with atypical LC geometries are successfully identified in two diagrams, using the Abbe values of the original and residual folded LCs, and the reduced $\chi^2$. Cleaning the data set from the atypical cases and further filtering out LCs that contain non-significant eclipse candidates, the ensemble of EBs can be studied on a statistical ground using the two-Gaussian model parameters. For illustration purposes, we present the distribution of projected eccentricities as a function of orbital period for the OGLE-III set of EBs in the LMC, as well as the distribution of their primary versus secondary eclipse widths.

In the new era of large-scale astronomical surveys, automated methods of analysis and classification of bulk data are a fundamental tool for fast and efficient production of deliverables. This becomes ever more imminent as we enter the Gaia era. We investigate the potential detectability of eclipsing binaries with Gaia using a data set of all Kepler eclipsing binaries sampled with Gaia cadence and folded with the Kepler period. The performance of fitting methods is evaluated with comparison to real Kepler data parameters and a classification scheme is proposed for the potentially detectable sources based on the geometry of the light curve fits. The polynomial chain (polyfit) and two-Gaussian models are used for light curve fitting of the data set. Classification is performed with a combination of the t-SNE (t-distrubuted Stochastic Neighbor Embedding) and DBSCAN (Density-Based Spatial Clustering of Applications with Noise) algorithms. We find that approximately 68% of Kepler Eclipsing Binary sources are potentially detectable by Gaia when folded with the Kepler period and propose a classification scheme of the detectable sources based on the morphological type indicative of the light curve, with subclasses that reflect the properties of the fitted model (presence and visibility of eclipses, their width, depth, etc.).

Context. The first Gaia Data Release contains the Tycho-Gaia Astrometric Solution (TGAS). This is a subset of about 2 million stars for which, besides the position and photometry, the proper motion and parallax are calculated using Hipparcos and Tycho-2 positions in 1991.25 as prior information. Aims. We investigate the scientific potential and limitations of the TGAS component by means of the astrometric data for open clusters. Methods. Mean cluster parallax and proper motion values are derived taking into account the error correlations within the astrometric solutions for individual stars, an estimate of the internal velocity dispersion in the cluster, and, where relevant, the effects of the depth of the cluster along the line of sight. Internal consistency of the TGAS data is assessed. Results. Values given for standard uncertainties are still inaccurate and may lead to unrealistic unit-weight standard deviations of least squares solutions for cluster parameters. Reconstructed mean cluster parallax and proper motion values are generally in very good agreement with earlier Hipparcos-based determination, although the Gaia mean parallax for the Pleiades is a significant exception. We have no current explanation for that discrepancy. Most clusters are observed to extend to nearly 15 pc from the cluster centre, and it will be up to future Gaia releases to establish whether those potential cluster-member stars are still dynamically bound to the clusters. Conclusions. The Gaia DR1 provides the means to examine open clusters far beyond their more easily visible cores, and can provide membership assessments based on proper motions and parallaxes. A combined HR diagram shows the same features as observed before using the Hipparcos data, with clearly increased luminosities for older A and F dwarfs.

Large surveys producing tera- and petabyte-scale databases require machine-learning and knowledge discovery methods to deal with the overwhelming quantity of data and the difficulties of extracting concise, meaningful information with reliable assessment of its uncertainty. This study investigates the potential of a few machine-learning methods for the automated analysis of eclipsing binaries in the data of such surveys. We aim to aid the extraction of samples of eclipsing binaries from such databases and to provide basic information about the objects. We estimate class labels according to two classification systems, one based on the light curve morphology (EA/EB/EW classes) and the other based on the physical characteristics of the binary system (system morphology classes; detached through overcontact systems). Furthermore, we explore low-dimensional surfaces along which the light curves of eclipsing binaries are concentrated, to use in the characterization of the binary systems and in the exploration of biases of the full unknown Gaia data with respect to the training sets. We explore the performance of principal component analysis (PCA), linear discriminant analysis (LDA), random forest classification and self-organizing maps (SOM). We pre-process the photometric time series by combining a double Gaussian profile fit and a smoothing spline, in order to de-noise and interpolate the observed light curves. We achieve further denoising, and selected the most important variability elements from the light curves using PCA. We perform supervised classification using random forest and LDA based on the PC decomposition, while SOM gives a continuous 2-dimensional manifold of the light curves arranged by a few important features. We estimate the uncertainty of the supervised methods due to the specific finite training set using ensembles of models constructed on randomized training sets.

Throughout the processing and analysis of survey data, a ubiquitous issue nowadays is that we are spoilt for choice when we need to select a methodology for some of its steps. The alternative methods usually fail and excel in different data regions, and have various advantages and drawbacks, so a combination that unites the strengths of all while suppressing the weaknesses is desirable. We propose to use a two-level hierarchy of learners. Its first level consists of training and applying the possible base methods on the first part of a known set. At the second level, we feed the output probability distributions from all base methods to a second learner trained on the remaining known objects. Using classification of variable stars and photometric redshift estimation as examples, we show that the hierarchical combination is capable of achieving general improvement over averaging-type combination methods, correcting systematics present in all base methods, is easy to train and apply, and thus, it is a promising tool in the astronomical "Big Data" era.

Tens of millions of new variable objects are expected to be identified in over a billion time series from the Gaia mission. Crossmatching known variable sources with those from Gaia is crucial to incorporate current knowledge, understand how these objects appear in the Gaia data, train supervised classifiers to recognise known classes, and validate the results of the Variability Processing and Analysis Coordination Unit (CU7) within the Gaia Data Analysis and Processing Consortium (DPAC). The method employed by CU7 to crossmatch variables for the first Gaia data release includes a binary classifier to take into account positional uncertainties, proper motion, targeted variability signals, and artefacts present in the early calibration of the Gaia data. Crossmatching with a classifier makes it possible to automate all those decisions which are typically made during visual inspection. The classifier can be trained with objects characterized by a variety of attributes to ensure similarity in multiple dimensions (astrometry, photometry, time-series features), with no need for a-priori transformations to compare different photometric bands, or of predictive models of the motion of objects to compare positions. Other advantages as well as some disadvantages of the method are discussed. Implementation steps from the training to the assessment of the crossmatch classifier and selection of results are described.

The ESA Gaia mission provides a unique time-domain survey for more than one billion sources brighter than G=20.7 mag. Gaia offers the unprecedented opportunity to study variability phenomena in the Universe thanks to multi-epoch G-magnitude photometry in addition to astrometry, blue and red spectro-photometry, and spectroscopy. Within the Gaia Consortium, Coordination Unit 7 has the responsibility to detect variable objects, classify them, derive characteristic parameters for specific variability classes, and provide global descriptions of variable phenomena. We describe the variability processing and analysis that we plan to apply to the successive data releases, and we present its application to the G-band photometry results of the first 14 months of Gaia operations that comprises 28 days of Ecliptic Pole Scanning Law and 13 months of Nominal Scanning Law. Out of the 694 million, all-sky, sources that have calibrated G-band photometry in this first stage of the mission, about 2.3 million sources that have at least 20 observations are located within 38 degrees from the South Ecliptic Pole. We detect about 14% of them as variable candidates, among which the automated classification identified 9347 Cepheid and RR Lyrae candidates. Additional visual inspections and selection criteria led to the publication of 3194 Cepheid and RR Lyrae stars, described in Clementini et al. (2016). Under the restrictive conditions for DR1, the completenesses of Cepheids and RR Lyrae stars are estimated at 67% and 58%, respectively, numbers that will significantly increase with subsequent Gaia data releases. Data processing within the Gaia Consortium is iterative, the quality of the data and the results being improved at each iteration. The results presented in this article show a glimpse of the exceptional harvest that is to be expected from the Gaia mission for variability phenomena. [abridged]

We present an overview of the Specific Objects Study (SOS) pipeline developed within the Coordination Unit 7 (CU7) of the Gaia Data Processing and Analysis Consortium (DPAC), the coordination unit charged with the processing and analysis of variable sources observed by Gaia, to validate and fully characterise Cepheids and RR Lyrae stars observed by the spacecraft. We describe how the SOS for Cepheids and RR Lyrae stars (SOS Cep&RRL) was specifically tailored to analyse Gaia's G-band photometric time-series with a South Ecliptic Pole (SEP) footprint, which covers an external region of the Large Magellanic Cloud (LMC). G-band time-series photometry and characterization by the SOS Cep&RRL pipeline (mean magnitude and pulsation characteristics) are published in Gaia Data Release 1 (Gaia DR1) for a total sample of 3,194 variable stars, 599 Cepheids and 2,595 RR Lyrae stars, of which 386 (43 Cepheids and 343 RR Lyrae stars) are new discoveries by Gaia. All 3,194 stars are distributed over an area extending 38 degrees on either side from a point offset from the centre of the LMC by about 3 degrees to the north and 4 degrees to the east. The vast majority, but not all, are located within the LMC. The published sample also includes a few bright RR Lyrae stars that trace the outer halo of the Milky Way in front of the LMC.

Combined studies of variable stars and stellar clusters open great horizons, and they allow us to improve our understanding of stellar cluster formation and stellar evolution. In that prospect, the Gaia mission will provide astrometric, photometric, and spectroscopic data for about one billion stars of the Milky Way. This will represent a major census of stellar clusters, and it will drastically increase the number of known variable stars. In particular, the peculiar Gaia scanning law offers the opportunity to investigate the rather unexplored domain of short timescale variability (from tens of seconds to a dozen of hours), bringing invaluable clues to the fields of stellar physics and stellar aggregates. We assess the Gaia capabilities in terms of short timescale variability detection, using extensive light-curve simulations for various variable object types. We show that Gaia can detect periodic variability phenomena with amplitude variations larger than a few millimagnitudes. Additionally, we plan to perform subsequent follow-up of variables stars detected in clusters by Gaia to better characterize them. Hence, we develop a pipeline for the analysis of high cadence photometry from ground-based telescopes such as the 1.2m Euler telescope (La Silla, Chile) and the 1.2m Mercator telescope (La Palma, Canary Islands).

We study the problem of periodicity detection in massive data sets of photometric or radial velocity time series, as presented by ESA's Gaia mission. Periodicity detection hinges on the estimation of the false alarm probability (FAP) of the extremum of the periodogram of the time series. We consider the problem of its estimation with two main issues in mind. First, for a given number of observations and signal-to-noise ratio, the rate of correct periodicity detections should be constant for all realized cadences of observations regardless of the observational time patterns, in order to avoid sky biases that are difficult to assess. Second, the computational loads should be kept feasible even for millions of time series. Using the Gaia case, we compare the $F^M$ method (Paltani 2004, Schwarzenberg-Czerny 2012), the Baluev method (Baluev 2008) and the GEV method (S\"uveges 2014), as well as a method for the direct estimation of a threshold. Three methods involve some unknown parameters, which are obtained by fitting a regression-type predictive model using easily obtainable covariates derived from observational time series. We conclude that the GEV and the Baluev methods both provide good solutions to the issues posed by a large-scale processing. The first of these yields the best scientific quality at the price of some moderately costly pre-processing. When this pre-processing is impossible for some reason (e.g. the computational costs are prohibitive or good regression models cannot be constructed), the Baluev method provides a computationally inexpensive alternative with slight biases in regions where time samplings exhibit strong aliases.

On the 19th of December 2013, the Gaia spacecraft was successfully launched by a Soyuz rocket from French Guiana and started its amazing journey to map and characterise one billion celestial objects with its one billion pixel camera. In this presentation, we briefly review the general aims of the mission and describe what has happened since launch, including the Ecliptic Pole scanning mode. We also focus especially on binary stars, starting with some basic observational aspects, and then turning to the remarkable harvest that Gaia is expected to yield for these objects.

We demonstrate the eclipsing binary detection performance of the Gaia variability analysis and processing pipeline using Hipparcos data. The automated pipeline classifies 1,067 (0.9%) of the 118,204 Hipparcos sources as eclipsing binary candidates. The detection rate amounts to 89% (732 sources) in a subset of 819 visually confirmed eclipsing binaries, with the period correctly identified for 80% of them, and double or half periods obtained in 6% of the cases.

Gaia is an ESA cornerstone mission, which was successfully launched December 2013 and commenced operations in July 2014. Within the Gaia Data Processing and Analysis consortium, Coordination Unit 7 (CU7) is responsible for the variability analysis of over a billion celestial sources and nearly 4 billion associated time series (photometric, spectrophotometric, and spectroscopic), encoding information in over 800 billion observations during the 5 years of the mission, resulting in a petabyte scale analytical problem. In this article, we briefly describe the solutions we developed to address the challenges of time series variability analysis: from the structure for a distributed data-oriented scientific collaboration to architectural choices and specific components used. Our approach is based on Open Source components with a distributed, partitioned database as the core to handle incrementally: ingestion, distributed processing, analysis, results and export in a constrained time window.

Noise is an unavoidable part of most measurements which can hinder a correct interpretation of the data. Uncertainties propagate in the data analysis and can lead to biased results even in basic descriptive statistics such as the central moments and cumulants. Expressions of noise-unbiased estimates of central moments and cumulants up to the fourth order are presented under the assumption of independent Gaussian uncertainties, for weighted and unweighted statistics. These results are expected to be relevant for applications of the skewness and kurtosis estimators such as outlier detections, normality tests and in automated classification procedures. The comparison of estimators corrected and not corrected for noise biases is illustrated with simulations as a function of signal-to-noise ratio, employing different sample sizes and weighting schemes.

Unevenly spaced time series are common in astronomy because of the day-night cycle, weather conditions, dependence on the source position in the sky, allocated telescope time, corrupt measurements, for example, or be inherent to the scanning law of satellites like Hipparcos and the forthcoming Gaia. Irregular sampling often causes clumps of measurements and gaps with no data which can severely disrupt the values of estimators. This paper aims at improving the accuracy of common statistical parameters when linear interpolation (in time or phase) can be considered an acceptable approximation of a deterministic signal. A pragmatic solution is formulated in terms of a simple weighting scheme, adapting to the sampling density and noise level, applicable to large data volumes at minimal computational cost. Tests on time series from the Hipparcos periodic catalogue led to significant improvements in the overall accuracy and precision of the estimators with respect to the unweighted counterparts and those weighted by inverse-squared uncertainties. Automated classification procedures employing statistical parameters weighted by the suggested scheme confirmed the benefits of the improved input attributes. The classification of eclipsing binaries, Mira, RR Lyrae, Delta Cephei and Alpha2 Canum Venaticorum stars employing exclusively weighted descriptive statistics achieved an overall accuracy of 92 per cent, about 6 per cent higher than with unweighted estimators.

We describe the construction of a highly reliable sample of approximately 7,000 optically faint periodic variable stars with light curves obtained by the asteroid survey LINEAR across 10,000 sq.deg of northern sky. Majority of these variables have not been cataloged yet. The sample flux limit is several magnitudes fainter than for most other wide-angle surveys; the photometric errors range from ~0.03 mag at $r=15$ to ~0.20 mag at r=18. Light curves include on average 250 data points, collected over about a decade. Using SDSS-based photometric recalibration of the LINEAR data for about 25 million objects, we selected ~200,000 most probable candidate variables and visually confirmed and classified approximately 7,000 periodic variables using phased light curves. The reliability and uniformity of visual classification across eight human classifiers was calibrated and tested using a SDSS Stripe 82 region variable star catalog, and verified using an unsupervised machine learning approach. The resulting sample of periodic LINEAR variables is dominated by 3,900 RR Lyrae stars and 2,700 eclipsing binary stars of all subtypes, and includes small fractions of relatively rare populations such as asymptotic giant branch stars and SX Phoenicis stars. We discuss the distribution of these mostly uncataloged variables in various diagrams constructed with optical-to-infrared SDSS, 2MASS and WISE photometry, and with LINEAR light curve features. An interesting side result is a robust and precise quantitative description of a strong correlation between the light-curve period and color/spectral type for close and contact eclipsing binary stars. These large samples of robustly classified variable stars will enable detailed statistical studies of the Galactic structure and physics of binary and other stars, and we make them publicly available.

Central moments and cumulants are often employed to characterize the distribution of data. The skewness and kurtosis are particularly useful for the detection of outliers, the assessment of departures from normally distributed data, automated classification techniques and other applications. Robust definitions of higher order moments are more stable but might miss characteristic features of the data, as in the case of astronomical time series with rare events like stellar bursts or eclipses from binary systems. Weighting can help identify reliable measurements from uncertain or spurious outliers, so unbiased estimates of the weighted skewness and kurtosis moments and cumulants, corrected for sample-size biases, are provided under the assumption of independent data. The comparison of biased and unbiased weighted estimators is illustrated with simulations as a function of sample size, employing different data distributions and weighting schemes.

We present an automated classification of stars exhibiting periodic, non-periodic and irregular light variations. The Hipparcos catalogue of unsolved variables is employed to complement the training set of periodic variables of Dubath et al. with irregular and non-periodic representatives, leading to 3881 sources in total which describe 24 variability types. The attributes employed to characterize light-curve features are selected according to their relevance for classification. Classifier models are produced with random forests and a multistage methodology based on Bayesian networks, achieving overall misclassification rates under 12 per cent. Both classifiers are applied to predict variability types for 6051 Hipparcos variables associated with uncertain or missing types in the literature.

We propose a robust principal component analysis (PCA) framework for the exploitation of multi-band photometric measurements in large surveys. Period search results are improved using the time series of the first principal component due to its optimized signal-to-noise ratio.The presence of correlated excess variations in the multivariate time series enables the detection of weaker variability. Furthermore, the direction of the largest variance differs for certain types of variable stars. This can be used as an efficient attribute for classification. The application of the method to a subsample of Sloan Digital Sky Survey Stripe 82 data yielded 132 high-amplitude Delta Scuti variables. We found also 129 new RR Lyrae variables, complementary to the catalogue of Sesar et al., 2010, extending the halo area mapped by Stripe 82 RR Lyrae stars towards the Galactic bulge. The sample comprises also 25 multiperiodic or Blazhko RR Lyrae stars.

A complete periodic star extraction and classification scheme is set up and tested with the Hipparcos catalogue. The efficiency of each step is derived by comparing the results with prior knowledge coming from the catalogue or from the literature. A combination of two variability criteria is applied in the first step to select 17 006 variability candidates from a complete sample of 115 152 stars. Our candidate sample turns out to include 10 406 known variables (i.e., 90% of the total of 11 597) and 6600 contaminating constant stars. A random forest classification is used in the second step to extract 1881 (82%) of the known periodic objects while removing entirely constant stars from the sample and limiting the contamination of non-periodic variables to 152 stars (7.5%). The confusion introduced by these 152 non-periodic variables is evaluated in the third step using the results of the Hipparcos periodic star classification presented in a previous study (Dubath et al. [1]).

We present an evaluation of the performance of an automated classification of the Hipparcos periodic variable stars into 26 types. The sub-sample with the most reliable variability types available in the literature is used to train supervised algorithms to characterize the type dependencies on a number of attributes. The most useful attributes evaluated with the random forest methodology include, in decreasing order of importance, the period, the amplitude, the V-I colour index, the absolute magnitude, the residual around the folded light-curve model, the magnitude distribution skewness and the amplitude of the second harmonic of the Fourier series model relative to that of the fundamental frequency. Random forests and a multi-stage scheme involving Bayesian network and Gaussian mixture methods lead to statistically equivalent results. In standard 10-fold cross-validation experiments, the rate of correct classification is between 90 and 100%, depending on the variability type. The main mis-classification cases, up to a rate of about 10%, arise due to confusion between SPB and ACV blue variables and between eclipsing binaries, ellipsoidal variables and other variability types. Our training set and the predicted types for the other Hipparcos periodic stars are available online.

We present a novel automated methodology to detect and classify periodic variable stars in a large database of photometric time series. The methods are based on multivariate Bayesian statistics and use a multi-stage approach. We applied our method to the ground-based data of the TrES Lyr1 field, which is also observed by the Kepler satellite, covering ~26000 stars. We found many eclipsing binaries as well as classical non-radial pulsators, such as slowly pulsating B stars, Gamma Doradus, Beta Cephei and Delta Scuti stars. Also a few classical radial pulsators were found.