Sky surveys produce enormous quantities of data on extensive regions of the sky. The easiest way to access this information is through catalogues of standardised data products. {\em XMM-Newton} has been surveying the sky in the X-ray, ultra-violet, and optical bands for 20 years. The {\em XMM-Newton} Survey Science Centre has been producing standardised data products and catalogues to facilitate access to the serendipitous X-ray sky. Using improved calibration and enhanced software, we re-reduced all of the 14041 {\em XMM-Newton} X-ray observations, of which 11204 observations contained data with at least one detection and with these we created a new, high quality version of the {\em XMM-Newton} serendipitous source catalogue, 4XMM-DR9. 4XMM-DR9 contains 810795 detections down to a detection significance of 3 $\sigma$, of which 550124 are unique sources, which cover 1152 degrees$^{2}$ (2.85\%) of the sky. Filtering 4XMM-DR9 to retain only the cleanest sources with at least a 5 $\sigma$ detection significance leaves 433612 detections. Of these detections, 99.6\% have no pileup. Furthermore, 336 columns of information on each detection are provided, along with images. The quality of the source detection is shown to have improved significantly with respect to previous versions of the catalogues. Spectra and lightcurves are also made available for more than 288000 of the brightest sources (36\% of all detections).

Young field stars are hardly distinguishable from older ones because their space motion rapidly mixes them with the stellar population of the Galactic plane. Nevertheless, a careful target selection allows for young stars to be spotted throughout the sky. We aim to identify additional sources associated with the four young comoving stars that we discovered towards the CO Cepheus void and to provide a comprehensive view of the Cepheus association. Based on multivariate analysis methods, we have built an extended sample of 193 young star candidates, which are the optical and infrared counterparts of ROSAT All-Sky Survey and XMM-Newton X-ray sources. From optical spectroscopic observations, we measured their radial velocity with the cross-correlation technique. We derived their atmospheric parameters and projected rotational velocity with the code ROTFIT. We applied the subtraction of inactive templates to measure the lithium equivalent width, from which we infer their lithium abundance and age. Finally, we studied their kinematics using the second Gaia data release. Our sample is mainly composed of young or active stars and multiple systems. We identify two distinct populations of young stars that are spatially and kinematically separated. Those with an age between 100 and 300 Myr are mostly projected towards the Galactic plane. In contrast, 23 of the 37 sources younger than 30 Myr are located in the CO Cepheus void, and 21 of them belong to the stellar kinematic group that we previously reported in this sky area. We report a total of 32 bona fide members and nine candidates for this nearby (distance = 157$\pm$10 pc) young (age = 10-20 Myr) stellar association. According to the spatial distribution of its members, the original cluster is already dispersed and partially mixed with the local population of the Galactic plane.

We highlight the power of the Gaia DR2 in studying many fine structures of the Hertzsprung-Russell diagram (HRD). Gaia allows us to present many different HRDs, depending in particular on stellar population selections. We do not aim here for completeness in terms of types of stars or stellar evolutionary aspects. Instead, we have chosen several illustrative examples. We describe some of the selections that can be made in Gaia DR2 to highlight the main structures of the Gaia HRDs. We select both field and cluster (open and globular) stars, compare the observations with previous classifications and with stellar evolutionary tracks, and we present variations of the Gaia HRD with age, metallicity, and kinematics. Late stages of stellar evolution such as hot subdwarfs, post-AGB stars, planetary nebulae, and white dwarfs are also analysed, as well as low-mass brown dwarf objects. The Gaia HRDs are unprecedented in both precision and coverage of the various Milky Way stellar populations and stellar evolutionary phases. Many fine structures of the HRDs are presented. The clear split of the white dwarf sequence into hydrogen and helium white dwarfs is presented for the first time in an HRD. The relation between kinematics and the HRD is nicely illustrated. Two different populations in a classical kinematic selection of the halo are unambiguously identified in the HRD. Membership and mean parameters for a selected list of open clusters are provided. They allow drawing very detailed cluster sequences, highlighting fine structures, and providing extremely precise empirical isochrones that will lead to more insight in stellar physics. Gaia DR2 demonstrates the potential of combining precise astrometry and photometry for large samples for studies in stellar evolution and stellar population and opens an entire new area for HRD-based studies.

Parallaxes for 331 classical Cepheids, 31 Type II Cepheids and 364 RR Lyrae stars in common between Gaia and the Hipparcos and Tycho-2 catalogues are published in Gaia Data Release 1 (DR1) as part of the Tycho-Gaia Astrometric Solution (TGAS). In order to test these first parallax measurements of the primary standard candles of the cosmological distance ladder, that involve astrometry collected by Gaia during the initial 14 months of science operation, we compared them with literature estimates and derived new period-luminosity ($PL$), period-Wesenheit ($PW$) relations for classical and Type II Cepheids and infrared $PL$, $PL$-metallicity ($PLZ$) and optical luminosity-metallicity ($M_V$-[Fe/H]) relations for the RR Lyrae stars, with zero points based on TGAS. The new relations were computed using multi-band ($V,I,J,K_{\mathrm{s}},W_{1}$) photometry and spectroscopic metal abundances available in the literature, and applying three alternative approaches: (i) by linear least squares fitting the absolute magnitudes inferred from direct transformation of the TGAS parallaxes, (ii) by adopting astrometric-based luminosities, and (iii) using a Bayesian fitting approach. TGAS parallaxes bring a significant added value to the previous Hipparcos estimates. The relations presented in this paper represent first Gaia-calibrated relations and form a "work-in-progress" milestone report in the wait for Gaia-only parallaxes of which a first solution will become available with Gaia's Data Release 2 (DR2) in 2018.

Context. The first Gaia Data Release contains the Tycho-Gaia Astrometric Solution (TGAS). This is a subset of about 2 million stars for which, besides the position and photometry, the proper motion and parallax are calculated using Hipparcos and Tycho-2 positions in 1991.25 as prior information. Aims. We investigate the scientific potential and limitations of the TGAS component by means of the astrometric data for open clusters. Methods. Mean cluster parallax and proper motion values are derived taking into account the error correlations within the astrometric solutions for individual stars, an estimate of the internal velocity dispersion in the cluster, and, where relevant, the effects of the depth of the cluster along the line of sight. Internal consistency of the TGAS data is assessed. Results. Values given for standard uncertainties are still inaccurate and may lead to unrealistic unit-weight standard deviations of least squares solutions for cluster parameters. Reconstructed mean cluster parallax and proper motion values are generally in very good agreement with earlier Hipparcos-based determination, although the Gaia mean parallax for the Pleiades is a significant exception. We have no current explanation for that discrepancy. Most clusters are observed to extend to nearly 15 pc from the cluster centre, and it will be up to future Gaia releases to establish whether those potential cluster-member stars are still dynamically bound to the clusters. Conclusions. The Gaia DR1 provides the means to examine open clusters far beyond their more easily visible cores, and can provide membership assessments based on proper motions and parallaxes. A combined HR diagram shows the same features as observed before using the Hipparcos data, with clearly increased luminosities for older A and F dwarfs.

The increasing volumes of astronomical data require practical methods for data exploration, access and visualisation. The Hierarchical Progressive Survey (HiPS) is a HEALPix based scheme that enables a multi-resolution approach to astronomy data from the individual pixels up to the whole sky. We highlight the decisions and approaches that have been taken to make this scheme a practical solution for managing large volumes of heterogeneous data. Early implementors of this system have formed a network of HiPS nodes, with some 250 diverse data sets currently available, with multiple mirror implementations for important data sets. This hierarchical approach can be adapted to expose Big Data in different ways. We describe how the ease of implementation, and local customisation of the Aladin Lite embeddable HiPS visualiser have been keys for promoting collaboration on HiPS.

The MocServer is an astronomical service dedicated to the manipulation of data set coverages. This server sets together about 15 000 spatial footprints associated to catalogs, data bases and pixel surveys. Thanks to the Multi-Order Coverage map coding method (MOC1.0 IVOA standard), the MocServer is able to provide in a few milliseconds the list of data set identifiers intersecting any polygon on the sky. The MOC server has been deployed in June 2015 by the Centre de Donnees astronomiques de Strasbourg. It is operational and already in use by Aladin Desktop and Aladin Lite prototype versions.

Context. Clusters of galaxies are important for cosmology and astrophysics. They may be discovered through either the summed optical/IR radiation originating from their member galaxies or via X-ray emission originating from the hot intracluster medium. X- ray samples are not affected by projection effects but a redshift determination typically needs optical and infrared follow-up to then infer X-ray temperatures and luminosities. Aims. We want to confirm serendipitously discovered X-ray emitting cluster candidates and measure their cosmological redshift through the analysis and exploration of multi-wavelength photometric catalogues. Methods. We developed a tool, the Integrated Cluster Finder (ICF), to search for clusters by determining overdensities of potential member galaxies in optical and infrared catalogues. Based on a spectroscopic meta-catalogue we calibrated colour-redshift relations that combine optical (SDSS) and IR data (UKIDSS, WISE). The tool is used to quantify the overdensity of galaxies against the background via a modified redMaPPer technique and to quantify the confidence of a cluster detection. Results. Cluster finding results are compared to reference catalogues found in the literature. The results agree to within 95-98%. The tool is used to confirm 488 out of 830 cluster candidates drawn from 3XMMe in the footprint of the SDSS and CFHT catalogues. Conclusions. The ICF is a flexible and highly efficient tool to search for galaxy clusters in multiple catalogues and is freely available to the community. It may be used to identify the cluster content in future X-ray catalogues from XMM-Newton and eventually from eROSITA.

We lay the foundations of a statistical framework for multi-catalogue cross-correlation and cross-identification based on explicit simplified catalogue models. A proper identification process should rely on both astrometric and photometric data. Under some conditions, the astrometric part and the photometric part can be processed separately and merged a posteriori to provide a single global probability of identification. The present paper addresses almost exclusively the astrometrical part and specifies the proper probabilities to be merged with photometric likelihoods. To select matching candidates in n catalogues, we used the Chi (or, indifferently, the Chi-square) test with 2(n-1) degrees of freedom. We thus call this cross-match a chi-match. In order to use Bayes' formula, we considered exhaustive sets of hypotheses based on combinatorial analysis. The volume of the Chi-test domain of acceptance -- a 2(n-1)-dimensional acceptance ellipsoid -- is used to estimate the expected numbers of spurious associations. We derived priors for those numbers using a frequentist approach relying on simple geometrical considerations. Likelihoods are based on standard Rayleigh, Chi and Poisson distributions that we normalized over the Chi-test acceptance domain. We validated our theoretical results by generating and cross-matching synthetic catalogues. The results we obtain do not depend on the order used to cross-correlate the catalogues. We applied the formalism described in the present paper to build the multi-wavelength catalogues used for the science cases of the ARCHES (Astronomical Resource Cross-matching for High Energy Studies) project. Our cross-matching engine is publicly available through a multi-purpose web interface. In a longer term, we plan to integrate this tool into the CDS XMatch Service.

ARCHES (Astronomical Resource Cross-matching for High Energy Studies) is a FP7-Space funded project whose aim is to provide the international astronomical community with well-characterised multi-wavelength data in the form of spectral energy distributions (SEDs) for large samples of objects extracted from the 3XMM DR5 X-ray catalogue of serendipitous sources. The project has developed new tools implementing fully probabilistic simultaneous cross-correlation of several catalogues for unresolved sources and a multi-wavelength finder for clusters of galaxies for extended sources. These enhanced resources have been tested in the framework of several science cases.

We cross-correlate the largest available Mid-Infrared (WISE), X-ray (3XMM) and Radio (FIRST+NVSS) catalogues to define the MIXR sample of AGN and star-forming galaxies. We pre-classify the sources based on their positions on the WISE colour/colour plot, showing that the MIXR triple selection is extremely effective to diagnose the star formation and AGN activity of individual populations, even on a flux/magnitude basis, extending the diagnostics to objects with luminosities and redshifts from SDSS DR12. We recover the radio/mid-IR star formation correlation with great accuracy, and use it to classify our sources, based on their activity, as radio-loud and radio-quiet AGN, LERGs/LINERs, and non-AGN galaxies. These diagnostics can prove extremely useful for large AGN and galaxy samples, and help develop ways to efficiently triage sources when data from the next generation of instruments becomes available. We study bias in detail, and show that while the widely-used WISE colour selections for AGN are very successful at cleanly selecting samples of luminous AGN, they miss or misclassify a substantial fraction of AGN at lower luminosities and/or higher redshifts. MIXR also allows us to test the relation between radiative and kinetic (jet) power in radio-loud AGN, for which a tight correlation is expected due to a mutual dependence on accretion. Our results highlight that long-term AGN variability, jet regulation, and other factors affecting the $Q/L$$_{bol}$ relation, are introducing a vast amount of scatter in this relation, with dramatic potential consequences on our current understanding of AGN feedback and its effect on star formation.

The nature of the low- to intermediate-luminosity (Lx$\,\sim 10^{32-34}$ erg s$^{-1}$) source population revealed in hard band (2-10 keV) X-ray surveys of the Galactic Plane is poorly understood. To overcome such problem we cross-correlated the XMM-Newton 3XMM-DR4 survey with the infrared 2MASS and GLIMPSE catalogues. We identified reliable X-ray-infrared associations for 690 sources. We selected 173 sources having hard X-ray spectra, typical of hard X-ray high-mass stars (kT$\,>\,5\,$keV), and 517 sources having soft X-ray spectra, typical of active coronae. About $18\,\%$ of the soft sources are classified in the literature: $\sim\,91\%$ as stars, with a minor fraction of WR stars. Roughly $15\,\%$ of the hard sources are classified in the literature: $\sim\,68\%$ as high-mass X-ray stars single or in binary systems (WR, Be and HMXBs), with a small fraction of G and B stars. We carried out infrared spectroscopic pilot observations at the William Herschel Telescope for five hard X-ray sources. Three of them are high-mass stars with spectral types WN7-8h, Ofpe/WN9 and Be, and Lx$\sim\,10^{32}-10^{33}$erg s$^{-1}$. One source is a colliding-wind binary, while another source is a colliding-wind binary or a supergiant fast X-ray transient in quiescence. The Be star is a likely $\gamma$-Cas system. The nature of the other two X-ray sources is uncertain. The distribution of hard X-ray sources in the parameter space made of X-ray hardness ratio, infrared colours and X-ray-to-infrared flux ratio suggests that many of the unidentified sources are new $\gamma$-Cas analogues, WRs and low Lx HMXBs. However, the nature of the X-ray population with Ks $\geq$ 11 and average X-ray-to-infrared flux ratio remains unconstrained.

Scientific exploitation of the ever increasing volumes of astronomical data requires efficient and practical methods for data access, visualisation, and analysis. Hierarchical sky tessellation techniques enable a multi-resolution approach to organising data on angular scales from the full sky down to the individual image pixels. Aims. We aim to show that the Hierarchical progressive survey (HiPS) scheme for describing astronomical images, source catalogues, and three-dimensional data cubes is a practical solution to managing large volumes of heterogeneous data and that it enables a new level of scientific interoperability across large collections of data of these different data types. Methods. HiPS uses the HEALPix tessellation of the sphere to define a hierarchical tile and pixel structure to describe and organise astronomical data. HiPS is designed to conserve the scientific properties of the data alongside both visualisation considerations and emphasis on the ease of implementation. We describe the development of HiPS to manage a large number of diverse image surveys, as well as the extension of hierarchical image systems to cube and catalogue data. We demonstrate the interoperability of HiPS and Multi-Order Coverage (MOC) maps and highlight the HiPS mechanism to provide links to the original data. Results. Hierarchical progressive surveys have been generated by various data centres and groups for ~200 data collections including many wide area sky surveys, and archives of pointed observations. These can be accessed and visualised in Aladin, Aladin Lite, and other applications. HiPS provides a basis for further innovations in the use of hierarchical data structures to facilitate the description and statistical analysis of large astronomical data sets.

Saada transforms a set of heterogeneous FITS files or VOTables of various categories (images, tables, spectra ...) in a database without writing code. Databases created with Saada come with a rich Web interface and an Application Programming Interface (API). They support the four most common VO services. Such databases can mix various categories of data in multiple collections. They allow a direct access to the original data while providing a homogenous view thanks to an internal data model compatible with the characterization axis defined by the VO. The data collections can be bound to each other with persistent links making relevant browsing paths and allowing data-mining oriented queries.

Many different classes of X-ray sources contribute to the Galactic landscape at high energies. Although the nature of the most luminous X-ray emitters is now fairly well understood, the population of low-to-medium X-ray luminosity (Lx = 10^27-10^34 erg/s) sources remains much less studied, our knowledge being mostly based on the observation of local members. The advent of wide field and high sensitivity X-ray telescopes such as XMM-Newton now offers the opportunity to observe this low-to-medium Lx population at large distances. We report on the results of a Galactic plane survey conducted by the XMM-Newton Survey Science Centre (SSC). Beyond its astrophysical goals, this survey aims at gathering a representative sample of identified X-ray sources at low latitude that can be used later on to statistically identify the rest of the serendipitous sources discovered in the Milky Way. The survey is based on 26 XMM-Newton observations, obtained at |b| < 20 deg, distributed over a large range in Galactic longitudes and covering a summed area of 4 deg2. The flux limit of our survey is 2 x 10-15 erg/cm^2/s in the soft (0.5 - 2 keV) band and 1 x 10^-14 erg/cm^2/s in the hard (2 - 12 keV) band. We detect a total of 1319 individual X-ray sources. Using optical follow-up observations supplemented by cross-correlation with a large range of multi-wavelength archival catalogues we identify 316 X-ray sources. This constitutes the largest group of spectroscopically identified low latitude X-ray sources at this flux level. The majority of the identified X-ray sources are active coronae with spectral types in the range A - M at maximum distances of ~ 1 kpc. The number of identified active stars increases towards late spectral types, reaching a maximum at K. (abridged)

Once mixed in the ambient galactic plane stellar population, young stars are virtually indiscernible because neither their global photometric properties nor the presence of nearby gas can help to disentangle them from older ones. Nevertheless, the study of the RasTyc sample revealed 4 lithium-rich field stars displaying the same space motion, which are located within a few degrees from each other on the celestial sphere near the Cepheus-Cassiopeia complex and at a similar distance from the Sun. Both physical and kinematical indicators show that all these stars are young, with ages in the range 10-30 Myr. Using multivariate analysis methods, we selected optical counterparts of ROSAT All-Sky Survey / XMM-Newton X-ray sources cross-identified with late-type stars around these 4 young stars. Recent spectroscopic observations of this sample allowed us to discover additional lithium-rich sources. Our preliminary results showed that some of them share the same space motion as the 4 young comoving stars. They have properties rather similar to the members of the TW Hydrae association, although they seem to be slightly older and are located in the northern hemisphere. Nearby young stars in the field are of great importance to understand the recent local history of star formation, as well as to give new insight into the process of star formation outside standard star-forming regions and to study the evolution of circumstellar discs.

The Survey Science Centre of the XMM-Newton satellite released the first incremental version of the 2XMM catalogue in August 2008 . With more than 220,000 X-ray sources, the 2XMMi was at that time the largest catalogue of X-ray sources ever published and thus constitutes an unprecedented resource for studying the high-energy properties of various classes of X-ray emitters such as AGN and stars. The advent of the 7th release of the Sloan Digital Sky Survey offers the opportunity to cross-match two major surveys and extend the spectral energy distribution of many 2XMMi sources towards the optical bands. We here present a cross-matching algorithm based on the classical likelihood ratio estimator. The method developed has the advantage of providing true probabilities of identifications without resorting to Monte-Carlo simulations. Over 30,000 2XMMi sources have SDSS counterparts with individual probabilities of identification higher than 90%. Using spectroscopic identifications from the SDSS DR7 catalogue supplemented by extraction from other catalogues, we build an identified sample from which the way the various classes of X-ray emitters gather in the multi dimensional parameter space can be analysed. We investigate two scientific use cases. In the first example we show how these multi-wavelength data can be used to search for new QSO2s. Although no specific range of observed properties allows us to identify Compton Thick QSO2s, we show that the prospects are much better for Compton Thin AGN2 and discuss several possible multi-parameter selection strategies. In a second example, we confirm the hardening of the mean X-ray spectrum with increasing X-ray luminosity on a sample of over 500 X-ray active stars and reveal that on average X-ray active M stars display bluer $g-r$ colour indexes than less active ones (abridged).

We report the results of an optical campaign carried out by the XMM-Newton Survey Science Centre with the specific goal of identifying the brightest X-ray sources in the XMM-Newton Galactic Plane Survey of Hands et al. (2004). In addition to photometric and spectroscopic observations obtained at the ESO-VLT and ESO-3.6m, we used cross-correlations with the 2XMMi, USNO-B1.0, 2MASS and GLIMPSE catalogues to progress the identification process. Active coronae account for 16 of the 30 identified X-ray sources. Many of the identified hard X-ray sources are associated with massive stars emitting at intermediate X-ray luminosities of 10^32-34 erg/s. Among these are a very absorbed likely hyper-luminous star with X-ray/optical spectra and luminosities comparable with those of eta Carina, a new X-ray selected WN8 Wolf-Rayet star, a new Be/X-ray star belonging to the growing class of Gamma-Cas analogs and a possible supergiant X-ray binary of the kind discovered recently by INTEGRAL. One of the sources, XGPS-25 has a counterpart which exhibits HeII 4686 and Bowen CIII-NIII emission lines suggesting a quiescent or X-ray shielded Low Mass X-ray Binary, although its properties might also be consistent with a rare kind of cataclysmic variable (CV). We also report the discovery of three new CVs, one of which is a likely magnetic system. The soft (0.4-2.0 keV) band LogN-LogS curve is completely dominated by active stars in the flux range of 1x10^-13 to 1x10^-14 erg/cm2/s. In total, we are able to identify a large fraction of the hard (2-10 keV) X-ray sources in the flux range of 1x10^-12 to 1x10^-13 erg/cm2/s with Galactic objects at a rate consistent with that expected for the Galactic contribution only. (abridged)