The XMM-Newton Survey Science Centre Consortium (SSC) develops software in close collaboration with the Science Operations Centre to perform a pipeline analysis of all XMM-Newton observations. In celebration of the 20th launch anniversary, the SSC has compiled the 4th generation of serendipitous source catalogues, 4XMM. The catalogue described here, 4XMM-DR9s, explores sky areas that were observed more than once by XMM-Newton. It was constructed from simultaneous source detection on the overlapping observations, which were bundled in groups ("stacks"). Stacking leads to a higher sensitivity, resulting in newly discovered sources and better constrained source parameters, and unveils long-term brightness variations. As a novel feature, positional rectification was applied beforehand. Observations with all filters and suitable camera settings were included. Exposures with a high background were discarded, which was determined through a statistical analysis of all exposures in each instrument configuration. The X-ray background maps used in source detection were modelled via adaptive smoothing with newly determined parameters. Source fluxes were derived for all contributing observations, irrespective of whether the source would be detectable in an individual observation. From 1,329 stacks with 6,604 contributing observations over repeatedly covered 300 square degrees in the sky, 4XMM-DR9s lists 288,191 sources. 218,283 of them were observed several times. Most stacks are composed of two observations, the largest one comprises 352. The number of observations of a source ranges from 1 to 40. Auxiliary products like X-ray images, long-term light curves, and optical finding charts are published as well. 4XMM-DR9s is considered a prime resource to explore long-term variability of X-ray sources discovered by XMM-Newton. Regular incremental releases including new public observations are planned.

Sky surveys produce enormous quantities of data on extensive regions of the sky. The easiest way to access this information is through catalogues of standardised data products. {\em XMM-Newton} has been surveying the sky in the X-ray, ultra-violet, and optical bands for 20 years. The {\em XMM-Newton} Survey Science Centre has been producing standardised data products and catalogues to facilitate access to the serendipitous X-ray sky. Using improved calibration and enhanced software, we re-reduced all of the 14041 {\em XMM-Newton} X-ray observations, of which 11204 observations contained data with at least one detection and with these we created a new, high quality version of the {\em XMM-Newton} serendipitous source catalogue, 4XMM-DR9. 4XMM-DR9 contains 810795 detections down to a detection significance of 3 $\sigma$, of which 550124 are unique sources, which cover 1152 degrees$^{2}$ (2.85\%) of the sky. Filtering 4XMM-DR9 to retain only the cleanest sources with at least a 5 $\sigma$ detection significance leaves 433612 detections. Of these detections, 99.6\% have no pileup. Furthermore, 336 columns of information on each detection are provided, along with images. The quality of the source detection is shown to have improved significantly with respect to previous versions of the catalogues. Spectra and lightcurves are also made available for more than 288000 of the brightest sources (36\% of all detections).

XMM-Newton has observed the X-ray sky since early 2000. The XMM-Newton Survey Science Centre Consortium has published catalogues of X-ray and ultraviolet sources found serendipitously in the individual observations. This series is now augmented by a catalogue dedicated to X-ray sources detected in spatially overlapping XMM-Newton observations. The aim of this catalogue is to explore repeatedly observed sky regions. It thus makes use of the long(er) effective exposure time per sky area and offers the opportunity to investigate long-term flux variability directly through the source detection process. A new standardised strategy for simultaneous source detection on multiple observations is introduced. It is coded as a new task within the XMM-Newton Science Analysis System and used to compile a catalogue of sources from 434 stacks comprising 1,789 overlapping XMM-Newton observations that entered the 3XMM-DR7 catalogue, have a low background and full-frame readout of all EPIC cameras. The first stacked catalogue is called 3XMM-DR7s. It contains 71,951 unique sources with positions and parameters such as fluxes, hardness ratios, quality estimates, and information on inter-observation variability. About 15% of the sources are new with respect to 3XMM-DR7. Through stacked source detection, the parameters of repeatedly observed sources can be determined with higher accuracy than in the individual observations. The method is more sensitive to faint sources and tends to produce fewer spurious detections. With this first stacked catalogue we demonstrate the feasibility and benefit of the approach. It supplements the large data base of XMM-Newton detections by additional, in particular faint, sources and adds variability information. In the future, the catalogue will be expanded to larger samples and continued within the series of serendipitous XMM-Newton source catalogues.

This document presents HiPS, a hierarchical scheme for the description, storage and access of sky survey data. The system is based on hierarchical tiling of sky regions at finer and finer spatial resolution which facilitates a progressive view of a survey, and supports multi-resolution zooming and panning. HiPS uses the HEALPix tessellation of the sky as the basis for the scheme and is implemented as a simple file structure with a direct indexing scheme that leads to practical implementations.

We lay the foundations of a statistical framework for multi-catalogue cross-correlation and cross-identification based on explicit simplified catalogue models. A proper identification process should rely on both astrometric and photometric data. Under some conditions, the astrometric part and the photometric part can be processed separately and merged a posteriori to provide a single global probability of identification. The present paper addresses almost exclusively the astrometrical part and specifies the proper probabilities to be merged with photometric likelihoods. To select matching candidates in n catalogues, we used the Chi (or, indifferently, the Chi-square) test with 2(n-1) degrees of freedom. We thus call this cross-match a chi-match. In order to use Bayes' formula, we considered exhaustive sets of hypotheses based on combinatorial analysis. The volume of the Chi-test domain of acceptance -- a 2(n-1)-dimensional acceptance ellipsoid -- is used to estimate the expected numbers of spurious associations. We derived priors for those numbers using a frequentist approach relying on simple geometrical considerations. Likelihoods are based on standard Rayleigh, Chi and Poisson distributions that we normalized over the Chi-test acceptance domain. We validated our theoretical results by generating and cross-matching synthetic catalogues. The results we obtain do not depend on the order used to cross-correlate the catalogues. We applied the formalism described in the present paper to build the multi-wavelength catalogues used for the science cases of the ARCHES (Astronomical Resource Cross-matching for High Energy Studies) project. Our cross-matching engine is publicly available through a multi-purpose web interface. In a longer term, we plan to integrate this tool into the CDS XMatch Service.

ARCHES (Astronomical Resource Cross-matching for High Energy Studies) is a FP7-Space funded project whose aim is to provide the international astronomical community with well-characterised multi-wavelength data in the form of spectral energy distributions (SEDs) for large samples of objects extracted from the 3XMM DR5 X-ray catalogue of serendipitous sources. The project has developed new tools implementing fully probabilistic simultaneous cross-correlation of several catalogues for unresolved sources and a multi-wavelength finder for clusters of galaxies for extended sources. These enhanced resources have been tested in the framework of several science cases.

Thanks to the large collecting area (3 x ~1500 cm$^2$ at 1.5 keV) and wide field of view (30' across in full field mode) of the X-ray cameras on board the European Space Agency X-ray observatory XMM-Newton, each individual pointing can result in the detection of hundreds of X-ray sources, most of which are newly discovered. Recently, many improvements in the XMM-Newton data reduction algorithms have been made. These include enhanced source characterisation and reduced spurious source detections, refined astrometric precision, greater net sensitivity and the extraction of spectra and time series for fainter sources, with better signal-to-noise. Further, almost 50\% more observations are in the public domain compared to 2XMMi-DR3, allowing the XMM-Newton Survey Science Centre (XMM-SSC) to produce a much larger and better quality X-ray source catalogue. The XMM-SSC has developed a pipeline to reduce the XMM-Newton data automatically and using improved calibration a new catalogue version has been produced from XMM-Newton data made public by 2013 Dec. 31 (13 years of data). Manual screening ensures the highest data quality. This catalogue is known as 3XMM. In the latest release, 3XMM-DR5, there are 565962 X-ray detections comprising 396910 unique X-ray sources. For the 133000 brightest sources, spectra and lightcurves are provided. For all detections, the positions on the sky, a measure of the quality of the detection, and an evaluation of the X-ray variability is provided, along with the fluxes and count rates in 7 X-ray energy bands, the total 0.2-12 keV band counts, and four hardness ratios. To identify the detections, a cross correlation with 228 catalogues is also provided for each X-ray detection. 3XMM-DR5 is the largest X-ray source catalogue ever produced. Thanks to the large array of data products, it is an excellent resource in which to find new and extreme objects.

This document describes the linking of data discovery metadata to access to the data itself, further detailed metadata, related resources, and to services that perform operations on the data. The web service capability supports a drill-down into the details of a specific dataset and provides a set of links to the dataset file(s) and related resources. This specification also includes a VOTable-specific method of providing descriptions of one or more services and their input(s), usually using parameter values from elsewhere in the VOTable document. Providers are able to describe services that are relevant to the records (usually datasets with identifiers) by including service descriptors in a result document.

Saada transforms a set of heterogeneous FITS files or VOTables of various categories (images, tables, spectra ...) in a database without writing code. Databases created with Saada come with a rich Web interface and an Application Programming Interface (API). They support the four most common VO services. Such databases can mix various categories of data in multiple collections. They allow a direct access to the original data while providing a homogenous view thanks to an internal data model compatible with the characterization axis defined by the VO. The data collections can be bound to each other with persistent links making relevant browsing paths and allowing data-mining oriented queries.

Many different classes of X-ray sources contribute to the Galactic landscape at high energies. Although the nature of the most luminous X-ray emitters is now fairly well understood, the population of low-to-medium X-ray luminosity (Lx = 10^27-10^34 erg/s) sources remains much less studied, our knowledge being mostly based on the observation of local members. The advent of wide field and high sensitivity X-ray telescopes such as XMM-Newton now offers the opportunity to observe this low-to-medium Lx population at large distances. We report on the results of a Galactic plane survey conducted by the XMM-Newton Survey Science Centre (SSC). Beyond its astrophysical goals, this survey aims at gathering a representative sample of identified X-ray sources at low latitude that can be used later on to statistically identify the rest of the serendipitous sources discovered in the Milky Way. The survey is based on 26 XMM-Newton observations, obtained at |b| < 20 deg, distributed over a large range in Galactic longitudes and covering a summed area of 4 deg2. The flux limit of our survey is 2 x 10-15 erg/cm^2/s in the soft (0.5 - 2 keV) band and 1 x 10^-14 erg/cm^2/s in the hard (2 - 12 keV) band. We detect a total of 1319 individual X-ray sources. Using optical follow-up observations supplemented by cross-correlation with a large range of multi-wavelength archival catalogues we identify 316 X-ray sources. This constitutes the largest group of spectroscopically identified low latitude X-ray sources at this flux level. The majority of the identified X-ray sources are active coronae with spectral types in the range A - M at maximum distances of ~ 1 kpc. The number of identified active stars increases towards late spectral types, reaching a maximum at K. (abridged)

This document defines the core components of the Observation data model that are necessary to perform data discovery when querying data centers for observations of interest. It exposes use-cases to be carried out, explains the model and provides guidelines for its implementation as a data access service based on the Table Access Protocol (TAP). It aims at providing a simple model easy to understand and to implement by data providers that wish to publish their data into the Virtual Observatory. This interface integrates data modeling and data access aspects in a single service and is named ObsTAP. It will be referenced as such in the IVOA registries. There will be a separate document to cover the full Observation data model. In this document, the Observation Data Model Core Components (ObsCoreDM) defines the core components of queryable metadata required for global discovery of observational data. It is meant to allow a single query to be posed to TAP services at multiple sites to perform global data discovery without having to understand the details of the services present at each site. It defines a minimal set of basic metadata and thus allows for a reasonable cost of implementation by data providers. The combination of the ObsCoreDM with TAP is referred to as an ObsTAP service. As with most of the VO Data Models, ObsCoreDM makes use of STC, Utypes, Units and UCDs. The ObsCoreDM can be serialized as a VOTable. ObsCoreDM can make reference to more complete data models such as ObsProvDM (the Observation Provenance Data Model, to come), Characterisation DM, Spectrum DM or Simple Spectral Line Data Model (SSLDM).

The Survey Science Centre of the XMM-Newton satellite released the first incremental version of the 2XMM catalogue in August 2008 . With more than 220,000 X-ray sources, the 2XMMi was at that time the largest catalogue of X-ray sources ever published and thus constitutes an unprecedented resource for studying the high-energy properties of various classes of X-ray emitters such as AGN and stars. The advent of the 7th release of the Sloan Digital Sky Survey offers the opportunity to cross-match two major surveys and extend the spectral energy distribution of many 2XMMi sources towards the optical bands. We here present a cross-matching algorithm based on the classical likelihood ratio estimator. The method developed has the advantage of providing true probabilities of identifications without resorting to Monte-Carlo simulations. Over 30,000 2XMMi sources have SDSS counterparts with individual probabilities of identification higher than 90%. Using spectroscopic identifications from the SDSS DR7 catalogue supplemented by extraction from other catalogues, we build an identified sample from which the way the various classes of X-ray emitters gather in the multi dimensional parameter space can be analysed. We investigate two scientific use cases. In the first example we show how these multi-wavelength data can be used to search for new QSO2s. Although no specific range of observed properties allows us to identify Compton Thick QSO2s, we show that the prospects are much better for Compton Thin AGN2 and discuss several possible multi-parameter selection strategies. In a second example, we confirm the hardening of the mean X-ray spectrum with increasing X-ray luminosity on a sample of over 500 X-ray active stars and reveal that on average X-ray active M stars display bluer $g-r$ colour indexes than less active ones (abridged).

Aims: Pointed observations with XMM-Newton provide the basis for creating catalogues of X-ray sources detected serendipitously in each field. This paper describes the creation and characteristics of the 2XMM catalogue. Methods: The 2XMM catalogue has been compiled from a new processing of the XMM-Newton EPIC camera data. The main features of the processing pipeline are described in detail. Results: The catalogue, the largest ever made at X-ray wavelengths, contains 246,897 detections drawn from 3491 public XMM-Newton observations over a 7-year interval, which relate to 191,870 unique sources. The catalogue fields cover a sky area of more than 500 sq.deg. The non-overlapping sky area is ~360 sq.deg. (~1% of the sky) as many regions of the sky are observed more than once by XMM-Newton. The catalogue probes a large sky area at the flux limit where the bulk of the objects that contribute to the X-ray background lie and provides a major resource for generating large, well-defined X-ray selected source samples, studying the X-ray source population and identifying rare object types. The main characteristics of the catalogue are presented, including its photometric and astrometric properties .

We describe the production, properties and scientific potential of the XMM-Newton catalogue of serendipitous X-ray sources. The first version of this catalogue is nearing completion and is planned to be released before the end of 2002.