Sky surveys produce enormous quantities of data on extensive regions of the sky. The easiest way to access this information is through catalogues of standardised data products. {\em XMM-Newton} has been surveying the sky in the X-ray, ultra-violet, and optical bands for 20 years. The {\em XMM-Newton} Survey Science Centre has been producing standardised data products and catalogues to facilitate access to the serendipitous X-ray sky. Using improved calibration and enhanced software, we re-reduced all of the 14041 {\em XMM-Newton} X-ray observations, of which 11204 observations contained data with at least one detection and with these we created a new, high quality version of the {\em XMM-Newton} serendipitous source catalogue, 4XMM-DR9. 4XMM-DR9 contains 810795 detections down to a detection significance of 3 $\sigma$, of which 550124 are unique sources, which cover 1152 degrees$^{2}$ (2.85\%) of the sky. Filtering 4XMM-DR9 to retain only the cleanest sources with at least a 5 $\sigma$ detection significance leaves 433612 detections. Of these detections, 99.6\% have no pileup. Furthermore, 336 columns of information on each detection are provided, along with images. The quality of the source detection is shown to have improved significantly with respect to previous versions of the catalogues. Spectra and lightcurves are also made available for more than 288000 of the brightest sources (36\% of all detections).

Thanks to the large collecting area (3 x ~1500 cm$^2$ at 1.5 keV) and wide field of view (30' across in full field mode) of the X-ray cameras on board the European Space Agency X-ray observatory XMM-Newton, each individual pointing can result in the detection of hundreds of X-ray sources, most of which are newly discovered. Recently, many improvements in the XMM-Newton data reduction algorithms have been made. These include enhanced source characterisation and reduced spurious source detections, refined astrometric precision, greater net sensitivity and the extraction of spectra and time series for fainter sources, with better signal-to-noise. Further, almost 50\% more observations are in the public domain compared to 2XMMi-DR3, allowing the XMM-Newton Survey Science Centre (XMM-SSC) to produce a much larger and better quality X-ray source catalogue. The XMM-SSC has developed a pipeline to reduce the XMM-Newton data automatically and using improved calibration a new catalogue version has been produced from XMM-Newton data made public by 2013 Dec. 31 (13 years of data). Manual screening ensures the highest data quality. This catalogue is known as 3XMM. In the latest release, 3XMM-DR5, there are 565962 X-ray detections comprising 396910 unique X-ray sources. For the 133000 brightest sources, spectra and lightcurves are provided. For all detections, the positions on the sky, a measure of the quality of the detection, and an evaluation of the X-ray variability is provided, along with the fluxes and count rates in 7 X-ray energy bands, the total 0.2-12 keV band counts, and four hardness ratios. To identify the detections, a cross correlation with 228 catalogues is also provided for each X-ray detection. 3XMM-DR5 is the largest X-ray source catalogue ever produced. Thanks to the large array of data products, it is an excellent resource in which to find new and extreme objects.

This programme is aimed at obtaining one of the largest X-ray selected samples of identified active galactic nuclei to date in order to characterise such a population at intermediate fluxes, where most of the Universe's accretion power originates. We present the XMM-Newton Wide Angle Survey (XWAS), a new catalogue of almost a thousand X-ray sources spectroscopically identified through optical observations. A sample of X-ray sources detected in 68 XMM-Newton pointed observations was selected for optical multi-fibre spectroscopy. Optical counterparts and corresponding photometry of the X-ray sources were obtained from the SuperCOSMOS Sky Survey. Candidates for spectroscopy were initially selected with magnitudes down to R~21, with preference for X-ray sources having a flux F(0.5-4.5 keV) >10^-14 erg s^-1 cm^-2. Optical spectroscopic observations performed at the Anglo Australian Telescope Two Degree Field were analysed, and the derived spectra were classified based on optical emission lines. We have identified through optical spectroscopy 940 X-ray sources over ~11.8 deg^2 of the sky. Source populations in our sample can be summarised as 65% broad line active galactic nuclei (BLAGN), 16% narrow emission line galaxies (NELGs), 6% absorption line galaxies (ALGs) and 13% stars. An active nucleus is likely to be present also in the large majority of the X-ray sources spectroscopically classified as NELGs or ALGs. Sources lie in high-galactic latitude (|b| > 20 deg) XMM-Newton fields mainly in the southern hemisphere. Due to the large parameter space in redshift (0 < z < 4.25) and flux (10^-15 < F(0.5-4.5 keV) < 10^-12 erg s^-1 cm^-2) covered by the XWAS this work provides an excellent resource to further study subsamples and particular cases. The overall properties of the extragalactic objects are presented in this paper.

Aims: Pointed observations with XMM-Newton provide the basis for creating catalogues of X-ray sources detected serendipitously in each field. This paper describes the creation and characteristics of the 2XMM catalogue. Methods: The 2XMM catalogue has been compiled from a new processing of the XMM-Newton EPIC camera data. The main features of the processing pipeline are described in detail. Results: The catalogue, the largest ever made at X-ray wavelengths, contains 246,897 detections drawn from 3491 public XMM-Newton observations over a 7-year interval, which relate to 191,870 unique sources. The catalogue fields cover a sky area of more than 500 sq.deg. The non-overlapping sky area is ~360 sq.deg. (~1% of the sky) as many regions of the sky are observed more than once by XMM-Newton. The catalogue probes a large sky area at the flux limit where the bulk of the objects that contribute to the X-ray background lie and provides a major resource for generating large, well-defined X-ray selected source samples, studying the X-ray source population and identifying rare object types. The main characteristics of the catalogue are presented, including its photometric and astrometric properties .

We have constrained the extragalactic source count distributions over a broad range of X-ray fluxes and in various energy bands to test whether the predictions from X-ray background synthesis models agree with the observational constraints provided by our measurements. We have used 1129 XMM-Newton observations at |b|>20 deg covering a sky area of 132.3 deg^2 to compile the largest complete samples of X-ray objects to date in the 0.5-1 keV, 1-2 keV, 2-4.5 keV, 4.5-10 keV, 0.5-2 keV and 2-10 keV energy bands. Our survey includes in excess of 30,000 sources down to ~10^-15 erg/cm^2/s below 2 keV and down to ~10^{-14} erg/cm^2/s above 2 keV. A break in the source count distributions was detected in all energy bands except the 4.5-10 keV band. An analytical model comprising 2 power-law components cannot adequately describe the curvature seen in the source count distributions. The shape of the logN(>S)-logS is strongly dependent on the energy band with a general steepening apparent as we move to higher energies. This is due to non-AGN populations, comprised mainly of stars and clusters of galaxies, contribute up to 30% of the source population at energies <2 keV and at fluxes >10^{-13} erg/cm^2/s, and these populations of objects have significantly flatter source count distributions than AGN. We find a substantial increase in the relative fraction of hard X-ray sources at higher energies, from >55% below 2 keV to >77% above 2 keV. However the majority of sources detected above 4.5 keV still have significant flux below 2 keV. Comparison with predictions from the synthesis models suggest that the models might be overpredicting the number of faint absorbed AGN, which would call for fine adjustment of some model parameters such as the obscured to unobscured AGN ratio and/or the distribution of column densities at intermediate obscuration.