Sky surveys produce enormous quantities of data on extensive regions of the sky. The easiest way to access this information is through catalogues of standardised data products. {\em XMM-Newton} has been surveying the sky in the X-ray, ultra-violet, and optical bands for 20 years. The {\em XMM-Newton} Survey Science Centre has been producing standardised data products and catalogues to facilitate access to the serendipitous X-ray sky. Using improved calibration and enhanced software, we re-reduced all of the 14041 {\em XMM-Newton} X-ray observations, of which 11204 observations contained data with at least one detection and with these we created a new, high quality version of the {\em XMM-Newton} serendipitous source catalogue, 4XMM-DR9. 4XMM-DR9 contains 810795 detections down to a detection significance of 3 $\sigma$, of which 550124 are unique sources, which cover 1152 degrees$^{2}$ (2.85\%) of the sky. Filtering 4XMM-DR9 to retain only the cleanest sources with at least a 5 $\sigma$ detection significance leaves 433612 detections. Of these detections, 99.6\% have no pileup. Furthermore, 336 columns of information on each detection are provided, along with images. The quality of the source detection is shown to have improved significantly with respect to previous versions of the catalogues. Spectra and lightcurves are also made available for more than 288000 of the brightest sources (36\% of all detections).

The XMM-Newton Survey Science Centre Consortium (SSC) develops software in close collaboration with the Science Operations Centre to perform a pipeline analysis of all XMM-Newton observations. In celebration of the 20th launch anniversary, the SSC has compiled the 4th generation of serendipitous source catalogues, 4XMM. The catalogue described here, 4XMM-DR9s, explores sky areas that were observed more than once by XMM-Newton. It was constructed from simultaneous source detection on the overlapping observations, which were bundled in groups ("stacks"). Stacking leads to a higher sensitivity, resulting in newly discovered sources and better constrained source parameters, and unveils long-term brightness variations. As a novel feature, positional rectification was applied beforehand. Observations with all filters and suitable camera settings were included. Exposures with a high background were discarded, which was determined through a statistical analysis of all exposures in each instrument configuration. The X-ray background maps used in source detection were modelled via adaptive smoothing with newly determined parameters. Source fluxes were derived for all contributing observations, irrespective of whether the source would be detectable in an individual observation. From 1,329 stacks with 6,604 contributing observations over repeatedly covered 300 square degrees in the sky, 4XMM-DR9s lists 288,191 sources. 218,283 of them were observed several times. Most stacks are composed of two observations, the largest one comprises 352. The number of observations of a source ranges from 1 to 40. Auxiliary products like X-ray images, long-term light curves, and optical finding charts are published as well. 4XMM-DR9s is considered a prime resource to explore long-term variability of X-ray sources discovered by XMM-Newton. Regular incremental releases including new public observations are planned.

In this work we present a robust quantification of X-ray selected AGN in local ($z \leq 0.25$) dwarf galaxies ($M_\mathrm{*} \leq 3 \times 10^9 \mathrm{M_\odot}$). We define a parent sample of 4,331 dwarf galaxies found within the footprint of both the MPA-JHU galaxy catalogue (based on SDSS DR8) and 3XMM DR7, performed a careful review of the data to remove misidentifications and produced a sample of 61 dwarf galaxies that exhibit nuclear X-ray activity indicative of an AGN. We examine the optical emission line ratios of our X-ray selected sample and find that optical AGN diagnostics fail to identify 85% of the sources. We then calculated the growth rates of the black holes powering our AGN in terms of their specific accretion rates ($\propto L_\mathrm{X}/M_\mathrm{*}$, an approximate tracer of the Eddington ratio). Within our observed sample, we found a wide range of specific accretion rates. After correcting the observed sample for the varying sensitivity of 3XMM, we found further evidence for a wide range of X-ray luminosities and specific accretion rates, described by a power law. Using this corrected AGN sample we also define an AGN fraction describing their relative incidence within the parent sample. We found the AGN fraction increases with host galaxy mass (up to $\approx$ 6%) for galaxies with X-ray luminosities between $10^{39} \mathrm{erg/s}$ and $10^{42} \mathrm{erg/s}$, and by extrapolating the power law to higher luminosities, we found evidence to suggest the fraction of luminous AGN ($L_\mathrm{X} \geq 10^{42.4} \mathrm{erg/s}$) is constant out to $z \approx 0.7$.

Modern soft X-ray observatories can yield unique insights into time domain astrophysics, and a huge amount of information is stored - and largely unexploited - in data archives. Like a treasure-hunt, the EXTraS project harvested the hitherto unexplored temporal domain information buried in the serendipitous data collected by the European Photon Imaging Camera instrument onboard the XMM- Newton satellite in 20 years of observations. The result is a vast catalogue, describing the temporal behaviour of hundreds of thousands of X-ray sources. But the catalogue is just a starting point because it has to be, in its turn, further analysed. During the project an education activity has been defined and run in several workshops for high school students in Italy, Germany and UK. The final goal is to engage the students, and in perspective citizen scientists, to go through the whole validation process: they look into the data and try to discover new sources, or to characterize already known sources. This paper describes how the EXTraS science gateway is used to accomplish these tasks and highlights the first discovery, a flaring X-ray source in the globular cluster NGC 6540.

XMM-Newton has observed the X-ray sky since early 2000. The XMM-Newton Survey Science Centre Consortium has published catalogues of X-ray and ultraviolet sources found serendipitously in the individual observations. This series is now augmented by a catalogue dedicated to X-ray sources detected in spatially overlapping XMM-Newton observations. The aim of this catalogue is to explore repeatedly observed sky regions. It thus makes use of the long(er) effective exposure time per sky area and offers the opportunity to investigate long-term flux variability directly through the source detection process. A new standardised strategy for simultaneous source detection on multiple observations is introduced. It is coded as a new task within the XMM-Newton Science Analysis System and used to compile a catalogue of sources from 434 stacks comprising 1,789 overlapping XMM-Newton observations that entered the 3XMM-DR7 catalogue, have a low background and full-frame readout of all EPIC cameras. The first stacked catalogue is called 3XMM-DR7s. It contains 71,951 unique sources with positions and parameters such as fluxes, hardness ratios, quality estimates, and information on inter-observation variability. About 15% of the sources are new with respect to 3XMM-DR7. Through stacked source detection, the parameters of repeatedly observed sources can be determined with higher accuracy than in the individual observations. The method is more sensitive to faint sources and tends to produce fewer spurious detections. With this first stacked catalogue we demonstrate the feasibility and benefit of the approach. It supplements the large data base of XMM-Newton detections by additional, in particular faint, sources and adds variability information. In the future, the catalogue will be expanded to larger samples and continued within the series of serendipitous XMM-Newton source catalogues.

X-ray astronomy is our gateway to the hot universe. More than half of the baryons in the cosmos are too hot to be visible at shorter wavelengths. Studying the extreme environments of black hole and neutron star vicinities also requires X-ray observations. With the successful launch of ISRO's AstroSat in 2015, and a few transformative results that emerged from JAXA's Hitomi mission in 2016, a new window has been opened into high sensitivity fast timing and high X-ray spectral resolution. Together with upcoming all-sky survey missions expected very soon, X-ray astronomy is entering a new era of parameter space exploration. The UK has been at the forefront of this field since the 1970s. But flat cash science budgets, compounded with the rising costs of cutting-edge space missions, imply inevitably diminishing roles for the UK in terms of both payload development and science exploitation in the future. To review the novel science possibilities enabled by recent and upcoming missions, and to discuss how to pave the way forward for X-ray astronomy in the UK, a specialist RAS discussion meeting was held in London on Feb 10 2017, summarised herein. A consolidated effort by the community to come together and work cohesively is a suggested natural first step in the current climate.

The requirements-driven OSIRIS-REx Camera Suite (OCAMS) acquires images essential to collecting a sample from the surface of Bennu. During proximity operations, these images document the presence of satellites and plumes, record spin state, enable an accurate digital terrain model of the shape of the asteroid and identify any surface hazards. They confirm the presence of sampleable regolith on the surface, observe the sampling event itself, and image the sample head in order to verify its readiness to be stowed. They document the history of Bennu as an example of early solar system material, as a microgravity body with a planetesimal size-scale, and as a carbonaceous object. OCAMS is fitted with three cameras. The MapCam records point-source color images on approach to the asteroid in order to connect ground-based point-source observations of Bennu to later higher-resolution surface spectral imaging. The SamCam documents the sample site before, during, and after it is disturbed by the sample mechanism. The PolyCam, using its focus mechanism, observes the sample site at sub-centimeter resolutions, revealing surface texture and morphology. While their imaging requirements divide naturally between the three cameras, they preserve a strong degree of functional overlap. OCAMS and the other spacecraft instruments allow the OSIRIS-REx mission to collect a sample from a microgravity body on the same visit during which it was first optically acquired from long range, a useful capability as humanity explores near-Earth, Main-Belt and Jupiter Trojan asteroids.

Ultraluminous x-ray sources (ULXs) in nearby galaxies shine brighter than any X-ray source in our Galaxy. ULXs are usually modeled as stellar-mass black holes (BHs) accreting at very high rates or intermediate-mass BHs. We present observations showing that NGC5907 ULX is instead an x-ray accreting neutron star (NS) with a spin period evolving from 1.43~s in 2003 to 1.13~s in 2014. It has an isotropic peak luminosity of about 1000 times the Eddington limit for a NS at 17.1~Mpc. Standard accretion models fail to explain its luminosity, even assuming beamed emission, but a strong multipolar magnetic field can describe its properties. These findings suggest that other extreme ULXs (x-ray luminosity > 10^{41} erg/s) might harbor NSs.

We study a sample of six X-ray selected broad absorption line (BAL) quasi-stellar objects (QSOs) from the XMM-Newton Wide Angle Survey. All six objects are classified as BALQSOs using the classic balnicity index, and together they form the largest sample of X-ray selected BALQSOs. We find evidence for absorption in the X-ray spectra of all six objects. An ionized absorption model applied to an X-ray spectral shape that would be typical for non-BAL QSOs (a power law with energy index alpha=0.98) provides acceptable fits to the X-ray spectra of all six objects. The optical to X-ray spectral indices, alpha_OX, of the X-ray selected BALQSOs, have a mean value of 1.69 +- 0.05, which is similar to that found for X-ray selected and optically selected non-BAL QSOs of similar ultraviolet luminosity. In contrast, optically-selected BALQSOs typically have much larger alpha_OX and so are characterised as being X-ray weak. The results imply that X-ray selection yields intrinsically X-ray bright BALQSOs, but their X-ray spectra are absorbed by a similar degree to that seen in optically-selected BALQSO samples; X-ray absorption appears to be ubiquitous in BALQSOs, but X-ray weakness is not. We argue that BALQSOs sit at one end of a spectrum of X-ray absorption properties in QSOs related to the degree of ultraviolet absorption in C IV 1550.

ARCHES (Astronomical Resource Cross-matching for High Energy Studies) is a FP7-Space funded project whose aim is to provide the international astronomical community with well-characterised multi-wavelength data in the form of spectral energy distributions (SEDs) for large samples of objects extracted from the 3XMM DR5 X-ray catalogue of serendipitous sources. The project has developed new tools implementing fully probabilistic simultaneous cross-correlation of several catalogues for unresolved sources and a multi-wavelength finder for clusters of galaxies for extended sources. These enhanced resources have been tested in the framework of several science cases.

A sample of X-ray and optically selected narrow emission-line galaxies (769 sources) from the 3XMM catalogue cross-correlated with SDSS (DR9) catalogue has been studied. Narrow-emission line active galactic nuclei (AGN; type-2) have been selected on the basis of their emission line ratios and/or X-ray luminosity. We have looked for X-ray unobscured type-2 AGN. As X-ray spectra were not available for our whole sample, we have checked the reliability of using the X-ray hardness ratio (HR) as a probe of the level of obscuration and we found a very good agreement with full spectral fitting results, with only 2% of the sources with apparently unobscured HR turning out to have an obscured spectrum. Despite the fact that type-2 AGN are supposed to be absorbed based on the Unified Model, about 60% of them show no sign or very low level of X-ray obscuration. After subtraction of contaminants to the sample, that is Narrow-Line Seyfert 1 and Compton-thick AGN, the fraction of unobscured Sy2 drops to 47%. For these sources, we were able to rule out dust reddening and variability for most of them as an explanation of the absence of optical broad emission-lines. The main explanations remaining are the dilution of weak/very broad emission-lines by the host galaxy and the intrinsic absence of the broad-line region (BLR) due to low accretion rates (i.e. True Sy2). However, the number of True Sy2 strongly depends on the method used to verify the intrinsic lack of broad lines. Indeed using the optical continuum luminosity to predict the BLR properties gives a much larger fraction of True Sy2 (about 90\% of the unobscured Sy2 sample) than the use of the X-ray 2 keV luminosity (about 20%). Nevertheless the number of AGN we securely detected as True Sy2 is at least three times larger that the previously confirmed number of True Sy2.

We cross-correlate the largest available Mid-Infrared (WISE), X-ray (3XMM) and Radio (FIRST+NVSS) catalogues to define the MIXR sample of AGN and star-forming galaxies. We pre-classify the sources based on their positions on the WISE colour/colour plot, showing that the MIXR triple selection is extremely effective to diagnose the star formation and AGN activity of individual populations, even on a flux/magnitude basis, extending the diagnostics to objects with luminosities and redshifts from SDSS DR12. We recover the radio/mid-IR star formation correlation with great accuracy, and use it to classify our sources, based on their activity, as radio-loud and radio-quiet AGN, LERGs/LINERs, and non-AGN galaxies. These diagnostics can prove extremely useful for large AGN and galaxy samples, and help develop ways to efficiently triage sources when data from the next generation of instruments becomes available. We study bias in detail, and show that while the widely-used WISE colour selections for AGN are very successful at cleanly selecting samples of luminous AGN, they miss or misclassify a substantial fraction of AGN at lower luminosities and/or higher redshifts. MIXR also allows us to test the relation between radiative and kinetic (jet) power in radio-loud AGN, for which a tight correlation is expected due to a mutual dependence on accretion. Our results highlight that long-term AGN variability, jet regulation, and other factors affecting the $Q/L$$_{bol}$ relation, are introducing a vast amount of scatter in this relation, with dramatic potential consequences on our current understanding of AGN feedback and its effect on star formation.

We present a study of the cataclysmic variable star PT Per based on archival XMM-Newton X-ray data and new optical spectroscopy from the WHT with ISIS. The X-ray data show deep minima which recur at a period of 82 minutes and a hard, unabsorbed X-ray spectrum. The optical spectra of PT Per show a relatively featureless blue continuum. From an analysis of the X-ray and optical data we conclude that PT Per is likely to be a magnetic cataclysmic variable of the polar class in which the minima correspond to those phase intervals when the accretion column rotates out of the field of view of the observer. We suggest that the optical spectrum, obtained around 4 years after the X-ray coverage, is dominated by the white dwarf in the system, implying that PT Per was in a low accretion state at the time of the observations. An analysis of the likely system parameters for PT Per suggests a distance of $\approx90$ pc and a very low-mass secondary, consistent with the idea that PT Per is a "period-bounce" binary.

Thanks to the large collecting area (3 x ~1500 cm$^2$ at 1.5 keV) and wide field of view (30' across in full field mode) of the X-ray cameras on board the European Space Agency X-ray observatory XMM-Newton, each individual pointing can result in the detection of hundreds of X-ray sources, most of which are newly discovered. Recently, many improvements in the XMM-Newton data reduction algorithms have been made. These include enhanced source characterisation and reduced spurious source detections, refined astrometric precision, greater net sensitivity and the extraction of spectra and time series for fainter sources, with better signal-to-noise. Further, almost 50\% more observations are in the public domain compared to 2XMMi-DR3, allowing the XMM-Newton Survey Science Centre (XMM-SSC) to produce a much larger and better quality X-ray source catalogue. The XMM-SSC has developed a pipeline to reduce the XMM-Newton data automatically and using improved calibration a new catalogue version has been produced from XMM-Newton data made public by 2013 Dec. 31 (13 years of data). Manual screening ensures the highest data quality. This catalogue is known as 3XMM. In the latest release, 3XMM-DR5, there are 565962 X-ray detections comprising 396910 unique X-ray sources. For the 133000 brightest sources, spectra and lightcurves are provided. For all detections, the positions on the sky, a measure of the quality of the detection, and an evaluation of the X-ray variability is provided, along with the fluxes and count rates in 7 X-ray energy bands, the total 0.2-12 keV band counts, and four hardness ratios. To identify the detections, a cross correlation with 228 catalogues is also provided for each X-ray detection. 3XMM-DR5 is the largest X-ray source catalogue ever produced. Thanks to the large array of data products, it is an excellent resource in which to find new and extreme objects.

We present the distributions of geometrical covering factors of active galactic nuclei (AGNs) dusty tori (f2) using an X-ray selected complete sample of 227 AGN drawn from the Bright Ultra-hard XMM-Newton Survey. The AGN have z from 0.05 to 1.7, 2-10 keV luminosities between 10^42 and 10^46 erg/s and Compton-thin X-ray absorption. Employing data from UKIDSS, 2MASS and the Wide-field Infrared Survey Explorer in a previous work we determined the rest-frame 1-20 microns continuum emission from the torus which we model here with the clumpy torus models of Nenkova et al. Optically classified type 1 and type 2 AGN are intrinsically different, with type 2 AGN having on average tori with higher f2 than type 1 AGN. Nevertheless, ~20 per cent of type 1 AGN have tori with large covering factors while ~23-28 per cent of type 2 AGN have tori with small covering factors. Low f2 are preferred at high AGN luminosities, as postulated by simple receding torus models, although for type 2 AGN the effect is certainly small. f2 increases with the X-ray column density, which implies that dust extinction an X-ray absorption takes place in material that shares an overall geometry and most likely belongs to the same structure, the putative torus. Based on our results, the viewing angle, AGN luminosity and also f2 determine the optical appearance of an AGN and control the shape of the rest-frame ~1-20 microns nuclear continuum emission. Thus, the torus geometrical covering factor is a key ingredient of unification schemes.

X-ray emission from Young Stellar Objects (YSOs) is crucial to understand star formation. A very limited amount of X-ray results is available for the protostellar (ClassI) phase. A systematic search of transient X-ray phenomena combined with a careful evaluation of the evolutionary stage offer a widely unexplored window to our understanding of YSOs X-ray properties. Within the EXTraS project, a search for transients and variability in the whole XMM-Newton archive, we discover transient X-ray emission consistent with ISO-Oph 85, a strongly embedded YSO in the rho Ophiuchi region, not detected in previous time-averaged X-ray studies. We extract an X-ray light curve for the flare and determine its spectral parameters from XMM-Newton/EPIC (European Photon Imaging Camera) data using quantile analysis. The X-ray flare ($2500\,s$), the only one detected in the XMM-Newton archive for ISO-Oph 85, has a luminosity of $LogL_X[erg/s]=31.1$ and a spectrum consistent with a highly-absorbed one-component thermal model ($N_H=1.0^{+1.2}_{-0.5}10^{23}\,cm^{-2}$, $kT=1.15^{+2.35}_{-0.65}\,keV)$. We set an upper limit of $LogL_X[erg/s]<29.5$ to the quiescent X-ray luminosity. We build a SED with IR to mm photometry drawn from literature and mid-IR Spitzer and sub-mm Herschel photometry analysed by us, and compare it with pre-computed models. The sub-mm emission peak in the Herschel data suggests that the object is a ClassI protostar. However, the Herschel/IR position offset is larger than for other YSOs in the region, leaving some doubt on the association. This is the first X-ray flare from a YSO recognised as a candidate ClassI YSO via the analysis of its complete SED. This work shows how the analysis of the whole SED is fundamental for the classification of YSOs, and how the X-ray source detection techniques we developed can open a new era in time-resolved analysis of the X-ray emission from stars.

The EXTraS project (Exploring the X-ray Transient and variable Sky) will characterise the temporal behaviour of the largest ever sample of objects in the soft X-ray range (0.1-12 keV) with a complex, systematic and consistent analysis of all data collected by the European Photon Imaging Camera (EPIC) instrument onboard the ESA XMM-Newton X-ray observatory since its launch. We will search for, and characterize variability (both periodic and aperiodic) in hundreds of thousands of sources spanning more than nine orders of magnitude in time scale and six orders of magnitude in flux. We will also search for fast transients, missed by standard image analysis. Our analysis will be completed by multiwavelength characterization of new discoveries and phenomenological classification of variable sources. All results and products will be made available to the community in a public archive, serving as a reference for a broad range of astrophysical investigations.

We report the multi-wavelength identification of the X-ray sources found in the Subaru-XMM-Newton Deep Survey (SXDS) using deep imaging data covering the wavelength range between the far-UV to the mid-IR. We select a primary counterpart of each X-ray source by applying the likelihood ratio method to R-band, 3.6micron, near-UV, and 24micron source catalogs as well as matching catalogs of AGN candidates selected in 1.4GHz radio and i'-band variability surveys. Once candidates of Galactic stars, ultra-luminous X-ray sources in a nearby galaxy, and clusters of galaxies are removed there are 896 AGN candidates in the sample. We conduct spectroscopic observations of the primary counterparts with multi-object spectrographs in the optical and NIR; 65\% of the X-ray AGN candidates are spectroscopically-identified. For the remaining X-ray AGN candidates, we evaluate their photometric redshift with photometric data in 15 bands. Utilising the multi-wavelength photometric data of the large sample of X-ray selected AGNs, we evaluate the stellar masses, M*, of the host galaxies of the narrow-line AGNs. The distribution of the stellar mass is remarkably constant from z=0.1 to 4.0. The relation between M* and 2--10 keV luminosity can be explained with strong cosmological evolution of the relationship between the black hole mass and M*. We also evaluate the scatter of the UV-MIR spectral energy distribution (SED) of the X-ray AGNs as a function of X-ray luminosity and absorption to the nucleus. The scatter is compared with galaxies which have redshift and stellar mass distribution matched with the X-ray AGN. The UV-NIR SEDs of obscured X-ray AGNs are similar to those of the galaxies in the matched sample. In the NIR-MIR range, the median SEDs of X-ray AGNs are redder, but the scatter of the SEDs of the X-ray AGN broadly overlaps that of the galaxies in the matched sample.

The Dark Energy Camera is a new imager with a 2.2-degree diameter field of view mounted at the prime focus of the Victor M. Blanco 4-meter telescope on Cerro Tololo near La Serena, Chile. The camera was designed and constructed by the Dark Energy Survey Collaboration, and meets or exceeds the stringent requirements designed for the wide-field and supernova surveys for which the collaboration uses it. The camera consists of a five element optical corrector, seven filters, a shutter with a 60 cm aperture, and a CCD focal plane of 250 micron thick fully-depleted CCDs cooled inside a vacuum Dewar. The 570 Mpixel focal plane comprises 62 2kx4k CCDs for imaging and 12 2kx2k CCDs for guiding and focus. The CCDs have 15 microns x15 microns pixels with a plate scale of 0.263 arc sec per pixel. A hexapod system provides state-of-the-art focus and alignment capability. The camera is read out in 20 seconds with 6-9 electrons readout noise. This paper provides a technical description of the camera's engineering, construction, installation, and current status.

The EXTraS project (Exploring the X-ray Transient and variable Sky) will harvest the hitherto unexplored temporal domain information buried in the serendipitous data collected by the European Photon Imaging Camera (EPIC) instrument onboard the ESA XMM-Newton X-ray observatory since its launch. This will include a search for fast transients, as well as a search and characterization of variability (both periodic and aperiodic) in hundreds of thousands of sources spanning more than nine orders of magnitude in time scale and six orders of magnitude in flux. X-ray results will be complemented by multiwavelength characterization of new discoveries. Phenomenological classification of variable sources will also be performed. All our results will be made available to the community. A didactic program in selected High Schools in Italy, Germany and the UK will also be implemented. The EXTraS project (2014-2016), funded within the EU/FP7 framework, is carried out by a collaboration including INAF (Italy), IUSS (Italy), CNR/IMATI (Italy), University of Leicester (UK), MPE (Germany) and ECAP (Germany).

The cosmic history of the growth of supermassive black holes in galactic centers parallels that of star-formation in the Universe. However, an important fraction of this growth occurs inconspicuously in obscured objects, where ultraviolet/optical/near-infrared emission is heavily obscured by dust. Since the X-ray flux is less attenuated, a high X-ray-to-optical flux ratio (Fx/Fo) is expected to be an efficient tool to find out these obscured accreting sources. We explore here via optical spectroscopy, X-ray spectroscopy and infrared photometry the most extreme cases of this population (those with Fx/Fo >50, EXO50 sources hereafter), using a well defined sample of seven X-ray sources extracted from the 2XMM catalogue. Five EXO50 sources (about 70 percent of the sample) in the bright flux regime explored by our survey (f(2-10 keV) > 1.5E-13 cgs) are associated with obscured AGN (Nh > 1.0E22 cm-2), spanning a redshift range between 0.75 and 1 and characterised by 2-10 keV intrinsic luminosities in the QSO regime (e.g. well in excess to 1.0E44 cgs). We did not find compelling evidence of Compton Thick AGN. Overall the EXO50 Type 2 QSOs do not seem to be different from standard X-ray selected Type 2 QSOs in terms of nuclear absorption; a very high AGN/host galaxy ratio seems to play a major role in explaining their extreme properties. Interestingly three out of five EXO50 Type 2 QSO objects can be classified as Extreme Dust Obscured Galaxies (EDOGs), suggesting that a very high AGN/host ratios (along with the large amount of dust absorption) could be the natural explanation also for a part of the EDOG population. The remaining two EXO50 sources are classified as BL Lac objects, having rather extreme properties, and which are good candidates for TeV emission.

The XMM-Newton spectral-fit database (XMMFITCAT) is a catalogue of spectral fitting results for the source detections within the XMM-Newton Serendipitous source catalogue with more than 50 net (background-subtracted) counts per detector in the 0.5-10 keV energy band. Its most recent version, constructed from the latest version of the XMM-Newton catalogue, the 3XMM Data Release 4 (3XMM-DR4), contains spectral-fitting results for $\gtrsim$ 114,000 detections, corresponding to $\simeq$ 78,000 unique sources. Three energy bands are defined and used in the construction of XMMFITCAT: Soft (0.5-2 keV), Hard (2-10 keV), and Full (0.5-10 keV) bands. Six spectral models, three simple and three more complex models, were implemented and applied to the spectral data. Simple models are applied to all sources, whereas complex models are applied to observations with more than 500 counts (30%). XMMFITCAT includes best-fit parameters and errors, fluxes, and goodness of fit estimates for all fitted models. XMMFITCAT has been conceived to provide the astronomical community with a tool to construct large and representative samples of X-ray sources by allowing source selection according to spectral properties, as well as characterise the X-ray properties of samples selected in different wavelengths. We present in this paper the main details of the construction of this database, and summarise its main characteristics.

Aims: The VY Scl system (anti-dwarf nova) V751 Cyg is examined following a claim of a super-soft spectrum in the optical low state. Methods: A serendipitous XMM-Newton X-ray observation and, 21 months later, Swift X-ray and UV observations, have provided the best such data on this source so far. These optical high-state datasets are used to study the flux and spectral variability of V751 Cyg. Results: Both the XMM-Newton and Swift data show evidence for modulation of the X-rays for the first time at the known 3.467 hr orbital period of V751 Cyg. In two Swift observations, taken ten days apart, the mean X-ray flux remained unchanged, while the UV source brightened by half a magnitude. The X-ray spectrum was not super-soft during the optical high state, but rather due to multi-temperature optically thin emission, with significant (10^{21-22} cm^-2) absorption, which was higher in the observation by Swift than that of XMM-Newton. The X-ray flux is harder at orbital minimum, suggesting that the modulation is related to absorption, perhaps linked to the azimuthally asymmetric wind absorption seen previously in H-alpha.

The majority of active galactic nuclei (AGN) are obscured by large amounts of absorbing material that makes them invisible at many wavelengths. X-rays, given their penetrating power, provide the most secure way for finding these AGN. The XMM-Newton serendipitous source catalog is the largest catalog of X-ray sources ever produced; it contains about half a million detections. These sources are mostly AGN. We have derived X-ray spectral fits for very many 3XMM-DR4 sources ($\gtrsim$ 114 000 observations, corresponding to $\sim$ 77 000 unique sources), which contain more than 50 source photons per detector. Here, we use a subsample of $\simeq$ 1000 AGN in the footprint of the SDSS area (covering 120 deg$^2$) with available spectroscopic redshifts. We searched for highly obscured AGN by applying an automated selection technique based on X-ray spectral analysis that is capable of efficiently selecting AGN. The selection is based on the presence of either a) flat rest-frame spectra; b) flat observed spectra; c) an absorption turnover, indicative of a high rest-frame column density; or d) an Fe K$\alpha$ line with an equivalent width > 500 eV. We found 81 highly obscured candidate sources. Subsequent detailed manual spectral fits revealed that 28 of them are heavily absorbed by column densities higher than 10$^{23}$ cm$^{-2}$. Of these 28 AGN, 15 are candidate Compton-thick AGN on the basis of either a high column density, consistent within the 90% confidence level with N$_{\rm H}$ $>$10$^{24}$ cm$^{-2}$, or a large equivalent width (>500 eV) of the Fe K$\alpha$ line. Another six are associated with near-Compton-thick AGN with column densities of $\sim$ 5$\times$10$^{23}$ cm$^{-2}$. A combination of selection criteria a) and c) for low-quality spectra, and a) and d) for medium- to high-quality spectra, pinpoint highly absorbed AGN with an efficiency of 80%.

Using the 3XMM catalogue of serendipitous X-ray sources, and the SDSS-DR9 spectroscopic catalogue, we have obtained a new sample of X-ray selected narrow emission line galaxies. The standard optical diagnostic diagram and selection by hard X-ray luminosity expose a mismatch between the optically-based and X-ray-based classifications. The nature of these misclassified elusive AGN can be understood in terms of their broader X-ray and optical properties and leads to a division of this sub-sample into two groups. A little more than half are likely to be narrow-line Seyfert 1s (NLS1s), so misclassified because of the contribution of the Broad Line Region (BLR) to their optical spectra. The remainder have some of the properties of Seyfert 2 (Sy2) AGN; their optical elusiveness can be explained by optical dilution from the host galaxy plus a star-formation contribution and by their underluminous optical emission due to low accretion rates. Because some of the Sy2 sources have very low accretion rates, are unabsorbed, plus the fact that they lack broad optical emission lines, they are good candidates to be True Sy2 AGN.

We present the most up-to-date X-ray luminosity function (XLF) and absorption function of Active Galactic Nuclei (AGNs) over the redshift range from 0 to 5, utilizing the largest, highly complete sample ever available obtained from surveys performed with Swift/BAT, MAXI, ASCA, XMM-Newton, Chandra, and ROSAT. The combined sample, including that of the Subaru/XMM-Newton Deep Survey, consists of 4039 detections in the soft (0.5--2 keV) and/or hard ($>2$ keV) band. We utilize a maximum likelihood method to reproduce the count-rate versus redshift distribution for each survey, by taking into account the evolution of the absorbed fraction, the contribution from Compton-thick (CTK) AGNs, and broad band spectra of AGNs including reflection components from tori based on the luminosity and redshift dependent unified scheme. We find that the shape of the XLF at $z \sim 1-3$ is significantly different from that in the local universe, for which the luminosity dependent density evolution model gives much better description than the luminosity and density evolution model. These results establish the standard population synthesis model of the X-Ray Background (XRB), which well reproduces the source counts, the observed fractions of CTK AGNs, and the spectrum of the hard XRB. The number ratio of CTK AGNs to the absorbed Compton-thin (CTN) AGNs is constrained to be $\approx$0.5--1.6 to produce the 20--50 keV XRB intensity within present uncertainties, by assuming that they follow the same evolution as CTN AGNs. The growth history of supermassive black holes is discussed based on the new AGN bolometric luminosity function.

The XMM-Newton spectral-fit database is an ongoing ESA funded project aimed to construct a catalogue of spectral-fitting results for all the sources within the XMM-Newton serendipitous source catalogue for which spectral data products have been pipeline-extracted (~ 120,000 X-ray source detections). The fundamental goal of this project is to provide the astronomical community with a tool to construct large and representative samples of X-ray sources by allowing source selection according to spectral properties.

By comparing the orbital period distributions of black hole and neutron star low mass X-ray binaries (LMXBs) in the Ritter-Kolb catalogue we show that there is statistical evidence for a dearth of black hole systems at short orbital periods (P_orb < 4h). This could either be due to a true divergence in orbital period distributions of these two types of system, or to black hole LMXBs being preferentially hidden from view at short orbital periods. We explore the latter possibility, by investigating whether black hole LMXBs could be concealed by a switch to radiatively inefficient accretion at low luminosities. The peak luminosity and the duration of X-ray binary outbursts are related to the disc radius and, hence, the orbital period. At short periods, where the peak outburst luminosity drops close to the threshold for radiatively inefficient accretion, black hole LMXBs have lower outburst luminosities, shorter outburst durations and lower X-ray duty cycles than comparable neutron star systems. These factors can combine to severely reduce the detection probability of short period black hole LMXBs relative to those containing neutron stars. We estimate the outburst properties and orbital period distribution of black hole LMXBs using two models of the transition to radiatively inefficient accretion: an instantaneous drop in accretion efficiency (eta) to zero, at a fraction (f) of the Eddington luminosity (L_Edd) and a power-law efficiency decrease, eta \propto \dot{M}^n, for L < f*L_Edd. We show that a population of black hole LMXBs at short orbital periods can only be hidden by a sharp drop in efficiency, either instantaneous or for n >= 3. This could be achieved by a genuine drop in luminosity or through abrupt spectral changes that shift the accretion power out of a given X-ray band.

The Advanced Telescope for High-energy Astrophysics (Athena+) is being proposed to ESA as the L2 mission (for a launch in 2028) and is specifically designed to answer two of the most pressing questions for astrophysics in the forthcoming decade: How did ordinary matter assemble into the large scale structures we see today? and how do black holes grow and shape the Universe? For addressing these two issues, Athena+ will provide transformational capabilities in terms of angular resolution, effective area, spectral resolution, grasp, that will make it the most powerful X-ray observatory ever flown. Such an observatory, when opened to the astronomical community, will be used for virtually all classes of astrophysical objects, from high-z gamma-ray bursts to the closest planets in our solar neighborhood. In this paper, we briefly review the core science objectives of Athena+, present the science requirements and the foreseen implementation of the mission, and illustrate its transformational capabilities compared to existing facilities.

This White Paper, submitted to the recent ESA call for science themes to define its future large missions, advocates the need for a transformational leap in our understanding of two key questions in astrophysics: 1) How does ordinary matter assemble into the large scale structures that we see today? 2) How do black holes grow and shape the Universe? Hot gas in clusters, groups and the intergalactic medium dominates the baryonic content of the local Universe. To understand the astrophysical processes responsible for the formation and assembly of these large structures, it is necessary to measure their physical properties and evolution. This requires spatially resolved X-ray spectroscopy with a factor 10 increase in both telescope throughput and spatial resolving power compared to currently planned facilities. Feedback from supermassive black holes is an essential ingredient in this process and in most galaxy evolution models, but it is not well understood. X-ray observations can uniquely reveal the mechanisms launching winds close to black holes and determine the coupling of the energy and matter flows on larger scales. Due to the effects of feedback, a complete understanding of galaxy evolution requires knowledge of the obscured growth of supermassive black holes through cosmic time, out to the redshifts where the first galaxies form. X-ray emission is the most reliable way to reveal accreting black holes, but deep survey speed must improve by a factor ~100 over current facilities to perform a full census into the early Universe. The Advanced Telescope for High Energy Astrophysics (Athena+) mission provides the necessary performance (e.g. angular resolution, spectral resolution, survey grasp) to address these questions and revolutionize our understanding of the Hot and Energetic Universe. These capabilities will also provide a powerful observatory to be used in all areas of astrophysics.

Many different classes of X-ray sources contribute to the Galactic landscape at high energies. Although the nature of the most luminous X-ray emitters is now fairly well understood, the population of low-to-medium X-ray luminosity (Lx = 10^27-10^34 erg/s) sources remains much less studied, our knowledge being mostly based on the observation of local members. The advent of wide field and high sensitivity X-ray telescopes such as XMM-Newton now offers the opportunity to observe this low-to-medium Lx population at large distances. We report on the results of a Galactic plane survey conducted by the XMM-Newton Survey Science Centre (SSC). Beyond its astrophysical goals, this survey aims at gathering a representative sample of identified X-ray sources at low latitude that can be used later on to statistically identify the rest of the serendipitous sources discovered in the Milky Way. The survey is based on 26 XMM-Newton observations, obtained at |b| < 20 deg, distributed over a large range in Galactic longitudes and covering a summed area of 4 deg2. The flux limit of our survey is 2 x 10-15 erg/cm^2/s in the soft (0.5 - 2 keV) band and 1 x 10^-14 erg/cm^2/s in the hard (2 - 12 keV) band. We detect a total of 1319 individual X-ray sources. Using optical follow-up observations supplemented by cross-correlation with a large range of multi-wavelength archival catalogues we identify 316 X-ray sources. This constitutes the largest group of spectroscopically identified low latitude X-ray sources at this flux level. The majority of the identified X-ray sources are active coronae with spectral types in the range A - M at maximum distances of ~ 1 kpc. The number of identified active stars increases towards late spectral types, reaching a maximum at K. (abridged)

This programme is aimed at obtaining one of the largest X-ray selected samples of identified active galactic nuclei to date in order to characterise such a population at intermediate fluxes, where most of the Universe's accretion power originates. We present the XMM-Newton Wide Angle Survey (XWAS), a new catalogue of almost a thousand X-ray sources spectroscopically identified through optical observations. A sample of X-ray sources detected in 68 XMM-Newton pointed observations was selected for optical multi-fibre spectroscopy. Optical counterparts and corresponding photometry of the X-ray sources were obtained from the SuperCOSMOS Sky Survey. Candidates for spectroscopy were initially selected with magnitudes down to R~21, with preference for X-ray sources having a flux F(0.5-4.5 keV) >10^-14 erg s^-1 cm^-2. Optical spectroscopic observations performed at the Anglo Australian Telescope Two Degree Field were analysed, and the derived spectra were classified based on optical emission lines. We have identified through optical spectroscopy 940 X-ray sources over ~11.8 deg^2 of the sky. Source populations in our sample can be summarised as 65% broad line active galactic nuclei (BLAGN), 16% narrow emission line galaxies (NELGs), 6% absorption line galaxies (ALGs) and 13% stars. An active nucleus is likely to be present also in the large majority of the X-ray sources spectroscopically classified as NELGs or ALGs. Sources lie in high-galactic latitude (|b| > 20 deg) XMM-Newton fields mainly in the southern hemisphere. Due to the large parameter space in redshift (0 < z < 4.25) and flux (10^-15 < F(0.5-4.5 keV) < 10^-12 erg s^-1 cm^-2) covered by the XWAS this work provides an excellent resource to further study subsamples and particular cases. The overall properties of the extragalactic objects are presented in this paper.

The Baryon Oscillation Spectroscopic Survey (BOSS) is designed to measure the scale of baryon acoustic oscillations (BAO) in the clustering of matter over a larger volume than the combined efforts of all previous spectroscopic surveys of large scale structure. BOSS uses 1.5 million luminous galaxies as faint as i=19.9 over 10,000 square degrees to measure BAO to redshifts z<0.7. Observations of neutral hydrogen in the Lyman alpha forest in more than 150,000 quasar spectra (g<22) will constrain BAO over the redshift range 2.15<z<3.5. Early results from BOSS include the first detection of the large-scale three-dimensional clustering of the Lyman alpha forest and a strong detection from the Data Release 9 data set of the BAO in the clustering of massive galaxies at an effective redshift z = 0.57. We project that BOSS will yield measurements of the angular diameter distance D_A to an accuracy of 1.0% at redshifts z=0.3 and z=0.57 and measurements of H(z) to 1.8% and 1.7% at the same redshifts. Forecasts for Lyman alpha forest constraints predict a measurement of an overall dilation factor that scales the highly degenerate D_A(z) and H^{-1}(z) parameters to an accuracy of 1.9% at z~2.5 when the survey is complete. Here, we provide an overview of the selection of spectroscopic targets, planning of observations, and analysis of data and data quality of BOSS.

In order to investigate the growth of super-massive black holes (SMBHs), we construct the black hole mass function (BHMF) and Eddington ratio distribution function (ERDF) of X-ray-selected broad-line AGNs at z~1.4 in the Subaru XMM-Newton Deep Survey field. In this redshift range, a significant part of the accretion growth of SMBHs is thought to be taking place. Black hole masses of X-ray-selected broad-line AGNs are estimated using the width of the broad MgII line and the 3000A monochromatic luminosity. We supplement the MgII FWHM values with the Ha FWHM obtained from our NIR spectroscopic survey. Using the black hole masses of broad-line AGNs at redshifts between 1.18 and 1.68, the binned broad-line AGN BHMF and ERDF are calculated using the Vmax method. To properly account for selection effects that impact the binned estimates, we derive the corrected broad-line AGN BHMF and ERDF by applying the Maximum Likelihood method, assuming that the ERDF is constant regardless of the black hole mass. We do not correct for the non-negligible uncertainties in virial BH mass estimates. If we compare the corrected broad-line AGN BHMF with that in the local Universe, the corrected BHMF at z~1.4 has a higher number density above 10^8 Msolar but a lower number density below that mass range. The evolution may be indicative of a down-sizing trend of accretion activity among the SMBH population. The evolution of broad-line AGN ERDF from z=1.4 to 0 indicates that the fraction of broad-line AGNs with accretion rate close to the Eddington-limit is higher at higher redshifts.

We study the comoving space density of X-ray-selected luminous active galactic nuclei (AGNs) and the obscured AGN fraction at high redshifts ($3 < z < 5$) in the Subaru/{\it XMM-Newton} Deep Survey (SXDS) field. From an X-ray source catalog with high completeness of optical identification thanks to deep optical images, we select a sample of 30 AGNs at $z > 3$ with intrinsic (de-absorbed and rest-frame 2--10 keV) luminosities of $L_{\rm X} = 10^{44-45}$ erg s$^{-1}$ detected in the 0.5--2 keV band, consisting of 20 and 10 objects with spectroscopic and photometric redshifts, respectively. Utilizing the $1/V_{\rm max}$ method, we confirm that the comoving space density of luminous AGNs decreases with redshift above $z > 3$. When combined with the {\it Chandra}-COSMOS result of Civano et al.\ (2011), the density decline of AGNs with $L_{\rm X} = 10^{44-45}$ erg s$^{-1}$ is well represented by a power law of $(1 + z)^{-6.2 \pm 0.9}$. We also determine the fraction of X-ray obscured AGNs with $N_{\rm H} > 10^{22}$ cm$^{-2}$ in the Compton-thin population to be 0.54$^{+0.17}_{-0.19}$, by carefully taking into account observational biases including the effects of photon statistics for each source. This result is consistent with an independent determination of the type-2 AGN fraction based on optical properties, for which the fraction is found to be 0.59$\pm$0.09. Comparing our result with that obtained in the local Universe, we conclude that the obscured fraction of luminous AGNs increases significantly from $z=0$ to $z>3$ by a factor of 2.5$\pm$1.1.

We present a highly complete and reliable mid-infrared (MIR) colour selection of luminous AGN candidates using the 3.4, 4.6, and 12 um bands of the WISE survey. The MIR colour wedge was defined using the wide-angle Bright Ultra-Hard XMM-Newton Survey (BUXS), one of the largest complete flux-limited samples of bright (f(4.5-10 keV)>6x10^{-14} erg cm^-2 s^-1) "ultra-hard" (4.5-10 keV) X-ray selected AGN to date. BUXS includes 258 objects detected over a total sky area of 44.43 deg^2 of which 251 are spectroscopically identified and classified, with 145 being type-1 AGN and 106 type-2 AGN. Our technique is designed to select objects with red MIR power-law spectral energy distributions (SED) in the three shortest bands of WISE and properly accounts for the errors in the photometry and deviations of the MIR SEDs from a pure power-law. The completeness of the MIR selection is a strong function of luminosity. At L(2-10 keV)>10^{44} erg s^-1, where the AGN is expected to dominate the MIR emission, 97.1_{-4.8}^{+2.2}% and 76.5_{-18.4}^{+13.3}% of the BUXS type-1 and type-2 AGN meet the selection. Our technique shows one of the highest reliability and efficiency of detection of the X-ray selected luminous AGN population with WISE amongst those in the literature. In the area covered by the BUXS survey our selection identifies 2755 AGN candidates detected with SNR>5 in the three shorter wavelength bands of WISE with 38.5% having a detection at 2-10 keV X-ray energies. We also analyzed the possibility of including the 22um WISE band to select AGN candidates, but neither the completeness nor the reliability of the selection improves. This is likely due to both the significantly shallower depth at 22um compared with the first three bands of WISE and star-formation contributing to the 22um emission at the WISE 22um sensitivity.

Athena is an X-ray observatory-class mission concept, developed from April to December 2011 as a result of the reformulation exercise for L-class mission proposals in the framework of ESA's Cosmic Vision 2015-2025. Athena's science case is that of the Universe of extremes, from Black Holes to Large-scale structure. The specific science goals are structured around three main pillars: "Black Holes and accretion physics", "Cosmic feedback" and "Large-scale structure of the Universe". Underpinning these pillars, the study of hot astrophysical plasmas offered by Athena broadens its scope to virtually all corners of Astronomy. The Athena concept consists of two co-aligned X-ray telescopes, with focal length 12 m, angular resolution of 10" or better, and totalling an effective area of 1 m2 at 1 keV (0.5 m2 at 6 keV). At the focus of one of the telescopes there is a Wide Field Imager (WFI) providing a field of view of 24'\times 24', 150 eV spectral resolution at 6 keV, and high count rate capability. At the focus of the other telescope there is the X-ray Microcalorimeter Spectrometer (XMS), a cryogenic instrument offering a spectral resolution of 3 eV over a field of view of 2.3' \times 2.3'. Although Athena has not been selected as ESA's Cosmic Vision 2015-2025 L1 mission, its science goals and concept conform the basis of what should become ESA's X-ray astronomy flagship.

Surveys have revealed a class of object displaying both high X-ray luminosities (Lx > 10^42 erg/s), and a lack of a discernible active galactic nucleus (AGN) in the optical band. If these sources are powered by star formation activity alone, they would be the most extreme X-ray luminosity star forming galaxies known. We have investigated the mechanism driving the X-ray luminosities of such galaxies by studying the X-ray emission of three moderate redshift (z ~ 0.1) examples of this class, selected from a cross-correlation of the SDSS-DR5 and 2XMMp-DR0 catalogues. X-ray spatial and long-term variability diagnostics of these sources suggest that they are compact X-ray emitters. This result is supported by the detection of rapid short term variability in an observation of one of the sources. The X-ray spectra of all three sources are best fitted with a simple absorbed power-law model, thus betraying no significant signs of star formation. These results indicate that the X-ray emission is powered by AGN activity. But why do these sources not display optical AGN signatures? We show that the most likely explanation is that the optical AGN emission lines are being diluted by star formation signatures from within their host galaxies.

GRAVITAS is an X-ray observatory, designed and optimised to address the ESA Cosmic Vision theme of "Matter under extreme conditions". It was submitted as a response to the call for M3 mission proposals. The concept centres around an X-ray telescope of unprecedented effective area, which will focus radiation emitted from close to the event horizon of black holes or the surface of neutron stars. To reveal the nature and behaviour of matter in the most extreme astrophysical environments, GRAVITAS targets a key feature in the X-ray spectra of compact objects: the iron Kalpha line at ~6.5 keV. The energy, profile, and variability of this emission line, and the properties of the surrounding continuum emission, shaped by General Relativity (GR) effects, provide a unique probe of gravity in its strong field limit. Among its prime targets are hundreds of supermassive black holes in bright Active Galactic Nuclei (AGN), which form the perfect laboratory to help understand the physical processes behind black hole growth. Accretion plays a fundamental role in the shaping of galaxies throughout cosmic time, via the process of feedback. Modest (~sub-arcmin) spatial resolution would deliver the necessary sensitivity to extend high quality X-ray spectroscopy of AGN to cosmologically-relevant distances. Closer to home, ultra-high count rate capabilities and sub-millisecond time resolution enable the study of GR effects and the equation of state of dense matter in the brightest X-ray binaries in our own Galaxy, using multiple probes, such as the broad iron line, the shape of the disk continuum emission, quasi-periodic oscillations, reverberation mapping, and X-ray burst oscillations. Despite its breakthrough capabilities, all enabling technologies for GRAVITAS are already in a high state of readiness. It is based on ultra light-weight X-ray optics and a focal plane detector using silicon technology.

Low ionisation nuclear emission-line region (LINER) nuclei have been claimed to be different than other active galactic nuclei (AGN) due to the presence of complex absorbing structures along the line-of-sight and/or an inefficient mode of accretion onto the supermassive black hole. However, this issue is still open. We have investigated the broad band X-ray spectrum of NGC 4102, one of the most luminous LINERs in the Swift/BAT survey. We studied a 80 ksec Suzaku spectrum of NGC 4102, together with archival Chandra and Swift/BAT observations. We also studied the optical (3.5m/TWIN at Calar Alto observatory) and near-infrared (WHT/LIRIS at Observatorio Roque los Muchachos) spectra that were taken contemporaneous to the Suzaku data. There is strong evidence that NGC 4102 is a Compton-thick AGN, as suggested by the Swift/BAT detected intrinsic continuum and the presence of a strong narrow, neutral FeKa emission line. We have also detected ionised FeXXV emission lines in the Suzaku spectrum of the source. NGC 4102 shows a variable soft excess found at a significantly higher flux state by the time of Suzaku observations when compared to Chandra observations. Finally, a complex structure of absorbers is seen with at least two absorbers apart from the Compton-thick one, derived from the X-ray spectral analysis and the optical extinction.

The Survey Science Centre of the XMM-Newton satellite released the first incremental version of the 2XMM catalogue in August 2008 . With more than 220,000 X-ray sources, the 2XMMi was at that time the largest catalogue of X-ray sources ever published and thus constitutes an unprecedented resource for studying the high-energy properties of various classes of X-ray emitters such as AGN and stars. The advent of the 7th release of the Sloan Digital Sky Survey offers the opportunity to cross-match two major surveys and extend the spectral energy distribution of many 2XMMi sources towards the optical bands. We here present a cross-matching algorithm based on the classical likelihood ratio estimator. The method developed has the advantage of providing true probabilities of identifications without resorting to Monte-Carlo simulations. Over 30,000 2XMMi sources have SDSS counterparts with individual probabilities of identification higher than 90%. Using spectroscopic identifications from the SDSS DR7 catalogue supplemented by extraction from other catalogues, we build an identified sample from which the way the various classes of X-ray emitters gather in the multi dimensional parameter space can be analysed. We investigate two scientific use cases. In the first example we show how these multi-wavelength data can be used to search for new QSO2s. Although no specific range of observed properties allows us to identify Compton Thick QSO2s, we show that the prospects are much better for Compton Thin AGN2 and discuss several possible multi-parameter selection strategies. In a second example, we confirm the hardening of the mean X-ray spectrum with increasing X-ray luminosity on a sample of over 500 X-ray active stars and reveal that on average X-ray active M stars display bluer $g-r$ colour indexes than less active ones (abridged).

Using a suite of X-ray, mid-IR and optical active galactic nuclei (AGN) luminosity indicators, we search for Compton-thick (CT) AGNs with intrinsic L_X>10^42erg/s at z~0.03-0.2, a region of parameter space which is currently poorly constrained by deep narrow-field and high-energy (E>10keV) all-sky X-ray surveys. We have used the widest XMM-Newton survey (the serendipitous source catalogue) to select a representative sub-sample (14; ~10%) of the 147 X-ray undetected candidate CT AGNs in the Sloan Digital Sky Survey (SDSS) with f_X/f_[OIII]<1; the 147 sources account for ~50% of the overall Type-2 AGN population in the SDSS-XMM overlap region. We use mid-IR spectral decomposition analyses and emission-line diagnostics, determined from pointed Spitzer-IRS spectroscopic observations of these candidate CT AGNs, to estimate the intrinsic AGN emission (predicted L_X,2-10keV (0.2-30)x10^42erg/s). On the basis of the optical [OIII], mid-IR [OIV] and 6um AGN continuum luminosities we conservatively find that the X-ray emission in at least 6/14 (>43%) of our sample appear to be obscured by CT material with N_H>1.5x10^24cm^-2. Under the reasonable assumption that our 14 AGNs are representative of the overall X-ray undetected AGN population in the SDSS-XMM parent sample, we find that >20% of the optical Type-2 AGN population are likely to be obscured by CT material. This implies a space-density of log(Phi) >-4.9Mpc^-3 for CT AGNs with L_X>10^42erg/s at z~0.1, which we suggest may be consistent with that predicted by X-ray background synthesis models. Furthermore, using the 6um continuum luminosity to infer the intrinsic AGN luminosity and the stellar velocity dispersion to estimate M_BH, we find that the most conservatively identified CT AGNs in this sample may harbour some of the most rapidly growing black holes (median M_BH~3x10^7M_o) in the nearby Universe, with a median Eddington ratio of ~0.2.

We report the results of an optical campaign carried out by the XMM-Newton Survey Science Centre with the specific goal of identifying the brightest X-ray sources in the XMM-Newton Galactic Plane Survey of Hands et al. (2004). In addition to photometric and spectroscopic observations obtained at the ESO-VLT and ESO-3.6m, we used cross-correlations with the 2XMMi, USNO-B1.0, 2MASS and GLIMPSE catalogues to progress the identification process. Active coronae account for 16 of the 30 identified X-ray sources. Many of the identified hard X-ray sources are associated with massive stars emitting at intermediate X-ray luminosities of 10^32-34 erg/s. Among these are a very absorbed likely hyper-luminous star with X-ray/optical spectra and luminosities comparable with those of eta Carina, a new X-ray selected WN8 Wolf-Rayet star, a new Be/X-ray star belonging to the growing class of Gamma-Cas analogs and a possible supergiant X-ray binary of the kind discovered recently by INTEGRAL. One of the sources, XGPS-25 has a counterpart which exhibits HeII 4686 and Bowen CIII-NIII emission lines suggesting a quiescent or X-ray shielded Low Mass X-ray Binary, although its properties might also be consistent with a rare kind of cataclysmic variable (CV). We also report the discovery of three new CVs, one of which is a likely magnetic system. The soft (0.4-2.0 keV) band LogN-LogS curve is completely dominated by active stars in the flux range of 1x10^-13 to 1x10^-14 erg/cm2/s. In total, we are able to identify a large fraction of the hard (2-10 keV) X-ray sources in the flux range of 1x10^-12 to 1x10^-13 erg/cm2/s with Galactic objects at a rate consistent with that expected for the Galactic contribution only. (abridged)

We discuss the broad band X-ray properties of one of the largest samples of X-ray selected type-1 AGN to date (487 objects in total), drawn from the XMM-Newton Wide Angle Survey. The objects cover 2-10 keV luminosities from ~10^{42}-10^{45} erg s^{-1} and are detected up to redshift ~4. We constrain the overall properties of the broad band continuum, soft excess and X-ray absorption, along with their dependence on the X-ray luminosity and redshift and we discuss the implications for models of AGN emission. We constrained the mean spectral index of the broad band X-ray continuum to <Gamma>=1.96+-0.02 with intrinsic dispersion sigma=0.27_{-0.02}^{+0.01}. The continuum becomes harder at faint fluxes and at higher redshifts and luminosities. The dependence of Gamma with flux is likely due to undetected absorption rather than to spectral variation. We found a strong dependence of the detection efficiency of objects on the spectral shape which can have a strong impact on the measured mean continuum shapes of sources at different redshifts and luminosities. We detected excess absorption in ~3% of our objects, with column densities ~a few x10^{22} cm^{-2}. The apparent mismatch between the optical classification and X-ray properties of these objects is a challenge for the standard AGN unification model. We found that the fraction of objects with detected soft excess is ~36%. Using a thermal model, we constrained the soft excess mean temperature and intrinsic dispersion to <kT>~100 eV and sigma~34 eV. The origin of the soft excess as thermal emission from the accretion disk or Compton scattered disk emission is ruled out on the basis of the temperatures detected and the lack of correlation of the measured temperature with the X-ray luminosity (abridged).

We present the results of a search for galaxy clusters in Subaru-XMM Deep Field. We reach a depth for a total cluster flux in the 0.5-2 keV band of 2x10^{-15} ergs cm^{-2} s^{-1} over one of the widest XMM-Newton contiguous raster surveys, covering an area of 1.3 square degrees. Cluster candidates are identified through a wavelet detection of extended X-ray emission. The red sequence technique allows us to identify 57 cluster candidates. We report on the progress with the cluster spectroscopic follow-up and derive their properties based on the X-ray luminosity and cluster scaling relations. In addition, 3 sources are identified as X-ray counterparts of radio lobes, and in 3 further sources, X-ray counterpart of radio lobes provides a significant fraction of the total flux of the source. In the area covered by NIR data, our identification success rate achieves 86%. We detect a number of radio galaxies within our groups and for a luminosity-limited sample of radio galaxies we compute halo occupation statistics using a marked cluster mass function. We compare the cluster detection statistics in the SXDF with the predictions of concordance cosmology and current knowledge of the X-ray cluster properties, concluding that a reduction of concordance sigma_8 value by 5% is required in order to match the prediction of the model and the data. This conclusion still needs verification through the completion of cluster follow-up.

In this paper we present the two-point angular correlation function of the X-ray source population of 1063 XMM-Newton observations at high Galactic latitudes, comprising up to ~30000 sources over a sky area of 125.5 sq. deg, in three energy bands: 0.5-2 (soft), 2-10 (hard), and 4.5-10 (ultrahard) keV. We have measured the angular clustering of our survey and find significant positive clustering signals in the soft and hard bands, and a marginal clustering detection in the ultrahard band. We find dependency of the clustering strength on the flux limit and no significant differences in the clustering properties between sources with high hardness ratios and those with low hardness ratios. Our results show that obscured and unobscured objects share similar clustering properties and therefore they both reside in similar environments, in agreement with the unified model of AGN. We deprojected the angular clustering parameters via Limber's equation to compute their typical spatial lengths. From that we have inferred the typical mass of the dark matter haloes in which AGN at redshifts of ~1 are embedded. The short AGN lifetimes derived suggest that AGN activity might be a transient phase that can be experienced several times by a large fraction of galaxies throughout their lives.

One of the main themes in extragalactic astronomy for the next decade will be the evolution of galaxies over cosmic time. Many future observatories, including JWST, ALMA, GMT, TMT and E-ELT will intensively observe starlight over a broad redshift range, out to the dawn of the modern Universe when the first galaxies formed. It has, however, become clear that the properties and evolution of galaxies are intimately linked to the growth of their central black holes. Understanding the formation of galaxies, and their subsequent evolution, will therefore be incomplete without similarly intensive observations of the accretion light from supermassive black holes (SMBH) in galactic nuclei. To make further progress, we need to chart the formation of typical SMBH at z>6, and their subsequent growth over cosmic time, which is most effectively achieved with X-ray observations. Recent technological developments in X-ray optics and instrumentation now bring this within our grasp, enabling capabilities fully matched to those expected from flagship observatories at longer wavelengths.

Disk accretion may be the fundamental astrophysical process. Stars and planets form through the accretion of gas in a disk. Black holes and galaxies co-evolve through efficient disk accretion onto the central supermassive black hole. Indeed, approximately 20 percent of the ionizing radiation in the universe is supplied by disk accretion onto black holes. And large-scale structures - galaxy clusters - are dramatically affected by the relativistic jets that result from accretion onto black holes. Yet, we are still searching for observational answers to some very basic questions that underlie all aspects of the feedback between black holes and their host galaxies: How do disks transfer angular momentum to deliver gas onto compact objects? How do accretion disks launch winds and jets?

Since the seminal work of Penrose (1969) and Blandford & Znajek (1977), it has been realized that black hole spin may be an important energy source in astrophysics. The radio-loud/radio-quiet dichotomy in the AGN population is usually attributed to differences in black hole spin, with correlations between black hole spin and host galaxy morphology being hypothesized in order to explain why radio-loud AGN occur in early-type galaxies. X-ray observations are uniquely able to answer: Does black hole spin play a crucial role in powering relativistic jets such as those seen from radio-loud active galactic nuclei (AGN), Galactic microquasars, and Gamma-Ray Bursts? Indeed, the importance of black hole spin goes beyond its role as a possible power source: the spin of a supermassive black hole is a fossil record of its formation and subsequent growth history.

We discuss the optical properties, X-ray detections, and Active Galactic Nucleus (AGN) populations of four clusters at z ~ 1 in the Subaru-XMM Deep Field (SXDF). The velocity distribution and plausible extended X-ray detections are examined, as well as the number of X-ray point sources and radio sources associated with the clusters. We find that the two clusters that appear virialised and have an extended X-ray detection contain few, if any, AGN, whereas the two pre-virialised clusters have a large AGN population. This constitutes evidence that the AGN fraction in clusters is linked to the clusters' evolutionary stage. The number of X-ray AGN in the pre-virialised clusters is consistent with an overdensity of factor ~ 200; the radio AGN appear to be clustered with a factor of three to six higher. The median K-band luminosities of L_K = 1.7 +/- 0.7 L* for the X-ray sources and L_K = 2.3 +/- 0.1 L* for the radio sources support the theory that these AGN are triggered by galaxy interaction and merging events in sub-groups with low internal velocity distributions, which make up the cluster environment in a pre-virialisation evolutionary stage.

We present the X-ray luminosity function of AGN in three energy bands (Soft: 0.5-2 keV, Hard: 2-10 keV and Ultrahard: 4.5-7.5 keV). We have used the XMS survey along with other highly complete flux-limited deeper and shallower surveys for a total of 1009, 435 and 119 sources in the Soft, Hard and Ultrahard bands, respectively. We have modeled the intrinsic absorption of the Hard and Ultrahard sources (NH function) and computed the intrinsic X-ray luminosity function in all bands using a Maximum Likelihood fit technique to an analytical model. We find that the X-ray luminosity function (XLF) is best described by a Luminosity-Dependent Density Evolution (LDDE) model. Our results show a good overall agreement with previous results in the Hard band, although with slightly weaker evolution. Our model in the Soft band present slight discrepancies with other works in this band, the shape of our present day XLF being significantly flatter. We find faster evolution in the AGN detected in the Ultrahard band than those in the Hard band. The fraction of absorbed AGN in the Hard and Ultrahard bands is dependent on the X-ray luminosity. We find evidence of evolution of this fraction with redshift in the Hard band but not in the Ultrahard band, possibly due to the low statistics. Our best-fit XLF shows that the high-luminosity AGN are fully formed earlier than the less luminous AGN. The latter sources account for the vast majority of the accretion rate and mass density of the Universe, according to an anti-hierarchical black hole growth scenario.

Aims: Pointed observations with XMM-Newton provide the basis for creating catalogues of X-ray sources detected serendipitously in each field. This paper describes the creation and characteristics of the 2XMM catalogue. Methods: The 2XMM catalogue has been compiled from a new processing of the XMM-Newton EPIC camera data. The main features of the processing pipeline are described in detail. Results: The catalogue, the largest ever made at X-ray wavelengths, contains 246,897 detections drawn from 3491 public XMM-Newton observations over a 7-year interval, which relate to 191,870 unique sources. The catalogue fields cover a sky area of more than 500 sq.deg. The non-overlapping sky area is ~360 sq.deg. (~1% of the sky) as many regions of the sky are observed more than once by XMM-Newton. The catalogue probes a large sky area at the flux limit where the bulk of the objects that contribute to the X-ray background lie and provides a major resource for generating large, well-defined X-ray selected source samples, studying the X-ray source population and identifying rare object types. The main characteristics of the catalogue are presented, including its photometric and astrometric properties .

We aim to understand the multi-wavelength properties of 2XMM J123204+215255, the source with the most extreme X-ray-to-optical flux ratio amongst a sample of bright X-ray selected EXOs drawn from a cross-correlation of the 2XMMp catalogue with the SDSS-DR5 catalogue. We use 2XMMp X-ray data, SDSS-DR5, NOT and UKIRT optical/NIR photometric data and Subaru MOIRCS IR spectroscopy to study the properties of 2XMM J123204+215255. We created a model SED including an obscured QSO and the host galaxy component to constrain the optical/IR extinction and the relative contribution of the AGN and the galaxy to the total emission. 2XMM J123204+215255 is a bright X-ray source with f_X~10^{-12} erg cm^{-2} s^{-1} (2-10 keV energy band) which has no detection down to a magnitude i' > 25.2. NIR imaging reveals a faint K-band counterpart and NIR spectroscopy shows a single broad (FWHM=5300 km/s) emission line, which is almost certainly H-alpha at z=1.87. The X-ray spectrum shows evidence of significant absorption (N_H > 10^{23} cm^{-2}), typical of type 2 AGN, but the broad H-alpha emission suggests a type 1 AGN classification. The very red optical/NIR colours (i'-K > 5.3) strongly suggest significant reddening however. We find that simple modelling can successfully reproduce the NIR continuum and strongly constrain the intrinsic nuclear optical/IR extinction to A_V~4, which turns out to be much smaller than the expected from the X-ray absorption (assuming Galactic gas-to-dust ratio).

One of the most important parameters in the XRB (X-ray background) synthesis models is the average efficiency of accretion onto SMBH (super-massive black holes). This can be inferred from the shape of broad relativistic Fe lines seen in X-ray spectra of AGN (active galactic nuclei). Several studies have tried to measure the mean Fe emission properties of AGN at different depths with very different results. We compute the mean Fe emission from a large and representative sample of AGN X-ray spectra up to redshift ~ 3.5. We developed a method of computing the rest-frame X-ray average spectrum and applied it to a large sample (more than 600 objects) of type 1 AGN from two complementary medium sensitivity surveys based on XMM-Newton data, the AXIS and XWAS samples. This method makes use of medium-to-low quality spectra without needing to fit complex models to the individual spectra but with computing a mean spectrum for the whole sample. Extensive quality tests were performed by comparing real to simulated data, and a significance for the detection of any feature over an underlying continuum was derived. We detect with a 99.9% significance an unresolved Fe K-alpha emission line around 6.4 keV with an EW ~ 90 eV, but we find no compelling evidence of any significant broad relativistic emission line in the final average spectrum. Deviations from a power law around the narrow line are best represented by a reflection component arising from cold or low-ionization material. We estimate an upper limit for the EW of any relativistic line of 400 eV at a 3 sigma confidence level. We also marginally detect the so-called Iwasawa-Taniguchi effect on the EW for the unresolved emission line, which appears weaker for higher luminosity AGN.

We have constrained the extragalactic source count distributions over a broad range of X-ray fluxes and in various energy bands to test whether the predictions from X-ray background synthesis models agree with the observational constraints provided by our measurements. We have used 1129 XMM-Newton observations at |b|>20 deg covering a sky area of 132.3 deg^2 to compile the largest complete samples of X-ray objects to date in the 0.5-1 keV, 1-2 keV, 2-4.5 keV, 4.5-10 keV, 0.5-2 keV and 2-10 keV energy bands. Our survey includes in excess of 30,000 sources down to ~10^-15 erg/cm^2/s below 2 keV and down to ~10^{-14} erg/cm^2/s above 2 keV. A break in the source count distributions was detected in all energy bands except the 4.5-10 keV band. An analytical model comprising 2 power-law components cannot adequately describe the curvature seen in the source count distributions. The shape of the logN(>S)-logS is strongly dependent on the energy band with a general steepening apparent as we move to higher energies. This is due to non-AGN populations, comprised mainly of stars and clusters of galaxies, contribute up to 30% of the source population at energies <2 keV and at fluxes >10^{-13} erg/cm^2/s, and these populations of objects have significantly flatter source count distributions than AGN. We find a substantial increase in the relative fraction of hard X-ray sources at higher energies, from >55% below 2 keV to >77% above 2 keV. However the majority of sources detected above 4.5 keV still have significant flux below 2 keV. Comparison with predictions from the synthesis models suggest that the models might be overpredicting the number of faint absorbed AGN, which would call for fine adjustment of some model parameters such as the obscured to unobscured AGN ratio and/or the distribution of column densities at intermediate obscuration.

We present the X-ray source catalog in the Subaru/XMM-Newton deep survey. A continuous area of 1.14 deg^2 centered at R.A. = 02h18m and Dec. = -05d is mapped by seven pointings with XMM-Newton covering the 0.2-10 keV band. From the combined images of the EPIC pn and MOS cameras, we detect 866, 1114, 645, and 136 sources with sensitivity limits of 6x10^{-16}, 8x10^{-16}, 3x10^{-15}, and 5x10^{-15} erg cm^{-2} s^{-1} in the 0.5-2, 0.5-4.5, 2-10, and 4.5-10 keV bands, respectively, with detection likelihood >= 7 (corresponding to a confidence level of 99.91%). The catalog consists of 1245 sources in total including 32 extended-source candidates. The averaged log N-log S relations are in good agreement with previous results, bridging the flux range between Chandra deep surveys and brighter surveys. The log N-log S relations show significant spatial variation among pointings on a scale of 0.2 deg^2. Analyzing the auto correlation function, we detect significant clustering signals from the 0.5-2 keV band sample, which can be fit with a power law form (\theta/\theta_c)^{-0.8} with a correlation length of \theta_c=5.9^{+1.0}_{-0.9} arcsec when the integral constraint term is included. In the 2-10 keV band, however, the clustering is not significant with a 90% upper limit of \theta_c < 1.5 arcsec.

We report the serendipituous discovery of the new eclipsing polar 2XMMp J131223.4+173659. Its striking X-ray light curve attracted immediate interest when we were visually inspecting the source products of the 2XMMp catalogue. This light curve revealed its likely nature as a magnetic cataclysmic variable of AM Herculis (or polar) type with an orbital period of ~92 min, which was confirmed by follow-up optical spectroscopy and photometry. 2XMMp J131223.4+173659 probably has a one-pole accretion geometry. It joins the group of now nine objects that show no evidence of a soft component in their X-ray spectra despite being in a high accretion state, thus escaping ROSAT/EUVE detection. We discuss the likely accretion scenario, the system parameters, and the spectral energy distribution.

We present the results of the X-ray spectral analysis of an XMM-Newton-selected type II QSO sample with z>0.5 and 0.5-10 keV flux of 0.3-33 x 10^{-14} erg/s/cm^2. The distribution of absorbing column densities in type II QSOs is investigated and the dependence of absorption on X-ray luminosity and redshift is studied. We inspected 51 spectroscopically classified type II QSO candidates from the XMM-Newton Marano field survey, the XMM-Newton-2dF wide angle survey (XWAS), and the AXIS survey to set-up a well-defined sample with secure optical type II identifications. Fourteen type II QSOs were classified and an X-ray spectral analysis performed. Since most of our sources have only ~40 X-ray counts (PN-detector), we carefully studied the fit results of the simulated X-ray spectra as a function of fit statistic and binning method. We determined that fitting the spectra with the Cash-statistic and a binning of minimum one count per bin recovers the input values of the simulated X-ray spectra best. Above 100 PN counts, the free fits of the spectrum's slope and absorbing hydrogen column density are reliable. We find only moderate absorption (N_H=(2-10) x 10^22 cm^-2) and no obvious trends with redshift and intrinsic X-ray luminosity. In a few cases a Compton-thick absorber cannot be excluded. Two type II objects with no X-ray absorption were discovered. We find no evidence for an intrinsic separation between type II AGN and high X-ray luminosity type II QSO in terms of absorption. The stacked X-ray spectrum of our 14 type II QSOs shows no iron K-alpha line. In contrast, the stack of the 8 type II AGN reveals a very prominent iron K-alpha line at an energy of ~ 6.6 keV and an EW ~ 2 keV.

We present the properties of active galactic nuclei (AGN) selected by optical variability in the Subaru/XMM-Newton Deep Field (SXDF). Based on the locations of variable components and light curves, 211 optically variable AGN were reliably selected. We made three AGN samples; X-ray detected optically non-variable AGN (XA), X-ray detected optically variable AGN (XVA), and X-ray undetected optically variable AGN (VA). In the VA sample, we found a bimodal distribution of the ratio between the variable component flux and the host flux. One of these two components in the distribution, a class of AGN with a faint variable component $i'_{\rm{vari}}\sim25$ mag in bright host galaxies $i'\sim21$ mag, is not seen in the XVA sample. These AGN are expected to have low Eddington ratios if we naively consider a correlation between bulge luminosity and black hole mass. These galaxies have photometric redshifts $z_{\rm{photo}}\sim0.5$ and we infer that they are low-luminosity AGN with radiatively inefficient accretion flows (RIAFs). The properties of the XVA and VA objects and the differences from those of the XA objects can be explained within the unified scheme for AGN. Optical variability selection for AGN is an independent method and could provide a complementary AGN sample which even deep X-ray surveys have not found.

We present our survey for optically faint variable objects using multi-epoch (8-10 epochs over 2-4 years) $i'$-band imaging data obtained with Subaru Suprime-Cam over 0.918 deg$^2$ in the Subaru/XMM-Newton Deep Field (SXDF). We found 1040 optically variable objects by image subtraction for all the combinations of images at different epochs. This is the first statistical sample of variable objects at depths achieved with 8-10m class telescopes or HST. The detection limit for variable components is $i'_{\rm{vari}}\sim25.5$ mag. These variable objects were classified into variable stars, supernovae (SNe), and active galactic nuclei (AGN), based on the optical morphologies, magnitudes, colors, and optical-mid-infrared colors of the host objects, spatial offsets of variable components from the host objects, and light curves. Detection completeness was examined by simulating light curves for periodic and irregular variability. We detected optical variability for $36\pm2%$ ($51\pm3%$ for a bright sample with $i'<24.4$ mag) of X-ray sources in the field. Number densities of variable obejcts as functions of time intervals $\Delta{t}$ and variable component magnitudes $i'_{\rm{vari}}$ are obtained. Number densities of variable stars, SNe, and AGN are 120, 489, and 579 objects deg$^{-2}$, respectively. Bimodal distributions of variable stars in the color-magnitude diagrams indicate that the variable star sample consists of bright ($V\sim22$ mag) blue variable stars of the halo population and faint ($V\sim23.5$ mag) red variable stars of the disk population. There are a few candidates of RR Lyrae providing a possible number density of $\sim10^{-2}$ kpc$^{-3}$ at a distance of $>150$ kpc from the Galactic center.

AIMS: We present the optical classification and redshift of 348 X-ray selected sources from the XMM-Newton Bright Serendipitous Survey (XBS) which contains a total of 400 objects (identification level = 87%). About 240 are new identifications. In particular, we discuss in detail the classification criteria adopted for the Active Galactic Nuclei population. METHODS: By means of systematic spectroscopic campaigns and through the literature search we have collected an optical spectrum for the large majority of the sources in the XBS survey and applied a well-defined classification ``flow-chart''. RESULTS: We find that the AGN represent the most numerous population at the flux limit of the XBS survey (~10^-13 erg cm^-2 s^-1) constituting 80% of the XBS sources selected in the 0.5-4.5 keV energy band and 95% of the ``hard'' (4.5-7.5 keV) selected objects. Galactic sources populate significantly the 0.5-4.5 keV sample (17%) and only marginally (3%) the 4.5-7.5 keV sample. The remaining sources in both samples are clusters/groups of galaxies and normal galaxies (i.e. probably not powered by an AGN). Furthermore, the percentage of type2 AGN (i.e. optically absorbed AGNs with A_V>2mag) dramatically increases going from the 0.5-4.5 keV sample (f=N_AGN2/N_AGN=7%) to the 4.5-7.5 keV sample (f=32%). We finally propose two simple diagnostic plots that can be easily used to obtain the spectral classification for relatively low redshift AGNs even if the quality of the spectrum is not good.

We present the XMM-Newton Medium sensitivity Survey (XMS), including a total of 318 X-ray sources found among the serendipitous content of 25 XMM-Newton target fields. The XMS comprises four largely overlapping source samples selected at soft (0.5-2 keV), intermediate (0.5-4.5 keV), hard (2-10 keV) and ultra-hard (4.5-7.5 keV) bands, the first three of them being flux-limited. We report on the optical identification of the XMS samples, complete to 85-95%. At the intermediate flux levels sampled by the XMS we find that the X-ray sky is largely dominated by Active Galactic Nuclei. The fraction of stars in soft X-ray selected samples is below 10%, and only a few per cent for hard selected samples. We find that the fraction of optically obscured objects in the AGN population stays constant at around 15-20% for soft and intermediate band selected X-ray sources, over 2 decades of flux. The fraction of obscured objects amongst the AGN population is larger (~35-45%) in the hard or ultra-hard selected samples, and constant across a similarly wide flux range. The distribution in X-ray-to-optical flux ratio is a strong function of the selection band, with a larger fraction of sources with high values in hard selected samples. Sources with X-ray-to-optical flux ratios in excess of 10 are dominated by obscured AGN, but with a significant contribution from unobscured AGN.

Our goal is to characterize AGN populations by comparing their X-ray and optical classifications. We present a sample of 99 spectroscopically identified X-ray point sources in the XMM-LSS survey which are significantly detected in the [2-10] keV band, and with more than 80 counts. We performed an X-ray spectral analysis for all of these 99 X-ray sources. Introducing the fourfold point correlation coefficient, we find only a mild correlation between the X-ray and the optical classifications, as up to 30% of the sources have differing X-ray and optical classifications: on one hand, 10% of the type 1 sources present broad emission lines in their optical spectra and strong absorption in the X-rays. These objects are highly luminous AGN lying at high redshift and thus dilution effects are totally ruled out, their discrepant nature being an intrinsic property. Their X-ray luminosities and redshifts distributions are consistent with those of the unabsorbed X-ray sources with broad emission lines. On the other hand, 25/32 are moderate luminosity AGN, which are both unabsorbed in the X-rays and only present narrow emission lines in their optical spectra. The majority of them have an optical spectrum which is representative of the host galaxy. We finally infer that dilution of the AGN by the host galaxy seems to account for their nature. 5/25 have been defined as Seyfert 2. In conclusion, most of these 32 discrepant cases can be accounted for by the standard AGN unified scheme, as its predictions are not met for only 12% of the 99 X-ray sources. ABRIDGED

We have obtained deep optical spectroscopic data of the highest-redshift cluster candidate (z ~ 1.4, CVB13) selected by Van Breukelen et al. (2006) in a photometric optical/infrared catalogue of the Subaru XMM-Newton Deep Field. The data, which comprise 104 targeted galaxies, were taken with the DEep Imaging Multi-Object Spectrograph (DEIMOS) on the Keck 2 telescope and yielded 31 secure redshifts in the range 1.25 < z < 1.54 within a 7' x 4' field centred on CVB13. Instead of one massive cluster at z = 1.4, we find evidence for three projected structures at z = 1.40, z = 1.45, and z = 1.48. The most statistically robust of these structures, at z = 1.454, has six spectroscopically confirmed galaxies. Its total mass is estimated at > 10^14 M_sun and it may therefore be termed a cluster. There is an X-ray source at the cluster position which is marginally spatially resolved but whose X-ray spectrum is too hard to be thermal cluster emission. Its origin could be the summed X-ray emission from active galaxies in, and projected onto, the cluster. Serendipitously we have discovered a cluster at z = 1.28 with a mass of > 10^14 M_sun at the same position on the sky, comprising six spectroscopically confirmed cluster galaxies and at least one additional radio source. The selection of CVB13 for the cluster catalogue was evidently aided by the superposition of other, presumably lower-mass, structures, whereas the single cluster at z = 1.28 contained too few galaxies to be isolated by the same algorithm. Given the complicated nature of such structures, caution must be employed when measuring the mass function of putative high-redshift clusters with photometric techniques alone.

We present new results on the cosmological evolution of the near-infrared galaxy luminosity function, derived from the analysis of a new sample of \~22,000 K(AB) < 22.5 galaxies selected over an area of 0.6 square degrees from the Early Data Release of the UKIDSS Ultra Deep Survey (UDS). Our study has exploited the multi-wavelength coverage of the UDS field provided by the new UKIDSS WFCAM K and J-band imaging, the Subaru/XMM-Newton Deep Survey and the Spitzer-SWIRE Survey. The unique combination of large area and depth provided by this new survey minimises the complicating effect of cosmic variance and has allowed us, for the first time, to trace the evolution of the brightest sources out to z~2 with good statistical accuracy. In agreement with previous studies we find that the characteristic luminosity of the near-infrared luminosity function brightens by 1 magnitude between z=0 and z~2, while the total density decreases by a factor ~2. Using the rest-frame (U-B) colour to split the sample into red and blue galaxies, we confirm the classic luminosity-dependent colour bimodality at z<1. However, the strength of the colour bimodality is found to be a decreasing function of redshift, and seems to disappear by z>1.5. Due to the large size of our sample we are able to investigate the differing cosmological evolution of the red and blue galaxy populations. It is found that the space density of the brightest red galaxies (M_K < -23) stays approximately constant with redshift, and that these sources dominate the bright-end of the luminosity function at redshifts z<1. In contrast, the brightening of the characteristic luminosity and mild decrease in space density displayed by the blue galaxy population leads them to dominate the bright-end of the luminosity function at redshifts z>1.

We present multi-object spectroscopy of galaxies in the immediate (Mpc-scale) environments of four low-power (L_1.4 GHz < 10^25 W/Hz) radio galaxies at z~0.5, selected from the Subaru/XMM-Newton Deep Field. We use the spectra to calculate velocity dispersions and central redshifts of the groups the radio galaxies inhabit, and combined with XMM-Newton (0.3-10 keV) X-ray observations investigate the L_X--sigma_v and T_X--sigma_v scaling relationships. All the radio galaxies reside in moderately rich groups -- intermediate environments between poor groups and rich clusters, with remarkably similar X-ray properties. We concentrate our discussion on our best statistical example that we interpret as a low-power (FRI) source triggered within a sub-group, which in turn is interacting with a nearby group of galaxies, containing the bulk of the X-ray emission for the system -- a basic scenario which can be compared to more powerful radio sources at both high (z>4) and low (z<0.1) redshifts. This suggests that galaxy-galaxy interactions triggered by group mergers may play an important role in the life-cycle of radio galaxies at all epochs and luminosities.

Using mid-infrared and radio selection criteria, we pre-select a sample of candidate high-redshift type-2 quasars in the Subaru XMM-Newton Deep Field (SXDF). To filter out starburst contaminants, we use a bayesian method to fit the spectral energy distributions (SEDs) between 24-microns and B-band, obtain photometric redshifts, and identify the best candidates for high-z type-2 quasars. This leaves us with 12 z_phot >= 1.7 type-2 quasar candidates in an area ~0.8 deg^2, of which only two have secure X-ray detections. The two detected sources have estimated column densities N_H~2 & 3x10^27 m^-2, i.e. heavily obscured but Compton-thin quasars. Given the large bolometric luminosities and redshifts of the undetected objects, the lack of X-ray detections suggests extreme absorbing columns N_H >= 10^28 m^-2 are typical. We have found evidence for a population of ``Compton-thick'' high-redshift type-2 quasars, at least comparable to, and probably larger than the type-1 quasar population, although spectroscopic confirmation of their AGN nature is important.

We present optical and X-ray data for a sample of serendipitous XMM-Newton sources that are selected to have 0.5-2 keV vs 2-4.5 keV X-ray hardness ratios which are harder than the X-ray background. The sources have 2-4.5 keV X-ray flux >= 10^-14 cgs, and in this paper we examine a subsample of 42 optically bright (r < 21) sources; this subsample is 100 per cent spectroscopically identified. All but one of the optical counterparts are extragalactic, and we argue that the single exception, a Galactic M star, is probably a coincidental association. The X-ray spectra are consistent with heavily absorbed power laws (21.8 < log NH < 23.4), and all of them appear to be absorbed AGN. The majority of the sources show only narrow emission lines in their optical spectra, implying that they are type-2 AGN. Only a small fraction of the sources (7/42) show broad optical emission lines, and all of these have NH < 10^23 cm^-2. This implies that ratios of X-ray absorption to optical/UV extinction equivalent to > 100 times the Galactic gas-to-dust ratio are rare in AGN absorbers (at most a few percent of the population), and may be restricted to broad absorption-line QSOs. Seven objects appear to have an additional soft X-ray component in addition to the heavily absorbed power law. We consider the implications of our results in the light of the AGN unified scheme. We find that the soft components in narrow-line objects are consistent with the unified scheme provided that > 4 per cent of broad-line AGN have ionised absorbers that attenuate their soft X-ray flux by >50 per cent. In at least one of the X-ray absorbed, broad-line AGN in our sample the X-ray spectrum requires an ionised absorber, consistent with this picture.

We investigate colour selection techniques for high redshift galaxies in the UKIDSS Ultra Deep Survey Early Data Release (UDS EDR). Combined with very deep Subaru optical photometry, the depth (K_AB = 22.5) and area (0.62 deg^2) of the UDS EDR allows us to investigate optical/near-IR selection using a large sample of over 30,000 objects. By using the B-z, z-K colour-colour diagram (the BzK technique) we identify over 7500 candidate galaxies at z > 1.4, which can be further separated into passive and starforming systems (pBzK and sBzK respectively). Our unique sample allows us to identify a new feature not previously seen in BzK diagrams, consistent with the passively evolving track of early type galaxies at z < 1.4. We also compare the BzK technique with the R-K colour selection of Extremely Red Objects (EROs) and the J-K selection of Distant Red Galaxies (DRGs), and quantify the overlap between these populations. We find that the majority of DRGs, at these relatively bright magnitudes are also EROs. Since previous studies have found that DRGs at these magnitudes have redshifts of z ~ 1 we determine that these DRG/ERO galaxies have SEDs consistent with being dusty star-forming galaxies or AGN at z < 2. Finally we observe a flattening in the number counts of pBzK galaxies, similar to other studies, which may indicate that we are sampling the luminosity function of passive z > 1 galaxies over a narrow redshift range.

AXIS (An XMM-Newton International Survey) is a survey of 36 high Galactic latitude XMM-Newton observations covering 4.8 deg2 and containing 1433 serendipitous X-ray sources detected with 5-sigma significance. We have studied the X-ray source counts in four energy bands soft (0.5-2 keV), hard (2-10 keV), XID (0.5-4.5 keV) and ultra-hard (4.5-7.5 keV). We have combined this survey with shallower and deeper surveys. Our source counts results are compatible with most previous samples in the soft, XID, ultra-hard and hard bands. The fractions of the XRB resolved in the surveys used in this work are 87%, 85%, 60% and 25% in the soft, hard, XID and ultra-hard bands, respectively. Extrapolation of our source counts to zero flux are not enough to saturate the XRB intensity. Only galaxies and/or absorbed AGN may be able contribute the remaining unresolved XRB intensity. Our results are compatible, within the errors, with recent revisions of the XRB intensity in the soft and hard bands. The maximum fractional contribution to the XRB comes from fluxes within about a decade of the break in the source counts (~1e-14 cgs), reaching ~50% of the total in the soft and hard bands. Using only AXIS sources, we have studied the angular correlation in those bands using a novel robust technique. Angular clustering (widely distributed over the sky and not confined to a few deep fields) is detected at 99-99.9% significance in the soft and XID bands, with no detection in the hard and ultra-hard band (probably due to the smaller number of sources). We cannot confirm the detection of significantly stronger clustering in the hard-spectrum hard sources. Medium depth surveys such as AXIS are essential to determine the evolution of the X-ray emission in the Universe below 10 keV.

We aim to test a method of efficiently selecting X-ray obscured AGN in the 2XMM-Newton EPIC Serendipitous Source Catalogue. By means of a strong correlation established using the XMM-Newton Hard Bright Sample between the intrinsic absorption and the hardness ratio to the 0.5-2.0 keV and 2.0-4.5 keV bands, an efficient way of selecting absorbed sources has been worked out. A hardness ratio selection based on the 2XMM-Newton pre-release Source Catalogue led us to the definition of candidates likely to be obscured in X-rays. X-ray and optical spectral analysis were performed for three objects. Strong absorption (NH > 10^{22} cm^{-2}) was detected from the X-ray analysis, confirming the efficiency of the method used to select obscured sources. The presence of absorption is also revealed in the optical band, although at a significantly lower level than inferred from the X-ray band.

We describe the number counts and spatial distribution of 239 Distant Red Galaxies (DRGs), selected from the Early Data Release of the UKIDSS Ultra Deep Survey. The DRGs are identified by their very red infrared colours with (J-K)AB>1.3, selected over 0.62 sq degree to a 90% completeness limit of KAB~20.7. This is the first time a large sample of bright DRGs has been studied within a contiguous area, and we provide the first measurements of their number counts and clustering. The population shows strong angular clustering, intermediate between those of K-selected field galaxies and optical/infrared-selected Extremely Red Galaxies. Adopting the redshift distributions determined from other recent studies, we infer a high correlation length of r0~11 h-1 Mpc. Such strong clustering could imply that our galaxies are hosted by very massive dark matter halos, consistent with the progenitors of present-day L>L* elliptical galaxies.

We investigate jet formation in black-hole systems using 3-D General Relativistic Particle-In-Cell (GRPIC) and 3-D GRMHD simulations. GRPIC simulations, which allow charge separations in a collisionless plasma, do not need to invoke the frozen condition as in GRMHD simulations. 3-D GRPIC simulations show that jets are launched from Kerr black holes as in 3-D GRMHD simulations, but jet formation in the two cases may not be identical. Comparative study of black hole systems with GRPIC and GRMHD simulations with the inclusion of radiate transfer will further clarify the mechanisms that drive the evolution of disk-jet systems.

We describe deep radio imaging at 1.4-GHz of the 1.3 square degree Subaru/XMM-Newton Deep Field (SXDF), made with the Very Large Array in B and C configurations. We present a radio map of the entire field, and a catalogue of 505 sources covering 0.8 square degrees to a peak flux density limit of 100 microJy. Robust optical identifications are provided for 90% of the sources, and suggested IDs are presented for all but 14 (of which 7 are optically blank, and 7 are close to bright contaminating objects). We show that the optical properties of the radio sources do not change with flux density, suggesting that AGNs continue to contribute significantly at faint flux densities. We test this assertion by cross-correlating our radio catalogue with the X-ray source catalogue and conclude that radio-quiet AGNs become a significant population at flux densities below 300 microJy, and may dominate the population responsible for the flattening of the radio source counts if a significant fraction of them are Compton-thick.

We present the first cluster catalogue extracted from the UKIRT Infrared Deep Sky Survey Early Data Release. The catalogue is created using UKIDSS Ultra Deep Survey infrared J and K data combined with 3.6 micro-m and 4.5 micro-m Spitzer bands and optical BVRi'z' imaging from the Subaru Telescope over 0.5 square degrees in the Subaru XMM-Newton Deep Field. We have created a new cluster-detection algorithm, based on the Friends-Of-Friends and Voronoi Tessellation methods, which utilises probability distribution functions derived from a photometric redshift analysis. We employ mock catalogues to understand the selection effects and contamination associated with the algorithm. The cluster catalogue contains 13 clusters at redshifts 0.61 <= z <= 1.39 with luminosities 10 L* <~ L_tot <~ 50 L*, corresponding to masses 5 x 10^13 M_sun <~ M_cluster <~ 3 x 10^14 M_sun for (M/M_sun) / (L/L_sun) = 75h. The measured sky surface density of ~ 10 deg^-2 for high-redshift (z=0.5-1.5), massive (>10^14 M_sun) clusters is precisely in line with theoretical predictions presented by Kneissl et al. (2001).

We construct a sample of extremely red objects (EROs) within the UKIDSS Ultra Deep Survey by combining the Early Data Release with optical data from the Subaru/XMM-Newton Deep Field. We find a total of 3715 objects over 2013 sq. arcmin with R-K>5.3 and K<=20.3, which is a higher surface density than found by previous studies. This is partly due to our ability to use a small aperture in which to measure colours, but is also the result of a genuine overdensity of objects compared to other fields. We separate our sample into passively-evolving and dusty star-forming galaxies using their RJK colours and investigate their radio properties using a deep radio map. The dusty population has a higher fraction of individually-detected radio sources and a higher mean radio flux density among the undetected objects, but the passive population has a higher fraction of bright radio sources, suggesting that AGNs are more prevalent among the passive ERO population.

We have exploited the large area coverage of the combined UKIDSS Ultra Deep Survey (UDS) and Subaru/XMM-Newton Deep Survey (SXDS) to search for bright Lyman-break galaxies (LBGs) at z >= 5. Using the available optical+near-infrared photometry to efficiently exclude low-redshift contaminants, we identify nine z >= 5 LBG candidates brighter than z'=25(AB) within the 0.6 square degree overlap region between the UDS early data release (EDR) and the optical coverage of the SXDS. Accounting for selection incompleteness, we estimate the corresponding surface density of z >= 5 LBGs with z'<=25(AB) to be 0.005+/-0.002 per square arcmin. Modelling of the optical+near-infrared photometry constrains the candidates' redshifts to lie in the range 5.1 < z < 5.9, and provides estimates for their stellar masses. Although the stellar mass estimates are individually uncertain, a stacking analysis suggests that the typical stellar mass of the LBG candidates is >~5x10^10 Msun which, if confirmed, places them amongst the most massive galaxies currently known at z >= 5. It is found that Lambda CDM structure formation can produce sufficient numbers of dark matter halos at z >= 5 to accommodate our estimated number density of massive LBGs for plausible values of sigma_8 and the ratio of stellar to dark matter. Moreover, it is found that recent galaxy formation models can also account for the existence of such massive galaxies at z >= 5. Finally, no evidence is found for the existence of LBGs with stellar masses in excess of ~3x10^11 Msun at this epoch, despite the large co-moving volume surveyed.

We present the XMM-Newton and the optical-VLT spectra along with the optical and the near-infrared photometric data of one of the brightest X-ray (F(2-10 keV)~1e-13 erg/s cm^2) extremely red objects (R-K>=5) discovered so far. The source, XBSJ0216-0435, belongs to the XMM-Newton Bright Serendipitous Survey and it has extreme X-ray-to-optical (~220) and X-ray-to-near-infrared (~60) flux ratios. Thanks to its brightness, the X-ray statistics are good enough for an accurate spectral analysis by which the presence of an X-ray obscured (NH>1e22 cm^-2) QSO (L(2-10 keV)=4e45 erg/s) is determined. A statistically significant (~99%) excess around 2 keV in the observed-frame suggests the presence of an emission line. By assuming that this feature corresponds to the iron Kalpha line at 6.4 keV, a first estimate of the redshift of the source is derived (z_x~2). The presence of a high redshift QSO2 has been finally confirmed through dedicated VLT optical spectroscopic observations (z_o=1.985+/-0.002). This result yields to an optical validation of a new X-ray Line Emitting Object (XLEO) for which the redshift has been firstly derived from the X-ray data. XBSJ0216-0435 can be considered one of the few examples of X-ray obscured QSO2 at high redshift for which a detailed X-ray and optical spectral analysis has been possible. The spectral energy distribution from radio to X-rays is also presented. Finally from the near-infrared data the luminosity and the stellar mass of the host galaxy has been estimated finding a new example of the coexistence at high-z between massive galaxies and powerful QSOs.

(Abridged) This paper presents the data recently released for the XMM-Newton/WFI survey carried out as part of the ESO Imaging Survey (EIS) project. The aim of this survey is to provide optical imaging follow-up data in BVRI for identification of serendipitously detected X-ray sources in selected XMM-Newton fields. In this paper, fully calibrated individual and stacked images of 12 fields as well as science-grade catalogs for the 8 fields located at high-galactic latitude are presented. The data covers an area of \sim 3 square degrees for each of the four passbands. The median limiting magnitudes (AB system, 2" aperture, 5\sigma detection limit) are 25.20, 24.92, 24.66, and 24.39 mag for B-, V-, R-, and I-band, respectively. These survey products, together with their logs, are available to the community for science exploitation in conjunction with their X-ray counterparts. Preliminary results from the X-ray/optical cross-correlation analysis show that about 61% of the detected X-ray point sources in deep XMM-Newton exposures have at least one optical counterpart within 2" radius down to R \simeq 25 mag, 50% of which are so faint as to require VLT observations thereby meeting one of the top requirements of the survey, namely to produce large samples for spectroscopic follow-up with the VLT, whereas only 15% of the objects have counterparts down to the DSS limiting magnitude.

GRB031203 was a very low apparent luminosity gamma-ray burst (GRB). It was also the first GRB with a dust-scattered X-ray halo. The observation of the halo allowed us to infer the presence of a large soft X-ray fluence in the total burst output. It has, however, also been claimed that GRB031203 was intrinsically sub-energetic, representative of a class of spectrally hard, low-energy bursts quite different from other GRBs. Reanalysis of the available data confirms our original finding that GRB031203 had a very large soft X-ray component, the time of which can be constrained to within a few minutes after the burst, implying that while GRB031203 did indeed have a very low apparent luminosity, it was also very soft. Notions propagated in the literature regarding the uncertainties in the determination of the soft X-ray fluence from the halo data and on the available constraints from the hard X-ray data are addressed: the properties of the scattering dust along the line of sight (grain sizes, precise location and the geometry) are determined directly from the high quality X-ray data so that there is little uncertainty about the scatterer; constraints on the X-ray lightcurve from the Integral spacecraft at the time of the soft X-ray blast are not complete because of a slew in the spacecraft pointing shortly after the burst. Claims that GRB031203 was intrinsically under-energetic and that it represents a deviation from the luminosity-peak energy relation do not appear to be substantiated by the data, regardless of whether the soft X-ray component is declared part of the prompt emission or the afterglow. We conclude that the difference between the soft and hard X-ray spectra from XMM-Newton and Integral indicate that a second soft pulse probably occurred in this burst as has been observed in other GRBs, notably GRB050502B.

We report the serendipitous discovery of several unresolved X-ray sources lying in the prominent spiral arms of the galaxy KUG 0214-057 in XMM-Newton observations. The location of these X-ray sources strongly suggests that at least three, and possibly four, of these may be physically related to the galaxy. The luminosity of each of these sources at the distance of KUG 0214-057 is > 5 x 10^39 erg/s (0.3-10 keV), making each a strong candidate ultraluminous X-ray source (ULX). Using the ULXs as a metric implies that this relatively low-mass galaxy may be experiencing rather intense starburst activity. The serendipitous discovery of these ULXs suggests that such objects are not a negligible component of the overall extragalactic X-ray source population.

We report on the results of a detailed analysis of the X-ray spectral properties of a large sample of sources detected serendipitously with the XMM-Newton observatory in 25 selected fields. The survey covers a total solid angle of ~3.5 deg2 and contains 1137 sources with ~10E-15 < S0.5-10 < 10E-12 erg cm-2 s-1. We find evidence for hardening of the average X-ray spectra of the sources towards fainter fluxes. We interpret this as indicating a higher degree of photoelectric absorption amongst the fainter population. Absorption is detected at 95% confidence in 20% of the sources, but it could certainly be present in many other sources below our detection capabilities. For Broad Line AGNs (BLAGNs), we detect absorption in ~10% of the sources with column densities in the range 10E21 - 10E22 cm-2. The fraction of absorbed Narrow Emission Line galaxies (NELGs, most with intrinsic X-ray luminosities >10E43 erg s-1, and therefore classified as type 2 AGNs) is significantly higher (40%), with a hint of moderately higher columns. We do not find evidence for a redshift evolution of the underlying power law index of BLAGNs, which stays roughly constant at Gamma ~1.9, with intrinsic dispersion of 0.4. A small fraction (~7%) of BLAGNs and NELGs require the presence of a soft excess, that we model as a black body with temperature ranging from 0.1 to 0.3 keV. Comparing our results on absorption to popular X-ray background synthesis models, we find absorption in only ~40% of the sources expected. This is due to a deficiency of heavily absorbed sources (with NH ~10E22 - 10E24 cm-2) in our sample in comparison with the models. We therefore conclude that the synthesis models require some revision in their specific parameters.

We present the first result of a programme to search for large flux variations in the X-ray sources of the XMM Serendipitous Survey compared to previous ROSAT observations. An increase in X-ray flux by a factor >10 was discovered from the nucleus of the galaxy NGC7589 on a timescale of less than 5 years. The 0.4-10keV XMM spectrum can be approximated by a power-law with photon index of 1.7-1.8, though it seems to flatten above 5keV, suggesting a possible complex model, such as partial covering or disc reflection. A classification based on an analysis of its optical spectrum places NGC7589 in the Seyfert region, but close to the Seyfert-LINER border-line on the AGN diagnostic diagrams. We classify NGC7589 as either Seyfert1.9 or LINERI, in the light of the detection of a broad H_alpha line, which makes NGC7589 an AGN in the low-luminosity regime. We interpret the observed variability in terms of either changes in covering factor of absorbing gas in the AGN, or variability in the intrinsic X-ray luminosity. Should the latter be the case, the inferred Eddington accretion rate increased from the radiatively inefficient accretion dominated regime to a value close to the putative critical value, at which a transition of the accretion mode is supposed to take place. This possibility presents a new prospect of studying accretion physics in the central black holes of external galaxies by direct observing changes of `spectral state', as is common in stellar black hole binary systems.

ABRIDGED. We present "The XMM-Newton Bright Serendipitous Survey", two flux-limited samples with flux limit fx ~7E-14 cgs in the 0.5-4.5 keV (BSS) and 4.5-7.5 keV (HBSS) energy band, respectively. After discussing the survey strategy, we present the basic data on a complete sample of 400 X-ray sources derived from the analysis of 237 XMM-Newton fields. The survey covers an area of 28.10 (25.17 for the HBSS) sq. deg. Up to now ~71% (~90%) of the sources have been spectroscopically identified making the BSS (HBSS) the sample with the highest number of identified XMM-Newton sources published so far. We find that: a) the optical counterpart in the majority (~90%) of cases has a magnitude brighter than the POSS II limit; b) the majority of the objects identified so far are broad line AGN. No obvious trend of the source spectra (as deduced from the Hardness Ratios analysis) as a function of the count rate is seen and the average spectra of the "extragalactic" population corresponds to an X-ray energy spectral index of ~0.8 (~0.64) for the BSS (HBSS) sample. About 13% (40%) of the sources are described by an energy spectral index flatter than that of the CXB. We measure a surface density of optically type 1 and type 2 AGN of 1.63+/-0.25 deg-2 and 0.83+/-0.18$ deg-2, respectively; optically type 2 AGN represent 34+/-9% of the total AGN population. Finally, we find a clear separation, in the hardness ratio diagram and in the (hardness ratio) vs. (X-ray to optical flux ratio) diagram, between "coronal emitting" stars and extragalactic sources.

We present the first results from the \xmm Galactic Plane Survey (XGPS). In the first phase of the programme, 22 pointings were used to cover a region of approximately three square degrees between 19\deg -- 22\deg in Galactic longitude and $\pm$0.6\deg in latitude. In total we have resolved over 400 point X-ray sources, at $\geq 5 \sigma$ significance, down to a flux limit of $\sim2 \times 10^{-14}$ \ergseccm (2--10 keV). The combination of the XGPS measurements in the hard X-ray band with the results from earlier surveys carried out by \asca and \chan reveals the form of the low-latitude X-ray source counts over 4 decades of flux. It appears that extragalactic sources dominate below $\sim10^{-13}$ \ergseccm (2--10 keV), with a predominantly Galactic source population present above this flux threshold. The nature of the faint Galactic population observed by \xmm remains uncertain, although cataclysmic variables and RS CVn systems may contribute substantially. \xmm observes an enhanced surface brightness in the Galactic plane in the 2--6 keV band associated with Galactic Ridge X-ray Emission (GRXE). The integrated contribution of Galactic sources plus the breakthrough of extragalactic signal accounts for up to 20 per cent of the observed surface brightness. The XGPS results are consistent with the picture suggested from a deep \chan observation in the Galactic plane, namely that the bulk of the GRXE is truly diffuse.

We report the first detection of a time-dependent, dust-scattered X-ray halo around a gamma-ray burst. GRB 031203 was observed by XMM-Newton starting six hours after the burst. The halo appeared as concentric ring-like structures centered on the GRB location. The radii of these structures increased with time as t^{1/2}, consistent with small-angle X-ray scattering caused by a large column of dust along the line of sight to a cosmologically distant GRB. The rings are due to dust concentrated in two distinct slabs in the Galaxy located at distances of 880 and 1390 pc, consistent with known Galactic features. The halo brightness implies an initial soft X-ray pulse consistent with the observed GRB.

We describe the initial results of a programme to detect and identify extended X-ray sources found serendipitously in XMM-Newton observations. We have analysed 186 EPIC-PN images at high galactic latitude with a limiting flux of $1\times 10^{-14}$ \ergcms and found 62 cluster candidates. Thanks to the enhanced sensitivity of the XMM-Newton telescopes, the new clusters found in this pilot study are on the average fainter, more compact, and more distant than those found in previous X-ray surveys. At our survey limit the surface density of clusters is about 5 deg$^{-2}$. We also present the first results of an optical follow-up programme aiming at the redshift measurement of a large sample of clusters. The results of this pilot study give a first glimpse on the potential of serendipitous cluster science with XMM-Newton based on real data. The largest, yet to be fulfilled promise is the identification of a large number of high-redshift clusters for cosmological studies up to $z=1$ or 1.5.

We have performed a detailed analysis of 3 optically normal galaxies extracted from the XMM Bright Serendipitous Source Sample. Thanks to the good statistics of the XMM-Newton data, we have unveiled the presence of an AGN in all of them. In particular, we detect both X-ray obscured (N_H>10^{22} cm^{-2}) and unobscured (N_H<10^{22} cm^{-2}) AGN with intrinsic 2--10 keV luminosities in the range between 10^{42} -- 10^{43} erg s^{-1}. We find that the X-ray and optical properties of the sources discussed here could be explained assuming a standard AGN hosted by galaxies with magnitudes M_R<M^*, taking properly into account the absorption associated with the AGN, the optical faintness of the nuclear emission with respect to the host galaxy, and the inadequate set--up and atmospheric conditions during the optical spectroscopic observations. Our new spectroscopic observations have revealed the expected AGN features also in the optical band. These results clearly show that optical spectroscopy sometimes can be inefficient in revealing the presence of an AGN, which instead is clearly found from an X-ray spectroscopic investigation. This remarks the importance of being careful in proposing the identification of X-ray sources (especially at faint fluxes) when only low quality optical spectra are in hand. This is particularly important for faint surveys (such as those with XMM-Newton and Chandra), in which optically dull but X-ray active objects are being found in sizeable numbers.

We describe the production, properties and scientific potential of the XMM-Newton catalogue of serendipitous X-ray sources. The first version of this catalogue is nearing completion and is planned to be released before the end of 2002.

We present preliminary results on the XMM-Newton Survey Science Centre medium sensitivity survey (XMS), with 0.5-4.5 keV flux limit 2 10^{-14} erg/cm2/s. At present, 19 fields have been examined with a total of 239 X-ray sources. Identifications for about 2/3 of these reveal that type 1 AGN dominate, but type 2 AGN, absorption-line galaxies and clusters as well as stars are also present. We also discuss on a few X-ray selected Broad-Absorption-Line QSOs found in this survey.

We report the discovery of periodic intensity dips in the X-ray source XMMU J004314.1+410724, in the globular cluster Bo158 in M31. The X-ray flux was modulated by ~83% at a period of 2.78 hr (10017 s) in an XMM-Newton observation taken 2002 Jan 6-7. The X-ray intensity dips show no energy dependence. We detected weaker dips with the same period in observations taken 2000 June 25 (XMM-Newton) and 1991 June 26 (ROSAT/PSPC). The amplitude of the modulation has been found to be anticorrelated with source X-ray flux: it becomes lower when the source intensity rises. The energy spectrum of Bo158 was stable from observation to observation, with a characteristic cutoff at ~4-6 keV. The photo-electric absorption was consistent with the Galactic foreground value. No significant spectral changes were seen in the course of the dips. If the 2.78 hr cycle is the binary period of Bo158 the system is highly compact, with a binary separation of ~10e11 cm. The association of the source with a globular cluster, together with spectral parameters consistent with Galactic neutron star sources, suggests that X-rays are emitted by an accreting neutron star. The properties of Bo 158 are somewhat reminiscent of the Galactic X-ray sources exhibiting a dip-like modulations. We discuss two possible mechanisms explaining the energy-independent modulation observed in Bo 158: i) the obscuration of the central source by highly ionized material that scatters X-rays out of the line of sight; ii) partial covering of an extended source by an opaque absorber which occults varying fractions of the source.

Since their identification with cosmological distances, Gamma-ray bursts (GRBs) have been recognised as the most energetic phenomena in the Universe, with an isotropic burst energy as high as 10^54 ergs. However, the progenitors responsible for the bursts remain elusive, favoured models ranging from a neutron star binary merger, to the collapse of a massive star. Crucial to our understanding of the origins of GRBs is the study of the afterglow emission, where spectroscopy can reveal details of the environment of the burst. Here we report on an XMM-Newton observation of the X-ray afterglow of GRB 011211. The X-ray spectrum reveals evidence for emission lines of Magnesium, Silicon, Sulphur, Argon, Calcium, and possibly Nickel, arising in enriched material with an outflow velocity of order 0.1c. This is the first direct measurement of outflowing matter in a gamma ray burst. The observations strongly favour models where a supernova explosion from a massive stellar progenitor precedes the burst event and is responsible for the outflowing matter.

The XMM-Newton Survey Science Center is currently conducting an optical identification programme of serendipitous EPIC sources at low galactic latitudes. The aim of this study is to quantify the various populations contributing to the overall X-ray emission of the Galaxy and elaborate identification rules that can be later applied to the bulk of the low galactic latitude EPIC detections. We report here on preliminary results from an optical campaign performed in two very low b XMM-Newton fields and discuss the contributions of the various X-ray populations. This paper is presented on behalf of the Survey Science Center and of the AXIS collaboration.

In A0-1 we proposed an ambitious long-term survey of selected regions of our Galaxy (the XGPS survey) using the EPIC CCD cameras on XMM-Newton. The first phase of the programme, which aims to survey a strip of the Galactic Plane in the Scutum region, is currently underway. Here we report on the preliminary results from the first 15 survey pointings. We show that the XGPS survey strategy of fairly shallow (5-10 ks) exposures but wide-angle coverage is well tuned to the goal of providing a large catalogue of predominantly Galactic sources at relatively faint X-ray fluxes in the hard 2-6 keV band.

The XMM-Newton Survey Science Center is constructing a large (~1000 sources) and complete sample of bright serendipitous XMM-Newton sources at high galactic latitude, so as to allow both the discovery of sources of high individual interest as well as statistical population studies. The sample, known as ``The XMM-Newton Bright Serendipitous Source Sample" (XMM-Newton BSS), has a flux limit of ~10^(-13) cgs in the 0.5--4.5 keV energy band and will be fundamental in complementing other medium and deep survey programs (having fluxes 10 to 100 times fainter) in order to: a) characterize the X-ray sky and its constituents, b) understand the evolution of the population selected and c) define statistical identification procedures to select rare and interesting populations of X-ray sources (e.g. high z clusters of galaxies, BL Lacs, type 2 QSOs, etc..). We discuss here the scientific rationale and the details of the project and we present some preliminary results.

We present the first results on the identifications of a medium sensitivity survey (X-ray flux limit 2E-14 erg/cm2/s in the 0.5-4.5 keV band) at high galactic latitude (|b|>20 deg) carried out with the XMM-Newton X-ray observatory within the AXIS observing programme. This study is being conducted as part of the XMM-Newton Survey Science Centre activities towards the identification of the sources in the X-ray serendipitous sky survey. The sample contains 29 X-ray sources in a solid angle of 0.26deg2 (source density 113 +/- 21 sources/deg2), out of which 27 (93%) have been identified. The majority of the sources are broad-line AGN (19), followed by narrow emission line X-ray emitting galaxies (6, all of which turn out to be AGN), 1 nearby non-emission line galaxy (NGC 4291) and 1 active coronal star. Among the identified sources we find 2 broad-absorption line QSOs (z~1.8 and z~1.9), which constitute ~10% of the AGN population at this flux level, similar to optically selected samples. Identifications of a further 10 X-ray sources fainter than our survey limit are also presented.

We present the results of a study of the variability of X-ray sources in the central 30' of the nearby Andromeda Galaxy (M31) based on XMM Performance Verification observations. Two observations of this field, with a total exposure time of about 50 ks, were performed in June and December of 2000. We found 116 sources brighter than a limiting luminosity of 6 x 10(35) erg/s (0.3--12 keV, d=760 kpc). For the ~60 brightest sources, we searched for periodic and non-periodic variability; at least 15% of these sources appear to be variable on a time scale of several months. We discovered a new bright transient source ~2.9' from the nucleus in the June observation; this source faded significantly and was no longer detected in December. The behaviour of the object is similar to a handful of Galactic LMXB transients, most of which are supposed to harbor black holes. We detected pulsations with a period of \~865 s from a source with a supersoft spectrum. The flux of this source decreased significantly between the two XMM observations. The detected period is unusually short and points to a rapidly spinning magnetized white dwarf. The high luminosity and transient nature of the source suggest its possible identification with classical or symbiotic nova, some of which were observed earlier as supersoft sources.

This paper describes the performance of XMM-Newton for serendipitous surveys and summarises the scope and potential of the XMM-Newton Serendipitous Survey. The role of the Survey Science Centre (SSC) in the XMM-Newton project is outlined. The SSC's follow-up and identification programme for the XMM-Newton serendipitous survey is described together with the presentation of some of the first results.

We report on the first deep X-ray survey with the XMM-Newton observatory during the performance verification phase. The field of the Lockman Hole, one of the best studied sky areas over a very wide range of wavelengths, has been observed. A total of ~100 ksec good exposure time has been accumulated. Combining the images of the European Photon Imaging Camera (EPIC) detectors we reach a flux limit of 0.31, 1.4 and 2.4 X 10^{-15} erg cm^{-2} s^{-1}, respectively in the 0.5-2, 2-10, and 5-10 keV band. Within an off-axis angle of 10 arcmin we detect 148, 112 and 61 sources, respectively. The log(N)-log(S) relation in the three bands is compared with previous results. In particular in the 5-10 keV band these observations present the deepest X-ray survey ever, about a factor 20 more sensitive than the previous BeppoSAX observations. Using X-ray spectral diagnostics and the set of previously known, spectroscopically identified ROSAT sources in the field, the new sources can be classified. XMM-Newton detects a significant number (~40%) of X-ray sources with hard, probably intrinsically absorbed X-ray spectra, confirming a prediction of the population synthesis models for the X-ray background.

We present the results of a study based on an XMM-Newton Performance Verification observation of the central 30 arcmin of the nearby spiral galaxy M31. In the 34-ks European Photon Imaging Camera (EPIC) exposure, we detect 116 sources down to a limiting luminosity of 6 x 10^35 erg/s (0.3--12 keV, d = 760 kpc). The luminosity distribution of the sources detected with XMM-Newton flattens at luminosities below ~ 2.5 x 10^37 erg/s. We make use of hardness ratios for the detected sources in order to distinguish between classes of objects such as super-soft sources and intrinsically hard or highly absorbed sources. We demonstrate that the spectrum of the unresolved emission in the bulge of M31 contains a soft excess which can be fitted with a ~ 0.35-keV optically-thin thermal-plasma component clearly distinct from the composite point-source spectrum. We suggest that this may represent diffuse gas in the centre of M31, and we illustrate its extent in a wavelet-deconvolved image.