Cosmic shear data contains a large amount of cosmological information encapsulated in the non-Gaussian features of the weak lensing mass maps. This information can be extracted using non-Gaussian statistics. We compare the constraining power in the $\Omega_{\mathrm{m}} - \sigma_8$ plane of three map-based non-Gaussian statistics with the angular power spectrum, namely; peak/minimum counts and Minkowski functionals. We further analyze the impact of tomography and systematic effects originating from galaxy intrinsic alignments, multiplicative shear bias and photometric redshift systematics. We forecast the performance of the statistics for a stage-3-like weak lensing survey and restrict ourselves to scales $\geq$ 10 arcmin. We find, that in our setup, the considered non-Gaussian statistics provide tighter constraints than the angular power spectrum. The peak counts show the greatest potential, increasing the Figure-of-Merit (FoM) in the $\Omega_{\mathrm{m}} - \sigma_8$ plane by a factor of about 4. A combined analysis using all non-Gaussian statistics in addition to the power spectrum increases the FoM by a factor of 5 and reduces the error on $S_8$ by $\approx$ 25\%. We find that the importance of tomography is diminished when combining non-Gaussian statistics with the angular power spectrum. The non-Gaussian statistics indeed profit less from tomography and the minimum counts and Minkowski functionals add some robustness against galaxy intrinsic alignment in a non-tomographic setting. We further find that a combination of the angular power spectrum and the non-Gaussian statistics allows us to apply conservative scale cuts in the analysis, thus helping to minimize the impact of baryonic and relativistic effects, while conserving the cosmological constraining power. We make the code that was used to conduct this analysis publicly available.

For the next generation of spectroscopic galaxy surveys, it is important to forecast their performances and to accurately interpret their large data sets. For this purpose, it is necessary to consistently simulate different populations of galaxies, in particular Emission Line Galaxies (ELGs), less used in the past for cosmological purposes. In this work, we further the forward modeling approach presented in Fagioli et al. 2018, by extending the spectra simulator Uspec to model galaxies of different kinds with improved parameters from Tortorelli et al. 2020. Furthermore, we improve the modeling of the selection function by using the image simulator Ufig. We apply this to the Sloan Digital Sky Survey (SDSS), and simulate $\sim157,000$ multi-band images. We pre-process and analyse them to apply cuts for target selection, and finally simulate SDSS/BOSS DR14 galaxy spectra. We compute photometric, astrometric and spectroscopic properties for red and blue, real and simulated galaxies, finding very good agreement. We compare the statistical properties of the samples by decomposing them with Principal Component Analysis (PCA). We find very good agreement for red galaxies and a good, but less pronounced one, for blue galaxies, as expected given the known difficulty of simulating those. Finally, we derive stellar population properties, mass-to-light ratios, ages and metallicities, for all samples, finding again very good agreement. This shows how this method can be used not only to forecast cosmology surveys, but it is also able to provide insights into studies of galaxy formation and evolution.

We forecast astrophysical and cosmological parameter constraints from synergies between 21 cm intensity mapping and wide field optical galaxy surveys (both spectroscopic and photometric) over $z \sim 0-3$. We focus on the following survey combinations in this work: (i) a CHIME-like and DESI-like survey in the northern hemisphere, (ii) an LSST-like and SKA I MID-like survey and (ii) a MeerKAT-like and DES-like survey in the southern hemisphere. We work with the $\Lambda$CDM cosmological model having parameters $\{h, \Omega_m, n_s, \Omega_b, \sigma_8\}$, parameters $v_{c,0}$ and $\beta$ representing the cutoff and slope of the HI-halo mass relation in the previously developed HI halo model framework, and a parameter $Q$ that represents the scale dependence of the optical galaxy bias. Using a Fisher forecasting framework, we explore (i) the effects of the HI and galaxy astrophysical uncertainties on the cosmological parameter constraints, assuming priors from the present knowledge of the astrophysics, (ii) the improvements on astrophysical constraints over their current priors in the three configurations considered, (ii) the tightening of the constraints on the parameters relative to the corresponding HI auto-correlation surveys alone.

Current and upcoming cosmological experiments open a new era of precision cosmology, thus demanding accurate theoretical predictions for cosmological observables. Because of the complexity of the codes delivering such predictions, reaching a high level of numerical accuracy is challenging. Among the codes already fulfilling this task, $\textsf{PyCosmo}$ is a Python based framework providing solutions to the Einstein-Boltzmann equations and accurate predictions for cosmological observables. In this work, we first describe how the observables are implemented. Then, we check the accuracy of the theoretical predictions for background quantities, power spectra and Limber and beyond-Limber angular power spectra by comparison with other codes: the Core Cosmology Library ($\texttt{CCL}$), $\texttt{CLASS}$, $\texttt{HMCode}$ and $\texttt{iCosmo}$. In our analysis we quantify the agreement of $\textsf{PyCosmo}$ with the other codes, for a range of cosmological models, monitored through a series of $\textit{unit tests}$. $\textsf{PyCosmo}$, conceived as a multi purpose cosmology calculation tool in $\texttt{Python}$, is designed to be interactive and user friendly. A current version of the code (without the Boltzmann Solver) is publicly available and can be used interactively on the platform $\textsf{PyCosmo Hub}$, all accessible from this link: https://cosmology.ethz.ch/research/software-lab/PyCosmo.html . On the hub the users can perform their own computations using $\texttt{Jupyter Notebooks}$ without the need of installing any software, access to the results presented in this work and benefit from tutorial notebooks illustrating the usage of the code. The link above also redirects to the code release and documentation.

Baryonic feedback effects lead to a suppression of the weak lensing angular power spectrum on small scales. The poorly constrained shape and amplitude of this suppression is an important source of uncertainties for upcoming cosmological weak lensing surveys such as Euclid or LSST. In this first paper in a series of two, we use simulations to build a Euclid-like tomographic mock data-set for the cosmic shear power spectrum and the corresponding covariance matrix, which are both corrected for baryonic effects following the baryonification method of Schneider et al. (2019). In addition, we develop an emulator to obtain fast predictions of the baryonic power suppression, allowing us to perform a likelihood inference analysis for a standard $\Lambda$CDM cosmology with both cosmological and astrophysical parameters. Our main findings are the following: (i) ignoring baryonic effects leads to a greater than 5$\sigma$ bias on the cosmological parameters $\Omega_m$ and $\sigma_8$; (ii) restricting the analysis to the largest scales, that are mostly unaffected by baryons, makes the bias disappear, but results in a blow-up of the $\Omega_m$-$\sigma_8$ contour area by more than a factor of 10; (iii) ignoring baryonic effects on the covariance matrix does not significantly affect cosmological parameter estimates; (iv) while the baryonic suppression is mildly cosmology dependent, this effect does not noticeably modify the posterior contours. Overall, we conclude that including baryonic uncertainties in terms of nuisance parameters results in unbiased and surprisingly tight constraints on cosmology.

In this Letter, we consider the model-independent reconstruction of the expansion and growth functions from the Pantheon supernova data. The method relies on developing the expansion function in terms of shifted Chebyshev polynomials and determining the coefficients of the polynomials by a maximum-likelihood fit to the data. Having obtained the expansion function in a model-independent way, we can then also determine the growth function without assuming a particular model. We then compare the results with the predictions of two classes of Dark Energy models, firstly a class of quintessence scalar field models consistent with the trans-Planckian censorship and swampland conjectures, and secondly a class of generalized Proca vector field models. We determine constraints on the parameters which appear in these models.

An accurate modelling of baryonic feedback effects is required to exploit the full potential of future weak-lensing surveys such as Euclid or LSST. In this second paper in a series of two, we combine Euclid-like mock data of the cosmic shear power spectrum with an eROSITA X-ray mock of the cluster gas fraction to run a combined likelihood analysis including both cosmological and baryonic parameters. Following the first paper of this series, the baryonic effects (based on the baryonic correction model of Schneider et al. 2019) are included in both the tomographic power spectrum and the covariance matrix. However, this time we assume the more realistic case of a $\Lambda$CDM cosmology with massive neutrinos, and we consider several extensions of the currently favoured cosmological model. For the standard $\Lambda$CDM case, we show that including X-ray data reduces the uncertainties on the sum of the neutrino mass by $\sim30$ percent, while there is only a mild improvement on other parameters such as $\Omega_m$ and $\sigma_8$. As extensions of $\Lambda$CDM, we consider the cases of a dynamical dark energy model (wCDM), a $f(R)$ gravity model (fRCDM), and a mixed dark matter model ($\Lambda$MDM) with both a cold and a warm/hot dark matter component. We find that combining weak lensing with X-ray data only leads to a mild improvement of the constraints on the additional parameters of wCDM, while the improvement is more substantial for both fRCDM and $\Lambda$MDM. Ignoring baryonic effects in the analysis pipeline leads to significant false-detections of either phantom dark energy or a light subdominant dark matter component. Overall we conclude that for all cosmologies considered, a general parametrisation of baryonic effects is both necessary and sufficient to obtain tight constraints on cosmological parameters.

The galaxy Luminosity Function (LF) is a key observable for galaxy formation, evolution studies and for cosmology. In this work, we propose a novel technique to forward model wide-field galaxy surveys using the fast image simulator UFig and measure the LF of galaxies in the B-band. We use Approximate Bayesian Computation (ABC) to constrain the galaxy population model parameters of the simulations and match data from the Canada-France-Hawaii Telescope Legacy Survey (CFHTLS). We define a number of distance metrics between the simulated and the survey data. By exploring the parameter space of the galaxy population model through ABC to find the set of parameters that minimize these distance metrics, we obtain constraints on the LFs of blue and red galaxies as a function of redshift. We find that $\mathrm{M^*}$ fades by $\Delta \mathrm{M}^*_{\mathrm{0.1-1.0,b}} = 0.37 \pm 0.34$ and $\Delta \mathrm{M}^*_{\mathrm{0.1-1.0,r}} = 0.58 \pm 0.42$ magnitudes between redshift $\mathrm{z = 1}$ and $\mathrm{z = 0.1}$ for blue and red galaxies, respectively. We also find that $\phi^*$ for blue galaxies stays roughly constant between redshift $\mathrm{z = 0.1}$ and $\mathrm{z=1}$, while for red galaxies it decreases of $\sim 90\%$. We compare our results to other measurements, finding good agreement at all redshifts, for both blue and red galaxies. To further test our results, we compare the redshift distributions for survey and simulated data. We use the spectroscopic redshift distribution from the VIMOS Public Extragalactic Redshift Survey (VIPERS) and we apply the same selection in colours and magnitudes on our simulations. We find a good agreement between the survey and the simulated redshift distributions. We provide best-fit values and uncertainties for the parameters of the LF. This work offers excellent prospects for measuring other galaxy population properties as a function of redshift using ABC.

The PAU Survey (PAUS) is an innovative photometric survey with 40 narrow bands at the William Herschel Telescope (WHT). The narrow bands are spaced at 100\AA\ intervals covering the range 4500\AA\ to 8500\AA\ and, in combination with standard broad bands, enable excellent redshift precision. This paper describes the technique, galaxy templates and additional photometric calibration used to determine early photometric redshifts from PAUS. Using BCNz2, a new photometric redshift code developed for this purpose, we characterise the photometric redshift performance using PAUS data on the COSMOS field. Comparison to secure spectra from zCOSMOS DR3 shows that PAUS achieves $\sigma_{68} /(1+z) = 0.0037$ to $i_{\mathrm{AB}} < 22.5$ when selecting the best 50% of the sources based on a photometric redshift quality cut. Furthermore, a higher photo-z precision ($\sigma_{68}/(1+z) \sim 0.001$) is obtained for a bright and high quality selection, which is driven by the identification of emission lines. We conclude that PAUS meets its design goals, opening up a hitherto uncharted regime of deep, wide, and dense galaxy survey with precise redshifts that will provide unique insights into the formation, evolution and clustering of galaxies, as well as their intrinsic alignments.

Upcoming weak-lensing surveys have the potential to become leading cosmological probes provided all systematic effects are under control. Recently, the ejection of gas due to feedback energy from active galactic nuclei (AGN) has been identified as major source of uncertainty, challenging the success of future weak-lensing probes in terms of cosmology. In this paper we investigate the effects of baryons on the number of weak-lensing peaks in the convergence field. Our analysis is based on full-sky convergence maps constructed via light-cones from $N$-body simulations, and we rely on the baryonic correction model of Schneider et al. (2019) to model the baryonic effects on the density field. As a result we find that the baryonic effects strongly depend on the Gaussian smoothing applied to the convergence map. For a DES-like survey setup, a smoothing of $\theta_k\gtrsim8$ arcmin is sufficient to keep the baryon signal below the expected statistical error. Smaller smoothing scales lead to a significant suppression of high peaks (with signal-to-noise above 2), while lower peaks are not affected. The situation is more severe for a Euclid-like setup, where a smoothing of $\theta_k\gtrsim16$ arcmin is required to keep the baryonic suppression signal below the statistical error. Smaller smoothing scales require a full modelling of baryonic effects since both low and high peaks are strongly affected by baryonic feedback.

Convolutional Neural Networks (CNN) have recently been demonstrated on synthetic data to improve upon the precision of cosmological inference. In particular they have the potential to yield more precise cosmological constraints from weak lensing mass maps than the two-point functions. We present the cosmological results with a CNN from the KiDS-450 tomographic weak lensing dataset, constraining the total matter density $\Omega_m$, the fluctuation amplitude $\sigma_8$, and the intrinsic alignment amplitude $A_{\rm{IA}}$. We use a grid of N-body simulations to generate a training set of tomographic weak lensing maps. We test the robustness of the expected constraints to various effects, such as baryonic feedback, simulation accuracy, different value of $H_0$, or the lightcone projection technique. We train a set of ResNet-based CNNs with varying depths to analyze sets of tomographic KiDS mass maps divided into 20 flat regions, with applied Gaussian smoothing of $\sigma=2.34$ arcmin. The uncertainties on shear calibration and $n(z)$ error are marginalized in the likelihood pipeline. Following a blinding scheme, we derive constraints of $S_8 = \sigma_8 (\Omega_m/0.3)^{0.5} = 0.777^{+0.038}_{-0.036}$ with our CNN analysis, with $A_{\rm{IA}}=1.398^{+0.779}_{-0.724}$. We compare this result to the power spectrum analysis on the same maps and likelihood pipeline and find an improvement of about $30\%$ for the CNN. We discuss how our results offer excellent prospects for the use of deep learning in future cosmological data analysis.

We investigate the implications of string Swampland criteria for alternative theories of gravity. Even though this has not rigorously been proven, there is some evidence that exact de-Sitter solutions with a positive cosmological constant cannot be successfully embedded into string theory, and that the low energy effective field theories containing a scalar field $\pi$ with a potential $V$ in the habitable landscape should satisfy the Swampland criteria $|V'|/V\ge c\sim\mathcal{O}(1)$. As a paradigmatic class of modified gravity theories for inflation and dark energy, we consider the extensively studied family of Horndeski Lagrangians in view of cosmological observations. Apart from a possible potential term, they contain derivative self-interactions as the Galileon and non-minimal couplings to the gravity sector. Hence, our conclusions on the Galileon sector can be also applied to many other alternative theories with scalar helicity modes containing derivative interactions such as massive gravity and generalized Proca. In the presence of such derivative terms, the dynamics of the scalar mode is substantially modified, and imposing the cosmological evolution constrained by observations places tight constraints on $c$ within the Swampland conjecture.

Weak lensing by large-scale structure is a powerful probe of cosmology and of the dark universe. This cosmic shear technique relies on the accurate measurement of the shapes and redshifts of background galaxies and requires precise control of systematic errors. The Monte Carlo Control Loops (MCCL) is a forward modelling method designed to tackle this problem. It relies on the Ultra Fast Image Generator (UFig) to produce simulated images tuned to match the target data statistically, followed by calibrations and tolerance loops. We present the first end-to-end application of this method, on the Dark Energy Survey (DES) Year 1 wide field imaging data. We simultaneously measure the shear power spectrum $C_{\ell}$ and the redshift distribution $n(z)$ of the background galaxy sample. The method includes maps of the systematic sources, Point Spread Function (PSF), an Approximate Bayesian Computation (ABC) inference of the simulation model parameters, a shear calibration scheme, and the fast estimation of the covariance matrix. We find a close statistical agreement between the simulations and the DES Y1 data using an array of diagnostics. In a non-tomographic setting, we derive a set of $C_\ell$ and $n(z)$ curves that encode the cosmic shear measurement, as well as the systematic uncertainty. Following a blinding scheme, we measure the combination of $\Omega_m$, $\sigma_8$, and intrinsic alignment amplitude $A_{\rm{IA}}$, defined as $S_8D_{\rm{IA}} = \sigma_8(\Omega_m/0.3)^{0.5}D_{\rm{IA}}$, where $D_{\rm{IA}}=1-0.11(A_{\rm{IA}}-1)$. We find $S_8D_{\rm{IA}}=0.895^{+0.054}_{-0.039}$, where systematics are at the level of roughly 60\% of the statistical errors. We discuss these results in the context of earlier cosmic shear analyses of the DES Y1 data. Our findings indicate that this method and its fast runtime offer good prospects for cosmic shear measurements with future wide-field surveys.

We develop a theoretical framework to describe the cosmological observables on the past light cone such as the luminosity distance, weak lensing, galaxy clustering, and the cosmic microwave background anisotropies. We consider that all the cosmological observables include not only the background quantity, but also the perturbation quantity, and they are subject to cosmic variance, which sets the fundamental limits on the cosmological information that can be derived from such observables, even in an idealized survey with an infinite number of observations. To quantify the maximum cosmological information content, we apply the Fisher information matrix formalism and spherical harmonic analysis to cosmological observations, in which the angular and the radial positions of the observables on the light cone carry different information. We discuss the maximum cosmological information that can be derived from five different observables: (1) type Ia supernovae, (2) cosmic microwave background anisotropies, (3) weak gravitational lensing, (4) local baryon density, and (5) galaxy clustering. We compare our results with the cosmic variance obtained in the standard approaches, which treat the light cone volume as a cubic box of simultaneity. We discuss implications of our formalism and ways to overcome the fundamental limit.

Feedback processes from baryons are expected to strongly affect weak-lensing observables of current and future cosmological surveys. In this paper we present a new parametrisation of halo profiles based on gas, stellar, and dark matter density components. This parametrisation is used to modify outputs of gravity-only $N$-body simulations (following the prescription of Schneider and Teyssier [1]) in order to mimic baryonic effects on the matter density field. The resulting baryonic correction model relies on a few well motivated physical parameters and is able to reproduce the redshift zero clustering signal of hydrodynamical simulations at two percent accuracy below $k\sim10$ h/Mpc. A detailed study of the baryon suppression effects on the matter power spectrum and the weak lensing shear correlation reveals that the signal is dominated by two parameters describing the slope of the gas profile in haloes and the maximum radius of gas ejection. We show that these parameters can be constrained with the observed gas fraction of galaxy groups and clusters from X-ray data. Based on these observations we predict a beyond percent effect on the power spectrum above $k=0.2-1.0$ h/Mpc with a maximum suppression of 15-25 percent around $k\sim 10$ h/Mpc. As a result, the weak lensing angular shear power spectrum is suppressed by 15-25 percent at scales beyond $\ell\sim 100-600$ and the shear correlations $\xi_{+}$ and $\xi_{-}$ are affected at the 10-25 percent level below 5 and 50 arc-minutes, respectively. The relatively large uncertainties of these predictions are a result of the poorly known hydrostatic mass bias of current X-ray observations as well as the generic difficulty to observe the low density gas outside of haloes.

We describe the first public data release of the Dark Energy Survey, DES DR1, consisting of reduced single epoch images, coadded images, coadded source catalogs, and associated products and services assembled over the first three years of DES science operations. DES DR1 is based on optical/near-infrared imaging from 345 distinct nights (August 2013 to February 2016) by the Dark Energy Camera mounted on the 4-m Blanco telescope at Cerro Tololo Inter-American Observatory in Chile. We release data from the DES wide-area survey covering ~5,000 sq. deg. of the southern Galactic cap in five broad photometric bands, grizY. DES DR1 has a median delivered point-spread function of g = 1.12, r = 0.96, i = 0.88, z = 0.84, and Y = 0.90 arcsec FWHM, a photometric precision of < 1% in all bands, and an astrometric precision of 151 mas. The median coadded catalog depth for a 1.95" diameter aperture at S/N = 10 is g = 24.33, r = 24.08, i = 23.44, z = 22.69, and Y = 21.44 mag. DES DR1 includes nearly 400M distinct astronomical objects detected in ~10,000 coadd tiles of size 0.534 sq. deg. produced from ~39,000 individual exposures. Benchmark galaxy and stellar samples contain ~310M and ~ 80M objects, respectively, following a basic object quality selection. These data are accessible through a range of interfaces, including query web clients, image cutout servers, jupyter notebooks, and an interactive coadd image visualization tool. DES DR1 constitutes the largest photometric data set to date at the achieved depth and photometric precision.

We use the results of previous work building a halo model formalism for the distribution of neutral hydrogen, along with experimental parameters of future radio facilities, to place forecasts on astrophysical and cosmological parameters from next generation surveys. We consider 21 cm intensity mapping surveys conducted using the BINGO, CHIME, FAST, TianLai, MeerKAT and SKA experimental configurations. We work with the 5-parameter cosmological dataset of {$\Omega_m, \sigma_8, h, n_s, \Omega_b$} assuming a flat $\Lambda$CDM model, and the astrophysical parameters {$v_{c,0}, \beta$} which represent the cutoff and slope of the HI- halo mass relation. We explore (i) quantifying the effects of the astrophysics on the recovery of the cosmological parameters, (ii) the dependence of the cosmological forecasts on the details of the astrophysical parametrization, and (iii) the improvement of the constraints on probing smaller scales in the HI power spectrum. For an SKA I MID intensity mapping survey alone, probing scales up to $\ell_{\rm max} = 1000$, we find a factor of $1.1 - 1.3$ broadening in the constraints on $\Omega_b$ and $\Omega_m$, and of $2.4 - 2.6$ on $h$, $n_s$ and $\sigma_8$, if we marginalize over astrophysical parameters without any priors. However, even the prior information coming from the present knowledge of the astrophysics largely alleviates this broadening. These findings do not change significantly on considering an extended HIHM relation, illustrating the robustness of the results to the choice of the astrophysical parametrization. Probing scales up to $\ell_{\rm max} = 2000$ improves the constraints by factors of 1.5-1.8. The forecasts improve on increasing the number of tomographic redshift bins, saturating, in many cases, with 4 - 5 redshift bins. We also forecast constraints for intensity mapping with other experiments, and draw similar conclusions.

We present cosmological results from a combined analysis of galaxy clustering and weak gravitational lensing, using 1321 deg$^2$ of $griz$ imaging data from the first year of the Dark Energy Survey (DES Y1). We combine three two-point functions: (i) the cosmic shear correlation function of 26 million source galaxies in four redshift bins, (ii) the galaxy angular autocorrelation function of 650,000 luminous red galaxies in five redshift bins, and (iii) the galaxy-shear cross-correlation of luminous red galaxy positions and source galaxy shears. To demonstrate the robustness of these results, we use independent pairs of galaxy shape, photometric redshift estimation and validation, and likelihood analysis pipelines. To prevent confirmation bias, the bulk of the analysis was carried out while blind to the true results; we describe an extensive suite of systematics checks performed and passed during this blinded phase. The data are modeled in flat $\Lambda$CDM and $w$CDM cosmologies, marginalizing over 20 nuisance parameters, varying 6 (for $\Lambda$CDM) or 7 (for $w$CDM) cosmological parameters including the neutrino mass density and including the 457 $\times$ 457 element analytic covariance matrix. We find consistent cosmological results from these three two-point functions, and from their combination obtain $S_8 \equiv \sigma_8 (\Omega_m/0.3)^{0.5} = 0.783^{+0.021}_{-0.025}$ and $\Omega_m = 0.264^{+0.032}_{-0.019}$ for $\Lambda$CDM for $w$CDM, we find $S_8 = 0.794^{+0.029}_{-0.027}$, $\Omega_m = 0.279^{+0.043}_{-0.022}$, and $w=-0.80^{+0.20}_{-0.22}$ at 68% CL. The precision of these DES Y1 results rivals that from the Planck cosmic microwave background measurements, allowing a comparison of structure in the very early and late Universe on equal terms. Although the DES Y1 best-fit values for $S_8$ and $\Omega_m$ are lower than the central values from Planck ...

With the high-precision data from current and upcoming experiments, it becomes increasingly important to perform consistency tests of the standard cosmological model. In this work, we focus on consistency measures between different data sets and methods that allow us to assess the goodness of fit of different models. We address both of these questions using the relative entropy or Kullback-Leibler (KL) divergence [Kullback et al., 1951]. First, we revisit the relative entropy as a consistency measure between data sets and further investigate some of its key properties, such as asymmetry and path dependence. We then introduce a novel model rejection framework, which is based on the relative entropy and the posterior predictive distribution. We validate the method on several toy models and apply it to Type Ia supernovae data from the JLA and CMB constraints from Planck 2015, testing the consistency of the data with six different cosmological models.

Deep learning is a powerful analysis technique that has recently been proposed as a method to constrain cosmological parameters from weak lensing mass maps. Due to its ability to learn relevant features from the data, it is able to extract more information from the mass maps than the commonly used power spectrum, and thus achieve better precision for cosmological parameter measurement. We explore the advantage of Convolutional Neural Networks (CNN) over the power spectrum for varying levels of shape noise and different smoothing scales applied to the maps. We compare the cosmological constraints from the two methods in the $\Omega_M-\sigma_8$ plane for sets of 400 deg$^2$ convergence maps. We find that, for a shape noise level corresponding to 8.53 galaxies/arcmin$^2$ and the smoothing scale of $\sigma_s = 2.34$ arcmin, the network is able to generate 45% tighter constraints. For smaller smoothing scale of $\sigma_s = 1.17$ the improvement can reach $\sim 50 \%$, while for larger smoothing scale of $\sigma_s = 5.85$, the improvement decreases to 19%. The advantage generally decreases when the noise level and smoothing scales increase. We present a new training strategy to train the neural network with noisy data, as well as considerations for practical applications of the deep learning approach.

Galaxy spectra are essential to probe the spatial distribution of galaxies in our Universe. To better interpret current and future spectroscopic galaxy redshift surveys, it is important to be able to simulate these data sets. We describe Uspec, a forward modeling tool to generate galaxy spectra taking into account some intrinsic galaxy properties as well as instrumental responses of a given telescope. The model for the intrinsic properties of the galaxy population, i.e., the luminosity functions, and size and spectral coefficients distribu- tions, was developed in an earlier work for broad-band imaging surveys [1], and we now aim to test the model further using spectroscopic data. We apply Uspec to the SDSS/CMASS sample of Luminous Red Galaxies (LRGs). We construct selection cuts that match those used to build this LRG sample, which we then apply to data and simulations in the same way. The resulting real and simulated average spectra show a good statistical agreement overall, with residual differences likely coming from a bluer galaxy population of the simulated sam- ple. We also do not explore the impact of non-solar element ratios in our simulations. For a quantitative comparison, we perform Principal Component Analysis (PCA) of the sets of spectra. By comparing the PCs constructed from simulations and data, we find good agree- ment for all components. The distributions of the eigencoefficients also show an appreciable overlap. We are therefore able to properly simulate the LRG sample taking into account the SDSS/BOSS instrumental responses. The differences between the two samples can be ascribed to the intrinsic properties of the simulated galaxy population, which can be reduced by further improvements of our modelling method in the future. We discuss how these results can be useful for the forward modeling of upcoming large spectroscopic surveys.

We present a structural and morphological catalogue for 45 million objects selected from the first year of data from the Dark Energy Survey (DES). Single Sersic fits and non-parametric measurements are produced for g, r and i filters. The parameters from the best-fitting Sersic model (total magnitude, half-light radius, Sersic index, axis ratio and position angle) are measured with Galfit; the non-parametric coefficients (concentration, asymmetry, clumpiness, Gini, M20) are provided using the Zurich Estimator of Structural Types (ZEST+). To study the statistical uncertainties, we consider a sample of state-of-the-art image simulations with a realistic distribution in the input parameter space and then process and analyse them as we do with real data: this enables us to quantify the observational biases due to PSF blurring and magnitude effects and correct the measurements as a function of magnitude, galaxy size, Sersic index (concentration for the analysis of the non-parametric measurements) and ellipticity. We present the largest structural catalogue to date: we find that accurate and complete measurements for all the structural parameters are typically obtained for galaxies with SExtractor MAG AUTO I < 21. Indeed, the parameters in the filters i and r can be overall well recovered up to MAG AUTO < 21.5, corresponding to a fitting completeness of ~90% below this threshold, for a total of 25 million galaxies. The combination of parametric and non-parametric structural measurements makes this catalogue an important instrument to explore and understand how galaxies form and evolve. The catalogue described in this paper will be publicly released alongside the Dark Energy Survey collaboration Y1 cosmology data products at the following URL: https://des.ncsa.illinois.edu/releases/y1a1/gold/morphology.

In this recent Letter [1], we studied the implications of string Swampland conjectures for quintessence models of dark energy. A couple of days ago, a paper appeared [2] which refers to our work but misrepresents what we have done. Here, we set the record straight.

In this Letter, we study the implications of string Swampland criteria for dark energy in view of ongoing and future cosmological observations. If string theory should be the ultimate quantum gravity theory, there is evidence that exact de Sitter solutions with a positive cosmological constant cannot describe the fate of the late-time universe. Even though cosmological models with dark energy given by a scalar field $\pi$ evolving in time are not in direct tension with string theory, they have to satisfy the Swampland criteria $|\Delta\pi|<d\sim\mathcal{O}(1)$ and $|V'|/V>c\sim\mathcal{O}(1)$, where $V$ is the scalar field potential. In view of the restrictive implications that the Swampland criteria have on dark energy, we investigate the accuracy needed for future observations to tightly constrain standard dark-energy models. We find that current 3-$\sigma$ constraints with $c \lesssim 1.35$ are still well in agreement with the string Swampland criteria. However, Stage-4 surveys such as Euclid, LSST and DESI, tightly constraining the equation of state $w(z)$, will start putting surviving quintessence models into tensions with the string Swampland criteria by demanding $c<0.4$. We further investigate whether any idealised futuristic survey will ever be able to give a decisive answer to the question whether the cosmological constant would be preferred over a time-evolving dark-energy model within the Swampland criteria. Hypothetical surveys with a reduction in the uncertainties by a factor of $\sim20$ compared to Euclid would be necessary to reveal strong tension between quintessence models obeying the string Swampland criteria and observations by pushing the allowed values down to $c<0.1$. In view of such perspectives, there will be fundamental observational limitations with future surveys.

Modeling the Point Spread Function (PSF) of wide-field surveys is vital for many astrophysical applications and cosmological probes including weak gravitational lensing. The PSF smears the image of any recorded object and therefore needs to be taken into account when inferring properties of galaxies from astronomical images. In the case of cosmic shear, the PSF is one of the dominant sources of systematic errors and must be treated carefully to avoid biases in cosmological parameters. Recently, forward modeling approaches to calibrate shear measurements within the Monte-Carlo Control Loops ($MCCL$) framework have been developed. These methods typically require simulating a large amount of wide-field images, thus, the simulations need to be very fast yet have realistic properties in key features such as the PSF pattern. Hence, such forward modeling approaches require a very flexible PSF model, which is quick to evaluate and whose parameters can be estimated reliably from survey data. We present a PSF model that meets these requirements based on a fast deep-learning method to estimate its free parameters. We demonstrate our approach on publicly available SDSS data. We extract the most important features of the SDSS sample via principal component analysis. Next, we construct our model based on perturbations of a fixed base profile, ensuring that it captures these features. We then train a Convolutional Neural Network to estimate the free parameters of the model from noisy images of the PSF. This allows us to render a model image of each star, which we compare to the SDSS stars to evaluate the performance of our method. We find that our approach is able to accurately reproduce the SDSS PSF at the pixel level, which, due to the speed of both the model evaluation and the parameter estimation, offers good prospects for incorporating our method into the $MCCL$ framework.

We present a mock catalogue for the Physics of the Accelerating Universe Survey (PAUS) and use it to quantify the competitiveness of the narrow band imaging for measuring spectral features and galaxy clustering. The mock agrees with observed number count and redshift distribution data. We demonstrate the importance of including emission lines in the narrow band fluxes. We show that PAUCam has sufficient resolution to measure the strength of the 4000\AA{} break to the nominal PAUS depth. We predict the evolution of a narrow band luminosity function and show how this can be affected by the OII emission line. We introduce new rest frame broad bands (UV and blue) that can be derived directly from the narrow band fluxes. We use these bands along with D4000 and redshift to define galaxy samples and provide predictions for galaxy clustering measurements. We show that systematic errors in the recovery of the projected clustering due to photometric redshift errors in PAUS are significantly smaller than the expected statistical errors. The galaxy clustering on two halo scales can be recovered quantatively without correction, and all qualitative trends seen in the one halo term are recovered. In this analysis mixing between samples reduces the expected contrast between the one halo clustering of red and blue galaxies and demonstrates the importance of a mock catalogue for interpreting galaxy clustering results. The mock catalogue is available on request at https://cosmohub.pic.es/home.

Weak gravitational lensing is a powerful probe of the dark sector, once measurement systematic errors can be controlled. In Refregier & Amara (2014), a calibration method based on forward modeling, called MCCL, was proposed. This relies on fast image simulations (e.g., UFig; Berge et al. 2013) that capture the key features of galaxy populations and measurement effects. The MCCL approach has been used in Herbel et al. (2017) to determine the redshift distribution of cosmological galaxy samples and, in the process, the authors derived a model for the galaxy population mainly based on broad-band photometry. Here, we test this model by forward modeling the 40 narrow-band photometry given by the novel PAU Survey (PAUS). For this purpose, we apply the same forced photometric pipeline on data and simulations using Source Extractor (Bertin & Arnouts 1996). The image simulation scheme performance is assessed at the image and at the catalogues level. We find good agreement for the distribution of pixel values, the magnitudes, in the magnitude-size relation and the interband correlations. A principal component analysis is then performed, in order to derive a global comparison of the narrow-band photometry between the data and the simulations. We use a `mixing' matrix to quantify the agreement between the observed and simulated sets of Principal Components (PCs). We find good agreement, especially for the first three most significant PCs. We also compare the coefficients of the PCs decomposition. While there are slight differences for some coefficients, we find that the distributions are in good agreement. Together, our results show that the galaxy population model derived from broad-band photometry is in good overall agreement with the PAUS data. This offers good prospect for incorporating spectral information to the galaxy model by adjusting it to the PAUS narrow-band data using forward modeling.

We use 26 million galaxies from the Dark Energy Survey (DES) Year 1 shape catalogs over 1321 deg$^2$ of the sky to produce the most significant measurement of cosmic shear in a galaxy survey to date. We constrain cosmological parameters in both the flat $\Lambda$CDM and $w$CDM models, while also varying the neutrino mass density. These results are shown to be robust using two independent shape catalogs, two independent \photoz\ calibration methods, and two independent analysis pipelines in a blind analysis. We find a 3.5\% fractional uncertainty on $\sigma_8(\Omega_m/0.3)^{0.5} = 0.782^{+0.027}_{-0.027}$ at 68\% CL, which is a factor of 2.5 improvement over the fractional constraining power of our DES Science Verification results. In $w$CDM, we find a 4.8\% fractional uncertainty on $\sigma_8(\Omega_m/0.3)^{0.5} = 0.777^{+0.036}_{-0.038}$ and a dark energy equation-of-state $w=-0.95^{+0.33}_{-0.39}$. We find results that are consistent with previous cosmic shear constraints in $\sigma_8$ -- $\Omega_m$, and see no evidence for disagreement of our weak lensing data with data from the CMB. Finally, we find no evidence preferring a $w$CDM model allowing $w\ne -1$. We expect further significant improvements with subsequent years of DES data, which will more than triple the sky coverage of our shape catalogs and double the effective integrated exposure time per galaxy.

We present the gauge-invariant formalism of cosmological weak lensing, accounting for all the relativistic effects due to the scalar, vector, and tensor perturbations at the linear order. While the light propagation is fully described by the geodesic equation, the relation of the photon wavevector to the physical quantities requires the specification of the frames, where they are defined. By constructing the local tetrad bases at the observer and the source positions, we clarify the relation of the weak lensing observables such as the convergence, the shear, and the rotation to the physical size and shape defined in the source rest-frame and the observed angle and redshift measured in the observer rest-frame. Compared to the standard lensing formalism, additional relativistic effects contribute to all the lensing observables. We explicitly verify the gauge-invariance of the lensing observables and compare our results to previous work. In particular, we demonstrate that even in the presence of the vector and tensor perturbations, the physical rotation of the lensing observables vanishes at the linear order, while the tetrad basis rotates along the light propagation compared to a FRW coordinate. Though the latter is often used as a probe of primordial gravitational waves, the rotation of the tetrad basis is indeed not a physical observable. We further clarify its relation to the E-B decomposition in weak lensing. Our formalism provides a transparent and comprehensive perspective of cosmological weak lensing.

We study the distribution of dark matter in the nonlinear regime in a model in which the primordial fluctuations include, in addition to the dominant primordial Gaussian fluctuations generated by the standard $\Lambda CDM$ cosmological model, the effects of a cosmic string wake set up at the time of equal matter and radiation, making use of cosmological $N$-body simulations. At early times the string wake leads to a planar overdensity of dark matter. We study how this non-Gaussian pattern of a cosmic string wake evolves in the presence of the Gaussian perturbations, making use of wavelet and ridgelet-like statistics specifically designed to extract string wake signals. At late times the Gaussian fluctuations disrupt the string wake. We find that for a string tension of $G \mu = 10^{-7}$, a value just below the current observational limit, the effects of a string wake can be identified in the dark matter distribution, using the current level of the statistical analysis, down to a redshift of $z = 10$.

We explore a new technique to measure cosmic shear using Einstein rings. In Birrer et al. (2017), we showed that the detailed modelling of Einstein rings can be used to measure external shear to high precision. In this letter, we explore how a collection of Einstein rings can be used as a statistical probe of cosmic shear. We present a forecast of the cosmic shear information available in Einstein rings for different strong lensing survey configurations. We find that, assuming that the number density of Einstein rings in the COSMOS survey is representative, future strong lensing surveys should have a cosmological precision comparable to the current ground based weak lensing surveys. We discuss how this technique is complementary to the standard cosmic shear analyses since it is sensitive to different systematic and can be used for cross-calibration.

Assessing the consistency of parameter constraints derived from different cosmological probes is an important way to test the validity of the underlying cosmological model. In an earlier work [Nicola et al., 2017], we computed constraints on cosmological parameters for $\Lambda$CDM from an integrated analysis of CMB temperature anisotropies and CMB lensing from Planck, galaxy clustering and weak lensing from SDSS, weak lensing from DES SV as well as Type Ia supernovae and Hubble parameter measurements. In this work, we extend this analysis and quantify the concordance between the derived constraints and those derived by the Planck Collaboration as well as WMAP9, SPT and ACT. As a measure for consistency, we use the Surprise statistic [Seehars et al., 2014], which is based on the relative entropy. In the framework of a flat $\Lambda$CDM cosmological model, we find all data sets to be consistent with one another at a level of less than 1$\sigma$. We highlight that the relative entropy is sensitive to inconsistencies in the models that are used in different parts of the analysis. In particular, inconsistent assumptions for the neutrino mass break its invariance on the parameter choice. When consistent model assumptions are used, the data sets considered in this work all agree with each other and $\Lambda$CDM, without evidence for tensions.

As wide-field surveys yield ever more precise measurements, cosmology has entered a phase of high precision requiring highly accurate and fast theoretical predictions. At the heart of most cosmological model predictions is a numerical solution of the Einstein-Boltzmann equations governing the evolution of linear perturbations in the Universe. We present PyCosmo, a new Python-based framework to solve this set of equations using a special pur- pose solver based on symbolic manipulations, automatic generation of C++ code and sparsity optimisation. The code uses a consistency relation of the field equations to adapt the time step and does not rely on physical approximations for speed-up. After reviewing the system of first-order linear homogeneous differential equations to be solved, we describe the numerical scheme implemented in PyCosmo. We then compare the predictions and performance of the code for the computation of the transfer functions of cosmological perturbations and compare it to existing cosmological Boltzmann codes. We find that we achieve comparable execution times for comparable accuracies. While PyCosmo does not yet have all the features of other codes, our approach is complementary to existing cosmological Boltzmann solvers and can be used as an independent test of their numerical solutions. The symbolic representation of the Einstein-Boltzmann equation system in PyCosmo provides a convenient interface for implementing extended cosmological models. We also discuss how the PyCosmo framework can also be used as a general framework to compute cosmological quantities as well as observables for both interactive and high-performance batch jobs applications. Information about the PyCosmo package and future code releases are available at http://www.cosmology.ethz.ch/research/software-lab.html.

Determining the redshift distribution $n(z)$ of galaxy samples is essential for several cosmological probes including weak lensing. For imaging surveys, this is usually done using photometric redshifts estimated on an object-by-object basis. We present a new approach for directly measuring the global $n(z)$ of cosmological galaxy samples, including uncertainties, using forward modeling. Our method relies on image simulations produced using UFig (Ultra Fast Image Generator) and on ABC (Approximate Bayesian Computation) within the $MCCL$ (Monte-Carlo Control Loops) framework. The galaxy population is modeled using parametric forms for the luminosity functions, spectral energy distributions, sizes and radial profiles of both blue and red galaxies. We apply exactly the same analysis to the real data and to the simulated images, which also include instrumental and observational effects. By adjusting the parameters of the simulations, we derive a set of acceptable models that are statistically consistent with the data. We then apply the same cuts to the simulations that were used to construct the target galaxy sample in the real data. The redshifts of the galaxies in the resulting simulated samples yield a set of $n(z)$ distributions for the acceptable models. We demonstrate the method by determining $n(z)$ for a cosmic shear like galaxy sample from the 4-band Subaru Suprime-Cam data in the COSMOS field. We also complement this imaging data with a spectroscopic calibration sample from the VVDS survey. We compare our resulting posterior $n(z)$ distributions to the one derived from photometric redshifts estimated using 36 photometric bands in COSMOS and find good agreement. This offers good prospects for applying our approach to current and future large imaging surveys.

Weak Gravitational Lensing is a powerful probe of the dark sector of the Universe. One of the main challenges for this technique is the treatment of systematics in the measurement of cosmic shear from galaxy shapes. In an earlier work, Refregier & Amara (2014) have proposed the Monte Carlo Control Loops (MCCL) to overcome these effects using a forward modeling approach. We focus here on one of the control loops in this method, the task of which is the calibration of the shear measurement. For this purpose, we first consider the requirements on the shear systematics for a given survey and propagate them to different systematics terms. We use two one-point statistics to calibrate the shear measurement and six further one-point statistics as diagnostics. We also propagate the systematics levels that we estimate from the one-point functions to the two-point functions for the different systematic error sources. This allows us to assess the consistency between the systematics levels measured in different ways. To test the method, we construct synthetic sky surveys with an area of 1,700 deg$^2$. With some simplifying assumptions, we are able to meet the requirements on the shear calibration for this survey configuration. Furthermore, we account for the total residual shear systematics in terms of the contributing sources. We discuss how this MCCL framework can be applied to current and future weak lensing surveys.

The linear Einstein-Boltzmann equations describe the evolution of perturbations in the universe and its numerical solutions play a central role in cosmology. We revisit this system of differential equations and present a detailed investigation of its mathematical properties. For this purpose, we focus on a simplified set of equations aimed at describing the broad features of the matter power spectrum. We first perform an eigenvalue analysis and study the onset of oscillations in the system signaled by the transition from real to complex eigenvalues. We then provide a stability criterion of different numerical schemes for this linear system and estimate the associated step-size. We elucidate the stiffness property of the Einstein-Boltzmann system and show how it can be characterized in terms of the eigenvalues. While the parameters of the system are time dependent making it non-autonomous, we define an adiabatic regime where the parameters vary slowly enough for the system to be quasi-autonomous. We summarize the different regimes of the system for these different criteria as function of wave number $k$ and scale factor $a$. We also provide a compendium of analytic solutions for all perturbation variables in 6 limits on the $k$-$a$ plane and express them explicitly in terms of initial conditions. These results are aimed to help the further development and testing of numerical cosmological Boltzmann solvers.

We study the substructure content of the strong gravitational lens RXJ1131-1231 through a forward modelling approach that relies on generating an extensive suite of realistic simulations. We use a semi-analytic merger tree prescription that allows us to stochastically generate substructure populations whose properties depend on the dark matter particle mass. These synthetic halos are then used as lenses to produce realistic mock images that have the same features, e.g. luminous arcs, quasar positions, instrumental noise and PSF, as the data. We then analyse the data and the simulations in the same way with summary statistics that are sensitive to the signal being targeted and are able to constrain models of dark matter statistically using Approximate Bayesian Computing (ABC) techniques. In this work, we focus on the thermal relic mass estimate and fix the semi-analytic descriptions of the substructure evolution based on recent literature. We are able, based on the HST data for RXJ1131-1231, to rule out a warm dark matter thermal relic mass below 2 keV at the 2$\sigma$ confidence level.

We present the first constraints on cosmology from the Dark Energy Survey (DES), using weak lensing measurements from the preliminary Science Verification (SV) data. We use 139 square degrees of SV data, which is less than 3\% of the full DES survey area. Using cosmic shear 2-point measurements over three redshift bins we find $\sigma_8 (\Omega_{\rm m}/0.3)^{0.5} = 0.81 \pm 0.06$ (68\% confidence), after marginalising over 7 systematics parameters and 3 other cosmological parameters. We examine the robustness of our results to the choice of data vector and systematics assumed, and find them to be stable. About $20$\% of our error bar comes from marginalising over shear and photometric redshift calibration uncertainties. The current state-of-the-art cosmic shear measurements from CFHTLenS are mildly discrepant with the cosmological constraints from Planck CMB data; our results are consistent with both datasets. Our uncertainties are $\sim$30\% larger than those from CFHTLenS when we carry out a comparable analysis of the two datasets, which we attribute largely to the lower number density of our shear catalogue. We investigate constraints on dark energy and find that, with this small fraction of the full survey, the DES SV constraints make negligible impact on the Planck constraints. The moderate disagreement between the CFHTLenS and Planck values of $\sigma_8 (\Omega_{\rm m}/0.3)^{0.5}$ is present regardless of the value of $w$.

We present a simple method to accurately infer line of sight (LOS) integrated lensing effects for galaxy scale strong lens systems through image reconstruction. Our approach enables us to separate weak lensing LOS effects from the main strong lens deflector. We test our method using mock data and show that strong lens systems can be accurate probes of cosmic shear with a precision on the shear terms of $\pm 0.003$ (statistical error) for an HST-like dataset. We apply our formalism to reconstruct the lens COSMOS 0038+4133 and its LOS. In addition, we estimate the LOS properties with a halo-rendering estimate based on the COSMOS field galaxies and a galaxy-halo connection. The two approaches are independent and complementary in their information content. We find that when estimating the convergence at the strong lens system, performing a joint analysis improves the measure by a factor of two compared to a halo model only analysis. Furthermore the constraints of the strong lens reconstruction lead to tighter constraints on the halo masses of the LOS galaxies. Joint constraints of multiple strong lens systems may add valuable information to the galaxy-halo connection and may allow independent weak lensing shear measurement calibrations.

We extend the results of previous analyses towards constraining the abundance and clustering of post-reionization ($z \sim 0-5$) neutral hydrogen (HI) systems using a halo model framework. We work with a comprehensive HI dataset including the small-scale clustering, column density and mass function of HI galaxies at low redshifts, intensity mapping measurements at intermediate redshifts and the UV/optical observations of Damped Lyman Alpha (DLA) systems at higher redshifts. We use a Markov Chain Monte Carlo (MCMC) approach to constrain the parameters of the best-fitting models, both for the HI-halo mass relation and the HI radial density profile. We find that a radial exponential profile results in a good fit to the low-redshift HI observations, including the clustering and the column density distribution. The form of the profile is also found to match the high-redshift DLA observations, when used in combination with a three-parameter HI-halo mass relation and a redshift evolution in the HI concentration. The halo model predictions are in good agreement with the observed HI surface density profiles of low-redshift galaxies, and the general trends in the the impact parameter and covering fraction observations of high-redshift DLAs. We provide convenient tables summarizing the best-fit halo model predictions.

Recent progress in cosmology has relied on combining different cosmological probes. In earlier work, we implemented an integrated approach to cosmology where the probes are combined into a common framework at the map level. This has the advantage of taking full account of the correlations between the different probes, to provide a stringent test of systematics and of the validity of the cosmological model. We extend this analysis to include not only CMB temperature, galaxy clustering, weak lensing from SDSS but also CMB lensing, weak lensing from the DES SV survey, Type Ia SNe and $H_{0}$ measurements. This yields 12 auto- and cross-power spectra as well as background probes. Furthermore, we extend the treatment of systematic uncertainties. For $\Lambda$CDM, we find results that are consistent with our earlier work. Given our enlarged data set and systematics treatment, this confirms the robustness of our analysis and results. Furthermore, we find that our best-fit cosmological model gives a good fit to the data we consider with no signs of tensions within our analysis. We also find our constraints to be consistent with those found by WMAP9, SPT and ACT and the KiDS weak lensing survey. Comparing with the Planck Collaboration results, we see a broad agreement, but there are indications of a tension from the marginalized constraints in most pairs of cosmological parameters. Since our analysis includes CMB temperature Planck data at $10 < \ell < 610$, the tension appears to arise between the Planck high$-\ell$ and the other measurements. Furthermore, we find the constraints on the probe calibration parameters to be in agreement with expectations, showing that the data sets are mutually consistent. In particular, this yields a confirmation of the amplitude calibration of the weak lensing measurements from SDSS, DES SV and Planck CMB lensing from our integrated analysis. [abridged]

The X-ray emission from active galactic nucleus (AGN) is a major component of extragalactic X-ray sky. In this paper, we use the X-ray luminosity function (XLF) and halo occupation distribution (HOD) formalism to construct a halo model for the X-ray emission from AGNs. Verifying that the two inputs (XLF and HOD) are in agreement with each other, we compute the auto-correlation power spectrum in the soft X-ray band (0.5-2 keV) due to the AGNs potentially resolved by eROSITA (extended ROentgen Survey with an Imaging Telescope Array) mission and explore the redshift and mass dependence of the power spectrum. Studying the relative contribution of the Poisson and the clustering terms to the total power, we find that at multipoles $l\lesssim 1000$ (i.e. large scales), the clustering term is larger than the Poisson term. We also forecast the potential of X-ray auto-correlation power spectrum and X-ray-lensing cross-correlation power spectrum using eROSITA and eROSITA-LSST (Large Synoptic Survey Telescope) surveys, respectively, to constrain the HOD parameters and their redshift evolution. In addition, we compute the power spectrum of the AGNs lying below the flux resolution limit of eROSITA, which is essential to understand in order to extract the X-ray signal from the hot diffuse gas present in galaxies and clusters.

We propose a novel approach for mitigating radio frequency interference (RFI) signals in radio data using the latest advances in deep learning. We employ a special type of Convolutional Neural Network, the U-Net, that enables the classification of clean signal and RFI signatures in 2D time-ordered data acquired from a radio telescope. We train and assess the performance of this network using the HIDE & SEEK radio data simulation and processing packages, as well as early Science Verification data acquired with the 7m single-dish telescope at the Bleien Observatory. We find that our U-Net implementation is showing competitive accuracy to classical RFI mitigation algorithms such as SEEK's SumThreshold implementation. We publish our U-Net software package on GitHub under GPLv3 license.

As several large single-dish radio surveys begin operation within the coming decade, a wealth of radio data will become available and provide a new window to the Universe. In order to fully exploit the potential of these data sets, it is important to understand the systematic effects associated with the instrument and the analysis pipeline. A common approach to tackle this is to forward-model the entire system - from the hardware to the analysis of the data products. For this purpose, we introduce two newly developed, open-source Python packages: the HI Data Emulator (HIDE) and the Signal Extraction and Emission Kartographer (SEEK) for simulating and processing single-dish radio survey data. HIDE forward-models the process of collecting astronomical radio signals in a single-dish radio telescope instrument and outputs pixel-level time-ordered-data. SEEK processes the time-ordered-data, removes artifacts from Radio Frequency Interference (RFI), automatically applies flux calibration, and aims to recover the astronomical radio signal. The two packages can be used separately or together depending on the application. Their modular and flexible nature allows easy adaptation to other instruments and data sets. We describe the basic architecture of the two packages and examine in detail the noise and RFI modeling in HIDE, as well as the implementation of gain calibration and RFI mitigation in SEEK. We then apply HIDE & SEEK to forward-model a Galactic survey in the frequency range 990 - 1260 MHz based on data taken at the Bleien Observatory. For this survey, we expect to cover 70% of the full sky and achieve a median signal-to-noise ratio of approximately 5 - 6 in the cleanest channels including systematic uncertainties. However, we also point out the potential challenges of high RFI contamination and baseline removal when examining the early data from the Bleien Observatory.

DESI (Dark Energy Spectropic Instrument) is a Stage IV ground-based dark energy experiment that will study baryon acoustic oscillations and the growth of structure through redshift-space distortions with a wide-area galaxy and quasar redshift survey. The DESI instrument is a robotically-actuated, fiber-fed spectrograph capable of taking up to 5,000 simultaneous spectra over a wavelength range from 360 nm to 980 nm. The fibers feed ten three-arm spectrographs with resolution $R= \lambda/\Delta\lambda$ between 2000 and 5500, depending on wavelength. The DESI instrument will be used to conduct a five-year survey designed to cover 14,000 deg$^2$. This powerful instrument will be installed at prime focus on the 4-m Mayall telescope in Kitt Peak, Arizona, along with a new optical corrector, which will provide a three-degree diameter field of view. The DESI collaboration will also deliver a spectroscopic pipeline and data management system to reduce and archive all data for eventual public use.

DESI (Dark Energy Spectroscopic Instrument) is a Stage IV ground-based dark energy experiment that will study baryon acoustic oscillations (BAO) and the growth of structure through redshift-space distortions with a wide-area galaxy and quasar redshift survey. To trace the underlying dark matter distribution, spectroscopic targets will be selected in four classes from imaging data. We will measure luminous red galaxies up to $z=1.0$. To probe the Universe out to even higher redshift, DESI will target bright [O II] emission line galaxies up to $z=1.7$. Quasars will be targeted both as direct tracers of the underlying dark matter distribution and, at higher redshifts ($ 2.1 < z < 3.5$), for the Ly-$\alpha$ forest absorption features in their spectra, which will be used to trace the distribution of neutral hydrogen. When moonlight prevents efficient observations of the faint targets of the baseline survey, DESI will conduct a magnitude-limited Bright Galaxy Survey comprising approximately 10 million galaxies with a median $z\approx 0.2$. In total, more than 30 million galaxy and quasar redshifts will be obtained to measure the BAO feature and determine the matter power spectrum, including redshift space distortions.

21cm intensity mapping is a novel approach aimed at measuring the power spectrum of density fluctuations and deducing cosmological information, notably from the Baryonic Acoustic Oscillations (BAO). We give an update on the progress of BAO from Integrated Neutral Gas Observations (BINGO) which is a single dish intensity mapping project. First we explain the basic ideas behind intensity mapping concept before updating the instrument design for BINGO. We also outline the survey we plan to make and its projected science output including estimates of cosmological parameters.

We describe a combined halo model to constrain the distribution of neutral hydrogen (HI) in the post-reionization universe. We combine constraints from the various probes of HI at different redshifts: the low-redshift 21-cm emission line surveys, intensity mapping experiments at intermediate redshifts, and the Damped Lyman-Alpha (DLA) observations at higher redshifts. We use a Markov Chain Monte Carlo (MCMC) approach to combine the observations and place constraints on the free parameters in the model. Our best-fit model involves a relation between neutral hydrogen mass $M_{\rm HI}$ and halo mass $M$ with a non-unit slope, and an upper and a lower cutoff. We find that the model fits all the observables but leads to an underprediction of the bias parameter of DLAs at $z \sim 2.3$. We also find indications of a possible tension between the HI column density distribution and the mass function of HI-selected galaxies at $z\sim 0$. We provide the central values of the parameters of the best-fit model so derived. We also provide a fitting form for the derived evolution of the concentration parameter of HI in dark matter haloes, and discuss the implications for the redshift evolution of the HI-halo mass relation.

Recent observational progress has led to the establishment of the standard $\Lambda$CDM model for cosmology. This development is based on different cosmological probes that are usually combined through their likelihoods at the latest stage in the analysis. We implement here an integrated scheme for cosmological probes, which are combined in a common framework starting at the map level. This treatment is necessary as the probes are generally derived from overlapping maps and are thus not independent. It also allows for a thorough test of the cosmological model and of systematics through the consistency of different physical tracers. As a first application, we combine current measurements of the Cosmic Microwave Background (CMB) from the Planck satellite, and galaxy clustering and weak lensing from SDSS. We consider the spherical harmonic power spectra of these probes including all six auto- and cross-correlations along with the associated full Gaussian covariance matrix. This provides an integrated treatment of different analyses usually performed separately including CMB anisotropies, cosmic shear, galaxy clustering, galaxy-galaxy lensing and the Integrated Sachs-Wolfe (ISW) effect with galaxy and shear tracers. We derive constraints on $\Lambda$CDM parameters that are compatible with existing constraints and highlight tensions between data sets, which become apparent in this integrated treatment. We discuss how this approach provides a complete and powerful integrated framework for probe combination and how it can be extended to include other tracers in the context of current and future wide field cosmological surveys.

We use wavelet and curvelet transforms to extract signals of cosmic strings from cosmic microwave background (CMB) temperature anisotropy maps, and to study the limits on the cosmic string tension which various ongoing CMB temperature anisotropy experiments will be able to achieve. We construct sky maps with size and angular resolution corresponding to various experiments. These maps contain the signals of a scaling solution of long string segments with a given string tension $G \mu$, the contribution of the dominant Gaussian primordial cosmological fluctuations, and pixel by pixel white noise with an amplitude corresponding to the instrumental noise of the various experiments. In the case that we include white noise, we find that the curvelets are more powerful than wavelets. For maps with Planck specification, we obtain bounds on the string tension comparable to what was obtained by the Planck collaboration. Experiments with better angular resolution such as the South Pole Telescope third generation (SPT-3G) survey will be able to yield stronger limits. For maps with a specification of SPT-3G we find that string signals will be visible down to a string tension of $G \mu = 1.4 \times 10^{-7}$.

This overview article describes the legacy prospect and discovery potential of the Dark Energy Survey (DES) beyond cosmological studies, illustrating it with examples from the DES early data. DES is using a wide-field camera (DECam) on the 4m Blanco Telescope in Chile to image 5000 sq deg of the sky in five filters (grizY). By its completion the survey is expected to have generated a catalogue of 300 million galaxies with photometric redshifts and 100 million stars. In addition, a time-domain survey search over 27 sq deg is expected to yield a sample of thousands of Type Ia supernovae and other transients. The main goals of DES are to characterise dark energy and dark matter, and to test alternative models of gravity; these goals will be pursued by studying large scale structure, cluster counts, weak gravitational lensing and Type Ia supernovae. However, DES also provides a rich data set which allows us to study many other aspects of astrophysics. In this paper we focus on additional science with DES, emphasizing areas where the survey makes a difference with respect to other current surveys. The paper illustrates, using early data (from `Science Verification', and from the first, second and third seasons of observations), what DES can tell us about the solar system, the Milky Way, galaxy evolution, quasars, and other topics. In addition, we show that if the cosmological model is assumed to be Lambda+ Cold Dark Matter (LCDM) then important astrophysics can be deduced from the primary DES probes. Highlights from DES early data include the discovery of 34 Trans Neptunian Objects, 17 dwarf satellites of the Milky Way, one published z > 6 quasar (and more confirmed) and two published superluminous supernovae (and more confirmed).

We present extended modeling of the strong lens system RXJ1131-1231 with archival data in two HST bands in combination with existing line-of-sight contribution and velocity dispersion estimates. Our focus is on source size and its influence on time-delay cosmography. We therefore examine the impact of mass-sheet degeneracy and especially the degeneracy pointed out by Schneider & Sluse (2013) using the source reconstruction scale. We also extend on previous work by further exploring the effects of priors on the kinematics of the lens and the external convergence in the environment of the lensing system. Our results coming from RXJ1131-1231 are given in a simple analytic form so that they can be easily combined with constraints coming from other cosmological probes. We find that the choice of priors on lens model parameters and source size are subdominant for the statistical errors for $H_0$ measurements of this systems. The choice of prior for the source is sub-dominant at present (2% uncertainty on $H_0$) but may be relevant for future studies. More importantly, we find that the priors on the kinematic anisotropy of the lens galaxy have a significant impact on our cosmological inference. When incorporating all the above modeling uncertainties, we find $H_0 = 86.6^{+6.8}_{-6.9}$ km s$^{-1}$Mpc$^{-1}$, when using kinematic priors similar to other studies. When we use a different kinematic prior motivated by Barnab\`e et al. (2012) but covering the same anisotropic range, we find $H_0 = 74.5^{+8.0}_{-7.8}$ km s$^{-1}$Mpc$^{-1}$. This means that the choice of kinematic modeling and priors have a significant impact on cosmographic inferences. The way forward is either to get better velocity dispersion measures which would down weight the impact of the priors or to construct physically motivated priors for the velocity dispersion model.

Cosmic shear is sensitive to fluctuations in the cosmological matter density field, including on small physical scales, where matter clustering is affected by baryonic physics in galaxies and galaxy clusters, such as star formation, supernovae feedback and AGN feedback. While muddying any cosmological information that is contained in small scale cosmic shear measurements, this does mean that cosmic shear has the potential to constrain baryonic physics and galaxy formation. We perform an analysis of the Dark Energy Survey (DES) Science Verification (SV) cosmic shear measurements, now extended to smaller scales, and using the Mead et al. 2015 halo model to account for baryonic feedback. While the SV data has limited statistical power, we demonstrate using a simulated likelihood analysis that the final DES data will have the statistical power to differentiate among baryonic feedback scenarios. We also explore some of the difficulties in interpreting the small scales in cosmic shear measurements, presenting estimates of the size of several other systematic effects that make inference from small scales difficult, including uncertainty in the modelling of intrinsic alignment on nonlinear scales, `lensing bias', and shape measurement selection effects. For the latter two, we make use of novel image simulations. While future cosmic shear datasets have the statistical power to constrain baryonic feedback scenarios, there are several systematic effects that require improved treatments, in order to make robust conclusions about baryonic feedback.

We present measurements of weak gravitational lensing cosmic shear two-point statistics using Dark Energy Survey Science Verification data. We demonstrate that our results are robust to the choice of shear measurement pipeline, either ngmix or im3shape, and robust to the choice of two-point statistic, including both real and Fourier-space statistics. Our results pass a suite of null tests including tests for B-mode contamination and direct tests for any dependence of the two-point functions on a set of 16 observing conditions and galaxy properties, such as seeing, airmass, galaxy color, galaxy magnitude, etc. We furthermore use a large suite of simulations to compute the covariance matrix of the cosmic shear measurements and assign statistical significance to our null tests. We find that our covariance matrix is consistent with the halo model prediction, indicating that it has the appropriate level of halo sample variance. We compare the same jackknife procedure applied to the data and the simulations in order to search for additional sources of noise not captured by the simulations. We find no statistically significant extra sources of noise in the data. The overall detection significance with tomography for our highest source density catalog is 9.7sigma. Cosmological constraints from the measurements in this work are presented in a companion paper (DES et al. 2015).

We describe the design and performance of the hardware system at the Bleien Observatory. The system is designed to deliver a map of the Galaxy for studying the foreground contamination of low-redshift (z=0.13--0.43) H$_{\rm I}$ intensity mapping experiments as well as other astronomical Galactic studies. This hardware system is composed of a 7m parabolic dish, a dual-polarization corrugated horn feed, a pseudo correlation receiver, a Fast Fourier Transform spectrometer, and an integrated control system that controls and monitors the progress of the data collection. The main innovative designs in the hardware are (1) the pseudo correlation receiver and the cold reference source within (2) the high dynamic range, high frequency resolution spectrometer and (3) the phase-switch implementation of the system. This is the first time these technologies are used together for a L-band radio telescope to achieve an electronically stable system, which is an essential first step for wide-field cosmological measurements. This work demonstrates the prospects and challenges for future H$_{\rm I}$ intensity mapping experiments.

We present a new method to measure the redshift-dependent galaxy bias by combining information from the galaxy density field and the weak lensing field. This method is based on Amara et al. (2012), where they use the galaxy density field to construct a bias-weighted convergence field kg. The main difference between Amara et al. (2012) and our new implementation is that here we present another way to measure galaxy bias using tomography instead of bias parameterizations. The correlation between kg and the true lensing field k allows us to measure galaxy bias using different zero-lag correlations, such as <kgk>/<kk> or <kgkg>/<kgk>. Our method measures the linear bias factor on linear scales under the assumption of no stochasticity between galaxies and matter. We use the MICE simulation to measure the linear galaxy bias for a flux-limited sample (i < 22.5) in tomographic redshift bins using this method. This paper is the first that studies the accuracy and systematic uncertainties associated with the implementation of the method, and the regime where it is consistent with the linear galaxy bias defined by projected 2-point correlation functions (2PCF). We find that our method is consistent with linear bias at the percent level for scales larger than 30 arcmin, while nonlinearities appear at smaller scales. This measurement is a good complement to other measurements of bias, since it does not depend strongly on sigma8 as the 2PCF measurements. We apply this method to the Dark Energy Survey Science Verification data in a follow-up paper.

Quantifying the concordance between different cosmological experiments is important for testing the validity of theoretical models and systematics in the observations. In earlier work, we thus proposed the Surprise, a concordance measure derived from the relative entropy between posterior distributions. We revisit the properties of the Surprise and describe how it provides a general, versatile, and robust measure for the agreement between datasets. We also compare it to other measures of concordance that have been proposed for cosmology. As an application, we extend our earlier analysis and use the Surprise to quantify the agreement between WMAP 9, Planck 13 and Planck 15 constraints on the $\Lambda$CDM model. Using a principle component analysis in parameter space, we find that the large Surprise between WMAP 9 and Planck 13 (S = 17.6 bits, implying a deviation from consistency at 99.8% confidence) is due to a shift along a direction that is dominated by the amplitude of the power spectrum. The Planck 15 constraints deviate from the Planck 13 results (S = 56.3 bits), primarily due to a shift in the same direction. The Surprise between WMAP and Planck consequently disappears when moving to Planck 15 (S = -5.1 bits). This means that, unlike Planck 13, Planck 15 is not in tension with WMAP 9. These results illustrate the advantages of the relative entropy and the Surprise for quantifying the disagreement between cosmological experiments and more generally as an information metric for cosmology.

We measure the redshift evolution of galaxy bias for a magnitude-limited galaxy sample by combining the galaxy density maps and weak lensing shear maps for a $\sim$116 deg$^{2}$ area of the Dark Energy Survey (DES) Science Verification data. This method was first developed in Amara et al. (2012) and later re-examined in a companion paper (Pujol et al. 2016) with rigorous simulation tests and analytical treatment of tomographic measurements. In this work we apply this method to the DES SV data and measure the galaxy bias for a i$<$22.5 galaxy sample. We find the galaxy bias and 1$\sigma$ error bars in 4 photometric redshift bins to be 1.12$\pm$0.19 (z=0.2-0.4), 0.97$\pm$0.15 (z=0.4-0.6), 1.38$\pm$0.39 (z=0.6-0.8)), and 1.45$\pm$0.56 (z=0.8-1.0). These measurements are consistent at the 2$\sigma$ level with measurements on the same dataset using galaxy clustering and cross-correlation of galaxies with CMB lensing, with most of the redshift bins consistent within the 1{\sigma} error bars. In addition, our method provides the only $\sigma_8$-independent constraint among the three. We forward-model the main observational effects using mock galaxy catalogs by including shape noise, photo-z errors and masking effects. We show that our bias measurement from the data is consistent with that expected from simulations. With the forthcoming full DES data set, we expect this method to provide additional constraints on the galaxy bias measurement from more traditional methods. Furthermore, in the process of our measurement, we build up a 3D mass map that allows further exploration of the dark matter distribution and its relation to galaxy evolution.

Massive gravity in the presence of doubly coupled matter field via en effective composite metric yields an accelerated expansion of the universe. It has been recently shown that the model admits stable de Sitter attractor solutions and could be used as a dark energy model. In this work, we perform a first analysis of the constraints imposed by the SNIa, BAO and CMB data on the massive gravity model with the effective composite metric and show that all the background observations are mutually compatible at the one sigma level with the model.

We present weak lensing shear catalogues for 139 square degrees of data taken during the Science Verification (SV) time for the new Dark Energy Camera (DECam) being used for the Dark Energy Survey (DES). We describe our object selection, point spread function estimation and shear measurement procedures using two independent shear pipelines, IM3SHAPE and NGMIX, which produce catalogues of 2.12 million and 3.44 million galaxies respectively. We detail a set of null tests for the shear measurements and find that they pass the requirements for systematic errors at the level necessary for weak lensing science applications using the SV data. We also discuss some of the planned algorithmic improvements that will be necessary to produce sufficiently accurate shear catalogues for the full 5-year DES, which is expected to cover 5000 square degrees.

This paper is dedicated to scrutinizing the cosmology in massive gravity. A matter field of the dark sector is coupled to an effective composite metric while a standard matter field couples to the dynamical metric in the usual way. For this purpose, we study the dynamical system of cosmological solutions by using phase analysis, which provides an overview of the class of cosmological solutions in this setup. This also permits us to study the critical points of the cosmological equations together with their stability. We show the presence of stable attractor de Sitter critical points relevant to the late-time cosmic acceleration. Furthermore, we study the tensor, vector and scalar perturbations in the presence of standard matter fields and obtain the conditions for the absence of ghost and gradient instabilities. Hence, massive gravity in the presence of the effective composite metric can accommodate interesting dark energy phenomenology, that can be observationally distinguished from the standard model according to the expansion history and cosmic growth.

In light of the growing number of cosmological observations, it is important to develop versatile tools to quantify the constraining power and consistency of cosmological probes. Originally motivated from information theory, we use the relative entropy to compute the information gained by Bayesian updates in units of bits. This measure quantifies both the improvement in precision and the 'surprise', i.e. the tension arising from shifts in central values. Our starting point is a WMAP9 prior which we update with observations of the distance ladder, supernovae (SNe), baryon acoustic oscillations (BAO), and weak lensing as well as the 2015 Planck release. We consider the parameters of the flat $\Lambda$CDM concordance model and some of its extensions which include curvature and Dark Energy equation of state parameter $w$. We find that, relative to WMAP9 and within these model spaces, the probes that have provided the greatest gains are Planck (10 bits), followed by BAO surveys (5.1 bits) and SNe experiments (3.1 bits). The other cosmological probes, including weak lensing (1.7 bits) and {$\rm H_0$} measures (1.7 bits), have contributed information but at a lower level. Furthermore, we do not find any significant surprise when updating the constraints of WMAP9 with any of the other experiments, meaning that they are consistent with WMAP9. However, when we choose Planck15 as the prior, we find that, accounting for the full multi-dimensionality of the parameter space, the weak lensing measurements of CFHTLenS produce a large surprise of 4.4 bits which is statistically significant at the 8 $\sigma$ level. We discuss how the relative entropy provides a versatile and robust framework to compare cosmological probes in the context of current and future surveys.

Shear peak statistics has gained a lot of attention recently as a practical alternative to the two point statistics for constraining cosmological parameters. We perform a shear peak statistics analysis of the Dark Energy Survey (DES) Science Verification (SV) data, using weak gravitational lensing measurements from a 139 deg$^2$ field. We measure the abundance of peaks identified in aperture mass maps, as a function of their signal-to-noise ratio, in the signal-to-noise range $0<\mathcal S / \mathcal N<4$. To predict the peak counts as a function of cosmological parameters we use a suite of $N$-body simulations spanning 158 models with varying $\Omega_{\rm m}$ and $\sigma_8$, fixing $w = -1$, $\Omega_{\rm b} = 0.04$, $h = 0.7$ and $n_s=1$, to which we have applied the DES SV mask and redshift distribution. In our fiducial analysis we measure $\sigma_{8}(\Omega_{\rm m}/0.3)^{0.6}=0.77 \pm 0.07$, after marginalising over the shear multiplicative bias and the error on the mean redshift of the galaxy sample. We introduce models of intrinsic alignments, blending, and source contamination by cluster members. These models indicate that peaks with $\mathcal S / \mathcal N>4$ would require significant corrections, which is why we do not include them in our analysis. We compare our results to the cosmological constraints from the two point analysis on the SV field and find them to be in good agreement in both the central value and its uncertainty. We discuss prospects for future peak statistics analysis with upcoming DES data.

Intensity mapping of neutral hydrogen (HI) is a promising observational probe of cosmology and large-scale structure. We present wide field simulations of HI intensity maps based on N-body simulations of a $2.6\, {\rm Gpc / h}$ box with $2048^3$ particles (particle mass $1.6 \times 10^{11}\, {\rm M_\odot / h}$). Using a conditional mass function to populate the simulated dark matter density field with halos below the mass resolution of the simulation ($10^{8}\, {\rm M_\odot / h} < M_{\rm halo} < 10^{13}\, {\rm M_\odot / h}$), we assign HI to those halos according to a phenomenological halo to HI mass relation. The simulations span a redshift range of 0.35 < z < 0.9 in redshift bins of width $\Delta z \approx 0.05$ and cover a quarter of the sky at an angular resolution of about 7'. We use the simulated intensity maps to study the impact of non-linear effects and redshift space distortions on the angular clustering of HI. Focusing on the autocorrelations of the maps, we apply and compare several estimators for the angular power spectrum and its covariance. We verify that these estimators agree with analytic predictions on large scales and study the validity of approximations based on Gaussian random fields, particularly in the context of the covariance. We discuss how our results and the simulated maps can be useful for planning and interpreting future HI intensity mapping surveys.

We review the analytical prescriptions in the literature to model the 21-cm (emission line surveys/intensity mapping experiments) and Damped Lyman-Alpha (DLA) observations of neutral hydrogen (HI) in the post-reionization universe. While these two sets of prescriptions have typically been applied separately for the two probes, we attempt to connect these approaches to explore the consequences for the distribution and evolution of HI across redshifts. We find that a physically motivated, 21-cm based prescription, extended to account for the DLA observables provides a good fit to the majority of the available data, but cannot accommodate the recent measurement of the clustering of DLAs at $z \sim 2.3$. This highlights a tension between the DLA bias and the 21-cm measurements, unless there is a very significant change in the nature of HI-bearing systems across redshifts 0-3. We discuss the implications of our findings for the characteristic host halo masses of the DLAs and the power spectrum of 21-cm intensity fluctuations.

The nature of dark matter, dark energy and large-scale gravity pose some of the most pressing questions in cosmology today. These fundamental questions require highly precise measurements, and a number of wide-field spectroscopic survey instruments are being designed to meet this requirement. A key component in these experiments is the development of a simulation tool to forecast science performance, define requirement flow-downs, optimize implementation, demonstrate feasibility, and prepare for exploitation. We present SPOKES (SPectrOscopic KEn Simulation), an end-to-end simulation facility for spectroscopic cosmological surveys designed to address this challenge. SPOKES is based on an integrated infrastructure, modular function organization, coherent data handling and fast data access. These key features allow reproducibility of pipeline runs, enable ease of use and provide flexibility to update functions within the pipeline. The cyclic nature of the pipeline offers the possibility to make the science output an efficient measure for design optimization and feasibility testing. We present the architecture, first science, and computational performance results of the simulation pipeline. The framework is general, but for the benchmark tests, we use the Dark Energy Spectrometer (DESpec), one of the early concepts for the upcoming project, the Dark Energy Spectroscopic Instrument (DESI). We discuss how the SPOKES framework enables a rigorous process to optimize and exploit spectroscopic survey experiments in order to derive high-precision cosmological measurements optimally.

We study the cross-correlation of distribution of galaxies, the Sunyaev-Zel'dovich (SZ) and X-ray power spectra of galaxies from current and upcoming surveys and show these to be excellent probes of the nature, i.e. extent, evolution and energetics, of the circumgalactic medium (CGM). The SZ-galaxy cross-power spectrum, especially at large multipoles, depends on the steepness of the pressure profile of the CGM. This property of the SZ signal can, thus, be used to constrain the pressure profile of the CGM. The X-ray cross power spectrum also has a similar shape. However, it is much more sensitive to the underlying density profile. We forecast the detectability of the cross-correlated galaxy distribution, SZ and X-ray signals by combining South Pole Telescope-Dark Energy Survey (SPT-DES) and eROSITA-DES/eROSITA-LSST (extended ROentgen Survey with an Imaging Telescope Array-Large Synoptic Survey Telescope) surveys, respectively. We find that, for the SPT-DES survey, the signal-to-noise ratio (SNR) peaks at high mass and redshift with SNR $\sim 9$ around $M_h\sim 10^{13} h^{-1} M_{\odot}$ and $z\sim 1.5\hbox{--} 2$ for flat density and temperature profiles. The SNR peaks at $\sim 6 (12 )$ for the eROSITA-DES (eROSITA-LSST) surveys. We also perform a Fisher matrix analysis to find the constraint on the gas fraction in the CGM in the presence or absence of an unknown redshift evolution of the gas fraction. Finally, we demonstrate that the cross-correlated SZ-galaxy and X-ray-galaxy power spectrum can be used as powerful probes of the CGM energetics and potentially discriminate between different feedback models recently proposed in the literature; for example, one can distinguish a `no active galactic nuclei feedback' scenario from a CGM energized by `fixed-velocity hot winds' at greater than $3\sigma$.

We measure the cross-correlation between weak lensing of galaxy images and of the cosmic microwave background (CMB). The effects of gravitational lensing on different sources will be correlated if the lensing is caused by the same mass fluctuations. We use galaxy shape measurements from 139 deg$^{2}$ of the Dark Energy Survey (DES) Science Verification data and overlapping CMB lensing from the South Pole Telescope (SPT) and Planck. The DES source galaxies have a median redshift of $z_{\rm med} {\sim} 0.7$, while the CMB lensing kernel is broad and peaks at $z{\sim}2$. The resulting cross-correlation is maximally sensitive to mass fluctuations at $z{\sim}0.44$. Assuming the Planck 2015 best-fit cosmology, the amplitude of the DES$\times$SPT cross-power is found to be $A = 0.88 \pm 0.30$ and that from DES$\times$Planck to be $A = 0.86 \pm 0.39$, where $A=1$ corresponds to the theoretical prediction. These are consistent with the expected signal and correspond to significances of $2.9 \sigma$ and $2.2 \sigma$ respectively. We demonstrate that our results are robust to a number of important systematic effects including the shear measurement method, estimator choice, photometric redshift uncertainty and CMB lensing systematics. Significant intrinsic alignment of galaxy shapes would increase the cross-correlation signal inferred from the data; we calculate a value of $A = 1.08 \pm 0.36$ for DES$\times$SPT when we correct the observations with a simple IA model. With three measurements of this cross-correlation now existing in the literature, there is not yet reliable evidence for any deviation from the expected LCDM level of cross-correlation, given the size of the statistical uncertainties and the significant impact of systematic errors, particularly IAs. We provide forecasts for the expected signal-to-noise of the combination of the five-year DES survey and SPT-3G.

We present a multi-frequency far-field beam map for the 5m dish telescope at the Bleien Observatory measured using a commercially available drone. We describe the hexacopter drone used in this experiment, the design of the flight pattern, and the data analysis scheme. This is the first application of this calibration method to a single dish radio telescope in the far-field. The high signal-to-noise data allows us to characterise the beam pattern with high accuracy out to at least the 4th side-lobe. The resulting 2D beam pattern is compared with that derived from a more traditional calibration approach using an astronomical calibration source. We discuss the advantages of this method compared to other beam calibration methods. Our results show that this drone-based technique is very promising for ongoing and future radio experiments, where the knowledge of the beam pattern is key to obtaining high-accuracy cosmological and astronomical measurements.

To shed light on the fundamental problems posed by Dark Energy and Dark Matter, a large number of experiments have been performed and combined to constrain cosmological models. We propose a novel way of quantifying the information gained by updates on the parameter constraints from a series of experiments which can either complement earlier measurements or replace them. For this purpose, we use the Kullback-Leibler divergence or relative entropy from information theory to measure differences in the posterior distributions in model parameter space from a pair of experiments. We apply this formalism to a historical series of Cosmic Microwave Background experiments ranging from Boomerang to WMAP, SPT, and Planck. Considering different combinations of these experiments, we thus estimate the information gain in units of bits and distinguish contributions from the reduction of statistical errors and the `surprise' corresponding to a significant shift of the parameters' central values. For this experiment series, we find individual relative entropy gains ranging from about 1 to 30 bits. In some cases, e.g. when comparing WMAP and Planck results, we find that the gains are dominated by the surprise rather than by improvements in statistical precision. We discuss how this technique provides a useful tool for both quantifying the constraining power of data from cosmological probes and detecting the tensions between experiments.

We present a strong lensing modeling technique based on versatile basis sets for the lens and source planes. Our method uses high performance Monte Carlo algorithms, allows for an adaptive build up of complexity and bridges the gap between parametric and pixel based reconstruction methods. We apply our method to a HST image of the strong lens system RXJ1131-1231 and show that our method finds a reliable solution and is able to detect substructure in the lens and source planes simultaneously. Using mock data we show that our method is sensitive to sub-clumps with masses four orders of magnitude smaller than the main lens, which corresponds to about $10^8 M_{\odot}$, without prior knowledge on the position and mass of the sub-clump. The modelling approach is flexible and maximises automation to facilitate the analysis of the large number of strong lensing systems expected in upcoming wide field surveys. The resulting search for dark sub-clumps in these systems, without mass-to-light priors, offers promise for probing physics beyond the standard model in the dark matter sector.

Bayesian inference is often used in cosmology and astrophysics to derive constraints on model parameters from observations. This approach relies on the ability to compute the likelihood of the data given a choice of model parameters. In many practical situations, the likelihood function may however be unavailable or intractable due to non-gaussian errors, non-linear measurements processes, or complex data formats such as catalogs and maps. In these cases, the simulation of mock data sets can often be made through forward modeling. We discuss how Approximate Bayesian Computation (ABC) can be used in these cases to derive an approximation to the posterior constraints using simulated data sets. This technique relies on the sampling of the parameter set, a distance metric to quantify the difference between the observation and the simulations and summary statistics to compress the information in the data. We first review the principles of ABC and discuss its implementation using a Population Monte-Carlo (PMC) algorithm and the Mahalanobis distance metric. We test the performance of the implementation using a Gaussian toy model. We then apply the ABC technique to the practical case of the calibration of image simulations for wide field cosmological surveys. We find that the ABC analysis is able to provide reliable parameter constraints for this problem and is therefore a promising technique for other applications in cosmology and astrophysics. Our implementation of the ABC PMC method is made available via a public code release.

We present photometric redshift estimates for galaxies used in the weak lensing analysis of the Dark Energy Survey Science Verification (DES SV) data. Four model- or machine learning-based photometric redshift methods -- ANNZ2, BPZ calibrated against BCC-Ufig simulations, SkyNet, and TPZ -- are analysed. For training, calibration, and testing of these methods, we construct a catalogue of spectroscopically confirmed galaxies matched against DES SV data. The performance of the methods is evaluated against the matched spectroscopic catalogue, focusing on metrics relevant for weak lensing analyses, with additional validation against COSMOS photo-zs. From the galaxies in the DES SV shear catalogue, which have mean redshift $0.72\pm0.01$ over the range $0.3<z<1.3$, we construct three tomographic bins with means of $z=\{0.45, 0.67, 1.00\}$. These bins each have systematic uncertainties $\delta z \lesssim 0.05$ in the mean of the fiducial SkyNet photo-z $n(z)$. We propagate the errors in the redshift distributions through to their impact on cosmological parameters estimated with cosmic shear, and find that they cause shifts in the value of $\sigma_8$ of approx. 3%. This shift is within the one sigma statistical errors on $\sigma_8$ for the DES SV shear catalog. We further study the potential impact of systematic differences on the critical surface density, $\Sigma_{\mathrm{crit}}$, finding levels of bias safely less than the statistical power of DES SV data. We recommend a final Gaussian prior for the photo-z bias in the mean of $n(z)$ of width $0.05$ for each of the three tomographic bins, and show that this is a sufficient bias model for the corresponding cosmology analysis.

Spatially-varying depth and characteristics of observing conditions, such as seeing, airmass, or sky background, are major sources of systematic uncertainties in modern galaxy survey analyses, in particular in deep multi-epoch surveys. We present a framework to extract and project these sources of systematics onto the sky, and apply it to the Dark Energy Survey (DES) to map the observing conditions of the Science Verification (SV) data. The resulting distributions and maps of sources of systematics are used in several analyses of DES SV to perform detailed null tests with the data, and also to incorporate systematics in survey simulations. We illustrate the complementarity of these two approaches by comparing the SV data with the BCC-UFig, a synthetic sky catalogue generated by forward-modelling of the DES SV images. We analyse the BCC-UFig simulation to construct galaxy samples mimicking those used in SV galaxy clustering studies. We show that the spatially-varying survey depth imprinted in the observed galaxy densities and the redshift distributions of the SV data are successfully reproduced by the simulation and well-captured by the maps of observing conditions. The combined use of the maps, the SV data and the BCC-UFig simulation allows us to quantify the impact of spatial systematics on $N(z)$, the redshift distributions inferred using photometric redshifts. We conclude that spatial systematics in the SV data are mainly due to seeing fluctuations and are under control in current clustering and weak lensing analyses. The framework presented here is relevant to all multi-epoch surveys, and will be essential for exploiting future surveys such as the Large Synoptic Survey Telescope (LSST), which will require detailed null-tests and realistic end-to-end image simulations to correctly interpret the deep, high-cadence observations of the sky.

Weak lensing by large-scale structure is a powerful technique to probe the dark components of the universe. To understand the measurement process of weak lensing and the associated systematic effects, image simulations are becoming increasingly important. For this purpose we present a first implementation of the $\textit{Monte Carlo Control Loops}$ ($\textit{MCCL}$; Refregier & Amara 2014), a coherent framework for studying systematic effects in weak lensing. It allows us to model and calibrate the shear measurement process using image simulations from the Ultra Fast Image Generator (UFig; Berge et al. 2013). We apply this framework to a subset of the data taken during the Science Verification period (SV) of the Dark Energy Survey (DES). We calibrate the UFig simulations to be statistically consistent with DES images. We then perform tolerance analyses by perturbing the simulation parameters and study their impact on the shear measurement at the one-point level. This allows us to determine the relative importance of different input parameters to the simulations. For spatially constant systematic errors and six simulation parameters, the calibration of the simulation reaches the weak lensing precision needed for the DES SV survey area. Furthermore, we find a sensitivity of the shear measurement to the intrinsic ellipticity distribution, and an interplay between the magnitude-size and the pixel value diagnostics in constraining the noise model. This work is the first application of the $\textit{MCCL}$ framework to data and shows how it can be used to methodically study the impact of systematics on the cosmic shear measurement.

We present a forward-modelling simulation framework designed to model the data products from the Dark Energy Survey (DES). This forward-model process can be thought of as a transfer function -- a mapping from cosmological and astronomical signals to the final data products used by the scientists. Using output from the cosmological simulations (the Blind Cosmology Challenge), we generate simulated images (the Ultra Fast Image Simulator, Berge et al. 2013) and catalogs representative of the DES data. In this work we simulate the 244 sq. deg coadd images and catalogs in 5 bands for the DES Science Verification (SV) data. The simulation output is compared with the corresponding data to show that major characteristics of the images and catalogs can be captured. We also point out several directions of future improvements. Two practical examples, star/galaxy classification and proximity effects on object detection, are then used to demonstrate how one can use the simulations to address systematics issues in data analysis. With clear understanding of the simplifications in our model, we show that one can use the simulations side-by-side with data products to interpret the measurements. This forward modelling approach is generally applicable for other upcoming and future surveys. It provides a powerful tool for systematics studies which is sufficiently realistic and highly controllable.

Mapping of the neutral hydrogen (HI) 21-cm intensity fluctuations across redshifts promises a novel and powerful probe of cosmology. The neutral hydrogen gas mass density, $\Omega_{\rm HI}$ and bias parameter, $b_{\rm HI}$ are key astrophysical inputs to the HI intensity fluctuation power spectrum. We compile the latest theoretical and observational constraints on $\Omega_{\rm HI}$ and $b_{\rm HI}$ at various redshifts in the post-reionization universe. Constraints are incorporated from galaxy surveys, HI intensity mapping experiments, damped Lyman-$\alpha$ system observations, theoretical prescriptions for assigning HI to dark matter halos, and the results of numerical simulations. Using a minimum variance interpolation scheme, we obtain the predicted uncertainties on the HI intensity fluctuation power spectrum across redshifts 0-3.5 for three different confidence scenarios. We provide a convenient tabular form for the interpolated values of $\Omega_{\rm HI}$, $b_{\rm HI}$ and the HI power spectrum amplitude and their uncertainties. We discuss the consequences for the measurement of the power spectrum by current and future intensity mapping experiments.

The Python programming language is becoming increasingly popular for scientific applications due to its simplicity, versatility, and the broad range of its libraries. A drawback of this dynamic language, however, is its low runtime performance which limits its applicability for large simulations and for the analysis of large data sets, as is common in astrophysics and cosmology. While various frameworks have been developed to address this limitation, most focus on covering the complete language set, and either force the user to alter the code or are not able to reach the full speed of an optimised native compiled language. In order to combine the ease of Python and the speed of C++, we developed HOPE, a specialised Python just-in-time (JIT) compiler designed for numerical astrophysical applications. HOPE focuses on a subset of the language and is able to translate Python code into C++ while performing numerical optimisation on mathematical expressions at runtime. To enable the JIT compilation, the user only needs to add a decorator to the function definition. We assess the performance of HOPE by performing a series of benchmarks and compare its execution speed with that of plain Python, C++ and the other existing frameworks. We find that HOPE improves the performance compared to plain Python by a factor of 2 to 120, achieves speeds comparable to that of C++, and often exceeds the speed of the existing solutions. We discuss the differences between HOPE and the other frameworks, as well as future extensions of its capabilities. The fully documented HOPE package is available at http://hope.phys.ethz.ch and is published under the GPLv3 license on PyPI and GitHub.

Spectroscopic redshift surveys offer great prospects for constraining the dark sector in cosmology. Future surveys will however be both deep and wide and will thus require an analysis in 3-dimensional spherical geometry. We review and compare several methods which have been proposed in the literature for this purpose, focusing in particular on implementations of the spherical harmonic tomography (SHT) power spectrum $C^{i j}_{l}$ and the spherical Fourier Bessel (SFB) power spectrum $C_{l} (k, k')$. Using a Fisher analysis, we compare the forecasted constraints on cosmological parameters using these statistics. These constraints typically rely on approximations such as the Limber approximation and make specific choices in the numerical implementation of each statistic. Using a series of toy models, we explore the applicability of these approximations and study the sensitivity of the SHT and SFB statistics to the details of their implementation. In particular, we show that overlapping redshift bins may improve cosmological constraints using the SHT statistic when the number of bins is small, and that the SFB constraints are quite robust to changes in the assumed distance-redshift relation. We also find that the SHT can be tailored to be more sensitive to modes at redshifts close to the survey boundary, while the SFB appears better suited to capture information beyond the smooth shape of the power spectrum. In this context, we discuss the pros and cons of the different techniques and their impact on the design and analysis of future wide field spectroscopic surveys.

We construct a simple phenomenological model for the evolving galaxy population by incorporating pre-defined baryonic prescriptions into a dark matter hierarchical merger tree. Specifically the model is based on the simple gas-regulator model introduced by Lilly et al. 2013 coupled with the empirical quenching rules of Peng et al. 2010/12. The simplest model already does quite well in reproducing, without re-adjusting the input parameters, many observables including the Main Sequence sSFR-mass relation, the faint end slope of the galaxy mass function and the shape of the star-forming and passive mass functions. Compared with observations and/or the recent phenomenological model of Behroozi et al. 2013 based on epoch-dependent abundance-matching, our model also qualitatively reproduces the evolution of the Main Sequence sSFR(z) and SFRD(z) star formation rate density relations, the $M_s - M_h$ stellar-to-halo mass relation and also the $SFR - M_h$ relation. Quantitatively the evolution of sSFR(z) and SFRD(z) is not steep enough, the $M_s - M_h$ relation is not quite peaked enough and, surprisingly, the ratio of quenched to star-forming galaxies around M* is not quite high enough. We show that these deficiencies can simultaneously be solved by ad hoc allowing galaxies to re-ingest some of the gas previously expelled in winds, provided that this is done in a mass-dependent and epoch-dependent way. These allow the model galaxies to reduce an inherent tendency to saturate their star-formation efficiency. This emphasizes how efficient galaxies around M* are in converting baryons into stars and highlights the fact that quenching occurs just at the point when galaxies are rapidly approaching the maximum possible efficiency of converting baryons into stars.

Weak lensing by large scale structure or 'cosmic shear' is a potentially powerful cosmological probe to shed new light on Dark Matter, Dark Energy and Modified Gravity. It is based on the weak distortions induced by large-scale structures on the observed shapes of distant galaxies through gravitational lensing. While the potentials of this purely gravitational effect are great, results from this technique have been hampered because the measurement of this weak effect is difficult and limited by systematics effects. In particular, a demanding step is the measurement of the weak lensing shear from wide field CCD images of galaxies. We describe the origin of the problem and propose a way forward for cosmic shear. Our proposed approach is based on Monte-Carlo Control Loops and draws upon methods widely used in particle physics and engineering. We describe the control loop scheme and show how it provides a calibration method based on fast image simulations tuned to reproduce the statistical properties of a specific cosmic shear data set. Through a series of iterative loops and diagnostic tests, the Monte Carlo image simulations are made robust to perturbations on modeling input parameters and thus to systematic effects. We discuss how this approach can make the problem tractable and unleash to full potential of cosmic shear for cosmology.

Recent observations have led to the establishment of the concordance LCDM model for cosmology. A number of experiments are being planned to shed light on dark energy, dark matter, inflation and gravity, which are the key components of the model. To optimize and compare the reach of these surveys, several figures of merit have been proposed. They are based on either the forecasted precision on the LCDM model and its expansion, or on the expected ability to distinguish two models. We propose here another figure of merit that quantifies the capacity of future surveys to rule out the LCDM model. It is based on a measure of the difference in volume of observable space that the future surveys will constrain with and without imposing the model. This model breaking figure of merit is easy to compute and can lead to different survey optimizations than other metrics. We illustrate its impact using a simple combination of supernovae and BAO mock observations and compare the respective merit of these probes to challenge LCDM. We discuss how this approach would impact the design of future cosmological experiments.

We outline the prospects for performing pioneering radio weak gravitational lensing analyses using observations from a potential forthcoming JVLA Sky Survey program. A large-scale survey with the JVLA can offer interesting and unique opportunities for performing weak lensing studies in the radio band, a field which has until now been the preserve of optical telescopes. In particular, the JVLA has the capacity for large, deep radio surveys with relatively high angular resolution, which are the key characteristics required for a successful weak lensing study. We highlight the potential advantages and unique aspects of performing weak lensing in the radio band. In particular, the inclusion of continuum polarisation information can greatly reduce noise in weak lensing reconstructions and can also remove the effects of intrinsic galaxy alignments, the key astrophysical systematic effect that limits weak lensing at all wavelengths. We identify a VLASS "deep fields" program (total area ~10-20 square degs), to be conducted at L-band and with high-resolution (A-array configuration), as the optimal survey strategy from the point of view of weak lensing science. Such a survey will build on the unique strengths of the JVLA and will remain unsurpassed in terms of its combination of resolution and sensitivity until the advent of the Square Kilometre Array. We identify the best fields on the JVLA-accessible sky from the point of view of overlapping with existing deep optical and near infra-red data which will provide crucial redshift information and facilitate a host of additional compelling multi-wavelength science.

We study the benefits and limits of parallelised Markov chain Monte Carlo (MCMC) sampling in cosmology. MCMC methods are widely used for the estimation of cosmological parameters from a given set of observations and are typically based on the Metropolis-Hastings algorithm. Some of the required calculations can however be computationally intensive, meaning that a single long chain can take several hours or days to calculate. In practice, this can be limiting, since the MCMC process needs to be performed many times to test the impact of possible systematics and to understand the robustness of the measurements being made. To achieve greater speed through parallelisation, MCMC algorithms need to have short auto-correlation times and minimal overheads caused by tuning and burn-in. The resulting scalability is hence influenced by two factors, the MCMC overheads and the parallelisation costs. In order to efficiently distribute the MCMC sampling over thousands of cores on modern cloud computing infrastructure, we developed a Python framework called CosmoHammer which embeds emcee, an implementation by Foreman-Mackey et al. (2012) of the affine invariant ensemble sampler by Goodman and Weare (2010). We test the performance of CosmoHammer for cosmological parameter estimation from cosmic microwave background data. While Metropolis-Hastings is dominated by overheads, CosmoHammer is able to accelerate the sampling process from a wall time of 30 hours on a dual core notebook to 16 minutes by scaling out to 2048 cores. Such short wall times for complex data sets opens possibilities for extensive model testing and control of systematics.

We present a method for attaining sub-arcsecond pointing stability during sub- orbital balloon flights, as designed for in the High Altitude Lensing Observatory (HALO) concept. The pointing method presented here has the potential to perform near-space quality optical astronomical imaging at 1-2% of the cost of space-based missions. We also discuss an architecture that can achieve sufficient thermomechanical stability to match the pointing stability. This concept is motivated by advances in the development and testing of Ultra Long Duration Balloon (ULDB) flights which promise to allow observation campaigns lasting more than three months. The design incorporates a multi-stage pointing architecture comprising: a gondola coarse azimuth control system, a multi-axis nested gimbal frame structure with arcsecond stability, a telescope de-rotator to eliminate field rotation, and a fine guidance stage consisting of both a telescope mounted angular rate sensor and guide CCDs in the focal plane to drive a fast-steering mirror. We discuss the results of pointing tests together with a preliminary thermo-mechanical analysis required for sub-arcsecond pointing at high altitude. Possible future applications in the areas of wide-field surveys and exoplanet searches are also discussed.

Weak gravitational lensing has the potential to constrain cosmological parameters to high precision. However, as shown by the Shear TEsting Programmes (STEP) and GRavitational lEnsing Accuracy Testing (GREAT) Challenges, measuring galaxy shears is a nontrivial task: various methods introduce different systematic biases which have to be accounted for. We investigate how pixel noise on the image affects the bias on shear estimates from a Maximum-Likelihood forward model-fitting approach using a sum of co-elliptical S\'{e}rsic profiles, in complement to the theoretical approach of an an associated paper. We evaluate the bias using a simple but realistic galaxy model and find that the effects of noise alone can cause biases of order 1-10% on measured shears, which is significant for current and future lensing surveys. We evaluate a simulation-based calibration method to create a bias model as a function of galaxy properties and observing conditions. This model is then used to correct the simulated measurements. We demonstrate that this method can effectively reduce noise bias so that shear measurement reaches the level of accuracy required for estimating cosmic shear in upcoming lensing surveys.

Weak lensing experiments are a powerful probe of cosmology through their measurement of the mass distribution of the universe. A challenge for this technique is to control systematic errors that occur when measuring the shapes of distant galaxies. In this paper we investigate noise bias, a systematic error that arises from second order noise terms in the shape measurement process. We first derive analytical expressions for the bias of general Maximum Likelihood Estimators (MLEs) in the presence of additive noise. We then find analytical expressions for a simplified toy model in which galaxies are modeled and fitted with a Gaussian with its size as a single free parameter. Even for this very simple case we find a significant effect. We also extend our analysis to a more realistic 6-parameter elliptical Gaussian model. We find that the noise bias is generically of the order of the inverse-squared signal-to-noise ratio (SNR) of the galaxies and is thus of the order of a percent for galaxies of SNR of 10, i.e. comparable to the weak lensing shear signal. This is nearly two orders of magnitude greater than the systematics requirements for future all-sky weak lensing surveys. We discuss possible ways to circumvent this effect, including a calibration method using simulations discussed in an associated paper.

High-precision cosmology requires the analysis of large-scale surveys in 3D spherical coordinates, i.e. spherical Fourier-Bessel decomposition. Current methods are insufficient for future data-sets from wide-field cosmology surveys. The aim of this paper is to present a public code for fast spherical Fourier-Bessel decomposition that can be applied to cosmological data or 3D data in spherical coordinates in other scientific fields. We present an equivalent formulation of the spherical Fourier-Bessel decomposition that separates radial and tangential calculations. We propose the use of the existing pixelisation scheme HEALPix for a rapid calculation of the tangential modes. 3DEX (3D EXpansions) is a public code for fast spherical Fourier-Bessel decomposition of 3D all-sky surveys that takes advantage of HEALPix for the calculation of tangential modes. We perform tests on very large simulations and we compare the precision and computation time of our method with an optimised implementation of the spherical Fourier-Bessel original formulation. For surveys with millions of galaxies, computation time is reduced by a factor 4-12 depending on the desired scales and accuracy. The formulation is also suitable for pre-calculations and external storage of the spherical harmonics, which allows for additional speed improvements. The 3DEX code can accommodate data with masked regions of missing data. 3DEX can also be used in other disciplines, where 3D data are to be analysed in spherical coordinates. The code and documentation can be downloaded at http://ixkael.com/blog/3dex.

Baryon Acoustic Oscillations (BAOs) are oscillatory features in the galaxy power spectrum and are a standard rod to measure the cosmological expansion. These have been studied in Cartesian space (Fourier or real space) or in Spherical Harmonic (SH) space in thin shells. Future wide-field surveys will cover both wide and deep regions of the sky and thus require a simultaneous treatment of the spherical sky and of an extended radial coverage. The Spherical Fourier-Bessel (SFB) decomposition is a natural basis for the analysis of fields in this geometry and facilitates the combination of BAO surveys with other cosmological probes readily described in this basis. We present here a new way to analyse BAOs by studying the BAO wiggles from the SFB power spectrum. In SFB space, the power spectrum generally has both a radial (k) and tangential (l) dependence and so do the BAOs. In the deep survey limit and ignoring evolution, the SFB power spectrum becomes radial and reduces to the Cartesian Fourier power spectrum. In the limit of a thin shell, all the information is contained in the tangential modes described by the 2D SH power spectrum. We find that the radialisation of the SFB power spectrum is still a good approximation even when considering an evolving and biased galaxy field with a finite selection function. This effect can be observed by all-sky surveys with depths comparable to current surveys. We find that the BAOs radialise more rapidly than the full SFB power spectrum. Our results suggest the first peak of the BAOs in SFB space becomes radial out to l ~ 10 for all-sky surveys with the same depth as SDSS or 2dF, and out to l ~ 70 for an all-sky stage IV survey. Subsequent BAO peaks also become radial, but for shallow surveys these may be in the non-linear regime. For modes that have become radial, measurements at different l's are useful in practice to reduce measurement errors.

Aims: The interactive software package iCosmo, designed to perform cosmological calculations is described. Methods: iCosmo is a software package to perform interactive cosmological calculations for the low redshift universe. Computing distance measures, the matter power spectrum, and the growth factor is supported for any values of the cosmological parameters. It also computes derived observed quantities for several cosmological probes such as cosmic shear, baryon acoustic oscillations and type Ia supernovae. The associated errors for these observables can be derived for customised surveys, or for pre-set values corresponding to current or planned instruments. The code also allows for the calculation of cosmological forecasts with Fisher matrices which can be manipulated to combine different surveys and cosmological probes. The code is written in the IDL language and thus benefits from the convenient interactive features and scientific library available in this language. iCosmo can also be used as an engine to perform cosmological calculations in batch mode, and forms a convenient adaptive platform for the development of further cosmological modules. With its extensive documentation, it may also serve as a useful resource for teaching and for newcomers in the field of cosmology. Results: The iCosmo package is described with various examples and command sequences. The code is freely available with documentation at http://www.icosmo.org, along with an interactive web interface and is part of the Initiative for Cosmology, a common archive for cosmological resources.

We compare the efficiency of weak lensing-selected galaxy clusters counts and of the weak lensing bispectrum at capturing non-Gaussian features in the dark matter distribution. We use the halo model to compute the weak lensing power spectrum, the bispectrum and the expected number of detected clusters, and derive constraints on cosmological parameters for a large, low systematic weak lensing survey, by focusing on the $\Omega_m$-$\sigma_8$ plane and on the dark energy equation of state. We separate the power spectrum into the resolved and the unresolved parts of the data, the resolved part being defined as detected clusters, and the unresolved part as the rest of the field. We consider four kinds of clusters counts, taking into account different amount of information : signal-to-noise ratio peak counts; counts as a function of clusters' mass; counts as a function of clusters' redshift; and counts as a function of clusters' mass and redshift. We show that when combined with the power spectrum, those four kinds of counts provide similar constraints, thus allowing one to perform the most direct counts, signal-to-noise peaks counts, and get percent level constraints on cosmological parameters. We show that the weak lensing bispectrum gives constraints comparable to those given by the power spectrum and captures non-Gaussian features as well as clusters counts, its combination with the power spectrum giving errors on cosmological parameters that are similar to, if not marginally smaller than, those obtained when combining the power spectrum with cluster counts. We finally note that in order to reach its potential, the weak lensing bispectrum must be computed using all triangle configurations, as equilateral triangles alone do not provide useful information.

Cosmic shear requires high precision measurement of galaxy shapes in the presence of the observational Point Spread Function (PSF) that smears out the image. The PSF must therefore be known for each galaxy to a high accuracy. However, for several reasons, the PSF is usually wavelength dependent, therefore the differences between the spectral energy distribution of the observed objects introduces further complexity. In this paper we investigate the effect of the wavelength-dependence of the PSF, focusing on instruments in which the PSF size is dominated by the diffraction-limit of the telescope and which use broad-band filters for shape measurement. We first calculate biases on cosmological parameter estimation from cosmic shear when the stellar PSF is used uncorrected. Using realistic galaxy and star spectral energy distributions and populations and a simple three-component circular PSF we find that the colour-dependence must be taken into account for the next generation of telescopes. We then consider two different methods for removing the effect (i) the use of stars of the same colour as the galaxies and (ii) estimation of the galaxy spectral energy distribution using multiple colours and using a telescope model for the PSF. We find that both of these methods correct the effect to levels below the tolerances required for per-cent level measurements of dark energy parameters. Comparison of the two methods favours the template-fitting method because its efficiency is less dependent on galaxy redshift than the broad-band colour method and takes full advantage of deeper photometry.

Weak gravitational lensing provides a sensitive probe of cosmology by measuring the mass distribution and the geometry of the low redshift universe. We show how an all-sky weak lensing tomographic survey can jointly constrain different sets of cosmological parameters describing dark energy, massive neutrinos (hot dark matter), and the primordial power spectrum. In order to put all sectors on an equal footing, we introduce a new parameter $\beta$, the second order running spectral index. Using the Fisher matrix formalism with and without CMB priors, we examine how the constraints vary as the parameter set is enlarged. We find that weak lensing with CMB priors provides robust constraints on dark energy parameters and can simultaneously provide strong constraints on all three sectors. We find that the dark energy sector is largely insensitive to the inclusion of the other cosmological sectors. Implications for the planning of future surveys are discussed.

The energy density of the Universe is dominated by dark energy and dark matter, two mysterious components which pose some of the most important questions in fundamental science today. Euclid is a high-precision survey mission designed to answer these questions by mapping the geometry of the dark Universe. Euclid's Visible-NIR imaging and spectroscopy of the entire extragalactic sky will further produce extensive legacy science for various fields of astronomy. Over the 2008-2009 period, Euclid has been the object of an ESA Assessment Phase in which the study of the Euclid Imaging instrument was under the responsibility of the Euclid Imaging Consortium (EIC). The EIC Science Book presents the studies done by the EIC science working groups in the context of this study phase. We first give a brief description of the Euclid mission and of the imaging instrument and surveys. We then summarise the primary and legacy science which will be achieved with the Euclid imaging surveys, along with the simulations and data handling scheme which have been developed to optimise the instrument and ensure its science performance.

Measurements of X-ray scaling laws are critical for improving cosmological constraints derived with the halo mass function and for understanding the physical processes that govern the heating and cooling of the intracluster medium. In this paper, we use a sample of 206 X-ray selected galaxy groups to investigate the scaling relation between X-ray luminosity (Lx) and halo mass (M00) where M200 is derived via stacked weak gravitational lensing. This work draws upon a broad array of multi-wavelength COSMOS observations including 1.64 square degrees of contiguous imaging with the Advanced Camera for Surveys (ACS) and deep XMM-Newton/Chandra imaging. The combined depth of these two data-sets allows us to probe the lensing signals of X-ray detected structures at both higher redshifts and lower masses than previously explored. Weak lensing profiles and halo masses are derived for nine sub-samples, narrowly binned in luminosity and redshift. The COSMOS data alone are well fit by a power law, M200 ~ Lx^a, with a slope of a=0.66+-0.14. These results significantly extend the dynamic range for which the halo masses of X-ray selected structures have been measured with weak gravitational lensing. As a result, tight constraints are obtained for the slope of the M-Lx relation. The combination of our group data with previously published cluster data demonstrates that the M-Lx relation is well described by a single power law, a=0.64+-0.03, over two decades in mass, 10^13.5-10^15.5 h72^-1 Msun. These results are inconsistent at the 3.7 level with the self-similar prediction of a=0.75. We examine the redshift dependence of the M-Lx relation and find little evidence for evolution beyond the rate predicted by self-similarity from z ~ 0.25 to z ~ 0.8.

In the absence of any compelling physical model, cosmological systematics are often misrepresented as statistical effects and the approach of marginalising over extra nuisance systematic parameters is used to gauge the effect of the systematic. In this article we argue that such an approach is risky at best since the key choice of function can have a large effect on the resultant cosmological errors. As an alternative we present a functional form filling technique in which an unknown, residual, systematic is treated as such. Since the underlying function is unknown we evaluate the effect of every functional form allowed by the information available (either a hard boundary or some data). Using a simple toy model we introduce the formalism of functional form filling. We show that parameter errors can be dramatically affected by the choice of function in the case of marginalising over a systematic, but that in contrast the functional form filling approach is independent of the choice of basis set. We then apply the technique to cosmic shear shape measurement systematics and show that a shear calibration bias of |m(z)|< 0.001(1+z)^0.7 is required for a future all-sky photometric survey to yield unbiased cosmological parameter constraints to percent accuracy. A module associated with the work in this paper is available through the open source iCosmo code available at http://www.icosmo.org .

This paper reviews statistical methods recently developed to reconstruct and analyze dark matter mass maps from weak lensing observations. The field of weak lensing is motivated by the observations made in the last decades showing that the visible matter represents only about 4-5% of the Universe, the rest being dark. The Universe is now thought to be mostly composed by an invisible, pressureless matter -potentially relic from higher energy theories- called "dark matter" (20-21%) and by an even more mysterious term, described in Einstein equations as a vacuum energy density, called "dark energy" (70%). This "dark" Universe is not well described or even understood, so this point could be the next breakthrough in cosmology. Weak gravitational lensing is believed to be the most promising tool to understand the nature of dark matter and to constrain the cosmological model used to describe the Universe. Gravitational lensing is the process in which light from distant galaxies is bent by the gravity of intervening mass in the Universe as it travels towards us. This bending causes the image of background galaxies to appear slightly distorted and can be used to extract significant results for cosmology. Future weak lensing surveys are already planned in order to cover a large fraction of the sky with large accuracy. However this increased accuracy also places greater demands on the methods used to extract the available information. In this paper, we will first describe the important steps of the weak lensing processing to reconstruct the dark matter distribution from shear estimation. Then we will discuss the problem of statistical estimation in order to set constraints on the cosmological model. We review the methods which are currently used especially new methods based on sparsity.

We present the results of the GREAT08 Challenge, a blind analysis challenge to infer weak gravitational lensing shear distortions from images. The primary goal was to stimulate new ideas by presenting the problem to researchers outside the shear measurement community. Six GREAT08 Team methods were presented at the launch of the Challenge and five additional groups submitted results during the 6 month competition. Participants analyzed 30 million simulated galaxies with a range in signal to noise ratio, point-spread function ellipticity, galaxy size, and galaxy type. The large quantity of simulations allowed shear measurement methods to be assessed at a level of accuracy suitable for currently planned future cosmic shear observations for the first time. Different methods perform well in different parts of simulation parameter space and come close to the target level of accuracy in several of these. A number of fresh ideas have emerged as a result of the Challenge including a re-examination of the process of combining information from different galaxies, which reduces the dependence on realistic galaxy modelling. The image simulations will become increasingly sophisticated in future GREAT challenges, meanwhile the GREAT08 simulations remain as a benchmark for additional developments in shear measurement algorithms.

The GRavitational lEnsing Accuracy Testing 2008 (GREAT08) Challenge focuses on a problem that is of crucial importance for future observations in cosmology. The shapes of distant galaxies can be used to determine the properties of dark energy and the nature of gravity, because light from those galaxies is bent by gravity from the intervening dark matter. The observed galaxy images appear distorted, although only slightly, and their shapes must be precisely disentangled from the effects of pixelisation, convolution and noise. The worldwide gravitational lensing community has made significant progress in techniques to measure these distortions via the Shear TEsting Program (STEP). Via STEP, we have run challenges within our own community, and come to recognise that this particular image analysis problem is ideally matched to experts in statistical inference, inverse problems and computational learning. Thus, in order to continue the progress seen in recent years, we are seeking an infusion of new ideas from these communities. This document details the GREAT08 Challenge for potential participants. Please visit http://www.great08challenge.info for the latest information.

Cosmic shear measurements rely on our ability to measure and correct the Point Spread Function (PSF) of the observations. This PSF is measured using stars in the field, which give a noisy measure at random points in the field. Using Wiener filtering, we show how errors in this PSF correction process propagate into shear power spectrum errors. This allows us to test future space-based missions, such as Euclid or JDEM, thereby allowing us to set clear engineering specifications on PSF variability. For ground-based surveys, where the variability of the PSF is dominated by the environment, we briefly discuss how our approach can also be used to study the potential of mitigation techniques such as correlating galaxy shapes in different exposures. To illustrate our approach we show that for a Euclid-like survey to be statistics limited, an initial pre-correction PSF ellipticity power spectrum, with a power-law slope of -3 must have an amplitude at l =1000 of less than 2 x 10^{-13}. This is 1500 times smaller than the typical lensing signal at this scale. We also find that the power spectrum of PSF size \dR^2) at this scale must be below 2 x 10^{-12}. Public code available as part of iCosmo at http://www.icosmo.org

We investigate the impact of point spread function (PSF) fitting errors on cosmic shear measurements using the concepts of complexity and sparsity. Complexity, introduced in a previous paper, characterizes the number of degrees of freedom of the PSF. For instance, fitting an underlying PSF with a model with low complexity will lead to small statistical errors on the model parameters, however these parameters could suffer from large biases. Alternatively, fitting with a large number of parameters will tend to reduce biases at the expense of statistical errors. We perform an optimisation of scatters and biases by studying the mean squared error of a PSF model. We also characterize a model sparsity, which describes how efficiently the model is able to represent the underlying PSF using a limited number of free parameters. We present the general case and illustrate it for a realistic example of PSF fitted with shapelet basis sets. We derive the relation between complexity and sparsity of the PSF model, signal-to-noise ratio of stars and systematic errors on cosmological parameters. With the constraint of maintaining the systematics below the statistical uncertainties, this lead to a relation between the required number of stars to calibrate the PSF and the sparsity. We discuss the impact of our results for current and future cosmic shear surveys. In the typical case where the biases can be represented as a power law of the complexity, we show that current weak lensing surveys can calibrate the PSF with few stars, while future surveys will require hard constraints on the sparsity in order to calibrate the PSF with 50 stars.

Weak gravitational lensing provides a unique method to map directly the dark matter in the Universe. The majority of lensing analyses uses the two-point statistics of the cosmic shear field to constrain the cosmological model yielding degeneracies, such as that between sigma_8 and Omega_M respectively the r.m.s. of the mass fluctuations at a scale of 8 Mpc/h and the matter density parameter both at z = 0. However, the two-point statistics only measure the Gaussian properties of the field and the weak lensing field is non-Gaussian. It has been shown that the estimation of non-Gaussian statistics on weak lensing data can improve the constraints on cosmological parameters. In this paper, we systematically compare a wide range of non-Gaussian estimators in order to determine which one provides tighter constraints on the cosmological parameters. These statistical methods include skewness, kurtosis and the Higher Criticism test in several sparse representations such as wavelet and curvelet; as well as the bispectrum, peak counting and a new introduced statistic called Wavelet Peak Counting (WPC). Comparisons based on sparse representations show that the wavelet transform is the most sensitive to non-Gaussian cosmological structures. It appears also that the best statistic for non-Gaussian characterization in weak lensing mass maps is the WPC. Finally, we show that the sigma_8 -Omega_m degeneracy could be even better broken if the WPC estimation is performed on weak lensing mass maps filtered by the wavelet method, MRLens.

With increasingly large data sets, weak lensing measurements are able to measure cosmological parameters with ever greater precision. However this increased accuracy also places greater demands on the statistical tools used to extract the available information. To date, the majority of lensing analyses use the two point-statistics of the cosmic shear field. These can either be studied directly using the two-point correlation function, or in Fourier space, using the power spectrum. But analyzing weak lensing data inevitably involves the masking out of regions or example to remove bright stars from the field. Masking out the stars is common practice but the gaps in the data need proper handling. In this paper, we show how an inpainting technique allows us to properly fill in these gaps with only $N \log N$ operations, leading to a new image from which we can compute straight forwardly and with a very good accuracy both the pow er spectrum and the bispectrum. We propose then a new method to compute the bispectrum with a polar FFT algorithm, which has the main advantage of avoiding any interpolation in the Fourier domain. Finally we propose a new method for dark matter mass map reconstruction from shear observations which integrates this new inpainting concept. A range of examples based on 3D N-body simulations illustrates the results.

We have performed a 70 billion dark-matter particles N-body simulation in a 2 $h^{-1}$ Gpc periodic box, using the concordance, cosmological model as favored by the latest WMAP3 results. We have computed a full-sky convergence map with a resolution of $\Delta \theta \simeq 0.74$ arcmin$^{2}$, spanning 4 orders of magnitude in angular dynamical range. Using various high-order statistics on a realistic cut sky, we have characterized the transition from the linear to the nonlinear regime at $\ell \simeq 1000$ and shown that realistic galactic masking affects high-order moments only below $\ell < 200$. Each domain (Gaussian and non-Gaussian) spans 2 decades in angular scale. This map is therefore an ideal tool for testing map-making algorithms on the sphere. As a first step in addressing the full map reconstruction problem, we have benchmarked in this paper two denoising methods: 1) Wiener filtering applied to the Spherical Harmonics decomposition of the map and 2) a new method, called MRLens, based on the modification of the Maximum Entropy Method on a Wavelet decomposition. While the latter is optimal on large spatial scales, where the signal is Gaussian, MRLens outperforms the Wiener method on small spatial scales, where the signal is highly non-Gaussian. The simulated full-sky convergence map is freely available to the community to help the development of new map-making algorithms dedicated to the next generation of weak-lensing surveys.

Astronomy and cosmology have embraced the internet. We routinely and successfully use the internet as a repository for sharing code, publications and information, and as a computational resource. However the interactive nature of the web, for use as an alternative to downloading code has been largely overlooked. In this article we will outline a simple framework in which a cosmological code can be turned into an interactive web interface. This is presented as a result of creating http://www.icosmo.org which is a front-end for the open-source software iCosmo. We explain how an HTML page can be created and how a cosmological code can be incorporated into a web environment using CGI scripts. We outline how plots and downloadable text can be made, and describe how help and documentation can be created. By using simple HTML and CGI scripts a basic web interface for any cosmological code can be created easily. We provide a worked example of the methods outlined, which can be used as a simple template by any researcher who wants to share their work online.

The Baryon Acoustic Oscillations (BAOs) or baryon wiggles which are present in the galaxy power spectrum at scales 100-150Mpc/h are powerful features with which to constrain cosmology. The potential of these probes is such that these are now included as primary science goals in the planning of several future galaxy surveys. However, there is not a uniquely defined BAO Method in the literature but a range of implementations. We study the assumptions and cosmological performances of three different BAO methods: the full Fourier space power spectrum [P(k)], the `wiggles only' in Fourier space and the spherical harmonics power spectrum [C(l)]. We contrast the power of each method to constrain cosmology for two fiducial surveys taken from the Dark Energy Task Force (DETF) report and equivalent to future ground and space based spectroscopic surveys. We find that, depending on the assumptions used, the dark energy Figure of Merit (FoM) can change by up to a factor of 35 for a given fiducial model and survey. We compare our results with the DETF implementation and, discuss the robustness of each probe, by quantifying the dependence of the FoM with the wavenumber range. The more information used by a method, the higher its statistical performance, but the higher its sensitivity to systematics and implementations details.

We present the first results of a MOS campaign to follow up cluster candidates located via weak lensing. Our main goals are to search for spatial concentrations of galaxies that are plausible optical counterparts of the weak lensing signals, and to determine the cluster redshifts from those of member galaxies. Around each of 36 targeted cluster candidates, we obtain 15-32 galaxy redshifts. For 28 of these targets, we confirm a secure cluster identification. This includes three cases where two clusters at different redshifts are projected along the same line-of-sight. In 6 of the 8 unconfirmed targets, we find multiple small galaxy concentrations at different redshifts. In both the remaining two targets, a single small galaxy concentration is found. We evaluate the weak lensing mass of confirmed clusters. For a subsample of our most cleanly measured clusters, we investigate the statistical relation between their weak lensing mass and the velocity dispersion of their member galaxies, comparing our sample with optically and X-ray selected samples from the literature. Our lensing-selected clusters are consistent with sigma_v=sigma_sis, with a similar scatter to the optically and X-ray selected clusters. We thus find no evidence of selection bias compared to these other techniques. We also derive an empirical relation between the cluster mass and the galaxy velocity dispersion, which is in reasonable agreement with the prediction of N-body simulations in the LCDM cosmology.

DUNE (Dark Universe Explorer) is a proposed mission to measure parameters of dark energy using weak gravitational lensing The particular challenges of both optical and infrared focal planes and the DUNE baseline solution is discussed. The DUNE visible Focal Plane Array (VFP) consists of 36 large format red-sensitive CCDs, arranged in a 9x4 array together with the associated mechanical support structure and electronics processing chains. Four additional CCDs dedicated to attitude control measurements are located at the edge of the array. All CCDs are 4096 pixel red-enhanced e2v CCD203-82 devices with square 12 $\mu$m pixels, operating from 550-920nm. Combining four rows of CCDs provides a total exposure time of 1500s. The VFP will be used in a closed-loop system by the spacecraft, which operates in a drift scan mode, in order to synchronize the scan and readout rates. The Near Infrared (NIR) FPA consists of a 5 x 12 mosaic of 60 Hawaii 2RG detector arrays from Teledyne, NIR bandpass filters for the wavelength bands Y, J, and H, the mechanical support structure, and the detector readout and signal processing electronics. The FPA is operated at a maximum temperature of 140 K for low dark current of 0.02e$-$/s. Each sensor chip assembly has 2048 x 2048 square pixels of 18 $\mu$m size (0.15 arcsec), sensitive in the 0.8 to 1.7 $\mu$m wavelength range. As the spacecraft is scanning the sky, the image motion on the NIR FPA is stabilized by a de-scanning mirror during the integration time of 300 s per detector. The total integration time of 1500 seconds is split among the three NIR wavelengths bands. DUNE has been proposed to ESA's Cosmic Vision program and has been jointly selected with SPACE for an ESA Assessment Phase which has led to the joint Euclid mission concept.

The Dark UNiverse Explorer (DUNE) is a wide-field imaging mission concept whose primary goal is the study of dark energy and dark matter with unprecedented precision. To this end, DUNE is optimised for weak gravitational lensing, and also uses complementary cosmolo gical probes, such as baryonic oscillations, the integrated Sachs-Wolf effect, a nd cluster counts. Immediate additional goals concern the evolution of galaxies, to be studied with groundbreaking statistics, the detailed structure of the Milky Way and nearby galaxies, and the demographics of Earth-mass planets. DUNE is a medium class mission consisting of a 1.2m telescope designed to carry out an all-sky survey in one visible and three NIR bands (1deg$^2$ field-of-view) which will form a unique legacy for astronomy. DUNE has been selected jointly with SPACE for an ESA Assessment phase which has led to the Euclid merged mission concept.

The Dark UNiverse Explorer (DUNE) is a wide-field space imager whose primary goal is the study of dark energy and dark matter with unprecedented precision. For this purpose, DUNE is optimised for the measurement of weak gravitational lensing but will also provide complementary measurements of baryonic accoustic oscillations, cluster counts and the Integrated Sachs Wolfe effect. Immediate auxiliary goals concern the evolution of galaxies, to be studied with unequalled statistical power, the detailed structure of the Milky Way and nearby galaxies, and the demographics of Earth-mass planets. DUNE is an Medium-class mission which makes use of readily available components, heritage from other missions, and synergy with ground based facilities to minimise cost and risks. The payload consists of a 1.2m telescope with a combined visible/NIR field-of-view of 1 deg^2. DUNE will carry out an all-sky survey, ranging from 550 to 1600nm, in one visible and three NIR bands which will form a unique legacy for astronomy. DUNE will yield major advances in a broad range of fields in astrophysics including fundamental cosmology, galaxy evolution, and extrasolar planet search. DUNE was recently selected by ESA as one of the mission concepts to be studied in its Cosmic Vision programme.

We present the first catalog of 67 strong galaxy-galaxy lens candidates discovered in the 1.64 square degree Hubble Space Telescope COSMOS survey. Twenty of these systems display multiple images or strongly curved large arcs. Our initial search is performed by visual inspection of the data and is restricted, for practical considerations, to massive early-type lens galaxies with arcs found at radii smaller than ~5''. Simple mass models are constructed for the best lens candidates and our results are compared to the strong lensing catalogs of the SLACS survey and the CASTLES database. These new strong galaxy-galaxy lensing systems constitute a valuable sample to study the mass distribution of early-type galaxies and their associated dark matter halos. We further expect this sample to play an important role in the testing of software algorithms designed to automatically search for strong gravitational lenses. From our analysis a robust lower limit is derived for the expected occurrence of strong galaxy-galaxy systems in current and future space-based wide-field imaging surveys. We expect that such surveys should uncover a large number of strong lensing systems (more than 10 systems per square degree), which will allow for a detailed statistical analysis of galaxy properties and will likely lead to constraints on models of gravitational structure formation and cosmology. The sample of strong lenses is available here: http://cosmosstronglensing.uni-hd.de/

The control of systematic effects when measuring galaxy shapes is one of the main challenges for cosmic shear analyses. In this context, we study the fundamental limitations on shear accuracy due to the measurement of the Point Spread Function (PSF) from the finite number of stars. In order to do that, we translate the accuracy required for cosmological parameter estimation to the minimum number of stars over which the PSF must be calibrated. We first derive our results analytically in the case of infinitely small pixels (i.e. infinitely high resolution). Then image simulations are used to validate these results and investigate the effect of finite pixel size in the case of an elliptical gaussian PSF. Our results are expressed in terms of the minimum number of stars required to calibrate the PSF in order to ensure that systematic errors are smaller than statistical errors when estimating the cosmological parameters. On scales smaller than the area containing this minimum number of stars, there is not enough information to model the PSF. In the case of an elliptical gaussian PSF and in the absence of dithering, 2 pixels per PSF Full Width at Half Maximum (FWHM) implies a 20% increase of the minimum number of stars compared to the ideal case of infinitely small pixels; 0.9 pixels per PSF FWHM implies a factor 100 increase. In the case of a good resolution and a typical Signal-to-Noise Ratio distribution of stars, we find that current surveys need the PSF to be calibrated over a few stars, which may explain residual systematics on scales smaller than a few arcmins. Future all-sky cosmic shear surveys require the PSF to be calibrated over a region containing about 50 stars.

We describe a method for computing the biases that systematic signals introduce in parameter estimation using a simple extension of the Fisher matrix formalism. This allows us to calculate the offset of the best fit parameters relative to the fiducial model, in addition to the usual statistical error ellipse. As an application, we study the impact that residual systematics in tomographic weak lensing measurements. In particular we explore three different types of shape measurement systematics: (i) additive systematic with no redshift evolution; (ii) additive systematic with redshift evolution; and (iii) multiplicative systematic. In each case, we consider a wide range of scale dependence and redshift evolution of the systematics signal. For a future DUNE-like full sky survey, we find that, for cases with mild redshift evolution, the variance of the additive systematic signal should be kept below 10^-7 to ensure biases on cosmological parameters that are sub-dominant to the statistical errors. For the multiplicative systematics, which depends on the lensing signal, we find the multiplicative calibration m0 needs to be controlled to an accuracy better than 10^-3. We find that the impact of systematics can be underestimated if their assumes redshift dependence is too simplistic. We provide simple scaling relations to extend these requirements to any survey geometry and discuss the impact of our results for current and future weak lensing surveys.

We present a sample of 29 galaxy clusters from the XMM-LSS survey over an area of some 5deg2 out to a redshift of z=1.05. The sample clusters, which represent about half of the X-ray clusters identified in the region, follow well defined X-ray selection criteria and are all spectroscopically confirmed. For all clusters, we provide X-ray luminosities and temperatures as well as masses. The cluster distribution peaks around z=0.3 and T =1.5 keV, half of the objects being groups with a temperature below 2 keV. Our L-T(z) relation points toward self-similar evolution, but does not exclude other physically plausible models. Assuming that cluster scaling laws follow self-similar evolution, our number density estimates up to z=1 are compatible with the predictions of the concordance cosmology and with the findings of previous ROSAT surveys. Our well monitored selection function allowed us to demonstrate that the inclusion of selection effects is essential for the correct determination of the evolution of the L-T relation, which may explain the contradictory results from previous studies. Extensive simulations show that extending the survey area to 10deg2 has the potential to exclude the non-evolution hypothesis, but that constraints on more refined ICM models will probably be limited by the large intrinsic dispersion of the L-T relation. We further demonstrate that increasing the dispersion in the scaling laws increases the number of detectable clusters, hence generating further degeneracy [in addition to sigma8, Omega_m, L(M,z) and T(M,z)] in the cosmological interpretation of the cluster number counts. We provide useful empirical formulae for the cluster mass-flux and mass-count-rate relations as well as a comparison between the XMM-LSS mass sensitivity and that of forthcoming SZ surveys.

We derive expressions, in terms of "polar shapelets", for the image distortion operations associated with weak gravitational lensing. Shear causes galaxy shapes to become elongated, and is sensitive to the second derivative of the projected gravitational potential along their line of sight; flexion bends galaxy shapes into arcs, and is sensitive to the third derivative. Polar shapelets provide a natural representation, in which both shear and flexion transformations are compact. Through this tool, we understand progress in several weak lensing methods. We then exploit various symmetries of shapelets to construct a range of shear estimators with useful properties. Through an analogous investigation, we also explore several flexion estimators. In particular, some of the estimators can be measured simultaneously and independently for every galaxy, and will provide unique checks for systematics in future weak lensing analyses. Using simulated images from the Shear TEsting Programme (STEP), we show that we can recover input shears with no significant bias. A complete software package to parametrize astronomical images in terms of polar shapelets, and to perform a full weak lensing analysis, is available at http://www.astro.caltech.edu/~rjm/shapelets/ .

Following the presentation of the XMM-LSS X-ray source detection package by Pacaud et al., we provide the source lists for the first 5.5 surveyed square degrees. The catalogues pertain to the [0.5-2] and [2-10] keV bands and contain in total 3385 point-like or extended sources above a detection likelihood of 15 in either band. The agreement with deep logN-logS is excellent. The main parameters considered are position, countrate, source extent with associated likelihood values. A set of additional quantities such as astrometric corrections and fluxes are further calculated while errors on the position and countrate are deduced from simulations. We describe the construction of the band-merged catalogue allowing rapid sub-sample selection and easy cross-correlation with external multi-wavelength catalogues. A small optical CFHTLS multi-band subset of objects is associated wich each source along with an X-ray/optical overlay. We make the full X-ray images available in FITS format. The data are available at CDS and, in a more extended form, at the Milan XMM-LSS database.

Weak lensing surveys provide a powerful probe of dark energy through the measurement of the mass distribution of the local Universe. A number of ground-based and space-based surveys are being planned for this purpose. Here, we study the optimal strategy for these future surveys using the joint constraints on the equation of state parameter wn and its evolution wa as a figure of merit by considering power spectrum tomography. For this purpose, we first consider an `ideal' survey which is both wide and deep and exempt from systematics. We find that such a survey has great potential for dark energy studies, reaching one sigma precisions of 1% and 10% on the two parameters respectively. We then study the relative impact of various limitations by degrading this ideal survey. In particular, we consider the effect of sky coverage, survey depth, shape measurements systematics, photometric redshifts systematics and uncertainties in the non-linear power spectrum predictions. We find that, for a given observing time, it is always advantageous to choose a wide rather than a deep survey geometry. We also find that the dark energy constraints from power spectrum tomography are robust to photometric redshift errors and catastrophic failures, if a spectroscopic calibration sample of 10^4-10^5 galaxies is available. The impact of these systematics is small compared to the limitations that come from potential uncertainties in the power spectrum, due to shear measurement and theoretical errors. To help the planning of future surveys, we summarize our results with comprehensive scaling relations which avoid the need for full Fisher matrix calculations.

We present the results of an ongoing weak lensing survey conducted with the Subaru telescope whose initial goal is to locate and study the distribution of shear-selected structures or halos. Using a Suprime-cam imaging survey spanning 21.82 square degree, we present a catalog of 100 candidate halos located from lensing convergence maps. Our sample is reliably drawn from that subset of our survey area, (totaling 16.72 square degree) uncontaminated by bright stars and edge effects and limited at a convergence signal to noise ratio of 3.69. To validate the sample detailed spectroscopic measures have been made for 26 candidates using the Subaru multi-object spectrograph, FOCAS. All are confirmed as clusters of galaxies but two arise as the superposition of multiple clusters viewed along the line of sight. Including data available in the literature and an ongoing Keck spectroscopic campaign, a total of 41 halos now have reliable redshifts. For one of our survey fields, the XMM LSS (Pierre et al. 2004) field, we compare our lensing-selected halo catalog with its X-ray equivalent. Of 15 halos detected in the XMM-LSS field, 10 match with published X-ray selected clusters and a further 2 are newly-detected and spectroscopically confirmed in this work. Although three halos have not yet been confirmed, the high success rate within the XMM-LSS field (12/15) confirms that weak lensing provides a reliable method for constructing cluster catalogs, irrespective of the nature of the constituent galaxies or the intracluster medium.

The Cosmic Evolution Survey (COSMOS) was initiated with an extensive allocation (590 orbits in Cycles 12-13) using the Hubble Space Telescope (HST) for high resolution imaging. Here we review the characteristics of the HST imaging with the Advanced Camera for Surveys (ACS) and parallel observations with NICMOS and WFPC2. A square field (1.8$\sq$\deg) has been imaged with single-orbit ACS I-F814W exposures with 50% completeness for sources 0.5\arcsec in diameter at I$_{AB} $ = 26.0 mag. The ACS imaging is a key part of the COSMOS survey, providing very high sensitivity and high resolution (0.09\arcsec FWHM, 0.05\arcsec pixels) imaging and detecting 1.2 million objects to a limiting magnitude of 26.5 (AB). These images yield resolved morphologies for several hundred thousand galaxies. The small HST PSF also provides greatly enhanced sensitivity for weak lensing investigations of the dark matter distribution.

With a primary goal of conducting precision weak lensing measurements from space, the COSMOS survey has imaged the largest contiguous area observed by the Hubble Space Telescope (HST) to date using the Advanced Camera for Surveys (ACS). This is the first paper in a series where we describe our strategy for addressing the various technical challenges in the production of weak lensing measurements from the COSMOS data. The COSMOS ACS catalog is constructed from 575 ACS/WFC tiles (1.64 deg^2) and contains a total 1.2x10^6 objects to a limiting magnitude of F814W=26.5. This catalog is made publicly available. The shapes of galaxies have been measured and corrected for the distortion induced by the time varying ACS Point Spread Function and for Charge Transfer Efficiency effects. Next, simulated images are used to derive the shear susceptibility factors that are necessary in order to transform shape measurements into unbiased shear estimators. Finally, for each galaxy, we derive a shape measurement error and utilize this quantity to extract the intrinsic shape noise of the galaxy sample. Interestingly, our results indicate that the intrinsic shape noise varies little with either size, magnitude or redshift. Representing a number density of 66 galaxies per arcmin^2, the final COSMOS weak lensing catalog contains 3.9x10^5 galaxies with accurate shape measurements. The properties of the COSMOS weak lensing catalog described throughout this paper will provide key input numbers for the preparation and design of next-generation wide field space missions.

(abridged) We examine the spatial and temporal stability of the HST ACS Wide Field Camera (WFC) point spread function (PSF) using the two square degree COSMOS survey. We show that stochastic aliasing of the PSF necessarily occurs during `drizzling'. This aliasing is maximal if the output pixel scale is equal to the input pixel scale of 0.05''. We show that this source of PSF variation can be significantly reduced by choosing a Gaussian drizzle kernel and by setting the output pixel size to 0.03''. We show that the PSF is temporally unstable, most likely due to thermal fluctuations in the telescope's focus. We find that the primary manifestation of this thermal drift in COSMOS images is an overall slow periodic focus change. Using a modified version of TinyTim, we create undistorted stars in a 30x30 grid across the ACS WFC CCDs. These PSF models are created for telescope focus values in the range -10 microns to +5 microns, thus spanning the allowed range of telescope focus values. We then use the approximately ten well measured stars in each COSMOS field to pick the best-fit focus value for each field. The TinyTim model stars are then used to perform PSF corrections for weak lensing allowing systematics due to incorrectly modeled PSFs to be greatly reduced. We have made the software for PSF modeling using our modified version of TinyTim available to the astronomical community. We show the effects of Charge Transfer Efficiency (CTE) degradation, which distorts the object in the readout direction, mimicking a weak lensing signal. We derive a parametric correction for the effect of CTE on the shapes of objects in the COSMOS field as a function of observation date, position within the ACS WFC field, and object flux.

We present a three dimensional cosmic shear analysis of the Hubble Space Telescope COSMOS survey, the largest ever optical imaging program performed in space. We have measured the shapes of galaxies for the tell-tale distortions caused by weak gravitational lensing, and traced the growth of that signal as a function of redshift. Using both 2D and 3D analyses, we measure cosmological parameters Omega_m, the density of matter in the universe, and sigma_8, the normalization of the matter power spectrum. The introduction of redshift information tightens the constraints by a factor of three, and also reduces the relative sampling (or "cosmic") variance compared to recent surveys that may be larger but are only two dimensional. From the 3D analysis, we find sigma_8*(Omega_m/0.3)^0.44=0.866+^0.085_-0.068 at 68% confidence limits, including both statistical and potential systematic sources of error in the total budget. Indeed, the absolute calibration of shear measurement methods is now the dominant source of uncertainty. Assuming instead a baseline cosmology to fix the geometry of the universe, we have measured the growth of structure on both linear and non-linear physical scales. Our results thus demonstrate a proof of concept for tomographic analysis techniques that have been proposed for future weak lensing surveys by a dedicated wide-field telescope in space.

Ordinary baryonic particles (such as protons and neutrons) account for only one-sixth of the total matter in the Universe. The remainder is a mysterious "dark matter" component, which does not interact via electromagnetism and thus neither emits nor reflects light. As dark matter cannot be seen directly using traditional observations, very little is currently known about its properties. It does interact via gravity, and is most effectively probed through gravitational lensing: the deflection of light from distant galaxies by the gravitational attraction of foreground mass concentrations. This is a purely geometrical effect that is free of astrophysical assumptions and sensitive to all matter -- whether baryonic or dark. Here we show high fidelity maps of the large-scale distribution of dark matter, resolved in both angle and depth. We find a loose network of filaments, growing over time, which intersect in massive structures at the locations of clusters of galaxies. Our results are consistent with predictions of gravitationally induced structure formation, in which the initial, smooth distribution of dark matter collapses into filaments then into clusters, forming a gravitational scaffold into which gas can accumulate, and stars can be built.

Understanding the nature of Dark Matter and Dark Energy is one of the most pressing issues in cosmology and fundamental physics. The purpose of the DUNE (Dark UNiverse Explorer) mission is to study these two cosmological components with high precision, using a space-based weak lensing survey as its primary science driver. Weak lensing provides a measure of the distribution of dark matter in the universe and of the impact of dark energy on the growth of structures. DUNE will also include a complementary supernovae survey to measure the expansion history of the universe, thus giving independent additional constraints on dark energy. The baseline concept consists of a 1.2m telescope with a 0.5 square degree optical CCD camera. It is designed to be fast with reduced risks and costs, and to take advantage of the synergy between ground-based and space observations. Stringent requirements for weak lensing systematics were shown to be achievable with the baseline concept. This will allow DUNE to place strong constraints on cosmological parameters, including the equation of state parameter of the dark energy and its evolution from redshift 0 to 1. DUNE is the subject of an ongoing study led by the French Space Agency (CNES), and is being proposed for ESA's Cosmic Vision programme.

The Shear TEsting Programme (STEP) is a collaborative project to improve the accuracy and reliability of weak lensing measurement, in preparation for the next generation of wide-field surveys. We review sixteen current and emerging shear measurement methods in a common language, and assess their performance by running them (blindly) on simulated images that contain a known shear signal. We determine the common features of algorithms that most successfully recover the input parameters. We achieve previously unattained discriminatory precision in our analysis, via a combination of more extensive simulations, and pairs of galaxy images that have been rotated with respect to each other, thus removing noise from their intrinsic ellipticities. The robustness of our simulation approach is also confirmed by testing the relative calibration of methods on real data. Weak lensing measurement has improved since the first STEP paper. Several methods now consistently achieve better than 2% precision, and are still being developed. However, the simulations can now distinguish all methods from perfect performance. Our main concern continues to be the potential for a multiplicative shear calibration bias: not least because this can not be internally calibrated with real data. We determine which galaxy populations are responsible and, by adjusting the simulated observing conditions, we also investigate the effects of instrumental and atmospheric parameters. We have isolated several previously unrecognised aspects of galaxy shape measurement, in which focussed development could provide further progress towards the sub-percent level of precision desired for future surveys. [ABRIDGED]

The shapelets method for image analysis is based upon the decomposition of localised objects into a series of orthogonal components with convenient mathematical properties. We extend the "Cartesian shapelet" formalism from earlier work, and construct "polar shapelet" basis functions that separate an image into components with explicit rotational symmetries. These frequently provide a more compact parameterisation, and can be interpreted in an intuitive way. Image manipulation in shapelet space is simplified by the concise expressions for linear coordinate transformations; and shape measures (including object photometry, astrometry and galaxy morphology estimators) take a naturally elegant form. Particular attention is paid to the analysis of astronomical survey images, and we test shapelet techniques upon real data from the Hubble Space Telescope. We present a practical method to automatically optimise the quality of an arbitrary shapelet decomposition in the presence of observational noise, pixellisation and a Point-Spread Function. A central component of this procedure is the adaptive choice of the shapelet expansion's scale size and truncation order. A complete software package to perform shapelet image analysis is made available on the world-wide web at http://www.astro.caltech.edu/~rjm/shapelets/ .

We present the X-ray pipeline developed for the purpose of the cluster search in the XMM-LSS survey. It is based on a two-stage procedure via a dedicated handling of the Poisson nature of the signal: (1) source detection on multi-resolution wavelet filtered images; (2) source analysis by means of a maximum likelihood fit to the photon images. The source detection efficiency and characterisation are studied through extensive Monte-Carlo simulations. This led us to define two samples of extended sources: the C1 class that is uncontaminated, and the less restrictive C2 class that allows for 50% contamination. The resulting predicted selection function is presented and the comparison to the current XMM-LSS confirmed cluster sample shows very good agreement. We arrive at average predicted source densities of about 7 C1 and 12 C2 per deg2, which is higher than any available wide field X-ray survey. We finally notice a substantial deviation of the predicted redshift distribution for our samples from the one obtained using the usual assumption of a flux limited sample.

The Shear TEsting Programme, STEP, is a collaborative project to improve the accuracy and reliability of all weak lensing measurements in preparation for the next generation of wide-field surveys. In this first STEP paper we present the results of a blind analysis of simulated ground-based observations of relatively simple galaxy morphologies. The most successful methods are shown to achieve percent level accuracy. From the cosmic shear pipelines that have been used to constrain cosmology, we find weak lensing shear measured to an accuracy that is within the statistical errors of current weak lensing analyses, with shear measurements accurate to better than 7%. The dominant source of measurement error is shown to arise from calibration uncertainties where the measured shear is over or under-estimated by a constant multiplicative factor. This is of concern as calibration errors cannot be detected through standard diagnostic tests. The measured calibration errors appear to result from stellar contamination, false object detection, the shear measurement method itself, selection bias and/or the use of biased weights. Additive systematics (false detections of shear) resulting from residual point-spread function anisotropy are, in most cases, reduced to below an equivalent shear of 0.001, an order of magnitude below cosmic shear distortions on the scales probed by current surveys. Our results provide a snapshot view of the accuracy of current ground-based weak lensing methods and a benchmark upon which we can improve. To this end we provide descriptions of each method tested and include details of the eight different implementations of the commonly used Kaiser, Squires and Broadhurst (1995) method (KSB+) to aid the improvement of future KSB+ analyses.

This paper presents a new method for the reconstruction of weak lensing mass maps. It uses the multiscale entropy concept, which is based on wavelets, and the False Discovery Rate which allows us to derive robust detection levels in wavelet space. We show that this new restoration approach outperforms several standard techniques currently used for weak shear mass reconstruction. This method can also be used to separate E and B modes in the shear field, and thus test for the presence of residual systematic effects. We concentrate on large blind cosmic shear surveys, and illustrate our results using simulated shear maps derived from N-Body Lambda-CDM simulations with added noise corresponding to both ground-based and space-based observations.

The cosmological potential of large-scale structure observations for cosmology have been extensively discussed in the litterature. In particular, it has recently been shown how Sunyaev-Zel'dovich (SZ) cluster surveys can be used to constrain dark energy parameters. In this paper, we study whether selection and systematics effects will limit future wide-field SZ surveys from achieving their cosmological potential. For this purpose, we use a sky simulation and an SZ-cluster detection software presented in Pires et al. (2005), using the future Olimpo, APEX and Planck surveys as a concrete examples. We show that the SZ-cluster selection function and contamination of SZ-cluster catalogues are more complex than is usually assumed. In particular, the simulated field-to-field detected cluster counts is a factor 3 larger than the expected Poisson fluctuations. We also study the impact of missing redshift information and of the uncertainty of the scaling relations for low mass clusters. We quantify, through hypothesis tests, how near-future SZ experiments can be used to discriminate between different structure formation models. Using a maximum likelihood approach, we then study the impact of these systematics on the joint measurement of cosmological models and of cluster scaling relations.

A major quest in cosmology is the understanding of the nature of dark energy. It is now well known that a combination of cosmological probes is required to break the underlying degeneracies on cosmological parameters. In this paper, we present a method, based on a frequentist approach, to combine probes without any prior constraints, taking full account of the correlations in the parameters. As an application, a combination of current SNIa and CMB data with an evolving dark energy component is first compared to other analyses. We emphasise the consequences of the implementation of the dark energy perturbations on the result for a time varying equation of state. The impact of future weak lensing surveys on the measurement of dark energy evolution is then studied in combination with future measurements of the cosmic microwave background and type Ia supernovae. We present the combined results for future mid-term and long-term surveys and confirm that the combination with weak lensing is very powerful in breaking parameter degeneracies. A second generation of experiment is however required to achieve a 0.1 error on the parameters describing the evolution of dark energy.

We report the results of a cosmic shear survey using the 4.2m William Herschel Telescope on La Palma, to a depth of R=25.8 (z~0.8), over 4 square degrees. The shear correlation functions are measured on scales from 1' to 15', and are used to constrain cosmological parameters. We ensure that our measurements are free from instrumental systematics by performing a series of tests, including a decomposition of the signal into E- and B-modes. We also reanalyse the data independently, using the shear measurement pipeline developed for the COMBO-17 survey. This confirms our results and also highlights various effects introduced by different implementations of the basic "KSB" shear measurement method. We find that the normalisation of the matter power spectrum on 8 h^{-1}Mpc scales is sigma_8=(1.02+/-0.15)(0.3/Omega_m)^{0.5}, where the 68%CL error includes noise, sample variance, covariance between angular scales, systematic effects, redshift uncertainty and marginalisation over other parameters. We compare these results with other cosmic shear surveys and with recent constraints from the WMAP experiment.

We have designed a medium deep large area X-ray survey with XMM - the XMM Large Scale Structure survey, XMM-LSS - with the scope of extending the cosmological tests attempted using ROSAT cluster samples to two redshift bins between 0<z<1 while maintaining the precision of earlier studies. Two main goals have constrained the survey design: the evolutionary study of the cluster-cluster correlation function and of the cluster number density. The results are promising and, so far, in accordance with our predictions as to the survey sensitivity and cluster number density. The feasibility of the programme is demonstrated and further X-ray coverage is awaited in order to proceed with a truly significant statistical analysis. (Abridged)

We present the first measurement of weak lensing by large-scale structure on 1-4 degree scales based on the FIRST Radio Survey, a quarter-sky, 20-cm survey produced with the NRAO Very Large Array (VLA). The large angular scales provide an unique measurement in the linear regime of the matter power spectrum. We use the shapelet method to estimate the shear of radio sources derived directly from the Fourier(uv) plane. With realistic simulations we verify that the method yields unbiased shear estimators. We quantify and correct for the systematic effects which can produce spurious shears, analytically and with simulations. We measure the shear correlation functions on angular scales of 0.5-40 degrees, and compute the corresponding aperture mass statistics. On 1-4 degrees scales, we find that the B-modes are consistent with zero, and detect a lensing E-mode signal significant at the 3.0 sigma level. After removing radio sources with an optical counterpart, the E-mode signal increases by 10-20%, as expected for a lensing signal derived from more distant sources. We use the E-mode measurement to constrain the mass power spectrum normalization sigma_8 and the median redshift z_m of the unidentified radio sources. We find sigma_8*(z_m/2)^(0.6) ~ 1.0 +/- 0.2, where the 1 sigma error bars include statistical errors, cosmic variance, and systematics. This is consistent with earlier determinations of sigma_8, and with our current knowledge of the redshift distribution of radio sources. Taking the prior sigma_8 = 0.9 +/- 0.1 (68%CL) from the WMAP experiment, this corresponds to z_m = 2.2 +/- 0.9 (68%CL) for radio sources without optical counterparts. Our results offer promising prospects for precision measurements of cosmic shear with future radio interferometers such as LOFAR and the SKA.

The measurement of weak gravitational lensing is currently limited to a precision of ~10% by instabilities in galaxy shape measurement techniques and uncertainties in their calibration. The potential of large, on-going and future cosmic shear surveys will only be realised with the development of more accurate image analysis methods. We present a description of several possible shear measurement methods using the linear "shapelets" decomposition. Shapelets provides a complete reconstruction of any galaxy image, including higher-order shape moments that can be used to generalise the KSB method to arbitrary order. Many independent shear estimators can then be formed for each object, using linear combinations of shapelet coefficients. These estimators can be treated separately, to improve their overall calibration; or combined in more sophisticated ways, to eliminate various instabilities and a calibration bias. We apply several methods to simulated astronomical images containing a known input shear, and demonstrate the dramatic improvement in shear recovery using shapelets. A complete IDL software package to perform image analysis and manipulation in shapelet space can be downloaded from the shapelets web site at http://www.astro.caltech.edu/~rjm/shapelets/ .

The Supernova / Acceleration Probe (SNAP) is a proposed space-based experiment designed to study the dark energy and alternative explanations of the acceleration of the Universe's expansion by performing a series of complementary systematics-controlled measurements. We describe a self-consistent reference mission design for building a Type Ia supernova Hubble diagram and for performing a wide-area weak gravitational lensing study. A 2-m wide-field telescope feeds a focal plane consisting of a 0.7 square-degree imager tiled with equal areas of optical CCDs and near infrared sensors, and a high-efficiency low-resolution integral field spectrograph. The SNAP mission will obtain high-signal-to-noise calibrated light-curves and spectra for several thousand supernovae at redshifts between z=0.1 and 1.7. A wide-field survey covering one thousand square degrees resolves ~100 galaxies per square arcminute. If we assume we live in a cosmological-constant-dominated Universe, the matter density, dark energy density, and flatness of space can all be measured with SNAP supernova and weak-lensing measurements to a systematics-limited accuracy of 1%. For a flat universe, the density-to-pressure ratio of dark energy can be similarly measured to 5% for the present value w0 and ~0.1 for the time variation w'. The large survey area, depth, spatial resolution, time-sampling, and nine-band optical to NIR photometry will support additional independent and/or complementary dark-energy measurement approaches as well as a broad range of auxiliary science programs. (Abridged)

A wide field space-based imaging telescope is necessary to fully exploit the technique of observing dark matter via weak gravitational lensing. This first paper in a three part series outlines the survey strategies and relevant instrumental parameters for such a mission. As a concrete example of hardware design, we consider the proposed Supernova/Acceleration Probe (SNAP). Using SNAP engineering models, we quantify the major contributions to this telescope's Point Spread Function (PSF). These PSF contributions are relevant to any similar wide field space telescope. We further show that the PSF of SNAP or a similar telescope will be smaller than current ground-based PSFs, and more isotropic and stable over time than the PSF of the Hubble Space Telescope. We outline survey strategies for two different regimes - a ``wide'' 300 square degree survey and a ``deep'' 15 square degree survey that will accomplish various weak lensing goals including statistical studies and dark matter mapping.

Weak gravitational lensing provides a unique method to directly map the dark matter in the universe and measure cosmological parameters. Current weak lensing surveys are limited by the atmospheric seeing from the ground and by the small field of view of existing space telescopes. We study how a future wide-field space telescope can measure the lensing power spectrum and skewness, and set constraints on cosmological parameters. The lensing sensitivity was calculated using detailed image simulations and instrumental specifications studied in earlier papers in this series. For instance, the planned SuperNova/Acceleration Probe (SNAP) mission will be able to measure the matter density parameter Omega_m and the dark energy equation of state parameter w with precisions comparable and nearly orthogonal to those derived with SNAP from supernovae. The constraints degrade by a factor of about 2 if redshift tomography is not used, but are little affected if the skewness only is dropped. We also study how the constraints on these parameters depend upon the survey geometry and define an optimal observing strategy.

We study the accuracy with which weak lensing measurements could be made from a future space-based survey, predicting the subsequent precisions of 3-dimensional dark matter maps, projected 2-dimensional dark matter maps, and mass-selected cluster catalogues. As a baseline, we use the instrumental specifications of the Supernova/Acceleration Probe (SNAP) satellite. We first compute its sensitivity to weak lensing shear as a function of survey depth. Our predictions are based on detailed image simulations created using `shapelets', a complete and orthogonal parameterization of galaxy morphologies. We incorporate a realistic redshift distribution of source galaxies, and calculate the average precision of photometric redshift recovery using the SNAP filter set to be Delta z=0.034. The high density of background galaxies resolved in a wide space-based survey allows projected dark matter maps with a rms sensitivity of 3% shear in 1 square arcminute cells. This will be further improved using a proposed deep space-based survey, which will be able to detect isolated clusters using a 3D lensing inversion techniques with a 1 sigma mass sensitivity of approximately 10^13 solar masses at z~0.25. Weak lensing measurements from space will thus be able to capture non-Gaussian features arising from gravitational instability and map out dark matter in the universe with unprecedented resolution.

Weak lensing provides a direct measure of the distribution of mass in the universe, and is therefore a uniquely powerful probe of dark matter. Weak lensing can also be used to measure the twin phenomenon of dark energy, via its effect upon the cosmological growth rate of structures. Essential for this technique are well-resolved images of background galaxies out to large distances. As a concrete example of the surveys that will become available by the end of the decade, we consider the planned Supernova/Acceleration Probe (SNAP) space telescope. Detailed simulations of space-based images, manufactured using the shapelets formalism, enable us to quantitatively predict the future sensitivity to weak lensing shear. The high number density of galaxies resolved from space will enable maps of dark matter to be produced in two and three dimensions, with a resolution superior to that from the ground. Such observations will also afford reduced systematics for high-precision measurements of weak lensing statistics. These will be used to set tight constraints on cosmological parameters. In particular, the parameter for equation of state of dark energy, w, will be measured using weak lensing with a precision comparable to and somewhat orthogonal to constraints from other methods.

Weak lensing by large-scale structure allows a direct measure of the dark matter distribution. We have used parallel images taken with the Space Telescope Imaging Spectrograph (STIS) on the Hubble Space Telescope to measure weak lensing, or cosmic shear. We measure the shapes of 26036 galaxies in 1292 STIS fields and measure the shear variance at a scale of 0.51 arcminutes. The charge transfer efficiency (CTE) of STIS has degraded over time and introduces a spurious ellipticity into galaxy shapes during the readout process. We correct for this effect as a function of signal to noise and CCD position. We further show that the detected cosmic shear signal is nearly constant in time over the approximately four years of observation. We detect cosmic shear at the 5.1 sigma level, and our measurement of the shear variance is consistent with theoretical predictions in a LambdaCDM universe. This provides a measure of the normalization of the mass power spectrum sigma_8=(1.02 +- 0.16) (0.3/Omega_m)^{0.46} (0.21/Gamma)^{0.18}$. The one-sigma error includes noise, cosmic variance, systematics and the redshift uncertainty of the source galaxies. This is consistent with previous cosmic shear measurements, but tends to favor those with a high value of sigma_8. It is also consistent with the recent determination of sigma_8 from the Wilkinson Microwave Anisotropy Probe (WMAP) experiment.

We present a method to simulate deep sky images, including realistic galaxy morphologies and telescope characteristics. To achieve a wide diversity of simulated galaxy morphologies, we first use the shapelets formalism to parametrize the shapes of all objects in the Hubble Deep Fields. We measure this distribution of real galaxy morphologies in shapelet parameter space, then resample it to generate a new population of objects. These simulated galaxies can contain spiral arms, bars, discs, arbitrary radial profiles and even dust lanes or knots. To create a final image, we also model observational effects, including noise, pixellisation, astrometric distortions and a Point-Spread Function. We demonstrate that they are realistic by showing that simulated and real data have consistent distributions of morphology diagnostics: including galaxy size, ellipticity, concentration and asymmetry statistics. Sample images are made available on the world wide web. These simulations are useful to develop and calibrate precision image analysis techniques for photometry, astrometry, and shape measurement. They can also be used to assess the sensitivity of future telescopes and surveys for applications such as supernova searches, microlensing, proper motions, and weak gravitational lensing.

The normalisation of the matter power spectrum, sigma_8, is an essential ingredient to predict the phenomenology of the low redshift universe. It has been measured using several methods, such as X-ray cluster counts, weak lensing and the cosmic microwave background, which have yielded values ranging from 0.7 to 1.0. While these differences could be due to systematic effects, they could also be due to physics beyond the standard LambdaCDM model. An obvious possibility is the presence of non-Gaussian initial fluctuations in the density field. To study the impact of non-Gaussianity on each of these methods, we use a generalised halo model to compute cluster counts and the non-linear power spectrum for non-Gaussian models. Assuming scale invariance, the upper-limits on non-Gaussianity from the WMAP CMB experiment correspond to roughly a 4% shift in sigma_8 as measured from cluster counts and about 2% shift through weak lensing. This is not enough to account for the current internal and mutual discrepancies between the different methods, unless non-Gaussianity is strongly scale dependent. A comparison between future X-ray surveys with a two fold improvement in cluster mass calibration and future cosmic shear surveys with 400 deg^2 will be required to constrain non-Gaussianity on small scales with a precision matching that of the current CMB constraints on larger scales. Our results argue for the presence of systematics in the current cluster and cosmic shear surveys, or to non-standard physics other than non-Gaussianity.

Weak gravitational lensing provides a unique method to map directly the distribution of dark matter in the universe and to measure cosmological parameters. This cosmic-shear technique is based on the measurement of the weak distortions that lensing induces in the shape of background galaxies as photons travel through large-scale structures. This technique is now widely used to measure the mass distribution of galaxy clusters and has recently been detected in random regions of the sky. In this review, we present the theory and observational status of cosmic shear. We describe the principles of weak lensing and the predictions for the shear statistics in favored cosmological models. Next, we review the current measurements of cosmic shear and show how they constrain cosmological parameters. We then describe the prospects offered by upcoming and future cosmic-shear surveys as well as the technical challenges that have to be met for the promises of cosmic shear to be fully realized.

We review the current status of cosmological parameters, dark energy and large-scale structure, from a theoretical and observational perspective. We first present the basic cosmological parameters and discuss how they are measured with different observational techniques. We then describe the recent evidence for dark energy from Type Ia supernovae. Dynamical models of the dark energy, quintessence, are then described, as well as how they relate to theories of gravity and particle physics. The basic theory of structure formation via gravitational instability is then reviewed. Finally, we describe new observational probes of the large-structure of the universe, and how they constrain cosmological parameters.

The upcoming XMM Large Scale Structure Survey (XMM-LSS) will ultimately provide a unique mapping of the distribution of X-ray sources in a contiguous 64 sq. deg. region. In particular, it will provide the 3-dimensional location of about 900 galaxy clusters out to a redshift of about 1. We study the prospects that this cluster catalogue offers for measuring cosmological parameters. We use the Press-Schechter formalism to predict the counts of clusters and their X-ray properties in several CDM models. We compute the detection efficiency of clusters, using realistic simulations of XMM X-ray images, and study how it differs from a conventional flux limit. We compute the expected correlation function of clusters using the extended halo model, and show that it is expected to evolve very little out to z~2, once the selection function of the survey is taken into account. The shape and the amplitude of the correlation function can be used to brake degeneracies present when cluster counts alone are considered. Ignoring systematic uncertainties, the combination of cluster counts evolution and of the correlation function yields measurements of Omega_m, sigma_8 and Gamma with a precision of about 15%, 10% and 35%, respectively, in a LCDM model. This combination will also provide a consistency check for the LCDM model, and a discrimination between this model and the OCDM model. The XMM-LSS will therefore provide important constraints on cosmological parameters, complementing that from other methods such as the Cosmic Microwave Background. We discuss how these constraints are affected by instrumental systematics and by the uncertainties in the scaling relations of clusters.

Weak lensing by large-scale structure provides a direct measurement of matter fluctuations in the universe. We report a measurement of this `cosmic shear' based on 271 WFPC2 archival images from the Hubble Space Telescope Medium Deep Survey (MDS). Our measurement method and treatment of systematic effects were discussed in an earlier paper. We measure the shear variance on scales ranging from 0.7' to 1.4', with a detection significance greater than 3.8. This allows us to measure the normalization of the matter power spectrum to be sigma8 = (0.94 +/- 0.10 +/- 0.14) (0.3/Omega_m)^0.44 (0.21/Gamma)^0.15, in a LCDM universe. The first 1sigma error includes statistical errors only, while the latter also includes (gaussian) cosmic variance and the uncertainty in the galaxy redshift distribution. Our results are consistent with earlier cosmic shear measurements from the ground and from space. We compare our cosmic shear results and those from other groups to the normalization from cluster abundance and galaxy surveys. We find that the combination of four recent cosmic shear measurements are somewhat inconsistent with the recent normalization using these methods, and discuss possible explanations for the discrepancy.

Thanks to its unrivalled sensitivity and large field of view, XMM potentially occupies a leading position as a survey instrument. We present cosmological arguments in favour of a medium-sensitivity, large-scale structure survey with XMM, using galaxy clusters as tracers of the cosmic network. We show how this has motivated the definition of a concrete survey, the XMM Large-Scale Structure Survey (XMM-LSS), which will cover 64 square degrees with a sensitivity about 1000 times better than that of the ROSAT All-Sky Survey. We present our predictions for cluster counts based on the Press-Schechter formalism and detailed X-ray image simulations, and show how they agree with the cluster statistics from recent ROSAT cluster surveys. We also present the extensive multi-wavelength follow-up associated with XMM-LSS, as well as the first observations from the programme.

The recent measurements of weak lensing by large-scale structure present significant new opportunities for studies of the matter distribution in the universe. Here, we present a new cosmic shear survey carried out with the Echelle Spectrograph and Imager on the Keck II telescope. This covers a total of 0.6 square degrees in 173 fields probing independent lines of sight, hence minimising the impact of sample variance. We also extend our measurements of cosmic shear with the William Herschel Telescope (Bacon, Refregier & Ellis 2000) to a survey area of 1 square degree. The joint measurements with two independent telescopes allow us to assess the impact of instrument-specific systematics, one of the major difficulties in cosmic shear measurements. For both surveys, we carefully account for effects such as smearing by the point spread function and shearing due to telescope optics. We find negligible residuals in both cases and recover mutually consistent cosmic shear signals, significant at the 5.1 sigma level. We present a simple method to compute the statistical error in the shear correlation function, including non-gaussian sample variance and the covariance between different angular bins. We measure shear correlation functions for all fields and use these to ascertain the amplitude of the matter power spectrum, finding sigma_8 (Omega_m/0.3)^0.68 = 0.97 \pm 0.13 with 0.14<Omega_m<0.65 in a Lambda-CDM model with Gamma=0.21. These 68% CL uncertainties include sample variance, statistical noise, redshift uncertainty, and the error in the shear measurement method. The results from our two independent surveys are both consistent with measurements of cosmic shear from other groups. We discuss how our results compare with current normalisation from cluster abundance.

We present a new approach for image reconstruction and weak lensing measurements with interferometers. Based on the shapelet formalism presented in Refregier (2001), object images are decomposed into orthonormal Hermite basis functions. The shapelet coefficients of a collection of sources are simultaneously fit on the uv plane, the Fourier transform of the sky brightness distribution observed by interferometers. The resulting chi-square fit is linear in its parameters and can thus be performed efficiently by simple matrix multiplications. We show how the complex effects of bandwidth smearing, time averaging and non-coplanarity of the array can be easily and fully corrected for in our method. Optimal image reconstruction, co-addition, astrometry, and photometry can all be achieved using weighted sums of the derived coefficients. As an example we consider the observing conditions of the FIRST radio survey (Becker et al. 1995; White et al. 1997). We find that our method accurately recovers the shapes of simulated images even for the sparse uv sampling of this snapshot survey. Using one of the FIRST pointings, we find our method compares well with CLEAN, the commonly used method for interferometric imaging. Our method has the advantage of being linear in the fit parameters, of fitting all sources simultaneously, and of providing the full covariance matrix of the coefficients, which allows us to quantify the errors and cross-talk in image shapes. It is therefore well-suited for quantitative shape measurements which require high-precision. In particular, we show how our method can be combined with the results of Refregier & Bacon (2001) to provide an accurate measurement of weak lensing from interferometric data.

We present a new approach to measure the shapes of galaxies, a fundamental task in observational astronomy. This approach is based on the decomposition of a galaxy image into a series of orthogonal basis functions, or `shapelets'. Our choice of basis functions, namely the Gauss-Hermite series, has a number of remarkable properties under distortions, convolutions and noise, which makes them particularly well suited for astrophysical applications. In particular, we describe how they can be used to measure the shear induced by weak gravitational lensing, with the precision required for upcoming surveys. We also show how shapelets can be used to reconstruct images from interferometric observations. Other application of shapelets, such as image compression, PSF deconvolution, de-projection and the study of galaxy morphology, are also briefly discussed.

Cosmic shear probes the distribution of dark matter via gravitational lensing of distant, background galaxies. We describe our cosmic shear survey consisting of deep blank fields observed with the Keck II telescope. We have found biases in the standard weak lensing analysis, which are enhanced by the elongated geometry of the Keck fields. We show how these biases can be diagnosed and corrected by masking edges and chip defects.

Weak gravitational lensing provides a unique method to directly measure the distribution of mass in the universe. Because the distortions induced by lensing in the shape of background galaxies are small, the measurement of weak lensing requires high precision. Here, we present a new method for obtaining reliable weak shear measurements. It is based on the Shapelet basis function formalism of Refregier (2001), in which galaxy images are decomposed into several shape components, each providing independent estimates of the local shear. The formalism affords an efficient modelling and deconvolution of the Point Spread Function. Using the remarkable properties of Shapelets under distortions, we construct a simple, minimum variance estimator for the shear. We describe how we implement the method in practice, and test the method using realistic simulated images. We find our method to be stable and reliable for conditions analogous to ground-based surveys. Compared to earlier methods, our method has the advantages of being accurate, linear, mathematically well-defined, and optimally sensitive, since it uses the full shape information available for each galaxy.

We present a new method for the analysis of images, a fundamental task in observational astronomy. It is based on the linear decomposition of each object in the image into a series of localised basis functions of different shapes, which we call `Shapelets'. A particularly useful set of complete and orthonormal shapelets is that consisting of weighted Hermite polynomials, which correspond to perturbations around a circular gaussian. They are also the eigenstates of the 2-dimensional Quantum Harmonic Oscillator, and thus allow us to use the powerful formalism developed for this problem. Among their remarkable properties, they are invariant under Fourier transforms (up to a rescaling), leading to an analytic form for convolutions. The generator of linear transformations such as translations, rotations, shears and dilatations can be written as simple combinations of raising and lowering operators. We derive analytic expressions for practical quantities, such as the centroid (astrometry), flux (photometry) and radius of the object, in terms of its shapelet coefficients. We also construct polar basis functions which are eigenstates of the angular momentum operator, and thus have simple properties under rotations. As an example, we apply the method to Hubble Space Telescope images, and show that the small number of shapelet coefficients required to represent galaxy images lead to compression factors of about 40 to 90. We discuss applications of shapelets for the archival of large photometric surveys, for weak and strong gravitational lensing and for image deprojection.

Weak lensing by large-scale structure provides a unique method to directly measure matter fluctuations in the universe, and has recently been detected from the ground. Here, we report the first detection of this `cosmic shear' based on space-based images. The detection was derived from the Hubble Space Telescope (HST) Survey Strip (or Groth Strip), a 4' by 42' set of 28 contiguous WFPC2 pointings with I<27. The small size of the HST Point-Spread Function (PSF) affords both a lower statistical noise, and a much weaker sensitivity to systematic effects, a crucial limiting factor of cosmic shear measurements. Our method and treatment of systematic effects were discussed in an earlier paper (Rhodes, Refregier & Groth 2000). We measure an rms shear of 1.8% on the WFPC2 chip scale (1.27'), in agreement with the predictions of cluster-normalized CDM models. Using a Maximum Likelihood (ML) analysis, we show that our detection is significant at the 99.5% confidence level (CL), and measure the normalization of the matter power spectrum to be sigma8*Omega_m^(0.48) = 0.51 (+0.14,-0.17), in a LambdaCDM universe. These 68% CL errors include (Gaussian) cosmic variance, systematic effects and the uncertainty in the redshift distribution of the background galaxies. Our result is consistent with earlier lensing measurements from the ground, and with the normalization derived from cluster abundance. We discuss how our measurement can be improved with the analysis of a large number of independent WFPC2 fields.

The SZ effect from clusters of galaxies is a dominant source of secondary CMB anisotropy in the low-redshift universe. We present analytic predictions for the CMB power spectrum from massive halos arising from the SZ effect. Since halos are discrete, the power spectrum consists of a Poisson and a correlation term. The latter is always smaller than the former, which is dominated by nearby bright rich clusters. In practice however, those bright clusters are easy to indentify and can thus be subtracted from the map. After this subtraction, the correlation term dominates degree-scale fluctuations over the Poisson term, as the main contribution to the correlation term comes from distant clusters. We find that the correlation term is detectable by Planck experiment. Since the degree scale spectrum is quite insensitive to the highly uncertain core structures of halos, our predictions are robust on these scales. Measuring the correlation term on degree scales thus cleanly probes the clustering of distant halos. This has not been measured yet, mainly because optical and X-ray surveys are not sufficiently sensitive to include such distant clusters and groups. Our analytic predictions are also compared to adiabatic hydrodynamic simulations. The agreement is remarkably good, down to ten arcminutes scales, indicating that our predictions are robust for the Planck experiment. Below ten arcminute scales, where the details of the core structure dominates the power spectrum, our analytic and simulated predictions might fail. In the near future, interferometer and bolometer array experiments will measure the SZ power spectrum down to arcminutes scales, and yield new insight into the physics of the intrahalo medium.

The hot gas embedded in the large-scale structures in the Universe produces secondary fluctuations in the Cosmic Microwave Background (CMB). Because it is proportional to the gas pressure integrated along the line of sight, this effect, the thermal Sunyaev-Zel'dovich (SZ) effect, provides a direct measure of large-scale structure and of cosmological parameters. We study the statistical properties of this effect using both hydrodynamical simulations and analytical predictions from an extended halo model. The Adaptive Mesh Refinement scheme, used in the newly developed code RAMSES, provides a dynamic range of 4 order of magnitudes, and thus allows us to significantly improve upon earlier calculations. After accounting for the finite mass resolution and box size of the simulation, we find that the halo model agrees well with the simulations. We discuss and quantify the uncertainty in both methods, and thus derive an accurate prediction for the SZ power spectrum in the 10^2<l<10^5 range of multipole. We show how this combined analytical and numerical approach is essential for accuracy, and useful for the understanding of the physical processes and scales which contribute to large-scale SZ anisotropies.

Gravitational lensing by large-scale structure induces weak coherent alignments in the shapes of background galaxies. Here we present evidence for the detection of this `cosmic shear' at the 3.4 sigma significance level with the William Herschel Telescope. Analysis and removal of notable systematic effects, such as shear induced by telescope optics and smearing by tracking and seeing, are conducted in order to recover the physical weak shear signal. Positive results for shear recovery on realistic simulated data are presented, enhancing confidence in the measurement method. The detection of cosmic shear is statistically characterised, and its cosmological significance is discussed.

Weak gravitational lensing is now established as a powerful method to measure mass fluctuations in the universe. It relies on the measurement of small coherent distortions of the images of background galaxies. Even low-level correlations in the intrinsic shapes of galaxies could however produce a significant spurious lensing signal. These correlations are also interesting in their own right, since their detection would constrain models of galaxy formation. Using $3\times 10^{4} - 10^5$ halos found in N-body simulations, we compute the correlation functions of the intrinsic ellipticity of spiral galaxies assuming that the disk is perpendicular to the angular momentum of the dark matter halo. We also consider a simple model for elliptical galaxies, in which the shape of the dark matter halo is assumed to be the same as that of the light. For deep lensing surveys with median redshifts $\sim 1$, we find that intrinsic correlations of $\sim 10^{-4}$ on angular scales $\theta \sim 0.1-10'$ are generally below the expected lensing signal, and contribute only a small fraction of the excess signals reported on these scales. On larger scales we find limits to the intrinsic correlation function at a level $\sim 10^{-5}$, which gives a (model-dependent) range of separations for which the intrinsic signal is about an order of magnitude below the ellipticity correlation function expected from weak lensing. Intrinsic correlations are thus negligible on these scales for dedicated weak lensing surveys. For wider but shallower surveys such as SuperCOSMOS, APM and SDSS, we cannot exclude the possibility that intrinsic correlations could dominate the lensing signal. We discuss how such surveys could be used to calibrate the importance of this effect, as well as study spin-spin correlations of spiral galaxies.

We report a detection of the coherent distortion of faint galaxies arising from gravitational lensing by foreground structures. This ``cosmic shear'' is potentially the most direct measure of the mass power spectrum, as it is unaffected by poorly-justified assumptions made concerning the biasing of the distribution. Our detection is based on an initial imaging study of 14 separated 8' x 16' fields observed in good, homogeneous conditions with the prime focus EEV CCD camera of the 4.2m William Herschel Telescope. We detect an rms shear of 1.6% in 8' x 8' cells, with a significance of 3.4 sigma. We carefully justify this detection by quantifying various systematic effects and carrying out extensive simulations of the recovery of the shear signal from artificial images defined according to measured instrument characteristics. We also verify our detection by computing the cross-correlation between the shear in adjacent cells. Including (gaussian) cosmic variance, we measure the shear variance to be (0.016)^2 plus/minus (0.012)^2 plus/minus (0.006)^2, where these 1 sigma errors correspond to statistical and systematic uncertainties, respectively. Our measurements are consistent with the predictions of cluster-normalised CDM models (within 1 sigma) but a COBE-normalised SCDM model is ruled out at the 3.0 sigma level. For the currently-favoured Lambda-CDM model (with Omega_m = 0.3), our measurement provides a normalisation of the mass power spectrum of sigma_8 = 1.5 plus/minus 0.5, fully consistent with that derived from cluster abundances. Our result demonstrates that ground-based telescopes can, with adequate care, be used to constrain the mass power spectrum on various scales. The present results are limited mainly by cosmic variance, which can be overcome in the near future with more observations.

(Abridged) Weak gravitational lensing induces distortions on the images of background galaxies, and thus provides a direct measure of mass fluctuations in the universe. Since the distortions induced by lensing on the images of background galaxies are only of a few percent, a reliable measurement demands very accurate galaxy shape estimation and a careful treatment of systematic effects. Here, we present a study of a shear measurement method using detailed simulations of artificial images. The images are produced using realisations of a galaxy ensemble drawn from the HST Groth strip. We consider realistic observational effects including atmospheric seeing, PSF anisotropy and pixelisation, incorporated in a manner to reproduce actual observations with the William Herschel Telescope. By applying an artificial shear to the simulated images, we test the shear measurement method proposed by Kaiser, Squires & Broadhurst (1995, KSB). Overall, we find the KSB method to be reliable with several provisos. To guide future weak lensing surveys, we study how seeing size, exposure time and pixelisation affect the sensitivity to shear. In addition, we study the impact of overlapping isophotes of neighboring galaxies, and find that this effect can produce spurious lensing signals on small scales. We discuss the prospects of using the KSB method for future, more sensitive, surveys. Numerical simulations of this kind are a required component of present and future analyses of weak lensing surveys.

We present the first detection of a gravitational depletion signal at near-infrared wavelengths, based on deep panoramic images of the cluster Abell 2219 (z=0.22) taken with the Cambridge Infrared Survey Instrument (CIRSI) at the prime focus of the 4.2m William Herschel Telescope. Infrared studies of gravitational depletion offer a number of advantages over similar techniques applied at optical wavelengths, and can provide reliable total masses for intermediate redshift clusters. Using the maximum likelihood technique developed by Schneider, King & Erben (1999), we detect the gravitational depletion at the 3 sigma confidence level. By modeling the mass distribution as a singular isothermal sphere and ignoring uncertainty in the unlensed number counts, we find an Einstein radius of 13.7 +3.9/-4.2 arcsec (66% confidence limit). This corresponds to a projected velocity dispersion of approximately 800 km/s, in agreement with constraints from strongly-lensed features. For a Navarro, Frenk and White mass model, the radial dependence observed indicates a best-fitting halo scale length of 125/h kpc}. We investigate the uncertainties arising from the observed fluctuations in the unlensed number counts, and show that clustering is the dominant source of error. We extend the maximum likelihood method to include the effect of incompleteness, and discuss the prospects of further systematic studies of lensing in the near-infrared band.

We propose a new technique to directly measure the shapes of dark matter halos of galaxies using weak gravitational lensing. Extending the standard galaxy-galaxy lensing method, we show that the shape parameters of the mass distribution of foreground galaxies can be measured from the two-dimensional shear field derived from background galaxies. This enables the comparison of the ellipticity of the mass distribution with that of the light in galaxies, as well as an estimate of the degree of alignment between the stellar component and dark matter. We choose the specific case of an elliptical, isothermal profile and estimate the feasibility and significance of the detection of this signal. The prospects for applying this technique are excellent with large on-going surveys like the Sloan Digital Sky Survey. The expected signal is smaller, but comparable in significance to that of the mass in standard galaxy-galaxy lensing analyses. Since shapes of halos depend on the degree of dissipation and the transfer of angular momentum during galaxy assembly, constraints obtained from our analysis will provide an important input to models of galaxy formation.

(Abridged) While the major contribution to the Cosmic Microwave Background (CMB) anisotropies are the sought-after primordial fluctuations produced at the surface of last scattering, other effects produce secondary fluctuations at lower redshifts. Here, we study the extragalactic foregrounds of the CMB in the context of the upcoming MAP mission. We first survey the major extragalactic foregrounds and show that discrete sources, the Sunyaev-Zel'dovich (SZ) effect, and gravitational lensing are the most dominant ones for MAP. We then show that MAP will detect (>5 sigma) about 46 discrete sources and 10 SZ clusters directly with 94 GHz fluxes above 2 Jy. The mean SZ fluxes of fainter clusters can be probed by cross-correlating MAP with cluster positions extracted from existing catalogs. For instance, a MAP-XBACs cross-correlation will be sensitive to clusters with S(94GHz)>200mJy, and will thus provide a test of their virialization state and a measurement of their gas fraction. Finally, we consider probing the hot gas on supercluster scales by cross-correlating the CMB with galaxy catalogs. Assuming that galaxies trace the gas, we show that a cross-correlation between MAP and the APM catalog should yield a marginal detection, or at least a four-fold improvement on the COBE upper limits for the rms Compton y-parameter.

(Abridged) The hot gas in the IGM produces anisotropies in the Cosmic Microwave Background (CMB) through the thermal Sunyaev-Zel'dovich (SZ) effect. The SZ effect is a powerful probe of large-scale structure in the universe and must be carefully subtracted from measurements of the primary CMB anisotropies. We use moving-mesh hydrodynamical simulations to study the 3-dimensional statistics of the gas, and compute the mean comptonization parameter and the angular power spectrum of the SZ fluctuations, for different cosmologies. We compare these results with predictions using the Press-Schechter formalism. We find that the two methods agree approximately, but differ in details. We discuss this discrepancy, and show that resolution limits the reliability of our results to the 200<l<2000 range. For cluster- normalized CDM models, the SZ power spectrum is comparable to the primordial power spectrum around l=2000. We show that groups and filaments (kT<5 keV) contribute about 50% of the SZ power spectrum at l=500. About half of the SZ power spectrum on these scales is produced at redshifts z<0.1, and can thus be detected and removed using existing catalogs of galaxies and X-ray clusters. We discuss the implications of these results for the future MAP and Planck Surveyor missions.

The weak distortions produced by gravitational lensing in the images of background galaxies provide a method to measure directly the distribution of mass in the universe. However this technique requires high precision measurements of the lensing shear and cautious corrections for systematic effects. Kaiser, Squires, & Broadhurst (1995) proposed a method to calibrate the ellipticity-shear relation in the presence of Point Spread Function (PSF) anisotropies and camera distortions. We revisit the KSB method and show that both the PSF and the camera distortions can be corrected for using source moments, as opposed to ellipticities. We clarify the applicability of some of the approximations made in this method. We derive expressions for the corrections which only involve the galaxy moments. We derive an explicit relation between the shear and the average ellipticity. We discuss the shortcomings of the method, and test its validity using numerical simulations. As an application of the method, we repeat the analysis of the HST WFPC2 camera performed by Hoekstra et al. (1998). We confirm the presence of sizable (10%) PSF ellipticities at the edge of the WFPC2 chips. We also show that the PSF ellipticity varies by as much as 2% over time. We use these measurements to correct the shape of galaxies in the HST Survey Strip (``Groth'' Strip). By considering the dependence of the ellipticities on object size, we show that, after corrections, the residual systematic uncertainty for galaxies with radii greater than 0.15 arcsec, is about 0.4%, when averaged over each chip. We discuss how these results provide good prospects for measuring weak lensing by large-scale structure with deep HST surveys.

While the major contribution to the Cosmic Microwave Background (CMB) anisotropies are the sought-after primordial fluctuations produced at the surface of last scattering, other effects produce secondary fluctuations at lower redshifts. These secondary fluctuations must be carefully accounted for, in order to isolate primordial fluctuations. In addition, they are interesting in their own right, since they provide a wealth of information on the geometry and local properties of the universe. Here, I survey the different sources of secondary anisotropies and extragalactic foregrounds of the CMB. I show their relative importance on the multipole-frequency plane. I discuss in particular their impact in the future CMB missions MAP and Planck Surveyor.

The coherent image distortions induced by weak gravitational lensing can be used to measure the power spectrum of density inhomogeneities in the universe. We present our on-going effort to detect this effect with the FIRST radio survey, which currently contains about 400,000 sources over 4,200 square degrees, and thus provides a unique resource for this purpose. We discuss the sensitivity of our measurement in the context of various cosmological models. We then discuss the crucial issue of systematic effects, the most serious of which are source fragmentation, image-noise correlation, and VLA-beam anisotropy. After accounting for these effects, we expect our experiment to yield a detection, or at least a tight upper limit, for the weak lensing power spectrum on 0.2-20 degree scales.

The measurement of shape parameters of sources in astronomical images is usually performed by assuming that the underlying noise is uncorrelated. Spatial noise correlation is however present in practice due to various observational effects and can affect source shape parameters. This effect is particularly important for measurements of weak gravitational lensing, for which the sought image distortions are typically of the order of only 1%. We compute the effect of correlated noise on two-dimensional gaussian fits in full generality. The noise properties are naturally quantified by the noise autocorrelation function (ACF), which is easily measured in practice. We compute the resulting bias on the mean, variance and covariance of the source parameters, and the induced correlation between the shapes of neighboring sources. We show that these biases are of second order in the inverse signal-to-noise ratio of the source, and could thus be overlooked if bright stars are used to monitor systematic distortions. Radio interferometric surveys are particularly prone to this effect because of the long-range pixel correlations produced by the Fourier inversion involved in their image construction. As a concrete application, we consider the search for weak lensing by large-scale structure with the FIRST radio survey. We measure the noise ACF for a FIRST coadded field, and compute the resulting ellipticity correlation function induced by the noise. In comparison with the weak-lensing signal expected in CDM models, the noise correlation effect is important on small angular scales, but is negligible for source separations greater than about 1 arcmin. We also discuss how noise correlation can affect weak-lensing studies with optical surveys.

Weak lensing by large-scale mass inhomogeneities in the Universe induces correlations in the observed ellipticities of distant sources. We first review the harmonic analysis and statistics required of these correlations and discuss calculations for the predicted signal. We consider the ellipticity correlation function, the mean-square ellipticity, the ellipticity power spectrum, and a global maximum-likelihood analysis to isolate a weak-lensing signal from the data. Estimates for the sensitivity of a survey of a given area, surface density, and mean intrinsic source ellipticity are presented. We then apply our results to the FIRST radio-source survey. We predict an rms ellipticity of roughly 0.011 in $1^\circ \times 1^\circ$ pixels and 0.018 in $20' \times 20'$ pixels if the power spectrum is normalized to $\sigma_8 \Omega^{0.53} = 0.6$, as indicated by the cluster abundance. The signal is significantly larger in some models if the power spectrum is normalized instead to the COBE anisotropy. The uncertainty in the predictions from imprecise knowledge of the FIRST redshift distribution is about 25% in the rms ellipticity. We show that FIRST should be able to make a statistically significant detection of a weak-lensing signal for cluster-abundance-normalized power spectra.

Gravitational lensing by clusters of galaxies affects the cosmic X-ray background (XRB) by altering the observed density and flux distribution of background X-ray sources. At faint detection flux thresholds, the resolved X-ray sources appear brighter and diluted, while the unresolved component of the XRB appears dimmer and more anisotropic, due to lensing. The diffuse X-ray intensity in the outer halos of clusters might be lower than the sky-averaged XRB, after the subtraction of resolved sources. Detection of the lensing signal with a wide-field X-ray telescope could probe the mass distribution of a cluster out to its virialization boundary. In particular, we show that the lensing signature imprinted on the resolved component of the XRB by the cluster A1689, should be difficult but possible to detect out to 8' at the 2-4 sigma level, after 10^6 seconds of observation with the forthcoming AXAF satellite. The lensing signal is fairly insensitive to the lens redshift in the range 0.1<z<0.6. The amplitude of the lensing signal is however sensitive to the faint end slope of the number-flux relation for unresolved X-ray sources, and can thus help constrain models of the XRB. A search for X-ray arcs or arclets could identify the fraction of all faint sources which originate from extended emission of distant galaxies. The probability for a 3 sigma detection of an arclet which is stretched by a factor of about 3 after a 10^6 seconds observation of A1689 with AXAF, is roughly comparable to the fraction of all background X-ray sources that have an intrinsic size of order 1''.

The Sunyaev-Zel'dovich (SZ) effect of a cluster of galaxies is usually measured after background radio sources are removed from the cluster field. Gravitational lensing by the cluster potential leads to a systematic deficit in the residual intensity of unresolved sources behind the cluster core relative to a control field far from the cluster center. As a result, the measured decrement in the Rayleigh-Jeans temperature of the cosmic microwave background is overestimated. We calculate the associated systematic bias which is inevitably introduced into measurements of the Hubble constant using the SZ effect. For the cluster A2218, we find that observations at 15 GHz with a beam radius of 0'.4 and a source removal threshold of 100 microJy underestimate the Hubble constant by 6-10%. If the profile of the gas pressure declines more steeply with radius than that of the dark matter density, then the ratio of lensing to SZ decrements increases towards the outer part of the cluster.

Recent ROSAT surveys suggest that galaxies constitute the new class of X-ray sources required to explain the full phenomenology of the cosmic X-Ray Background (XRB). To test this hypothesis, we compute the two-point cross-correlation function Wxg(theta) between 62 Einstein-IPC fields (.81-3.5 keV) and the APM Northern galaxy catalog (13.5<E<19.0). At zero-lag (theta=0), we detect a 3.5sigma correlation signal with an amplitude of Wxg(0)=.045+/-.013. At non-zero lag (theta>0), the angular dependence of Wxg has two main features: the main signal for theta<4', and an almost flat plateau with an amplitude of Wxg(theta>4')=.015, likely to result from the diffuse X-ray emission by clusters of galaxies. Taking the point-spread function of the X-ray instrument into account, we find that the mean X-ray flux of galaxies with <E>=17.5+/-.3 is (8.1+/-4.7) 10^(-16) ergs/cm^2/s. This agrees with the X-ray flux expected from earlier direct studies of brighter galaxies, which were shown to result in a total galaxy contribution to the XRB of about 13%. We discuss how this powerful cross-correlation method can be used to measure the flux of X-ray sources well below the detection limit of X-ray instruments, and, perhaps, to probe otherwise undetectable faint diffuse X-ray emission.

The foreground component of the X-ray Background (XRB) can be studied by cross-correlating its intensity with galaxy catalogs. We computed the two-point cross-correlation function $W_{xg}$ between 67 {\em Einstein} X-ray fields and the APM galaxy catalog. We detected a signal with an amplitude of $W_{xg} = .04 \pm .01$, significant at the $3.5\sigma$ level. The reality of this signal was tested with a series of control data sets. We discuss how this signal can be used to constrain models of the XRB.

We examine the gravitational lensing effect of a foreground galaxy cluster on the number count statistics of background X-ray sources. The lensing produces a deficit in the number of resolved sources in a ring close to the critical radius of the cluster. This deficit could be detected at the $\sim 3\sigma$ level with the AXAF-ACIS camera.