The combination of different cosmological probes offers stringent tests of the $\Lambda$CDM model and enhanced control of systematics. For this purpose, we present an extension of the lightcone generator UFalcon first introduced in Sgier et al. 2019 (arXiv:1801.05745), enabling the simulation of a self-consistent set of maps for different cosmological probes. Each realization is generated from the same underlying simulated density field, and contains full-sky maps of different probes, namely weak lensing shear, galaxy overdensity including RSD, CMB lensing, and CMB temperature anisotropies from the ISW effect. The lightcone generation performed by UFalcon is parallelized and based on the replication of a large periodic volume simulated with the GPU-accelerated $N$-Body code PkdGrav3. The post-processing to construct the lightcones requires only a runtime of about 1 walltime-hour corresponding to about 100 CPU-hours. We use a randomization procedure to increase the number of quasi-independent full-sky UFalcon map-realizations, which enables us to compute an accurate multi-probe covariance matrix. Using this framework, we forecast cosmological parameter constraints by performing a multi-probe likelihood analysis for a combination of simulated future stage-IV-like surveys. We find that the inclusion of the cross-correlations between the probes significantly increases the information gain in the parameter constraints. We also find that the use of a non-Gaussian covariance matrix is increasingly important, as more probes and cross-correlation power spectra are included. A version of the UFalcon package currently including weak gravitational lensing is publicly available.

Deep generative models, such as Generative Adversarial Networks (GANs) or Variational Autoencoders (VAs) have been demonstrated to produce images of high visual quality. However, the existing hardware severely limits the size of the images that can be generated. The rapid growth of high dimensional data in many fields of science therefore poses a significant challenge for generative models. In cosmology, the large-scale, three-dimensional matter distribution, modeled with N-body simulations, plays a crucial role in understanding the evolution of the universe. As these simulations are computationally very expensive, GANs have recently generated interest as a possible method to emulate these datasets, but they have been, so far, mostly limited to two dimensional data. In this work, we introduce a new benchmark for the generation of three dimensional N-body simulations, in order to stimulate new ideas in the machine learning community and move closer to the practical use of generative models in cosmology. As a first benchmark result, we propose a scalable GAN approach for training a generator of N-body three-dimensional cubes. Our technique relies on two key building blocks, (i) splitting the generation of the high-dimensional data into smaller parts, and (ii) using a multi-scale approach that efficiently captures global image features that might otherwise be lost in the splitting process. We evaluate the performance of our model for the generation of N-body samples using various statistical measures commonly used in cosmology. Our results show that the proposed model produces samples of high visual quality, although the statistical analysis reveals that capturing rare features in the data poses significant problems for the generative models. We make the data, quality evaluation routines, and the proposed GAN architecture publicly available at https://github.com/nperraud/3DcosmoGAN

Dark matter in the universe evolves through gravity to form a complex network of halos, filaments, sheets and voids, that is known as the cosmic web. Computational models of the underlying physical processes, such as classical N-body simulations, are extremely resource intensive, as they track the action of gravity in an expanding universe using billions of particles as tracers of the cosmic matter distribution. Therefore, upcoming cosmology experiments will face a computational bottleneck that may limit the exploitation of their full scientific potential. To address this challenge, we demonstrate the application of a machine learning technique called Generative Adversarial Networks (GAN) to learn models that can efficiently generate new, physically realistic realizations of the cosmic web. Our training set is a small, representative sample of 2D image snapshots from N-body simulations of size 500 and 100 Mpc. We show that the GAN-generated samples are qualitatively and quantitatively very similar to the originals. For the larger boxes of size 500 Mpc, it is very difficult to distinguish them visually. The agreement of the power spectrum $P_k$ is 1-2\% for most of the range, between $k=0.06$ and $k=0.4$. An important advantage of generating cosmic web realizations with a GAN is the considerable gains in terms of computation time. Each new sample generated by a GAN takes a fraction of a second, compared to the many hours needed by traditional N-body techniques. We anticipate that the use of generative models such as GANs will therefore play an important role in providing extremely fast and precise simulations of cosmic web in the era of large cosmological surveys, such as Euclid and Large Synoptic Survey Telescope (LSST).

Weak lensing peak counts are a powerful statistical tool for constraining cosmological parameters. So far, this method has been applied only to surveys with relatively small areas, up to several hundred square degrees. As future surveys will provide weak lensing datasets with size of thousands of square degrees, the demand on the theoretical prediction of the peak statistics will become heightened. In particular, large simulations of increased cosmological volume are required. In this work, we investigate the possibility of using simulations generated with the fast Comoving-Lagrangian acceleration (COLA) method, coupled to the convergence map generator Ufalcon, for predicting the peak counts. We examine the systematics introduced by the COLA method by comparing it with a full TreePM code. We find that for a 2000 deg$^2$ survey, the systematic error is much smaller than the statistical error. This suggests that the COLA method is able to generate promising theoretical predictions for weak lensing peaks. We also examine the constraining power of various configurations of data vectors, exploring the influence of splitting the sample into tomographic bins and combining different smoothing scales. We find the combination of smoothing scales to have the most constraining power, improving the constraints on the $S_8$ amplitude parameter by at least 40% compared to a single smoothing scale, with tomography brining only limited increase in measurement precision.

Upcoming weak lensing surveys will probe large fractions of the sky with unprecedented accuracy. To infer cosmological constraints, a large ensemble of survey simulations are required to accurately model cosmological observables and their covariances. We develop a parallelized multi-lens-plane pipeline called UFalcon, designed to generate full-sky weak lensing maps from lightcones within a minimal runtime. It makes use of L-PICOLA, an approximate numerical code, which provides a fast and accurate alternative to cosmological $N$-Body simulations. The UFalcon maps are constructed by nesting 2 simulations covering a redshift-range from $z=0.1$ to $1.5$ without replicating the simulation volume. We compute the convergence and projected overdensity maps for L-PICOLA in the lightcone or snapshot mode. The generation of such a map, including the L-PICOLA simulation, takes about 3 hours walltime on 220 cores. We use the maps to calculate the spherical harmonic power spectra, which we compare to theoretical predictions and to UFalcon results generated using the full $N$-Body code GADGET-2. We then compute the covariance matrix of the full-sky spherical harmonic power spectra using 150 UFalcon maps based on L-PICOLA in lightcone mode. We consider the PDF, the higher-order moments and the variance of the smoothed field variance to quantify the accuracy of the covariance matrix, which we find to be a few percent for scales $\ell \sim 10^2$ to $10^3$. We test the impact of this level of accuracy on cosmological constraints using an optimistic survey configuration, and find that the final results are robust to this level of uncertainty. The speed and accuracy of our developed pipeline provides a basis to also include further important features such as masking, varying noise and will allow us to compute covariance matrices for models beyond $\Lambda$CDM. [abridged]

Approximate Bayesian Computation (ABC) is a method to obtain a posterior distribution without a likelihood function, using simulations and a set of distance metrics. For that reason, it has recently been gaining popularity as an analysis tool in cosmology and astrophysics. Its drawback, however, is a slow convergence rate. We propose a novel method, which we call qABC, to accelerate ABC with Quantile Regression. In this method, we create a model of quantiles of distance measure as a function of input parameters. This model is trained on a small number of simulations and estimates which regions of the prior space are likely to be accepted into the posterior. Other regions are then immediately rejected. This procedure is then repeated as more simulations are available. We apply it to the practical problem of estimation of redshift distribution of cosmological samples, using forward modelling developed in previous work. The qABC method converges to nearly same posterior as the basic ABC. It uses, however, only 20\% of the number of simulations compared to basic ABC, achieving a fivefold gain in execution time for our problem. For other problems the acceleration rate may vary; it depends on how close the prior is to the final posterior. We discuss possible improvements and extensions to this method.

We demonstrate the potential of Deep Learning methods for measurements of cosmological parameters from density fields, focusing on the extraction of non-Gaussian information. We consider weak lensing mass maps as our dataset. We aim for our method to be able to distinguish between five models, which were chosen to lie along the $\sigma_8$ - $\Omega_m$ degeneracy, and have nearly the same two-point statistics. We design and implement a Deep Convolutional Neural Network (DCNN) which learns the relation between five cosmological models and the mass maps they generate. We develop a new training strategy which ensures the good performance of the network for high levels of noise. We compare the performance of this approach to commonly used non-Gaussian statistics, namely the skewness and kurtosis of the convergence maps. We find that our implementation of DCNN outperforms the skewness and kurtosis statistics, especially for high noise levels. The network maintains the mean discrimination efficiency greater than $85\%$ even for noise levels corresponding to ground based lensing observations, while the other statistics perform worse in this setting, achieving efficiency less than $70\%$. This demonstrates the ability of CNN-based methods to efficiently break the $\sigma_8$ - $\Omega_m$ degeneracy with weak lensing mass maps alone. We discuss the potential of this method to be applied to the analysis of real weak lensing data and other datasets.

Simulated wide-field images are becoming an important part of observational astronomy, either to prepare for new surveys or to test measurement methods. In order to efficiently explore vast parameter spaces, the computational speed of simulation codes is a central requirement to their implementation. We introduce the Ultra Fast Image Generator (UFig) which aims to bring wide-field imaging simulations to the current limits of computational capabilities. We achieve this goal through: (1) models of galaxies, stars and observational conditions, which, while simple, capture the key features necessary for realistic simulations, and (2) state-of-the-art computational and implementation optimizations. We present the performances of UFig and show that it is faster than existing public simulation codes by several orders of magnitude. It allows us to produce images more quickly than SExtractor needs to analyze them. For instance, it can simulate a typical 0.25 deg^2 Subaru SuprimeCam image (10k x 8k pixels) with a 5-sigma limiting magnitude of R=26 in 30 seconds on a laptop, yielding an average simulation time for a galaxy of 30 microseconds. This code is complementary to end-to-end simulation codes and can be used as a fast, central component of observational methods relying on simulations.

We present a joint weak lensing and X-ray analysis of 4 deg$^2$ from the CFHTLS and XMM-LSS surveys. Our weak lensing analysis is the first analysis of a real survey using shapelets, a new generation weak lensing analysis method. We create projected mass maps of the images, and extract 6 weak-lensing-detected clusters of galaxies. We show that their counts can be used to constrain the power spectrum normalisation $\sigma_8 =0.92_{-0.30}^{+0.26}$ for $\Omega_m=0.24$. We show that despite the large scatter generally observed in the M-T relation derived from lensing masses, tight constraints on both its slope and normalisation $M_*$ can be obtained with a moderate number of sources provided that the covered mass range is large enough. Adding clusters from Bardeau et al. (2007) to our sample, we measure $M_* = 2.71_{-0.61}^{+0.79} 10^{14} h^{-1} M_\odot$. Although they are dominated by shot noise and sample variance, our measurements are consistent with currently favoured values, and set the stage for future surveys. We thus investigate the dependence of those estimates on survey size, depth, and integration time, for joint weak lensing and X-ray surveys. We show that deep surveys should be dedicated to the study of the physics of clusters and groups of galaxies. For a given exposure time, wide surveys provide a larger number of detected clusters and are therefore preferred for the measurement of cosmological parameters such as $\sigma_8$ and $M_*$. We show that a wide survey of a few hundred square degrees is needed to improve upon current measurements of these parameters. More ambitious surveys covering 7000 deg$^2$ will provide the 1% accuracy in the estimation of the power spectrum and the M-T relation normalisations.