Measuring temperature fluctuations in the 21 cm signal from the Epoch of Reionization and the Cosmic Dawn is one of the most promising ways to study the Universe at high redshifts. Unfortunately, the 21 cm signal is affected by both cosmology and astrophysics processes in a non-trivial manner. We run a suite of 1,000 numerical simulations with different values of the main astrophysical parameters. From these simulations we produce tens of thousands of 21 cm maps at redshifts $10\leq z\leq 20$. We train a convolutional neural network to remove the effects of astrophysics from the 21 cm maps, and output maps of the underlying matter field. We show that our model is able to generate 2D matter fields that not only resemble the true ones visually, but whose statistical properties agree with the true ones within a few percent down to pretty small scales. We demonstrate that our neural network retains astrophysical information, that can be used to constrain the value of the astrophysical parameters. Finally, we use saliency maps to try to understand which features of the 21 cm maps is the network using in order to determine the value of the astrophysical parameters.

This paper introduces the Wavelet Phase Harmonics (WPH) statistics. They are interpretable low-dimensional statistics which describe 2D non-Gaussian density fields. These statistics are built from WPH moments, which have been recently introduced in data science and machine learning community. In this paper, we applied WPH statistics to projected matter density fields from the Quijote N-body simulations. We find by computing the Fisher information matrix, that the WPH statistics can place more stringent constraints on 5 cosmological parameters when compared to the combination of power-spectrum and bi-spectrum. We also use the WPH statistics to successfully generate from a maximum entropy model new 2D density fields that reproduce the PDF, mean, power-spectrum, bispectrum and the Minkowski functionals of the input density fields. While separate methods have been proven very efficient for parameter estimations and statistical syntheses for for large scale structure, WPH statistics are the first statistics that can both achieve a more stringent cosmological parameter constraint, and produce a sufficiently accurate simulation of the Universe while being interpretable.

We introduce a physically-motivated model of the matter power spectrum, based on the halo model and perturbation theory. This model achieves 1\% accuracy on all $k-$scales between $k=0.02h\,\mathrm{Mpc}^{-1}$ to $k=1h\,\mathrm{Mpc}^{-1}$. Our key ansatz is that the number density of halos depends on the non-linear density contrast filtered on some unknown scale $R$. Using the Effective Field Theory of Large Scale Structure to evaluate the two-halo term, we obtain a model for the power spectrum with only two fitting parameters: $R$ and the effective `sound speed', which encapsulates small-scale physics. This is tested with two suites of cosmological simulations across a broad range of cosmologies and found to be highly accurate. Due to its physical motivation, the statistics can be easily extended beyond the power spectrum; we additionally derive the one-loop covariance matrices of cluster counts and their combination with the matter power spectrum. This yields a significantly better fit to simulations than previous models, and includes a new model for super-sample effects, which is rigorously tested with separate universe simulations. At low redshift, we find a significant ($\sim 10\%$) exclusion covariance from accounting for the finite size of halos which has not previously been modeled. Such power spectrum and covariance models will enable joint analysis of upcoming large-scale structure surveys, gravitational lensing surveys and cosmic microwave background maps on scales down to the non-linear scale. We provide a publicly released Python code.

We present an extension of our recently developed Wasserstein optimized model to emulate accurate high-resolution features from computationally cheaper low-resolution cosmological simulations. Our deep physical modelling technique relies on restricted neural networks to perform a mapping of the distribution of the low-resolution cosmic density field to the space of the high-resolution small-scale structures. We constrain our network using a single triplet of high-resolution initial conditions and the corresponding low- and high-resolution evolved dark matter simulations from the Quijote suite of simulations. We exploit the information content of the high-resolution initial conditions as a well constructed prior distribution from which the network emulates the small-scale structures. Once fitted, our physical model yields emulated high-resolution simulations at low computational cost, while also providing some insights about how the large-scale modes affect the small-scale structure in real space.

Massive neutrinos suppress the growth of structure below their free-streaming scale and leave an imprint on large-scale structure. Measuring this imprint allows us to constrain the sum of neutrino masses, $M_\nu$, a key parameter in particle physics beyond the Standard Model. However, degeneracies among cosmological parameters, especially between $M_\nu$ and $\sigma_8$, limit the constraining power of standard two-point clustering statistics. In this work, we investigate whether we can break these degeneracies and constrain $\smnu$ with the next higher-order correlation function --- the bispectrum. We first examine the redshift-space halo bispectrum of $800$ $N$-body simulations from the HADES suite and demonstrate that the bispectrum helps break the $M_\nu$--$\sigma_8$ degeneracy. Then using 22,000 $N$-body simulations of the Quijote suite, we quantify for the first time the full information content of the redshift-space halo bispectrum down to nonlinear scales using a Fisher matrix forecast of $\{\Omega_m$, $\Omega_b$, $h$, $n_s$, $\sigma_8$, $M_\nu\}$. For $k_{\rm max}{=}0.5~h/{\rm Mpc}$, the bispectrum provides $\Omega_m$, $\Omega_b$, $h$, $n_s$, and $\sigma_8$ constraints 1.9, 2.6, 3.1, 3.6, and 2.6 times tighter than the power spectrum. For $M_\nu$, the bispectrum improves the 1$\sigma$ constraint from 0.2968 to 0.0572 eV --- over 5 times tighter than the power spectrum. Even with priors from {\em Planck}, the bispectrum improves $M_\nu$ constraints by a factor of 1.8. Although we reserve marginalizing over a more complete set of bias parameters to the next paper of the series, these constraints are derived for a $(1~h^{-1}{\rm Gpc})^3$ box, a substantially smaller volume than upcoming surveys. Thus, our results demonstrate that the bispectrum offers significant improvements over the power spectrum, especially for constraining $M_\nu$.

Cosmological neutrinos have their greatest influence in voids: these are the regions with the highest neutrino to dark matter density ratios. The marked power spectrum can be used to emphasize low density regions over high density regions, and therefore is potentially much more sensitive than the power spectrum to the effects of neutrino masses. Using 22,000 N-body simulations from the Quijote suite, we quantify the information content in the marked power spectrum of the matter field, and show that it outperforms the standard power spectrum by setting constraints improved by a factor larger than 2 on all cosmological parameters. The combination of marked and standard power spectrum allows to place a 4.3{\sigma} constraint on the minimum sum of the neutrino masses with a volume equal to 1 (Gpc/h)^3 and without CMB priors. Combinations of different marked power spectra yield a 6{\sigma} constraint within the same conditions.

Detecting primordial non-Gaussianity on mildly non-linear scales requires precise modelling of late-time structure formation. Accurately predicting the impact of non-linear gravitational collapse, non-linear tracer bias and baryonic physics on the variance and higher order moments of the cosmic density field is challenging, as they strongly depend on the tails of the probability distribution function (PDF) of density fluctuations. A way around this problem is to directly analyse the bulk of the PDF instead. For this purpose we devise a new method to predict the impact of general non-Gaussian initial conditions on the late-time density PDF. With this formalism we show that - even when marginalizing over potential ignorance of the amplitude and slope of the non-linear power spectrum - an analysis of the PDF at mildly non-linear densities can measure the amplitude of different primordial bispectrum shapes to an accuracy of $\Delta f_{\mathrm{NL}}^{\mathrm{loc}} = \pm 3.1\ ,\ \Delta f_{\mathrm{NL}}^{\mathrm{equi}} = \pm 10.0\ ,\ \Delta f_{\mathrm{NL}}^{\mathrm{ortho}} = \pm 17.0\ $. This assumes a joint analysis of the PDF on smoothing scales of $15$Mpc/$h$ and $30$Mpc/$h$ in a survey volume of $V=100(\mathrm{Gpc}/h)^3$ at $z=1$, analysing only densities of $\delta(15\mathrm{Mpc}/h) \in [-0.4, 0.5]$ ($\approx 87\%$ of probability) and $\delta(30\mathrm{Mpc}/h) \in [-0.3, 0.4]$ ($\approx 95\%$ of probability). Note that a formalism closely related to ours was already successfully applied to observational data \citep{Gruen2018, Friedrich2018}, demonstrating that the methodology developed here can indeed be carried over to real data analysis.

We comprehensively analyse the cosmology dependence of counts-in-cell statistics. We focus on the shape of the one-point probability distribution function (PDF) of the matter density field at mildly nonlinear scales. Based on large-deviation statistics, we parametrise the cosmology dependence of the matter PDF in terms of the linear power spectrum, the growth factor, the spherical collapse dynamics, and the nonlinear variance. We extend our formalism to include massive neutrinos, finding that the total matter PDF is highly sensitive to the total neutrino mass $M_\nu$ and can disentangle it from the clustering amplitude $\sigma_8$. Using more than a million PDFs extracted from the Quijote simulations, we determine the response of the matter PDF to changing parameters in the $\nu\Lambda$CDM model and successfully cross-validate the theoretical model and the simulation measurements. We present the first $\nu\Lambda$CDM Fisher forecast for the matter PDF at multiple scales and redshifts, and its combination with the matter power spectrum. We establish that the matter PDF and the matter power spectrum are highly complementary at mildly nonlinear scales. The matter PDF is particularly powerful for constraining the matter density $\Omega_m$, clustering amplitude $\sigma_8$ and the total neutrino mass $M_\nu$. Adding the mildly nonlinear matter PDF to the mildly nonlinear matter power spectrum improves constraints on $\Omega_m$ by a factor of 5 and $\sigma_8$ by a factor of 2 when considering the three lowest redshifts. In our joint analysis of the matter PDF and matter power spectrum at three redshifts, the total neutrino mass is constrained to better than 0.01 eV with a total volume of 6 (Gpc/h)$^3$. We discuss how density-split statistics can be used to translate those encouraging results for the matter PDF into realistic observables in galaxy surveys.

We study the clustering properties of dark matter halos in real- and redshift-space in cosmologies with massless and massive neutrinos through a large set of state-of-the-art N-body simulations. We provide quick and easy-to-use prescriptions for the halo bias on linear and mildly non-linear scales, both in real and redshift space, which are valid also for massive neutrinos cosmologies. Finally we present a halo bias emulator,$\textbf{BE-HaPPY}$, calibrated on the N-body simulations, which is fast enough to be used in the standard Markov Chain Monte Carlo approach to cosmological inference. For a fiducial standard $\Lambda$CDM cosmology $\textbf{BE-HaPPY}$ provides percent or sub-percent accuracy on the scales of interest (linear and well into the mildly non-linear regime), meeting therefore for the halo-bias the accuracy requirements for the analysis of next-generation large--scale structure surveys.

The Square Kilometre Array (SKA) is a planned large radio interferometer designed to operate over a wide range of frequencies, and with an order of magnitude greater sensitivity and survey speed than any current radio telescope. The SKA will address many important topics in astronomy, ranging from planet formation to distant galaxies. However, in this work, we consider the perspective of the SKA as a facility for studying physics. We review four areas in which the SKA is expected to make major contributions to our understanding of fundamental physics: cosmic dawn and reionisation; gravity and gravitational radiation; cosmology and dark energy; and dark matter and astroparticle physics. These discussions demonstrate that the SKA will be a spectacular physics machine, which will provide many new breakthroughs and novel insights on matter, energy and spacetime.

Cosmological simulations play an important role in the interpretation of astronomical data, in particular in comparing observed data to our theoretical expectations. However, to compare data with these simulations, the simulations in principle need to include gravity, magneto-hydrodyanmics, radiative transfer, etc. These ideal large-volume simulations (gravo-magneto-hydrodynamical) are incredibly computationally expensive which can cost tens of millions of CPU hours to run. In this paper, we propose a deep learning approach to map from the dark-matter-only simulation (computationally cheaper) to the galaxy distribution (from the much costlier cosmological simulation). The main challenge of this task is the high sparsity in the target galaxy distribution: space is mainly empty. We propose a cascade architecture composed of a classification filter followed by a regression procedure. We show that our result outperforms a state-of-the-art model used in the astronomical community, and provides a good trade-off between computational cost and prediction accuracy.

Measuring the sum of the three active neutrino masses, $M_\nu$, is one of the most important challenges in modern cosmology. Massive neutrinos imprint characteristic signatures on several cosmological observables in particular on the large-scale structure of the Universe. In order to maximize the information that can be retrieved from galaxy surveys, accurate theoretical predictions in the non-linear regime are needed. Currently, one way to achieve those predictions is by running cosmological numerical simulations. Unfortunately, producing those simulations requires high computational resources -- seven hundred CPU hours for each neutrino mass case. In this work, we propose a new method, based on a deep learning network (U-Net), to quickly generate simulations with massive neutrinos from standard $\Lambda$CDM simulations without neutrinos. We computed multiple relevant statistical measures of deep-learning generated simulations, and conclude that our method accurately reproduces the 3-dimensional spatial distribution of matter down to non-linear scales: $k < 0.7$ h/Mpc. Finally, our method allows us to generate massive neutrino simulations 10,000 times faster than the traditional methods.

The large-scale clustering of matter is impacted by baryonic physics, particularly AGN feedback. Modelling or mitigating this impact will be essential for making full use of upcoming measurements of cosmic shear and other large-scale structure probes. We study baryonic effects on the matter bispectrum, using measurements from a selection of state-of-the-art hydrodynamical simulations: IllustrisTNG, Illustris, EAGLE, and BAHAMAS. We identify a low-redshift enhancement of the bispectrum, peaking at $k\sim 3h\,{\rm Mpc}^{-1}$, that is present in several simulations, and discuss how it can be associated to the evolving nature of AGN feedback at late times. This enhancement does not appear in the matter power spectrum, and therefore represents a new source of degeneracy breaking between two- and three-point statistics. In addition, we provide physical interpretations for other aspects of these measurements, and make initial comparisons to predictions from perturbation theory, empirical fitting formulas, and the response function formalism. We publicly release our measurements (including estimates of their uncertainty due to sample variance) and bispectrum measurement code as resources for the community.

The Quijote simulations are a set of 43100 full N-body simulations spanning more than 7000 cosmological models in the $\{\Omega_{\rm m}, \Omega_{\rm b}, h, n_s, \sigma_8, M_\nu, w \}$ hyperplane. At a single redshift the simulations contain more than 8.5 trillions of particles over a combined volume of 43100 $(h^{-1}{\rm Gpc})^3$. Billions of dark matter halos and cosmic voids have been identified in the simulations, whose runs required more than 35 million core hours. The Quijote simulations have been designed for two main purposes: 1) to quantify the information content on cosmological observables, and 2) to provide enough data to train machine learning algorithms. In this paper we describe the simulations and show a few of their applications. We also release the Petabyte of data generated, comprising hundreds of thousands of simulation snapshots at multiple redshifts, halo and void catalogs, together with millions of summary statistics such as power spectra, bispectra, correlation functions, marked power spectra, and estimated probability density functions.

This white paper envisions a revolutionary post-DESI, post-LSST dark energy program based on intensity mapping of the redshifted 21cm emission line from neutral hydrogen at radio frequencies. The proposed intensity mapping survey has the unique capability to quadruple the volume of the Universe surveyed by optical programs, provide a percent-level measurement of the expansion history to $z \sim 6$, open a window to explore physics beyond the concordance $\Lambda$CDM model, and to significantly improve the precision on standard cosmological parameters. In addition, characterization of dark energy and new physics will be powerfully enhanced by cross-correlations with optical surveys and cosmic microwave background measurements. The rich dataset obtained by the proposed intensity mapping instrument will be simultaneously useful in exploring the time-domain physics of fast radio transients and pulsars, potentially in live "multi-messenger" coincidence with other observatories. The core dark energy/inflation science advances enabled by this program are the following: (i) Measure the expansion history of the universe over $z=0.3-6$ with a single instrument, extending the range deep into the pre-acceleration era, providing an unexplored window for new physics; (ii) Measure the growth rate of structure in the universe over the same redshift range; (iii) Observe, or constrain, the presence of inflationary relics in the primordial power spectrum, improving existing constraints by an order of magnitude; (iv) Observe, or constrain, primordial non-Gaussianity with unprecedented precision, improving constraints on several key numbers by an order of magnitude. Detailed mapping of the enormous, and still largely unexplored, volume of cosmic space will thus provide unprecedented information on fundamental questions of the vacuum energy and early-universe physics.

Development of the hardware, data analysis, and simulation techniques for large compact radio arrays dedicated to mapping the 21 cm line of neutral hydrogen gas has proven to be more difficult than imagined twenty years ago when such telescopes were first proposed. Despite tremendous technical and methodological advances, there are several outstanding questions on how to optimally calibrate and analyze such data. On the positive side, it has become clear that the outstanding issues are purely technical in nature and can be solved with sufficient development activity. Such activity will enable science across redshifts, from early galaxy evolution in the pre-reionization era to dark energy evolution at low redshift.

PUMA is a proposal for an ultra-wideband, low-resolution and transit interferometric radio telescope operating at $200-1100\,\mathrm{MHz}$. Its design is driven by six science goals which span three science themes: the physics of dark energy (measuring the expansion history and growth of the universe up to $z=6$), the physics of inflation (constraining primordial non-Gaussianity and primordial features) and the transient radio sky (detecting one million fast radio bursts and following up SKA-discovered pulsars). We propose two array configurations composed of hexagonally close-packed 6m dish arrangements with 50% fill factor. The initial 5,000 element 'petite array' is scientifically compelling, and can act as a demonstrator and a stepping stone to the full 32,000 element 'full array'. Viewed as a 21cm intensity mapping telescope, the program has the noise equivalent of a traditional spectroscopic galaxy survey comprised of 0.6 and 2.5 billion galaxies at a comoving wavenumber of $k=0.5\,h\mathrm{Mpc}^{-1}$ spanning the redshift range $z = 0.3 - 6$ for the petite and full configurations, respectively. At redshifts beyond $z=2$, the 21cm technique is a uniquely powerful way of mapping the universe, while the low-redshift range will allow for numerous cross-correlations with existing and upcoming surveys. This program is enabled by the development of ultra-wideband radio feeds, cost-effective dish construction methods, commodity radio-frequency electronics driven by the telecommunication industry and the emergence of sufficient computing power to facilitate real-time signal processing that exploits the full potential of massive radio arrays. The project has an estimated construction cost of 55 and 330 million FY19 USD for the petite and full array configurations. Including R&D, design, operations and science analysis, the cost rises to 125 and 600 million FY19 USD, respectively.

Nonlinear objects like halos and voids exhibit a scale-dependent bias on linear scales in massive neutrino cosmologies. The shape of this scale-dependent bias is a unique signature of the neutrino masses, but the amplitude of the signal is generally small, of the order of $f_\nu$, the contribution of neutrinos to the total matter content ($\lesssim 1\%$). In this paper, we demonstrate for the first time how the strength of this signal can be substantially enhanced by using information about the halo environment at a range of scales. This enhancement is achieved by using certain combinations of the large scale Cold Dark Matter and total matter environments of halos, both of which are measurable from galaxy clustering and weak lensing surveys.

We have recently developed a post-processing framework to estimate the abundance of atomic and molecular hydrogen (HI and H2, respectively) in galaxies in large-volume cosmological simulations. Here we compare the HI and H2 content of IllustrisTNG galaxies to observations. We mostly restrict this comparison to $z \approx 0$ and consider six observational metrics: the overall abundance of HI and H2, their mass functions, gas fractions as a function of stellar mass, the correlation between H2 and star formation rate, the spatial distribution of gas, and the correlation between gas content and morphology. We find generally good agreement between simulations and observations, particularly for the gas fractions and the HI mass-size relation. The H2 mass correlates with star formation rate as expected, revealing an almost constant depletion time that evolves up to z = 2 as observed. However, we also discover a number of tensions with varying degrees of significance, including an overestimate of the total neutral gas abundance at z = 0 by about a factor of two and a possible excess of satellites with no or very little neutral gas. These conclusions are robust to the modelling of the HI/H2 transition. In terms of their neutral gas properties, the IllustrisTNG simulations represent an enormous improvement over the original Illustris run. All data used in this paper are publicly available as part of the IllustrisTNG data release.

One of the most promising ways to observe the Universe is by detecting the 21cm emission from cosmic neutral hydrogen (HI) through radio-telescopes. Those observations can shed light on fundamental astrophysical questions only if accurate theoretical predictions are available. In order to maximize the scientific return of these surveys, those predictions need to include different observables and be precise on non-linear scales. Currently, one of the best ways to achieve this is via cosmological hydrodynamic simulations; however, the computational cost of these simulations is high -- tens of millions of CPU hours. In this work, we use Wasserstein Generative Adversarial Networks (WGANs) to generate new high-resolution ($35~h^{-1}{\rm kpc}$) 3D realizations of cosmic HI at $z=5$. We do so by sampling from a 100-dimension manifold, learned by the generator, that characterizes the fully non-linear abundance and clustering of cosmic HI from the state-of-the-art simulation IllustrisTNG. We show that different statistical properties of the produced samples -- 1D PDF, power spectrum, bispectrum, and void size function -- match very well those of IllustrisTNG, and outperform state-of-the-art models such as Halo Occupation Distributions (HODs). Our WGAN samples reproduce the abundance of HI across 9 orders of magnitude, from the Ly$\alpha$ forest to Damped Lyman Absorbers. WGAN can produce new samples orders of magnitude faster than hydrodynamic simulations.

Cosmological surveys aim at answering fundamental questions about our Universe, including the nature of dark matter or the reason of unexpected accelerated expansion of the Universe. In order to answer these questions, two important ingredients are needed: 1) data from observations and 2) a theoretical model that allows fast comparison between observation and theory. Most of the cosmological surveys observe galaxies, which are very difficult to model theoretically due to the complicated physics involved in their formation and evolution; modeling realistic galaxies over cosmological volumes requires running computationally expensive hydrodynamic simulations that can cost millions of CPU hours. In this paper, we propose to use deep learning to establish a mapping between the 3D galaxy distribution in hydrodynamic simulations and its underlying dark matter distribution. One of the major challenges in this pursuit is the very high sparsity in the predicted galaxy distribution. To this end, we develop a two-phase convolutional neural network architecture to generate fast galaxy catalogues, and compare our results against a standard cosmological technique. We find that our proposed approach either outperforms or is competitive with traditional cosmological techniques. Compared to the common methods used in cosmology, our approach also provides a nice trade-off between time-consumption (comparable to fastest benchmark in the literature) and the quality and accuracy of the predicted simulation. In combination with current and upcoming data from cosmological observations, our method has the potential to answer fundamental questions about our Universe with the highest accuracy.

Cosmic voids, the less dense patches of the Universe, are promising laboratories to extract cosmological information. Thanks to their unique low density character, voids are extremely sensitive to diffuse components such as neutrinos and dark energy, and represent ideal environments to study modifications of gravity, where the effects of such modifications are expected to be more prominent. Robust void-related observables, including for example redshift-space distortions (RSD) and weak lensing around voids, are a promising way to chase and test new physics. Cosmological analysis of the large-scale structure of the Universe predominantly relies on the high density regions. Current and upcoming surveys are designed to optimize the extraction of cosmological information from these zones, but leave voids under-exploited. A dense, large area spectroscopic survey with imaging capabilities is ideal to exploit the power of voids fully. Besides helping illuminate the nature of dark energy, modified gravity, and neutrinos, this survey will give access to a detailed map of under-dense regions, providing an unprecedented opportunity to observe and study a so far under-explored galaxy population.

Recent advances in cosmic observations have brought us to the verge of discovery of the absolute scale of neutrino masses. Nonzero neutrino masses are known evidence of new physics beyond the Standard Model. Our understanding of the clustering of matter in the presence of massive neutrinos has significantly improved over the past decade, yielding cosmological constraints that are tighter than any laboratory experiment, and which will improve significantly over the next decade, resulting in a guaranteed detection of the absolute neutrino mass scale.

The large-scale structure of the Universe should soon be measured at high redshift during the Epoch of Reionization (EoR) through line-intensity mapping. A number of ongoing and planned surveys are using the 21 cm line to trace neutral hydrogen fluctuations in the intergalactic medium (IGM) during the EoR. These may be fruitfully combined with separate efforts to measure large-scale emission fluctuations from galactic lines such as [CII], CO, H-$\alpha$, and Ly-$\alpha$ during the same epoch. The large scale power spectrum of each line encodes important information about reionization, with the 21 cm power spectrum providing a relatively direct tracer of the ionization history. Here we show that the large scale 21 cm power spectrum can be extracted using only cross-power spectra between the 21 cm fluctuations and each of two separate line-intensity mapping data cubes. This technique is more robust to residual foregrounds than the usual 21 cm auto-power spectrum measurements and so can help in verifying auto-spectrum detections. We characterize the accuracy of this method using numerical simulations and find that the large-scale 21 cm power spectrum can be inferred to an accuracy of within 5% for most of the EoR, reaching 0.6% accuracy on a scale of $k\sim0.1\,\text{Mpc}^{-1}$ at $\left< x_i \right> = 0.36$ ($z = 8.34$ in our model). An extension from two to $N$ additional lines would provide $N(N-1)/2$ cross-checks on the large-scale 21 cm power spectrum. This work strongly motivates redundant line-intensity mapping surveys probing the same cosmological volumes.

Using $N$-body simulations with massive neutrino density perturbations, we detect the scale-dependent linear halo bias with high significance. This is the first time that this effect is detected in simulations containing neutrino density perturbations on all scales, confirming the same finding from separate universe simulations. The scale dependence is the result of the additional scale in the system, i.e. the massive neutrino free-streaming length, and it persists even if the bias is defined with respect to the cold dark matter plus baryon (instead of total matter) power spectrum. The separate universe approach provides a good model for the scale-dependent linear bias, and the effect is approximately $0.25f_\nu$ and $0.43f_\nu$ for halos with bias of 1.7 and 3.5, respectively. While the size of the effect is small, it is ${\it not}$ insignificant in terms of $f_\nu$ and should therefore be included to accurately constrain neutrino mass from clustering statistics of biased tracers. More importantly, this feature is a distinct signature of free-streaming particles and cannot be mimicked by other components of the standard cosmological model.

Baryonic feedback can significantly modify the spatial distribution of matter on small scales and create a bulk relative velocity between the dominant cold dark matter and the hot gas. We study the consequences of such bulk motions using two high resolution hydrodynamic simulations, one with no feedback and one with very strong feedback. We find that relative velocities of order $100\ \kms$ are produced in the strong feedback simulation whereas it is much smaller when there is no feedback. Such relative motions induce dipole distortions to the gas, which we quantify by computing the dipole correlation function. We find halo coordinates and velocities are systematically changed in the direction of the relative velocity. Finally, we discuss potential to observe the relative velocity via large scale structure, Sunyaev-Zel'dovich and line emission measurements. Given the nonlinear nature of this effect, it should next be studied in simulations with different feedback implementations/strengths to determine the available model space.

We test a method to reduce unwanted sample variance when predicting Lyman-$\alpha$ (ly$\alpha$) forest power spectra from cosmological hydrodynamical simulations. Sample variance arises due to sparse sampling of modes on large scales and propagates to small scales through non-linear gravitational evolution. To tackle this, we generate initial conditions in which the density perturbation amplitudes are {\it fixed} to the ensemble average power spectrum -- and are generated in {\it pairs} with exactly opposite phases. We run $50$ such simulations ($25$ pairs) and compare their performance against $50$ standard simulations by measuring the ly$\alpha$ 1D and 3D power spectra at redshifts $z=2$, 3, and 4. Both ensembles use periodic boxes of $40$ Mpc/h containing $512^3$ particles each of dark matter and gas. As a typical example of improvement, for wavenumbers $k=0.25$ h/Mpc at $z=3$, we find estimates of the 1D and 3D power spectra converge $34$ and $12$ times faster in a paired-fixed ensemble compared with a standard ensemble. We conclude that, by reducing the computational time required to achieve fixed accuracy on predicted power spectra, the method frees up resources for exploration of varying thermal and cosmological parameters -- ultimately allowing the improved precision and accuracy of statistical inference.

We present a detailed overview of the cosmological surveys that will be carried out with Phase 1 of the Square Kilometre Array (SKA1), and the science that they will enable. We highlight three main surveys: a medium-deep continuum weak lensing and low-redshift spectroscopic HI galaxy survey over 5,000 sqdeg; a wide and deep continuum galaxy and HI intensity mapping survey over 20,000 sqdeg from z = 0.35 - 3; and a deep, high-redshift HI intensity mapping survey over 100 sqdeg from z = 3 - 6. Taken together, these surveys will achieve an array of important scientific goals: measuring the equation of state of dark energy out to z ~ 3 with percent-level precision measurements of the cosmic expansion rate; constraining possible deviations from General Relativity on cosmological scales by measuring the growth rate of structure through multiple independent methods; mapping the structure of the Universe on the largest accessible scales, thus constraining fundamental properties such as isotropy, homogeneity, and non-Gaussianity; and measuring the HI density and bias out to z = 6. These surveys will also provide highly complementary clustering and weak lensing measurements that have independent systematic uncertainties to those of optical surveys like LSST and Euclid, leading to a multitude of synergies that can improve constraints significantly beyond what optical or radio surveys can achieve on their own. This document, the 2018 Red Book, provides reference technical specifications, cosmological parameter forecasts, and an overview of relevant systematic effects for the three key surveys, and will be regularly updated by the Cosmology Science Working Group in the run up to start of operations and the Key Science Programme of SKA1.

Large-scale cosmological simulations of galaxy formation currently do not resolve the densities at which molecular hydrogen forms, implying that the atomic-to-molecular transition must be modeled either on the fly or in postprocessing. We present an improved postprocessing framework to estimate the abundance of atomic and molecular hydrogen and apply it to the IllustrisTNG simulations. We compare five different models for the atomic-to-molecular transition, including empirical, simulation-based, and theoretical prescriptions. Most of these models rely on the surface density of neutral hydrogen and the ultraviolet (UV) flux in the Lyman-Werner band as input parameters. Computing these quantities on the kiloparsec scales resolved by the simulations emerges as the main challenge. We show that the commonly used Jeans length approximation to the column density of a system can be biased and exhibits large cell-to-cell scatter. Instead, we propose to compute all surface quantities in face-on projections and perform the modeling in two dimensions. In general, the two methods agree on average, but their predictions diverge for individual galaxies and for models based on the observed midplane pressure of galaxies. We model the UV radiation from young stars by assuming a constant escape fraction and optically thin propagation throughout the galaxy. With these improvements, we find that the five models for the atomic-to-molecular transition roughly agree on average but that the details of the modeling matter for individual galaxies and the spatial distribution of molecular hydrogen. We emphasize that the estimated molecular fractions are approximate due to the significant systematic uncertainties.

Intensity mapping surveys will provide access to a coarse view of the cosmic large-scale structure in unprecedented large volumes at high redshifts. Given the large fractions of the sky that can be efficiently scanned using emission from cosmic neutral hydrogen (HI), intensity mapping is ideally suited to probe a wide range of density environments and hence to constrain cosmology and fundamental physics. To efficiently extract information from 21cm intensities beyond average, one needs non-Gaussian statistics that capture large deviations from mean HI density. Counts-in-cells statistics are ideally suited for this purpose, as the statistics of matter densities in spheres can be predicted accurately on scales where their variance is below unity. We use a large state-of-the-art magneto-hydrodynamic simulation from the IllustrisTNG project to determine the relation between neutral hydrogen and matter densities in cells. We demonstrate how our theoretical knowledge about the matter PDF for a given cosmology can be used to extract a parametrisation-independent HI bias function from a measured neutral hydrogen PDF. When combining the predicted matter PDFs with a simple bias fit to the simulation, we obtain a prediction for neutral hydrogen PDFs at a few percent accuracy at scale R=5 Mpc/h from redshift z=5 to z=1. Furthermore, we find a density-dependent HI clustering signal that is consistent with theoretical expectations and could allow for joint constraints of HI bias and the amplitude of matter fluctuations or the growth of structure.

The initial conditions of cosmological simulations are commonly drawn from a Gaussian ensemble. The limited number of modes inside a simulation volume gives rise to statistical fluctuations known as \textit{sample variance}, limiting the accuracy of simulation predictions. Fixed fields offer an alternative initialization strategy; they have the same power spectrum as standard Gaussian fields but without intrinsic amplitude scatter at linear order. Paired fixed fields consists of two fixed fields with opposite phases that cancel phase correlations which otherwise induce second-order scatter in the non-linear power spectrum. We study the statistical properties of those fields for 19 different quantities at different redshifts through a large set of 600 N-body and 506 state-of-the-art magneto-hydrodynamic simulations covering a wide range of scales, mass and spatial resolutions. We find that paired fixed simulations do not introduce a bias on any of the examined quantities. We quantify the statistical improvement brought by these simulations, over standard ones, on different power spectra such as matter, halos, CDM, gas, stars, black-holes and magnetic fields, finding that they can reduce their variance by factors as large as $10^6$. We quantify the improvement achieved by fixing and by pairing, showing that sample variance in some quantities can be highly suppressed by pairing after fixing. Paired fixed simulations do not change the scatter in quantities such as the probability distribution function of matter density, or the halo, void or stellar mass functions. We argue that procedures aiming at reducing the sample variance of those quantities are unlikely to work. Our results show that paired fixed simulations do not affect either mean relations or scatter of galaxy properties, and suggest that the information embedded in 1-pt statistics is highly complementary to that in clustering.

The key to understand the nature of dark energy relies in our ability to probe the distant Universe. In this framework, the recent detection of the kinematic Sunyaev-Zel'dovich (kSZ) effect signature in the cosmic microwave background obtained with the South Pole Telescope (SPT) is extremely useful since this observable is sensitive to the high-redshift diffuse plasma. We analyse a set of cosmological hydrodynamical simulation with 4 different realisations of a Hu & Sawicki $f(R)$ gravity model, parametrised by the values of $\overline{f}_{\rm R,0}=(0,-10^{-6},-10^{-5},-10^{-4})$, to compute the properties of the kSZ effect due to the ionized Universe and how they depend on $\overline{f}_{\rm R,0}$ and on the redshift of reionization, $z_{\rm re}$. In the standard General Relativity limit ($\overline{f}_{\rm R,0}$=0) we obtain an amplitude of the kSZ power spectrum of $\mathcal{D}^{\rm kSZ}_{3000}=4.1\,$$\mu$K$^2$ ($z_{\rm re}$=8.8), close to the $+1\sigma$ limit of the $\mathcal{D}^{\rm kSZ}_{3000}=(2.9\pm1.3)\,$$\mu$K$^2$ measurement by SPT. This corresponds to an upper limit on the kSZ contribute from patchy reionization of $\mathcal{D}^{\rm kSZ,patchy}_{3000}<0.9\,$$\mu$K$^2$ (95 per cent confidence level). Modified gravity boosts the kSZ signal by about 3, 12 and 50 per cent for $\overline{f}_{\rm R,0}=(-10^{-6},-10^{-5},-10^{-4})$, respectively, with almost no dependence on the angular scale. This means that with modified gravity the limits on patchy reionization shrink significantly: for $\overline{f}_{\rm R,0}=-10^{-5}$ we obtain $\mathcal{D}^{\rm kSZ,patchy}_{3000}<0.4\,$$\mu$K$^2$. Finally, we provide an analytical formula for the scaling of the kSZ power spectrum with $z_{\rm re}$ and $\overline{f}_{\rm R,0}$ at different multipoles: at $\ell=3000$ we obtain $\mathcal{D}^{\rm kSZ}_{3000}\propto z_{\rm re}^{0.24}\left(1+\sqrt{\left|\overline{f}_{\rm R,0}\right|}\right)^{41}$.

We investigate the possibility of performing cosmological studies in the redshift range $2.5<z<5$ through suitable extensions of existing and upcoming radio-telescopes like CHIME, HIRAX and FAST. We use the Fisher matrix technique to forecast the bounds that those instruments can place on the growth rate, the BAO distance scale parameters, the sum of the neutrino masses and the number of relativistic degrees of freedom at decoupling, $N_{\rm eff}$. We point out that quantities that depend on the amplitude of the 21cm power spectrum, like $f\sigma_8$, are completely degenerate with $\Omega_{\rm HI}$ and $b_{\rm HI}$, and propose several strategies to independently constraint them through cross-correlations with other probes. Assuming $5\%$ priors on $\Omega_{\rm HI}$ and $b_{\rm HI}$, $k_{\rm max}=0.2~h{\rm Mpc}^{-1}$ and the primary beam wedge, we find that a HIRAX extension can constrain, within bins of $\Delta z=0.1$: 1) the value of $f\sigma_8$ at $\simeq4\%$, 2) the value of $D_A$ and $H$ at $\simeq1\%$. In combination with data from Euclid-like galaxy surveys and CMB S4, the sum of the neutrino masses can be constrained with an error equal to $23$ meV ($1\sigma$), while $N_{\rm eff}$ can be constrained within 0.02 ($1\sigma$). We derive similar constraints for the extensions of the other instruments. We study in detail the dependence of our results on the instrument, amplitude of the HI bias, the foreground wedge coverage, the nonlinear scale used in the analysis, uncertainties in the theoretical modeling and the priors on $b_{\rm HI}$ and $\Omega_{\rm HI}$. We conclude that 21cm intensity mapping surveys operating in this redshift range can provide extremely competitive constraints on key cosmological parameters.

We combine information from the clustering of HI galaxies in the 100% data release of the Arecibo Legacy Fast ALFA survey (ALFALFA), and from the HI content of optically-selected galaxy groups found in the Sloan Digital Sky Survey (SDSS) to constrain the relation between halo mass $M_h$ and its average total HI mass content $M_{\rm HI}$. We model the abundance and clustering of neutral hydrogen through a halo-model-based approach, parametrizing the $M_{\rm HI}(M_h)$ relation as a power law with an exponential mass cutoff. To break the degeneracy between the amplitude and low-mass cutoff of the $M_{\rm HI}(M_h)$ relation, we also include a recent measurement of the cosmic HI abundance from the $\alpha$.100 sample. We find that all datasets are consistent with a power-law index $\alpha=0.44\pm 0.08$ and a cutoff halo mass $\log_{10}M_{\rm min}/(h^{-1}M_\odot)=11.27^{+0.24}_{-0.30}$. We compare these results with predictions from state-of-the-art magneto-hydrodynamical simulations, and find both to be in good qualitative agreement, although the data favours a significantly larger cutoff mass that is consistent with the higher cosmic HI abundance found in simulations. Both data and simulations seem to predict a similar value for the HI bias ($b_{\rm HI}=0.875\pm0.022$) and shot-noise power ($P_{\rm SN}=92^{+20}_{-18}\,[h^{-1}{\rm Mpc}]^3$) at redshift $z=0$.

[Abridged] We study the abundance and clustering properties of HI at redshifts $z\leqslant5$ using TNG100, a large state-of-the-art magneto-hydrodynamic simulation of a 75 Mpc/h box size. We show that most of the HI lies within dark matter halos and quantify the average HI mass hosted by halos of mass M at redshift z. We find that only halos with circular velocities larger than $\simeq$ 30 km/s contain HI. While the density profiles of HI exhibit a large halo-to-halo scatter, the mean profiles are universal across mass and redshift. The HI in low-mass halos is mostly located in the central galaxy, while in massive halos is concentrated in the satellites. We show that the HI and matter density probability distribution functions differ significantly. Our results point out that for small halos the HI bulk velocity goes in the same direction and has the same magnitude as the halo peculiar velocity, while in large halos differences show up. We find that halo HI velocity dispersion follows a power-law with halo mass. We find a complicated HI bias, with HI becoming non-linear already at $k=0.3$ h/Mpc at $z\gtrsim3$. Our simulation reproduces the DLAs bias value from observations. We find that the clustering of HI can be accurately reproduced by perturbative methods. We identify a new secondary bias, by showing that the clustering of halos depends not only on mass but also on HI content. We compute the amplitude of the HI shot-noise and find that it is small at all redshifts. We study the clustering of HI in redshift-space, and show that linear theory can explain the ratio between the monopoles in redshift- and real-space down to small scales at high redshift. We find that the amplitude of the Fingers-of-God effect is larger for HI than for matter. We point out that accurate 21 cm maps can be created from N-body or approximate simulations rather than full hydrodynamic simulations.

We develop a new method to constraint primordial non-Gaussianities of the local kind using unclustered tracers of the Large Scale Structure. We show that in the limit of low noise, zero bias tracers yield large improvement over standard methods, mostly due to vanishing sampling variance. We propose a simple technique to construct such a tracer, using environmental information obtained from the original sample, and validate our method with N-body simulations. Our results indicate that $\sigma_{f_{\mathrm{NL}}^{\mathrm{loc}}}\simeq1$ can be reached using only information on a single tracer of sufficiently high number density.

We present a new method for generating initial conditions for numerical cosmological simulations in which massive neutrinos are treated as an extra set of N-body (collisionless) particles. It allows us to accurately follow the density field for both Cold Dark Matter (CDM) and neutrinos at both high and low redshifts. At high redshifts, the new method is able to reduce the shot noise in the neutrino power spectrum by a factor of more than $10^7$ compared to previous methods, where the power spectrum was dominated by shot noise at all scales. We find that our new approach also helps to reduce the noise on the total matter power spectrum on large scales, whereas on small scales the results agree with previous simulations. Our new method also allows for a systematic study of clustering of the low velocity tail of the distribution function of neutrinos. This method also allows for the study of the evolution of the overall velocity distribution as a function of the environment determined by the CDM field.

Following the first two annual intensity mapping workshops at Stanford in March 2016 and Johns Hopkins in June 2017, we report on the recent advances in theory, instrumentation and observation that were presented in these meetings and some of the opportunities and challenges that were identified looking forward. With preliminary detections of CO, [CII], Lya and low-redshift 21cm, and a host of experiments set to go online in the next few years, the field is rapidly progressing on all fronts, with great anticipation for a flood of new exciting results. This current snapshot provides an efficient reference for experts in related fields and a useful resource for nonspecialists. We begin by introducing the concept of line-intensity mapping and then discuss the broad array of science goals that will be enabled, ranging from the history of star formation, reionization and galaxy evolution to measuring baryon acoustic oscillations at high redshift and constraining theories of dark matter, modified gravity and dark energy. After reviewing the first detections reported to date, we survey the experimental landscape, presenting the parameters and capabilities of relevant instruments such as COMAP, mmIMe, AIM-CO, CCAT-p, TIME, CONCERTO, CHIME, HIRAX, HERA, STARFIRE, MeerKAT/SKA and SPHEREx. Finally, we describe recent theoretical advances: different approaches to modeling line luminosity functions, several techniques to separate the desired signal from foregrounds, statistical methods to analyze the data, and frameworks to generate realistic intensity map simulations.

Gravitational non-linear evolution induces a shift in the position of the baryon acoustic oscillations (BAO) peak together with a damping and broadening of its shape that bias and degrades the accuracy with which the position of the peak can be determined. BAO reconstruction is a technique developed to undo part of the effect of non-linearities. We present and analyse a reconstruction method that consists of displacing pixels instead of galaxies and whose implementation is easier than the standard reconstruction method. We show that this method is equivalent to the standard reconstruction technique in the limit where the number of pixels becomes very large. This method is particularly useful in surveys where individual galaxies are not resolved, as in 21cm intensity mapping observations. We validate this method by reconstructing mock pixelated maps, that we build from the distribution of matter and halos in real- and redshift-space, from a large set of numerical simulations. We find that this method is able to decrease the uncertainty in the BAO peak position by 30-50% over the typical angular resolution scales of 21 cm intensity mapping experiments.

(abridged) We investigate the signatures left by the cosmic neutrino background on the clustering of matter, CDM+baryons and halos in redshift-space using a set of more than 1000 N-body and hydrodynamical simulations with massless and massive neutrinos. We find that the effect neutrinos induce on the clustering of CDM+baryons in redshift-space on small scales is almost entirely due to the change in $\sigma_8$. Neutrinos imprint a characteristic signature in the quadrupole of the matter (CDM+baryons+neutrinos) field on small scales, that can be used to disentangle the effect of $\sigma_8$ and $M_\nu$. We show that the effect of neutrinos on the clustering of halos is very different, on all scales, to the one induced by $\sigma_8$. We find that the effects of neutrinos of the growth rate of CDM+baryons ranges from $\sim0.3\%$ to $2\%$ on scales $k\in[0.01, 0.5]~h{\rm Mpc}^{-1}$ for neutrinos with masses $M_\nu \leqslant 0.15$ eV. We compute the bias between the momentum of halos and the momentum of CDM+baryon and find it to be 1 on large scales for all models with massless and massive neutrinos considered. This point towards a velocity bias between halos and total matter on large scales that it is important to account for in order to extract unbiased neutrino information from velocity/momentum surveys such as kSZ observations. We show that baryonic effects can affect the clustering of matter and CDM+baryons in redshift-space by up to a few percent down to $k=0.5~h{\rm Mpc}^{-1}$. We find that hydrodynamics and astrophysical processes, as implemented in our simulations, only distort the relative effect that neutrinos induce on the anisotropic clustering of matter, CDM+baryons and halos in redshift-space by less than $1\%$. Thus, the effect of neutrinos in the fully non-linear regime can be written as a transfer function with very weak dependence on astrophysics.

The relation between the halo field and the matter fluctuations (halo bias), in the presence of massive neutrinos depends on the total neutrino mass, massive neutrinos introduce an additional scale-dependence of the bias which is usually neglected in cosmological analyses. We investigate the magnitude of the systematic effect on interesting cosmological parameters induced by neglecting this scale dependence, finding that while it is not a problem for current surveys, it is non-negligible for future, denser or deeper ones depending on the neutrino mass, the maximum scale used for the analyses and the details of the nuisance parameters considered. However there is a simple recipe to account for the bulk of the effect as to make it fully negligible, which we illustrate and advocate should be included in analysis of forthcoming large-scale structure surveys.

We investigate the cross-correlation signal between 21cm intensity mapping maps and the Lyman-alpha forest in the fully non-linear regime using state-of-the-art hydrodynamic simulations. The cross-correlation signal between these fields can provide a coherent and comprehensive picture of the neutral hydrogen (HI) content of our Universe in the post-reionization era, probing both its mass content and volume distribution. We compute the auto-power spectra of both fields together with their cross-power spectrum at z = 2.4 and find that on large scales the fields are completely anti-correlated. This anti-correlation arises because regions with high (low) 21cm emission, such as those with a large (low) concentration of damped Lyman-alpha systems, will show up as regions with low (high) transmitted flux. We find that on scales smaller than k = 0.2 h/Mpc the cross-correlation coefficient departs from -1, at a scale where non-linearities show up. We use the anisotropy of the power spectra in redshift-space to determine the values of the bias and of the redshift-space distortion parameters of both fields; we find that the errors on the value of these parameters could decrease by 30% when adding data from the cross-power spectrum in a conservative analysis. Our results point out that linear theory is capable of reproducing the shape and amplitude of the cross-power up to rather non-linear scales. Finally, we find that the 21cm-Lya cross-power spectrum can be detected by combining data from a BOSS-like survey together with 21cm intensity mapping observations by SKA1-MID with a S/N ratio higher than 3 in the range 0.06< k <1 h/Mpc. We emphasize that while the shape and amplitude of the 21cm auto-power spectrum can be severely affected by residual foreground contamination, cross-power spectra will be less sensitive to that and therefore can be used to identify systematics in the 21cm maps.

The study of neutrinos in astrophysics requires the combination of different observational probes. The temperature anisotropies of the cosmic microwave background induced via the kinematic Sunyaev-Zel'dovich (kSZ) effect may provide interesting information since they are expected to receive significant contribution from high-redshift plasma. We present a set of cosmological hydrodynamical simulations that include a treatment of the neutrino component considering four different sum of neutrino masses: $\Sigma m_\nu=(0,0.15,0.3,0.6)$ eV. Using their outputs, we modelled the kSZ effect due to the large-scale structure after the reionization by producing mock maps, then computed the kSZ power spectrum and studied how it depends on $z_{\rm re}$ and $\Sigma m_\nu$. We also run a set of four simulations to study and correct possible systematics due to resolution, finite box size and astrophysics. With massless neutrinos we obtain $\mathcal{D}^{\rm kSZ}_{3000}=4.0$ $\mu {\rm K}^2$ ($z_{\rm re}$=8.8), enough to account for all of the kSZ signal of $\mathcal{D}^{\rm kSZ}_{3000}=(2.9\pm1.3)$ $\mu {\rm K}^2$ measured with the South Pole Telescope. This translates into an upper limit on the kSZ effect due to patchy reionization of $\mathcal{D}^{\rm kSZ,patchy}_{3000}<1.0$ $\mu {\rm K}^2$ (95 per cent confidence level). Massive neutrinos induce a damping of kSZ effect power of about 8, 12 and 40 per cent for $\Sigma m_\nu=(0.15,0.3,0.6)$ eV, respectively. We study the dependence of the kSZ signal with $z_{\rm re}$ and the neutrino mass fraction, $f_\nu$, and obtain $\mathcal{D}^{\rm kSZ}_{3000}\propto z_{\rm re}^{0.26}(1-f_\nu)^{14.3}$. Interestingly, the scaling with $f_\nu$ is significantly shallower with respect to the equivalent thermal SZ effect, and may be used to break the degeneracy with other cosmological parameters.

The set-up of the initial conditions in cosmological N-body simulations is usually implemented by rescaling the desired low-redshift linear power spectrum to the required starting redshift consistently with the Newtonian evolution of the simulation. The implementation of this practical solution requires more care in the context of massive neutrino cosmologies, mainly because of the non-trivial scale-dependence of the linear growth that characterises these models. In this work we consider a simple two-fluid, Newtonian approximation for cold dark matter and massive neutrinos perturbations that can reproduce the cold matter linear evolution predicted by Boltzmann codes such as CAMB or CLASS with a 0.1% accuracy or below for all redshift relevant to nonlinear structure formation. We use this description, in the first place, to quantify the systematic errors induced by several approximations often assumed in numerical simulations, including the typical set-up of the initial conditions for massive neutrino cosmologies adopted in previous works. We then take advantage of the flexibility of this approach to rescale the late-time linear power spectra to the simulation initial redshift, in order to be as consistent as possible with the dynamics of the N-body code and the approximations it assumes. We implement our method in a public code providing the initial displacements and velocities for cold dark matter and neutrino particles that will allow accurate, i.e. one-percent level, numerical simulations for this cosmological scenario.

We present high signal-to-noise galaxy-galaxy lensing measurements of the BOSS CMASS sample using 250 square degrees of weak lensing data from CFHTLenS and CS82. We compare this signal with predictions from mock catalogs trained to match observables including the stellar mass function and the projected and two dimensional clustering of CMASS. We show that the clustering of CMASS, together with standard models of the galaxy-halo connection, robustly predicts a lensing signal that is 20-40% larger than observed. Detailed tests show that our results are robust to a variety of systematic effects. Lowering the value of $S_{\rm 8}=\sigma_{\rm 8} \sqrt{\Omega_{\rm m}/0.3}$ compared to Planck2015 reconciles the lensing with clustering. However, given the scale of our measurement ($r<10$ $h^{-1}$ Mpc), other effects may also be at play and need to be taken into consideration. We explore the impact of baryon physics, assembly bias, massive neutrinos, and modifications to general relativity on $\Delta\Sigma$ and show that several of these effects may be non-negligible given the precision of our measurement. Disentangling cosmological effects from the details of the galaxy-halo connection, the effects of baryons, and massive neutrinos, is the next challenge facing joint lensing and clustering analyses. This is especially true in the context of large galaxy samples from Baryon Acoustic Oscillation surveys with precise measurements but complex selection functions.

We quantify the error in the results of mixed baryon--dark-matter hydrodynamic simulations, stemming from outdated approximations for the generation of initial conditions. The error at redshift 0 in contemporary large simulations, is of the order of few to ten percent in the power spectra of baryons and dark matter, and their combined total-matter power spectrum. After describing how to properly assign initial displacements and peculiar velocities to multiple species, we review several approximations: (1) {using the total-matter power spectrum to compute displacements and peculiar velocities of both fluids}, (2) scaling the linear redshift-zero power spectrum back to the initial power spectrum using the Newtonian growth factor ignoring homogeneous radiation, (3) using longitudinal-gauge velocities with synchronous-gauge densities, and (4) ignoring the phase-difference in the Fourier modes for the offset baryon grid, relative to the dark-matter grid. Three of these approximations do not take into account that dark matter and baryons experience a scale-dependent growth after photon decoupling, which results in directions of velocity which are not the same as their direction of displacement. We compare the outcome of hydrodynamic simulations with these four approximations to our reference simulation, all setup with the same random seed and simulated using Gadget-III.

We present a method that extends the capabilities of the PINpointing Orbit-Crossing Collapsed HIerarchical Objects (PINOCCHIO) code, allowing it to generate accurate dark matter halo mock catalogues in cosmological models where the linear growth factor and the growth rate depend on scale. Such cosmologies comprise, among others, models with massive neutrinos and some classes of modified gravity theories. We validate the code by comparing the halo properties from PINOCCHIO against N-body simulations, focusing on cosmologies with massive neutrinos: $\nu\Lambda$CDM. We analyse the halo mass function, halo two-point correlation function, halo power spectrum and the moments of the halo density field, showing that PINOCCHIO reproduces the results from simulations with the same level of precision as the original code ($\sim5-10\%$). We demonstrate that the abundance of halos in cosmologies with massless and massive neutrinos from PINOCCHIO matches very well the outcome of simulations, and point out that PINOCCHIO can reproduce the $\Omega_\nu-\sigma_8$ degeneracy that affects the halo mass function. We show that the clustering properties of the halos from PINOCCHIO matches accurately those from simulations both in real and redshift-space, in the latter case up to $k=0.3~h~{\rm Mpc}^{-1}$. We finally point out that the first moments of the halo density field from simulations are precisely reproduced by PINOCCHIO. We emphasize that the computational time required by PINOCCHIO to generate mock halo catalogues is orders of magnitude lower than the one needed for N-body simulations. This makes this tool ideal for applications like covariance matrix studies within the standard $\Lambda$CDM model but also in cosmologies with massive neutrinos or some modified gravity theories.

The spatial distribution of neutral hydrogen (HI) in the Universe contains a wealth of cosmological information. The 21 cm emission line can be used to map the HI up to very high redshift and therefore reveal us something about the evolution of the large scale structures in the Universe. However little is known about the abundance and clustering properties of the HI over cosmic time. Motivated by this, we build an analytic framework where the relevant parameters that govern how the HI is distributed among dark matter halos can be fixed using observations. At the same time we provide tools to study the column density distribution function of the HI absorbers together with their clustering properties. Our formalism is the first one able to account for all observations at a single redshift, $z = 2.3$. The linear bias of the HI and the mean number density of HI sources, two main ingredients in the calculation of the signal-to-noise ratio of a cosmological survey, are then discussed in detail, also extrapolating the results to low and high redshift. We find that HI bias is relatively higher than the value reported in similar studies, but the shot noise level is always sub dominant, making the HI Power Spectrum always a high signal-to-noise measurements up to $z\simeq5$ in the limit of no instrumental noise and foreground contamination.

We quantitatively investigate the possibility of detecting baryonic acoustic oscillations (BAO) using single-dish 21cm intensity mapping observations in the post-reionization era. We show that the telescope beam smears out the isotropic BAO signature and, in the case of the Square Kilometer Array (SKA) instrument, makes it undetectable at redshifts $z\gtrsim1$. We however demonstrate that the BAO peak can still be detected in the radial 21cm power spectrum and describe a method to make this type of measurements. By means of numerical simulations, containing the 21cm cosmological signal as well as the most relevant Galactic and extra-Galactic foregrounds and basic instrumental effect, we quantify the precision with which the radial BAO scale can be measured in the 21cm power spectrum. We systematically investigate the signal-to-noise and the precision of the recovered BAO signal as a function of cosmic variance, instrumental noise, angular resolution and foreground contamination. We find that the expected noise levels of SKA would degrade the final BAO errors by $\sim5\%$ with respect to the cosmic-variance limited case at low redshifts, but that the effect grows up to $\sim65\%$ at $z\sim2-3$. Furthermore, we find that the radial BAO signature is robust against foreground systematics, and that the main effect is an increase of $\sim20\%$ in the final uncertainty on the standard ruler caused by the contribution of foreground residuals as well as the reduction in sky area needed to avoid high-foreground regions. We also find that it should be possible to detect the radial BAO signature with high significance in the full redshift range. We conclude that a 21cm experiment carried out by the SKA should be able to make direct measurements of the expansion rate $H(z)$ with competitive per-cent level precision on redshifts $z\lesssim2.5$.

We present for the first time the outcomes of a cosmological N-body simulation that simultaneously implements a Warm Dark Matter (WDM) particle candidate and a modified gravitational interaction in the form of $f(R)$ gravity, and compare its results with the individual effects of these two independent extensions of the standard $\Lambda $CDM scenario, and with the reference cosmology itself. We consider a rather extreme value of the WDM particle mass ($m_{\rm WDM}=0.4$ keV) and a single realisation of $f(R)$ gravity with $|\bar{f}_{R0}|=10^{-5}$, and we investigate the impact of these models and of their combination on a wide range of cosmological observables with the aim to identify possible observational degeneracies. In particular, we focus on the large-scale matter distribution, as well as on the statistical and structural properties of collapsed halos and cosmic voids. Differently from the case of combining $f(R)$ gravity with massive neutrinos -- previously investigated in Baldi et al. (2014) -- we find that most of the considered observables do not show any significant degeneracy due to the fact that WDM and $f(R)$ gravity are characterised by individual observational footprints with a very different functional dependence on cosmic scales and halo masses. In particular, this is the case for the nonlinear matter power spectrum in real space, for the halo and sub-halo mass functions, for the halo density profiles and for the concentration-mass relation. However, other observables -- like e.g. the halo bias -- do show some level of degeneracy between the two models, while a very strong degeneracy is observed for the nonlinear matter power spectrum in redshift space, for the density profiles of small cosmic voids -- with radius below $\approx 5$ Mpc$/h$ -- and for the voids abundance as a function of the void core density.

Despite its continued observational successes, there is a persistent (and growing) interest in extending cosmology beyond the standard model, $\Lambda$CDM. This is motivated by a range of apparently serious theoretical issues, involving such questions as the cosmological constant problem, the particle nature of dark matter, the validity of general relativity on large scales, the existence of anomalies in the CMB and on small scales, and the predictivity and testability of the inflationary paradigm. In this paper, we summarize the current status of $\Lambda$CDM as a physical theory, and review investigations into possible alternatives along a number of different lines, with a particular focus on highlighting the most promising directions. While the fundamental problems are proving reluctant to yield, the study of alternative cosmologies has led to considerable progress, with much more to come if hopes about forthcoming high-precision observations and new theoretical ideas are fulfilled.

We investigate the signatures left by massive neutrinos on the spatial distribution of neutral hydrogen (HI) in the post-reionization era by running hydrodynamic simulations that include massive neutrinos as additional collisionless particles. We find that halos in massive/massless neutrino cosmologies host a similar amount of neutral hydrogen, although for a fixed halo mass, on average, the HI mass increases with the sum of the neutrino masses. Our results show that HI is more strongly clustered in cosmologies with massive neutrinos, while its abundance, $\Omega_{\rm HI}(z)$, is lower. These effects arise mainly from the impact of massive neutrinos on cosmology: they suppress both the amplitude of the matter power spectrum on small scales and the abundance of dark matter halos. Modelling the HI distribution with hydrodynamic simulations at $z > 3$, and a simple analytic model at $z<3$, we use the Fisher matrix formalism to conservatively forecast the constraints that Phase 1 of the Square Kilometre Array (SKA) will place on the sum of neutrino masses, $M_\nu\equiv \Sigma m_{\nu}$. We find that with 10,000 hours of interferometric observations at $3 \lesssim z \lesssim 6$ from a deep and narrow survey with SKA1-LOW, the sum of the neutrino masses can be measured with an error $\sigma(M_\nu)\lesssim0.3$ eV (95% CL). Similar constraints can be obtained with a wide and deep SKA1-MID survey at $z \lesssim 3$, using the single-dish mode. By combining data from MID, LOW, and Planck, plus priors on cosmological parameters from a Stage IV spectroscopic galaxy survey, the sum of the neutrino masses can be determined with an error $\sigma(M_\nu)\simeq0.06$ eV (95% CL).

By means of zoom-in hydrodynamic simulations we quantify the amount of neutral hydrogen (HI) hosted by groups and clusters of galaxies. Our simulations, which are based on an improved formulation of smoothed particle hydrodynamics (SPH), include radiative cooling, star formation, metal enrichment and supernova feedback, and can be split in two different groups, depending on whether feedback from active galactic nuclei (AGN) is turned on or off. Simulations are analyzed to account for HI self-shielding and the presence of molecular hydrogen. We find that the mass in neutral hydrogen of dark matter halos monotonically increases with the halo mass and can be well described by a power-law of the form $M_{\rm HI}(M,z)\propto M^{3/4}$. Our results point out that AGN feedback reduces both the total halo mass and its HI mass, although it is more efficient in removing HI. We conclude that AGN feedback reduces the neutral hydrogen mass of a given halo by $\sim50\%$, with a weak dependence on halo mass and redshift. The spatial distribution of neutral hydrogen within halos is also affected by AGN feedback, whose effect is to decrease the fraction of HI that resides in the halo inner regions. By extrapolating our results to halos not resolved in our simulations we derive astrophysical implications from the measurements of $\Omega_{\rm HI}(z)$: halos with circular velocities larger than $\sim25~{\rm km/s}$ are needed to host HI in order to reproduce observations. We find that only the model with AGN feedback is capable of reproducing the value of $\Omega_{\rm HI}b_{\rm HI}$ derived from available 21cm intensity mapping observations.

We investigate the cross-correlation between the spatial distribution of Lyman Break Galaxies (LBGs) and the 21cm intensity mapping signal at $z\sim[3-5]$. At these redshifts, galactic feedback is supposed to only marginally affect the matter power spectrum, and the neutral hydrogen distribution is independently constrained by quasar spectra. Using a high resolution N-body simulation, populated with neutral hydrogen a posteriori, we forecast for the expected LBG-21cm cross-spectrum and its error for a 21cm field observed by the Square Kilometre Array (SKA1-LOW and SKA1-MID), combined with a spectroscopic LBG survey with the same volume. The cross power can be detected with a signal-to-noise ratio (SNR) up to ~10 times higher (and down to ~4 times smaller scales) than the 21cm auto-spectrum for this set-up, with the SNR depending only very weakly on redshift and the LBG population. We also show that while both the 21cm auto- and LBG-21cm cross-spectra can be reliably recovered after the cleaning of smooth-spectrum foreground contamination, only the cross-power is robust to problematic non-smooth foregrounds like polarized synchrotron emission.

Cosmic voids are a promising environment to characterize neutrino-induced effects on the large-scale distribution of matter in the universe. We perform a comprehensive numerical study of the statistical properties of voids, identified both in the matter and galaxy distributions, in massive and massless neutrino cosmologies. The matter density field is obtained by running several independent $N$-body simulations with cold dark matter and neutrino particles, while the galaxy catalogs are modeled by populating the dark matter halos in simulations via a halo occupation distribution (HOD) model to reproduce the clustering properties observed by the Sloan Digital Sky Survey (SDSS) II Data Release 7. We focus on the impact of massive neutrinos on the following void statistical properties: number density, ellipticities, two-point statistics, density and velocity profiles. Considering the matter density field, we find that voids in massive neutrino cosmologies are less evolved than those in the corresponding massless neutrinos case: there is a larger number of small voids and a smaller number of large ones, their profiles are less evacuated, and they present a lower wall at the edge. Moreover, the degeneracy between $\sigma_8$ and $\Omega_{\nu}$ is broken when looking at void properties. In terms of the galaxy density field, we find that differences among cosmologies are difficult to detect because of the small number of galaxy voids in the simulations. Differences are instead present when looking at the matter density and velocity profiles around these voids.

We study the impact of neutrino masses on the shape and height of the BAO peak of the matter correlation function, both in real and redshift space. In order to describe the nonlinear evolution of the BAO peak we run N-body simulations and compare them with simple analytic formulae. We show that the evolution with redshift of the correlation function and its dependence on the neutrino masses is well reproduced in a simplified version of the Zel'dovich approximation, in which the mode-coupling contribution to the power spectrum is neglected. While in linear theory the BAO peak decreases for increasing neutrino masses, the effect of nonlinear structure formation goes in the opposite direction, since the peak broadening by large scale flows is less effective. As a result of this combined effect, the peak decreases by $\sim 0.6 \%$ for $ \sum m_\nu = 0.15$ eV and increases by $\sim1.2 \%$ for $ \sum m_\nu = 0.3$ eV, with respect to a massless neutrino cosmology with equal value of the other cosmological parameters. We extend our analysis to redshift space and to halos, and confirm the agreement between simulations and the analytic formulae. We argue that all analytical approaches having the Zel'dovich propagator in their lowest order approximation should give comparable performances, irrespectively to their formulation in Lagrangian or in Eulerian space.

We investigate the impact that warm dark matter (WDM) has in terms of 21cm intensity mapping in the post-reionization Universe at z = 3 - 5. We perform hydrodynamic simulations for 5 different models: cold dark matter and WDM with 1,2,3,4 keV (thermal relic) mass and assign the neutral hydrogen a-posteriori using two different methods that both reproduce observations in terms of column density distribution function of neutral hydrogen systems. Contrary to naive expectations, the suppression of power present in the linear and non-linear matter power spectra, results in an increase of power in terms of neutral hydrogen and 21cm power spectra. This is due to the fact that there is a lack of small mass halos in WDM models with respect to cold dark matter: in order to distribute a total amount of neutral hydrogen within the two cosmological models, a larger quantity has to be placed in the most massive halos, that are more biased compared to the cold dark matter cosmology. We quantify this effect and address significance for the telescope SKA1-LOW, including a realistic noise modeling. The results indicate that we will be able to rule out a 4 keV WDM model with 5000 hours of observations at z > 3, with a statistical significance of > 3 sigma, while a smaller mass of 3 keV, comparable to present day constraints, can be ruled out at more than 2 sigma confidence level with 1000 hours of observations at z > 5.

We provide a quantitative analysis of the halo model in the context of massive neutrino cosmologies. We discuss all the ingredients necessary to model the non-linear matter and cold dark matter power spectra and compare with the results of N-body simulations that incorporate massive neutrinos. Our neutrino halo model is able to capture the non-linear behavior of matter clustering with a $\sim 20\%$ accuracy up to very non-linear scales of $k=10~h/$Mpc (which would be affected by baryon physics). The largest discrepancies arise in the range $k=0.5-1~h/$Mpc where the 1-halo and 2-halo terms are comparable and are present also in a massless neutrino cosmology. However, at scales $k<0.2~h/$Mpc our neutrino halo model agrees with the results of N-body simulations at the level of 8\% for total neutrino masses of $<0.3$ eV. We also model the neutrino non-linear density field as a sum of a linear and clustered component and predict the neutrino power spectrum and the cold dark matter-neutrino cross-power spectrum up to $k=1~h/$Mpc with $\sim$ 30\% accuracy. For masses below 0.15 eV the neutrino halo model captures the neutrino induced suppression, casted in terms of matter power ratios between massive and massless scenarios, with a 2\% agreement with the results of N-body/neutrino simulations. Finally, we provide a simple application of the halo model: the computation of the clustering of galaxies, in massless and massive neutrinos cosmologies, using a simple Halo Occupation Distribution scheme and our halo model extension.

We review the impact of massive neutrinos on cosmological observables at the linear order. By means of N-body simulations we investigate the signatures left by neutrinos on the fully non-linear regime. We present the effects induced by massive neutrinos on the matter power spectrum, the halo mass function and on the halo-matter bias in massive neutrino cosmologies. We also investigate the clustering of cosmic neutrinos within galaxy clusters.

HI intensity mapping (IM) is a novel technique capable of mapping the large-scale structure of the Universe in three dimensions and delivering exquisite constraints on cosmology, by using HI as a biased tracer of the dark matter density field. This is achieved by measuring the intensity of the redshifted 21cm line over the sky in a range of redshifts without the requirement to resolve individual galaxies. In this chapter, we investigate the potential of SKA1 to deliver HI intensity maps over a broad range of frequencies and a substantial fraction of the sky. By pinning down the baryon acoustic oscillation and redshift space distortion features in the matter power spectrum -- thus determining the expansion and growth history of the Universe -- these surveys can provide powerful tests of dark energy models and modifications to General Relativity. They can also be used to probe physics on extremely large scales, where precise measurements of spatial curvature and primordial non-Gaussianity can be used to test inflation; on small scales, by measuring the sum of neutrino masses; and at high redshifts where non-standard evolution models can be probed. We discuss the impact of foregrounds as well as various instrumental and survey design parameters on the achievable constraints. In particular we analyse the feasibility of using the SKA1 autocorrelations to probe the large-scale signal.

The constraints on neutrino masses led to the revision of their cosmological role, since the existence of a cosmological neutrino background is a clear prediction of the standard cosmological model. In this paper, we study the impact of such background on the spatial distribution of both Dark Matter (DM) and galaxies, by coupling $N$-body numerical simulations with semi-analytic models (SAMs) of galaxy formation. Cosmological simulations including massive neutrinos predict a slower evolution of DM perturbations with respect to the $\Lambda$CDM runs with the same initial conditions and a suppression on the matter power spectrum on small and intermediate scales, thus impacting on the predicted properties of galaxy populations. We explicitly show that most of these deviations are driven by the different $\sigma_8$ predicted for cosmologies including a massive neutrino background. We conclude that independent estimates of $\sigma_8$ are needed, in order to unambiguously characterise the effect of this background on the growth of structures. Galaxy properties alone are a weak tracer of deviations with respect to the $\Lambda$CDM run, but their combination with the overall matter distribution at all scales allows to disentangle between different cosmological models. Moreover, these deviations go on opposite direction with respect to competing models like modified gravity, thus weakening any detectable cosmological signal. Given the ubiquitous presence of a neutrino background, these effects have to be taken into account in future missions aimed at constraining the properties of the "Dark" components of the Universe.

Standard cosmological perturbation theory (SPT) for the Large Scale Structure (LSS) of the Universe fails at small scales (UV) due to strong nonlinearities and to multistreaming effects. In Pietroni et al. 2011 a new framework was proposed in which the large scales (IR) are treated perturbatively while the information on the UV, mainly small scale velocity dispersion, is obtained by nonlinear methods like N-body simulations. Here we develop this approach, showing that it is possible to reproduce the fully nonlinear power spectrum (PS) by combining a simple (and fast) 1-loop computation for the IR scales and the measurement of a single, dominant, correlator from N-body simulations for the UV ones. We measure this correlator for a suite of seven different cosmologies, and we show that its inclusion in our perturbation scheme reproduces the fully non-linear PS with percent level accuracy, for wave numbers up to $k\sim 0.4\, h~{\rm Mpc^{-1}}$ down to $z=0$. We then show that, once this correlator has been measured in a given cosmology, there is no need to run a new simulation for a different cosmology in the suite. Indeed, by rescaling this correlator by a proper function computable in SPT, the reconstruction procedure works also for the other cosmologies and for all redshifts, with comparable accuracy. Finally, we clarify the relation of this approach to the Effective Field Theory methods recently proposed in the LSS context.

We model the distribution of neutral hydrogen (HI) in the post-reionization era and investigate its detectability in 21 cm intensity mapping with the future SKA radio telescope. We rely on high resolution hydrodynamical N-body simulations. The HI is assigned a-posteriori to the gas particles following two different approaches: a halo-based method in which HI is assigned only to gas particles residing within dark matter halos; a particle-based method that assigns HI to all gas particles using a prescription based on the physical properties of the particles. The HI statistical properties are then compared to the observational properties of Damped Lyman-$\alpha$ Absorbers (DLAs) and of lower column density systems and reasonable good agreement is found for all the cases. Among the halo-based method, we further consider two different schemes that aim at reproducing the observed properties of DLAs by distributing HI inside halos: one of this results in a much higher bias for DLAs, in agreement with recent observations, which boosts the 21 cm power spectrum by a factor $\sim 4$ with respect to the other recipe. We compute the 21 cm power spectrum from the simulated HI distribution and calculate the expected signal for both SKA1-mid and SKA1-low configurations at $2.4 \leq z \leq 4$. We find that SKA will be able to detect the 21 cm power spectrum, in the non-linear regime, up to $k\sim 1\,h$/Mpc for SKA1-mid and $k\sim 5\,h$/Mpc for SKA1-low with 100 hours of observations. We also investigate the perspective of imaging the HI distribution. Our findings indicate that SKA1-low could detect the most massive HI peaks with a signal to noise ratio (SNR) higher than 5 for an observation time of about 1000 hours at $z=4$, for a synthesized beam width of $2'$. Detection at redshifts $z\geqslant2.4$ with SKA1-mid would instead require a much longer observation time to achieve a comparable SNR level.

We present VIDE, the Void IDentification and Examination toolkit, an open-source Python/C++ code for finding cosmic voids in galaxy redshift surveys and N-body simulations, characterizing their properties, and providing a platform for more detailed analysis. At its core, VIDE uses a substantially enhanced version of ZOBOV (Neyinck 2008) to calculate a Voronoi tessellation for estimating the density field and a performing a watershed transform to construct voids. Additionally, VIDE provides significant functionality for both pre- and post-processing: for example, vide can work with volume- or magnitude-limited galaxy samples with arbitrary survey geometries, or dark matter particles or halo catalogs in a variety of common formats. It can also randomly subsample inputs and includes a Halo Occupation Distribution model for constructing mock galaxy populations. VIDE uses the watershed levels to place voids in a hierarchical tree, outputs a summary of void properties in plain ASCII, and provides a Python API to perform many analysis tasks, such as loading and manipulating void catalogs and particle members, filtering, plotting, computing clustering statistics, stacking, comparing catalogs, and fitting density profiles. While centered around ZOBOV, the toolkit is designed to be as modular as possible and accommodate other void finders. VIDE has been in development for several years and has already been used to produce a wealth of results, which we summarize in this work to highlight the capabilities of the toolkit. VIDE is publicly available at http://bitbucket.org/cosmicvoids/vide public and http://www.cosmicvoids.net.

We propose a new method to constrain the warm dark matter (WDM) particle mass, $m_\chi$, based on the counts of multiply imaged, distant supernovae (SN) produced by strong lensing by intervening cosmological matter fluctuations. The counts are very sensitive to the WDM particle mass, assumed here to be $m_\chi=1, 1.5, 2$ keV. We use the analytic approach developed by Das & Ostriker to compute the probability density function of the cold dark matter (CDM) convergence ($\kappa$) on the lens plane; such method has been extensively tested against numerical simulations. We have extended this method generalizing it to the WDM case, after testing it against WDM $N$-body simulations. Using the observed cosmic star formation history we compute the probability for a distant SN to undergo a strong lensing event in different cosmologies. A minimum observing time of 2 yr (5 yr) is required for a future 100 square degrees survey reaching $z \approx 4$ ($z \approx 3$) to disentangle at 2$\sigma$ a WDM ($m_\chi=1$ keV) model from the standard CDM scenario. Our method is not affected by any astrophysical uncertainty (such as baryonic physics effects), and, in principle, it does not require any particular dedicated survey strategy, as it may come as a byproduct of a future SN survey.

We present the first suite of cosmological N-body simulations that simultaneously include the effects of two different and theoretically independent extensions of the standard $\Lambda$CDM cosmological scenario - namely an $f(R)$ theory of Modified Gravity (MG) and a cosmological background of massive neutrinos - with the aim to investigate their possible observational degeneracies. We focus on three basic statistics of the large-scale matter distribution, more specifically the nonlinear matter power spectrum, the halo mass function, and the halo bias, for which we determine the deviation with respect to the fiducial $\Lambda$CDM cosmology in the context of both separate and combined simulations of $f(R)$ MG and massive neutrinos scenarios. Our results show that while these two extended models separately determine very prominent and potentially detectable features in all the three statistics, when we allow them to be simultaneously at work these features are strongly suppressed, resulting in much weaker deviations from the standard model's predictions. In particular, when an $f(R)$ gravity model with $f_{R0}=-1\times 10^{-4}$ is combined with a total neutrino mass of $\Sigma _{i}m_{\nu _{i}}=0.4$ eV, the resulting matter power spectrum, halo mass function, and bias at z=0 are found to be consistent with the standard model's predictions at the 10%, 20%, and 5% accuracy levels, respectively. Therefore, our results imply an intrinsic theoretical limit to the effective discriminating power of present and future observational data sets with respect to these widely considered extensions of the standard cosmological scenario in the absence of independent measurements of the neutrino masses from laboratory experiments, even though the high-redshift evolution might still allow to partially break the degeneracy [Abridged].

We use a suite of N-body simulations that incorporate massive neutrinos as an extra-set of particles to investigate their effect on the halo mass function. We show that for cosmologies with massive neutrinos the mass function of dark matter haloes selected using the spherical overdensity (SO) criterion is well reproduced by the fitting formula of Tinker et al. (2008) once the cold dark matter power spectrum is considered instead of the total matter power, as it is usually done. The differences between the two implementations, i.e. using $P_{\rm cdm}(k)$ instead of $P_{\rm m}(k)$, are more pronounced for large values of the neutrino masses and in the high end of the halo mass function: in particular, the number of massive haloes is higher when $P_{\rm cdm}(k)$ is considered rather than $P_{\rm m}(k)$. As a quantitative application of our findings we consider a Planck-like SZ-clusters survey and show that the differences in predicted number counts can be as large as $30\%$ for $\sum m_\nu = 0.4$ eV. Finally, we use the Planck-SZ clusters sample, with an approximate likelihood calculation, to derive Planck-like constraints on cosmological parameters. We find that, in a massive neutrino cosmology, our correction to the halo mass function produces a shift in the $\sigma_8(\Omega_{\rm m}/0.27)^\gamma$ relation which can be quantified as $\Delta \gamma \sim 0.05$ and $\Delta \gamma \sim 0.14$ assuming one ($N_\nu=1$) or three ($N_\nu=3$) degenerate massive neutrino, respectively. The shift results in a lower mean value of $\sigma_8$ with $\Delta \sigma_8 = 0.01$ for $N_\nu=1$ and $\Delta \sigma_8 = 0.02$ for $N_\nu=3$, respectively. Such difference, in a cosmology with massive neutrinos, would increase the tension between cluster abundance and Planck CMB measurements.

We use a large suite of N-body simulations to study departures from universality in halo abundances and clustering in cosmologies with non-vanishing neutrino masses. To this end, we study how the halo mass function and halo bias factors depend on the scaling variable $\sigma^2(M,z)$, the variance of the initial matter fluctuation field, rather than on halo mass $M$ and redshift $z$ themselves. We show that using the variance of the cold dark matter rather than the total mass field, i.e., $\sigma^2_{cdm}(M,z)$ rather than $\sigma^2_{m}(M,z)$, yields more universal results. Analysis of halo bias yields similar conclusions: When large-scale halo bias is defined with respect to the cold dark matter power spectrum, the result is both more universal, and less scale- or $k$-dependent. These results are used extensively in Papers I and III of this series.

By using a suite of large box-size N-body simulations that incorporate massive neutrinos as an extra set of particles, we investigate the impact of neutrino masses on the spatial distribution of dark matter haloes and galaxies. We compute the bias between the spatial distribution of dark matter haloes and the overall matter and cold dark matter distributions using statistical tools such as the power spectrum and the two-point correlation function. Overall we find a scale-dependent bias on large scales for the cosmologies with massive neutrinos. However, our results indicate that the scale-dependence in the bias is reduced if the latter is computed with respect to the cold dark matter distribution only. We find that the value of the bias on large scales is reasonably well reproduced by the Tinker fitting formula once the linear cold dark matter power spectrum is used, instead of the total matter power spectrum. We investigate whether scale-dependent bias really comes from purely neutrino's effect or from nonlinear gravitational collapse of haloes. For this purpose, we address the $\Omega_\nu$-$\sigma_8$ degeneracy and find that such degeneracy is not perfect, implying that neutrinos imprint a slight scale dependence on the large-scale bias. Finally, by using a simple halo occupation distribution (HOD) model, we investigate the impact of massive neutrinos on the distribution of galaxies within dark matter haloes. We use the main galaxy sample in the Sloan Digital Sky Survey II Data Release 7 to investigate if the small-scale galaxy clustering alone can be used to discriminate among different cosmological models with different neutrino masses. Our results suggest that different choices of the HOD parameters can reproduce the observational measurements relatively well, and we quantify the difference between the values of the HOD parameters between massless and massive neutrino cosmologies.

We quantify the impact of massive neutrinos on the statistics of low density regions in the intergalactic medium (IGM) as probed by the Lyman-alpha forest at redshifts z=2.2--4. Based on mock but realistic quasar (QSO) spectra extracted from hydrodynamic simulations with cold dark matter, baryons and neutrinos, we find that the probability distribution of weak Lyman-alpha absorption features, as sampled by Lyman-alpha flux regions at high transmissivity, is strongly affected by the presence of massive neutrinos. We show that systematic errors affecting the Lyman-alpha forest reduce but do not erase the neutrino signal. Using the Fisher matrix formalism, we conclude that the sum of the neutrino masses can be measured, using the method proposed in this paper, with a precision smaller than 0.4 eV using a catalog of 200 high resolution (S/N~100) QSO spectra. This number reduces to 0.27 eV by making use of reasonable priors in the other parameters that also affect the statistics of the high transitivity regions of the Lyman-alpha forest. The constraints obtained with this method can be combined with independent bounds from the CMB, large scale structures and measurements of the matter power spectrum from the Lyman-alpha forest to produce tighter upper limits on the sum of the masses of the neutrinos.

We investigate the non-linear evolution of the relic cosmic neutrino background by running large box-size, high resolution N-body simulations. Our set of simulations explore the properties of neutrinos in a reference $\Lambda$CDM model with total neutrino masses between 0.05-0.60 eV in cold dark matter haloes of mass $10^{11}-10^{15}$ $h^{-1}$M$_{\odot}$, over a redshift range $z=0-2$. We compute the halo mass function and show that it is reasonably well fitted by the Sheth-Tormen formula. More importantly, we focus on the CDM and neutrino properties of the density and peculiar velocity fields in the cosmological volume, inside and in the outskirts of virialized haloes. The dynamical state of the neutrino particles depends strongly on their momentum: whereas neutrinos in the low velocity tail behave similarly to CDM particles, neutrinos in the high velocity tail are not affected by the clustering of the underlying CDM component. We find that the neutrino (linear) unperturbed momentum distribution is modified and mass and redshift dependent deviations from the expected Fermi-Dirac distribution are in place both in the cosmological volume and inside haloes. The neutrino density profiles around virialized haloes have been carefully investigated and a simple fitting formula is provided. The neutrino profile, unlike the cold dark matter one, is found to be cored with core size and central density that depend on the neutrino mass, redshift and mass of the halo, for halos of masses larger than $\sim 10^{13.5}h^{-1}$M$_{\odot}$. For lower masses the neutrino profile is best fitted by a simple power-law relation in the range probed by the simulations. Our findings are particularly important in view of upcoming large-scale structure surveys, like Euclid, that are expected to probe the non-linear regime at the percent level with lensing and clustering observations.

We study whether non-linear gravitational effects of relic neutrinos on the development of clustering and large-scale structure may be observable by weak gravitational lensing. We compute the density profile of relic massive neutrinos in a spherical model of a cluster of galaxies, for several neutrino mass schemes and cluster masses. Relic neutrinos add a small perturbation to the mass profile, making it more extended in the outer parts. In principle, this non-linear neutrino perturbation is detectable in an all-sky weak lensing survey such as EUCLID by averaging the shear profile of a large fraction of the visible massive clusters in the universe, or from its signature in the general weak lensing power spectrum or its cross-spectrum with galaxies. However, correctly modeling the distribution of mass in baryons and cold dark matter and suppressing any systematic errors to the accuracy required for detecting this neutrino perturbation is severely challenging.

Photons couple to Axion-Like Particles (ALPs) or more generally to any pseudo Nambu-Goldstone boson in the presence of an external electromagnetic field. Mixing between photons and ALPs in the strong magnetic field of a Gamma-Ray Burst (GRB) jet during the prompt emission phase can leave observable imprints on the gamma-ray polarization and spectrum. Mixing in the intergalactic medium is not expected to modify these signatures for ALP mass > 10^(-14) eV and/or for < nG magnetic field. We show that the depletion of photons due to conversion to ALPs changes the linear degree of polarization from the values predicted by the synchrotron model of gamma ray emission. We also show that when the magnetic field orientation in the propagation region is perpendicular to the field orientation in the production region, the observed synchrotron spectrum becomes steeper than the theoretical prediction and as detected in a sizable fraction of GRB sample. Detection of the correlated polarization and spectral signatures from these steep-spectrum GRBs by gamma-ray polarimeters can be a very powerful probe to discover ALPs. Measurement of gamma-ray polarization from GRBs in general, with high statistics, can also be useful to search for ALPs.

The apparent presence of large core radii in Low Surface Brightness galaxies has been claimed as evidence in favor of warm dark matter. Here we show that WDM halos do not have cores that are large fractions of the halo size: typically, r_core/r_200 < 0.001. This suggests an astrophysical origin for the large cores observed in these galaxies, as has been argued by other authors.