Fluctuations with wavelengths larger than the volume of a galaxy survey affect the measurement of the galaxy power spectrum within the survey itself. In the presence of local Primordial Non- Gaussianities (PNG), in addition to the super-sample matter density and tidal fluctuations, the large-scale gravitational potential also induces a modulation of the observed power spectrum. In this work we investigate this modulation by computing for the first time the response of the redshift-space galaxy power spectrum to the presence of a long wavelength gravitational potential, fully accounting for the stochastic contributions. For biased tracers new response functions arise due to couplings between the small-scale fluctuations in the density, velocity and gravitational fields, the latter through scale dependent bias operators, and the large-scale gravitational potential. We study the impact of the super-sample modes on the measurement of the amplitude of the primordial bispectrum of the local-shape, $f_{\rm NL}^{\rm loc}$, accounting for modulations of both the signal and the covariance of the galaxy power spectrum by the long modes. Considering DESI-like survey specifications, we show that in most cases super-sample modes cause little or no degradation of the constraints, and could actually reduce the errorbars on $f_{\rm NL}^{\rm loc}$ by (10 - 30)\%, if external information on the bias parameters is available.

The time delay measured between the images of gravitationally lensed quasars probes a combination of the angular diameter distance to the source-lens system and the mass density profile of the lens. Observational campaigns to measure such systems have reported a determination of the Hubble parameter H0 that shows significant tension with independent determination based on the cosmic microwave background (CMB) and large scale structure (LSS). We show that lens mass models that exhibit a cored component, coexisting with a cusp, probe a degenerate direction in the lens model parameter space, being an approximate mass sheet transformation. This family of lens models has not been considered by the cosmographic analyses. Once added to the model, the cosmographic error budget should become dependent on stellar kinematics uncertainties. We propose that a core component coexisting with a cusp could bring the lensing measurements of H0 to accord with the CMB/LSS value.

The most commonly used estimators of the anisotropic galaxy power spectrum employ Fast Fourier transforms, and rely on a specific choice of the line-of-sight that breaks the symmetry between the galaxy pair. This leads to wide-angle effects, including the presence of odd power spectrum multipoles like the dipole ($\ell = 1$) and octopole ($\ell = 3$). In Fourier-space these wide-angle effects also couple to the survey window function. We present a self-consistent framework extending the commonly used window function treatment to include the wide-angle effects. We show that our framework can successfully model the wide-angle effects in the BOSS DR12 dataset. We present estimators for the odd power spectrum multipoles and, detect these multipoles in BOSS DR12 with high significance. Understanding the impact of the wide-angle effects on the power spectrum multipoles is essential for many cosmological observables like primordial non-Gaussianity and the detection of General Relativistic effects and represents a potential systematic for measurements of Baryon Acoustic Oscillations and redshift-space distortions.

Massive neutrinos suppress the growth of structure below their free-streaming scale and leave an imprint on large-scale structure. Measuring this imprint allows us to constrain the sum of neutrino masses, $M_\nu$, a key parameter in particle physics beyond the Standard Model. However, degeneracies among cosmological parameters, especially between $M_\nu$ and $\sigma_8$, limit the constraining power of standard two-point clustering statistics. In this work, we investigate whether we can break these degeneracies and constrain $\smnu$ with the next higher-order correlation function --- the bispectrum. We first examine the redshift-space halo bispectrum of $800$ $N$-body simulations from the HADES suite and demonstrate that the bispectrum helps break the $M_\nu$--$\sigma_8$ degeneracy. Then using 22,000 $N$-body simulations of the Quijote suite, we quantify for the first time the full information content of the redshift-space halo bispectrum down to nonlinear scales using a Fisher matrix forecast of $\{\Omega_m$, $\Omega_b$, $h$, $n_s$, $\sigma_8$, $M_\nu\}$. For $k_{\rm max}{=}0.5~h/{\rm Mpc}$, the bispectrum provides $\Omega_m$, $\Omega_b$, $h$, $n_s$, and $\sigma_8$ constraints 1.9, 2.6, 3.1, 3.6, and 2.6 times tighter than the power spectrum. For $M_\nu$, the bispectrum improves the 1$\sigma$ constraint from 0.2968 to 0.0572 eV --- over 5 times tighter than the power spectrum. Even with priors from {\em Planck}, the bispectrum improves $M_\nu$ constraints by a factor of 1.8. Although we reserve marginalizing over a more complete set of bias parameters to the next paper of the series, these constraints are derived for a $(1~h^{-1}{\rm Gpc})^3$ box, a substantially smaller volume than upcoming surveys. Thus, our results demonstrate that the bispectrum offers significant improvements over the power spectrum, especially for constraining $M_\nu$.

The Packed Ultra-wideband Mapping Array (PUMA) is a proposed low-resolution transit interferometric radio telescope operating over the frequency range 200 - 1100MHz. Its rich science portfolio will include measuring structure in the universe from redshift z = 0.3 to 6 using 21cm intensity mapping, detecting one million fast radio bursts, and monitoring thousands of pulsars. It will allow PUMA to advance science in three different areas of physics (the physics of dark energy, the physics of cosmic inflation and time-domain astrophysics). This document is a response to a request for information (RFI) by the Panel on Radio, Millimeter, and Submillimeter Observations from the Ground (RMS) of the Decadal Survey on Astronomy and Astrophysics 2020. We present the science case of PUMA, the development path and major risks to the project.

We present a new method to measure neutrino masses using the dark matter-neutrino relative velocity. The relative motion between dark matter and neutrinos results in a parity-odd bispectrum which can be measured from cross-correlation of different cosmic fields. This new method is not affected by most systematics which are parity even and not limited by the knowledge of optical depth to the cosmic microwave background. We estimate the detectability of the relative velocity effect and find that the minimal sum of neutrino masses could be detected at high significance with upcoming surveys.

The line-of-sight peculiar velocities of galaxies contribute to their observed redshifts, breaking the translational invariance of galaxy clustering down to a rotational invariance around the observer. This becomes important when the line-of-sight direction varies significantly across a survey, leading to what are known as `wide angle' effects in redshift space distortions. Wide-angle effects will also be present in measurements of the momentum field, i.e. the galaxy density-weighted velocity field, in upcoming peculiar velocity surveys. In this work we study how wide-angle effects modify the predicted correlation function and power spectrum for momentum statistics, both in auto-correlation and in cross-correlation with the density field. Using both linear theory and the Zeldovich approximation, we find that deviations from the plane-parallel limit are large and could become important in data analysis for low redshift surveys. We point out that even multipoles in the cross-correlation between density and momentum are non-zero regardless of the choice of line of sight, and therefore contain new cosmological information that could be exploited. We discuss configuration-space, Fourier-space and spherical analyses, providing exact expressions in each case rather than relying on an expansion in small angles. We hope these expressions will be of use in the analysis of upcoming surveys for redshift-space distortions and peculiar velocities.

This paper introduces the Hidden Valley simulations, a set of trillion-particle N-body simulations in gigaparsec volumes aimed at intensity mapping science. We present details of the simulations and their convergence, then specialize to the study of 21-cm fluctuations between redshifts 2 and 6. Neutral hydrogen is assigned to halos using three prescriptions, and we investigate the clustering in real and redshift-space at the 2-point level. In common with earlier work we find the bias of HI increases from near 2 at z = 2 to 4 at z = 6, becoming more scale dependent at high z. The level of scale-dependence and decorrelation with the matter field are as predicted by perturbation theory. Due to the low mass of the hosting halos, the impact of fingers of god is small on the range relevant for proposed 21-cm instruments. We show that baryon acoustic oscillations and redshift-space distortions could be well measured by such instruments. Taking advantage of the large simulation volume, we assess the impact of fluctuations in the ultraviolet background, which change HI clustering primarily at large scales.

We study the impact of lensing corrections on modeling cross correlations between CMB lensing and galaxies, cosmic shear and galaxies, and galaxies in different redshift bins. Estimating the importance of these corrections becomes necessary in the light of anticipated high-accuracy measurements of these observables. While higher order lensing corrections (sometimes also referred to as post Born corrections) have been shown to be negligibly small for lensing auto correlations, they have not been studied for cross correlations. We evaluate the contributing four-point functions without making use of the Limber approximation and compute line-of-sight integrals with the numerically stable and fast FFTlog formalism. We find that the relative size of lensing corrections depends on the respective redshift distributions of the lensing sources and galaxies, but that they are generally small for high signal-to-noise correlations. We point out that a full assessment and judgement of the importance of these corrections requires the inclusion of lensing Jacobian terms on the galaxy side. We identify these additional correction terms, but do not evaluate them due to their large number. We argue that they could be potentially important and suggest that their size should be measured in the future with ray-traced simulations. We make our code publicly available.

Upcoming 21-cm intensity surveys will use the hyperfine transition in emission to map out neutral hydrogen in large volumes of the universe. Unfortunately, large spatial scales are completely contaminated with spectrally smooth astrophysical foregrounds which are orders of magnitude brighter than the signal. This contamination also leaks into smaller radial and angular modes to form a foreground wedge, further limiting the usefulness of 21-cm observations for different science cases, especially cross-correlations with tracers that have wide kernels in the radial direction. In this paper, we investigate reconstructing these modes within a forward modeling framework. Starting with an initial density field, a suitable bias parameterization and non-linear dynamics to model the observed 21-cm field, our reconstruction proceeds by combining the likelihood of a forward simulation to match the observations (under given modeling error and a data noise model) with the Gaussian prior on initial conditions and maximizing the obtained posterior. For redshifts $z=2$ and $4$, we are able to reconstruct 21cm field with cross correlation, $r_c > 0.8$ on all scales for both our optimistic and pessimistic assumptions about foreground contamination and for different levels of thermal noise. The performance deteriorates slightly at $z=6$. The large-scale line-of-sight modes are reconstructed almost perfectly. We demonstrate how our method also reconstructs baryon acoustic oscillations, outperforming standard methods on all scales. We also describe how our reconstructed field can provide superb clustering redshift estimation at high redshifts, where it is otherwise extremely difficult to obtain dense spectroscopic samples, as well as open up cross-correlation opportunities with projected fields (e.g. lensing) which are restricted to modes transverse to the line of sight.

The Quijote simulations are a set of 43100 full N-body simulations spanning more than 7000 cosmological models in the $\{\Omega_{\rm m}, \Omega_{\rm b}, h, n_s, \sigma_8, M_\nu, w \}$ hyperplane. At a single redshift the simulations contain more than 8.5 trillions of particles over a combined volume of 43100 $(h^{-1}{\rm Gpc})^3$. Billions of dark matter halos and cosmic voids have been identified in the simulations, whose runs required more than 35 million core hours. The Quijote simulations have been designed for two main purposes: 1) to quantify the information content on cosmological observables, and 2) to provide enough data to train machine learning algorithms. In this paper we describe the simulations and show a few of their applications. We also release the Petabyte of data generated, comprising hundreds of thousands of simulation snapshots at multiple redshifts, halo and void catalogs, together with millions of summary statistics such as power spectra, bispectra, correlation functions, marked power spectra, and estimated probability density functions.

The contribution of line-of-sight peculiar velocities to the observed redshift of objects breaks the translational symmetry of the underlying theory, modifying the predicted 2-point functions. These `wide angle effects' have mostly been studied using linear perturbation theory in the context of the multipoles of the correlation function and power spectrum. In this work we present the first calculation of wide angle terms in the Zeldovich approximation, which is known to be more accurate than linear theory on scales probed by the next generation of galaxy surveys. We present the exact result for dark matter and perturbatively biased tracers as well as the small angle expansion of the configuration- and Fourier-space two-point functions and the connection to the multi-frequency angular power spectrum. We compare different definitions of the line-of-sight direction and discuss how to translate between them. We show that wide angle terms can reach tens of percent of the total signal in a measurement at low redshift in some approximations, and that a generic feature of wide angle effects is to slightly shift the Baryon Acoustic Oscillation scale.

This white paper envisions a revolutionary post-DESI, post-LSST dark energy program based on intensity mapping of the redshifted 21cm emission line from neutral hydrogen at radio frequencies. The proposed intensity mapping survey has the unique capability to quadruple the volume of the Universe surveyed by optical programs, provide a percent-level measurement of the expansion history to $z \sim 6$, open a window to explore physics beyond the concordance $\Lambda$CDM model, and to significantly improve the precision on standard cosmological parameters. In addition, characterization of dark energy and new physics will be powerfully enhanced by cross-correlations with optical surveys and cosmic microwave background measurements. The rich dataset obtained by the proposed intensity mapping instrument will be simultaneously useful in exploring the time-domain physics of fast radio transients and pulsars, potentially in live "multi-messenger" coincidence with other observatories. The core dark energy/inflation science advances enabled by this program are the following: (i) Measure the expansion history of the universe over $z=0.3-6$ with a single instrument, extending the range deep into the pre-acceleration era, providing an unexplored window for new physics; (ii) Measure the growth rate of structure in the universe over the same redshift range; (iii) Observe, or constrain, the presence of inflationary relics in the primordial power spectrum, improving existing constraints by an order of magnitude; (iv) Observe, or constrain, primordial non-Gaussianity with unprecedented precision, improving constraints on several key numbers by an order of magnitude. Detailed mapping of the enormous, and still largely unexplored, volume of cosmic space will thus provide unprecedented information on fundamental questions of the vacuum energy and early-universe physics.

PUMA is a proposal for an ultra-wideband, low-resolution and transit interferometric radio telescope operating at $200-1100\,\mathrm{MHz}$. Its design is driven by six science goals which span three science themes: the physics of dark energy (measuring the expansion history and growth of the universe up to $z=6$), the physics of inflation (constraining primordial non-Gaussianity and primordial features) and the transient radio sky (detecting one million fast radio bursts and following up SKA-discovered pulsars). We propose two array configurations composed of hexagonally close-packed 6m dish arrangements with 50% fill factor. The initial 5,000 element 'petite array' is scientifically compelling, and can act as a demonstrator and a stepping stone to the full 32,000 element 'full array'. Viewed as a 21cm intensity mapping telescope, the program has the noise equivalent of a traditional spectroscopic galaxy survey comprised of 0.6 and 2.5 billion galaxies at a comoving wavenumber of $k=0.5\,h\mathrm{Mpc}^{-1}$ spanning the redshift range $z = 0.3 - 6$ for the petite and full configurations, respectively. At redshifts beyond $z=2$, the 21cm technique is a uniquely powerful way of mapping the universe, while the low-redshift range will allow for numerous cross-correlations with existing and upcoming surveys. This program is enabled by the development of ultra-wideband radio feeds, cost-effective dish construction methods, commodity radio-frequency electronics driven by the telecommunication industry and the emergence of sufficient computing power to facilitate real-time signal processing that exploits the full potential of massive radio arrays. The project has an estimated construction cost of 55 and 330 million FY19 USD for the petite and full array configurations. Including R&D, design, operations and science analysis, the cost rises to 125 and 600 million FY19 USD, respectively.

Development of the hardware, data analysis, and simulation techniques for large compact radio arrays dedicated to mapping the 21 cm line of neutral hydrogen gas has proven to be more difficult than imagined twenty years ago when such telescopes were first proposed. Despite tremendous technical and methodological advances, there are several outstanding questions on how to optimally calibrate and analyze such data. On the positive side, it has become clear that the outstanding issues are purely technical in nature and can be solved with sufficient development activity. Such activity will enable science across redshifts, from early galaxy evolution in the pre-reionization era to dark energy evolution at low redshift.

Nonlinear objects like halos and voids exhibit a scale-dependent bias on linear scales in massive neutrino cosmologies. The shape of this scale-dependent bias is a unique signature of the neutrino masses, but the amplitude of the signal is generally small, of the order of $f_\nu$, the contribution of neutrinos to the total matter content ($\lesssim 1\%$). In this paper, we demonstrate for the first time how the strength of this signal can be substantially enhanced by using information about the halo environment at a range of scales. This enhancement is achieved by using certain combinations of the large scale Cold Dark Matter and total matter environments of halos, both of which are measurable from galaxy clustering and weak lensing surveys.

Line intensity mapping offers a new avenue for constraining cosmological parameters in the high redshift Universe. However measurements of the growth of structure, a sensitive probe of gravity, are affected by a well known degeneracy with astrophysical parameters, encoded in the mean brightness temperature of the specific line. In this work we show how to break this degeneracy, to a level that could allow constraints of the amplitude of cosmological fluctuations at the percent level, using information in the mildly non-linear regime of structure formation as described by Lagrangian Perturbation Theory. We focus on the 21-cm line with forecasts for HIRAX and the proposed Stage II experiment as illustrations.

We study synergies between three promising methods to measure $2<z<5$ large-scale structure in the next decade. Optical spectroscopic surveys are the most mature, but become increasingly difficult at $z>2$ and suffer from interloper problems even for spectroscopic surveys. Intensity mapping of the 21-cm signal can cover large volumes with exquisite fidelity, but is limited both by loss of information to foreground cleaning and by lack of knowledge of the mean signal. Cosmic microwave background (CMB) lensing is theoretically very clean, but ultimately measures just the projected variations in density. We find that cross-correlation between optical and radio can significantly improve the measurement of growth rate. Combining these with the CMB provides a promising avenue to detecting modified gravity at high redshifts, in particular by independently probing the Weyl and Newtonian potentials and by strengthening control of systematics. We find that cross-correlating a Stage {\sc ii} 21-cm survey with DESI quasars with a reasonable brightness temperature prior could enable measurements of the growth rate $f\sigma_8$ at sub 3\% and sub 8\% levels at $z = 3, 4$, representing a factor of 4 and 8 improvement over constraints obtainable from DESI quasars alone. Similarly, cross-correlating 21-cm data with a futuristic LBG survey to $m_{UV}<24.5$ over 1000 square degrees will make possible $f\sigma_8$ measurements at close to 1\% at $z = 3$ and 3\% at $z = 4$, and improve similar constraints at $z = 5$ by close to a factor of 3 to sub-10\% precision. Combining the above with CMB lensing from a Stage 4 CMB survey and LSST data can additionally constrain the gravitational slip $\gamma$ parameter to similar precision at these redshifts, enabling us to test the predictions of general relativity at large scales.

We explore Lagrangian perturbation theory (LPT) for biased tracers in the presence of two fluids, focusing on the case of cold dark matter (CDM) and baryons. The presence of two fluids induces corrections to the Lagrangian bias expansion and tracer advection, both of which we formulate as expansions in the three linear modes of the Lagrangian equations of motion. We compute the linear-order two-fluid corrections in the Zeldovich approximation, finding that modifications to the bias expansion and tracer advection both enter as percent-level corrections over a large range of wavenumbers at low redshift and draw parallels with the Eulerian formalism. We then discuss nonlinear corrections in the two-fluid picture, and calculate contributions from the relative velocity effect ($\propto v_r^2$) at one loop order. Finally, we conduct an exploratory Fisher analysis to assess the impact of two-fluid corrections on baryon acoustic oscillations (BAO) measurements, finding that while modest values of the relative bias parameters can introduce systematic biases in the measured BAO scale of up to $0.5\, \sigma$, fitting for these effects as additional parameters increases the error bar by less than $30\%$ across a wide range of bias values.

We present constraints on local primordial non-Gaussianity (PNG), parametrized through $f^{\rm loc}_{\rm NL}$, using the Sloan Digital Sky Survey IV extended Baryon Oscillation Spectroscopic Survey Data Release 14 quasar sample. We measure and analyze the anisotropic clustering of the quasars in Fourier space, testing for the scale-dependent bias introduced by primordial non-Gaussianity on large scales. We derive and employ a power spectrum estimator using optimal weights that account for the redshift evolution of the PNG signal. We find constraints of $-51<f^{\rm loc}_{\rm NL}<21$ at 95% confidence level. These are amont the tightest constraints from Large Scale Structure (LSS) data. Our redshift weighting improves the error bar by 15% in comparison to the unweighted case. If quasars have lower response to PNG, the constraint degrades to $-81<f^{\rm loc}_{\rm NL}<26$, with a 40% improvement over the standard approach. We forecast that the full eBOSS dataset could reach $\sigma_{f^{\rm loc}_{\rm NL}}\simeq 5\text{-}8$ using optimal methods and full range of scales.

The expansion of the Universe is understood to have accelerated during two epochs: in its very first moments during a period of Inflation and much more recently, at $z < 1$, when Dark Energy is hypothesized to drive cosmic acceleration. The undiscovered mechanisms behind these two epochs represent some of the most important open problems in fundamental physics. The large cosmological volume at $2 < z < 5$, together with the ability to efficiently target high-$z$ galaxies with known techniques, enables large gains in the study of Inflation and Dark Energy. A future spectroscopic survey can test the Gaussianity of the initial conditions up to a factor of ~50 better than our current bounds, crossing the crucial theoretical threshold of $\sigma(f_{NL}^{\rm local})$ of order unity that separates single field and multi-field models. Simultaneously, it can measure the fraction of Dark Energy at the percent level up to $z = 5$, thus serving as an unprecedented test of the standard model and opening up a tremendous discovery space.

Our current understanding of the Universe is established through the pristine measurements of structure in the cosmic microwave background (CMB) and the distribution and shapes of galaxies tracing the large scale structure (LSS) of the Universe. One key ingredient that underlies cosmological observables is that the field that sources the observed structure is assumed to be initially Gaussian with high precision. Nevertheless, a minimal deviation from Gaussianityis perhaps the most robust theoretical prediction of models that explain the observed Universe; itis necessarily present even in the simplest scenarios. In addition, most inflationary models produce far higher levels of non-Gaussianity. Since non-Gaussianity directly probes the dynamics in the early Universe, a detection would present a monumental discovery in cosmology, providing clues about physics at energy scales as high as the GUT scale.

The hot dense environment of the early universe is known to have produced large numbers of baryons, photons, and neutrinos. These extreme conditions may have also produced other long-lived species, including new light particles (such as axions or sterile neutrinos) or gravitational waves. The gravitational effects of any such light relics can be observed through their unique imprint in the cosmic microwave background (CMB), the large-scale structure, and the primordial light element abundances, and are important in determining the initial conditions of the universe. We argue that future cosmological observations, in particular improved maps of the CMB on small angular scales, can be orders of magnitude more sensitive for probing the thermal history of the early universe than current experiments. These observations offer a unique and broad discovery space for new physics in the dark sector and beyond, even when its effects would not be visible in terrestrial experiments or in astrophysical environments. A detection of an excess light relic abundance would be a clear indication of new physics and would provide the first direct information about the universe between the times of reheating and neutrino decoupling one second later.

Astrophysical observations currently provide the only robust, empirical measurements of dark matter. In the coming decade, astrophysical observations will guide other experimental efforts, while simultaneously probing unique regions of dark matter parameter space. This white paper summarizes astrophysical observations that can constrain the fundamental physics of dark matter in the era of LSST. We describe how astrophysical observations will inform our understanding of the fundamental properties of dark matter, such as particle mass, self-interaction strength, non-gravitational interactions with the Standard Model, and compact object abundances. Additionally, we highlight theoretical work and experimental/observational facilities that will complement LSST to strengthen our understanding of the fundamental characteristics of dark matter.

We investigate the possibility of performing cosmological studies in the redshift range $2.5<z<5$ through suitable extensions of existing and upcoming radio-telescopes like CHIME, HIRAX and FAST. We use the Fisher matrix technique to forecast the bounds that those instruments can place on the growth rate, the BAO distance scale parameters, the sum of the neutrino masses and the number of relativistic degrees of freedom at decoupling, $N_{\rm eff}$. We point out that quantities that depend on the amplitude of the 21cm power spectrum, like $f\sigma_8$, are completely degenerate with $\Omega_{\rm HI}$ and $b_{\rm HI}$, and propose several strategies to independently constraint them through cross-correlations with other probes. Assuming $5\%$ priors on $\Omega_{\rm HI}$ and $b_{\rm HI}$, $k_{\rm max}=0.2~h{\rm Mpc}^{-1}$ and the primary beam wedge, we find that a HIRAX extension can constrain, within bins of $\Delta z=0.1$: 1) the value of $f\sigma_8$ at $\simeq4\%$, 2) the value of $D_A$ and $H$ at $\simeq1\%$. In combination with data from Euclid-like galaxy surveys and CMB S4, the sum of the neutrino masses can be constrained with an error equal to $23$ meV ($1\sigma$), while $N_{\rm eff}$ can be constrained within 0.02 ($1\sigma$). We derive similar constraints for the extensions of the other instruments. We study in detail the dependence of our results on the instrument, amplitude of the HI bias, the foreground wedge coverage, the nonlinear scale used in the analysis, uncertainties in the theoretical modeling and the priors on $b_{\rm HI}$ and $\Omega_{\rm HI}$. We conclude that 21cm intensity mapping surveys operating in this redshift range can provide extremely competitive constraints on key cosmological parameters.

[Abridged] We study the abundance and clustering properties of HI at redshifts $z\leqslant5$ using TNG100, a large state-of-the-art magneto-hydrodynamic simulation of a 75 Mpc/h box size. We show that most of the HI lies within dark matter halos and quantify the average HI mass hosted by halos of mass M at redshift z. We find that only halos with circular velocities larger than $\simeq$ 30 km/s contain HI. While the density profiles of HI exhibit a large halo-to-halo scatter, the mean profiles are universal across mass and redshift. The HI in low-mass halos is mostly located in the central galaxy, while in massive halos is concentrated in the satellites. We show that the HI and matter density probability distribution functions differ significantly. Our results point out that for small halos the HI bulk velocity goes in the same direction and has the same magnitude as the halo peculiar velocity, while in large halos differences show up. We find that halo HI velocity dispersion follows a power-law with halo mass. We find a complicated HI bias, with HI becoming non-linear already at $k=0.3$ h/Mpc at $z\gtrsim3$. Our simulation reproduces the DLAs bias value from observations. We find that the clustering of HI can be accurately reproduced by perturbative methods. We identify a new secondary bias, by showing that the clustering of halos depends not only on mass but also on HI content. We compute the amplitude of the HI shot-noise and find that it is small at all redshifts. We study the clustering of HI in redshift-space, and show that linear theory can explain the ratio between the monopoles in redshift- and real-space down to small scales at high redshift. We find that the amplitude of the Fingers-of-God effect is larger for HI than for matter. We point out that accurate 21 cm maps can be created from N-body or approximate simulations rather than full hydrodynamic simulations.

We develop a new method to constraint primordial non-Gaussianities of the local kind using unclustered tracers of the Large Scale Structure. We show that in the limit of low noise, zero bias tracers yield large improvement over standard methods, mostly due to vanishing sampling variance. We propose a simple technique to construct such a tracer, using environmental information obtained from the original sample, and validate our method with N-body simulations. Our results indicate that $\sigma_{f_{\mathrm{NL}}^{\mathrm{loc}}}\simeq1$ can be reached using only information on a single tracer of sufficiently high number density.

Redshift space distortions privilege the location of the observer in cosmological redshift surveys, breaking the translational symmetry of the underlying theory. This violation of statistical homogeneity has consequences for the modeling of clustering observables, leading to what are frequently called `wide angle effects'. We study these effects analytically, computing their signature in the clustering of the multipoles in configuration and Fourier space. We take into account both physical wide angle contributions as well as the terms generated by the galaxy selection function. Similar considerations also affect the way power spectrum estimators are constructed. We quantify, in an analytical way the biases which enter and clarify the relation between what we measure and the underlying theoretical modeling. The presence of an angular window function is also discussed. Motivated by this analysis we present new estimators for the three dimensional Cartesian power spectrum and bispectrum multipoles written in terms of spherical Fourier-Bessel coefficients. We show how the latter have several interesting properties, allowing in particular a clear separation between angular and radial modes.

The main effect of massive neutrinos on the large-scale structure consists in a few percent suppression of matter perturbations on all scales below their free-streaming scale. Such effect is of particular importance as it allows to constraint the value of the sum of neutrino masses from measurements of the galaxy power spectrum. In this work, we present the first measurements of the next higher-order correlation function, the bispectrum, from N-body simulations that include massive neutrinos as particles. This is the simplest statistics characterising the non-Gaussian properties of the matter and dark matter halos distributions. We investigate, in the first place, the suppression due to massive neutrinos on the matter bispectrum, comparing our measurements with the simplest perturbation theory predictions, finding the approximation of neutrinos contributing at quadratic order in perturbation theory to provide a good fit to the measurements in the simulations. On the other hand, as expected, a linear approximation for neutrino perturbations would lead to O($f_{\nu}$) errors on the total matter bispectrum at large scales. We then attempt an extension of previous results on the universality of linear halo bias in neutrino cosmologies, to non-linear and non-local corrections finding consistent results with the power spectrum analysis.

We present several methods to accurately estimate Lagrangian bias parameters and substantiate them using simulations. In particular, we focus on the quadratic terms, both the local and the non local ones, and show the first clear evidence for the latter in the simulations. Using Fourier space correlations, we also show for the first time, the scale dependence of the quadratic and non-local bias coefficients. For the linear bias, we fit for the scale dependence and demonstrate the validity of a consistency relation between linear bias parameters. Furthermore we employ real space estimators, using both cross-correlations and the Peak-Background Split argument. This is the first time the latter is used to measure anisotropic bias coefficients. We find good agreement for all the parameters among these different methods, and also good agreement for local bias with ESP$\tau$ theory predictions. We also try to exploit possible relations among the different bias parameters. Finally, we show how including higher order bias reduces the magnitude and scale dependence of stochasticity of the halo field.

Gravitational non-linear evolution induces a shift in the position of the baryon acoustic oscillations (BAO) peak together with a damping and broadening of its shape that bias and degrades the accuracy with which the position of the peak can be determined. BAO reconstruction is a technique developed to undo part of the effect of non-linearities. We present and analyse a reconstruction method that consists of displacing pixels instead of galaxies and whose implementation is easier than the standard reconstruction method. We show that this method is equivalent to the standard reconstruction technique in the limit where the number of pixels becomes very large. This method is particularly useful in surveys where individual galaxies are not resolved, as in 21cm intensity mapping observations. We validate this method by reconstructing mock pixelated maps, that we build from the distribution of matter and halos in real- and redshift-space, from a large set of numerical simulations. We find that this method is able to decrease the uncertainty in the BAO peak position by 30-50% over the typical angular resolution scales of 21 cm intensity mapping experiments.

(abridged) We investigate the signatures left by the cosmic neutrino background on the clustering of matter, CDM+baryons and halos in redshift-space using a set of more than 1000 N-body and hydrodynamical simulations with massless and massive neutrinos. We find that the effect neutrinos induce on the clustering of CDM+baryons in redshift-space on small scales is almost entirely due to the change in $\sigma_8$. Neutrinos imprint a characteristic signature in the quadrupole of the matter (CDM+baryons+neutrinos) field on small scales, that can be used to disentangle the effect of $\sigma_8$ and $M_\nu$. We show that the effect of neutrinos on the clustering of halos is very different, on all scales, to the one induced by $\sigma_8$. We find that the effects of neutrinos of the growth rate of CDM+baryons ranges from $\sim0.3\%$ to $2\%$ on scales $k\in[0.01, 0.5]~h{\rm Mpc}^{-1}$ for neutrinos with masses $M_\nu \leqslant 0.15$ eV. We compute the bias between the momentum of halos and the momentum of CDM+baryon and find it to be 1 on large scales for all models with massless and massive neutrinos considered. This point towards a velocity bias between halos and total matter on large scales that it is important to account for in order to extract unbiased neutrino information from velocity/momentum surveys such as kSZ observations. We show that baryonic effects can affect the clustering of matter and CDM+baryons in redshift-space by up to a few percent down to $k=0.5~h{\rm Mpc}^{-1}$. We find that hydrodynamics and astrophysical processes, as implemented in our simulations, only distort the relative effect that neutrinos induce on the anisotropic clustering of matter, CDM+baryons and halos in redshift-space by less than $1\%$. Thus, the effect of neutrinos in the fully non-linear regime can be written as a transfer function with very weak dependence on astrophysics.

We update the ingredients of the Gaussian streaming model (GSM) for the redshift-space clustering of biased tracers using the techniques of Lagrangian perturbation theory, effective field theory (EFT) and a generalized Lagrangian bias expansion. After relating the GSM to the cumulant expansion, we present new results for the real-space correlation function, mean pairwise velocity and pairwise velocity dispersion including counter terms from EFT and bias terms through third order in the linear density, its leading derivatives and its shear up to second order. We discuss the connection to the Gaussian peaks formalism. We compare the ingredients of the GSM to a suite of large N-body simulations, and show the performance of the theory on the low order multipoles of the redshift-space correlation function and power spectrum. We highlight the importance of a general biasing scheme, which we find to be as important as higher-order corrections due to non-linear evolution for the halos we consider on the scales of interest to us.

Cross-correlations between biased tracers and the dark matter field encode information about the physical variables which characterize these tracers. However, if the physical variables of interest are correlated with one another, then extracting this information is not as straightforward as one might naively have thought. We show how to exploit these correlations so as to estimate scale-independent bias factors of all orders in a model-independent way. We also show that failure to account for this will lead to incorrect conclusions about which variables matter and which do not. Morever, accounting for this allows one to use the scale dependence of bias to constrain the physics of halo formation; to date the argument has been phrased the other way around. We illustrate by showing that the scale dependence of linear and nonlinear bias, measured on nonlinear scales, can be used to provide consistent estimates of how the critical density for halo formation depends on halo mass. Our methods work even when the bias is nonlocal and stochastic, such as when, in addition to the spherically averaged density field and its derivatives, the quadrupolar shear field also matters for halo formation. In such models, the nonlocal bias factors are closely related to the more familiar local nonlinear bias factors, which are much easier to measure. Our analysis emphasizes the fact that biased tracers are biased because they do not sample fields (density, velocity, shear, etc.) at all positions in space in the same way that the dark matter does.

Recent analytical work on the modelling of dark halo abundances and clustering has demonstrated the advantages of combining the excursion set approach with peaks theory. We extend these ideas and introduce a model of excursion set peaks that incorporates the role of initial tidal effects or shear in determining the gravitational collapse of dark haloes. The model -- in which the critical density threshold for collapse depends on the tidal influences acting on protohaloes -- is well motivated from ellipsoidal collapse arguments and is also simple enough to be analytically tractable. We show that the predictions of this model are in very good agreement with measurements of the halo mass function and traditional scale dependent halo bias in N-body simulations across a wide range of masses and redshift. The presence of shear in the collapse threshold means that halo bias is naturally predicted to be nonlocal, and that protohalo densities at fixed mass are naturally predicted to have Lognormal-like distributions. We present the first direct estimate of Lagrangian nonlocal bias in N-body simulations, finding broad agreement with the model prediction. Finally, the simplicity of the model (which has essentially a single free parameter) opens the door to building efficient and accurate non-universal fitting functions of halo abundances and bias for use in precision cosmology.

We present a method that extends the capabilities of the PINpointing Orbit-Crossing Collapsed HIerarchical Objects (PINOCCHIO) code, allowing it to generate accurate dark matter halo mock catalogues in cosmological models where the linear growth factor and the growth rate depend on scale. Such cosmologies comprise, among others, models with massive neutrinos and some classes of modified gravity theories. We validate the code by comparing the halo properties from PINOCCHIO against N-body simulations, focusing on cosmologies with massive neutrinos: $\nu\Lambda$CDM. We analyse the halo mass function, halo two-point correlation function, halo power spectrum and the moments of the halo density field, showing that PINOCCHIO reproduces the results from simulations with the same level of precision as the original code ($\sim5-10\%$). We demonstrate that the abundance of halos in cosmologies with massless and massive neutrinos from PINOCCHIO matches very well the outcome of simulations, and point out that PINOCCHIO can reproduce the $\Omega_\nu-\sigma_8$ degeneracy that affects the halo mass function. We show that the clustering properties of the halos from PINOCCHIO matches accurately those from simulations both in real and redshift-space, in the latter case up to $k=0.3~h~{\rm Mpc}^{-1}$. We finally point out that the first moments of the halo density field from simulations are precisely reproduced by PINOCCHIO. We emphasize that the computational time required by PINOCCHIO to generate mock halo catalogues is orders of magnitude lower than the one needed for N-body simulations. This makes this tool ideal for applications like covariance matrix studies within the standard $\Lambda$CDM model but also in cosmologies with massive neutrinos or some modified gravity theories.

The spatial distribution of neutral hydrogen (HI) in the Universe contains a wealth of cosmological information. The 21 cm emission line can be used to map the HI up to very high redshift and therefore reveal us something about the evolution of the large scale structures in the Universe. However little is known about the abundance and clustering properties of the HI over cosmic time. Motivated by this, we build an analytic framework where the relevant parameters that govern how the HI is distributed among dark matter halos can be fixed using observations. At the same time we provide tools to study the column density distribution function of the HI absorbers together with their clustering properties. Our formalism is the first one able to account for all observations at a single redshift, $z = 2.3$. The linear bias of the HI and the mean number density of HI sources, two main ingredients in the calculation of the signal-to-noise ratio of a cosmological survey, are then discussed in detail, also extrapolating the results to low and high redshift. We find that HI bias is relatively higher than the value reported in similar studies, but the shot noise level is always sub dominant, making the HI Power Spectrum always a high signal-to-noise measurements up to $z\simeq5$ in the limit of no instrumental noise and foreground contamination.

We present the latest version of Pinocchio, a code that generates catalogues of DM haloes in an approximate but fast way with respect to an N-body simulation. This code version extends the computation of particle and halo displacements up to 3rd-order Lagrangian Perturbation Theory (LPT), in contrast with previous versions that used Zeldovich approximation (ZA). We run Pinocchio on the same initial configuration of a reference N-body simulation, so that the comparison extends to the object-by-object level. We consider haloes at redshifts 0 and 1, using different LPT orders either for halo construction - where displacements are needed to decide particle accretion onto a halo or halo merging - or to compute halo final positions. We compare the clustering properties of Pinocchio haloes with those from the simulation by computing the power spectrum and 2-point correlation function (2PCF) in real and redshift space (monopole and quadrupole), the bispectrum and the phase difference of halo distributions. We find that 2LPT and 3LPT give noticeable improvement. 3LPT provides the best agreement with N-body when it is used to displace haloes, while 2LPT gives better results for constructing haloes. At the highest orders, linear bias is typically recovered at a few per cent level. In Fourier space and using 3LPT for halo displacements, the halo power spectrum is recovered to within 10 per cent up to $k_{max}\sim0.5\ h/$Mpc. The results presented in this paper have interesting implications for the generation of large ensemble of mock surveys aimed at accurately compute covariance matrices for clustering statistics.

(abridged) We analyse the clustering features of Large Scale Structures (LSS) in the presence of massive neutrinos, employing a set of large-volume, high-resolution cosmological N-body simulations, where neutrinos are treated as a separate collisionless fluid. The volume of 8$\cGpc$, combined with a resolution of about $8\times 10^{10}\Ms$ for the cold dark matter (CDM) component, represents a significant improvement over previous N-body simulations in massive neutrino cosmologies. We show that most of the nonlinear evolution is generated exclusively by the CDM component. We find that accounting only for the nonlinear evolution of the CDM power spectrum allows to recover the total matter power spectrum with the same accuracy as the massless case. Indeed, we show that, the most recent version of the \halofit\ formula calibrated on $\Lambda$CDM simulations can be applied directly to the linear CDM power spectrum without requiring additional fitting parameters in the massive case. As a second step, we study the abundance and clustering properties of CDM halos, confirming that, in massive neutrino cosmologies, the proper definition of the halo bias should be made with respect to the {\em cold} rather than the {\em total} matter distribution, as recently shown in the literature. Here we extend these results to the redshift space, finding that, when accounting for massive neutrinos, an improper definition of the linear bias can lead to a systematic error of about 1-$2 \%$ in the determination of the linear growth rate from anisotropic clustering. This result is quite important if we consider that future spectroscopic galaxy surveys, as \eg\ Euclid, are expected to measure the linear growth-rate with statistical errors less than about $3 \%$ at $z\lesssim1$.

We use a suite of N-body simulations that incorporate massive neutrinos as an extra-set of particles to investigate their effect on the halo mass function. We show that for cosmologies with massive neutrinos the mass function of dark matter haloes selected using the spherical overdensity (SO) criterion is well reproduced by the fitting formula of Tinker et al. (2008) once the cold dark matter power spectrum is considered instead of the total matter power, as it is usually done. The differences between the two implementations, i.e. using $P_{\rm cdm}(k)$ instead of $P_{\rm m}(k)$, are more pronounced for large values of the neutrino masses and in the high end of the halo mass function: in particular, the number of massive haloes is higher when $P_{\rm cdm}(k)$ is considered rather than $P_{\rm m}(k)$. As a quantitative application of our findings we consider a Planck-like SZ-clusters survey and show that the differences in predicted number counts can be as large as $30\%$ for $\sum m_\nu = 0.4$ eV. Finally, we use the Planck-SZ clusters sample, with an approximate likelihood calculation, to derive Planck-like constraints on cosmological parameters. We find that, in a massive neutrino cosmology, our correction to the halo mass function produces a shift in the $\sigma_8(\Omega_{\rm m}/0.27)^\gamma$ relation which can be quantified as $\Delta \gamma \sim 0.05$ and $\Delta \gamma \sim 0.14$ assuming one ($N_\nu=1$) or three ($N_\nu=3$) degenerate massive neutrino, respectively. The shift results in a lower mean value of $\sigma_8$ with $\Delta \sigma_8 = 0.01$ for $N_\nu=1$ and $\Delta \sigma_8 = 0.02$ for $N_\nu=3$, respectively. Such difference, in a cosmology with massive neutrinos, would increase the tension between cluster abundance and Planck CMB measurements.

We use a large suite of N-body simulations to study departures from universality in halo abundances and clustering in cosmologies with non-vanishing neutrino masses. To this end, we study how the halo mass function and halo bias factors depend on the scaling variable $\sigma^2(M,z)$, the variance of the initial matter fluctuation field, rather than on halo mass $M$ and redshift $z$ themselves. We show that using the variance of the cold dark matter rather than the total mass field, i.e., $\sigma^2_{cdm}(M,z)$ rather than $\sigma^2_{m}(M,z)$, yields more universal results. Analysis of halo bias yields similar conclusions: When large-scale halo bias is defined with respect to the cold dark matter power spectrum, the result is both more universal, and less scale- or $k$-dependent. These results are used extensively in Papers I and III of this series.

By using a suite of large box-size N-body simulations that incorporate massive neutrinos as an extra set of particles, we investigate the impact of neutrino masses on the spatial distribution of dark matter haloes and galaxies. We compute the bias between the spatial distribution of dark matter haloes and the overall matter and cold dark matter distributions using statistical tools such as the power spectrum and the two-point correlation function. Overall we find a scale-dependent bias on large scales for the cosmologies with massive neutrinos. However, our results indicate that the scale-dependence in the bias is reduced if the latter is computed with respect to the cold dark matter distribution only. We find that the value of the bias on large scales is reasonably well reproduced by the Tinker fitting formula once the linear cold dark matter power spectrum is used, instead of the total matter power spectrum. We investigate whether scale-dependent bias really comes from purely neutrino's effect or from nonlinear gravitational collapse of haloes. For this purpose, we address the $\Omega_\nu$-$\sigma_8$ degeneracy and find that such degeneracy is not perfect, implying that neutrinos imprint a slight scale dependence on the large-scale bias. Finally, by using a simple halo occupation distribution (HOD) model, we investigate the impact of massive neutrinos on the distribution of galaxies within dark matter haloes. We use the main galaxy sample in the Sloan Digital Sky Survey II Data Release 7 to investigate if the small-scale galaxy clustering alone can be used to discriminate among different cosmological models with different neutrino masses. Our results suggest that different choices of the HOD parameters can reproduce the observational measurements relatively well, and we quantify the difference between the values of the HOD parameters between massless and massive neutrino cosmologies.

We describe a simple fully analytic model of the excursion set approach associated with two Gaussian random walks: the first walk represents the initial overdensity around a protohalo, and the second is a crude way of allowing for other factors which might influence halo formation. This model is richer than that based on a single walk, because it yields a distribution of heights at first crossing. We provide explicit expressions for the unconditional first crossing distribution which is usually used to model the halo mass function, the progenitor distributions, and the conditional distributions from which correlations with environment are usually estimated. These latter exhibit perhaps the simplest form of what is often called nonlocal bias, and which we prefer to call stochastic bias, since the new bias effects arise from `hidden-variables' other than density, but these may still be defined locally. We provide explicit expressions for these new bias factors. We also provide formulae for the distribution of heights at first crossing in the unconditional and conditional cases. In contrast to the first crossing distribution, these are exact, even for moving barriers, and for walks with correlated steps. The conditional distributions yield predictions for the distribution of halo concentrations at fixed mass and formation redshift. They also exhibit assembly bias like effects, even when the steps in the walks themselves are uncorrelated. Finally, we show how the predictions are modified if we add the requirement that halos form around peaks: these depend on whether the peaks constraint is applied to a combination of the overdensity and the other variable, or to the overdensity alone. Our results demonstrate the power of requiring models to reproduce not just halo counts but the distribution of overdensities at fixed protohalo mass as well.

The AMADEUS (ANTARES Modules for the Acoustic Detection Under the Sea) system which is described in this article aims at the investigation of techniques for acoustic detection of neutrinos in the deep sea. It is integrated into the ANTARES neutrino telescope in the Mediterranean Sea. Its acoustic sensors, installed at water depths between 2050 and 2300 m, employ piezo-electric elements for the broad-band recording of signals with frequencies ranging up to 125 kHz. The typical sensitivity of the sensors is around -145 dB re 1V/muPa (including preamplifier). Completed in May 2008, AMADEUS consists of six "acoustic clusters", each comprising six acoustic sensors that are arranged at distances of roughly 1 m from each other. Two vertical mechanical structures (so-called lines) of the ANTARES detector host three acoustic clusters each. Spacings between the clusters range from 14.5 to 340 m. Each cluster contains custom-designed electronics boards to amplify and digitise the acoustic signals from the sensors. An on-shore computer cluster is used to process and filter the data stream and store the selected events. The daily volume of recorded data is about 10 GB. The system is operating continuously and automatically, requiring only little human intervention. AMADEUS allows for extensive studies of both transient signals and ambient noise in the deep sea, as well as signal correlations on several length scales and localisation of acoustic point sources. Thus the system is excellently suited to assess the background conditions for the measurement of the bipolar pulses expected to originate from neutrino interactions.

While the baryon asymmetry of the Universe is nowadays well measured by cosmological observations, the bounds on the lepton asymmetry in the form of neutrinos are still significantly weaker. We place limits on the relic neutrino asymmetries using some of the latest cosmological data, taking into account the effect of flavor oscillations. We present our results for two different values of the neutrino mixing angle \theta_{13}, and show that for large \theta_{13} the limits on the total neutrino asymmetry become more stringent, diluting even large initial flavor asymmetries. In particular, we find that the present bounds are still dominated by the limits coming from Big Bang Nucleosynthesis, while the limits on the total neutrino mass from cosmological data are essentially independent of \theta_{13}. Finally, we perform a forecast for COrE, taken as an example of a future CMB experiment, and find that it could improve the limits on the total lepton asymmetry approximately by up to a factor 6.6.

An Acoustic Doppler Current Profiler (ADCP) was moored at the deep-sea site of the ANTARES neutrino telescope near Toulon, France, thus providing a unique opportunity to compare high-resolution acoustic and optical observations between 70 and 170 m above the sea bed at 2475 m. The ADCP measured downward vertical currents of magnitudes up to 0.03 m s-1 in late winter and early spring 2006. In the same period, observations were made of enhanced levels of acoustic reflection, interpreted as suspended particles including zooplankton, by a factor of about 10 and of horizontal currents reaching 0.35 m s-1. These observations coincided with high light levels detected by the telescope, interpreted as increased bioluminescence. During winter 2006 deep dense-water formation occurred in the Ligurian subbasin, thus providing a possible explanation for these observations. However, the 10-20 days quasi-periodic episodes of high levels of acoustic reflection, light and large vertical currents continuing into the summer are not direct evidence of this process. It is hypothesized that the main process allowing for suspended material to be moved vertically later in the year is local advection, linked with topographic boundary current instabilities along the rim of the 'Northern Current'.