We address the problem of inferring the three-dimensional matter distribution from a sparse set of one-dimensional quasar absorption spectra of the Lyman-$\alpha$ forest. Using a Bayesian forward modelling approach, we focus on extending the dynamical model to a fully self-consistent hierarchical field-level prediction of redshift-space quasar absorption sightlines. Our field-level approach rests on a recently developed semiclassical analogue to Lagrangian perturbation theory (LPT), which improves over noise problems and interpolation requirements of LPT. It furthermore allows for a manifestly conservative mapping of the optical depth to redshift space. In addition, this new dynamical model naturally introduces a coarse-graining scale, which we exploit to accelerate the MCMC sampler using simulated annealing. By gradually reducing the effective temperature of the forward model, we can allow it to converge first on large spatial scales before the sampler becomes sensitive to the increasingly larger space of smaller scales. We demonstrate the advantages -- in terms of speed and noise properties -- of this field-level approach over using LPT as a forward model, and, using mock data, validate its performance to reconstruct three-dimensional primordial perturbations and matter distribution from sparse quasar sightlines.

We present updates on the cosmology inference using the effective field theory (EFT) likelihood presented previously in Schmidt et al., 2018, Elsner et al., 2019 [1,2]. Specifically, we add a cutoff to the initial conditions that serve as starting point for the matter forward model. We show that this cutoff, which was not employed in any previous related work, is important to regularize loop integrals that otherwise involve small-scale, non-perturbative modes. We then present results on the inferred value of the linear power spectrum normalization $\sigma_{8}$ from rest-frame halo catalogs using both second- and third-order bias expansions, imposing uniform priors on all bias parameters. Due to the perfect bias-$\sigma_{8}$ degeneracy at linear order, constraints on $\sigma_{8}$ rely entirely on nonlinear information. The results show the expected convergence behavior when lowering the cutoff in wavenumber, $\Lambda$. When including modes up to $k \leq \Lambda = 0.1\,h\,{\rm Mpc}^{-1}$ in the second-order case, $\sigma_{8}$ is recovered to within $\lesssim 6\,\%$ for a range of halo masses and redshifts. The systematic bias shrinks to $4\,\%$ or less for the third-order bias expansion on the same range of scales. Together with additional evidence we provide, this shows that the residual mismatch in $\sigma_{8}$ can be attributed to higher-order bias contributions. We conclude that the EFT likelihood is able to infer unbiased cosmological constraints, within expected theoretical systematic errors, from physical biased tracers on quasilinear scales

Existing cosmological simulation methods lack a high degree of parallelism due to the long-range nature of the gravitational force, which limits the size of simulations that can be run at high resolution. To solve this problem, we propose a new, perfectly parallel approach to simulate cosmic structure formation, based on the spatial COmoving Lagrangian Acceleration (sCOLA) framework. Building upon a hybrid analytical and numerical description of particles' trajectories, our algorithm allows an efficient tiling of a cosmological volume, where the dynamics within each tile is computed independently. As a consequence, the degree of parallelism is equal to the number of tiles. We optimise the accuracy of sCOLA by the use of a buffer region around tiles, and of appropriate Dirichlet boundary conditions around sCOLA boxes. As a result, we show that cosmological simulations at the degree of accuracy required for the analysis of the next generation of surveys can be run in drastically reduced wall-clock times and with very low memory requirements. The perfect scalability of our algorithm unlocks profoundly new possibilities of computing larger and higher-resolution cosmological simulations, taking advantage of a variety of hardware architectures.

We study structure formation in a set of cosmological simulations to uncover the scales in the initial density field that gave rise to the formation of present-day structures. Our simulations share a common primordial power spectrum (here Lambda-CDM), but the introduction of hierarchical variations of the phase information allows us to systematically study the scales that determine the formation of structure at later times. We consider the variance in z=0 statistics such as the matter power spectrum and halo mass function. We also define a criterion for the existence of individual haloes across simulations, and determine what scales in the initial density field contain sufficient information for the non-linear formation of unique haloes. We study how the characteristics of individual haloes such as the mass and concentration, as well as the position and velocity, are affected by variations on different scales, and give scaling relations for haloes of different mass. Finally, we use the example of a cluster-mass halo to show how our hierarchical parametrisation of the initial density field can be used to create variants of particular objects. With properties such as mass, concentration, kinematics and substructure of haloes set on distinct and well-determined scales, and its unique ability to introduce variations localised in real space, our method is a powerful tool to study structure formation in cosmological simulations.

The effective-field-theory (EFT) approach to the clustering of galaxies and other biased tracers allows for an isolation of the cosmological information that is protected by symmetries, in particular the equivalence principle, and thus is robust to the complicated dynamics of dark matter, gas, and stars on small scales. All existing implementations proceed by making predictions for the lowest-order $n$-point functions of biased tracers, as well as their covariance, and comparing with measurements. Recently, we presented an EFT-based expression for the conditional probability of the density field of a biased tracer given the matter density field, which in principle combines information from arbitrarily high order $n$-point functions. Here, we report results based on this likelihood by applying it to halo catalogs in real space, specifically on the inference of the power spectrum normalization $\sigma_8$. We include bias terms up to second order as well as the leading higher-derivative term. For a cutoff value of $\Lambda = 0.1 h\,{\rm Mpc}^{-1}$, we recover the ground-truth value of $\sigma_8$ to within 95% CL for different halo samples and redshifts. We discuss possible sources for the remaining systematic bias in $\sigma_8$ as well as future developments.

The peculiar velocity field offers a unique way to probe dark matter density field on large scales at low redshifts. In this work, we have compiled a new sample of 465 peculiar velocities from low redshift $(z < 0.067)$ Type Ia supernovae. We compare the reconstructed velocity field derived from the 2M++ galaxy redshift compilation to the supernovae, the SFI++ and the 2MTF Tully-Fisher distance catalogues. We used a forward method to jointly infer the distances and the velocities of distance indicators by comparing the observations to the reconstruction. Comparison of the reconstructed peculiar velocity fields to observations allows us to infer the cosmological parameter combination $f\sigma_8$, and the bulk flow velocity arising from outside the survey volume. The residual bulk flow arising from outside the 2M++ volume is inferred to be $159^{+12}_{-11}$ km s$^{-1}$ in the direction $l=259^{\circ} \pm 4^{\circ}$ and $b= 5^{\circ}\pm 3^{\circ}$. We obtain $f\sigma_{8} = 0.401 \pm 0.017$, equivalent to $\sigma_8(\Omega_m/0.3)^{0.55}=0.775 \pm 0.033$, a $\lesssim 4\%\,$ statistical uncertainty on the value of $f\sigma_8$. Our inferred value is consistent with other low redshift results in the literature.

We reconstruct the 3D structure of magnetic fields, which were seeded by density perturbations during the radiation dominated epoch of the Universe and later on were evolved by structure formation. To achieve this goal, we rely on three dimensional initial density fields inferred from the 2M++ galaxy compilation via the Bayesian $\texttt{BORG}$ algorithm. Using those, we estimate the magnetogenesis by the so called Harrison mechanism. This effect produced magnetic fields exploiting the different photon drag on electrons and ions in vortical motions, which are exited due to second order perturbation effects in the Early Universe. Subsequently we study the evolution of these seed fields through the non-linear cosmic structure formation by virtue of a MHD simulation to obtain a 3D estimate for the structure of this primordial magnetic field component today. At recombination we obtain a reliable lower limit on the large scale magnetic field strength around $10^{-23} \mathrm{G}$, with a power spectrum peaking at about $ 2\, \mathrm{Mpc}^{-1}h$ in comoving scales. At present we expect this evolved primordial field to have strengthts above $\approx 10^{-27}\, \mathrm{G}$ and $\approx 10^{-29}\, \mathrm{G}$ in clusters of galaxies and voids, respectively. We also calculate the corresponding Faraday rotation measure map and show the magnetic field morphology and strength for specific objects of the Local Universe.

We present an augmented version of our dual messenger algorithm for spin field reconstruction on the sphere, while accounting for highly non-trivial and realistic noise models such as modulated correlated noise. We also describe an optimization method for the estimation of noise covariance from Monte Carlo simulations. Using simulated Planck polarized cosmic microwave background (CMB) maps as a showcase, we demonstrate the capabilities of the algorithm in reconstructing pure E and B maps, guaranteed to be free from ambiguous modes resulting from the leakage or coupling issue that plagues conventional methods of E/B separation. Due to its high speed execution, coupled with lenient memory requirements, the algorithm can be optimized in exact global Bayesian analyses of state-of-the-art CMB data for a statistically optimal separation of pure E and B modes. Our algorithm, therefore, has a potentially key role in the data analysis of high-resolution and high-sensitivity CMB data, especially with the range of upcoming CMB experiments tailored for the detection of the elusive primordial B-mode signal.

Gravitational wave (GW) sources are an excellent probe of the luminosity distance and offer a novel measure of the Hubble constant, $H_0$. This estimation of $H_0$ from standard sirens requires an accurate estimation of the cosmological redshift of the host galaxy of the GW source, after correcting for its peculiar velocity. Absence of an accurate peculiar velocity correction affects both the precision and accuracy of the measurement of $H_0$, particularly for nearby sources. We propose a framework to incorporate such a peculiar velocity correction for GW sources. The implementation of our method to the event GW170817 combined with the Very Large Baseline Interferometry (VLBI) observation leads to a revised value of $H_0= 69.3^{+ 4.5}_{-4.0}$ km s$^{-1}$Mpc$^{-1}$; more importantly, it demonstrates that our method will allow to achieve in practice unbiased, accurate measurements of $H_0$ at the precision promised by standard siren forecasts.

One of the major science goals over the coming decade is to test fundamental physics with probes of the cosmic large-scale structure out to high redshift. Here we present a fully Bayesian approach to infer the three-dimensional cosmic matter distribution and its dynamics at $z>2$ from observations of the Lyman-$\alpha$ forest. We demonstrate that the method recovers the unbiased mass distribution and the correct matter power spectrum at all scales. Our method infers the three-dimensional density field from a set of one-dimensional spectra, interpolating the information between the lines of sight. We show that our algorithm provides unbiased mass profiles of clusters, becoming an alternative for estimating cluster masses complementary to weak lensing or X-ray observations. The algorithm employs a Hamiltonian Monte Carlo method to generate realizations of initial and evolved density fields and the three-dimensional large-scale flow, revealing the cosmic dynamics at high redshift. The method correctly handles multi-modal parameter distributions, which allow constraining the physics of the intergalactic medium (IGM) with high accuracy. We performed several tests using realistic simulated quasar spectra to test and validate our method. Our results show that detailed and physically plausible inference of three-dimensional large-scale structures at high redshift has become feasible.

We perform an analysis of the three-dimensional cosmic matter density field traced by galaxies of the SDSS-III/BOSS galaxy sample. The systematic-free nature of this analysis is confirmed by two elements: the successful cross-correlation with the gravitational lensing observations derived from Planck 2018 data and the absence of bias at scales $k \simeq 10^{-3}-10^{-2}h$ Mpc$^{-1}$ in the a posteriori power spectrum of recovered initial conditions. Our analysis builds upon our algorithm for Bayesian Origin Reconstruction from Galaxies (BORG) and uses a physical model of cosmic structure formation to infer physically meaningful cosmic structures and their corresponding dynamics from deep galaxy observations. Our approach accounts for redshift-space distortions and light-cone effects inherent to deep observations. We also apply detailed corrections to account for known and unknown foreground contaminations, selection effects and galaxy biases. We obtain maps of residual, so far unexplained, systematic effects in the spectroscopic data of SDSS-III/BOSS. Our results show that unbiased and physically plausible models of the cosmic large scale structure can be obtained from present and next-generation galaxy surveys.

An ambitious goal in cosmology is to forward-model the observed distribution of galaxies in the nearby Universe today from the initial conditions of large-scale structures. For practical reasons, the spatial resolution at which this can be done is necessarily limited. Consequently, one needs a mapping between the density of dark matter averaged over ~Mpc scales, and the distribution of dark matter halos (used as a proxy for galaxies) in the same region. Here we demonstrate a method for determining the halo mass distribution function by learning the tracer bias between density fields and halo catalogues using a neural bias model. The method is based on the Bayesian analysis of simple, physically motivated, neural network-like architectures, which we denote as neural physical engines, and neural density estimation. As a result, we are able to sample the initial phases of the dark matter density field whilst inferring the parameters describing the halo mass distribution function, providing a fully Bayesian interpretation of both the initial dark matter density distribution and the neural bias model. We successfully run an upgraded BORG inference using our new likelihood and neural bias model with halo catalogues derived from full N-body simulations. We notice orders of magnitude improvement in modelling compared to classical biasing techniques.

We present a novel halo painting network that learns to map approximate 3D dark matter fields to realistic halo distributions. This map is provided via a physically motivated network with which we can learn the non-trivial local relation between dark matter density field and halo distributions without relying on a physical model. Unlike other generative or regressive models, a well motivated prior and simple physical principles allow us to train the mapping network quickly and with relatively little data. In learning to paint halo distributions from computationally cheap, analytical and non-linear density fields, we bypass the need for full particle mesh simulations and halo finding algorithms. Furthermore, by design, our halo painting network needs only local patches of dark matter density to predict the halos, and as such, it can predict the 3D halo distribution for any arbitrary simulation box size. Our neural network can be trained using small simulations and used to predict large halo distributions, as long as the resolutions are equivalent. We evaluate our model's ability to generate 3D halo count distributions which reproduce, to a high degree, summary statistics such as the power spectrum and bispectrum, of the input or reference realizations.

The treatment of unknown foreground contaminations will be one of the major challenges for galaxy clustering analyses of coming decadal surveys. These data contaminations introduce erroneous large-scale effects in recovered power spectra and inferred dark matter density fields. In this work, we present an effective solution to this problem in the form of a robust likelihood designed to account for effects due to unknown foreground and target contaminations. Conceptually, this robust likelihood marginalizes over the unknown large-scale contamination amplitudes. We showcase the effectiveness of this novel likelihood via an application to a mock SDSS-III data set subject to dust extinction contamination. In order to illustrate the performance of our proposed likelihood, we infer the underlying dark-matter density field and reconstruct the matter power spectrum, being maximally agnostic about the foregrounds. The results are compared to those of an analysis with a standard Poissonian likelihood, as typically used in modern large-scale structure analyses. While the standard Poissonian analysis yields excessive power for large-scale modes and introduces an overall bias in the power spectrum, our likelihood provides unbiased estimates of the matter power spectrum over the entire range of Fourier modes considered in this work. Further, we demonstrate that our approach accurately accounts for and corrects the effects of unknown foreground contaminations when inferring three-dimensional density fields. Robust likelihood approaches, as presented in this work, will be crucial to control unknown systematic error and maximize the outcome of the decadal surveys.

Conventional approaches to cosmology inference from galaxy redshift surveys are based on n-point functions, which are under rigorous perturbative control on sufficiently large scales. Here, we present an alternative approach, which employs a likelihood at the level of the galaxy density field. By integrating out small-scale modes based on effective-field theory arguments, we prove that this likelihood is under perturbative control if certain specific conditions are met. We further show that the information captured by this likelihood is equivalent to the combination of the next-to-leading order galaxy power spectrum, leading-order bispectrum, and BAO reconstruction. Combined with MCMC sampling and MAP optimization techniques, our results allow for fully Bayesian cosmology inference from large-scale structure that is under perturbative control. We illustrate this via a first demonstration of unbiased cosmology inference from nonlinear large-scale structure using this likelihood. In particular, we show unbiased estimates of the power spectrum normalization $\sigma_{8}$ from a catalog of simulated dark matter halos, where nonlinear information is crucial in breaking the $b_{1} - \sigma_{8}$ degeneracy.

A hierarchical Bayesian model is applied to the Cosmicflows-3 catalog of galaxy distances in order to derive the peculiar velocity field and distribution of matter within $z \sim 0.054$. The model assumes the $\Lambda$CDM model within the linear regime and includes the fit of the galaxy distances together with the underlying density field. By forward modeling the data, the method is able to mitigate biases inherent to peculiar velocity analyses, such as the Homogeneous Malmquist bias or the log-normal distribution of peculiar velocities. The statistical uncertainty on the recovered velocity field is about 150 km/s depending on the location, and we study systematics coming from the selection function and calibration of distance indicators. The resulting velocity field and related density fields recover the cosmography of the Local Universe which is presented in an unprecedented volume of universe 10 times larger than previously reached. This methodology open the doors to reconstruction of initial conditions for larger and more accurate constrained cosmological simulations. This work is also preparatory to larger peculiar velocity datasets coming from Wallaby, TAIPAN or LSST.

Extensions of the standard models of particle physics and cosmology often lead to long-range fifth forces with properties dependent on gravitational environment. Fifth forces on astrophysical scales are best studied in the cosmic web where perturbation theory breaks down. We present constraints on chameleon- and symmetron-screened fifth forces with Yukawa coupling and megaparsec range -- as well as unscreened fifth forces with differential coupling to galactic mass components -- by searching for the displacements they predict between galaxies' stars and gas. Taking data from the Alfalfa HI survey, identifying galaxies' gravitational environments with the maps of Desmond et al. (2018a) and forward-modelling with a Bayesian likelihood framework, we set upper bounds on fifth-force strength relative to Newtonian gravity from $\Delta G/G_N < \text{few} \: \times 10^{-4}$ for range $\lambda_C = 50$ Mpc, to $\Delta G/G_N \lesssim 0.1$ for $\lambda_C = 500$ kpc. In $f(R)$ gravity this requires $f_{R0} < \text{few} \: \times \: 10^{-8}$. The analogous bounds without screening are $\Delta G/G_N < \text{few} \: \times 10^{-4}$ and $\Delta G/G_N < \text{few} \times 10^{-3}$. These are the tightest and among the only fifth-force constraints on galaxy scales. We show how our results may be strengthened with future survey data and identify the key features of an observational programme for furthering fifth-force tests beyond the Solar System.

We present a large-scale Bayesian inference framework to constrain cosmological parameters using galaxy redshift surveys, via an application of the Alcock-Paczy\'nski (AP) test. Our physical model of the non-linearly evolved density field, as probed by galaxy surveys, employs Lagrangian perturbation theory (LPT) to connect Gaussian initial conditions to the final density field, followed by a coordinate transformation to obtain the redshift space representation for comparison with data. We generate realizations of primordial and present-day matter fluctuations given a set of observations. This hierarchical approach encodes a novel AP test, extracting several orders of magnitude more information from the cosmological expansion compared to classical approaches, to infer cosmological parameters and jointly reconstruct the underlying 3D dark matter density field. The novelty of this AP test lies in constraining the comoving-redshift transformation to infer the appropriate cosmology which yields isotropic correlations of the galaxy density field, with the underlying assumption relying purely on the cosmological principle. Such an AP test does not rely explicitly on modelling the full statistics of the field. We verify in depth via simulations that this renders our test robust to model misspecification. This leads to another crucial advantage, namely that the cosmological parameters exhibit extremely weak dependence on the currently unresolved phenomenon of galaxy bias, thereby circumventing a potentially key limitation. This is consequently among the first methods to extract a large fraction of information from statistics other than that of direct density contrast correlations, without being sensitive to the amplitude of density fluctuations. We perform several statistical efficiency and consistency tests on a mock galaxy catalogue, using the SDSS-III survey as template.

Intra-galaxy signals contain a wealth of information on fundamental physics, both the dark sector and the nature of gravity. While so far largely unexplored, such probes are set to rise dramatically in importance as upcoming surveys provide data of unprecedented quantity and quality on galaxy structure and dynamics. In this paper, we use warping of stellar disks to test the chameleon- or symmetron-screened fifth forces which generically arise when new fields couple to matter. We take r-band images of mostly late-type galaxies from the Nasa Sloan Atlas and develop an automated algorithm to quantify the degree of U-shaped warping they exhibit. We then forward-model the warp signal as a function of fifth-force strength $\Delta G/G_N$ and range $\lambda_C$, and the gravitational environments and internal properties of the galaxies, including full propagation of the non-Gaussian uncertainties. Convolving this fifth-force likelihood function with a Gaussian describing astrophysical and observational noise and then constraining $\Delta G/G_N$ and $\lambda_C$ by Markov Chain Monte Carlo, we find the overall likelihood to be significant increased ($\Delta\log(\mathcal{L}) \simeq 20$) by adding a screened fifth force with $\lambda_C \simeq 2$ Mpc, $\Delta G/G_N \simeq 0.01$. The variation of $\Delta\log(\mathcal{L})$ with $\lambda_C$ is quantitatively as expected from the correlation of the magnitude of the fifth-force field with the force's range, and a similar model without screening achieves no increase in likelihood over the General Relativistic case $\Delta G=0$. Although these results are in good agreement with a previous analysis of the same model using offsets between galaxies' stellar and gas mass centroids (Desmond et al. 2018), we caution that the effects of confounding baryonic and dark matter physics must be thoroughly investigated for the results of the inference to be unambiguous.

One of the most common consequences of extensions to the standard models of particle physics or cosmology is the emergence of a fifth force. While generic fifth forces are tightly constrained at Solar System scales and below, they may escape detection by means of a screening mechanism which effectively removes them in dense environments. We constrain the strength $\Delta G/G_N$ and range $\lambda_C$ of a chameleon- or symmetron-screened fifth force with Yukawa coupling -- as well as an unscreened fifth force with differential coupling to galactic mass components -- by searching for the displacement it predicts between galaxies' stellar and gas mass centroids. Taking data from the Alfalfa HI survey, identifying galaxies' gravitational environments with the maps of Desmond et al. (2018a) and forward-modelling with a Bayesian likelihood framework, we find $6.6\sigma$ evidence for $\Delta G>0$ at $\lambda_C \simeq 2$ Mpc, with $\Delta G/G_N = 0.025$ at maximum-likelihood. A similar fifth-force model without screening gives no increase in likelihood over the case $\Delta G = 0$ for any $\lambda_C$. Although we validate these results by several methods, we do not claim screened modified gravity to provide the only possible explanation for the signal: this would require knowing that "galaxy formation" physics could not be responsible. We show also the results of a more conservative -- though less well motivated -- noise model which yields only upper limits on $\Delta G/G_N$, ranging from $\sim10^{-1}$ for $\lambda_C \simeq 0.5$ Mpc to $\sim \: \text{few} \times 10^{-4}$ at $\lambda_C \simeq 50$ Mpc. We show how these constraints may be improved by future galaxy surveys and identify the key features of an observational programme for directly constraining fifth forces on galactic scales. This paper provides a complete description of the analysis summarised in Desmond et al. (2018b).

Compressing large data sets to a manageable number of summaries that are informative about the underlying parameters vastly simplifies both frequentist and Bayesian inference. When only simulations are available, these summaries are typically chosen heuristically, so they may inadvertently miss important information. We introduce a simulation-based machine learning technique that trains artificial neural networks to find non-linear functionals of data that maximise Fisher information: information maximising neural networks (IMNNs). In test cases where the posterior can be derived exactly, likelihood-free inference based on automatically derived IMNN summaries produces nearly exact posteriors, showing that these summaries are good approximations to sufficient statistics. In a series of numerical examples of increasing complexity and astrophysical relevance we show that IMNNs are robustly capable of automatically finding optimal, non-linear summaries of the data even in cases where linear compression fails: inferring the variance of Gaussian signal in the presence of noise; inferring cosmological parameters from mock simulations of the Lyman-{\alpha} forest in quasar spectra; and inferring frequency-domain parameters from LISA-like detections of gravitational waveforms. In this final case, the IMNN summary outperforms linear data compression by avoiding the introduction of spurious likelihood maxima. We anticipate that the automatic physical inference method described in this paper will be essential to obtain both accurate and precise cosmological parameter estimates from complex and large astronomical data sets, including those from LSST and Euclid.

Accurate analyses of present and next-generation galaxy surveys require new ways to handle effects of non-linear gravitational structure formation in data. To address these needs we present an extension of our previously developed algorithm for Bayesian Origin Reconstruction from Galaxies to analyse matter clustering at non-linear scales in observations. This is achieved by incorporating a numerical particle mesh model of structure formation into our Bayesian inference framework. The algorithm simultaneously infers the 3D primordial matter fluctuations from which present non-linear observations formed and provides reconstructions of velocity fields and structure formation histories. The physical forward modelling approach automatically accounts for non-Gaussian features in evolved matter density fields and addresses the redshift space distortion problem associated with peculiar motions of galaxies. Our algorithm employs a hierarchical Bayes approach to jointly account for observational effects, such as galaxy biases, selection effects, and noise. Corresponding parameters are marginalized out via a sophisticated Markov Chain Monte Carlo approach relying on a combination of a multiple block sampling framework and a Hamiltonian Monte Carlo sampler. We demonstrate the performance of the method by applying it to the 2M++ galaxy compilation, tracing the matter distribution of the Nearby Universe. We show accurate and detailed inferences of the 3D non-linear dark matter distribution of the Nearby Universe. As exemplified in the case of the Coma cluster, we provide mass estimates that are compatible with those obtained from weak lensing and X-ray observations. For the first time, we reconstruct the vorticity of the non-linear velocity field from observations. In summary, our method provides plausible and detailed inferences of dark matter and velocity fields of our cosmic neighbourhood.

The "Square Kilometre Array" (SKA) is a large international radio telescope project characterised, as suggested by its name, by a total collecting area of approximately one square kilometre, and consisting of several interferometric arrays to observe at metric and centimetric wavelengths. The deployment of the SKA will take place in two sites, in South Africa and Australia, and in two successive phases. From its Phase 1, the SKA will be one of the most formidable scientific machines ever deployed by mankind, and by far the most impressive in terms of data throughput and required computing power. With the participation of almost 200 authors from forty research institutes and six private companies, the publication of this French SKA white paper illustrates the strong involvement in the SKA project of the French astronomical community and of a rapidly growing number of major scientific and technological players in the fields of Big Data, high performance computing, energy production and storage, as well as system integration.

We adapt our recently proposed dual messenger algorithm for spin field reconstruction and showcase its efficiency and effectiveness in Wiener filtering polarized cosmic microwave background (CMB) maps. Unlike conventional preconditioned conjugate gradient (PCG) solvers, our preconditioner-free technique can deal with high-resolution joint temperature and polarization maps with inhomogeneous noise distributions and arbitrary mask geometries with relative ease. Various convergence diagnostics illustrate the high quality of the dual messenger reconstruction. In contrast, the PCG implementation fails to converge to a reasonable solution for the specific problem considered. The implementation of the dual messenger method is straightforward and guarantees numerical stability and convergence. We show how the algorithm can be modified to generate fluctuation maps, which, combined with the Wiener filter solution, yield unbiased constrained signal realizations, consistent with observed data. This algorithm presents a pathway to exact global analyses of high-resolution and high-sensitivity CMB data for a statistically optimal separation of E and B modes. It is therefore relevant for current and next-generation CMB experiments, in the quest for the elusive primordial B-mode signal.

Black hole masses are found to correlate with several global properties of their host galaxies, suggesting that black holes and galaxies have an intertwined evolution and that active galactic nuclei (AGN) have a significant impact on galaxy evolution. Since the large-scale environment can also affect AGN, this work studies how their formation and properties depend on the environment. We have used a reconstructed three-dimensional high-resolution density field obtained from a Bayesian large-scale structure reconstruction method applied to the 2M++ galaxy sample. A web-type classification relying on the shear tensor is used to identify different structures on the cosmic web, defining voids, sheets, filaments, and clusters. We confirm that the environmental density affects the AGN formation and their properties. We found that the AGN abundance is equivalent to the galaxy abundance, indicating that active and inactive galaxies reside in similar dark matter halos. However, occurrence rates are different for each spectral type and accretion rate. These differences are consistent with the AGN evolutionary sequence suggested by previous authors, Seyferts and Transition objects transforming into LINERs (Low-Ionization Nuclear Emission Line Regions), the weaker counterpart of Seyferts. We conclud that AGN properties depend on the environmental density more than on the web-type. More powerful starbursts and younger stellar populations are found in high densities, where interactions and mergers are more likely. AGN hosts show smaller masses in clusters for Seyferts and Transition objects, which might be due to gas stripping. In voids, the AGN population is dominated by the most massive galaxy hosts.

Tests of gravity at the galaxy scale are in their infancy. As a first step to systematically uncovering the gravitational significance of galaxies, we map three fundamental gravitational variables -- the Newtonian potential, acceleration and curvature -- over the galaxy environments of the local universe to a distance of approximately 200 Mpc. Our method combines the contributions from galaxies in an all-sky redshift survey, halos from an N-body simulation hosting low-luminosity objects, and linear and quasi-linear modes of the density field. We use the ranges of these variables to determine the extent to which galaxies expand the scope of generic tests of gravity and are capable of constraining specific classes of model for which they have special significance. Finally, we investigate the improvements afforded by upcoming galaxy surveys.

This work presents a joint and self-consistent Bayesian treatment of various foreground and target contaminations when inferring cosmological power-spectra and three dimensional density fields from galaxy redshift surveys. This is achieved by introducing additional block sampling procedures for unknown coefficients of foreground and target contamination templates to the previously presented ARES framework for Bayesian large scale structure analyses. As a result the method infers jointly and fully self-consistently three dimensional density fields, cosmological power-spectra, luminosity dependent galaxy biases, noise levels of respective galaxy distributions and coefficients for a set of a priori specified foreground templates. In addition this fully Bayesian approach permits detailed quantification of correlated uncertainties amongst all inferred quantities and correctly marginalizes over observational systematic effects. We demonstrate the validity and efficiency of our approach in obtaining unbiased estimates of power-spectra via applications to realistic mock galaxy observations subject to stellar contamination and dust extinction. While simultaneously accounting for galaxy biases and unknown noise levels our method reliably and robustly infers three dimensional density fields and corresponding cosmological power-spectra from deep galaxy surveys. Further our approach correctly accounts for joint and correlated uncertainties between unknown coefficients of foreground templates and the amplitudes of the power-spectrum. An effect amounting up to $10$ percent correlations and anti-correlations across large ranges in Fourier space.

Previous studies using numerical simulations have demonstrated that the shape of the cosmic web can be described by studying the Lagrangian displacement field. We extend these analyses, showing that it is now possible to perform a Lagrangian description of cosmic structure in the nearby Universe based on large-scale structure observations. Building upon recent Bayesian large-scale inference of initial conditions, we present a cosmographic analysis of the dark matter distribution and its evolution, referred to as the dark matter phase-space sheet, in the nearby universe as probed by the Sloan Digital Sky Survey main galaxy sample. We consider its stretchings and foldings using a tetrahedral tessellation of the Lagrangian lattice. The method provides extremely accurate estimates of nearby density and velocity fields, even in regions of low galaxy density. It also measures the number of matter streams, and the deformation and parity reversals of fluid elements, which were previously thought inaccessible using observations. We illustrate the approach by showing the phase-space structure of known objects of the nearby Universe such as the Sloan Great Wall, the Coma cluster and the Bo\"otes void. We dissect cosmic structures into four distinct components (voids, sheets, filaments, and clusters), using the Lagrangian classifiers DIVA, ORIGAMI, and a new scheme which we introduce and call LICH. Because these classifiers use information other than the sheer local density, identified structures explicitly carry physical information about their formation history. Accessing the phase-space structure of dark matter in galaxy surveys opens the way for new confrontations of observational data and theoretical models. We have made our data products publicly available.

We present a high performance solution to the Wiener filtering problem via a formulation that is dual to the recently developed messenger technique. This new dual messenger algorithm, like its predecessor, efficiently calculates the Wiener filter solution of large and complex data sets without preconditioning and can account for inhomogeneous noise distributions and arbitrary mask geometries. We demonstrate the capabilities of this scheme in signal reconstruction by applying it on a simulated cosmic microwave background (CMB) temperature data set. The performance of this new method is compared to that of the standard messenger algorithm and the preconditioned conjugate gradient (PCG) approach, using a series of well-known convergence diagnostics and their processing times, for the particular problem under consideration. This variant of the messenger algorithm matches the performance of the PCG method in terms of the effectiveness of reconstruction of the input angular power spectrum and converges smoothly to the final solution. The dual messenger algorithm outperforms the standard messenger and PCG methods in terms of execution time, as it runs to completion around 2 and 3-4 times faster than the respective methods, for the specific problem considered.

The Universe is mostly composed of large and relatively empty domains known as cosmic voids, whereas its matter content is predominantly distributed along their boundaries. The remaining material inside them, either dark or luminous matter, is attracted to these boundaries and causes voids to expand faster and to grow emptier over time. Using the distribution of galaxies centered on voids identified in the Sloan Digital Sky Survey and adopting minimal assumptions on the statistical motion of these galaxies, we constrain the average matter content $\Omega_\mathrm{m}=0.281\pm0.031$ in the Universe today, as well as the linear growth rate of structure $f/b=0.417\pm0.089$ at median redshift $\bar{z}=0.57$, where $b$ is the galaxy bias ($68\%$ C.L.). These values originate from a percent-level measurement of the anisotropic distortion in the void-galaxy cross-correlation function, $\varepsilon = 1.003\pm0.012$, and are robust to consistency tests with bootstraps of the data and simulated mock catalogs within an additional systematic uncertainty of half that size. They surpass (and are complementary to) existing constraints by unlocking cosmological information on smaller scales through an accurate model of nonlinear clustering and dynamics in void environments. As such, our analysis furnishes a powerful probe of deviations from Einstein's general relativity in the low-density regime which has largely remained untested so far. We find no evidence for such deviations in the data at hand.

We introduce a decision scheme for optimally choosing a classifier, which segments the cosmic web into different structure types (voids, sheets, filaments, and clusters). Our framework, based on information theory, accounts for the design aims of different classes of possible applications: (i) parameter inference, (ii) model selection, and (iii) prediction of new observations. As an illustration, we use cosmographic maps of web-types in the Sloan Digital Sky Survey to assess the relative performance of the classifiers T-web, DIVA and ORIGAMI for: (i) analyzing the morphology of the cosmic web, (ii) discriminating dark energy models, and (iii) predicting galaxy colors. Our study substantiates a data-supported connection between cosmic web analysis and information theory, and paves the path towards principled design of analysis procedures for the next generation of galaxy surveys. We have made the cosmic web maps, galaxy catalog, and analysis scripts used in this work publicly available.

I describe a new Bayesian based algorithm to infer the full three dimensional velocity field from observed distances and spectroscopic galaxy catalogues. In addition to the velocity field itself, the algorithm reconstructs true distances, some cosmological parameters and specific non-linearities in the velocity field. The algorithm takes care of selection effects, miscalibration issues and can be easily extended to handle direct fitting of, e.g., the inverse Tully-Fisher relation. I first describe the algorithm in details alongside its performances. This algorithm is implemented in the VIRBIuS (VelocIty Reconstruction using Bayesian Inference Software) software package. I then test it on different mock distance catalogues with a varying complexity of observational issues. The model proved to give robust measurement of velocities for mock catalogues of 3,000 galaxies. I expect the core of the algorithm to scale to tens of thousands galaxies. It holds the promises of giving a better handle on future large and deep distance surveys for which individual errors on distance would impede velocity field inference.

This work describes a full Bayesian analysis of the Nearby Universe as traced by galaxies of the 2M++ survey. The analysis is run in two sequential steps. The first step self-consistently derives the luminosity dependent galaxy biases, the power-spectrum of matter fluctuations and matter density fields within a Gaussian statistic approximation. The second step makes a detailed analysis of the three dimensional Large Scale Structures, assuming a fixed bias model and a fixed cosmology. This second step allows for the reconstruction of both the final density field and the initial conditions at z=1000 assuming a fixed bias model. From these, we derive fields that self-consistently extrapolate the observed large scale structures. We give two examples of these extrapolation and their utility for the detection of structures: the visibility of the Sloan Great Wall, and the detection and characterization of the Local Void using DIVA, a Lagrangian based technique to classify structures.

The BORG algorithm is an inference engine that derives the initial conditions given a cosmological model and galaxy survey data, and produces physical reconstructions of the underlying large-scale structure by assimilating the data into the model. We present the application of BORG to real galaxy catalogs and describe the primordial and late-time large-scale structure in the considered volumes. We then show how these results can be used for building various probabilistic maps of the large-scale structure, with rigorous propagation of uncertainties. In particular, we study dynamic cosmic web elements and secondary effects in the cosmic microwave background.

Cosmic voids in the large-scale structure of the Universe affect the peculiar motions of objects in their vicinity. Although these motions are difficult to observe directly, the clustering pattern of their surrounding tracers in redshift space is influenced in a unique way. This allows to investigate the interplay between densities and velocities around voids, which is solely dictated by the laws of gravity. With the help of $N$-body simulations and derived mock-galaxy catalogs we calculate the average density fluctuations around voids identified with a watershed algorithm in redshift space and compare the results with the expectation from general relativity and the $\Lambda$CDM model. We find linear theory to work remarkably well in describing the dynamics of voids. Adopting a Bayesian inference framework, we explore the full posterior of our model parameters and forecast the achievable accuracy on measurements of the growth rate of structure and the geometric distortion through the Alcock-Paczynski effect. Systematic errors in the latter are reduced from $\sim15\%$ to $\sim5\%$ when peculiar velocities are taken into account. The relative parameter uncertainties in galaxy surveys with number densities comparable to the SDSS MAIN (CMASS) sample probing a volume of $1h^{-3}{\rm Gpc}^3$ yield $\sigma_{f/b}\left/(f/b)\right.\sim2\%$ ($20\%$) and $\sigma_{D_AH}/D_AH\sim0.2\%$ ($2\%$), respectively. At this level of precision the linear-theory model becomes systematics dominated, with parameter biases that fall beyond these values. Nevertheless, the presented method is highly model independent; its viability lies in the underlying assumption of statistical isotropy of the Universe.

We present a non-parametric, model-independent method to reconstruct the spherical density profiles of void stacks in real space, without redshift-space distortions. Our method uses the expected spherical symmetry of stacked voids to build the shape of the spherical density profile of cosmic voids in real space without any assumption about the cosmological model. We test the reconstruction algorithm with both a toy model and a full dark matter simulation. We present the result for the simulation: the reconstruction of the spherical density profile for a simulated stacked void in real space. We also present a first application of the algorithm to reconstruct real cosmic void stacks density profiles in real space from the Sloan Digital Sky Survey (Sutter et al. 2012b). We discuss capabilities of the algorithm and possible future improvements. Reconstructed density profiles from real voids open the way to the study of the spherically averaged dynamical structure of voids.

The Planck satellite, along with several ground based telescopes, have mapped the cosmic microwave background (CMB) at sufficient resolution and signal-to-noise so as to allow a detection of the subtle distortions due to the gravitational influence of the intervening matter distribution. A natural modeling approach is to write a Bayesian hierarchical model for the lensed CMB in terms of the unlensed CMB and the lensing potential. So far there has been no feasible algorithm for inferring the posterior distribution of the lensing potential from the lensed CMB map. We propose a solution that allows efficient Markov Chain Monte Carlo sampling from the joint posterior of the lensing potential and the unlensed CMB map using the Hamiltonian Monte Carlo technique. The main conceptual step in the solution is a re-parameterization of CMB lensing in terms of the lensed CMB and the "inverse lensing" potential. We demonstrate a fast implementation on simulated data including noise and a sky cut, that uses a further acceleration based on a very mild approximation of the inverse lensing potential. We find that the resulting Markov Chain has short correlation lengths and excellent convergence properties, making it promising for application to high resolution CMB data sets of the future.

Peculiar velocity measurements are the only tool available in the low-redshift Universe for mapping the large-scale distribution of matter and can thus be used to constrain cosmology. Using redshifts from the 2M++ redshift compilation, we reconstruct the density of galaxies within 200 Mpc/h, allowing for the first time good sampling of important superclusters such as the Shapley Concentration. We compare the predicted peculiar velocities from 2M++ to Tully-Fisher and SNe peculiar velocities. We find a value of $\beta^* \equiv \Omega_{\rm{m}}^{0.55}/b^* = 0.431 \pm 0.021$, suggesting $\Omega_{\rm{m}}^{0.55}\sigma_{\rm{8,lin}} = 0.401 \pm 0.024$, in good agreement with other probes. The predicted peculiar velocity of the Local Group arising from the 2M++ volume alone is $540 \pm 40$ km/s, towards $l = 268 \pm 4, b= 38 \pm 6$, only $10^\circ$ out of alignment with the Cosmic Microwave Background dipole. To account for velocity contributions arising from sources outside the 2M++ volume, we fit simultaneously for $\beta^*$ and an external bulk flow in our analysis. We find that an external bulk flow is preferred at the 5.1$\sigma$ level, and the best fit has a velocity of $159\pm23$ km/s towards $l=304 \pm 11, b = 6 \pm 13$. Finally, the predicted bulk flow of a 50 Mpc/h Gaussian-weighted volume centred on the Local Group is $230 \pm 30$ km/s, in the direction $l=293\pm 8, b = 14 \pm 10$, in agreement with predictions from $\Lambda$CDM.

We propose a novel technique to probe the expansion history of the Universe based on the clustering statistics of cosmic voids. In particular, we compute their two-point statistics in redshift space on the basis of realistic mock galaxy catalogs and apply the Alcock-Paczynski test. In contrast to galaxies, we find void auto-correlations to be marginally affected by peculiar motions, providing a model-independent measure of cosmological parameters without systematics from redshift-space distortions. Because only galaxy-galaxy and void-galaxy correlations have been considered in these types of studies before, the presented method improves both statistical and systematic uncertainties on the product of angular diameter distance and Hubble rate, furnishing the potentially cleanest probe of cosmic geometry available to date.

We present VIDE, the Void IDentification and Examination toolkit, an open-source Python/C++ code for finding cosmic voids in galaxy redshift surveys and N-body simulations, characterizing their properties, and providing a platform for more detailed analysis. At its core, VIDE uses a substantially enhanced version of ZOBOV (Neyinck 2008) to calculate a Voronoi tessellation for estimating the density field and a performing a watershed transform to construct voids. Additionally, VIDE provides significant functionality for both pre- and post-processing: for example, vide can work with volume- or magnitude-limited galaxy samples with arbitrary survey geometries, or dark matter particles or halo catalogs in a variety of common formats. It can also randomly subsample inputs and includes a Halo Occupation Distribution model for constructing mock galaxy populations. VIDE uses the watershed levels to place voids in a hierarchical tree, outputs a summary of void properties in plain ASCII, and provides a Python API to perform many analysis tasks, such as loading and manipulating void catalogs and particle members, filtering, plotting, computing clustering statistics, stacking, comparing catalogs, and fitting density profiles. While centered around ZOBOV, the toolkit is designed to be as modular as possible and accommodate other void finders. VIDE has been in development for several years and has already been used to produce a wealth of results, which we summarize in this work to highlight the capabilities of the toolkit. VIDE is publicly available at http://bitbucket.org/cosmicvoids/vide public and http://www.cosmicvoids.net.

We discuss various applications of VIDE, the Void IDentification and Examination toolkit, an open-source Python/C++ code for finding cosmic voids in galaxy redshift surveys and N-body simulations. Based on a substantially enhanced version of ZOBOV, VIDE not only finds voids, but also summarizes their properties, extracts statistical information, and provides a Python-based platform for more detailed analysis, such as manipulating void catalogs and particle members, filtering, plotting, computing clustering statistics, stacking, comparing catalogs, and fitting density profiles. VIDE also provides significant additional functionality for pre-processing inputs: for example, VIDE can work with volume- or magnitude-limited galaxy samples with arbitrary survey geometries, or dark matter particles or halo catalogs in a variety of common formats. It can also randomly subsample inputs and includes a Halo Occupation Distribution model for constructing mock galaxy populations. VIDE has been used for a wide variety of applications, from discovering a universal density profile to estimating primordial magnetic fields, and is publicly available at http://bitbucket.org/cosmicvoids/vide_public and http://www.cosmicvoids.net.

We present and study cosmic voids identified using the watershed void finder VIDE in the Sloan Digital Sky Survey Data Release 9, compare these voids to ones identified in mock catalogs, and assess the impact of the survey mask on void statistics such as number functions, ellipticity distributions, and radial density profiles. The nearly 1,000 identified voids span three nearly volume-limited samples from redshift z = 0.43 to 0.7. For comparison we use 98 of the publicly available 2LPT-based mock galaxy catalogs of Manera et al., and also generate our own mock catalogs by applying a Halo Occupation Distribution model to an N-body simulation. We find that the mask reduces the number density of voids at all scales by a factor of three and slightly skews the relative size distributions. This engenders an increase in the mean ellipticity by roughly 30%. However, we find that radial density profiles are largely robust to the effects of the mask. We see excellent agreement between the data and both mock catalogs, and find no tension between the observed void properties and the properties derived from {\Lambda}CDM simulations. We have added the void catalogs from both data and mock galaxy populations discussed in this work to the Public Cosmic Void Catalog at http://www.cosmicvoids.net.

To study the impact of sparsity and galaxy bias on void statistics, we use a single large-volume, high-resolution N-body simulation to compare voids in multiple levels of subsampled dark matter, halo populations, and mock galaxies from a Halo Occupation Distribution model tuned to different galaxy survey densities. We focus our comparison on three key observational statistics: number functions, ellipticity distributions, and radial density profiles. We use the hierarchical tree structure of voids to interpret the impacts of sampling density and galaxy bias, and theoretical and empirical functions to describe the statistics in all our sample populations. We are able to make simple adjustments to theoretical expectations to offer prescriptions for translating from analytics to the void properties measured in realistic observations. We find that sampling density has a much larger effect on void sizes than galaxy bias. At lower tracer density, small voids disappear and the remaining voids are larger, more spherical, and have slightly steeper profiles. When a proper lower mass threshold is chosen, voids in halo distributions largely mimic those found in galaxy populations, except for ellipticities, where galaxy bias leads to higher values. We use the void density profile of Hamaus et al. (2014) to show that voids follow a self-similar and universal trend, allowing simple translations between voids studied in dark matter and voids identified in galaxy surveys. We have added the mock void catalogs used in this work to the Public Cosmic Void Catalog at http://www.cosmicvoids.net.

In this work we propose a new matrix-free implementation of the Wiener sampler which is traditionally applied to high dimensional analysis when signal covariances are unknown. Specifically, the proposed method addresses the problem of jointly inferring a high dimensional signal and its corresponding covariance matrix from a set of observations. Our method implements a Gibbs sampling adaptation of the previously presented messenger approach, permitting to cast the complex multivariate inference problem into a sequence of uni-variate random processes. In this fashion, the traditional requirement of inverting high dimensional matrices is completely eliminated from the inference process, resulting in an efficient algorithm that is trivial to implement. Using cosmic large scale structure data as a showcase, we demonstrate the capabilities of our Gibbs sampling approach by performing a joint analysis of three dimensional density fields and corresponding power-spectra from Gaussian mock catalogues. These tests clearly demonstrate the ability of the algorithm to accurately provide measurements of the three dimensional density field and its power-spectrum and corresponding uncertainty quantification. Moreover, these tests reveal excellent numerical and statistical efficiency which will generally render the proposed algorithm a valuable addition to the toolbox of large scale Bayesian inference in cosmology and astrophysics.

Galaxy bias, the unknown relationship between the clustering of galaxies and the underlying dark matter density field is a major hurdle for cosmological inference from large-scale structure. While traditional analyses focus on the absolute clustering amplitude of high-density regions mapped out by galaxy surveys, we propose a relative measurement that compares those to the underdense regions, cosmic voids. On the basis of realistic mock catalogs we demonstrate that cross correlating galaxies and voids opens up the possibility to calibrate galaxy bias and to define a static ruler thanks to the observable geometric nature of voids. We illustrate how the clustering of voids is related to mass compensation and show that volume-exclusion significantly reduces the degree of stochasticity in their spatial distribution. Extracting the spherically averaged distribution of galaxies inside voids from their cross correlations reveals a remarkable concordance with the mass-density profile of voids.

How do observed voids relate to the underlying dark matter distribution? To examine the spatial distribution of dark matter contained within voids identified in galaxy surveys, we apply Halo Occupation Distribution models representing sparsely and densely sampled galaxy surveys to a high-resolution N-body simulation. We compare these galaxy voids to voids found in the halo distribution, low-resolution dark matter, and high-resolution dark matter. We find that voids at all scales in densely sampled surveys - and medium- to large-scale voids in sparse surveys - trace the same underdensities as dark matter, but they are larger in radius by ~20%, they have somewhat shallower density profiles, and they have centers offset by ~0.4Rv rms. However, in void-to-void comparison we find that shape estimators are less robust to sampling, and the largest voids in sparsely sampled surveys suffer fragmentation at their edges. We find that voids in galaxy surveys always correspond to underdensities in the dark matter, though the centers may be offset. When this offset is taken into account, we recover almost identical radial density profiles between galaxies and dark matter. All mock catalogs used in this work are available at http://www.cosmicvoids.net.

Recently, Nadathur & Hotchkiss (2013) submitted a paper discussing a new cosmic void catalog. This paper includes claims about the void catalog described in Sutter et al. (2012). In this note, we respond to those claims, clarify some discrepancies between the text of Sutter et al. (2012) and the most recent version of the catalog, and provide some comments on the differences between our catalog and that of Nadathur & Hotchkiss (2013). All updates and documentation for our catalog are available at http://www.cosmicvoids.net.

We present a statistically-optimal and model-independent method to extract the pressure profile of hot gas in the intracluster medium (ICM). Using the thermal Sunyaev-Zeldovich effect, we constrain the mean pressure profile of the ICM by appropriately considering all primary cosmic microwave background (CMB) and instrumental noise correlations, while using the maximum resolution and sensitivity of all frequency channels. As a first application, we analyze CMB maps of WMAP 9-year data through a study of the Meta-Catalogue of X-ray detected Clusters of galaxies (MCXC). We constrain the universal pressure profile out to 4R_500 with 15-sigma confidence, though our measurements are only significant out to R_200. Using a temperature profile constrained from X-ray observations, we measure the mean gas mass fraction out to R_200. Within statistical and systematic uncertainties, our constraints are compatible with the cosmic baryon fraction and the expected gas fraction in halos. While Planck multi-frequency CMB data are expected to reduce statistical uncertainties by a factor of 20, we argue that systematic errors in determining mass of clusters dominate the uncertainty in gas mass fraction measurements at the level of 20 percent.

Peculiar velocities in the nearby Universe can be measured via the kinetic Sunyaev-Zel'dovich (kSZ) effect. Using a statistical method based on an optimised cross-correlation with nearby galaxies, we extract the kSZ signal generated by plasma halo of galaxies from the Cosmic Microwave Background (CMB) temperature anisotropies observed by the Wilkinson Microwave Anisotropy Probe (WMAP). Marginalising over the thermal Sunyaev-Zel'dovich contribution from clusters of galaxies, possible unresolved point source contamination, and Galactic foregrounds (dust, synchrotron and free-free emission), we report a kSZ bulk flow signal present at the 90% confidence level in the seven-year WMAP data. When only galaxies within 50 Mpc/h are included in the kSZ template we find a bulk flow in the CMB frame of |V|=533 +/- 263 km/s, in the direction l=324 +/- 27, b=-7 +/- 17, consistent with bulk flow measurements on a similar scale using classical distance indicators. We show how this comparison constrains the (ionised) baryonic budget in the local universe. On very large (~ 500 Mpc/h) scales, we find a 95% upper limit of 470 km/s, inconsistent with some analyses of bulk flow of clusters from the kSZ. We estimate that the significance of the bulk flow signal may increase to 3-5 sigma using data from the PLANCK probe.

We report on the first application of the Alcock-Paczynski test to stacked voids in spectroscopic galaxy redshift surveys.We use voids from the Sutter et al. (2012) void catalog, which was derived from the Sloan Digital Sky Survey Data Release 7 main sample and luminous red galaxy catalogs. The construction of that void catalog removes potential shape measurement bias by using a modified version of the ZOBOV algorithm and by removing voids near survey boundaries and masks. We apply the shape-fitting procedure presented in Lavaux & Wandelt (2012) to ten void stacks out to redshift z=0.36. Combining these measurements, we determine the mean cosmologically induced "stretch" of voids in three redshift bins, with 1-sigma errors of 5-15%. The mean stretch is consistent with unity, providing no indication of a distortion induced by peculiar velocities. While the statistical errors are too large to detect the Alcock-Paczynski effect over our limited redshift range, this proof-of-concept analysis defines procedures that can be applied to larger spectroscopic galaxy surveys at higher redshifts to constrain dark energy using the expected statistical isotropy of structures that are minimally affected by uncertainties in galaxy velocity bias.

We discuss two projects in non-linear cosmostatistics applicable to very large surveys of galaxies. The first is a Bayesian reconstruction of galaxy redshifts and their number density distribution from approximate, photometric redshift data. The second focuses on cosmic voids and uses them to construct cosmic spheres that allow reconstructing the expansion history of the Universe using the Alcock-Paczynski test. In both cases we find that non-linearities enable the methods or enhance the results: non-linear gravitational evolution creates voids and our photo-z reconstruction works best in the highest density (and hence most non-linear) portions of our simulations.

We produce the most comprehensive public void catalog to date using the Sloan Digital Sky Survey Data Release 7 main sample out to redshift z=0.2 and the luminous red galaxy sample out to z=0.44. Using a modified version of the parameter-free void finder ZOBOV, we fully take into account the presence of the survey boundary and masks. Our strategy for finding voids is thus appropriate for any survey configuration. We produce two distinct catalogs: a complete catalog including voids near any masks, which would be appropriate for void galaxy surveys, and a bias-free catalog of voids away from any masks, which is necessary for analyses that require a fair sampling of void shapes and alignments. Our discovered voids have effective radii from 5 to 135 h^-1 Mpc. We discuss basic catalog statistics such as number counts and redshift distributions and describe some additional data products derived from our catalog, such as radial density profiles and projected density maps. We find that radial profiles of stacked voids show a qualitatively similar behavior across nearly two decades of void radii and throughout the full redshift range.

We present a purely geometrical method for probing the expansion history of the Universe from the observation of the shape of stacked voids in spectroscopic redshift surveys. Our method is an Alcock-Paczynski (AP) test based on the average sphericity of voids posited on the local isotropy of the Universe. It works by comparing the temporal extent of cosmic voids along the line of sight with their angular, spatial extent. We describe the algorithm that we use to detect and stack voids in redshift shells on the light cone and test it on mock light cones produced from N-body simulations. We establish a robust statistical model for estimating the average stretching of voids in redshift space and quantify the contamination by peculiar velocities. Finally, assuming that the void statistics that we derive from N-body simulations is preserved when considering galaxy surveys, we assess the capability of this approach to constrain dark energy parameters. We report this assessment in terms of the figure of merit (FoM) of the dark energy task force and in particular of the proposed EUCLID mission which is particularly suited for this technique since it is a spectroscopic survey. The FoM due to stacked voids from the EUCLID wide survey may double that of all other dark energy probes derived from EUCLID data alone (combined with Planck priors). In particular, voids seem to outperform Baryon Acoustic Oscillations by an order of magnitude. This result is consistent with simple estimates based on mode-counting. The AP test based on stacked voids may be a significant addition to the portfolio of major dark energy probes and its potentialities must be studied in detail.

We generate the peculiar velocity field for the 2MASS Redshift Survey (2MRS) catalog using an orbit-reconstruction algorithm. The reconstructed velocities of individual objects in 2MRS are well-correlated with the peculiar velocities obtained from high-precision observed distances within 3,000 km/s. We estimate the mean matter density to be 0.31 +/- 0.05 by comparing observed to reconstructed velocities in this volume. The reconstructed motion of the Local Group in the rest frame established by distances within 3,000 km/s agrees with the observed motion and is generated by fluctuations within this volume, in agreement with observations. Then, we reconstruct the velocity field of 2MRS in successively larger radii, to study the problem of convergence towards the CMB dipole. We find that less than half of the amplitude of the CMB dipole is generated within a volume enclosing the Hydra-Centaurus-Norma supercluster at around 40 Mpc/h. Although most of the amplitude of the CMB dipole seems to be recovered by 120 Mpc/h, the direction does not agree and hence we observe no convergence up to this scale. We develop a statistical model which allows us to estimate cosmological para meters from the reconstructed growth of convergence of the velocity of the Local Group towards the CMB dipole motion. For scales up to 60 Mpc/h, assuming a Local Group velocity of 627 km/s, we estimate Omega_m h^2 = 0.11 +/- 0.06 and sigma_8=0.9 +/- 0.4, in agreement with WMAP5 measurements at the 1-sigma level. However, for scales up to 100 Mpc/h, we obtain Omega_m h^2 = 0.08 +/- 0.03 and sigma_8=1.0 +/- 0.4, which agrees at the 1 to 2-sigma level with WMAP5 results. (abridged)

We investigate the use of a logarithmic density variable in estimating the Lagrangian displacement field, motivated by the success of a logarithmic transformation in restoring information to the matter power spectrum. The logarithmic relation is an extension of the linear relation, motivated by the continuity equation, in which the density field is assumed to be proportional to the divergence of the displacement field; we compare the linear and logarithmic relations by measuring both of these fields directly in a cosmological N-body simulation. The relative success of the logarithmic and linear relations depends on the scale at which the density field is smoothed. Thus we explore several ways of measuring the density field, including Cloud-In-Cell smoothing, adaptive smoothing, and the (scale-independent) Delaunay tessellation, and we use both a Fourier space and a geometrical tessellation approach to measuring the divergence. We find that the relation between the divergence of the displacement field and the density is significantly tighter with a logarithmic density variable, especially at low redshifts and for very small (~2 Mpc/h) smoothing scales. We find that the grid-based methods are more reliable than the tessellation-based method of calculating both the density and the divergence fields, though in both cases the logarithmic relation works better in the appropriate regime, which corresponds to nonlinear scales for the grid-based methods and low densities for the tessellation-based method.

Peculiar velocities arise from gravitational instability, and thus are linked to the surrounding distribution of matter. In order to understand the motion of the Local Group with respect to the Cosmic Microwave Background, a deep all-sky map of the galaxy distribution is required. Here we present a new redshift compilation of 69~160 galaxies, dubbed 2M++, to map large-scale structures of the Local Universe over nearly the whole sky, and reaching depths of K <= 12.5, or 200 Mpc/h. The target catalogue is based on the Two-Micron-All-Sky Extended Source Catalog (2MASS-XSC). The primary sources of redshifts are the 2MASS Redshift Survey, the 6dF galaxy redshift survey and the Sloan Digital Sky Survey (DR7). We assess redshift completeness in each region and compute the weights required to correct for redshift incompleteness and apparent magnitude limits, and discuss corrections for incompleteness in the Zone of Avoidance. We present the density field for this survey, and discuss the importance of large-scale structures such as the Shapley Concentration.

We describe a accurate and fast pixel-based statistical method to interpolate fields of arbitrary spin on the sphere. We call this method Fast and Lean Interpolation on the Sphere (FLINTS). The method predicts the optimal interpolated values based on the theory of isotropic Gaussian random fields and provides an accurate error estimate at no additional cost. We use this method to compute lensed Cosmic Microwave Background (CMB) maps precisely and quickly, achieving a relative precision of 0.02% at a HEALPix resolution of Nside=4096, for a bandlimit of l_max=4096 in the same time it takes to simulate the original, unlensed CMB map. The method is suitable for efficient, distributed memory parallelization. The power spectra of our lensed maps are accurate to better than 0.5% at l=3000 for the temperature, the E and B mode of the polarization. As expected theoretically, we demonstrate that, on realistic cases, this method is between two to three orders of magnitude more precise than other known interpolation methods for the same computational cost.

We use the formalism of constrained Gaussian random field to compute a precise large scale simulation of the 60 Mpc/h volume of our Local Universe. We derive the constraints from the reconstructed peculiar velocities of the 2MASS Redshift Survey. We obtain a correlation of 0.97 between the log-density field of the dark matter distribution of the simulation and the log-density of observed galaxies of the Local Universe. We achieve a good comparison of the simulated velocity field to the observed velocity field obtained from the galaxy distances of the NBG-3k. At the end, we compare the two-point correlation function of both the 2MRS galaxies and of the dark matter particles of the simulation. We conclude that this method is a very promising technique of exploring the dynamics and the particularities the Universe in our neighbourhood.

We propose a new definition of cosmic voids based on methods of Lagrangian orbit reconstruction as well as an algorithm to find them in actual data called DIVA. Our technique is intended to yield results which can be modeled sufficiently accurately to create a new probe of precision cosmology. We then develop an analytical model of the ellipticity of voids found by our method based on Zel'dovich approximation. We measure in N-body simulation that this model is precise at the 0.1% level for the mean ellipticity of voids of size greater than ~4 Mpc/h. We estimate that at this scale, we are able to predict the ellipticity with an accuracy of 0.02. Finally, we compare the distribution of void shapes in N-body simulation for two different equations of state w of the dark energy. We conclude that our method is far more accurate than Eulerian methods and is therefore promising as a precision probe of dark energy phenomenology.

A valuable amount of information is available in peculiar velocities of galaxies. Peculiar velocity surveys have recently allowed the discovery of potential problems with LCDM. Nonetheless, their direct observation through distance measurements remains a daunting task. Another way of considering the problem is to use orbit reconstruction methods assuming some mass-to-light assignment for galaxies. We give here two applications of this procedure for the study of large-scale bulk flows and the dynamics of voids in the Local Universe. We concentrate our study on the use of the Monge-Ampere-Kantorovitch reconstruction technique. Using peculiar velocities reconstructed from the 2MASS Galaxy Redshift Survey, and after comparison with the NGB-3k peculiar velocity catalog, we look in the details of these peculiar velocities. More particularly, we estimate the constraints that the peculiar velocities put on the cosmology. The information on dynamics that is included in reconstructed orbits of galaxies also allows us to have a much better prescription for defining and identifying voids in simulations and redshift catalogs. We present this new technique and how voids may give us additional constraints on cosmology with current and future surveys.

We discuss a Lagrangian reconstruction method of the velocity field from galaxy redshift catalog that takes its root in the Euler equation. This results in a ``functional'' of the velocity field which must be minimized. This is helped by an algorithm solving the minimization of cost-flow problems. The results obtained by applying this method to cosmological problems are shown and boundary effects happening in real observational cases are then discussed. Finally, a statistical model of the errors made by the reconstruction method is proposed.

Lagrangian reconstruction of large-scale peculiar velocity fields can be strongly affected by observational biases. We develop a thorough analysis of these systematic effects by relying on specially selected mock catalogues. For the purpose of this paper, we use the MAK reconstruction method, although any other Lagrangian reconstruction method should be sensitive to the same problems. We extensively study the uncertainty in the mass-to-light assignment due to luminosity incompleteness, and the poorly-determined relation between mass and luminosity. The impact of redshift distortion corrections is analyzed in the context of MAK and we check the importance of edge and finite-volume effects on the reconstructed velocities. Using three mock catalogues with different average densities, we also study the effect of cosmic variance. In particular, one of them presents the same global features as found in observational catalogues that extend to 80 Mpc/h scales. We give recipes, checked using the aforementioned mock catalogues, to handle these particular observational effects, after having introduced them into the mock catalogues so as to quantitatively mimic the most densely sampled currently available galaxy catalogue of the nearby universe. Once biases have been taken care of, the typical resulting error in reconstructed velocities is typically about a quarter of the overall velocity dispersion, and without significant bias. We finally model our reconstruction errors to propose an improved Bayesian approach to measure Omega_m in an unbiased way by comparing the reconstructed velocities to the measured ones in distance space, even though they may be plagued by large errors. We show that, in the context of observational data, a nearly unbiased estimator of Omega_m may be built using MAK reconstruction.

The peculiar velocity reconstruction methods allow one to have a deeper insight into the distribution of dark matter: both to measure mean matter density and to obtain the primordial density fluctuations. We present here the Monge-Ampere-Kantorovitch method applied to mock catalogues mimicking in both redshift and distance catalogues. After having discussed the results obtained for a class of biases that may be corrected for, we focus on the systematics coming from the unknown distribution of unobserved mass and from the statistical relationship between mass and luminosity. We then show how to use these systematics to put constraints on the dark matter distribution. Finally a preliminary application to an extended version (c z < 3000 km/s) of the Neighbour Galaxy Catalogue is presented. We recover the peculiar velocities in our neighbourhood and present a preliminary measurement of the local Omega_M.

Using adiabatic hydrodynamical simulations, we follow the evolution of two symmetric cold fronts developing in the remnant of a violent z=0.3 massive cluster merger. The structure and location of the simulated cold fronts are very similar to those recently found in X-ray cluster observations, supporting the merger hypothesis for the origin of at least some of the cold fronts. The cold fronts are preceded by an almost spherical bow shock which originates at the core and disappears after 1.6 Gyr. The cold fronts last longer and survive until z=0. We trace back the gas mass constituting the fronts and find it initially associated with the two dense cores of the merging clusters. Conversely, we follow how the energy of the gas of the initial merging cores evolves until z=0 from the merging and show that a fraction of this gas can escape from the local potential well of the sub-clumps. This release occurs as the sub-clumps reach their apocentre in an eccentric orbit and is due to decoupling between the dark matter and part of the gas in the sub-clump because of, first, heating of the gas at first close core passage and of, second, the effect of the global cluster pressure which peaks as the centrifugal acceleration of the sub-clump is maximal. The fraction of the gas of the sub-clump liberated in the outbound direction then cools as it expands adiabatically and constitutes the cold fronts.

We present high-resolution hydrodynamical simulations of the degree and direction of polarisation imprinted on the CMB by the Sunyaev-Zel'dovich effect in the the line of sight to massive galaxy clusters. We focus on two contributions which contribute most of the induced CMB polarisation in addition to the intrinsic CMB quadrupole: the radiation quadrupole seen by electrons due to their own velocity in the plane normal to the line of sight, and the radiation quadrupole due to the thermal Sunyaev-Zel'dovich effect, which is generated by a previous scattering elsewhere in the cores of the local and nearby clusters. We show that inside the virial radius of a massive cluster, this latter effect, although being second order in the optical depth, can reach the level of the former effect. These two effects can, respectively, constrain the projected tangential velocity and inner density profile of the gas, if they can be separated with multi-frequency observations. As the information on the tangential velocity of the ICM gas is combined with the kinetic Sunyaev-Zel'dovich temperature effect probing the projected radial velocity it will be possible to constrain the dynamics of the ICM. In particular, future polarisation observations may be able to trace out the filamentary structure of the cooler and less dense ionized gas that has not yet been incorporated into massive clusters. We also discuss how the collapse of a cluster should produce a peculiar ring-like polarisation pattern which would open a new window to detect proto-clusters at high redshift.