We address the problem of inferring the three-dimensional matter distribution from a sparse set of one-dimensional quasar absorption spectra of the Lyman-$\alpha$ forest. Using a Bayesian forward modelling approach, we focus on extending the dynamical model to a fully self-consistent hierarchical field-level prediction of redshift-space quasar absorption sightlines. Our field-level approach rests on a recently developed semiclassical analogue to Lagrangian perturbation theory (LPT), which improves over noise problems and interpolation requirements of LPT. It furthermore allows for a manifestly conservative mapping of the optical depth to redshift space. In addition, this new dynamical model naturally introduces a coarse-graining scale, which we exploit to accelerate the MCMC sampler using simulated annealing. By gradually reducing the effective temperature of the forward model, we can allow it to converge first on large spatial scales before the sampler becomes sensitive to the increasingly larger space of smaller scales. We demonstrate the advantages -- in terms of speed and noise properties -- of this field-level approach over using LPT as a forward model, and, using mock data, validate its performance to reconstruct three-dimensional primordial perturbations and matter distribution from sparse quasar sightlines.

We present updates on the cosmology inference using the effective field theory (EFT) likelihood presented previously in Schmidt et al., 2018, Elsner et al., 2019 [1,2]. Specifically, we add a cutoff to the initial conditions that serve as starting point for the matter forward model. We show that this cutoff, which was not employed in any previous related work, is important to regularize loop integrals that otherwise involve small-scale, non-perturbative modes. We then present results on the inferred value of the linear power spectrum normalization $\sigma_{8}$ from rest-frame halo catalogs using both second- and third-order bias expansions, imposing uniform priors on all bias parameters. Due to the perfect bias-$\sigma_{8}$ degeneracy at linear order, constraints on $\sigma_{8}$ rely entirely on nonlinear information. The results show the expected convergence behavior when lowering the cutoff in wavenumber, $\Lambda$. When including modes up to $k \leq \Lambda = 0.1\,h\,{\rm Mpc}^{-1}$ in the second-order case, $\sigma_{8}$ is recovered to within $\lesssim 6\,\%$ for a range of halo masses and redshifts. The systematic bias shrinks to $4\,\%$ or less for the third-order bias expansion on the same range of scales. Together with additional evidence we provide, this shows that the residual mismatch in $\sigma_{8}$ can be attributed to higher-order bias contributions. We conclude that the EFT likelihood is able to infer unbiased cosmological constraints, within expected theoretical systematic errors, from physical biased tracers on quasilinear scales

We study structure formation in a set of cosmological simulations to uncover the scales in the initial density field that gave rise to the formation of present-day structures. Our simulations share a common primordial power spectrum (here Lambda-CDM), but the introduction of hierarchical variations of the phase information allows us to systematically study the scales that determine the formation of structure at later times. We consider the variance in z=0 statistics such as the matter power spectrum and halo mass function. We also define a criterion for the existence of individual haloes across simulations, and determine what scales in the initial density field contain sufficient information for the non-linear formation of unique haloes. We study how the characteristics of individual haloes such as the mass and concentration, as well as the position and velocity, are affected by variations on different scales, and give scaling relations for haloes of different mass. Finally, we use the example of a cluster-mass halo to show how our hierarchical parametrisation of the initial density field can be used to create variants of particular objects. With properties such as mass, concentration, kinematics and substructure of haloes set on distinct and well-determined scales, and its unique ability to introduce variations localised in real space, our method is a powerful tool to study structure formation in cosmological simulations.

The effective-field-theory (EFT) approach to the clustering of galaxies and other biased tracers allows for an isolation of the cosmological information that is protected by symmetries, in particular the equivalence principle, and thus is robust to the complicated dynamics of dark matter, gas, and stars on small scales. All existing implementations proceed by making predictions for the lowest-order $n$-point functions of biased tracers, as well as their covariance, and comparing with measurements. Recently, we presented an EFT-based expression for the conditional probability of the density field of a biased tracer given the matter density field, which in principle combines information from arbitrarily high order $n$-point functions. Here, we report results based on this likelihood by applying it to halo catalogs in real space, specifically on the inference of the power spectrum normalization $\sigma_8$. We include bias terms up to second order as well as the leading higher-derivative term. For a cutoff value of $\Lambda = 0.1 h\,{\rm Mpc}^{-1}$, we recover the ground-truth value of $\sigma_8$ to within 95% CL for different halo samples and redshifts. We discuss possible sources for the remaining systematic bias in $\sigma_8$ as well as future developments.

Realistic predictions for the arrival directions of ultra-high-energy cosmic rays require extensive simulations of UHECR propagation through 3D space, potentially even including cosmological evolution and timing effects. Such 3D or 4D simulations of cosmic-ray propagation suffer from the fact that a relatively small target - the observer sphere - needs to be hit. If particles are ejected in any direction from the source according to the source emission geometry, such simulations are tremendously inefficient. We present here a targeting mechanism which finds an optimal emission geometry to maximize the number of hits while remaining unbiased in the arrival-direction distribution. This can lead to speedups by many of orders of magnitude, depending on the simulation setup. We present the basic mathematics to produce unbiased results from targeted simulations, demonstrate its effectiveness with the simulation package CRPropa 3 for various propagation scenarios, and discuss prospects to include this mechanism as a standard part of CRPropa in the future.

We reconstruct the 3D structure of magnetic fields, which were seeded by density perturbations during the radiation dominated epoch of the Universe and later on were evolved by structure formation. To achieve this goal, we rely on three dimensional initial density fields inferred from the 2M++ galaxy compilation via the Bayesian $\texttt{BORG}$ algorithm. Using those, we estimate the magnetogenesis by the so called Harrison mechanism. This effect produced magnetic fields exploiting the different photon drag on electrons and ions in vortical motions, which are exited due to second order perturbation effects in the Early Universe. Subsequently we study the evolution of these seed fields through the non-linear cosmic structure formation by virtue of a MHD simulation to obtain a 3D estimate for the structure of this primordial magnetic field component today. At recombination we obtain a reliable lower limit on the large scale magnetic field strength around $10^{-23} \mathrm{G}$, with a power spectrum peaking at about $ 2\, \mathrm{Mpc}^{-1}h$ in comoving scales. At present we expect this evolved primordial field to have strengthts above $\approx 10^{-27}\, \mathrm{G}$ and $\approx 10^{-29}\, \mathrm{G}$ in clusters of galaxies and voids, respectively. We also calculate the corresponding Faraday rotation measure map and show the magnetic field morphology and strength for specific objects of the Local Universe.

We propose a new, likelihood-free approach to inferring the primordial matter power spectrum and cosmological parameters from arbitrarily complex forward models of galaxy surveys where all relevant statistics can be determined from numerical simulations, i.e. black-boxes. Our approach, which we call simulator expansion for likelihood-free inference (SELFI), builds upon approximate Bayesian computation using a novel effective likelihood, and upon the linearisation of black-box models around an expansion point. Consequently, we obtain simple "filter equations" for an effective posterior of the primordial power spectrum, and a straightforward scheme for cosmological parameter inference. We demonstrate that the workload is computationally tractable, fixed a priori, and perfectly parallel. As a proof of concept, we apply our framework to a realistic synthetic galaxy survey, with a data model accounting for physical structure formation and incomplete and noisy galaxy observations. In doing so, we show that the use of non-linear numerical models allows the galaxy power spectrum to be safely fitted up to at least $k_\mathrm{max} = 0.5$ $h$/Mpc, outperforming state-of-the-art backward-modelling techniques by a factor of $\sim 5$ in the number of modes used. The result is an unbiased inference of the primordial matter power spectrum across the entire range of scales considered, including a high-fidelity reconstruction of baryon acoustic oscillations. It translates into an unbiased and robust inference of cosmological parameters. Our results pave the path towards easy applications of likelihood-free simulation-based inference in cosmology. We have made our code pySELFI and our data products publicly available at http://pyselfi.florent-leclercq.eu.

Gravitational wave (GW) sources are an excellent probe of the luminosity distance and offer a novel measure of the Hubble constant, $H_0$. This estimation of $H_0$ from standard sirens requires an accurate estimation of the cosmological redshift of the host galaxy of the GW source, after correcting for its peculiar velocity. Absence of an accurate peculiar velocity correction affects both the precision and accuracy of the measurement of $H_0$, particularly for nearby sources. We propose a framework to incorporate such a peculiar velocity correction for GW sources. The implementation of our method to the event GW170817 combined with the Very Large Baseline Interferometry (VLBI) observation leads to a revised value of $H_0= 69.3^{+ 4.5}_{-4.0}$ km s$^{-1}$Mpc$^{-1}$; more importantly, it demonstrates that our method will allow to achieve in practice unbiased, accurate measurements of $H_0$ at the precision promised by standard siren forecasts.

One of the major science goals over the coming decade is to test fundamental physics with probes of the cosmic large-scale structure out to high redshift. Here we present a fully Bayesian approach to infer the three-dimensional cosmic matter distribution and its dynamics at $z>2$ from observations of the Lyman-$\alpha$ forest. We demonstrate that the method recovers the unbiased mass distribution and the correct matter power spectrum at all scales. Our method infers the three-dimensional density field from a set of one-dimensional spectra, interpolating the information between the lines of sight. We show that our algorithm provides unbiased mass profiles of clusters, becoming an alternative for estimating cluster masses complementary to weak lensing or X-ray observations. The algorithm employs a Hamiltonian Monte Carlo method to generate realizations of initial and evolved density fields and the three-dimensional large-scale flow, revealing the cosmic dynamics at high redshift. The method correctly handles multi-modal parameter distributions, which allow constraining the physics of the intergalactic medium (IGM) with high accuracy. We performed several tests using realistic simulated quasar spectra to test and validate our method. Our results show that detailed and physically plausible inference of three-dimensional large-scale structures at high redshift has become feasible.

An ambitious goal in cosmology is to forward-model the observed distribution of galaxies in the nearby Universe today from the initial conditions of large-scale structures. For practical reasons, the spatial resolution at which this can be done is necessarily limited. Consequently, one needs a mapping between the density of dark matter averaged over ~Mpc scales, and the distribution of dark matter halos (used as a proxy for galaxies) in the same region. Here we demonstrate a method for determining the halo mass distribution function by learning the tracer bias between density fields and halo catalogues using a neural bias model. The method is based on the Bayesian analysis of simple, physically motivated, neural network-like architectures, which we denote as neural physical engines, and neural density estimation. As a result, we are able to sample the initial phases of the dark matter density field whilst inferring the parameters describing the halo mass distribution function, providing a fully Bayesian interpretation of both the initial dark matter density distribution and the neural bias model. We successfully run an upgraded BORG inference using our new likelihood and neural bias model with halo catalogues derived from full N-body simulations. We notice orders of magnitude improvement in modelling compared to classical biasing techniques.

We perform an analysis of the three-dimensional cosmic matter density field traced by galaxies of the SDSS-III/BOSS galaxy sample. The systematic-free nature of this analysis is confirmed by two elements: the successful cross-correlation with the gravitational lensing observations derived from Planck 2018 data and the absence of bias at scales $k \simeq 10^{-3}-10^{-2}h$ Mpc$^{-1}$ in the a posteriori power spectrum of recovered initial conditions. Our analysis builds upon our algorithm for Bayesian Origin Reconstruction from Galaxies (BORG) and uses a physical model of cosmic structure formation to infer physically meaningful cosmic structures and their corresponding dynamics from deep galaxy observations. Our approach accounts for redshift-space distortions and light-cone effects inherent to deep observations. We also apply detailed corrections to account for known and unknown foreground contaminations, selection effects and galaxy biases. We obtain maps of residual, so far unexplained, systematic effects in the spectroscopic data of SDSS-III/BOSS. Our results show that unbiased and physically plausible models of the cosmic large scale structure can be obtained from present and next-generation galaxy surveys.

The treatment of unknown foreground contaminations will be one of the major challenges for galaxy clustering analyses of coming decadal surveys. These data contaminations introduce erroneous large-scale effects in recovered power spectra and inferred dark matter density fields. In this work, we present an effective solution to this problem in the form of a robust likelihood designed to account for effects due to unknown foreground and target contaminations. Conceptually, this robust likelihood marginalizes over the unknown large-scale contamination amplitudes. We showcase the effectiveness of this novel likelihood via an application to a mock SDSS-III data set subject to dust extinction contamination. In order to illustrate the performance of our proposed likelihood, we infer the underlying dark-matter density field and reconstruct the matter power spectrum, being maximally agnostic about the foregrounds. The results are compared to those of an analysis with a standard Poissonian likelihood, as typically used in modern large-scale structure analyses. While the standard Poissonian analysis yields excessive power for large-scale modes and introduces an overall bias in the power spectrum, our likelihood provides unbiased estimates of the matter power spectrum over the entire range of Fourier modes considered in this work. Further, we demonstrate that our approach accurately accounts for and corrects the effects of unknown foreground contaminations when inferring three-dimensional density fields. Robust likelihood approaches, as presented in this work, will be crucial to control unknown systematic error and maximize the outcome of the decadal surveys.

The IMAGINE Consortium aims to bring modeling of the magnetic field of the Milky Way to a next level, by using Bayesian inference. IMAGINE includes an open-source modular software pipeline that optimizes parameters in a user-defined Galactic magnetic field model against various selected observational datasets. Bayesian priors can be added as external probabilistic constraints of the model parameters. These conference proceedings describe the science goals of the IMAGINE Consortium, the software pipeline and its inputs, viz observational data sets, Galactic magnetic field models, and Bayesian priors.

Conventional approaches to cosmology inference from galaxy redshift surveys are based on n-point functions, which are under rigorous perturbative control on sufficiently large scales. Here, we present an alternative approach, which employs a likelihood at the level of the galaxy density field. By integrating out small-scale modes based on effective-field theory arguments, we prove that this likelihood is under perturbative control if certain specific conditions are met. We further show that the information captured by this likelihood is equivalent to the combination of the next-to-leading order galaxy power spectrum, leading-order bispectrum, and BAO reconstruction. Combined with MCMC sampling and MAP optimization techniques, our results allow for fully Bayesian cosmology inference from large-scale structure that is under perturbative control. We illustrate this via a first demonstration of unbiased cosmology inference from nonlinear large-scale structure using this likelihood. In particular, we show unbiased estimates of the power spectrum normalization $\sigma_{8}$ from a catalog of simulated dark matter halos, where nonlinear information is crucial in breaking the $b_{1} - \sigma_{8}$ degeneracy.

Extensions of the standard models of particle physics and cosmology often lead to long-range fifth forces with properties dependent on gravitational environment. Fifth forces on astrophysical scales are best studied in the cosmic web where perturbation theory breaks down. We present constraints on chameleon- and symmetron-screened fifth forces with Yukawa coupling and megaparsec range -- as well as unscreened fifth forces with differential coupling to galactic mass components -- by searching for the displacements they predict between galaxies' stars and gas. Taking data from the Alfalfa HI survey, identifying galaxies' gravitational environments with the maps of Desmond et al. (2018a) and forward-modelling with a Bayesian likelihood framework, we set upper bounds on fifth-force strength relative to Newtonian gravity from $\Delta G/G_N < \text{few} \: \times 10^{-4}$ for range $\lambda_C = 50$ Mpc, to $\Delta G/G_N \lesssim 0.1$ for $\lambda_C = 500$ kpc. In $f(R)$ gravity this requires $f_{R0} < \text{few} \: \times \: 10^{-8}$. The analogous bounds without screening are $\Delta G/G_N < \text{few} \: \times 10^{-4}$ and $\Delta G/G_N < \text{few} \times 10^{-3}$. These are the tightest and among the only fifth-force constraints on galaxy scales. We show how our results may be strengthened with future survey data and identify the key features of an observational programme for furthering fifth-force tests beyond the Solar System.

We present a large-scale Bayesian inference framework to constrain cosmological parameters using galaxy redshift surveys, via an application of the Alcock-Paczy\'nski (AP) test. Our physical model of the non-linearly evolved density field, as probed by galaxy surveys, employs Lagrangian perturbation theory (LPT) to connect Gaussian initial conditions to the final density field, followed by a coordinate transformation to obtain the redshift space representation for comparison with data. We generate realizations of primordial and present-day matter fluctuations given a set of observations. This hierarchical approach encodes a novel AP test, extracting several orders of magnitude more information from the cosmological expansion compared to classical approaches, to infer cosmological parameters and jointly reconstruct the underlying 3D dark matter density field. The novelty of this AP test lies in constraining the comoving-redshift transformation to infer the appropriate cosmology which yields isotropic correlations of the galaxy density field, with the underlying assumption relying purely on the cosmological principle. Such an AP test does not rely explicitly on modelling the full statistics of the field. We verify in depth via simulations that this renders our test robust to model misspecification. This leads to another crucial advantage, namely that the cosmological parameters exhibit extremely weak dependence on the currently unresolved phenomenon of galaxy bias, thereby circumventing a potentially key limitation. This is consequently among the first methods to extract a large fraction of information from statistics other than that of direct density contrast correlations, without being sensitive to the amplitude of density fluctuations. We perform several statistical efficiency and consistency tests on a mock galaxy catalogue, using the SDSS-III survey as template.

Intra-galaxy signals contain a wealth of information on fundamental physics, both the dark sector and the nature of gravity. While so far largely unexplored, such probes are set to rise dramatically in importance as upcoming surveys provide data of unprecedented quantity and quality on galaxy structure and dynamics. In this paper, we use warping of stellar disks to test the chameleon- or symmetron-screened fifth forces which generically arise when new fields couple to matter. We take r-band images of mostly late-type galaxies from the Nasa Sloan Atlas and develop an automated algorithm to quantify the degree of U-shaped warping they exhibit. We then forward-model the warp signal as a function of fifth-force strength $\Delta G/G_N$ and range $\lambda_C$, and the gravitational environments and internal properties of the galaxies, including full propagation of the non-Gaussian uncertainties. Convolving this fifth-force likelihood function with a Gaussian describing astrophysical and observational noise and then constraining $\Delta G/G_N$ and $\lambda_C$ by Markov Chain Monte Carlo, we find the overall likelihood to be significant increased ($\Delta\log(\mathcal{L}) \simeq 20$) by adding a screened fifth force with $\lambda_C \simeq 2$ Mpc, $\Delta G/G_N \simeq 0.01$. The variation of $\Delta\log(\mathcal{L})$ with $\lambda_C$ is quantitatively as expected from the correlation of the magnitude of the fifth-force field with the force's range, and a similar model without screening achieves no increase in likelihood over the General Relativistic case $\Delta G=0$. Although these results are in good agreement with a previous analysis of the same model using offsets between galaxies' stellar and gas mass centroids (Desmond et al. 2018), we caution that the effects of confounding baryonic and dark matter physics must be thoroughly investigated for the results of the inference to be unambiguous.

One of the most common consequences of extensions to the standard models of particle physics or cosmology is the emergence of a fifth force. While generic fifth forces are tightly constrained at Solar System scales and below, they may escape detection by means of a screening mechanism which effectively removes them in dense environments. We constrain the strength $\Delta G/G_N$ and range $\lambda_C$ of a chameleon- or symmetron-screened fifth force with Yukawa coupling -- as well as an unscreened fifth force with differential coupling to galactic mass components -- by searching for the displacement it predicts between galaxies' stellar and gas mass centroids. Taking data from the Alfalfa HI survey, identifying galaxies' gravitational environments with the maps of Desmond et al. (2018a) and forward-modelling with a Bayesian likelihood framework, we find $6.6\sigma$ evidence for $\Delta G>0$ at $\lambda_C \simeq 2$ Mpc, with $\Delta G/G_N = 0.025$ at maximum-likelihood. A similar fifth-force model without screening gives no increase in likelihood over the case $\Delta G = 0$ for any $\lambda_C$. Although we validate these results by several methods, we do not claim screened modified gravity to provide the only possible explanation for the signal: this would require knowing that "galaxy formation" physics could not be responsible. We show also the results of a more conservative -- though less well motivated -- noise model which yields only upper limits on $\Delta G/G_N$, ranging from $\sim10^{-1}$ for $\lambda_C \simeq 0.5$ Mpc to $\sim \: \text{few} \times 10^{-4}$ at $\lambda_C \simeq 50$ Mpc. We show how these constraints may be improved by future galaxy surveys and identify the key features of an observational programme for directly constraining fifth forces on galactic scales. This paper provides a complete description of the analysis summarised in Desmond et al. (2018b).

In this white paper we introduce the IMAGINE Consortium and its scientific background, goals and structure. Our purpose is to coordinate and facilitate the efforts of a diverse group of researchers in the broad areas of the interstellar medium, Galactic magnetic fields and cosmic rays, and our goal is to develop more comprehensive insights into the structures and roles of interstellar magnetic fields and their interactions with cosmic rays. To achieve a higher level of self-consistency, depth and rigour can only be achieved by the coordinated efforts of experts in diverse areas of astrophysics involved in observational, theoretical and numerical work. We present our view of the present status of this topic, identify its key unsolved problems and suggest a strategy that will underpin our work. The backbone of the consortium is the Interstellar MAGnetic field INference Engine, a publicly available Bayesian platform that employs robust statistical methods to explore the multi-dimensional likelihood space using any number of modular inputs. It provides an interpretation and modelling framework that has the power and flexibility to include a variety of observational, theoretical and numerical lines of evidence into a self-consistent and comprehensive picture of the thermal and non-thermal interstellar media. An important innovation is that a consistent understanding of the phenomena that are directly or indirectly influenced by the Galactic magnetic field, such as the deflection of ultra-high energy cosmic rays or extragalactic backgrounds, is made an integral part of the modelling. The IMAGINE Consortium, which is informal by nature and open to new participants, hereby presents a methodological framework for the modelling and understanding of Galactic magnetic fields that is available to all communities whose research relies on a state-of-the-art solution to this problem. (Abridged.)

Accurate analyses of present and next-generation galaxy surveys require new ways to handle effects of non-linear gravitational structure formation in data. To address these needs we present an extension of our previously developed algorithm for Bayesian Origin Reconstruction from Galaxies to analyse matter clustering at non-linear scales in observations. This is achieved by incorporating a numerical particle mesh model of structure formation into our Bayesian inference framework. The algorithm simultaneously infers the 3D primordial matter fluctuations from which present non-linear observations formed and provides reconstructions of velocity fields and structure formation histories. The physical forward modelling approach automatically accounts for non-Gaussian features in evolved matter density fields and addresses the redshift space distortion problem associated with peculiar motions of galaxies. Our algorithm employs a hierarchical Bayes approach to jointly account for observational effects, such as galaxy biases, selection effects, and noise. Corresponding parameters are marginalized out via a sophisticated Markov Chain Monte Carlo approach relying on a combination of a multiple block sampling framework and a Hamiltonian Monte Carlo sampler. We demonstrate the performance of the method by applying it to the 2M++ galaxy compilation, tracing the matter distribution of the Nearby Universe. We show accurate and detailed inferences of the 3D non-linear dark matter distribution of the Nearby Universe. As exemplified in the case of the Coma cluster, we provide mass estimates that are compatible with those obtained from weak lensing and X-ray observations. For the first time, we reconstruct the vorticity of the non-linear velocity field from observations. In summary, our method provides plausible and detailed inferences of dark matter and velocity fields of our cosmic neighbourhood.

Black hole masses are found to correlate with several global properties of their host galaxies, suggesting that black holes and galaxies have an intertwined evolution and that active galactic nuclei (AGN) have a significant impact on galaxy evolution. Since the large-scale environment can also affect AGN, this work studies how their formation and properties depend on the environment. We have used a reconstructed three-dimensional high-resolution density field obtained from a Bayesian large-scale structure reconstruction method applied to the 2M++ galaxy sample. A web-type classification relying on the shear tensor is used to identify different structures on the cosmic web, defining voids, sheets, filaments, and clusters. We confirm that the environmental density affects the AGN formation and their properties. We found that the AGN abundance is equivalent to the galaxy abundance, indicating that active and inactive galaxies reside in similar dark matter halos. However, occurrence rates are different for each spectral type and accretion rate. These differences are consistent with the AGN evolutionary sequence suggested by previous authors, Seyferts and Transition objects transforming into LINERs (Low-Ionization Nuclear Emission Line Regions), the weaker counterpart of Seyferts. We conclud that AGN properties depend on the environmental density more than on the web-type. More powerful starbursts and younger stellar populations are found in high densities, where interactions and mergers are more likely. AGN hosts show smaller masses in clusters for Seyferts and Transition objects, which might be due to gas stripping. In voids, the AGN population is dominated by the most massive galaxy hosts.

Context. The Galactic magnetic field (GMF) has a huge impact on the evolution of the Milky Way. Yet currently there exists no standard model for it, as its structure is not fully understood. In the past many parametric GMF models of varying complexity have been developed that all have been fitted to an individual set of observational data complicating comparability. Aims. Our goal is to systematize parameter inference of GMF models. We want to enable a statistical comparison of different models in the future, allow for simple refitting with respect to newly available data sets and thereby increase the research area's transparency. We aim to make state-of-the-art Bayesian methods easily available and in particular to treat the statistics related to the random components of the GMF correctly. Methods. To achieve our goals, we built IMAGINE, the Interstellar Magnetic Field Inference Engine. It is a modular open source framework for doing inference on generic parametric models of the Galaxy. We combine highly optimized tools and technology such as the MultiNest sampler and the information field theory framework NIFTy in order to leverage existing expertise. Results. We demonstrate the steps needed for robust parameter inference and model comparison. Our results show how important the combination of complementary observables like synchrotron emission and Faraday depth is while building a model and fitting its parameters to data. IMAGINE is open-source software available under the GNU General Public License v3 (GPL-3) at: https://gitlab.mpcdf.mpg.de/ift/IMAGINE

Tests of gravity at the galaxy scale are in their infancy. As a first step to systematically uncovering the gravitational significance of galaxies, we map three fundamental gravitational variables -- the Newtonian potential, acceleration and curvature -- over the galaxy environments of the local universe to a distance of approximately 200 Mpc. Our method combines the contributions from galaxies in an all-sky redshift survey, halos from an N-body simulation hosting low-luminosity objects, and linear and quasi-linear modes of the density field. We use the ranges of these variables to determine the extent to which galaxies expand the scope of generic tests of gravity and are capable of constraining specific classes of model for which they have special significance. Finally, we investigate the improvements afforded by upcoming galaxy surveys.

This work presents a joint and self-consistent Bayesian treatment of various foreground and target contaminations when inferring cosmological power-spectra and three dimensional density fields from galaxy redshift surveys. This is achieved by introducing additional block sampling procedures for unknown coefficients of foreground and target contamination templates to the previously presented ARES framework for Bayesian large scale structure analyses. As a result the method infers jointly and fully self-consistently three dimensional density fields, cosmological power-spectra, luminosity dependent galaxy biases, noise levels of respective galaxy distributions and coefficients for a set of a priori specified foreground templates. In addition this fully Bayesian approach permits detailed quantification of correlated uncertainties amongst all inferred quantities and correctly marginalizes over observational systematic effects. We demonstrate the validity and efficiency of our approach in obtaining unbiased estimates of power-spectra via applications to realistic mock galaxy observations subject to stellar contamination and dust extinction. While simultaneously accounting for galaxy biases and unknown noise levels our method reliably and robustly infers three dimensional density fields and corresponding cosmological power-spectra from deep galaxy surveys. Further our approach correctly accounts for joint and correlated uncertainties between unknown coefficients of foreground templates and the amplitudes of the power-spectrum. An effect amounting up to $10$ percent correlations and anti-correlations across large ranges in Fourier space.

Previous studies using numerical simulations have demonstrated that the shape of the cosmic web can be described by studying the Lagrangian displacement field. We extend these analyses, showing that it is now possible to perform a Lagrangian description of cosmic structure in the nearby Universe based on large-scale structure observations. Building upon recent Bayesian large-scale inference of initial conditions, we present a cosmographic analysis of the dark matter distribution and its evolution, referred to as the dark matter phase-space sheet, in the nearby universe as probed by the Sloan Digital Sky Survey main galaxy sample. We consider its stretchings and foldings using a tetrahedral tessellation of the Lagrangian lattice. The method provides extremely accurate estimates of nearby density and velocity fields, even in regions of low galaxy density. It also measures the number of matter streams, and the deformation and parity reversals of fluid elements, which were previously thought inaccessible using observations. We illustrate the approach by showing the phase-space structure of known objects of the nearby Universe such as the Sloan Great Wall, the Coma cluster and the Bo\"otes void. We dissect cosmic structures into four distinct components (voids, sheets, filaments, and clusters), using the Lagrangian classifiers DIVA, ORIGAMI, and a new scheme which we introduce and call LICH. Because these classifiers use information other than the sheer local density, identified structures explicitly carry physical information about their formation history. Accessing the phase-space structure of dark matter in galaxy surveys opens the way for new confrontations of observational data and theoretical models. We have made our data products publicly available.

We introduce a decision scheme for optimally choosing a classifier, which segments the cosmic web into different structure types (voids, sheets, filaments, and clusters). Our framework, based on information theory, accounts for the design aims of different classes of possible applications: (i) parameter inference, (ii) model selection, and (iii) prediction of new observations. As an illustration, we use cosmographic maps of web-types in the Sloan Digital Sky Survey to assess the relative performance of the classifiers T-web, DIVA and ORIGAMI for: (i) analyzing the morphology of the cosmic web, (ii) discriminating dark energy models, and (iii) predicting galaxy colors. Our study substantiates a data-supported connection between cosmic web analysis and information theory, and paves the path towards principled design of analysis procedures for the next generation of galaxy surveys. We have made the cosmic web maps, galaxy catalog, and analysis scripts used in this work publicly available.

This work describes the implementation and application of a correlation determination method based on Self Organizing Maps and Bayesian Inference (SOMBI). SOMBI aims to automatically identify relations between different observed parameters in unstructured cosmological or astrophysical surveys by automatically identifying data clusters in high-dimensional datasets via the Self Organizing Map neural network algorithm. Parameter relations are then revealed by means of a Bayesian inference within respective identified data clusters. Specifically such relations are assumed to be parametrized as a polynomial of unknown order. The Bayesian approach results in a posterior probability distribution function for respective polynomial coefficients. To decide which polynomial order suffices to describe correlation structures in data, we include a method for model selection, the Bayesian Information Criterion, to the analysis. The performance of the SOMBI algorithm is tested with mock data. As illustration we also provide applications of our method to cosmological data. In particular, we present results of a correlation analysis between galaxy and AGN properties provided by the SDSS catalog with the cosmic large-scale-structure (LSS). The results indicate that the combined galaxy and LSS dataset indeed is clustered into several sub-samples of data with different average properties (for example different stellar masses or web-type classifications). The majority of data clusters appear to have a similar correlation structure between galaxy properties and the LSS. In particular we revealed a positive and linear dependency between the stellar mass, the absolute magnitude and the color of a galaxy with the corresponding cosmic density field. A remaining subset of data shows inverted correlations, which might be an artifact of non-linear redshift distortions.

We present a proof-of-concept of a novel and fully Bayesian methodology designed to detect halos of different masses in cosmological observations subject to noise and systematic uncertainties. Our methodology combines the previously published Bayesian large-scale structure inference algorithm, HADES, and a Bayesian chain rule (the Blackwell-Rao Estimator), which we use to connect the inferred density field to the properties of dark matter halos. To demonstrate the capability of our approach we construct a realistic galaxy mock catalogue emulating the wide-area 6-degree Field Galaxy Survey, which has a median redshift of approximately 0.05. Application of HADES to the catalogue provides us with accurately inferred three-dimensional density fields and corresponding quantification of uncertainties inherent to any cosmological observation. We then use a cosmological simulation to relate the amplitude of the density field to the probability of detecting a halo with mass above a specified threshold. With this information we can sum over the HADES density field realisations to construct maps of detection probabilities and demonstrate the validity of this approach within our mock scenario. We find that the probability of successful of detection of halos in the mock catalogue increases as a function of the signal-to-noise of the local galaxy observations. Our proposed methodology can easily be extended to account for more complex scientific questions and is a promising novel tool to analyse the cosmic large-scale structure in observations.

This work describes a full Bayesian analysis of the Nearby Universe as traced by galaxies of the 2M++ survey. The analysis is run in two sequential steps. The first step self-consistently derives the luminosity dependent galaxy biases, the power-spectrum of matter fluctuations and matter density fields within a Gaussian statistic approximation. The second step makes a detailed analysis of the three dimensional Large Scale Structures, assuming a fixed bias model and a fixed cosmology. This second step allows for the reconstruction of both the final density field and the initial conditions at z=1000 assuming a fixed bias model. From these, we derive fields that self-consistently extrapolate the observed large scale structures. We give two examples of these extrapolation and their utility for the detection of structures: the visibility of the Sloan Great Wall, and the detection and characterization of the Local Void using DIVA, a Lagrangian based technique to classify structures.

The BORG algorithm is an inference engine that derives the initial conditions given a cosmological model and galaxy survey data, and produces physical reconstructions of the underlying large-scale structure by assimilating the data into the model. We present the application of BORG to real galaxy catalogs and describe the primordial and late-time large-scale structure in the considered volumes. We then show how these results can be used for building various probabilistic maps of the large-scale structure, with rigorous propagation of uncertainties. In particular, we study dynamic cosmic web elements and secondary effects in the cosmic microwave background.

Determining magnetic field properties in different environments of the cosmic large-scale structure as well as their evolution over redshift is a fundamental step toward uncovering the origin of cosmic magnetic fields. Radio observations permit the study of extragalactic magnetic fields via measurements of the Faraday depth of extragalactic radio sources. Our aim is to investigate how much different extragalactic environments contribute to the Faraday depth variance of these sources. We develop a Bayesian algorithm to distinguish statistically Faraday depth variance contributions intrinsic to the source from those due to the medium between the source and the observer. In our algorithm the Galactic foreground and the measurement noise are taken into account as the uncertainty correlations of the galactic model. Additionally, our algorithm allows for the investigation of possible redshift evolution of the extragalactic contribution. This work presents the derivation of the algorithm and tests performed on mock observations. With cosmic magnetism being one of the key science projects of the new generation of radio interferometers we have made predictions for the algorithm's performance on data from the next generation of radio interferometers. Applications to real data are left for future work.

On the smallest scales, three-dimensional large-scale structure surveys contain a wealth of cosmological information which cannot be trivially extracted due to the non-linear dynamical evolution of the density field. Lagrangian perturbation theory (LPT) is widely applied to the generation of mock halo catalogs and data analysis. In this work, we compare topological features of the cosmic web such as voids, sheets, filaments and clusters, in the density fields predicted by LPT and full numerical simulation of gravitational large-scale structure formation. We propose a method designed to improve the correspondence between these density fields, in the mildly non-linear regime. We develop a computationally fast and flexible tool for a variety of cosmological applications. Our method is based on a remapping of the approximately-evolved density field, using information extracted from N-body simulations. The remapping procedure consists of replacing the one-point distribution of the density contrast by one which better accounts for the full gravitational dynamics. As a result, we obtain a physically more pertinent density field on a point-by-point basis, while also improving higher-order statistics predicted by LPT. We quantify the approximation error in the power spectrum and in the bispectrum as a function of scale and redshift. Our remapping procedure improves one-, two- and three-point statistics at scales down to 8 Mpc/h.

This document is an addendum to "One-point remapping of Lagrangian perturbation theory in the mildly non-linear regime of cosmic structure formation" (arXiv:1305.4642).

What do we know about voids in the dark matter distribution given the Sloan Digital Sky Survey (SDSS) and assuming the $\Lambda\mathrm{CDM}$ model? Recent application of the Bayesian inference algorithm BORG to the SDSS Data Release 7 main galaxy sample has generated detailed Eulerian and Lagrangian representations of the large-scale structure as well as the possibility to accurately quantify corresponding uncertainties. Building upon these results, we present constrained catalogs of voids in the Sloan volume, aiming at a physical representation of dark matter underdensities and at the alleviation of the problems due to sparsity and biasing on galaxy void catalogs. To do so, we generate data-constrained reconstructions of the presently observed large-scale structure using a fully non-linear gravitational model. We then find and analyze void candidates using the VIDE toolkit. Our methodology therefore predicts the properties of voids based on fusing prior information from simulations and data constraints. For usual void statistics (number function, ellipticity distribution and radial density profile), all the results obtained are in agreement with dark matter simulations. Our dark matter void candidates probe a deeper void hierarchy than voids directly based on the observed galaxies alone. The use of our catalogs therefore opens the way to high-precision void cosmology at the level of the dark matter field. We will make the void catalogs used in this work available at http://www.cosmicvoids.net.

We propose a decision criterion for segmenting the cosmic web into different structure types (voids, sheets, filaments, and clusters) on the basis of their respective probabilities and the strength of data constraints. Our approach is inspired by an analysis of games of chance where the gambler only plays if a positive expected net gain can be achieved based on some degree of privileged information. The result is a general solution for classification problems in the face of uncertainty, including the option of not committing to a class for a candidate object. As an illustration, we produce high-resolution maps of web-type constituents in the nearby Universe as probed by the Sloan Digital Sky Survey main galaxy sample. Other possible applications include the selection and labelling of objects in catalogues derived from astronomical survey data.

Recent application of the Bayesian algorithm BORG to the Sloan Digital Sky Survey (SDSS) main sample galaxies resulted in the physical inference of the formation history of the observed large-scale structure from its origin to the present epoch. In this work, we use these inferences as inputs for a detailed probabilistic cosmic web-type analysis. To do so, we generate a large set of data-constrained realizations of the large-scale structure using a fast, fully non-linear gravitational model. We then perform a dynamic classification of the cosmic web into four distinct components (voids, sheets, filaments, and clusters) on the basis of the tidal field. Our inference framework automatically and self-consistently propagates typical observational uncertainties to web-type classification. As a result, this study produces accurate cosmographic classification of large-scale structure elements in the SDSS volume. By also providing the history of these structure maps, the approach allows an analysis of the origin and growth of the early traces of the cosmic web present in the initial density field and of the evolution of global quantities such as the volume and mass filling fractions of different structures. For the problem of web-type classification, the results described in this work constitute the first connection between theory and observations at non-linear scales including a physical model of structure formation and the demonstrated capability of uncertainty quantification. A connection between cosmology and information theory using real data also naturally emerges from our probabilistic approach. Our results constitute quantitative chrono-cosmography of the complex web-like patterns underlying the observed galaxy distribution.

To better understand the origin and properties of cosmological magnetic fields, a detailed knowledge of magnetic fields in the large-scale structure of the Universe (galaxy clusters, filaments) is crucial. We propose a new statistical approach to study magnetic fields on large scales with the rotation measure grid data that will be obtained with the new generation of radio interferometers.

We develop and test a new statistical method to measure the kinematic Sunyaev-Zel'dovich (kSZ) effect. A sample of independently detected clusters is combined with the cosmic flow field predicted from a galaxy redshift survey in order to derive a matched filter that optimally weights the kSZ signal for the sample as a whole given the noise involved in the problem. We apply this formalism to realistic mock microwave skies based on cosmological $N$-body simulations, and demonstrate its robustness and performance. In particular, we carefully assess the various sources of uncertainty, cosmic microwave background primary fluctuations, instrumental noise, uncertainties in the determination of the velocity field, and effects introduced by miscentring of clusters and by uncertainties of the mass-observable relation (normalization and scatter). We show that available data (\plk\ maps and the MaxBCG catalogue) should deliver a $7.7\sigma$ detection of the kSZ. A similar cluster catalogue with broader sky coverage should increase the detection significance to $\sim 13\sigma$. We point out that such measurements could be binned in order to study the properties of the cosmic gas and velocity fields, or combined into a single measurement to constrain cosmological parameters or deviations of the law of gravity from General Relativity.

We present a chrono-cosmography project, aiming at the inference of the four dimensional formation history of the observed large scale structure from its origin to the present epoch. To do so, we perform a full-scale Bayesian analysis of the northern galactic cap of the Sloan Digital Sky Survey (SDSS) Data Release 7 main galaxy sample, relying on a fully probabilistic, physical model of the non-linearly evolved density field. Besides inferring initial conditions from observations, our methodology naturally and accurately reconstructs non-linear features at the present epoch, such as walls and filaments, corresponding to high-order correlation functions generated by late-time structure formation. Our inference framework self-consistently accounts for typical observational systematic and statistical uncertainties such as noise, survey geometry and selection effects. We further account for luminosity dependent galaxy biases and automatic noise calibration within a fully Bayesian approach. As a result, this analysis provides highly-detailed and accurate reconstructions of the present density field on scales larger than $\sim~3$ Mpc$/h$, constrained by SDSS observations. This approach also leads to the first quantitative inference of plausible formation histories of the dynamic large scale structure underlying the observed galaxy distribution. The results described in this work constitute the first full Bayesian non-linear analysis of the cosmic large scale structure with the demonstrated capability of uncertainty quantification. Some of these results will be made publicly available along with this work. The level of detail of inferred results and the high degree of control on observational uncertainties pave the path towards high precision chrono-cosmography, the subject of simultaneously studying the dynamics and the morphology of the inhomogeneous Universe.

The ESA's Planck satellite, dedicated to studying the early Universe and its subsequent evolution, was launched 14 May 2009 and has been scanning the microwave and submillimetre sky continuously since 12 August 2009. This paper gives an overview of the mission and its performance, the processing, analysis, and characteristics of the data, the scientific results, and the science data products and papers in the release. The science products include maps of the CMB and diffuse extragalactic foregrounds, a catalogue of compact Galactic and extragalactic sources, and a list of sources detected through the SZ effect. The likelihood code used to assess cosmological models against the Planck data and a lensing likelihood are described. Scientific results include robust support for the standard six-parameter LCDM model of cosmology and improved measurements of its parameters, including a highly significant deviation from scale invariance of the primordial power spectrum. The Planck values for these parameters and others derived from them are significantly different from those previously determined. Several large-scale anomalies in the temperature distribution of the CMB, first detected by WMAP, are confirmed with higher confidence. Planck sets new limits on the number and mass of neutrinos, and has measured gravitational lensing of CMB anisotropies at greater than 25 sigma. Planck finds no evidence for non-Gaussianity in the CMB. Planck's results agree well with results from the measurements of baryon acoustic oscillations. Planck finds a lower Hubble constant than found in some more local measures. Some tension is also present between the amplitude of matter fluctuations derived from CMB data and that derived from SZ data. The Planck and WMAP power spectra are offset from each other by an average level of about 2% around the first acoustic peak.

Using \Planck\ data combined with the Meta Catalogue of X-ray detected Clusters of galaxies (MCXC), we address the study of peculiar motions by searching for evidence of the kinetic Sunyaev-Zeldovich effect (kSZ). By implementing various filters designed to extract the kSZ generated at the positions of the clusters, we obtain consistent constraints on the radial peculiar velocity average, root mean square (rms), and local bulk flow amplitude at different depths. For the whole cluster sample of average redshift 0.18, the measured average radial peculiar velocity with respect to the cosmic microwave background (CMB) radiation at that redshift, i.e., the kSZ monopole, amounts to $72 \pm 60$ km s$^{-1}$. This constitutes less than 1% of the relative Hubble velocity of the cluster sample with respect to our local CMB frame. While the linear $\Lambda$CDM prediction for the typical cluster radial velocity rms at $z=0.15$ is close to 230km s$^{-1}$, the upper limit imposed by \Planck\ data on the cluster subsample corresponds to 800 km s$^{-1}$ at 95% confidence level, i.e., about three times higher. \Planck\ data also set strong constraints on the local bulk flow in volumes centred on the Local Group. There is no detection of bulk flow as measured in any comoving sphere extending to the maximum redshift covered by the cluster sample. A blind search for bulk flows in this sample has an upper limit of 254 km s$^{-1}$ (95% confidence level) dominated by CMB confusion and instrumental noise, indicating that the Universe is largely homogeneous on Gpc scales. In this context, in conjunction with supernova observations, \Planck\ is able to rule out a large class of inhomogeneous void models as alternatives to dark energy or modified gravity. The \Planck\ constraints on peculiar velocities and bulk flows are thus consistent with the $\Lambda$CDM scenario.

In this work we propose a new matrix-free implementation of the Wiener sampler which is traditionally applied to high dimensional analysis when signal covariances are unknown. Specifically, the proposed method addresses the problem of jointly inferring a high dimensional signal and its corresponding covariance matrix from a set of observations. Our method implements a Gibbs sampling adaptation of the previously presented messenger approach, permitting to cast the complex multivariate inference problem into a sequence of uni-variate random processes. In this fashion, the traditional requirement of inverting high dimensional matrices is completely eliminated from the inference process, resulting in an efficient algorithm that is trivial to implement. Using cosmic large scale structure data as a showcase, we demonstrate the capabilities of our Gibbs sampling approach by performing a joint analysis of three dimensional density fields and corresponding power-spectra from Gaussian mock catalogues. These tests clearly demonstrate the ability of the algorithm to accurately provide measurements of the three dimensional density field and its power-spectrum and corresponding uncertainty quantification. Moreover, these tests reveal excellent numerical and statistical efficiency which will generally render the proposed algorithm a valuable addition to the toolbox of large scale Bayesian inference in cosmology and astrophysics.

Based on CMB maps from the 2013 Planck Mission data release, this paper presents the detection of the ISW effect, i.e., the correlation between the CMB and large-scale evolving gravitational potentials. The significance of detection ranges from 2 to 4 sigma, depending on which method is used. We investigate three separate approaches, which cover essentially all previous studies, as well as breaking new ground. (i) Correlation of the CMB with the Planck reconstructed gravitational lensing potential (for the first time). This detection is made using the lensing-induced bispectrum; the correlation between lensing and the ISW effect has a significance close to 2.5 sigma. (ii) Cross-correlation with tracers of LSS, yielding around 3 sigma significance, based on a combination of radio (NVSS) and optical (SDSS) data. (iii) Aperture photometry on stacked CMB fields at the locations of known large-scale structures, which yields a 4 sigma signal when using a previously explored catalogue, but shows strong discrepancies in amplitude and scale compared to expectations. More recent catalogues give more moderate results, ranging from negligible to 2.5 sigma at most, but with a more consistent scale and amplitude, the latter being still slightly above what is expected from numerical simulations within LCMD. Where they can be compared, these measurements are compatible with previous work using data from WMAP, which had already mapped these scales to the limits of cosmic variance. Planck's broader frequency coverage confirms that the signal is achromatic, bolstering the case for ISW detection. As a final step we use tracers of large-scale structure to filter the CMB data, presenting maps of the ISW temperature perturbation. These results provide complementary and independent evidence for the existence of a dark energy component that governs the current accelerated expansion of the Universe.

We derive and implement a full Bayesian large scale structure inference method aiming at precision recovery of the cosmological power spectrum from galaxy redshift surveys. Our approach improves over previous Bayesian methods by performing a joint inference of the three dimensional density field, the cosmological power spectrum, luminosity dependent galaxy biases and corresponding normalizations. We account for all joint and correlated uncertainties between all inferred quantities. Classes of galaxies with different biases are treated as separate sub samples. The method therefore also allows the combined analysis of more than one galaxy survey. In particular, it solves the problem of inferring the power spectrum from galaxy surveys with non-trivial survey geometries by exploring the joint posterior distribution with efficient implementations of multiple block Markov chain and Hybrid Monte Carlo methods. Our Markov sampler achieves high statistical efficiency in low signal to noise regimes by using a deterministic reversible jump algorithm. We test our method on an artificial mock galaxy survey, emulating characteristic features of the Sloan Digital Sky Survey data release 7, such as its survey geometry and luminosity dependent biases. These tests demonstrate the numerical feasibility of our large scale Bayesian inference frame work when the parameter space has millions of dimensions. The method reveals and correctly treats the anti-correlation between bias amplitudes and power spectrum, which are not taken into account in current approaches to power spectrum estimation, a 20 percent effect across large ranges in k-space. In addition, the method results in constrained realizations of density fields obtained without assuming the power spectrum or bias parameters in advance.

The Square Kilometre Array (SKA) is the most ambitious radio telescope ever planned. With a collecting area of about a square kilometre, the SKA will be far superior in sensitivity and observing speed to all current radio facilities. The scientific capability promised by the SKA and its technological challenges provide an ideal base for interdisciplinary research, technology transfer, and collaboration between universities, research centres and industry. The SKA in the radio regime and the European Extreme Large Telescope (E-ELT) in the optical band are on the roadmap of the European Strategy Forum for Research Infrastructures (ESFRI) and have been recognised as the essential facilities for European research in astronomy. This "White Paper" outlines the German science and R&D interests in the SKA project and will provide the basis for future funding applications to secure German involvement in the Square Kilometre Array.

We discuss two projects in non-linear cosmostatistics applicable to very large surveys of galaxies. The first is a Bayesian reconstruction of galaxy redshifts and their number density distribution from approximate, photometric redshift data. The second focuses on cosmic voids and uses them to construct cosmic spheres that allow reconstructing the expansion history of the Universe using the Alcock-Paczynski test. In both cases we find that non-linearities enable the methods or enhance the results: non-linear gravitational evolution creates voids and our photo-z reconstruction works best in the highest density (and hence most non-linear) portions of our simulations.

We present further results from the ongoing XMM-Newton validation follow-up of Planck cluster candidates, detailing X-ray observations of eleven candidates detected at a signal-to-noise ratio of 4.5<S/N<5.3 in the same 10-month survey maps used in the construction of the Early SZ sample. The sample was selected in order to test internal SZ quality flags, and the pertinence of these flags is discussed in light of the validation results. Ten of the candidates are found to be bona fide clusters lying below the RASS flux limit. Redshift estimates are available for all confirmed systems via X-ray Fe-line spectroscopy. They lie in the redshift range 0.19<z<0.94, demonstrating Planck's capability to detect clusters up to high z. The X-ray properties of the new clusters appear to be similar to previous new detections by Planck at lower z and higher SZ flux: the majority are X-ray underluminous for their mass, estimated using Y_X as mass proxy, and many have a disturbed morphology. We find tentative indication for Malmquist bias in the Y_SZ-Y_X relation, with a turnover at Y_SZ \sim 4 e-4 arcmin^2. We present additional new optical redshift determinations with ENO and ESO telescopes of candidates previously confirmed with XMM-Newton. The X-ray and optical redshifts for a total of 20 clusters are found to be in excellent agreement. We also show that useful lower limits can be put on cluster redshifts using X-ray data only via the use of the Y_X vs. Y_SZ and X-ray flux F_X vs. Y_SZ relations.

We present a fully probabilistic, physical model of the non-linearly evolved density field, as probed by realistic galaxy surveys. Our model is valid in the linear and mildly non-linear regimes and uses second order Lagrangian perturbation theory to connect the initial conditions with the final density field. Our parameter space consists of the 3D initial density field and our method allows a fully Bayesian exploration of the sets of initial conditions that are consistent with the galaxy distribution sampling the final density field. A natural byproduct of this technique is an optimal non-linear reconstruction of the present density and velocity fields, including a full propagation of the observational uncertainties. A test of these methods on simulated data mimicking the survey mask, selection function and galaxy number of the SDSS DR7 main sample shows that this physical model gives accurate reconstructions of the underlying present-day density and velocity fields on scales larger than ~6 Mpc/h. Our method naturally and accurately reconstructs non-linear features corresponding to three-point and higher order correlation functions such as walls and filaments. Simple tests of the reconstructed initial conditions show statistical consistency with the Gaussian simulation inputs. Our test demonstrates that statistical approaches based on physical models of the large scale structure distribution are now becoming feasible for realistic current and future surveys.

We show how to enhance the redshift accuracy of surveys consisting of tracers with highly uncertain positions along the line of sight. Photometric surveys with redshift uncertainty delta_z ~ 0.03 can yield final redshift uncertainties of delta_z_f ~ 0.003 in high density regions. This increased redshift precision is achieved by imposing an isotropy and 2-point correlation prior in a Bayesian analysis and is completely independent of the process that estimates the photometric redshift. As a byproduct, the method also infers the three dimensional density field, essentially super-resolving high density regions in redshift space. Our method fully takes into account the survey mask and selection function. It uses a simplified Poissonian picture of galaxy formation, relating preferred locations of galaxies to regions of higher density in the matter field. The method quantifies the remaining uncertainties in the three dimensional density field and the true radial locations of galaxies by generating samples that are constrained by the survey data. The exploration of this high dimensional, non-Gaussian joint posterior is made feasible using multiple-block Metropolis-Hastings sampling. We demonstrate the performance of our implementation on a simulation containing 2.0 x 10^7 galaxies. These results bear out the promise of Bayesian analysis for upcoming photometric large scale structure surveys with tens of millions of galaxies.

In this work we present the first non-linear, non-Gaussian full Bayesian large scale structure analysis of the cosmic density field conducted so far. The density inference is based on the Sloan Digital Sky Survey data release 7, which covers the northern galactic cap. We employ a novel Bayesian sampling algorithm, which enables us to explore the extremely high dimensional non-Gaussian, non-linear log-normal Poissonian posterior of the three dimensional density field conditional on the data. These techniques are efficiently implemented in the HADES computer algorithm and permit the precise recovery of poorly sampled objects and non-linear density fields. The non-linear density inference is performed on a 750 Mpc cube with roughly 3 Mpc grid-resolution, while accounting for systematic effects, introduced by survey geometry and selection function of the SDSS, and the correct treatment of a Poissonian shot noise contribution. Our high resolution results represent remarkably well the cosmic web structure of the cosmic density field. Filaments, voids and clusters are clearly visible. Further, we also conduct a dynamical web classification, and estimated the web type posterior distribution conditional on the SDSS data.

In this work we present a new and efficient Bayesian method for nonlinear three dimensional large scale structure inference. We employ a Hamiltonian Monte Carlo (HMC) sampler to obtain samples from a multivariate highly non-Gaussian lognormal Poissonian density posterior given a set of observations. The HMC allows us to take into account the nonlinear relations between the observations and the underlying density field which we seek to recover. As the HMC provides a sampled representation of the density posterior any desired statistical summary, such as the mean, mode or variance, can be calculated from the set of samples. Further, it permits us to seamlessly propagate non-Gaussian uncertainty information to any final quantity inferred from the set of samples. The developed method is extensively tested in a variety of test scenarios, taking into account a highly structured survey geometry and selection effects. Tests with a mock galaxy catalog based on the millennium run show that the method is able to recover the filamentary structure of the nonlinear density field. The results further demonstrate the feasibility of non-Gaussian sampling in high dimensional spaces, as required for precision nonlinear large scale structure inference. The HMC is a flexible and efficient method, which permits for simple extension and incorporation of additional observational constraints. Thus, the method presented here provides an efficient and flexible basis for future high precision large scale structure inference.

We describe an exact, flexible, and computationally efficient algorithm for a joint estimation of the large-scale structure and its power-spectrum, building on a Gibbs sampling framework and present its implementation ARES (Algorithm for REconstruction and Sampling). ARES is designed to reconstruct the 3D power-spectrum together with the underlying dark matter density field in a Bayesian framework, under the reasonable assumption that the long wavelength Fourier components are Gaussian distributed. As a result ARES does not only provide a single estimate but samples from the joint posterior of the power-spectrum and density field conditional on a set of observations. This enables us to calculate any desired statistical summary, in particular we are able to provide joint uncertainty estimates. We apply our method to mock catalogs, with highly structured observational masks and selection functions, in order to demonstrate its ability to reconstruct the power-spectrum from real data sets, while fully accounting for any mask induced mode coupling.

We present a general expression for a lognormal filter given an arbitrary nonlinear galaxy bias. We derive this filter as the maximum a posteriori solution assuming a lognormal prior distribution for the matter field with a given mean field and modeling the observed galaxy distribution by a Poissonian process. We have performed a three-dimensional implementation of this filter with a very efficient Newton-Krylov inversion scheme. Furthermore, we have tested it with a dark matter N-body simulation assuming a unit galaxy bias relation and compared the results with previous density field estimators like the inverse weighting scheme and Wiener filtering. Our results show good agreement with the underlying dark matter field for overdensities even above delta~1000 which exceeds by one order of magnitude the regime in which the lognormal is expected to be valid. The reason is that for our filter the lognormal assumption enters as a prior distribution function, but the maximum a posteriori solution is also conditioned on the data. We find that the lognormal filter is superior to the previous filtering schemes in terms of higher correlation coefficients and smaller Euclidean distances to the underlying matter field. We also show how it is able to recover the positive tail of the matter density field distribution for a unit bias relation down to scales of about >~2 Mpc/h.

We present the largest Wiener reconstruction of the cosmic density field made to date. The reconstruction is based on the Sloan Digital Sky Survey data release 6 covering the northern Galactic cap. We use a novel supersampling algorithm to suppress aliasing effects and a Krylov-space inversion method to enable high performance with high resolution. These techniques are implemented in the ARGO computer code. We reconstruct the field over a 500 Mpc cube with Mpc grid-resolution while accounting both for the angular and radial selection functions of the SDSS, and the shot noise giving an effective resolution of the order of ~10 Mpc. In addition, we correct for the redshift distortions in the linear and nonlinear regimes in an approximate way. We show that the commonly used method of inverse weighting the galaxies by the corresponding selection function heads to excess noise in regions where the density of the observed galaxies is small. It is more accurate and conservative to adopt a Bayesian framework in which we model the galaxy selection/detection process to be Poisson-binomial. This results in heavier smoothing in regions of reduced sampling density. Our results show a complex cosmic web structure with huge void regions indicating that the recovered matter distribution is highly non-Gaussian. Filamentary structures are clearly visible on scales up to ~20 Mpc. We also calculate the statistical distribution of density after smoothing the reconstruction with Gaussian kernels of different radii r_S and find good agreement with a log-normal distribution for ~10 Mpc < r_S < ~30 Mpc.

We address the problem of discretizing continuous cosmological signals such as a galaxy distribution for further processing with Fast Fourier techniques. Discretizing, in particular representing continuous signals by discrete sets of sample points, introduces an enormous loss of information, which has to be understood in detail if one wants to make inference from the discretely sampled signal towards actual natural physical quantities. We therefore review the mathematics of discretizing signals and the application of Fast Fourier Transforms to demonstrate how the interpretation of the processed data can be affected by these procedures. It is also a well known fact that any practical sampling method introduces sampling artifacts and false information in the form of aliasing. These sampling artifacts, especially aliasing, make further processing of the sampled signal difficult. For this reason we introduce a fast and efficient supersampling method, frequently applied in 3D computer graphics, to cosmological applications such as matter power spectrum estimation. This method consists of two filtering steps which allow for a much better approximation of the ideal sampling procedure, while at the same time being computationally very efficient.Thus, it provides discretely sampled signals which are greately cleaned from aliasing contributions.

One of the most outstanding problems in the gravitational collapse scenario of early structure formation is the cooling of primordial gas to allow for small mass objects to form. As the neutral primordial gas is a poor radiator at temperatures (T\le10^4\unit{K}), molecular hydrogen is needed for further cooling down to temperatures (T\sim100\unit{K}). The formation of molecular hydrogen is catalyzed by the presence of free electrons, which could be provided by the ionization due to an early population of cosmic rays. In order to investigate this possibility we developed a code to study the effects of ionizing cosmic rays on the thermal and chemical evolution of primordial gas. We found that cosmic rays can provide enough free electrons needed for the formation of molecular hydrogen, and therefore can increase the cooling ability of such primordial gas under following conditions: A dissociating photon flux with (F<10^{-18}\unit{erg cm^{-2} Hz^{-1} s^{-1}}), initial temperature of the gas (\sim10^{3}\unit{K}), total gas number densities (n\ge1\unit{cm^{-3}}), Cosmic ray sources with (\dot{\epsilon}_{CR}>10^{-33}\unit{erg cm^{-3} s^{-1}}).