Galactic all-sky maps at very disparate frequencies, like in the radio and $\gamma$-ray regime, show similar morphological structures. This mutual information reflects the imprint of the various physical components of the interstellar medium. We want to use multifrequency all-sky observations to test resolution improvement and restoration of unobserved areas for maps in certain frequency ranges. For this we aim to reconstruct or predict from sets of other maps all-sky maps that, in their original form, lack a high resolution compared to other available all-sky surveys or are incomplete in their spatial coverage. Additionally, we want to investigate the commonalities and differences that the ISM components exhibit over the electromagnetic spectrum. We build an $n$-dimensional representation of the joint pixel-brightness distribution of $n$ maps using a Gaussian mixture model and see how predictive it is: How well can one map be reproduced based on subsets of other maps? Tests with mock data show that reconstructing the map of a certain frequency from other frequency regimes works astonishingly well, predicting reliably small-scale details well below the spatial resolution of the initially learned map. Applied to the observed multifrequency data sets of the Milky Way this technique is able to improve the resolution of, e.g., the low-resolution Fermi LAT maps as well as to recover the sky from artifact-contaminated data like the ROSAT 0.855 keV map. The predicted maps generally show less imaging artifacts compared to the original ones. A comparison of predicted and original maps highlights surprising structures, imaging artifacts (fortunately not reproduced in the prediction), and features genuine to the respective frequency range that are not present at other frequency bands. We discuss limitations of this machine learning approach and ideas how to overcome them.

Context. The Galactic magnetic field (GMF) has a huge impact on the evolution of the Milky Way. Yet currently there exists no standard model for it, as its structure is not fully understood. In the past many parametric GMF models of varying complexity have been developed that all have been fitted to an individual set of observational data complicating comparability. Aims. Our goal is to systematize parameter inference of GMF models. We want to enable a statistical comparison of different models in the future, allow for simple refitting with respect to newly available data sets and thereby increase the research area's transparency. We aim to make state-of-the-art Bayesian methods easily available and in particular to treat the statistics related to the random components of the GMF correctly. Methods. To achieve our goals, we built IMAGINE, the Interstellar Magnetic Field Inference Engine. It is a modular open source framework for doing inference on generic parametric models of the Galaxy. We combine highly optimized tools and technology such as the MultiNest sampler and the information field theory framework NIFTy in order to leverage existing expertise. Results. We demonstrate the steps needed for robust parameter inference and model comparison. Our results show how important the combination of complementary observables like synchrotron emission and Faraday depth is while building a model and fitting its parameters to data. IMAGINE is open-source software available under the GNU General Public License v3 (GPL-3) at: https://gitlab.mpcdf.mpg.de/ift/IMAGINE

We present a Bayesian reconstruction algorithm that infers the three-dimensional large-scale matter distribution from the weak gravitational lensing effects measured in the image shapes of galaxies. The algorithm is designed to also work with non-Gaussian posterior distributions which arise, for example, from a non-Gaussian prior distribution. In this work, we use a lognormal prior and compare the reconstruction results to a Gaussian prior in a suite of increasingly realistic tests on mock data. We find that in cases of high noise levels (i.e. for low source galaxy densities and/or high shape measurement uncertainties), both normal and lognormal priors lead to reconstructions of comparable quality, but with the lognormal reconstruction being prone to mass-sheet degeneracy. In the low-noise regime and on small scales, the lognormal model produces better reconstructions than the normal model: The lognormal model 1) enforces non-negative densities, while negative densities are present when a normal prior is employed, 2) better traces the extremal values and the skewness of the true underlying distribution, and 3) yields a higher pixel-wise correlation between the reconstruction and the true density.

NIFTy, "Numerical Information Field Theory", is a software framework designed to ease the development and implementation of field inference algorithms. Field equations are formulated independently of the underlying spatial geometry allowing the user to focus on the algorithmic design. Under the hood, NIFTy ensures that the discretization of the implemented equations is consistent. This enables the user to prototype an algorithm rapidly in 1D and then apply it to high-dimensional real-world problems. This paper introduces NIFTy 3, a major upgrade to the original NIFTy framework. NIFTy 3 allows the user to run inference algorithms on massively parallel high performance computing clusters without changing the implementation of the field equations. It supports n-dimensional Cartesian spaces, spherical spaces, power spaces, and product spaces as well as transforms to their harmonic counterparts. Furthermore, NIFTy 3 is able to treat non-scalar fields. The functionality and performance of the software package is demonstrated with example code, which implements a real inference algorithm from the realm of information field theory. NIFTy 3 is open-source software available under the GNU General Public License v3 (GPL-3) at https://gitlab.mpcdf.mpg.de/ift/NIFTy/

The standard imaging algorithm for interferometric radio data, CLEAN, is optimal for point source observations, but suboptimal for diffuse emission. Recently, RESOLVE, a new Bayesian algorithm has been developed, which is ideal for extended source imaging. Unfortunately, RESOLVE is computationally very expensive. In this paper we present fastRESOLVE, a modification of RESOLVE based on an approximation of the interferometric likelihood that allows us to avoid expensive gridding routines and consequently gain a factor of roughly 100 in computation time. Furthermore, we include a Bayesian estimation of the measurement uncertainty of the visibilities into the imaging, a procedure not applied in aperture synthesis before. The algorithm requires little to no user input compared to the standard method CLEAN while being superior for extended and faint emission. We apply the algorithm to VLA data of Abell 2199 and show that it resolves more detailed structures.

We present charm (cosmic history agnostic reconstruction method), a novel inference algorithm that reconstructs the cosmic expansion history as encoded in the Hubble parameter $H(z)$ from SNe Ia data. The novelty of the approach lies in the usage of information field theory, a statistical field theory that is very well suited for the construction of optimal signal recovery algorithms. The charm algorithm infers non-parametrically $s(a)=\ln(\rho(a)/\rho_{\mathrm{crit}0})$, the density evolution which determines $H(z)$, without assuming an analytical form of $\rho(a)$ but only its smoothness with the scale factor $a=(1+z)^{-1}$. The inference problem of recovering the signal $s(a)$ from the data is formulated in a fully Bayesian way. In detail, we have rewritten the signal as the sum of a background cosmology and a perturbation. This allows us to determine the maximum a posteriory estimate of the signal by an iterative Wiener filter method. Applying charm to the Union2.1 supernova compilation, we have recovered a cosmic expansion history that is fully compatible with the standard $\Lambda$CDM cosmological expansion history with parameter values consistent with the results of the Planck mission.

Stochastic differential equations describe well many physical, biological and sociological systems, despite the simplification often made in their derivation. Here the usage of simple stochastic differential equations to characterize and classify complex dynamical systems is proposed within a Bayesian framework. To this end, we develop a dynamic system classifier (DSC). The DSC first abstracts training data of a system in terms of time dependent coefficients of the descriptive stochastic differential equation. Thereby the DSC identifies unique correlation structures within the training data. For definiteness we restrict the presentation of DSC to oscillation processes with a time dependent frequency {\omega}(t) and damping factor {\gamma}(t). Although real systems might be more complex, this simple oscillator captures many characteristic features. The {\omega} and {\gamma} timelines represent the abstract system characterization and permit the construction of efficient signal classifiers. Numerical experiments show that such classifiers perform well even in the low signal-to-noise regime.

We present a new algorithm to reconstruct the Galactic free electron density from pulsar dispersion measures. The algorithm performs a nonparametric tomography for a density field with an arbitrary amount of degrees of freedom. It is based on approximating the Galactic free electron density as the product of a profile function with a statistically isotropic and homogeneous log-normal field. Under this approximation the algorithm generates a map of the free electron density as well as an uncertainty estimate without the need of information about the power spectrum. The uncertainties of the pulsar distances are treated consistently by an iterative procedure. We test the algorithm using the NE2001 model with modified fluctuations as a Galaxy model, pulsar populations generated from the Lorimer population model, and mock observations emulating the upcoming Square Kilometer Array. We show the quality of the reconstruction for mock data sets containing between 1000 and 10000 pulsars with distance uncertainties up to 25%. Our results show, that with the SKA nonparametric tomography of the Galactic free electron density becomes feasible, but the quality of the reconstruction is very sensitive to the distance uncertainties.

Determining magnetic field properties in different environments of the cosmic large-scale structure as well as their evolution over redshift is a fundamental step toward uncovering the origin of cosmic magnetic fields. Radio observations permit the study of extragalactic magnetic fields via measurements of the Faraday depth of extragalactic radio sources. Our aim is to investigate how much different extragalactic environments contribute to the Faraday depth variance of these sources. We develop a Bayesian algorithm to distinguish statistically Faraday depth variance contributions intrinsic to the source from those due to the medium between the source and the observer. In our algorithm the Galactic foreground and the measurement noise are taken into account as the uncertainty correlations of the galactic model. Additionally, our algorithm allows for the investigation of possible redshift evolution of the extragalactic contribution. This work presents the derivation of the algorithm and tests performed on mock observations. With cosmic magnetism being one of the key science projects of the new generation of radio interferometers we have made predictions for the algorithm's performance on data from the next generation of radio interferometers. Applications to real data are left for future work.

The calibration of a measurement device is crucial for every scientific experiment, where a signal has to be inferred from data. We present CURE, the calibration uncertainty renormalized estimator, to reconstruct a signal and simultaneously the instrument's calibration from the same data without knowing the exact calibration, but its covariance structure. The idea of CURE, developed in the framework of information field theory, is starting with an assumed calibration to successively include more and more portions of calibration uncertainty into the signal inference equations and to absorb the resulting corrections into renormalized signal (and calibration) solutions. Thereby, the signal inference and calibration problem turns into solving a single system of ordinary differential equations and can be identified with common resummation techniques used in field theories. We verify CURE by applying it to a simplistic toy example and compare it against existent self-calibration schemes, Wiener filter solutions, and Markov Chain Monte Carlo sampling. We conclude that the method is able to keep up in accuracy with the best self-calibration methods and serves as a non-iterative alternative to it.

An essential quantity required to understand the physics of the early Universe, in particular the inflationary epoch, is the primordial scalar potential $\Phi$ and its statistics. We present for the first time an all-sky reconstruction of $\Phi$ with corresponding $1\sigma$-uncertainty from WMAP's cosmic microwave background (CMB) temperature data -- a map of the very early Universe right after the inflationary epoch. This has been achieved by applying a Bayesian inference method that separates the whole inverse problem of the reconstruction into many independent ones, each of them solved by an optimal linear filter (Wiener filter). In this way, the three-dimensional potential $\Phi$ gets reconstructed slice by slice resulting in a thick shell of nested spheres around the comoving distance to the last scattering surface. Each slice represents the primordial scalar potential $\Phi$ projected onto a sphere with corresponding distance. Furthermore, we present an advanced method for inferring $\Phi$ and its power spectrum simultaneously from data, but argue that applying it requires polarization data with high signal-to-noise levels not available yet. Future CMB data should improve results significantly, as polarization data will fill the present $\ell-$blind gaps of the reconstruction.

(abridged) Observations of Faraday rotation for extragalactic sources probe magnetic fields both inside and outside the Milky Way. Building on our earlier estimate of the Galactic contribution, we set out to estimate the extragalactic contributions. We discuss the problems involved; in particular, we point out that taking the difference between the observed values and the Galactic foreground reconstruction is not a good estimate for the extragalactic contributions. We point out a degeneracy between the contributions to the observed values due to extragalactic magnetic fields and observational noise and comment on the dangers of over-interpreting an estimate without taking into account its uncertainty information. To overcome these difficulties, we develop an extended reconstruction algorithm based on the assumption that the observational uncertainties are accurately described for a subset of the data, which can overcome the degeneracy with the extragalactic contributions. We present a probabilistic derivation of the algorithm and demonstrate its performance using a simulation, yielding a high quality reconstruction of the Galactic Faraday rotation foreground, a precise estimate of the typical extragalactic contribution, and a well-defined probabilistic description of the extragalactic contribution for each data point. We then apply this reconstruction technique to a catalog of Faraday rotation observations. We vary our assumptions about the data, showing that the dispersion of extragalactic contributions to observed Faraday depths is most likely lower than 7 rad/m^2, in agreement with earlier results, and that the extragalactic contribution to an individual data point is poorly constrained by the data in most cases.

To better understand the origin and properties of cosmological magnetic fields, a detailed knowledge of magnetic fields in the large-scale structure of the Universe (galaxy clusters, filaments) is crucial. We propose a new statistical approach to study magnetic fields on large scales with the rotation measure grid data that will be obtained with the new generation of radio interferometers.

We investigate whether non-linear effects on the large-scale power spectrum of dark matter, namely the increase in small-scale power and the smearing of baryon acoustic oscillations, can be decreased by a log-transformation or emulated by an exponential transformation of the linear spectrum. To that end we present a formalism to convert the power spectrum of a log-normal field to the power spectrum of the logarithmic Gaussian field and vice versa. All ingredients of our derivation can already be found in various publications in cosmology and other fields. We follow a more pedagogical approach providing a detailed derivation, application examples, and a discussion of implementation subtleties in one text. We use the formalism to show that the non-linear increase in small-scale power in the matter power spectrum is significantly smaller for the log-transformed spectrum which fits the linear spectrum (with less than 20% error) for redshifts down to 1 and $k\leq1.0\,h\,\mathrm{Mpc}$. For lower redshifts the fit to the linear spectrum is not as good, but the reduction of non-linear effects is still significant. Similarly, we show that applying the linear growth factor to the logarithmic density leads to an automatic increase in small-scale power for low redshifts fitting to third-order perturbation spectra and Cosmic Emulator spectra with an error of less than $20%$. Smearing of baryon acoustic oscillations is at least three times weaker, but still present.

Response calibration is the process of inferring how much the measured data depend on the signal one is interested in. It is essential for any quantitative signal estimation on the basis of the data. Here, we investigate self-calibration methods for linear signal measurements and linear dependence of the response on the calibration parameters. The common practice is to augment an external calibration solution using a known reference signal with an internal calibration on the unknown measurement signal itself. Contemporary self-calibration schemes try to find a self-consistent solution for signal and calibration by exploiting redundancies in the measurements. This can be understood in terms of maximizing the joint probability of signal and calibration. However, the full uncertainty structure of this joint probability around its maximum is thereby not taken into account by these schemes. Therefore better schemes -- in sense of minimal square error -- can be designed by accounting for asymmetries in the uncertainty of signal and calibration. We argue that at least a systematic correction of the common self-calibration scheme should be applied in many measurement situations in order to properly treat uncertainties of the signal on which one calibrates. Otherwise the calibration solutions suffer from a systematic bias, which consequently distorts the signal reconstruction. Furthermore, we argue that non-parametric, signal-to-noise filtered calibration should provide more accurate reconstructions than the common bin averages and provide a new, improved self-calibration scheme. We illustrate our findings with a simplistic numerical example.

NIFTY, "Numerical Information Field Theory", is a software package designed to enable the development of signal inference algorithms that operate regardless of the underlying spatial grid and its resolution. Its object-oriented framework is written in Python, although it accesses libraries written in Cython, C++, and C for efficiency. NIFTY offers a toolkit that abstracts discretized representations of continuous spaces, fields in these spaces, and operators acting on fields into classes. Thereby, the correct normalization of operations on fields is taken care of automatically without concerning the user. This allows for an abstract formulation and programming of inference algorithms, including those derived within information field theory. Thus, NIFTY permits its user to rapidly prototype algorithms in 1D, and then apply the developed code in higher-dimensional settings of real world problems. The set of spaces on which NIFTY operates comprises point sets, n-dimensional regular grids, spherical spaces, their harmonic counterparts, and product spaces constructed as combinations of those. The functionality and diversity of the package is demonstrated by a Wiener filter code example that successfully runs without modification regardless of the space on which the inference problem is defined.

It is of fundamental importance to determine if and how hierarchical clustering is involved in large-scale structure formation of the universe. Hierarchical evolution is characterized by rules which specify how dark matter halos are formed by the merging of halos at smaller scales. We show that scale-scale correlations of the matter density field are direct and sensitive measures to quantify this merging tree. Such correlations are most conveniently determined from discrete wavelet transforms. Analyzing two samples of Ly-alpha forests of QSO's absorption spectra, we find significant scale-scale correlations whose dependence is typical for a branching process. Therefore, models which predict a "history" independent evolution are ruled out and the halos hosting the Ly-alpha clouds must have gone through a "history" dependent merging process during their formation.