We present the NPIPE processing pipeline, which produces calibrated frequency maps in temperature and polarization from data from the Planck Low Frequency Instrument (LFI) and High Frequency Instrument (HFI) using high-performance computers. NPIPE represents a natural evolution of previous Planck analysis efforts, and combines some of the most powerful features of the separate LFI and HFI analysis pipelines. The net effect of the improvements is lower levels of noise and systematics in both frequency and component maps at essentially all angular scales, as well as notably improved internal consistency between the various frequency channels. Based on the NPIPE maps, we present the first estimate of the Solar dipole determined through component separation across all nine Planck frequencies. The amplitude is ($3366.6 \pm 2.7$)$\mu$K, consistent with, albeit slightly higher than, earlier estimates. From the large-scale polarization data, we derive an updated estimate of the optical depth of reionization of $\tau = 0.051 \pm 0.006$, which appears robust with respect to data and sky cuts. There are 600 complete signal, noise and systematics simulations of the full-frequency and detector-set maps. As a Planck first, these simulations include full time-domain processing of the beam-convolved CMB anisotropies. The release of NPIPE maps and simulations is accompanied with a complete suite of raw and processed time-ordered data and the software, scripts, auxiliary data, and parameter files needed to improve further on the analysis and to run matching simulations.

Gravitational waves can provide an accurate measurement of the luminosity distance to the source, but cannot provide the source redshift unless the degeneracy between mass and redshift can be broken. This makes it essential to infer the redshift of the source independently to measure the expansion history of the Universe. We show that by exploiting the clustering scale of the gravitational wave sources with galaxies of known redshift, we can infer the expansion history from redshift unknown gravitational wave sources. Using gravitational wave sources with unknown redshift that are detectable from the network of gravitational wave detectors with Advanced LIGO design sensitivity, we will be able to obtain accurate and precise measurements of the local Hubble constant, the expansion history of the universe, and the gravitational wave bias parameter, which captures the distribution of gravitational wave sources with respect to the redshift tracer distribution. This technique is not only limited to the low redshift gravitational wave sources, but will be also applicable to the high redshift gravitational wave sources detectable from Laser Interferometer Space Antenna (LISA), Cosmic Explorer (CE), and Einstein Telescope (ET). Moreover, this method is also going to be applicable to samples of supernovae and fast radio bursts with unknown or photometric redshifts.

General relativity (GR) predicts concordant trajectories for photons and gravitational waves (GW). We propose a new multi-messenger avenue (GW-CMB-CMB) to prove this aspect of fundamental physics by cross-correlating the GW signal of astrophysical origin with the lensing field derived from the cosmic microwave background (CMB). This new window will allow robust measurement of the prediction from GR with high signal-to-noise and will be able to unveil the true nature of gravity using the GW sources detected by missions such as the Laser Interferometer Space Antenna (LISA), Einstein Telescope and Cosmic Explorer.

We present an extension of our recently developed Wasserstein optimized model to emulate accurate high-resolution features from computationally cheaper low-resolution cosmological simulations. Our deep physical modelling technique relies on restricted neural networks to perform a mapping of the distribution of the low-resolution cosmic density field to the space of the high-resolution small-scale structures. We constrain our network using a single triplet of high-resolution initial conditions and the corresponding low- and high-resolution evolved dark matter simulations from the Quijote suite of simulations. We exploit the information content of the high-resolution initial conditions as a well constructed prior distribution from which the network emulates the small-scale structures. Once fitted, our physical model yields emulated high-resolution simulations at low computational cost, while also providing some insights about how the large-scale modes affect the small-scale structure in real space.

The cross-correlation of gravitational wave strain with upcoming galaxy surveys probe theories of gravity in a new way. This method enables testing the theory of gravity by combining the effects from both gravitational lensing of gravitational waves and the propagation of gravitational waves in spacetime. We find that within 10 years, the combination of the Advanced-LIGO and VIRGO detector networks with planned galaxy surveys should detect weak gravitational lensing of gravitational waves in the low redshift Universe ($z<0.5$). With the next generation gravitational wave experiments such as Voyager, LISA, Cosmic-Explorer and Einstein Telescope, we can extend this test of the theory of gravity to larger redshifts by exploiting the synergies between electromagnetic wave and gravitational wave probes.

Existing cosmological simulation methods lack a high degree of parallelism due to the long-range nature of the gravitational force, which limits the size of simulations that can be run at high resolution. To solve this problem, we propose a new, perfectly parallel approach to simulate cosmic structure formation, based on the spatial COmoving Lagrangian Acceleration (sCOLA) framework. Building upon a hybrid analytical and numerical description of particles' trajectories, our algorithm allows an efficient tiling of a cosmological volume, where the dynamics within each tile is computed independently. As a consequence, the degree of parallelism is equal to the number of tiles. We optimise the accuracy of sCOLA by the use of a buffer region around tiles, and of appropriate Dirichlet boundary conditions around sCOLA boxes. As a result, we show that cosmological simulations at the degree of accuracy required for the analysis of the next generation of surveys can be run in drastically reduced wall-clock times and with very low memory requirements. The perfect scalability of our algorithm unlocks profoundly new possibilities of computing larger and higher-resolution cosmological simulations, taking advantage of a variety of hardware architectures.

CMB-HD is a proposed ultra-deep (0.5 uk-arcmin), high-resolution (15 arcseconds) millimeter-wave survey over half the sky that would answer many outstanding questions in both fundamental physics of the Universe and astrophysics. This survey would be delivered in 7.5 years of observing 20,000 square degrees, using two new 30-meter-class off-axis cross-Dragone telescopes to be located at Cerro Toco in the Atacama Desert. Each telescope would field 800,000 detectors (200,000 pixels), for a total of 1.6 million detectors.

We propose the implementation of an imaging telescope in combination with an inter-frequency calibrator to measure the spectral shape of the microwave sky by exploiting the differences in the sky intensity between multiple pairs of frequency channels. By jointly sampling the cosmological and foreground parameters in a Bayesian framework for $600$ instrument configurations, we determine the minimum calibration accuracy required in order to obtain measurements of spectral distortions and simultaneously measure spectral and spatial fluctuations of the CMB. We demonstrate the feasibility of this technique for a CMB mission like PICO (Probe of Inflation and Cosmic Origins), and show that a $10$-$\sigma$ measurement of the $y$-distortion along with a two orders of magnitude improvement on the FIRAS (Far-Infrared Absolute Spectrophotometer) $\mu$-distortion limit is feasible from this technique. We argue that longer term applications may be envisaged at even higher sensitivity, capable of attaining the $\mu$-distortion that provide a robust prediction of the $\Lambda$CDM model and even primordial recombination lines of hydrogen and helium, in the context of the ESA (European Space Agency) Voyage 2035-2050 program.

We propose using the upcoming Cosmic Microwave Background (CMB) ground based experiments to detect the signal of ALPs (Axion like particles) interacting with magnetic fields in galaxy clusters. The conversion between CMB photons and ALPs in the presence of the cluster magnetic field can cause a polarized spectral distortion in the CMB around a galaxy cluster. The strength of the signal depends upon the redshift of the galaxy cluster and will exhibit a distinctive spatial profile around it depending upon the structure of electron density and magnetic field. This distortion produces a different shape from the other known spectral distortions like $y$-type and $\mu$-type and hence are separable from the multi-frequency CMB observation. The spectrum is close to kinematic Sunyaev-Zeldovich (kSZ) signal but can be separated from it using the polarization information. For the future ground-based CMB experiments such as Simons Observatory and CMB-S4, we estimate the measurability of this signal in the presence of foreground contamination, instrument noise and CMB anisotropies. This new avenue can probe the photon-ALP coupling over the ALP mass range from $10^{-13}$ eV to $10^{-12}$ eV with two orders of magnitude better accuracy from CMB-S4 than the current existing bounds.

The search for primordial gravitational waves in the Cosmic Microwave Background (CMB) will soon be limited by our ability to remove the lensing contamination to $B$-mode polarization. The often-used quadratic estimator for lensing is known to be suboptimal for surveys that are currently operating and will continue to become less and less efficient as instrumental noise decreases. While foregrounds can in principle be mitigated by observing in more frequency bands, progress in delensing hinges entirely on algorithmic advances. We demonstrate here a new inference method that solves this problem by sampling the exact Bayesian posterior of any desired cosmological parameters, of the gravitational lensing potential, and of the delensed CMB maps, given lensed temperature and polarization data. We validate the method using simulated CMB data with non-white noise and masking on up to 650\,deg$^2$ patches of sky. A unique strength of this approach is the ability to jointly estimate cosmological parameters which control both the primordial CMB and the lensing potential, which we demonstrate here for the first time by sampling both the tensor-to-scalar ratio, $r$, and the amplitude of the lensing potential, $A_\phi$. The method allows us to perform the most precise check to-date of several important approximations underlying CMB-S4 $r$ forecasting, and we confirm these yield the correct expected uncertainty on $r$ to better than 10%.

Upcoming million-star spectroscopic surveys have the potential to revolutionize our view of the formation and chemical evolution of the Milky Way. Realizing this potential requires automated approaches to optimize estimates of stellar properties, such as chemical element abundances, from the spectra. The volume and quality of the observations strongly motivate that these approaches should be data-driven. With this in mind, we introduce SSSpaNG: a data-driven Gaussian Process model of stellar spectra. We demonstrate the capabilities of SSSpaNG using a sample of APOGEE red clump stars, whose model parameters we infer via Gibbs sampling. Pooling information between stars to infer their covariance, we permit clear identification of the correlations between spectral pixels. Harnessing these correlations, we infer the true spectrum of each star, inpainting missing regions and denoising by a factor of at least 2-3 for low-signal-to-noise stars. As we marginalize over the covariance matrix of the spectra, the effective prior on these true spectra is non-Gaussian, non-convex and sparsifying, promoting typically small but occasionally large excursions from the mean. The high-fidelity true spectra produced will enable improved elemental abundance measurements for individual stars. Our model also allows us to quantify the information gained by observing portions of a star's spectrum, and thereby define the most mutually informative spectral regions. Using 25 windows centred on elemental absorption lines, we demonstrate that the iron-peak and alpha-process elements are particularly mutually informative for these spectra, and that the majority of information about a target window is contained in the 10-or-so most informative windows. Our information-gain metric has the potential to inform models of nucleosynthetic yields and optimize the design of future observations.

The European Space Agency's Planck satellite, which was dedicated to studying the early Universe and its subsequent evolution, was launched on 14 May 2009. It scanned the microwave and submillimetre sky continuously between 12 August 2009 and 23 October 2013, producing deep, high-resolution, all-sky maps in nine frequency bands from 30 to 857GHz. This paper presents the cosmological legacy of Planck, which currently provides our strongest constraints on the parameters of the standard cosmological model and some of the tightest limits available on deviations from that model. The 6-parameter LCDM model continues to provide an excellent fit to the cosmic microwave background data at high and low redshift, describing the cosmological information in over a billion map pixels with just six parameters. With 18 peaks in the temperature and polarization angular power spectra constrained well, Planck measures five of the six parameters to better than 1% (simultaneously), with the best-determined parameter (theta_*) now known to 0.03%. We describe the multi-component sky as seen by Planck, the success of the LCDM model, and the connection to lower-redshift probes of structure formation. We also give a comprehensive summary of the major changes introduced in this 2018 release. The Planck data, alone and in combination with other probes, provide stringent constraints on our models of the early Universe and the large-scale structure within which all astrophysical objects form and evolve. We discuss some lessons learned from the Planck mission, and highlight areas ripe for further experimental advances.

Cosmic voids, the underdense regions in the universe, are particularly sensitive to diffuse density components such as cosmic neutrinos. This sensitivity is enhanced by the match between void sizes and the free-streaming scale of massive neutrinos. Using the massive neutrino simulations \texttt{MassiveNuS}, we investigate the effect of neutrino mass on dark matter halos as a function of environment. We find that the halo mass function depends strongly on neutrino mass and that this dependence is more pronounced in voids than in high-density environments. An observational program that measured the characteristic mass of the most massive halos in voids should be able to place novel constraints on the sum of the masses of neutrinos $\sum m_\nu$. The neutrino mass effect in the simulations is quite strong: In a 512$^3$ $h^{-3}$ Mpc$^3$ survey, the mean mass of the 1000 most massive halos in the void interiors is $(4.82 \pm 0.11) \times 10^{12} h^{-1}M_{\odot}$ for $\sum m_\nu = 0.6$ eV and $(8.21 \pm 0.13) \times 10^{12} h^{-1}M_{\odot}$ for $\sum m_\nu = 0.1$ eV. Subaru (SuMIRe), Euclid and WFIRST will have both spectroscopic and weak lensing surveys. Covering volumes at least 50 times larger than our simulations, they should be sensitive probes of neutrino mass through void substructure.

We present an augmented version of our dual messenger algorithm for spin field reconstruction on the sphere, while accounting for highly non-trivial and realistic noise models such as modulated correlated noise. We also describe an optimization method for the estimation of noise covariance from Monte Carlo simulations. Using simulated Planck polarized cosmic microwave background (CMB) maps as a showcase, we demonstrate the capabilities of the algorithm in reconstructing pure E and B maps, guaranteed to be free from ambiguous modes resulting from the leakage or coupling issue that plagues conventional methods of E/B separation. Due to its high speed execution, coupled with lenient memory requirements, the algorithm can be optimized in exact global Bayesian analyses of state-of-the-art CMB data for a statistically optimal separation of pure E and B modes. Our algorithm, therefore, has a potentially key role in the data analysis of high-resolution and high-sensitivity CMB data, especially with the range of upcoming CMB experiments tailored for the detection of the elusive primordial B-mode signal.

We present cosmological parameter results from the final full-mission Planck measurements of the CMB anisotropies. We find good consistency with the standard spatially-flat 6-parameter $\Lambda$CDM cosmology having a power-law spectrum of adiabatic scalar perturbations (denoted "base $\Lambda$CDM" in this paper), from polarization, temperature, and lensing, separately and in combination. A combined analysis gives dark matter density $\Omega_c h^2 = 0.120\pm 0.001$, baryon density $\Omega_b h^2 = 0.0224\pm 0.0001$, scalar spectral index $n_s = 0.965\pm 0.004$, and optical depth $\tau = 0.054\pm 0.007$ (in this abstract we quote $68\,\%$ confidence regions on measured parameters and $95\,\%$ on upper limits). The angular acoustic scale is measured to $0.03\,\%$ precision, with $100\theta_*=1.0411\pm 0.0003$. These results are only weakly dependent on the cosmological model and remain stable, with somewhat increased errors, in many commonly considered extensions. Assuming the base-$\Lambda$CDM cosmology, the inferred late-Universe parameters are: Hubble constant $H_0 = (67.4\pm 0.5)$km/s/Mpc; matter density parameter $\Omega_m = 0.315\pm 0.007$; and matter fluctuation amplitude $\sigma_8 = 0.811\pm 0.006$. We find no compelling evidence for extensions to the base-$\Lambda$CDM model. Combining with BAO we constrain the effective extra relativistic degrees of freedom to be $N_{\rm eff} = 2.99\pm 0.17$, and the neutrino mass is tightly constrained to $\sum m_\nu< 0.12$eV. The CMB spectra continue to prefer higher lensing amplitudes than predicted in base -$\Lambda$CDM at over $2\,\sigma$, which pulls some parameters that affect the lensing amplitude away from the base-$\Lambda$CDM model; however, this is not supported by the lensing reconstruction or (in models that also change the background geometry) BAO data. (Abridged)

Gravitational wave (GW) sources are an excellent probe of the luminosity distance and offer a novel measure of the Hubble constant, $H_0$. This estimation of $H_0$ from standard sirens requires an accurate estimation of the cosmological redshift of the host galaxy of the GW source, after correcting for its peculiar velocity. Absence of an accurate peculiar velocity correction affects both the precision and accuracy of the measurement of $H_0$, particularly for nearby sources. We propose a framework to incorporate such a peculiar velocity correction for GW sources. The implementation of our method to the event GW170817 combined with the Very Large Baseline Interferometry (VLBI) observation leads to a revised value of $H_0= 69.3^{+ 4.5}_{-4.0}$ km s$^{-1}$Mpc$^{-1}$; more importantly, it demonstrates that our method will allow to achieve in practice unbiased, accurate measurements of $H_0$ at the precision promised by standard siren forecasts.

An ambitious goal in cosmology is to forward-model the observed distribution of galaxies in the nearby Universe today from the initial conditions of large-scale structures. For practical reasons, the spatial resolution at which this can be done is necessarily limited. Consequently, one needs a mapping between the density of dark matter averaged over ~Mpc scales, and the distribution of dark matter halos (used as a proxy for galaxies) in the same region. Here we demonstrate a method for determining the halo mass distribution function by learning the tracer bias between density fields and halo catalogues using a neural bias model. The method is based on the Bayesian analysis of simple, physically motivated, neural network-like architectures, which we denote as neural physical engines, and neural density estimation. As a result, we are able to sample the initial phases of the dark matter density field whilst inferring the parameters describing the halo mass distribution function, providing a fully Bayesian interpretation of both the initial dark matter density distribution and the neural bias model. We successfully run an upgraded BORG inference using our new likelihood and neural bias model with halo catalogues derived from full N-body simulations. We notice orders of magnitude improvement in modelling compared to classical biasing techniques.

The Quijote simulations are a set of 43100 full N-body simulations spanning more than 7000 cosmological models in the $\{\Omega_{\rm m}, \Omega_{\rm b}, h, n_s, \sigma_8, M_\nu, w \}$ hyperplane. At a single redshift the simulations contain more than 8.5 trillions of particles over a combined volume of 43100 $(h^{-1}{\rm Gpc})^3$. Billions of dark matter halos and cosmic voids have been identified in the simulations, whose runs required more than 35 million core hours. The Quijote simulations have been designed for two main purposes: 1) to quantify the information content on cosmological observables, and 2) to provide enough data to train machine learning algorithms. In this paper we describe the simulations and show a few of their applications. We also release the Petabyte of data generated, comprising hundreds of thousands of simulation snapshots at multiple redshifts, halo and void catalogs, together with millions of summary statistics such as power spectra, bispectra, correlation functions, marked power spectra, and estimated probability density functions.

Cosmic microwave background measurements show an agreement with the concordance cosmology model except for a few notable anomalies: Power Suppression, the lack of large scale power in the temperature data compared to what is expected in the concordance model, and Cosmic Hemispherical Asymmetry, a dipolar breakdown of statistical isotropy. An expansion of the CMB covariance in Bipolar Spherical Harmonics naturally parametrizes both these large-scale anomalies, allowing us to perform an exhaustive, fully Bayesian joint analysis of the power spectrum and violations of statistical isotropy up to the dipole level. Our analysis sheds light on the scale dependence of the Cosmic Hemispherical Asymmetry. Assuming a scale-dependent dipole modulation model with a two-parameter power law form, we explore the posterior pdf of amplitude $A(l = 16)$ and the power law index $\alpha$ and find the maximum a posteriori values $A_*(l = 16) = 0.064 \pm 0.022$ and $\alpha_* = -0.92 \pm 0.22$. The maximum a posteriori direction associated with the Cosmic Hemispherical Asymmetry is $(l,b) = (247.8^o, -19.6^o)$ in Galactic coordinates, consistent with previous analyses. We evaluate the Bayes factor $B_{SI-DM}$ to compare the Cosmic Hemispherical Asymmetry model with the isotropic model. The data prefer but do not substantially favor the anisotropic model ($B_{SI-DM}=0.4$). We consider several priors and find that this evidence ratio is robust to prior choice. The large-scale power suppression does not soften when jointly inferring both the isotropic power spectrum and the parameters of the asymmetric model, indicating no evidence that these anomalies are coupled.

We report on the implications for cosmic inflation of the 2018 Release of the Planck CMB anisotropy measurements. The results are fully consistent with the two previous Planck cosmological releases, but have smaller uncertainties thanks to improvements in the characterization of polarization at low and high multipoles. Planck temperature, polarization, and lensing data determine the spectral index of scalar perturbations to be $n_\mathrm{s}=0.9649\pm 0.0042$ at 68% CL and show no evidence for a scale dependence of $n_\mathrm{s}.$ Spatial flatness is confirmed at a precision of 0.4% at 95% CL with the combination with BAO data. The Planck 95% CL upper limit on the tensor-to-scalar ratio, $r_{0.002}<0.10$, is further tightened by combining with the BICEP2/Keck Array BK15 data to obtain $r_{0.002}<0.056$. In the framework of single-field inflationary models with Einstein gravity, these results imply that: (a) slow-roll models with a concave potential, $V" (\phi) < 0,$ are increasingly favoured by the data; and (b) two different methods for reconstructing the inflaton potential find no evidence for dynamics beyond slow roll. Non-parametric reconstructions of the primordial power spectrum consistently confirm a pure power law. A complementary analysis also finds no evidence for theoretically motivated parameterized features in the Planck power spectrum, a result further strengthened for certain oscillatory models by a new combined analysis that includes Planck bispectrum data. The new Planck polarization data provide a stringent test of the adiabaticity of the initial conditions. The polarization data also provide improved constraints on inflationary models that predict a small statistically anisotropic quadrupolar modulation of the primordial fluctuations. However, the polarization data do not confirm physical models for a scale-dependent dipolar modulation.

This paper describes the 2018 Planck CMB likelihoods, following a hybrid approach similar to the 2015 one, with different approximations at low and high multipoles, and implementing several methodological and analysis refinements. With more realistic simulations, and better correction and modelling of systematics, we can now make full use of the High Frequency Instrument polarization data. The low-multipole 100x143 GHz EE cross-spectrum constrains the reionization optical-depth parameter $\tau$ to better than 15% (in combination with with the other low- and high-$\ell$ likelihoods). We also update the 2015 baseline low-$\ell$ joint TEB likelihood based on the Low Frequency Instrument data, which provides a weaker $\tau$ constraint. At high multipoles, a better model of the temperature-to-polarization leakage and corrections for the effective calibrations of the polarization channels (polarization efficiency or PE) allow us to fully use the polarization spectra, improving the constraints on the $\Lambda$CDM parameters by 20 to 30% compared to TT-only constraints. Tests on the modelling of the polarization demonstrate good consistency, with some residual modelling uncertainties, the accuracy of the PE modelling being the main limitation. Using our various tests, simulations, and comparison between different high-$\ell$ implementations, we estimate the consistency of the results to be better than the 0.5$\sigma$ level. Minor curiosities already present before (differences between $\ell$<800 and $\ell$>800 parameters or the preference for more smoothing of the $C_\ell$ peaks) are shown to be driven by the TT power spectrum and are not significantly modified by the inclusion of polarization. Overall, the legacy Planck CMB likelihoods provide a robust tool for constraining the cosmological model and represent a reference for future CMB observations. (Abridged)

We present measurements of the cosmic microwave background (CMB) lensing potential using the final $\textit{Planck}$ 2018 temperature and polarization data. We increase the significance of the detection of lensing in the polarization maps from $5\,\sigma$ to $9\,\sigma$. Combined with temperature, lensing is detected at $40\,\sigma$. We present an extensive set of tests of the robustness of the lensing-potential power spectrum, and construct a minimum-variance estimator likelihood over lensing multipoles $8 \le L \le 400$. We find good consistency between lensing constraints and the results from the $\textit{Planck}$ CMB power spectra within the $\rm{\Lambda CDM}$ model. Combined with baryon density and other weak priors, the lensing analysis alone constrains $\sigma_8 \Omega_{\rm m}^{0.25}=0.589\pm 0.020$ ($1\,\sigma$ errors). Also combining with baryon acoustic oscillation (BAO) data, we find tight individual parameter constraints, $\sigma_8=0.811\pm0.019$, $H_0=67.9_{-1.3}^{+1.2}\,\text{km}\,\text{s}^{-1}\,\rm{Mpc}^{-1}$, and $\Omega_{\rm m}=0.303^{+0.016}_{-0.018}$. Combining with $\textit{Planck}$ CMB power spectrum data, we measure $\sigma_8$ to better than $1\,\%$ precision, finding $\sigma_8=0.811\pm 0.006$. We find consistency with the lensing results from the Dark Energy Survey, and give combined lensing-only parameter constraints that are tighter than joint results using galaxy clustering. Using $\textit{Planck}$ cosmic infrared background (CIB) maps we make a combined estimate of the lensing potential over $60\,\%$ of the sky with considerably more small-scale signal. We demonstrate delensing of the $\textit{Planck}$ power spectra, detecting a maximum removal of $40\,\%$ of the lensing-induced power in all spectra. The improvement in the sharpening of the acoustic peaks by including both CIB and the quadratic lensing reconstruction is detected at high significance (abridged).

Density-estimation likelihood-free inference (DELFI) has recently been proposed as an efficient method for simulation-based cosmological parameter inference. Compared to the standard likelihood-based Markov Chain Monte Carlo (MCMC) approach, DELFI has several advantages: it is highly parallelizable, there is no need to assume a possibly incorrect functional form for the likelihood and complicated effects (e.g the mask and detector systematics) are easier to handle with forward models. In light of this, we present two DELFI pipelines to perform weak lensing parameter inference with lognormal realizations of the tomographic shear field -- using the C_l summary statistic. The first pipeline accounts for the non-Gaussianities of the shear field, intrinsic alignments and photometric-redshift error. We validate that it is accurate enough for Stage III experiments and estimate that O(1000) simulations are needed to perform inference on Stage IV data. By comparing the second DELFI pipeline, which makes no assumption about the functional form of the likelihood, with the standard MCMC approach, which assumes a Gaussian likelihood, we test the impact of the Gaussian likelihood approximation in the MCMC analysis. We find it has a negligible impact on Stage IV parameter constraints. Our pipeline is a step towards seamlessly propagating all data-processing, instrumental, theoretical and astrophysical systematics through to the final parameter constraints.

Do void statistics contain information beyond the tracer 2-point correlation function? Yes! As we vary the sum of the neutrino masses, we find void statistics contain information absent when using just tracer 2-point statistics. Massive neutrinos uniquely affect cosmic voids. We explore their impact on void clustering using both the DEMNUni and MassiveNuS simulations. For voids, neutrino effects depend on the observed void tracers. As the neutrino mass increases, the number of small voids traced by cold dark matter particles increases and the number of large voids decreases. Surprisingly, when massive, highly biased, halos are used as tracers, we find the opposite effect. The scale at which voids cluster, as well as the void correlation, is similarly sensitive to the sum of neutrino masses and the tracers. This scale dependent trend is not due to simulation volume or halo density. The interplay of these signatures in the void abundance and clustering leaves a distinct fingerprint that could be detected with observations and potentially help break degeneracies between different cosmological parameters. This paper paves the way to exploit cosmic voids in future surveys to constrain the mass of neutrinos.

The non-resonant conversion of Cosmic Microwave Background (CMB) photons into scalar as well as light pseudoscalar particles such as axion-like particles (ALPs) in the presence of turbulent magnetic fields can cause a unique, spatially fluctuating spectral distortion in the CMB. We use the publicly available Planck temperature maps for the frequency channels (70-545 GHz) to obtain the first ALP distortion map using $45\%$ clean part of the sky. The $95^{th}$ percentile upper limit on the RMS fluctuation of ALP distortions from the cleanest part of the CMB sky at $15$ arcmin angular resolution is $18.5 \times 10^{-6}$. The RMS fluctuation in the distortion map is also consistent with different combinations of frequency channels and sky-fractions.

Analysis of the Planck 2018 data set indicates that the statistical properties of the cosmic microwave background (CMB) temperature anisotropies are in excellent agreement with previous studies using the 2013 and 2015 data releases. In particular, they are consistent with the Gaussian predictions of the $\Lambda$CDM cosmological model, yet also confirm the presence of several so-called "anomalies" on large angular scales. The novelty of the current study, however, lies in being a first attempt at a comprehensive analysis of the statistics of the polarization signal over all angular scales, using either maps of the Stokes parameters, $Q$ and $U$, or the $E$-mode signal derived from these using a new methodology (which we describe in an appendix). Although remarkable progress has been made in reducing the systematic effects that contaminated the 2015 polarization maps on large angular scales, it is still the case that residual systematics (and our ability to simulate them) can limit some tests of non-Gaussianity and isotropy. However, a detailed set of null tests applied to the maps indicates that these issues do not dominate the analysis on intermediate and large angular scales (i.e., $\ell \lesssim 400$). In this regime, no unambiguous detections of cosmological non-Gaussianity, or of anomalies corresponding to those seen in temperature, are claimed. Notably, the stacking of CMB polarization signals centred on the positions of temperature hot and cold spots exhibits excellent agreement with the $\Lambda$CDM cosmological model, and also gives a clear indication of how Planck provides state-of-the-art measurements of CMB temperature and polarization on degree scales.

The three-point correlation function (3PCF) of the 21cm brightness temperature from the Epoch of Reionization (EoR) probes complementary information to the commonly studied two-point correlation function (2PCF) about the morphology of ionized regions. We investigate the 21cm 2PCF and 3PCF in configuration space using semi-numerical simulations and test whether they can be described by the local quadratic bias model. We find that fits of bias model predictions for the 2PCF and 3PCF deviate from our measurements by $\sim 20\%$ at scales above the typical size of ionized regions ($\simeq 30$ Mpc) and at early times with global neutral fractions of $\langle x_{\rm HI} \rangle \gtrsim 0.7$. At later times and smaller scales these deviations increase strongly, indicating a break down of the bias model. The 2PCF and 3PCF fits of the linear bias parameter agree at the $10\%$ level for different EoR model configurations. This agreement holds, when adding redshift space distortions to the simulations. The relation between spatial fluctuations in the matter density and the 21cm signal, as predicted by the bias model, is consistent with direct measurements of this relation in simulations for large smoothing scales ($\gtrsim 30$ Mpc). From this latter test we conclude that negative amplitudes of the 21cm 3PCF result from negative bias parameters, which describe the anti-correlation between the matter over-densities and the 21cm signal during the EoR. However, a more detailed interpretation of the bias parameters may require a description of non-local contributions to the bias model.

We analyse the Planck full-mission cosmic microwave background (CMB) temperature and E-mode polarization maps to obtain constraints on primordial non-Gaussianity (NG). We compare estimates obtained from separable template-fitting, binned, and modal bispectrum estimators, finding consistent values for the local, equilateral, and orthogonal bispectrum amplitudes. Our combined temperature and polarization analysis produces the following results: f_NL^local = -0.9 +\- 5.1; f_NL^equil = -26 +\- 47; and f_NL^ortho = - 38 +\- 24 (68%CL, statistical). These results include the low-multipole (4 <= l < 40) polarization data, not included in our previous analysis, pass an extensive battery of tests, and are stable with respect to our 2015 measurements. Polarization bispectra display a significant improvement in robustness; they can now be used independently to set NG constraints. We consider a large number of additional cases, e.g. scale-dependent feature and resonance bispectra, isocurvature primordial NG, and parity-breaking models, where we also place tight constraints but do not detect any signal. The non-primordial lensing bispectrum is detected with an improved significance compared to 2015, excluding the null hypothesis at 3.5 sigma. We present model-independent reconstructions and analyses of the CMB bispectrum. Our final constraint on the local trispectrum shape is g_NLl^local = (-5.8 +\-6.5) x 10^4 (68%CL, statistical), while constraints for other trispectra are also determined. We constrain the parameter space of different early-Universe scenarios, including general single-field models of inflation, multi-field and axion field parity-breaking models. Our results provide a high-precision test for structure-formation scenarios, in complete agreement with the basic picture of the LambdaCDM cosmology regarding the statistics of the initial conditions (abridged).

Following the pioneering observations with COBE in the early 1990s, studies of the cosmic microwave background (CMB) have focused on temperature and polarization anisotropies. CMB spectral distortions - tiny departures of the CMB energy spectrum from that of a perfect blackbody - provide a second, independent probe of fundamental physics, with a reach deep into the primordial Universe. The theoretical foundation of spectral distortions has seen major advances in recent years, which highlight the immense potential of this emerging field. Spectral distortions probe a fundamental property of the Universe - its thermal history - thereby providing additional insight into processes within the cosmological standard model (CSM) as well as new physics beyond. Spectral distortions are an important tool for understanding inflation and the nature of dark matter. They shed new light on the physics of recombination and reionization, both prominent stages in the evolution of our Universe, and furnish critical information on baryonic feedback processes, in addition to probing primordial correlation functions at scales inaccessible to other tracers. In principle the range of signals is vast: many orders of magnitude of discovery space could be explored by detailed observations of the CMB energy spectrum. Several CSM signals are predicted and provide clear experimental targets, some of which are already observable with present-day technology. Confirmation of these signals would extend the reach of the CSM by orders of magnitude in physical scale as the Universe evolves from the initial stages to its present form. The absence of these signals would pose a huge theoretical challenge, immediately pointing to new physics.

The ages of the oldest stellar objects in our galaxy provide an independent test of the current cosmological model as they give a lower limit to the age of the Universe. Recent accurate parallaxes by the Gaia space mission, accurate measurements of the metallicity of stars, via individual elemental abundances, and advances in the modelling of stellar evolution, provide new, higher-precision age estimates of the oldest stellar populations in the galaxy: globular clusters and very-low-metallicity stars. The constraints on the age of the Universe, $t_U$, so obtained are determined from the local Universe and at late time. It is well known that local and early-Universe determinations of another cosmological parameter closely related to the age of the Universe, the Hubble constant $H_0$, show a $\gtrsim 3 \sigma$ tension. In the standard cosmological model, $\Lambda$CDM, $t_U$ and $H_0$ are related by the matter density parameter $\Omega_{m,0}$. We propose to combine local $t_U$ constraints with late-time $\Omega_{m,0}$ estimates in a $\Lambda$CDM framework, to obtain a low-redshift $H_0$ determination that does not rely on early Universe physics. A proof-of-principle of this approach with current data gives $H_0=71\pm2.8$ ($H_0= 69.3 \pm 2.7$) km s$^{-1}$ Mpc$^{-1}$ from globular clusters (very-low-metallicity stars) with excellent prospects for improved constraints in the near future.

Our current understanding of the Universe is established through the pristine measurements of structure in the cosmic microwave background (CMB) and the distribution and shapes of galaxies tracing the large scale structure (LSS) of the Universe. One key ingredient that underlies cosmological observables is that the field that sources the observed structure is assumed to be initially Gaussian with high precision. Nevertheless, a minimal deviation from Gaussianityis perhaps the most robust theoretical prediction of models that explain the observed Universe; itis necessarily present even in the simplest scenarios. In addition, most inflationary models produce far higher levels of non-Gaussianity. Since non-Gaussianity directly probes the dynamics in the early Universe, a detection would present a monumental discovery in cosmology, providing clues about physics at energy scales as high as the GUT scale.

Cosmic voids, the less dense patches of the Universe, are promising laboratories to extract cosmological information. Thanks to their unique low density character, voids are extremely sensitive to diffuse components such as neutrinos and dark energy, and represent ideal environments to study modifications of gravity, where the effects of such modifications are expected to be more prominent. Robust void-related observables, including for example redshift-space distortions (RSD) and weak lensing around voids, are a promising way to chase and test new physics. Cosmological analysis of the large-scale structure of the Universe predominantly relies on the high density regions. Current and upcoming surveys are designed to optimize the extraction of cosmological information from these zones, but leave voids under-exploited. A dense, large area spectroscopic survey with imaging capabilities is ideal to exploit the power of voids fully. Besides helping illuminate the nature of dark energy, modified gravity, and neutrinos, this survey will give access to a detailed map of under-dense regions, providing an unprecedented opportunity to observe and study a so far under-explored galaxy population.

We present 353 GHz full-sky maps of the polarization fraction $p$, angle $\psi$, and dispersion of angles $S$ of Galactic dust thermal emission produced from the 2018 release of Planck data. We confirm that the mean and maximum of $p$ decrease with increasing $N_H$. The uncertainty on the maximum polarization fraction, $p_\mathrm{max}=22.0$% at 80 arcmin resolution, is dominated by the uncertainty on the zero level in total intensity. The observed inverse behaviour between $p$ and $S$ is interpreted with models of the polarized sky that include effects from only the topology of the turbulent Galactic magnetic field. Thus, the statistical properties of $p$, $\psi$, and $S$ mostly reflect the structure of the magnetic field. Nevertheless, we search for potential signatures of varying grain alignment and dust properties. First, we analyse the product map $S \times p$, looking for residual trends. While $p$ decreases by a factor of 3--4 between $N_H=10^{20}$ cm$^{-2}$ and $N_H=2\times 10^{22}$ cm$^{-2}$, $S \times p$ decreases by only about 25%, a systematic trend observed in both the diffuse ISM and molecular clouds. Second, we find no systematic trend of $S \times p$ with the dust temperature, even though in the diffuse ISM lines of sight with high $p$ and low $S$ tend to have colder dust. We also compare Planck data with starlight polarization in the visible at high latitudes. The agreement in polarization angles is remarkable. Two polarization emission-to-extinction ratios that characterize dust optical properties depend only weakly on $N_H$ and converge towards the values previously determined for translucent lines of sight. We determine an upper limit for the polarization fraction in extinction of 13%, compatible with the $p_\mathrm{max}$ observed in emission. These results provide strong constraints for models of Galactic dust in diffuse gas.

In this paper we show how nuisance parameter marginalized posteriors can be inferred directly from simulations in a likelihood-free setting, without having to jointly infer the higher-dimensional interesting and nuisance parameter posterior first and marginalize a posteriori. The result is that for an inference task with a given number of interesting parameters, the number of simulations required to perform likelihood-free inference can be kept (roughly) the same irrespective of the number of additional nuisances to be marginalized over. To achieve this we introduce two extensions to the standard likelihood-free inference set-up. Firstly we show how nuisance parameters can be re-cast as latent variables and hence automatically marginalized over in the likelihood-free framework. Secondly, we derive an asymptotically optimal compression from $N$ data down to $n$ summaries -- one per interesting parameter -- such that the Fisher information is (asymptotically) preserved, but the summaries are insensitive (to leading order) to the nuisance parameters. This means that the nuisance marginalized inference task involves learning $n$ interesting parameters from $n$ "nuisance hardened" data summaries, regardless of the presence or number of additional nuisance parameters to be marginalized over. We validate our approach on two examples from cosmology: supernovae and weak lensing data analyses with nuisance parameterized systematics. For the supernova problem, high-fidelity posterior inference of $\Omega_m$ and $w_0$ (marginalized over systematics) can be obtained from just a few hundred data simulations. For the weak lensing problem, six cosmological parameters can be inferred from $\mathcal{O}(10^3)$ simulations, irrespective of whether ten additional nuisance parameters are included in the problem or not.

Likelihood-free inference provides a framework for performing rigorous Bayesian inference using only forward simulations, properly accounting for all physical and observational effects that can be successfully included in the simulations. The key challenge for likelihood-free applications in cosmology, where simulation is typically expensive, is developing methods that can achieve high-fidelity posterior inference with as few simulations as possible. Density-estimation likelihood-free inference (DELFI) methods turn inference into a density estimation task on a set of simulated data-parameter pairs, and give orders of magnitude improvements over traditional Approximate Bayesian Computation approaches to likelihood-free inference. In this paper we use neural density estimators (NDEs) to learn the likelihood function from a set of simulated datasets, with active learning to adaptively acquire simulations in the most relevant regions of parameter space on-the-fly. We demonstrate the approach on a number of cosmological case studies, showing that for typical problems high-fidelity posterior inference can be achieved with just $\mathcal{O}(10^3)$ simulations or fewer. In addition to enabling efficient simulation-based inference, for simple problems where the form of the likelihood is known, DELFI offers a fast alternative to MCMC sampling, giving orders of magnitude speed-up in some cases. Finally, we introduce \textsc{pydelfi} -- a flexible public implementation of DELFI with NDEs and active learning -- available at \url{https://github.com/justinalsing/pydelfi}.

In recent years, machine learning (ML) methods have remarkably improved how cosmologists can interpret data. The next decade will bring new opportunities for data-driven cosmological discovery, but will also present new challenges for adopting ML methodologies and understanding the results. ML could transform our field, but this transformation will require the astronomy community to both foster and promote interdisciplinary research endeavors.

We present a large-scale Bayesian inference framework to constrain cosmological parameters using galaxy redshift surveys, via an application of the Alcock-Paczy\'nski (AP) test. Our physical model of the non-linearly evolved density field, as probed by galaxy surveys, employs Lagrangian perturbation theory (LPT) to connect Gaussian initial conditions to the final density field, followed by a coordinate transformation to obtain the redshift space representation for comparison with data. We generate realizations of primordial and present-day matter fluctuations given a set of observations. This hierarchical approach encodes a novel AP test, extracting several orders of magnitude more information from the cosmological expansion compared to classical approaches, to infer cosmological parameters and jointly reconstruct the underlying 3D dark matter density field. The novelty of this AP test lies in constraining the comoving-redshift transformation to infer the appropriate cosmology which yields isotropic correlations of the galaxy density field, with the underlying assumption relying purely on the cosmological principle. Such an AP test does not rely explicitly on modelling the full statistics of the field. We verify in depth via simulations that this renders our test robust to model misspecification. This leads to another crucial advantage, namely that the cosmological parameters exhibit extremely weak dependence on the currently unresolved phenomenon of galaxy bias, thereby circumventing a potentially key limitation. This is consequently among the first methods to extract a large fraction of information from statistics other than that of direct density contrast correlations, without being sensitive to the amplitude of density fluctuations. We perform several statistical efficiency and consistency tests on a mock galaxy catalogue, using the SDSS-III survey as template.

We present a final description of the data-processing pipeline for the Planck, Low Frequency Instrument (LFI), implemented for the 2018 data release. Several improvements have been made with respect to the previous release, especially in the calibration process and in the correction of instrumental features such as the effects of nonlinearity in the response of the analogue-to-digital converters. We provide a brief pedagogical introduction to the complete pipeline, as well as a detailed description of the important changes implemented. Self-consistency of the pipeline is demonstrated using dedicated simulations and null tests. We present the final version of the LFI full sky maps at 30, 44, and 70 GHz, both in temperature and polarization, together with a refined estimate of the Solar dipole and a final assessment of the main LFI instrumental parameters.

Using the ${\it Planck}$ full-mission data, we present a detection of the temperature (and therefore velocity) dispersion due to the kinetic Sunyaev-Zeldovich (kSZ) effect from clusters of galaxies. To suppress the primary CMB and instrumental noise we derive a matched filter and then convolve it with the ${\it Planck}$ foreground-cleaned `${\tt 2D-ILC\,}$' maps. By using the Meta Catalogue of X-ray detected Clusters of galaxies (MCXC), we determine the normalized ${\it rms}$ dispersion of the temperature fluctuations at the positions of clusters, finding that this shows excess variance compared with the noise expectation. We then build an unbiased statistical estimator of the signal, determining that the normalized mean temperature dispersion of $1526$ clusters is $\langle \left(\Delta T/T \right)^{2} \rangle = (1.64 \pm 0.48) \times 10^{-11}$. However, comparison with analytic calculations and simulations suggest that around $0.7\,\sigma$ of this result is due to cluster lensing rather than the kSZ effect. By correcting this, the temperature dispersion is measured to be $\langle \left(\Delta T/T \right)^{2} \rangle = (1.35 \pm 0.48) \times 10^{-11}$, which gives a detection at the $2.8\,\sigma$ level. We further convert uniform-weight temperature dispersion into a measurement of the line-of-sight velocity dispersion, by using estimates of the optical depth of each cluster (which introduces additional uncertainty into the estimate). We find that the velocity dispersion is $\langle v^{2} \rangle =(123\,000 \pm 71\,000)\,({\rm km}\,{\rm s}^{-1})^{2}$, which is consistent with findings from other large-scale structure studies, and provides direct evidence of statistical homogeneity on scales of $600\,h^{-1}{\rm Mpc}$. Our study shows the promise of using cross-correlations of the kSZ effect with large-scale structure in order to constrain the growth of structure.

LSST will supply up to $10^6$ supernovae (SNe) to constrain dark energy through the distance-redshift ($D_L$-$z$) test. Obtaining spectroscopic SN redshifts (spec-$z$s) is unfeasible; alternatives are suboptimal and may be biased. We propose a powerful multi-tracer generalization of the Alcock-Paczynski test that pairs redshift-free distance tracers and an overlapping galaxy redshift survey. Cross-correlating $5\times 10^4$ redshift-free SNe with DESI or Euclid outperforms the classical $D_L$-$z$ test with spec-$z$s for all SN. Our method also applies to gravitational wave sirens or any redshift-free distance tracer.

Compressing large data sets to a manageable number of summaries that are informative about the underlying parameters vastly simplifies both frequentist and Bayesian inference. When only simulations are available, these summaries are typically chosen heuristically, so they may inadvertently miss important information. We introduce a simulation-based machine learning technique that trains artificial neural networks to find non-linear functionals of data that maximise Fisher information: information maximising neural networks (IMNNs). In test cases where the posterior can be derived exactly, likelihood-free inference based on automatically derived IMNN summaries produces nearly exact posteriors, showing that these summaries are good approximations to sufficient statistics. In a series of numerical examples of increasing complexity and astrophysical relevance we show that IMNNs are robustly capable of automatically finding optimal, non-linear summaries of the data even in cases where linear compression fails: inferring the variance of Gaussian signal in the presence of noise; inferring cosmological parameters from mock simulations of the Lyman-{\alpha} forest in quasar spectra; and inferring frequency-domain parameters from LISA-like detections of gravitational waveforms. In this final case, the IMNN summary outperforms linear data compression by avoiding the introduction of spurious likelihood maxima. We anticipate that the automatic physical inference method described in this paper will be essential to obtain both accurate and precise cosmological parameter estimates from complex and large astronomical data sets, including those from LSST and Euclid.

We present full-sky maps of the cosmic microwave background (CMB) and polarized synchrotron and thermal dust emission, derived from the third set of Planck frequency maps. These products have significantly lower contamination from instrumental systematic effects than previous versions. The methodologies used to derive these maps follow closely those described in earlier papers, adopting four methods (Commander, NILC, SEVEM, and SMICA) to extract the CMB component, as well as three methods (Commander, GNILC, and SMICA) to extract astrophysical components. Our revised CMB temperature maps agree with corresponding products in the Planck 2015 delivery, whereas the polarization maps exhibit significantly lower large-scale power, reflecting the improved data processing described in companion papers; however, the noise properties of the resulting data products are complicated, and the best available end-to-end simulations exhibit relative biases with respect to the data at the few percent level. Using these maps, we are for the first time able to fit the spectral index of thermal dust independently over 3 degree regions. We derive a conservative estimate of the mean spectral index of polarized thermal dust emission of beta_d = 1.55 +/- 0.05, where the uncertainty marginalizes both over all known systematic uncertainties and different estimation techniques. For polarized synchrotron emission, we find a mean spectral index of beta_s = -3.1 +/- 0.1, consistent with previously reported measurements. We note that the current data processing does not allow for construction of unbiased single-bolometer maps, and this limits our ability to extract CO emission and correlated components. The foreground results for intensity derived in this paper therefore do not supersede corresponding Planck 2015 products. For polarization the new results supersede the corresponding 2015 products in all respects.

This paper presents the High Frequency Instrument (HFI) data processing procedures for the Planck 2018 release. Major improvements in mapmaking have been achieved since the previous 2015 release. They enabled the first significant measurement of the reionization optical depth parameter using HFI data. This paper presents an extensive analysis of systematic effects, including the use of simulations to facilitate their removal and characterize the residuals. The polarized data, which presented a number of known problems in the 2015 Planck release, are very significantly improved. Calibration, based on the CMB dipole, is now extremely accurate and in the frequency range 100 to 353 GHz reduces intensity-to-polarization leakage caused by calibration mismatch. The Solar dipole direction has been determined in the three lowest HFI frequency channels to within one arc minute, and its amplitude has an absolute uncertainty smaller than $0.35\mu$K, an accuracy of order $10^{-4}$. This is a major legacy from the HFI for future CMB experiments. The removal of bandpass leakage has been improved by extracting the bandpass-mismatch coefficients for each detector as part of the mapmaking process; these values in turn improve the intensity maps. This is a major change in the philosophy of "frequency maps", which are now computed from single detector data, all adjusted to the same average bandpass response for the main foregrounds. Simulations reproduce very well the relative gain calibration of detectors, as well as drifts within a frequency induced by the residuals of the main systematic effect. Using these simulations, we measure and correct the small frequency calibration bias induced by this systematic effect at the $10^{-4}$ level. There is no detectable sign of a residual calibration bias between the first and second acoustic peaks in the CMB channels, at the $10^{-3}$ level.

The initial conditions of cosmological simulations are commonly drawn from a Gaussian ensemble. The limited number of modes inside a simulation volume gives rise to statistical fluctuations known as \textit{sample variance}, limiting the accuracy of simulation predictions. Fixed fields offer an alternative initialization strategy; they have the same power spectrum as standard Gaussian fields but without intrinsic amplitude scatter at linear order. Paired fixed fields consists of two fixed fields with opposite phases that cancel phase correlations which otherwise induce second-order scatter in the non-linear power spectrum. We study the statistical properties of those fields for 19 different quantities at different redshifts through a large set of 600 N-body and 506 state-of-the-art magneto-hydrodynamic simulations covering a wide range of scales, mass and spatial resolutions. We find that paired fixed simulations do not introduce a bias on any of the examined quantities. We quantify the statistical improvement brought by these simulations, over standard ones, on different power spectra such as matter, halos, CDM, gas, stars, black-holes and magnetic fields, finding that they can reduce their variance by factors as large as $10^6$. We quantify the improvement achieved by fixing and by pairing, showing that sample variance in some quantities can be highly suppressed by pairing after fixing. Paired fixed simulations do not change the scatter in quantities such as the probability distribution function of matter density, or the halo, void or stellar mass functions. We argue that procedures aiming at reducing the sample variance of those quantities are unlikely to work. Our results show that paired fixed simulations do not affect either mean relations or scatter of galaxy properties, and suggest that the information embedded in 1-pt statistics is highly complementary to that in clustering.

SPHEREx is a proposed NASA MIDEX mission selected for Phase A study. SPHEREx would carry out the first all-sky spectral survey in the near infrared. At the end of its two-year mission, SPHEREx would obtain 0.75-to-5$\mu$m spectra of every 6.2 arcsec pixel on the sky, with spectral resolution R>35 and a 5-$\sigma$ sensitivity AB$>$19 per spectral/spatial resolution element. More details concerning SPHEREx are available at http://spherex.caltech.edu. The SPHEREx team has proposed three specific science investigations to be carried out with this unique data set: cosmic inflation, interstellar and circumstellar ices, and the extra-galactic background light. Though these three themes are undoubtedly compelling, they are far from exhausting the scientific output of SPHEREx. Indeed, SPHEREx would create a unique all-sky spectral database including spectra of very large numbers of astronomical and solar system targets, including both extended and diffuse sources. These spectra would enable a wide variety of investigations, and the SPHEREx team is dedicated to making the data available to the community to enable these investigations, which we refer to as Legacy Science. To that end, we have sponsored two workshops for the general scientific community to identify the most interesting Legacy Science themes and to ensure that the SPHEREx data products are responsive to their needs. In February of 2016, some 50 scientists from all fields met in Pasadena to develop these themes and to understand their implications for the SPHEREx mission. The 2016 workshop highlighted many synergies between SPHEREx and other contemporaneous astronomical missions, facilities, and databases. Consequently, in January 2018 we convened a second workshop at the Center for Astrophysics in Cambridge to focus specifically on these synergies. This white paper reports on the results of the 2018 SPHEREx workshop.

We revisit the cosmological constraints on resonant and non-resonant conversion of photons to axions in the cosmological magnetic fields. We find that the constraints on photon-axion coupling and primordial magnetic fields are much weaker than previously claimed for low mass axion like particles with masses $m_{\rm a} \lesssim 5\times 10^{-13}\,\text{eV}$. In particular we find that the axion mass range $10^{-14}\,\text{eV} \le m_{\rm a} \le 5\times 10^{-13}\,\text{eV}$ is not excluded by the CMB data contrary to the previous claims. We also examine the photon-axion conversion in the Galactic magnetic fields. Resonant conversion in the large scale coherent Galactic magnetic field results in $100\%$ polarized anisotropic spectral distortions of the CMB for the mass range $10^{-13}\,\text{eV} \lesssim m_{\rm a} \lesssim 10^{-11}\,\text{eV}$. The polarization pattern traces the transverse to line of sight component of the Galactic magnetic field while both the anisotropy in the Galactic magnetic field and electron distribution imprint a characteristic anisotropy pattern in the spectral distortion. Our results apply to scalar as well as pseudoscalar particles. For conversion to scalar particles, the polarization is rotated by $90^{\circ}$ allowing us to distinguish them from the pseudoscalars. For $m_{\rm a} \lesssim 10^{-14} \,\text{eV}$ we have non-resonant conversion in the small scale turbulent magnetic field of the Galaxy resulting in anisotropic but unpolarized spectral distortion in the CMB. These unique signatures are potential discriminants against the isotropic and non-polarized signals such as primary CMB, and $\mu$ and $y$ distortions with the anisotropic nature making it accessible to experiments with only relative calibration like Planck, LiteBIRD, and CORE. We forecast for PIXIE as well as for these experiments using Fisher matrix formalism.

Data compression has become one of the cornerstones of modern astronomical data analysis, with the vast majority of analyses compressing large raw datasets down to a manageable number of informative summaries. In this paper we provide a general procedure for optimally compressing $N$ data down to $n$ summary statistics, where $n$ is equal to the number of parameters of interest. We show that compression to the score function -- the gradient of the log-likelihood with respect to the parameters -- yields $n$ compressed statistics that are optimal in the sense that they preserve the Fisher information content of the data. Our method generalizes earlier work on linear Karhunen-Lo\'{e}ve compression for Gaussian data whilst recovering both lossless linear compression and quadratic estimation as special cases when they are optimal. We give a unified treatment that also includes the general non-Gaussian case as long as mild regularity conditions are satisfied, producing optimal non-linear summary statistics when appropriate. As a worked example, we derive explicitly the $n$ optimal compressed statistics for Gaussian data in the general case where both the mean and covariance depend on the parameters.

Many statistical models in cosmology can be simulated forwards but have intractable likelihood functions. Likelihood-free inference methods allow us to perform Bayesian inference from these models using only forward simulations, free from any likelihood assumptions or approximations. Likelihood-free inference generically involves simulating mock data and comparing to the observed data; this comparison in data-space suffers from the curse of dimensionality and requires compression of the data to a small number of summary statistics to be tractable. In this paper we use massive asymptotically-optimal data compression to reduce the dimensionality of the data-space to just one number per parameter, providing a natural and optimal framework for summary statistic choice for likelihood-free inference. Secondly, we present the first cosmological application of Density Estimation Likelihood-Free Inference (\textsc{delfi}), which learns a parameterized model for joint distribution of data and parameters, yielding both the parameter posterior and the model evidence. This approach is conceptually simple, requires less tuning than traditional Approximate Bayesian Computation approaches to likelihood-free inference and can give high-fidelity posteriors from orders of magnitude fewer forward simulations. As an additional bonus, it enables parameter inference and Bayesian model comparison simultaneously. We demonstrate Density Estimation Likelihood-Free Inference with massive data compression on an analysis of the joint light-curve analysis supernova data, as a simple validation case study. We show that high-fidelity posterior inference is possible for full-scale cosmological data analyses with as few as $\sim 10^4$ simulations, with substantial scope for further improvement, demonstrating the scalability of likelihood-free inference to large and complex cosmological datasets.

We describe a hybrid Fourier/direct space convolution algorithm for compact radial (azimuthally symmetric) kernels on the sphere. For high resolution maps covering a large fraction of the sky, our implementation takes advantage of the inexpensive massive parallelism afforded by consumer graphics processing units (GPUs). Applications involve modeling of instrumental beam shapes in terms of compact kernels, computation of fine-scale wavelet transformations, and optimal filtering for the detection of point sources. Our algorithm works for any pixelization where pixels are grouped into isolatitude rings. Even for kernels that are not bandwidth limited, ringing features are completely absent on an ECP grid. We demonstrate that they can be highly suppressed on the popular HEALPix pixelization, for which we develop a freely available implementation of the algorithm. As an example application, we show that running on a high-end consumer graphics card our method speeds up beam convolution for simulations of a characteristic Planck high frequency instrument channel by two orders of magnitude compared to the commonly used HEALPix implementation on one CPU core while maintaining at typical a fractional RMS accuracy of about 1 part in 10^5.

We present cluster counts and corresponding cosmological constraints from the Planck full mission data set. Our catalogue consists of 439 clusters detected via their Sunyaev-Zeldovich (SZ) signal down to a signal-to-noise ratio of 6, and is more than a factor of 2 larger than the 2013 Planck cluster cosmology sample. The counts are consistent with those from 2013 and yield compatible constraints under the same modelling assumptions. Taking advantage of the larger catalogue, we extend our analysis to the two-dimensional distribution in redshift and signal-to-noise. We use mass estimates from two recent studies of gravitational lensing of background galaxies by Planck clusters to provide priors on the hydrostatic bias parameter, $(1-b)$. In addition, we use lensing of cosmic microwave background (CMB) temperature fluctuations by Planck clusters as an independent constraint on this parameter. These various calibrations imply constraints on the present-day amplitude of matter fluctuations in varying degrees of tension with those from the Planck analysis of primary fluctuations in the CMB; for the lowest estimated values of $(1-b)$ the tension is mild, only a little over one standard deviation, while it remains substantial ($3.7\,\sigma$) for the largest estimated value. We also examine constraints on extensions to the base flat $\Lambda$CDM model by combining the cluster and CMB constraints. The combination appears to favour non-minimal neutrino masses, but this possibility does little to relieve the overall tension because it simultaneously lowers the implied value of the Hubble parameter, thereby exacerbating the discrepancy with most current astrophysical estimates. Improving the precision of cluster mass calibrations from the current 10%-level to 1% would significantly strengthen these combined analyses and provide a stringent test of the base $\Lambda$CDM model.

We present a method for the computation of the variance of cosmic microwave background (CMB) temperature maps on azimuthally symmetric patches using a fast convolution approach. As an example of the application of the method, we show results for the search for concentric rings with unusual variance in the 7-year WMAP data. We re-analyse claims concerning the unusual variance profile of rings centred at two locations on the sky that have recently drawn special attention in the context of the conformal cyclic cosmology scenario proposed by Penrose (2009). We extend this analysis to rings with larger radii and centred on other points of the sky. Using the fast convolution technique enables us to perform this search with higher resolution and a wider range of radii than in previous studies. We show that for one of the two special points rings with radii larger than 10 degrees have systematically lower variance in comparison to the concordance LambdaCDM model predictions. However, we show that this deviation is caused by the multipoles up to order l=7. Therefore, the deficit of power for concentric rings with larger radii is yet another manifestation of the well-known anomalous CMB distribution on large angular scales. Furthermore, low variance rings can be easily found centred on other points in the sky. In addition, we show also the results of a search for extremely high variance rings. As for the low variance rings, some anomalies seem to be related to the anomalous distribution of the low-order multipoles of the WMAP CMB maps. As such our results are not consistent with the conformal cyclic cosmology scenario.

We adapt our recently proposed dual messenger algorithm for spin field reconstruction and showcase its efficiency and effectiveness in Wiener filtering polarized cosmic microwave background (CMB) maps. Unlike conventional preconditioned conjugate gradient (PCG) solvers, our preconditioner-free technique can deal with high-resolution joint temperature and polarization maps with inhomogeneous noise distributions and arbitrary mask geometries with relative ease. Various convergence diagnostics illustrate the high quality of the dual messenger reconstruction. In contrast, the PCG implementation fails to converge to a reasonable solution for the specific problem considered. The implementation of the dual messenger method is straightforward and guarantees numerical stability and convergence. We show how the algorithm can be modified to generate fluctuation maps, which, combined with the Wiener filter solution, yield unbiased constrained signal realizations, consistent with observed data. This algorithm presents a pathway to exact global analyses of high-resolution and high-sensitivity CMB data for a statistically optimal separation of E and B modes. It is therefore relevant for current and next-generation CMB experiments, in the quest for the elusive primordial B-mode signal.

We provide a fast algorithm to diagnose any directional dependence in the cosmological parameters by calculating maps of local cosmological parameter estimates and their joint errors. The technique implements a fast quadratic estimator technique based on Wiener filtering and convolution of the sky with a patch shape. It uses only three map-resolution spherical harmonic transforms per parameter and applies to any data set with full sky or a partial sky coverage. We apply this method to Planck SMICA-2015 and obtain fluctuation map for six cosmological parameters. Our estimate shows that the Planck data is consistent with a single global value of the cosmological parameters and is not influenced by any severe local contaminations. This method is applicable also to other angular or 3D data sets of future missions to scrutinize any local variation in the cosmological parameters.

Although the Cosmic Microwave Background agrees with a perfect blackbody spectrum within the current experimental limits, it is expected to exhibit certain spectral distortions with known spectral properties. We propose a new method, Frequency Space Differential (FSD) to measure the spectral distortions in the CMB spectrum by using the inter-frequency differences of the brightness temperature. The difference between the observed CMB temperature at different frequencies must agree with the frequency derivative of the blackbody spectrum, in the absence of any distortion. However, in the presence of spectral distortions, the measured inter-frequency differences would also exhibit deviations from blackbody which can be modeled for known sources of spectral distortions like $y\,\&\,\mu$. Our technique uses FSD information for the CMB blackbody, $y$, $\mu$ or any other sources of spectral distortions to model the observed signal. Successful application of this method in future CMB missions can provide an alternative method to extract spectral distortion signals and can potentially make it feasible to measure spectral distortions without an internal blackbody calibrator.

The next generation of CMB experiments (CMB Stage-4) will produce a Sunyaev-Zel'dovich (SZ) cluster catalog containing $\sim10^{5}$ objects, two orders of magnitudes more than currently available. In this paper, we discuss the detectability of the polarized signal generated by scattering of the CMB quadrupole on the cluster electron gas using this catalog. We discuss the possibility of using this signal to measure the relationship between cluster optical depth and mass. We find that the area of observation of S4 maximizes the signal-to-noise (S/N) on the polarized signal but that this S/N is extremely small for an individual cluster, of order 0.5% for a typical cluster in our catalog, the main source of noise being the residual primordial E-mode signal. However, we find that the signal could be detected using the full cluster catalog and that the significance of the result will increase linearly with the size of the CMB S4 telescope mirror.

We present the implications for cosmic inflation of the Planck measurements of the cosmic microwave background (CMB) anisotropies in both temperature and polarization based on the full Planck survey. The Planck full mission temperature data and a first release of polarization data on large angular scales measure the spectral index of curvature perturbations to be $n_\mathrm{s} = 0.968 \pm 0.006$ and tightly constrain its scale dependence to $d n_s/d \ln k =-0.003 \pm 0.007$ when combined with the Planck lensing likelihood. When the high-$\ell$ polarization data is included, the results are consistent and uncertainties are reduced. The upper bound on the tensor-to-scalar ratio is $r_{0.002} < 0.11$ (95% CL), consistent with the B-mode polarization constraint $r< 0.12$ (95% CL) obtained from a joint BICEP2/Keck Array and Planck analysis. These results imply that $V(\phi) \propto \phi^2$ and natural inflation are now disfavoured compared to models predicting a smaller tensor-to-scalar ratio, such as $R^2$ inflation. Three independent methods reconstructing the primordial power spectrum are investigated. The Planck data are consistent with adiabatic primordial perturbations. We investigate inflationary models producing an anisotropic modulation of the primordial curvature power spectrum as well as generalized models of inflation not governed by a scalar field with a canonical kinetic term. The 2015 results are consistent with the 2013 analysis based on the nominal mission data.

We develop the first algorithm able to jointly compute the maximum {\it a posteriori} estimate of the Cosmic Microwave Background (CMB) temperature and polarization fields, the gravitational potential by which they are lensed, and cosmological parameters such as the tensor-to-scalar ratio, $r$. This is an important step towards sampling from the joint posterior probability function of these quantities, which, assuming Gaussianity of the CMB fields and lensing potential, contains all available cosmological information and would yield theoretically optimal constraints. Attaining such optimal constraints will be crucial for next-generation CMB surveys like CMB-S4, where limits on $r$ could be improved by factors of a few over currently used sub-optimal quadratic estimators. The maximization procedure described here depends on a newly developed lensing algorithm, which we term \textsc{LenseFlow}, and which lenses a map by solving a system of ordinary differential equations. This description has conceptual advantages, such as allowing us to give a simple non-perturbative proof that the lensing determinant is equal to unity in the weak-lensing regime. The algorithm itself maintains this property even on pixelized maps, which is crucial for our purposes and unique to \textsc{LenseFlow} as compared to other lensing algorithms we have tested. It also has other useful properties such as that it can be trivially inverted (i.e. delensing) for the same computational cost as the forward operation, and can be used to compute lensing adjoint, Jacobian, and Hessian operators. We test and validate the maximization procedure on flat-sky simulations covering up to 600\,deg$^2$ with non-uniform noise and masking.

In order to draw scientific conclusions from observations of cosmic microwave background (CMB) polarization, it is necessary to separate the contributions of the E and B components of the data. For data with incomplete sky coverage, there are ambiguous modes, which can be sourced by either E or B signals. Techniques exist for producing "pure" E and B maps, which are guaranteed to be free of cross-contamination, although the standard method, which involves constructing an eigenbasis, has a high computational cost. We show that such pure maps can be thought of as resulting from the application of a Wiener filter to the data. This perspective leads to far more efficient methods of producing pure maps. Moreover, by expressing the idea of purification in the general framework of Wiener filtering (i.e., maximization of a posterior probability), it leads to a variety of generalizations of the notion of pure E and B maps, e.g., accounting for noise or other contaminants in the data as well as correlations with temperature anisotropy.

Previous studies using numerical simulations have demonstrated that the shape of the cosmic web can be described by studying the Lagrangian displacement field. We extend these analyses, showing that it is now possible to perform a Lagrangian description of cosmic structure in the nearby Universe based on large-scale structure observations. Building upon recent Bayesian large-scale inference of initial conditions, we present a cosmographic analysis of the dark matter distribution and its evolution, referred to as the dark matter phase-space sheet, in the nearby universe as probed by the Sloan Digital Sky Survey main galaxy sample. We consider its stretchings and foldings using a tetrahedral tessellation of the Lagrangian lattice. The method provides extremely accurate estimates of nearby density and velocity fields, even in regions of low galaxy density. It also measures the number of matter streams, and the deformation and parity reversals of fluid elements, which were previously thought inaccessible using observations. We illustrate the approach by showing the phase-space structure of known objects of the nearby Universe such as the Sloan Great Wall, the Coma cluster and the Bo\"otes void. We dissect cosmic structures into four distinct components (voids, sheets, filaments, and clusters), using the Lagrangian classifiers DIVA, ORIGAMI, and a new scheme which we introduce and call LICH. Because these classifiers use information other than the sheer local density, identified structures explicitly carry physical information about their formation history. Accessing the phase-space structure of dark matter in galaxy surveys opens the way for new confrontations of observational data and theoretical models. We have made our data products publicly available.

Future observations of cosmic microwave background (CMB) polarisation have the potential to answer some of the most fundamental questions of modern physics and cosmology. In this paper, we list the requirements for a future CMB polarisation survey addressing these scientific objectives, and discuss the design drivers of the CORE space mission proposed to ESA in answer to the "M5" call for a medium-sized mission. The rationale and options, and the methodologies used to assess the mission's performance, are of interest to other future CMB mission design studies. CORE is designed as a near-ultimate CMB polarisation mission which, for optimal complementarity with ground-based observations, will perform the observations that are known to be essential to CMB polarisation scienceand cannot be obtained by any other means than a dedicated space mission.

The characterization of the dust polarization foreground to the Cosmic Microwave Background (CMB) is a necessary step towards the detection of the B-mode signal associated with primordial gravitational waves. We present a method to simulate maps of polarized dust emission on the sphere, similarly to what is done for the CMB anisotropies. This method builds on the understanding of Galactic polarization stemming from the analysis of Planck data. It relates the dust polarization sky to the structure of the Galactic magnetic field and its coupling with interstellar matter and turbulence. The Galactic magnetic field is modelled as a superposition of a mean uniform field and a random component with a power-law power spectrum of exponent $\alpha_{\rm M}$. The model parameters are constrained to fit the power spectra of dust polarization EE, BB and TE measured using Planck data. We find that the slopes of the E and B power spectra of dust polarization are matched for $\alpha_{\rm M} = -2.5$. The model allows us to compute multiple realizations of the Stokes Q and U maps for different realizations of the random component of the magnetic field, and to quantify the variance of dust polarization spectra for any given sky area outside of the Galactic plane. The simulations reproduce the scaling relation between the dust polarization power and the mean total dust intensity including the observed dispersion around the mean relation. We also propose a method to carry out multi-frequency simulations including the decorrelation measured recently by Planck, using a given covariance matrix of the polarization maps. These simulations are well suited to optimize component separation methods and to quantify the confidence with which the dust and CMB B-modes can be separated in present and future experiments. We also provide an astrophysical perspective on our modeling of the dust polarization spectra.

The six parameters of the standard $\Lambda$CDM model have best-fit values derived from the Planck temperature power spectrum that are shifted somewhat from the best-fit values derived from WMAP data. These shifts are driven by features in the Planck temperature power spectrum at angular scales that had never before been measured to cosmic-variance level precision. We investigate these shifts to determine whether they are within the range of expectation and to understand their origin in the data. Taking our parameter set to be the optical depth of the reionized intergalactic medium $\tau$, the baryon density $\omega_{\rm b}$, the matter density $\omega_{\rm m}$, the angular size of the sound horizon $\theta_*$, the spectral index of the primordial power spectrum, $n_{\rm s}$, and $A_{\rm s}e^{-2\tau}$ (where $A_{\rm s}$ is the amplitude of the primordial power spectrum), we examine the change in best-fit values between a WMAP-like large angular-scale data set (with multipole moment $\ell<800$ in the Planck temperature power spectrum) and an all angular-scale data set ($\ell<2500$ Planck temperature power spectrum), each with a prior on $\tau$ of $0.07\pm0.02$. We find that the shifts, in units of the 1$\sigma$ expected dispersion for each parameter, are $\{\Delta \tau, \Delta A_{\rm s} e^{-2\tau}, \Delta n_{\rm s}, \Delta \omega_{\rm m}, \Delta \omega_{\rm b}, \Delta \theta_*\} = \{-1.7, -2.2, 1.2, -2.0, 1.1, 0.9\}$, with a $\chi^2$ value of 8.0. We find that this $\chi^2$ value is exceeded in 15% of our simulated data sets, and that a parameter deviates by more than 2.2$\sigma$ in 9% of simulated data sets, meaning that the shifts are not unusually large. Comparing $\ell<800$ instead to $\ell>800$, or splitting at a different multipole, yields similar results. We examine the $\ell<800$ model residuals in the $\ell>800$ power spectrum data and find that the features there... [abridged]

We present a high performance solution to the Wiener filtering problem via a formulation that is dual to the recently developed messenger technique. This new dual messenger algorithm, like its predecessor, efficiently calculates the Wiener filter solution of large and complex data sets without preconditioning and can account for inhomogeneous noise distributions and arbitrary mask geometries. We demonstrate the capabilities of this scheme in signal reconstruction by applying it on a simulated cosmic microwave background (CMB) temperature data set. The performance of this new method is compared to that of the standard messenger algorithm and the preconditioned conjugate gradient (PCG) approach, using a series of well-known convergence diagnostics and their processing times, for the particular problem under consideration. This variant of the messenger algorithm matches the performance of the PCG method in terms of the effectiveness of reconstruction of the input angular power spectrum and converges smoothly to the final solution. The dual messenger algorithm outperforms the standard messenger and PCG methods in terms of execution time, as it runs to completion around 2 and 3-4 times faster than the respective methods, for the specific problem considered.

We use the lensing potential map from Planck CMB lensing reconstruction analysis and the "Public Cosmic Void Catalog" to measure the stacked void lensing potential. In this profile, four parameters are needed to describe the shape of voids with different characteristic radii $R_V$. However, we have found that after reducing the background noise by subtracting the average background, there is a residue lensing power left in the data. The inclusion of the environment shifting parameter, $\gamma_V$, is necessary to get a better fit to the data with the residue lensing power. We divide the voids into two redshift bins: cmass1 ($0.45 < z < 0.5$) and cmass2 ($0.5 < z < 0.6$). Our best-fit parameters are $\alpha = 1.989\pm0.149$, $\beta = 12.61\pm0.56$, $\delta_c=-0.697\pm0.025$, $R_S/R_V=1.039\pm0.030$, $\gamma_v=(-7.034\pm0.150) \times 10^{-2}$ for the cmass1 sample with 123 voids and $\alpha = 1.956\pm0.165$, $\beta = 12.91\pm0.60$, $\delta_c=-0.673\pm0.027$, $R_S/R_V=1.115\pm0.032$, $\gamma_v=(-4.512\pm0.114) \times 10^{-2}$ for the cmass2 sample with 393 voids at 68% C.L. The addition of the environment parameter is consistent with the conjecture that the Sloan Digital Sky Survey voids reside in an underdense region.

This paper presents a study of the ISW effect from the Planck 2015 temperature and polarization data release. The CMB is cross-correlated with different LSS tracers: the NVSS, SDSS and WISE catalogues, and the Planck 2015 lensing map. This cross-correlation yields a detection at $4\,\sigma$, where most of the signal-to-noise is due to the Planck lensing and NVSS. In fact, the ISW effect is detected only from the Planck data (through the ISW-lensing bispectrum) at $\approx 3\,\sigma$, which is similar to the detection level achieved by combining the cross-correlation signal coming from all the catalogues. The ISW signal allow us to detect $\Omega_\Lambda$ at more than $3\,\sigma$. This cross-correlation analysis is performed only with the Planck temperature data, since the polarization scales available in the 2015 release do not permit significant improvement of the CMB-LSS cross-correlation detectability. Nevertheless, polarization data is used to study the anomalously large ISW signal previously reported through the stacking of CMB features at the locations of known superstructures. We find that the current Planck polarization data do not exclude that this signal could be caused by the ISW effect. In addition, the stacking of the Planck lensing map on the locations of superstructures exhibits a positive cross-correlation with these large-scale structures. Finally, we have improved our previous reconstruction of the ISW temperature fluctuations by combining the information encoded in all the previously mentioned LSS tracers. In particular, we construct a map of the ISW secondary anisotropies and the corresponding uncertainties map, obtained from simulations. We also explore the reconstruction of the ISW anisotropies caused by the LSS traced by the 2MPZ survey by directly inverting the density field into the gravitational potential field.

The secondary cosmic microwave background (CMB) $B$-modes stem from the post-decoupling distortion of the polarization $E$-modes due to the gravitational lensing effect of large-scale structures. These lensing-induced $B$-modes constitute both a valuable probe of the dark matter distribution and an important contaminant for the extraction of the primary CMB $B$-modes from inflation. Planck provides accurate nearly all-sky measurements of both the polarization $E$-modes and the integrated mass distribution via the reconstruction of the CMB lensing potential. By combining these two data products, we have produced an all-sky template map of the lensing-induced $B$-modes using a real-space algorithm that minimizes the impact of sky masks. The cross-correlation of this template with an observed (primordial and secondary) $B$-mode map can be used to measure the lensing $B$-mode power spectrum at multipoles up to $2000$. In particular, when cross-correlating with the $B$-mode contribution directly derived from the Planck polarization maps, we obtain lensing-induced $B$-mode power spectrum measurement at a significance level of $12\,\sigma$, which agrees with the theoretical expectation derived from the Planck best-fit $\Lambda$CDM model. This unique nearly all-sky secondary $B$-mode template, which includes the lensing-induced information from intermediate to small ($10\lesssim \ell\lesssim 1000$) angular scales, is delivered as part of the Planck 2015 public data release. It will be particularly useful for experiments searching for primordial $B$-modes, such as BICEP2/Keck Array or LiteBIRD, since it will enable an estimate to be made of the lensing-induced contribution to the measured total CMB $B$-modes.

We present the most significant measurement of the cosmic microwave background (CMB) lensing potential to date (at a level of 40 sigma), using temperature and polarization data from the Planck 2015 full-mission release. Using a polarization-only estimator we detect lensing at a significance of 5 sigma. We cross-check the accuracy of our measurement using the wide frequency coverage and complementarity of the temperature and polarization measurements. Public products based on this measurement include an estimate of the lensing potential over approximately 70% of the sky, an estimate of the lensing potential power spectrum in bandpowers for the multipole range 40<L<400 and an associated likelihood for cosmological parameter constraints. We find good agreement between our measurement of the lensing potential power spectrum and that found in the best-fitting LCDM model based on the Planck temperature and polarization power spectra. Using the lensing likelihood alone we obtain a percent-level measurement of the parameter combination $\sigma_8 \Omega_m^{0.25} = 0.591\pm 0.021$. We combine our determination of the lensing potential with the E-mode polarization also measured by Planck to generate an estimate of the lensing B-mode. We show that this lensing B-mode estimate is correlated with the B-modes observed directly by Planck at the expected level and with a statistical significance of 10 sigma, confirming Planck's sensitivity to this known sky signal. We also correlate our lensing potential estimate with the large-scale temperature anisotropies, detecting a cross-correlation at the 3 sigma level, as expected due to dark energy in the concordance LCDM model.

We investigate constraints on cosmic reionization extracted from the Planck cosmic microwave background (CMB) data. We combine the Planck CMB anisotropy data in temperature with the low-multipole polarization data to fit LCDM models with various parameterizations of the reionization history. We obtain a Thomson optical depth tau=0.058 +/- 0.012 for the commonly adopted instantaneous reionization model. This confirms, with only data from CMB anisotropies, the low value suggested by combining Planck 2015 results with other data sets and also reduces the uncertainties. We reconstruct the history of the ionization fraction using either a symmetric or an asymmetric model for the transition between the neutral and ionized phases. To determine better constraints on the duration of the reionization process, we also make use of measurements of the amplitude of the kinetic Sunyaev-Zeldovich (kSZ) effect using additional information from the high resolution Atacama Cosmology Telescope and South Pole Telescope experiments. The average redshift at which reionization occurs is found to lie between z=7.8 and 8.8, depending on the model of reionization adopted. Using kSZ constraints and a redshift-symmetric reionization model, we find an upper limit to the width of the reionization period of Dz < 2.8. In all cases, we find that the Universe is ionized at less than the 10% level at redshifts above z~10. This suggests that an early onset of reionization is strongly disfavoured by the Planck data. We show that this result also reduces the tension between CMB-based analyses and constraints from other astrophysical sources.

The Universe is mostly composed of large and relatively empty domains known as cosmic voids, whereas its matter content is predominantly distributed along their boundaries. The remaining material inside them, either dark or luminous matter, is attracted to these boundaries and causes voids to expand faster and to grow emptier over time. Using the distribution of galaxies centered on voids identified in the Sloan Digital Sky Survey and adopting minimal assumptions on the statistical motion of these galaxies, we constrain the average matter content $\Omega_\mathrm{m}=0.281\pm0.031$ in the Universe today, as well as the linear growth rate of structure $f/b=0.417\pm0.089$ at median redshift $\bar{z}=0.57$, where $b$ is the galaxy bias ($68\%$ C.L.). These values originate from a percent-level measurement of the anisotropic distortion in the void-galaxy cross-correlation function, $\varepsilon = 1.003\pm0.012$, and are robust to consistency tests with bootstraps of the data and simulated mock catalogs within an additional systematic uncertainty of half that size. They surpass (and are complementary to) existing constraints by unlocking cosmological information on smaller scales through an accurate model of nonlinear clustering and dynamics in void environments. As such, our analysis furnishes a powerful probe of deviations from Einstein's general relativity in the low-density regime which has largely remained untested so far. We find no evidence for such deviations in the data at hand.

We introduce a decision scheme for optimally choosing a classifier, which segments the cosmic web into different structure types (voids, sheets, filaments, and clusters). Our framework, based on information theory, accounts for the design aims of different classes of possible applications: (i) parameter inference, (ii) model selection, and (iii) prediction of new observations. As an illustration, we use cosmographic maps of web-types in the Sloan Digital Sky Survey to assess the relative performance of the classifiers T-web, DIVA and ORIGAMI for: (i) analyzing the morphology of the cosmic web, (ii) discriminating dark energy models, and (iii) predicting galaxy colors. Our study substantiates a data-supported connection between cosmic web analysis and information theory, and paves the path towards principled design of analysis procedures for the next generation of galaxy surveys. We have made the cosmic web maps, galaxy catalog, and analysis scripts used in this work publicly available.

Using the Planck 2015 data release (PR2) temperature maps, we separate Galactic thermal dust emission from cosmic infrared background (CIB) anisotropies. For this purpose, we implement a specifically tailored component-separation method, the so-called generalized needlet internal linear combination (GNILC) method, which uses spatial information (the angular power spectra) to disentangle the Galactic dust emission and CIB anisotropies. We produce significantly improved all-sky maps of Planck thermal dust emission, with reduced CIB contamination, at 353, 545, and 857 GHz. By reducing the CIB contamination of the thermal dust maps, we provide more accurate estimates of the local dust temperature and dust spectral index over the sky with reduced dispersion, especially at high Galactic latitudes above $b = \pm 20{\deg}$. We find that the dust temperature is $T = (19.4 \pm 1.3)$ K and the dust spectral index is $\beta = 1.6 \pm 0.1$ averaged over the whole sky, while $T = (19.4 \pm 1.5)$ K and $\beta = 1.6 \pm 0.2$ on 21 % of the sky at high latitudes. Moreover, subtracting the new CIB-removed thermal dust maps from the CMB-removed Planck maps gives access to the CIB anisotropies over 60 % of the sky at Galactic latitudes $|b| > 20{\deg}$. Because they are a significant improvement over previous Planck products, the GNILC maps are recommended for thermal dust science. The new CIB maps can be regarded as indirect tracers of the dark matter and they are recommended for exploring cross-correlations with lensing and large-scale structure optical surveys. The reconstructed GNILC thermal dust and CIB maps are delivered as Planck products.

Parity violating extensions of the standard electromagnetic theory cause in vacuo rotation of the plane of polarization of propagating photons. This effect, also known as cosmic birefringence, impacts the cosmic microwave background (CMB) anisotropy angular power spectra, producing non-vanishing $T$--$B$ and $E$--$B$ correlations that are otherwise null when parity is a symmetry. Here we present new constraints on an isotropic rotation, parametrized by the angle $\alpha$, derived from Planck 2015 CMB polarization data. To increase the robustness of our analyses, we employ two complementary approaches, in harmonic space and in map space, the latter based on a peak stacking technique. The two approaches provide estimates for $\alpha$ that are in agreement within statistical uncertainties and very stable against several consistency tests. Considering the $T$--$B$ and $E$--$B$ information jointly, we find $\alpha = 0.31^{\circ} \pm 0.05^{\circ} \, ({\rm stat.})\, \pm 0.28^{\circ} \, ({\rm syst.})$ from the harmonic analysis and $\alpha = 0.35^{\circ} \pm 0.05^{\circ} \, ({\rm stat.})\, \pm 0.28^{\circ} \, ({\rm syst.})$ from the stacking approach. These constraints are compatible with no parity violation and are dominated by the systematic uncertainty in the orientation of Planck's polarization-sensitive bolometers.

The Planck full mission cosmic microwave background(CMB) temperature and E-mode polarization maps are analysed to obtain constraints on primordial non-Gaussianity(NG). Using three classes of optimal bispectrum estimators - separable template-fitting (KSW), binned, and modal - we obtain consistent values for the local, equilateral, and orthogonal bispectrum amplitudes, quoting as our final result from temperature alone fNL^local=2.5+\-5.7, fNL^equil=-16+\-70 and fNL^ortho=-34+\-33(68%CL). Combining temperature and polarization data we obtain fNL^local=0.8+\-5.0, fNL^equil=-4+\-43 and fNL^ortho=-26+\-21 (68%CL). The results are based on cross-validation of these estimators on simulations, are stable across component separation techniques, pass an extensive suite of tests, and are consistent with Minkowski functionals based measurements. The effect of time-domain de-glitching systematics on the bispectrum is negligible. In spite of these test outcomes we conservatively label the results including polarization data as preliminary, owing to a known mismatch of the noise model in simulations and the data. Beyond fNL estimates, we present model-independent reconstructions of the CMB bispectrum and derive constraints on early universe scenarios that generate NG, including general single-field and axion inflation, initial state modifications, parity-violating tensor bispectra, and directionally dependent vector models. We also present a wide survey of scale-dependent oscillatory bispectra, and we look for isocurvature NG. Our constraint on the local primordial trispectrum amplitude is gNL^local=(-9.0+\-7.7)x10^4 (68%CL), and we perform an analysis of additional trispectrum shapes. The global picture is one of consistency with the premises of the LambdaCDM cosmology, namely that the structure we observe today was sourced by adiabatic, passive, Gaussian, and primordial seed perturbations.[abridged]

This paper presents the Planck 2015 likelihoods, statistical descriptions of the 2-point correlations of CMB data, using the hybrid approach employed previously: pixel-based at $\ell<30$ and a Gaussian approximation to the distribution of spectra at higher $\ell$. The main improvements are the use of more and better processed data and of Planck polarization data, and more detailed foreground and instrumental models, allowing further checks and enhanced immunity to systematics. Progress in foreground modelling enables a larger sky fraction. Improvements in processing and instrumental models further reduce uncertainties. For temperature, we perform an analysis of end-to-end instrumental simulations fed into the data processing pipeline; this does not reveal biases from residual instrumental systematics. The $\Lambda$CDM cosmological model continues to offer a very good fit to Planck data. The slope of primordial scalar fluctuations, $n_s$, is confirmed smaller than unity at more than 5{\sigma} from Planck alone. We further validate robustness against specific extensions to the baseline cosmology. E.g., the effective number of neutrino species remains compatible with the canonical value of 3.046. This first detailed analysis of Planck polarization concentrates on E modes. At low $\ell$ we use temperature at all frequencies and a subset of polarization. The frequency range improves CMB-foreground separation. Within the baseline model this requires a reionization optical depth $\tau=0.078\pm0.019$, significantly lower than without high-frequency data for explicit dust monitoring. At high $\ell$ we detect residual errors in E, typically O($\mu$K$^2$); we recommend temperature alone as the high-$\ell$ baseline. Nevertheless, Planck high-$\ell$ polarization allows a separate determination of $\Lambda$CDM parameters consistent with those from temperature alone.

The characterization of the Galactic foregrounds has been shown to be the main obstacle in the challenging quest to detect primordial B-modes in the polarized microwave sky. We make use of the Planck-HFI 2015 data release at high frequencies to place new constraints on the properties of the polarized thermal dust emission at high Galactic latitudes. Here, we specifically study the spatial variability of the dust polarized spectral energy distribution, and its potential impact on the determination of the tensor-to-scalar ratio. We use the correlation ratio of the $C_\ell^{BB}$ angular power spectra between the 217- and 353-GHz channels as a tracer of these potential variations, computed on different high Galactic latitude regions, ranging from 80% to 20% of the sky. The new insight from Planck data is a departure of the correlation ratio from unity that cannot be attributed to a spurious decorrelation due to the cosmic microwave background, instrumental noise, or instrumental systematics. The effect is marginally detected on each region, but the statistical combination of all the regions gives more than 99% confidence for this variation in polarized dust properties. In addition, we show that the decorrelation increases when there is a decrease in the mean column density of the region of the sky being considered, and we propose a simple power-law empirical model for this dependence, which matches what is seen in the Planck data. We explore the effect that this measured decorrelation has on simulations of the BICEP2-Keck Array/Planck analysis and show that the 2015 constraints from those data still allow a decorrelation between the dust at 150 and 353GHz of the order of the one we measure. Finally we show that either spatial variation of the dust SED or of the dust polarization angle could produce decorrelations between 217- and 353-GHz data similar to those we observe in the data.

We present results based on full-mission Planck observations of temperature and polarization anisotropies of the CMB. These data are consistent with the six-parameter inflationary LCDM cosmology. From the Planck temperature and lensing data, for this cosmology we find a Hubble constant, H0= (67.8 +/- 0.9) km/s/Mpc, a matter density parameter Omega_m = 0.308 +/- 0.012 and a scalar spectral index with n_s = 0.968 +/- 0.006. (We quote 68% errors on measured parameters and 95% limits on other parameters.) Combined with Planck temperature and lensing data, Planck LFI polarization measurements lead to a reionization optical depth of tau = 0.066 +/- 0.016. Combining Planck with other astrophysical data we find N_ eff = 3.15 +/- 0.23 for the effective number of relativistic degrees of freedom and the sum of neutrino masses is constrained to < 0.23 eV. Spatial curvature is found to be |Omega_K| < 0.005. For LCDM we find a limit on the tensor-to-scalar ratio of r <0.11 consistent with the B-mode constraints from an analysis of BICEP2, Keck Array, and Planck (BKP) data. Adding the BKP data leads to a tighter constraint of r < 0.09. We find no evidence for isocurvature perturbations or cosmic defects. The equation of state of dark energy is constrained to w = -1.006 +/- 0.045. Standard big bang nucleosynthesis predictions for the Planck LCDM cosmology are in excellent agreement with observations. We investigate annihilating dark matter and deviations from standard recombination, finding no evidence for new physics. The Planck results for base LCDM are in agreement with BAO data and with the JLA SNe sample. However the amplitude of the fluctuations is found to be higher than inferred from rich cluster counts and weak gravitational lensing. Apart from these tensions, the base LCDM cosmology provides an excellent description of the Planck CMB observations and many other astrophysical data sets.

Continuum spectra covering centimetre to submillimetre wavelengths are presented for a northern sample of 104 extragalactic radio sources, mainly active galactic nuclei, based on four-epoch Planck data. The nine Planck frequencies, from 30 to 857 GHz, are complemented by a set of simultaneous ground-based radio observations between 1.1 and 37 GHz. The single-survey Planck data confirm that the flattest high-frequency radio spectral indices are close to zero, indicating that the original accelerated electron energy spectrum is much harder than commonly thought, with power-law index around 1.5 instead of the canonical 2.5. The radio spectra peak at high frequencies and exhibit a variety of shapes. For a small set of low-z sources, we find a spectral upturn at high frequencies, indicating the presence of intrinsic cold dust. Variability can generally be approximated by achromatic variations, while sources with clear signatures of evolving shocks appear to be limited to the strongest outbursts.

(abridged) We discuss the Galactic foreground emission between 20 and 100GHz based on observations by Planck/WMAP. The Commander component-separation tool has been used to separate the various astrophysical processes in total intensity. Comparison with RRL templates verifies the recovery of the free-free emission along the Galactic plane. Comparison of the high-latitude Halpha emission with our free-free map shows residuals that correlate with dust optical depth, consistent with a fraction (~30%) of Halpha having been scattered by high-latitude dust. We highlight a number of diffuse spinning dust morphological features at high latitude. There is substantial spatial variation in the spinning dust spectrum, with the emission peak ranging from below 20GHz to more than 50GHz. There is a strong tendency for the spinning dust component near many prominent HII regions to have a higher peak frequency, suggesting that this increase in peak frequency is associated with dust in the photodissociation regions around the nebulae. The emissivity of spinning dust in these diffuse regions is of the same order as previous detections in the literature. Over the entire sky, the commander solution finds more anomalous microwave emission than the WMAP component maps, at the expense of synchrotron and free-free emission. This can be explained by the difficulty in separating multiple broadband components with a limited number of frequency maps. Future surveys (5-20GHz), will greatly improve the separation by constraining the synchrotron spectrum. We combine Planck/WMAP data to make the highest S/N ratio maps yet of the intensity of the all-sky polarized synchrotron emission at frequencies above a few GHz. Most of the high-latitude polarized emission is associated with distinct large-scale loops and spurs, and we re-discuss their structure...

We present a proof-of-concept of a novel and fully Bayesian methodology designed to detect halos of different masses in cosmological observations subject to noise and systematic uncertainties. Our methodology combines the previously published Bayesian large-scale structure inference algorithm, HADES, and a Bayesian chain rule (the Blackwell-Rao Estimator), which we use to connect the inferred density field to the properties of dark matter halos. To demonstrate the capability of our approach we construct a realistic galaxy mock catalogue emulating the wide-area 6-degree Field Galaxy Survey, which has a median redshift of approximately 0.05. Application of HADES to the catalogue provides us with accurately inferred three-dimensional density fields and corresponding quantification of uncertainties inherent to any cosmological observation. We then use a cosmological simulation to relate the amplitude of the density field to the probability of detecting a halo with mass above a specified threshold. With this information we can sum over the HADES density field realisations to construct maps of detection probabilities and demonstrate the validity of this approach within our mock scenario. We find that the probability of successful of detection of halos in the mock catalogue increases as a function of the signal-to-noise of the local galaxy observations. Our proposed methodology can easily be extended to account for more complex scientific questions and is a promising novel tool to analyse the cosmic large-scale structure in observations.

Full-sky CMB maps from the 2015 Planck release allow us to detect departures from global isotropy on the largest scales. We present the first searches using CMB polarization for correlations induced by a non-trivial topology with a fundamental domain intersecting, or nearly intersecting, the last scattering surface (at comoving distance $\chi_{rec}$). We specialize to flat spaces with toroidal and slab topologies, finding that explicit searches for the latter are sensitive to other topologies with antipodal symmetry. These searches yield no detection of a compact topology at a scale below the diameter of the last scattering surface. The limits on the radius $R_i$ of the largest sphere inscribed in the topological domain (at log-likelihood-ratio $\Delta\ln{L}>-5$ relative to a simply-connected flat Planck best-fit model) are $R_i>0.97\chi_{rec}$ for the cubic torus and $R_i>0.56\chi_{rec}$ for the slab. The limit for the cubic torus from the matched-circles search is numerically equivalent, $R_i>0.97\chi_{rec}$ (99% CL) from polarisation data alone. We also perform a Bayesian search for a Bianchi VII$_h$ geometry. In the non-physical setting where the Bianchi cosmology is decoupled from the standard cosmology, Planck temperature data favour the inclusion of a Bianchi component. However, the cosmological parameters generating this pattern are in strong disagreement with those found from CMB anisotropy data alone. Fitting the induced polarization pattern for this model to Planck data requires an amplitude of $-0.1\pm0.04$ compared to +1 if the model were to be correct. In the physical setting where the Bianchi parameters are fit simultaneously with the standard cosmological parameters, we find no evidence for a Bianchi VII$_h$ cosmology and constrain the vorticity of such models to $(\omega/H)_0<7.6\times10^{-10}$ (95% CL). [Abridged]

This paper describes the identification, modelling, and removal of previously unexplained systematic effects in the polarization data of the Planck High Frequency Instrument (HFI) on large angular scales, including new mapmaking and calibration procedures, new and more complete end-to-end simulations, and a set of robust internal consistency checks on the resulting maps. These maps, at 100, 143, 217, and 353 GHz, are early versions of those that will be released in final form later in 2016. The improvements allow us to determine the cosmic reionization optical depth $\tau$ using, for the first time, the low-multipole $EE$ data from HFI, reducing significantly the central value and uncertainty, and hence the upper limit. Two different likelihood procedures are used to constrain $\tau$ from two estimators of the CMB $E$- and $B$-mode angular power spectra at 100 and 143 GHz, after debiasing the spectra from a small remaining systematic contamination. These all give fully consistent results. A further consistency test is performed using cross-correlations derived from the Low Frequency Instrument maps of the Planck 2015 data release and the new HFI data. For this purpose, end-to-end analyses of systematic effects from the two instruments are used to demonstrate the near independence of their dominant systematic error residuals. The tightest result comes from the HFI-based $\tau$ posterior distribution using the maximum likelihood power spectrum estimator from $EE$ data only, giving a value $0.055\pm 0.009$. In a companion paper these results are discussed in the context of the best-fit Planck $\Lambda$CDM cosmological model and recent models of reionization.

Recent models for the large-scale Galactic magnetic fields in the literature have been largely constrained by synchrotron emission and Faraday rotation measures. We use three different but representative models to compare their predicted polarized synchrotron and dust emission with that measured by the Planck satellite. We first update these models to match the Planck synchrotron products using a common model for the cosmic-ray leptons. We discuss the impact on this analysis of the ongoing problems of component separation in the Planck microwave bands and of the uncertain cosmic-ray spectrum. In particular, the inferred degree of ordering in the magnetic fields is sensitive to these systematic uncertainties, and we further show the importance of considering the expected variations in the observables in addition to their mean morphology. We then compare the resulting simulated emission to the observed dust polarization and find that the dust predictions do not match the morphology in the Planck data but underpredict the dust polarization away from the plane. We modify one of the models to roughly match both observables at high latitudes by increasing the field ordering in the thin disc near the observer. Though this specific analysis is dependent on the component separation issues, we present the improved model as a proof of concept for how these studies can be advanced in future using complementary information from ongoing and planned observational projects.

We study the implications of Planck data for models of dark energy (DE) and modified gravity (MG), beyond the cosmological constant scenario. We start with cases where the DE only directly affects the background evolution, considering Taylor expansions of the equation of state, principal component analysis and parameterizations related to the potential of a minimally coupled DE scalar field. When estimating the density of DE at early times, we significantly improve present constraints. We then move to general parameterizations of the DE or MG perturbations that encompass both effective field theories and the phenomenology of gravitational potentials in MG models. Lastly, we test a range of specific models, such as k-essence, f(R) theories and coupled DE. In addition to the latest Planck data, for our main analyses we use baryonic acoustic oscillations, type-Ia supernovae and local measurements of the Hubble constant. We further show the impact of measurements of the cosmological perturbations, such as redshift-space distortions and weak gravitational lensing. These additional probes are important tools for testing MG models and for breaking degeneracies that are still present in the combination of Planck and background data sets. All results that include only background parameterizations are in agreement with LCDM. When testing models that also change perturbations (even when the background is fixed to LCDM), some tensions appear in a few scenarios: the maximum one found is \sim 2 sigma for Planck TT+lowP when parameterizing observables related to the gravitational potentials with a chosen time dependence; the tension increases to at most 3 sigma when external data sets are included. It however disappears when including CMB lensing.