Searches for the imprint of primordial gravitational waves in degree-scale CMB $B$-mode polarisation data must account for significant contamination from gravitational lensing. Fortunately, the lensing effects can be partially removed by combining high-resolution $E$-mode measurements with an estimate of the projected matter distribution. In the near future, experimental characteristics will be such that the latter can be reconstructed internally with high fidelity from the observed CMB, with the $EB$ quadratic estimator providing a large fraction of the signal-to-noise. It is a well-known phenomenon in this context that any overlap in modes between the $B$-field to be delensed and the $B$-field from which the reconstruction is derived leads to a suppression of delensed power going beyond that which can be attributed to a mitigation of the lensing effects. More importantly, the variance associated with this spectrum is also reduced, posing the question of whether the additional power suppression could help better constrain the tensor-to-scalar ratio, $r$. In this paper, we show this is not the case, as suggested but not quantified in previous work. We develop an analytic model for the biased delensed $B$-mode angular power spectrum, which suggests a simple renormalisation prescription to avoid bias on the inferred tensor-to-scalar ratio. With this approach, we learn that the bias necessarily leads to a degradation of the signal-to-noise on a primordial component compared to "unbiased delensing". Next, we assess the impact of removing from the lensing reconstruction any overlapping $B$-modes on our ability to constrain $r$, showing that it is in general advantageous to do this rather than modeling or renormalising the bias. Finally, we verify these results within a maximum-likelihood inference framework applied to simulations.

Using only cosmic microwave background polarization data from the POLARBEAR experiment, we measure $B$-mode polarization delensing on subdegree scales at more than $5\sigma$ significance. We achieve a 14% $B$-mode power variance reduction, the highest to date for internal delensing, and improve this result to 2% by applying for the first time an iterative maximum a posteriori delensing method. Our analysis demonstrates the capability of internal delensing as a means of improving constraints on inflationary models, paving the way for the optimal analysis of next-generation primordial $B$-mode experiments.

We present a measurement of the gravitational lensing deflection power spectrum reconstructed with two seasons cosmic microwave background polarization data from the POLARBEAR experiment. Observations were taken at 150 GHz from 2012 to 2014 which survey three patches of sky totaling 30 square degrees. We test the consistency of the lensing spectrum with a Cold Dark Matter (CDM) cosmology and reject the no-lensing hypothesis at a confidence of 10.9 sigma including statistical and systematic uncertainties. We observe a value of A_L = 1.33 +/- 0.32 (statistical) +/- 0.02 (systematic) +/- 0.07 (foreground) using all polarization lensing estimators, which corresponds to a 24% accurate measurement of the lensing amplitude. Compared to the analysis of the first year data, we have improved the breadth of both the suite of null tests and the error terms included in the estimation of systematic contamination.

The European Space Agency's Planck satellite, which was dedicated to studying the early Universe and its subsequent evolution, was launched on 14 May 2009. It scanned the microwave and submillimetre sky continuously between 12 August 2009 and 23 October 2013, producing deep, high-resolution, all-sky maps in nine frequency bands from 30 to 857GHz. This paper presents the cosmological legacy of Planck, which currently provides our strongest constraints on the parameters of the standard cosmological model and some of the tightest limits available on deviations from that model. The 6-parameter LCDM model continues to provide an excellent fit to the cosmic microwave background data at high and low redshift, describing the cosmological information in over a billion map pixels with just six parameters. With 18 peaks in the temperature and polarization angular power spectra constrained well, Planck measures five of the six parameters to better than 1% (simultaneously), with the best-determined parameter (theta_*) now known to 0.03%. We describe the multi-component sky as seen by Planck, the success of the LCDM model, and the connection to lower-redshift probes of structure formation. We also give a comprehensive summary of the major changes introduced in this 2018 release. The Planck data, alone and in combination with other probes, provide stringent constraints on our models of the early Universe and the large-scale structure within which all astrophysical objects form and evolve. We discuss some lessons learned from the Planck mission, and highlight areas ripe for further experimental advances.

We report a 4.8$\sigma$ measurement of the cross-correlation signal between the cosmic microwave background (CMB) lensing convergence reconstructed from measurements of the CMB polarization made by the POLARBEAR experiment and the infrared-selected galaxies of the Herschel-ATLAS survey. This is the first measurement of its kind. We infer a best-fit galaxy bias of $b = 5.76 \pm 1.25$, corresponding to a host halo mass of $\log_{10}(M_h/M_\odot) =13.5^{+0.2}_{-0.3}$ at an effective redshift of $z \sim 2$ from the cross-correlation power spectrum. Residual uncertainties in the redshift distribution of the sub-mm galaxies are subdominant with respect to the statistical precision. We perform a suite of systematic tests, finding that instrumental and astrophysical contaminations are small compared to the statistical error. This cross-correlation measurement only relies on CMB polarization information that, differently from CMB temperature maps, is less contaminated by galactic and extra-galactic foregrounds, providing a clearer view of the projected matter distribution. This result demonstrates the feasibility and robustness of this approach for future high-sensitivity CMB polarization experiments.

We present a measurement of the $B$-mode polarization power spectrum of the cosmic microwave background (CMB) using taken from July 2014 to December 2016 with the POLARBEAR experiment. The CMB power spectra are measured using observations at 150 GHz with an instantaneous array sensitivity of $\mathrm{NET}_\mathrm{array}=23\, \mu \mathrm{K} \sqrt{\mathrm{s}}$ on a 670 square degree patch of sky centered at (RA, Dec)=($+0^\mathrm{h}12^\mathrm{m}0^\mathrm{s},-59^\circ18^\prime$). A continuously rotating half-wave plate is used to modulate polarization and to suppress low-frequency noise. We achieve $32\,\mu\mathrm{K}$-$\mathrm{arcmin}$ effective polarization map noise with a knee in sensitivity of $\ell = 90$, where the inflationary gravitational wave signal is expected to peak. The measured $B$-mode power spectrum is consistent with a $\Lambda$CDM lensing and single dust component foreground model over a range of multipoles $50 \leq \ell \leq 600$. The data disfavor zero $C_\ell^{BB}$ at $2.2\sigma$ using this $\ell$ range of POLARBEAR data alone. We cross-correlate our data with Planck high frequency maps and find the low-$\ell$ $B$-mode power in the combined dataset to be consistent with thermal dust emission. We place an upper limit on the tensor-to-scalar ratio $r < 0.90$ at 95% confidence level after marginalizing over foregrounds.

We present cosmological parameter results from the final full-mission Planck measurements of the CMB anisotropies. We find good consistency with the standard spatially-flat 6-parameter $\Lambda$CDM cosmology having a power-law spectrum of adiabatic scalar perturbations (denoted "base $\Lambda$CDM" in this paper), from polarization, temperature, and lensing, separately and in combination. A combined analysis gives dark matter density $\Omega_c h^2 = 0.120\pm 0.001$, baryon density $\Omega_b h^2 = 0.0224\pm 0.0001$, scalar spectral index $n_s = 0.965\pm 0.004$, and optical depth $\tau = 0.054\pm 0.007$ (in this abstract we quote $68\,\%$ confidence regions on measured parameters and $95\,\%$ on upper limits). The angular acoustic scale is measured to $0.03\,\%$ precision, with $100\theta_*=1.0411\pm 0.0003$. These results are only weakly dependent on the cosmological model and remain stable, with somewhat increased errors, in many commonly considered extensions. Assuming the base-$\Lambda$CDM cosmology, the inferred late-Universe parameters are: Hubble constant $H_0 = (67.4\pm 0.5)$km/s/Mpc; matter density parameter $\Omega_m = 0.315\pm 0.007$; and matter fluctuation amplitude $\sigma_8 = 0.811\pm 0.006$. We find no compelling evidence for extensions to the base-$\Lambda$CDM model. Combining with BAO we constrain the effective extra relativistic degrees of freedom to be $N_{\rm eff} = 2.99\pm 0.17$, and the neutrino mass is tightly constrained to $\sum m_\nu< 0.12$eV. The CMB spectra continue to prefer higher lensing amplitudes than predicted in base -$\Lambda$CDM at over $2\,\sigma$, which pulls some parameters that affect the lensing amplitude away from the base-$\Lambda$CDM model; however, this is not supported by the lensing reconstruction or (in models that also change the background geometry) BAO data. (Abridged)

Upcoming ground-based cosmic microwave background experiments will provide CMB maps with high sensitivity and resolution that can be used for high fidelity lensing reconstruction. However, the sky coverage will be incomplete and the noise highly anisotropic, so optimized estimators are required to extract the most information from the maps. We focus on quadratic-estimator based lensing reconstruction methods that are fast to implement, and compare new more-optimally filtered estimators with various estimators that have previously been used in the literature. Input CMB maps can be optimally inverse-signal-plus-noise filtered using conjugate gradient (or other) techniques to account for the noise anisotropy. However, lensing reconstructions from these filtered input maps have an anisotropic response to the lensing signal and are difficult to interpret directly. We describe a second-stage filtering of the lensing maps and analytic response model that can be used to construct lensing power spectrum estimates that account for the anisotropic response and noise inhomogeneity in an approximately optimal way while remaining fast to compute. We compare results for simulations of upcoming Simons Observatory and CMB Stage-4 experiments to show the robustness of the more optimal lensing reconstruction pipeline and quantify the improvement compared to less optimal estimators. We find a substantial improvement in reconstructed lensing power variance between optimal anisotropic and isotropic filtering of CMB maps, and up to 30% improvement in variance by using the additional filtering step on the reconstruction potential map. Our approximate analytic response model is unbiased to within a small percent-level additional Monte Carlo correction.

This document supplements the release of the Planck 2018 CMB lensing pipeline, now made publicly available. It collects calculations relevant to curved-sky separable quadratic estimators in the spin-weight, position-space correlation function formalism, including analytic calculations of estimator responses and Gaussian noise biases between arbitrary pairs of quadratic estimators. It also contains the derivation of optimal, joint gradient and curl mode quadratic estimators for parametrized anisotropy of arbitrary spin.

We report on the implications for cosmic inflation of the 2018 Release of the Planck CMB anisotropy measurements. The results are fully consistent with the two previous Planck cosmological releases, but have smaller uncertainties thanks to improvements in the characterization of polarization at low and high multipoles. Planck temperature, polarization, and lensing data determine the spectral index of scalar perturbations to be $n_\mathrm{s}=0.9649\pm 0.0042$ at 68% CL and show no evidence for a scale dependence of $n_\mathrm{s}.$ Spatial flatness is confirmed at a precision of 0.4% at 95% CL with the combination with BAO data. The Planck 95% CL upper limit on the tensor-to-scalar ratio, $r_{0.002}<0.10$, is further tightened by combining with the BICEP2/Keck Array BK15 data to obtain $r_{0.002}<0.056$. In the framework of single-field inflationary models with Einstein gravity, these results imply that: (a) slow-roll models with a concave potential, $V" (\phi) < 0,$ are increasingly favoured by the data; and (b) two different methods for reconstructing the inflaton potential find no evidence for dynamics beyond slow roll. Non-parametric reconstructions of the primordial power spectrum consistently confirm a pure power law. A complementary analysis also finds no evidence for theoretically motivated parameterized features in the Planck power spectrum, a result further strengthened for certain oscillatory models by a new combined analysis that includes Planck bispectrum data. The new Planck polarization data provide a stringent test of the adiabaticity of the initial conditions. The polarization data also provide improved constraints on inflationary models that predict a small statistically anisotropic quadrupolar modulation of the primordial fluctuations. However, the polarization data do not confirm physical models for a scale-dependent dipolar modulation.

We provide an overview of the science case, instrument configuration and project plan for the next-generation ground-based cosmic microwave background experiment CMB-S4, for consideration by the 2020 Decadal Survey.

This paper describes the 2018 Planck CMB likelihoods, following a hybrid approach similar to the 2015 one, with different approximations at low and high multipoles, and implementing several methodological and analysis refinements. With more realistic simulations, and better correction and modelling of systematics, we can now make full use of the High Frequency Instrument polarization data. The low-multipole 100x143 GHz EE cross-spectrum constrains the reionization optical-depth parameter $\tau$ to better than 15% (in combination with with the other low- and high-$\ell$ likelihoods). We also update the 2015 baseline low-$\ell$ joint TEB likelihood based on the Low Frequency Instrument data, which provides a weaker $\tau$ constraint. At high multipoles, a better model of the temperature-to-polarization leakage and corrections for the effective calibrations of the polarization channels (polarization efficiency or PE) allow us to fully use the polarization spectra, improving the constraints on the $\Lambda$CDM parameters by 20 to 30% compared to TT-only constraints. Tests on the modelling of the polarization demonstrate good consistency, with some residual modelling uncertainties, the accuracy of the PE modelling being the main limitation. Using our various tests, simulations, and comparison between different high-$\ell$ implementations, we estimate the consistency of the results to be better than the 0.5$\sigma$ level. Minor curiosities already present before (differences between $\ell$<800 and $\ell$>800 parameters or the preference for more smoothing of the $C_\ell$ peaks) are shown to be driven by the TT power spectrum and are not significantly modified by the inclusion of polarization. Overall, the legacy Planck CMB likelihoods provide a robust tool for constraining the cosmological model and represent a reference for future CMB observations. (Abridged)

We present measurements of the cosmic microwave background (CMB) lensing potential using the final $\textit{Planck}$ 2018 temperature and polarization data. We increase the significance of the detection of lensing in the polarization maps from $5\,\sigma$ to $9\,\sigma$. Combined with temperature, lensing is detected at $40\,\sigma$. We present an extensive set of tests of the robustness of the lensing-potential power spectrum, and construct a minimum-variance estimator likelihood over lensing multipoles $8 \le L \le 400$. We find good consistency between lensing constraints and the results from the $\textit{Planck}$ CMB power spectra within the $\rm{\Lambda CDM}$ model. Combined with baryon density and other weak priors, the lensing analysis alone constrains $\sigma_8 \Omega_{\rm m}^{0.25}=0.589\pm 0.020$ ($1\,\sigma$ errors). Also combining with baryon acoustic oscillation (BAO) data, we find tight individual parameter constraints, $\sigma_8=0.811\pm0.019$, $H_0=67.9_{-1.3}^{+1.2}\,\text{km}\,\text{s}^{-1}\,\rm{Mpc}^{-1}$, and $\Omega_{\rm m}=0.303^{+0.016}_{-0.018}$. Combining with $\textit{Planck}$ CMB power spectrum data, we measure $\sigma_8$ to better than $1\,\%$ precision, finding $\sigma_8=0.811\pm 0.006$. We find consistency with the lensing results from the Dark Energy Survey, and give combined lensing-only parameter constraints that are tighter than joint results using galaxy clustering. Using $\textit{Planck}$ cosmic infrared background (CIB) maps we make a combined estimate of the lensing potential over $60\,\%$ of the sky with considerably more small-scale signal. We demonstrate delensing of the $\textit{Planck}$ power spectra, detecting a maximum removal of $40\,\%$ of the lensing-induced power in all spectra. The improvement in the sharpening of the acoustic peaks by including both CIB and the quadratic lensing reconstruction is detected at high significance (abridged).

The Simons Observatory (SO) is a ground-based cosmic microwave background (CMB) experiment sited on Cerro Toco in the Atacama Desert in Chile that promises to provide breakthrough discoveries in fundamental physics, cosmology, and astrophysics. Supported by the Simons Foundation, the Heising-Simons Foundation, and with contributions from collaborating institutions, SO will see first light in 2021 and start a five year survey in 2022. SO has 287 collaborators from 12 countries and 53 institutions, including 85 students and 90 postdocs. The SO experiment in its currently funded form ('SO-Nominal') consists of three 0.4 m Small Aperture Telescopes (SATs) and one 6 m Large Aperture Telescope (LAT). Optimized for minimizing systematic errors in polarization measurements at large angular scales, the SATs will perform a deep, degree-scale survey of 10% of the sky to search for the signature of primordial gravitational waves. The LAT will survey 40% of the sky with arc-minute resolution. These observations will measure (or limit) the sum of neutrino masses, search for light relics, measure the early behavior of Dark Energy, and refine our understanding of the intergalactic medium, clusters and the role of feedback in galaxy formation. With up to ten times the sensitivity and five times the angular resolution of the Planck satellite, and roughly an order of magnitude increase in mapping speed over currently operating ("Stage 3") experiments, SO will measure the CMB temperature and polarization fluctuations to exquisite precision in six frequency bands from 27 to 280 GHz. SO will rapidly advance CMB science while informing the design of future observatories such as CMB-S4.

We present the science case, reference design, and project plan for the Stage-4 ground-based cosmic microwave background experiment CMB-S4.

We present 353 GHz full-sky maps of the polarization fraction $p$, angle $\psi$, and dispersion of angles $S$ of Galactic dust thermal emission produced from the 2018 release of Planck data. We confirm that the mean and maximum of $p$ decrease with increasing $N_H$. The uncertainty on the maximum polarization fraction, $p_\mathrm{max}=22.0$% at 80 arcmin resolution, is dominated by the uncertainty on the zero level in total intensity. The observed inverse behaviour between $p$ and $S$ is interpreted with models of the polarized sky that include effects from only the topology of the turbulent Galactic magnetic field. Thus, the statistical properties of $p$, $\psi$, and $S$ mostly reflect the structure of the magnetic field. Nevertheless, we search for potential signatures of varying grain alignment and dust properties. First, we analyse the product map $S \times p$, looking for residual trends. While $p$ decreases by a factor of 3--4 between $N_H=10^{20}$ cm$^{-2}$ and $N_H=2\times 10^{22}$ cm$^{-2}$, $S \times p$ decreases by only about 25%, a systematic trend observed in both the diffuse ISM and molecular clouds. Second, we find no systematic trend of $S \times p$ with the dust temperature, even though in the diffuse ISM lines of sight with high $p$ and low $S$ tend to have colder dust. We also compare Planck data with starlight polarization in the visible at high latitudes. The agreement in polarization angles is remarkable. Two polarization emission-to-extinction ratios that characterize dust optical properties depend only weakly on $N_H$ and converge towards the values previously determined for translucent lines of sight. We determine an upper limit for the polarization fraction in extinction of 13%, compatible with the $p_\mathrm{max}$ observed in emission. These results provide strong constraints for models of Galactic dust in diffuse gas.

The Simons Observatory (SO) is a new cosmic microwave background experiment being built on Cerro Toco in Chile, due to begin observations in the early 2020s. We describe the scientific goals of the experiment, motivate the design, and forecast its performance. SO will measure the temperature and polarization anisotropy of the cosmic microwave background in six frequency bands: 27, 39, 93, 145, 225 and 280 GHz. The initial configuration of SO will have three small-aperture 0.5-m telescopes (SATs) and one large-aperture 6-m telescope (LAT), with a total of 60,000 cryogenic bolometers. Our key science goals are to characterize the primordial perturbations, measure the number of relativistic species and the mass of neutrinos, test for deviations from a cosmological constant, improve our understanding of galaxy evolution, and constrain the duration of reionization. The SATs will target the largest angular scales observable from Chile, mapping ~10% of the sky to a white noise level of 2 $\mu$K-arcmin in combined 93 and 145 GHz bands, to measure the primordial tensor-to-scalar ratio, $r$, at a target level of $\sigma(r)=0.003$. The LAT will map ~40% of the sky at arcminute angular resolution to an expected white noise level of 6 $\mu$K-arcmin in combined 93 and 145 GHz bands, overlapping with the majority of the LSST sky region and partially with DESI. With up to an order of magnitude lower polarization noise than maps from the Planck satellite, the high-resolution sky maps will constrain cosmological parameters derived from the damping tail, gravitational lensing of the microwave background, the primordial bispectrum, and the thermal and kinematic Sunyaev-Zel'dovich effects, and will aid in delensing the large-angle polarization signal to measure the tensor-to-scalar ratio. The survey will also provide a legacy catalog of 16,000 galaxy clusters and more than 20,000 extragalactic sources.

Gravitational lensing of the CMB is a valuable cosmological signal that correlates to tracers of large-scale structure and acts as a important source of confusion for primordial $B$-mode polarization. State-of-the-art lensing reconstruction analyses use quadratic estimators, which are easily applicable to data. However, these estimators are known to be suboptimal, in particular for polarization, and large improvements are expected to be possible for high signal-to-noise polarization experiments. We develop a method and numerical code, $\rm{LensIt}$, that is able to find efficiently the most probable lensing map, introducing no significant approximations to the lensed CMB likelihood, and applicable to beamed and masked data with inhomogeneous noise. It works by iteratively reconstructing the primordial unlensed CMB using a deflection estimate and its inverse, and removing residual lensing from these maps with quadratic estimator techniques. Roughly linear computational cost is maintained due to fast convergence of iterative searches, combined with the local nature of lensing. The method achieves the maximal improvement in signal to noise expected from analytical considerations on the unmasked parts of the sky. Delensing with this optimal map leads to forecast tensor-to-scalar ratio parameter errors improved by a factor $\simeq 2 $ compared to the quadratic estimator in a CMB stage IV configuration.

We demonstrate how to obtain optimal constraints on a primordial gravitational wave component in lensed Cosmic Microwave Background (CMB) data under ideal conditions. We first derive an estimator of the tensor-to-scalar ratio, $r$, by using an error-controlled close approximation to the exact posterior, under the assumption of Gaussian primordial CMB and lensing deflection potential. This combines fast internal iterative lensing reconstruction with optimal recovery of the unlensed CMB. We evaluate its performance on simulated low-noise polarization data targeted at the recombination peak. We carefully demonstrate our $r$-posterior estimate is optimal and shows no significant bias, making it the most powerful estimator of primordial gravitational waves from the CMB. We compare these constraints to those obtained from $B$-mode band-power likelihood analyses on the same simulated data, before and after map-level quadratic estimator delensing, and iterative delensing. Internally, iteratively delensed band powers are only slightly less powerful on average (by less than 10\%), promising close-to-optimal constraints from a stage IV CMB experiment.

The study of polarized dust emission has become entwined with the analysis of the cosmic microwave background (CMB) polarization. We use new Planck maps to characterize Galactic dust emission as a foreground to the CMB polarization. We present Planck EE, BB, and TE power spectra of dust polarization at 353 GHz for six nested sky regions covering from 24 to 71 % of the sky. We present power-law fits to the angular power spectra, yielding evidence for statistically significant variations of the exponents over sky regions and a difference between the values for the EE and BB spectra. The TE correlation and E/B power asymmetry extend to low multipoles that were not included in earlier Planck polarization papers. We also report evidence for a positive TB dust signal. Combining data from Planck and WMAP, we determine the amplitudes and spectral energy distributions (SEDs) of polarized foregrounds, including the correlation between dust and synchrotron polarized emission, for the six sky regions as a function of multipole. This quantifies the challenge of the component separation procedure required for detecting the reionization and recombination peaks of primordial CMB B modes. The SED of polarized dust emission is fit well by a single-temperature modified blackbody emission law from 353 GHz to below 70 GHz. For a dust temperature of 19.6 K, the mean spectral index for dust polarization is $\beta_{\rm d}^{P} = 1.53\pm0.02 $. By fitting multi-frequency cross-spectra, we examine the correlation of the dust polarization maps across frequency. We find no evidence for decorrelation. If the Planck limit for the largest sky region applies to the smaller sky regions observed by sub-orbital experiments, then decorrelation might not be a problem for CMB experiments aiming at a primordial B-mode detection limit on the tensor-to-scalar ratio $r\simeq0.01$ at the recombination peak.

This paper presents the Planck Multi-frequency Catalogue of Non-thermal (i.e. synchrotron-dominated) Sources (PCNT) observed between 30 and 857 GHz by the ESA Planck mission. This catalogue was constructed by selecting objects detected in the full mission all-sky temperature maps at 30 and 143 GHz, with a signal-to-noise ratio (S/N)>3 in at least one of the two channels after filtering with a particular Mexican hat wavelet. As a result, 29400 source candidates were selected. Then, a multi-frequency analysis was performed using the Matrix Filters methodology at the position of these objects, and flux densities and errors were calculated for all of them in the nine Planck channels. The present catalogue is the first unbiased, full-sky catalogue of synchrotron-dominated sources published at millimetre and submillimetre wavelengths and constitutes a powerful database for statistical studies of non-thermal extragalactic sources, whose emission is dominated by the central active galactic nucleus. Together with the full multi-frequency catalogue, we also define the Bright Planck Multi-frequency Catalogue of Non-thermal Sources PCNTb, where only those objects with a S/N>4 at both 30 and 143 GHz were selected. In this catalogue 1146 compact sources are detected outside the adopted Planck GAL070 mask; thus, these sources constitute a highly reliable sample of extragalactic radio sources. We also flag the high-significance subsample PCNThs, a subset of 151 sources that are detected with S/N>4 in all nine Planck channels, 75 of which are found outside the Planck mask adopted here. The remaining 76 sources inside the Galactic mask are very likely Galactic objects.

Using the ${\it Planck}$ full-mission data, we present a detection of the temperature (and therefore velocity) dispersion due to the kinetic Sunyaev-Zeldovich (kSZ) effect from clusters of galaxies. To suppress the primary CMB and instrumental noise we derive a matched filter and then convolve it with the ${\it Planck}$ foreground-cleaned `${\tt 2D-ILC\,}$' maps. By using the Meta Catalogue of X-ray detected Clusters of galaxies (MCXC), we determine the normalized ${\it rms}$ dispersion of the temperature fluctuations at the positions of clusters, finding that this shows excess variance compared with the noise expectation. We then build an unbiased statistical estimator of the signal, determining that the normalized mean temperature dispersion of $1526$ clusters is $\langle \left(\Delta T/T \right)^{2} \rangle = (1.64 \pm 0.48) \times 10^{-11}$. However, comparison with analytic calculations and simulations suggest that around $0.7\,\sigma$ of this result is due to cluster lensing rather than the kSZ effect. By correcting this, the temperature dispersion is measured to be $\langle \left(\Delta T/T \right)^{2} \rangle = (1.35 \pm 0.48) \times 10^{-11}$, which gives a detection at the $2.8\,\sigma$ level. We further convert uniform-weight temperature dispersion into a measurement of the line-of-sight velocity dispersion, by using estimates of the optical depth of each cluster (which introduces additional uncertainty into the estimate). We find that the velocity dispersion is $\langle v^{2} \rangle =(123\,000 \pm 71\,000)\,({\rm km}\,{\rm s}^{-1})^{2}$, which is consistent with findings from other large-scale structure studies, and provides direct evidence of statistical homogeneity on scales of $600\,h^{-1}{\rm Mpc}$. Our study shows the promise of using cross-correlations of the kSZ effect with large-scale structure in order to constrain the growth of structure.

We present full-sky maps of the cosmic microwave background (CMB) and polarized synchrotron and thermal dust emission, derived from the third set of Planck frequency maps. These products have significantly lower contamination from instrumental systematic effects than previous versions. The methodologies used to derive these maps follow closely those described in earlier papers, adopting four methods (Commander, NILC, SEVEM, and SMICA) to extract the CMB component, as well as three methods (Commander, GNILC, and SMICA) to extract astrophysical components. Our revised CMB temperature maps agree with corresponding products in the Planck 2015 delivery, whereas the polarization maps exhibit significantly lower large-scale power, reflecting the improved data processing described in companion papers; however, the noise properties of the resulting data products are complicated, and the best available end-to-end simulations exhibit relative biases with respect to the data at the few percent level. Using these maps, we are for the first time able to fit the spectral index of thermal dust independently over 3 degree regions. We derive a conservative estimate of the mean spectral index of polarized thermal dust emission of beta_d = 1.55 +/- 0.05, where the uncertainty marginalizes both over all known systematic uncertainties and different estimation techniques. For polarized synchrotron emission, we find a mean spectral index of beta_s = -3.1 +/- 0.1, consistent with previously reported measurements. We note that the current data processing does not allow for construction of unbiased single-bolometer maps, and this limits our ability to extract CO emission and correlated components. The foreground results for intensity derived in this paper therefore do not supersede corresponding Planck 2015 products. For polarization the new results supersede the corresponding 2015 products in all respects.

This paper presents the High Frequency Instrument (HFI) data processing procedures for the Planck 2018 release. Major improvements in mapmaking have been achieved since the previous 2015 release. They enabled the first significant measurement of the reionization optical depth parameter using HFI data. This paper presents an extensive analysis of systematic effects, including the use of simulations to facilitate their removal and characterize the residuals. The polarized data, which presented a number of known problems in the 2015 Planck release, are very significantly improved. Calibration, based on the CMB dipole, is now extremely accurate and in the frequency range 100 to 353 GHz reduces intensity-to-polarization leakage caused by calibration mismatch. The Solar dipole direction has been determined in the three lowest HFI frequency channels to within one arc minute, and its amplitude has an absolute uncertainty smaller than $0.35\mu$K, an accuracy of order $10^{-4}$. This is a major legacy from the HFI for future CMB experiments. The removal of bandpass leakage has been improved by extracting the bandpass-mismatch coefficients for each detector as part of the mapmaking process; these values in turn improve the intensity maps. This is a major change in the philosophy of "frequency maps", which are now computed from single detector data, all adjusted to the same average bandpass response for the main foregrounds. Simulations reproduce very well the relative gain calibration of detectors, as well as drifts within a frequency induced by the residuals of the main systematic effect. Using these simulations, we measure and correct the small frequency calibration bias induced by this systematic effect at the $10^{-4}$ level. There is no detectable sign of a residual calibration bias between the first and second acoustic peaks in the CMB channels, at the $10^{-3}$ level.

Lensing of the CMB is now a well-developed probe of large-scale clustering over a broad range of redshifts. By exploiting the non-Gaussian imprints of lensing in the polarization of the CMB, the CORE mission can produce a clean map of the lensing deflections over nearly the full-sky. The number of high-S/N modes in this map will exceed current CMB lensing maps by a factor of 40, and the measurement will be sample-variance limited on all scales where linear theory is valid. Here, we summarise this mission product and discuss the science that it will enable. For example, the summed mass of neutrinos will be determined to an accuracy of 17 meV combining CORE lensing and CMB two-point information with contemporaneous BAO measurements, three times smaller than the minimum total mass allowed by neutrino oscillations. In the search for B-mode polarization from primordial gravitational waves with CORE, lens-induced B-modes will dominate over instrument noise, limiting constraints on the gravitational wave power spectrum amplitude. With lensing reconstructed by CORE, one can "delens" the observed polarization internally, reducing the lensing B-mode power by 60%. This improves to 70% by combining lensing and CIB measurements from CORE, reducing the error on the gravitational wave amplitude by 2.5 compared to no delensing (in the null hypothesis). Lensing measurements from CORE will allow calibration of the halo masses of the 40000 galaxy clusters that it will find, with constraints dominated by the clean polarization-based estimators. CORE can accurately remove Galactic emission from CMB maps with its 19 frequency channels. We present initial findings that show that residual Galactic foreground contamination will not be a significant source of bias for lensing power spectrum measurements with CORE. [abridged]

We present a first internal delensing of CMB maps, both in temperature and polarization, using the public foreground-cleaned (SMICA) Planck 2015 maps. After forming quadratic estimates of the lensing potential, we use the corresponding displacement field to undo the lensing on the same data. We build differences of the delensed spectra to the original data spectra specifically to look for delensing signatures. After taking into account reconstruction noise biases in the delensed spectra, we find an expected sharpening of the power spectrum acoustic peaks with a delensing efficiency of $29\,\%$ ($TT$) $25\,\%$ ($TE$) and $22\,\%$ ($EE$). The detection significance of the delensing effects is very high in all spectra: $12\,\sigma$ in $EE$ polarization; $18\,\sigma$ in $TE$; and $20\,\sigma$ in $TT$. The null hypothesis of no lensing in the maps is rejected at $26\,\sigma$. While direct detection of the power in lensing $B$-modes themselves is not possible at high significance at Planck noise levels, we do detect (at $4.5\,\sigma$ under the null hypothesis) delensing effects in the $B$-mode map, with $7\,\%$ reduction in lensing power. Our results provide a first demonstration of polarization delensing, and generally of internal CMB delensing, and stand in agreement with the baseline $\Lambda$CDM Planck 2015 cosmology expectations.

The cosmological dark matter field is not completely described by its hierarchy of $N$-point functions, a non-perturbative effect with the consequence that only part of the theory can be probed with the hierarchy. We give here an exact characterization of the joint information of the full set of $N$-point correlators of the lognormal field. The lognormal field is the archetypal example of a field where this effect occurs, and, at the same time, one of the few tractable and insightful available models to specify fully the statistical properties of the evolved matter density field beyond the perturbative regime. Nonlinear growth in the Universe in that model is set letting the log-density field probability density functional evolve keeping its Gaussian shape, according to the diffusion equation in Euclidean space. We show that the hierarchy probes a different evolution equation, the diffusion equation defined not in Euclidean space but on the compact torus, with uniformity as the long-term solution. The extraction of the hierarchy of correlators can be recast in the form of a nonlinear transformation applied to the field, 'wrapping', undergoing a sharp transition towards complete disorder in the deeply nonlinear regime, where all memory of the initial conditions is lost.

CMB and lensing reconstruction power spectra are powerful probes of cosmology. However they are correlated, since the CMB power spectra are lensed and the lensing reconstruction is constructed using CMB multipoles. We perform a full analysis of the auto- and cross-covariances, including polarization power spectra and minimum variance lensing estimators, and compare with simulations of idealized future CMB-S4 observations. Covariances sourced by fluctuations in the unlensed CMB and instrumental noise can largely be removed by using a realization-dependent subtraction of lensing reconstruction noise, leaving a relatively simple covariance model that is dominated by lensing-induced terms and well described by a small number of principal components. The correlations between the CMB and lensing power spectra will be detectable at the level of $\sim 5\sigma$ for a CMB-S4 mission, and neglecting those could underestimate some parameter error bars by several tens of percent. However we found that the inclusion of external priors or data sets to estimate parameter error bars can make the impact of the correlations almost negligible.

Measurements of flux density are described for five planets, Mars, Jupiter, Saturn, Uranus, and Neptune, across the six Planck High Frequency Instrument frequency bands (100-857 GHz) and these are then compared with models and existing data. In our analysis, we have also included estimates of the brightness of Jupiter and Saturn at the three frequencies of the Planck Low Frequency Instrument (30, 44, and 70 GHz). The results provide constraints on the intrinsic brightness and the brightness time-variability of these planets. The majority of the planet flux density estimates are limited by systematic errors, but still yield better than 1% measurements in many cases. Applying data from Planck HFI, the Wilkinson Microwave Anisotropy Probe (WMAP), and the Atacama Cosmology Telescope (ACT) to a model that incorporates contributions from Saturn's rings to the planet's total flux density suggests a best fit value for the spectral index of Saturn's ring system of $\beta _\mathrm{ring} = 2.30\pm0.03$ over the 30-1000 GHz frequency range. The average ratio between the Planck-HFI measurements and the adopted model predictions for all five planets (excluding Jupiter observations for 353 GHz) is 0.997, 0.997, 1.018, and 1.032 for 100, 143, 217, and 353 GHz, respectively. Model predictions for planet thermodynamic temperatures are therefore consistent with the absolute calibration of Planck-HFI detectors at about the three-percent-level. We compare our measurements with published results from recent cosmic microwave background experiments. In particular, we observe that the flux densities measured by Planck HFI and WMAP agree to within 2%. These results allow experiments operating in the mm-wavelength range to cross-calibrate against Planck and improve models of radiative transport used in planetary science.

We investigate constraints on cosmic reionization extracted from the Planck cosmic microwave background (CMB) data. We combine the Planck CMB anisotropy data in temperature with the low-multipole polarization data to fit LCDM models with various parameterizations of the reionization history. We obtain a Thomson optical depth tau=0.058 +/- 0.012 for the commonly adopted instantaneous reionization model. This confirms, with only data from CMB anisotropies, the low value suggested by combining Planck 2015 results with other data sets and also reduces the uncertainties. We reconstruct the history of the ionization fraction using either a symmetric or an asymmetric model for the transition between the neutral and ionized phases. To determine better constraints on the duration of the reionization process, we also make use of measurements of the amplitude of the kinetic Sunyaev-Zeldovich (kSZ) effect using additional information from the high resolution Atacama Cosmology Telescope and South Pole Telescope experiments. The average redshift at which reionization occurs is found to lie between z=7.8 and 8.8, depending on the model of reionization adopted. Using kSZ constraints and a redshift-symmetric reionization model, we find an upper limit to the width of the reionization period of Dz < 2.8. In all cases, we find that the Universe is ionized at less than the 10% level at redshifts above z~10. This suggests that an early onset of reionization is strongly disfavoured by the Planck data. We show that this result also reduces the tension between CMB-based analyses and constraints from other astrophysical sources.

Using the Planck 2015 data release (PR2) temperature maps, we separate Galactic thermal dust emission from cosmic infrared background (CIB) anisotropies. For this purpose, we implement a specifically tailored component-separation method, the so-called generalized needlet internal linear combination (GNILC) method, which uses spatial information (the angular power spectra) to disentangle the Galactic dust emission and CIB anisotropies. We produce significantly improved all-sky maps of Planck thermal dust emission, with reduced CIB contamination, at 353, 545, and 857 GHz. By reducing the CIB contamination of the thermal dust maps, we provide more accurate estimates of the local dust temperature and dust spectral index over the sky with reduced dispersion, especially at high Galactic latitudes above $b = \pm 20{\deg}$. We find that the dust temperature is $T = (19.4 \pm 1.3)$ K and the dust spectral index is $\beta = 1.6 \pm 0.1$ averaged over the whole sky, while $T = (19.4 \pm 1.5)$ K and $\beta = 1.6 \pm 0.2$ on 21 % of the sky at high latitudes. Moreover, subtracting the new CIB-removed thermal dust maps from the CMB-removed Planck maps gives access to the CIB anisotropies over 60 % of the sky at Galactic latitudes $|b| > 20{\deg}$. Because they are a significant improvement over previous Planck products, the GNILC maps are recommended for thermal dust science. The new CIB maps can be regarded as indirect tracers of the dark matter and they are recommended for exploring cross-correlations with lensing and large-scale structure optical surveys. The reconstructed GNILC thermal dust and CIB maps are delivered as Planck products.

Parity violating extensions of the standard electromagnetic theory cause in vacuo rotation of the plane of polarization of propagating photons. This effect, also known as cosmic birefringence, impacts the cosmic microwave background (CMB) anisotropy angular power spectra, producing non-vanishing $T$--$B$ and $E$--$B$ correlations that are otherwise null when parity is a symmetry. Here we present new constraints on an isotropic rotation, parametrized by the angle $\alpha$, derived from Planck 2015 CMB polarization data. To increase the robustness of our analyses, we employ two complementary approaches, in harmonic space and in map space, the latter based on a peak stacking technique. The two approaches provide estimates for $\alpha$ that are in agreement within statistical uncertainties and very stable against several consistency tests. Considering the $T$--$B$ and $E$--$B$ information jointly, we find $\alpha = 0.31^{\circ} \pm 0.05^{\circ} \, ({\rm stat.})\, \pm 0.28^{\circ} \, ({\rm syst.})$ from the harmonic analysis and $\alpha = 0.35^{\circ} \pm 0.05^{\circ} \, ({\rm stat.})\, \pm 0.28^{\circ} \, ({\rm syst.})$ from the stacking approach. These constraints are compatible with no parity violation and are dominated by the systematic uncertainty in the orientation of Planck's polarization-sensitive bolometers.

This paper describes the identification, modelling, and removal of previously unexplained systematic effects in the polarization data of the Planck High Frequency Instrument (HFI) on large angular scales, including new mapmaking and calibration procedures, new and more complete end-to-end simulations, and a set of robust internal consistency checks on the resulting maps. These maps, at 100, 143, 217, and 353 GHz, are early versions of those that will be released in final form later in 2016. The improvements allow us to determine the cosmic reionization optical depth $\tau$ using, for the first time, the low-multipole $EE$ data from HFI, reducing significantly the central value and uncertainty, and hence the upper limit. Two different likelihood procedures are used to constrain $\tau$ from two estimators of the CMB $E$- and $B$-mode angular power spectra at 100 and 143 GHz, after debiasing the spectra from a small remaining systematic contamination. These all give fully consistent results. A further consistency test is performed using cross-correlations derived from the Low Frequency Instrument maps of the Planck 2015 data release and the new HFI data. For this purpose, end-to-end analyses of systematic effects from the two instruments are used to demonstrate the near independence of their dominant systematic error residuals. The tightest result comes from the HFI-based $\tau$ posterior distribution using the maximum likelihood power spectrum estimator from $EE$ data only, giving a value $0.055\pm 0.009$. In a companion paper these results are discussed in the context of the best-fit Planck $\Lambda$CDM cosmological model and recent models of reionization.

The primary science driver for 3D galaxy surveys is their potential to constrain cosmological parameters. Forecasts of these surveys' effectiveness typically assume Gaussian statistics for the underlying matter density, despite the fact that the actual distribution is decidedly non-Gaussian. To quantify the effect of this assumption, we employ an analytic expression for the power spectrum covariance matrix to calculate the Fisher information for BAO-type model surveys. We find that for typical number densities, at $k_\mathrm{max} = 0.5 h$ Mpc$^{-1}$, Gaussian assumptions significantly overestimate the information on all parameters considered, in some cases by up to an order of magnitude. However, after marginalizing over a six-parameter set, the form of the covariance matrix (dictated by $N$-body simulations) causes the majority of the effect to shift to the "amplitude-like" parameters, leaving the others virtually unaffected. We find that Gaussian assumptions at such wavenumbers can underestimate the dark energy parameter errors by well over 50 per cent, producing dark energy figures of merit almost 3 times too large. Thus, for 3D galaxy surveys probing the non-linear regime, proper consideration of non-Gaussian effects is essential.

We discuss an analytical approximation for the matter power spectrum covariance matrix and its inverse on translinear scales, $k \sim 0.1h - 0.8h/\textrm{Mpc}$ at $z = 0$. We proceed to give an analytical expression for the Fisher information matrix of the nonlinear density field spectrum, and derive implications for its cosmological information content. We find that the spectrum information is characterized by a pair of upper bounds, 'plateaux', caused by the trispectrum, and a 'knee' in the presence of white noise. The effective number of Fourier modes, normally growing as a power law, is bounded from above by these plateaux, explaining naturally earlier findings from $N$-body simulations. These plateaux limit best possible measurements of the nonlinear power at the percent level in a $h^{-3}\textrm{Gpc}^3$ volume; the extraction of model parameters from the spectrum is limited explicitly by their degeneracy to the nonlinear amplitude. The value of the first, super-survey (SS) plateau depends on the characteristic survey volume and the large scale power; the second, intra-survey (IS) plateau is set by the small scale power. While both have simple interpretations within the hierarchical \textit{Ansatz}, the SS plateau can be predicted and generalized to still smaller scales within Takada and Hu's spectrum response formalism. Finally, the noise knee is naturally set by the density of tracers.

We use the "Dark Energy and Massive Neutrino Universe" (DEMNUni) simulations to compare the constraining power of "sufficient statistics" with the standard matter power spectrum on the sum of neutrino masses, $M_\nu \equiv \sum m_\nu$. In general, the power spectrum, even supplemented with higher moments of the distribution, captures only a fraction of the available cosmological information due to correlations between the Fourier modes. In contrast, the non-linear transform of sufficient statistics, approximated by a logarithmic mapping A=ln(1+\delta), was designed to capture all the available cosmological information contained in the matter clustering; in this sense it is an optimal observable. Our analysis takes advantage of the recent analytical model developed by Carron et al. 2014 to estimate both the matter power spectrum and the A-power spectrum covariance matrices. Using a Fisher information approach, we find that using sufficient statistics increases up to 8 times the available information on the total neutrino mass at z=0, thus tightening the constraints by almost a factor of 3 compared to the matter power spectrum.

Beyond the linear regime of structure formation, part of cosmological information encoded in galaxy clustering becomes inaccessible to the usual power spectrum. "Sufficient statistics", A*, were introduced recently to recapture the lost, and ultimately extract all, cosmological information. We present analytical approximations for the A* and traditional power spectra as well as for their covariance matrices in order to calculate analytically their cosmological information content in the context of Fisher information theory. Our approach allows the precise quantitative comparison of the techniques with each other and to the total information in the data, and provides insights into sufficient statistics. In particular, we find that while the A* power spectrum has a similar shape to the usual galaxy power spectrum, its amplitude is strongly modulated by small scale statistics. This effect is mostly responsible for the ability of the A* power spectrum to recapture the information lost for the usual power spectrum. We use our framework to forecast the best achievable cosmological constraints for projected surveys as a function of their galaxy density, and compare the information content of the two power spectra. We find that sufficient statistics extract all cosmological information, resulting in an approximately factor of ~2 gain for dense projected surveys at low redshift. This increase in the effective volume of projected surveys is consistent with previous numerical calculations.

Owing to the mass-sheet degeneracy, cosmic shear maps do not probe directly the Fourier modes of the underlying mass distribution on scales comparable to the survey size and larger. To assess the corresponding effect on attainable cosmological parameter constraints, we quantify the information on super-survey modes in a lognormal model and, when interpreted as nuisance parameters, their degeneracies to cosmological parameters. Our analytical and numerical calculations clarify the central role of super-sample covariance (SSC) in shaping the statistical power of cosmological observables. Reconstructing the background modes from their non-Gaussian statistical dependence to small scales modes yields the renormalized convergence. This diagonalizes the spectrum covariance matrix, and the information content of the corresponding power spectrum is increased by a factor of two over standard methods. Unfortunately, careful calculation of the Cramer-Rao bound shows that the information recovery can never be made complete, any observable built from shear fields, including optimal sufficient statistics, are subject to severe information loss, typically $80\%$ to $90\%$ below $\ell \sim 3000$ for generic cosmological parameters. The lost information can only be recovered from additional, non-shear based data. Our predictions hold just as well for a tomographic analysis, and/or full sky surveys.

Beyond the linear regime, Fourier modes of cosmological random fields become correlated, and the power spectrum of density fluctuations contains only a fraction of the available cosmological information. To unveil this formerly hidden information, the A* non-linear transform was introduced; it is optimized both for the nonlinearities induced by gravity and observational noise. Quantifying the resulting increase of our knowledge of cosmological parameters, we forecast the constraints from the angular power spectrum and that of A* from l ~ 200 to 3000 for upcoming galaxy surveys such as: the Wide-Field Infrared Survey Telescope (WFIRST), the Large Synoptic Survey Telescope (LSST), Euclid, the Hyper Suprime-Cam (HSC) and the Dark Energy Survey (DES). We find that at low redshifts this new data analysis strategy can double the extracted information, effectively doubling the survey area. To test the accuracy of our forecasting and the power of our data analysis methods, we apply the A* transformation to the latest release of the Canada-France-Hawaii-Telescope Legacy Survey (CFHTLS) Wide. While this data set is too sparse to allow for more than modest gains (~1.1-1.2), the realized gain from our method is in excellent agreement with our forecast, thus verifying the robustness of our analysis and prediction pipelines.

The statistical translation invariance of cosmological random fields is broken by a finite survey boundary, correlating the observable Fourier modes. Standard methods for generating Gaussian fields either neglect these correlations, or are costly, or both. Here we report on a fast and exact simulation method applicable to a wide class of two-point statistics that requires the simulation of a periodic grid of only twice the survey side with fast Fourier transforms. Super-survey modes, dominating the covariance of power spectra beyond linear scales in galaxy surveys and causing the correlation of large and small scales, "beat coupling", or "super-sample" covariance, are precisely accounted for in non-linear transformations of the Gaussian field. As an application, we simulate the CFHTLS $\sim 7^\circ \times 7^\circ$ W1 galaxy density field, modeled as a Poisson sampling of a lognormal density field. We show that our simulations produce power spectra, $A^*$-power spectra, counts-in-cells probability distributions as well as covariances perfectly consistent with the data. In addition, our technique reproduces the information plateau beyond linear scales as observed previously in Sloan Digital Sky Survey galaxy catalogs and in $N$-body simulations. Our method is thus an efficient yet powerful simulation and prediction tool for galaxy survey data and covariances.

The sufficient statistics of the one-point probability density function of the dark matter density field is worked out using cosmological perturbation theory and tested to the Millennium simulation density field. The logarithmic transformation is recovered for spectral index close to $-1$ as a special case of the family of power transformations. We then discuss how these transforms should be modified in the case of noisy tracers of the field and focus on the case of Poisson sampling. This gives us optimal local transformations to apply to galaxy survey data prior the extraction of the spectrum in order to capture most efficiently the information encoded in large scale structures.

A large fraction of this thesis is dedicated to the study of the information content of random fields with heavy tails, in particular the lognormal field, a model for the matter density fluctuation field. It is well known that in the nonlinear regime of structure formation, the matter fluctuation field develops such large tails. It has also been suggested that fields with large tails are not necessarily well described by the hierarchy of $N$-point functions. In this thesis, we are able to make this last statement precise and with the help of the lognormal model to quantify precisely its implications for inference on cosmological parameters : we find as our main result that only a tiny fraction of the total Fisher information of the field is still contained in the hierarchy of $N$-point moments in the nonlinear regime, rendering parameter inference from such moments very inefficient. We show that the hierarchy fails to capture the information that is contained in the underdense regions, which at the same time are found to be the most rich in information. We find further our results to be very consistent with numerical analysis using $N$-body simulations. We also discuss these issues with the help of explicit families of fields with the same hierarchy of $N$-point moments defined in this work. A similar analysis is then applied to the convergence field, the weighted projection of the matter density fluctuation field along the line of sight, with similar conclusions. We also show how simple mappings can correct for this inadequacy, consistently with previous findings in the literature (Abridged) .

Beyond the linear regime, the power spectrum and higher order moments of the matter field no longer capture all cosmological information encoded in density fluctuations. While non-linear transforms have been proposed to extract this information lost to traditional methods, up to now, the way to generalize these techniques to discrete processes was unclear; ad hoc extensions had some success. We pointed out in Carron and Szapudi (2013) that the logarithmic transform approximates extremely well the optimal "sufficient statistics", observables that extract all information from the (continuous) matter field. Building on these results, we generalize optimal transforms to discrete galaxy fields. We focus our calculations on the Poisson sampling of an underlying lognormal density field. We solve and test the one-point case in detail, and sketch out the sufficient observables for the multi-point case. Moreover, we present an accurate approximation to the sufficient observables in terms of the mean and spectrum of a non-linearly transformed field. We find that the corresponding optimal non-linear transformation is directly related to the maximum a posteriori Bayesian reconstruction of the underlying continuous field with a lognormal prior as put forward in Kitaura et al (2010). Thus simple recipes for realizing the sufficient observables can be built on previously proposed algorithms that have been successfully implemented and tested in simulations.

The recent data release of ESA's Planck mission together with earlier WMAP releases provide the first opportunity to compare high resolution full sky Cosmic Microwave Background temperature anisotropy maps. To quantify the coherence of these maps beyond the power spectrum we introduce Generalized Phases, unit vectors in the (2l+1) dimensional representation spaces. For a Gaussian distribution, Generalized Phases are random and if there is non-Gaussianity, they represent most of the non-Gaussian information. The alignment of these unit vectors from two maps can be characterized by their angle, 0 deg expected for full coherence, and 90 deg for random vectors. We analyze maps from both missions with the same mask and Nside=512 resolution, and compare both power spectra and Generalized Phases. We find excellent agreement of the Generalize Phases of Planck Smica map with that of the WMAP Q,V,W maps, rejecting the null hypothesis of no correlations at 5 sigma for l's l<700, l<900 and l<1100, respectively, except perhaps for l<10. Using foreground reduced maps for WMAP increases the phase coherence. The observed coherence angles can be explained with a simple assumption of Gaussianity and a WMAP noise model neglecting Planck noise, except for low-intermediate l's there is a slight, but significant off-set, depending on WMAP band. On the same scales WMAP power spectrum is about 2.6% higher at a very high significance, while at higher l's there appears to be no significant bias. Using our theoretical tools, we predict the phase alignment of Planck with a hypothetical perfect noiseless CMB experiment, finding decoherence at l > 2900; below this value Planck can be used most efficiently to constrain non-Gaussianity.

Recently, several studies proposed non-linear transformations, such as a logarithmic or Gaussianization transformation, as efficient tools to recapture information about the (Gaussian) initial conditions. During non-linear evolution, part of the cosmologically relevant information leaks out from the second moment of the distribution. This information is accessible only through complex higher order moments or, in the worst case, becomes inaccessible to the hierarchy. The focus of this work is to investigate these transformations in the framework of Fisher information using cosmological perturbation theory of the matter field with Gaussian initial conditions. We show that at each order in perturbation theory, there is a polynomial of corresponding order exhausting the information on a given parameter. This polynomial can be interpreted as the Taylor expansion of the maximally efficient "sufficient" observable in the non-linear regime. We determine explicitly this maximally efficient observable for local transformations. Remarkably, this optimal transform is essentially the simple power transform with an exponent related to the slope of the power spectrum; when this is -1, it is indistinguishable from the logarithmic transform. This transform Gaussianizes the distribution, and recovers the linear density contrast. Thus a direct connection is revealed between undoing of the non-linear dynamics and the efficient capture of Fisher information. Our analytical results were compared with measurements from the Millennium Simulation density field. We found that our transforms remain very close to optimal even in the deeply non-linear regime with \sigma^2 \sim 10.

We define and study statistical ensembles of matter density profiles describing spherically symmetric, virialized dark matter haloes of finite extent with a given mass and total gravitational potential energy. Our ensembles include spatial degrees of freedom only, a microstate being a spherically symmetric matter density function. We provide an exact solution for the grand canonical partition functional, and show its equivalence to that of the microcanonical ensemble. We obtain analytically the mean profiles that correspond to an overwhelming majority of microstates. All such profiles have an infinitely deep potential well, with the singular isothermal sphere arising in the infinite temperature limit. Systems with virial radius larger than gravitational radius exhibit a localization of a finite fraction of the energy in the very center. The universal logarithmic inner slope of unity of the NFW haloes is predicted at any mass and energy if an upper bound is set to the maximal depth of the potential well. In this case, the statistically favored mean profiles compare well to the NFW profiles. For very massive haloes the agreement becomes exact.

In this brief paper we revisit the Fisher information content of cosmological power spectra or two-point functions of Gaussian fields in order to comment on the assumption of Gaussian estimators and the use of parameter-dependent covariance matrices for parameter inference in the context of precision cosmology. Even though the assumption of a Gaussian likelihood is motivated by the central limit theorem, we discuss that it leads to Fisher information content that violates the Cram\'er-Rao bound if used consistently, owing to independent but artificial information from the parameter-dependent covariance matrix. At any fixed multipole, this artificial term is shown to become dominant in the case of a large number of correlated fields. While the distribution of the estimators does indeed tend to a Gaussian with a large number of modes, it is shown, however, that its Fisher information content does not, in the sense that their covariance matrix never carries independent information content, precisely because of the non-Gaussian shape of the distribution. In this light, we discuss the use of parameter-dependent covariance matrices with Gaussian likelihoods for parameter inference from two-point statistics. As a rule of thumb, Gaussian likelihoods should always be used with a covariance matrix fixed in parameter space, since only this guarantees that conservative information content is assigned to the observables, and at the same time prevents biases appearing.

Using fits to numerical simulations, we show that the entire hierarchy of moments quickly ceases to provide a complete description of the convergence one-point probability density function leaving the linear regime. This suggests that the full N-point correlation function hierarchy of the convergence field becomes quickly generically incomplete and a very poor cosmological probe on nonlinear scales. At the scale of unit variance, only 5% of the Fisher information content of the one-point probability density function is still contained in its hierarchy of moments, making clear that information escaping the hierarchy is a far stronger effect than information propagating to higher order moments. It follows that the constraints on cosmological parameters achievable through extraction of the entire hierarchy become suboptimal by large amounts. A simple logarithmic mapping makes the moment hierarchy well suited again for parameter extraction.

Motivated by recent results on lognormal statistics showing that the moment hierarchy of a lognormal variable completely fails at capturing its information content in the large variance regime, we discuss in this work the inadequacy of the hierarchy of correlation functions to describe a correlated lognormal field, which provides a roughly accurate description of the non-linear cosmological matter density field. We present families of fields having the same hierarchy of correlation functions than the lognormal field at all orders. This explicitly demonstrates the little studied though known fact that the correlation function hierarchy never provides a complete description of a lognormal field, and that it fails to capture information in the non-linear regime, where other simple observables are left totally unconstrained. We discuss why perturbative, Edgeworth-like approaches to statistics in the non-linear regime, common in cosmology, can never reproduce or predict that effect, and why it is however generic for tailed fields, hinting at a breakdown of the perturbation theory based on the field fluctuations. We make a rough but successful quantitative connection to N-body simulations results, that showed that the spectrum of the log-density field carries more information than the spectrum of the field entering the non-linear regime.

We study the constraining power on primordial non-Gaussianity of future surveys of the large-scale structure of the Universe for both near-term surveys (such as the Dark Energy Survey - DES) as well as longer term projects such as Euclid and WFIRST. Specifically we perform a Fisher matrix analysis forecast for such surveys, using DES-like and Euclid-like configurations as examples, and take account of any expected photometric and spectroscopic data. We focus on two-point statistics and we consider three observables: the 3D galaxy power spectrum in redshift space, the angular galaxy power spectrum, and the projected weak-lensing shear power spectrum. We study the effects of adding a few extra parameters to the basic LCDM set. We include the two standard parameters to model the current value for the dark energy equation of state and its time derivative, w_0, w_a, and we account for the possibility of primordial non-Gaussianity of the local, equilateral and orthogonal types, of parameter fNL and, optionally, of spectral index n_fNL. We present forecasted constraints on these parameters using the different observational probes. We show that accounting for models that include primordial non-Gaussianity does not degrade the constraint on the standard LCDM set nor on the dark-energy equation of state. By combining the weak lensing data and the information on projected galaxy clustering, consistently including all two-point functions and their covariance, we find forecasted marginalised errors sigma (fNL) ~ 3, sigma (n_fNL) ~ 0.12 from a Euclid-like survey for the local shape of primordial non-Gaussianity, while the orthogonal and equilateral constraints are weakened for the galaxy clustering case, due to the weaker scale-dependence of the bias. In the lensing case, the constraints remain instead similar in all configurations.

This paper is aimed at developing a better understanding of the structure of the information that in contained in galaxy surveys, so as to find optimal ways to combine observables from such surveys. We first show how Jaynes' Maximal Entropy Principle allows us, in the general case, to express the Fisher information content of data sets in terms of the curvature of the Shannon entropy surface with respect to the relevant observables. This allows us to understand the Fisher information content of a data set, once a physical model is specified, independently of the specific way that the data will be processed, and without any assumptions of Gaussianity. This includes as a special case the standard Fisher matrix prescriptions for Gaussian variables widely used in the cosmological community, for instance for power spectra extraction. As an application of this approach, we evaluate the prospects of a joint analysis of weak lensing tracers up to second order in the shapes distortions, in the case that the noise in each probe can be effectively treated as model independent. These include the magnification, the two ellipticity and the four flexion fields. At the two point level, we show that the only effect of treating these observables in combination is a simple scale dependent decrease of the noise contaminating the accessible spectrum of the lensing E-mode. We provide simple bounds to its extraction by a combination of such probes, as well as its quantitative evaluation when the correlations between the noise variables for any two such probes can be neglected.

We trace with analytical methods and in a model parameter independent manner the independent bits of Fisher information of each of the moments of the lognormal distribution, as a now standard prescription for the distribution of the cosmological matter density field, as it departs from Gaussian initial conditions. We show that, when entering the regime of large fluctuations, only a tiny, dramatically decaying fraction of the total information content remains accessible through the extraction of the full series of moments of the field. This is due to a known peculiarity of highly tailed distributions, that they cannot be uniquely recovered given the values of all of their moments. This renders under this lognormal assumption cosmological probes such as the correlation function hierarchy or equivalently their Fourier transforms fundamentally limited once the field becomes non linear, for any parameter of interest. We show that the fraction of the information accessible from two-point correlations decays to zero following the inverse squared variance of the field. We discuss what general properties of a random field's probability density function are making the correlation function hierarchy an efficient or inefficient, complete or incomplete set of probes of any model parameter.