The fields of Astronomy and Astrophysics are technology limited, where the advent and application of new technologies to astronomy usher in a flood of discoveries altering our understanding of the Universe (e.g., recent cases include LIGO and the GRAVITY instrument at the VLTI). Currently, the field of astronomical spectroscopy is rapidly approaching an impasse: the size and cost of instruments, especially multi-object and integral field spectrographs for extremely large telescopes (ELTs), are pushing the limits of what is feasible, requiring optical components at the very edge of achievable size and performance. For these reasons, astronomers are increasingly looking for innovative solutions like photonic technologies that promote instrument miniaturization and simplification, while providing superior performance. Astronomers have long been aware of the potential of photonic technologies. The goal of this white paper is to draw attention to key photonic technologies and developments over the past two decades and demonstrate there is new momentum in this arena. We outline where the most critical efforts should be focused over the coming decade in order to move towards realizing a fully photonic instrument. A relatively small investment in this technology will advance astronomical photonics to a level where it can reliably be used to solve challenging instrument design limitations. For the benefit of both ground and space borne instruments alike, an endorsement from the National Academy of Sciences decadal survey will ensure that such solutions are set on a path to their full scientific exploitation, which may one day address a broad range of science cases outlined in the KSPs.

This white paper addresses key challenges for the design of next-decade Cosmic Microwave Background (CMB) experiments, and for assessing their capability to extract cosmological information from CMB polarization. We focus here on the challenges posed by foreground emission, CMB lensing, and instrumental systematics to detect the signal that arises from gravitational waves sourced by inflation and parameterized by $r$, at the level of $r \sim 10^{-3}$ or lower, as proposed for future observational efforts. We argue that more accurate and robust analysis and simulation tools are required for these experiments to realize their promise. We are optimistic that the capability to simulate the joint impact of foregrounds, CMB lensing, and systematics can be developed to the level necessary to support the design of a space mission at $r \sim 10^{-4}$ in a few years. We make the case here for supporting such work. Although ground-based efforts present additional challenges (e.g., atmosphere, ground pickup), which are not addressed here, they would also benefit from these improved simulation capabilities.

There is an opportunity to advance both solar system and extrasolar planetary studies that does not require the construction of new telescopes or new missions but better use and access to inter-disciplinary data sets. This approach leverages significant investment from NASA and international space agencies in exploring this solar system and using those discoveries as "ground truth" for the study of extrasolar planets. This white paper illustrates the potential, using phase curves and atmospheric modeling as specific examples. A key advance required to realize this potential is to enable seamless discovery and access within and between planetary science and astronomical data sets. Further, seamless data discovery and access also expands the availability of science, allowing researchers and students at a variety of institutions, equipped only with Internet access and a decent computer to conduct cutting-edge research.

A major science goal of future, large-aperture, optical space telescopes is to directly image and spectroscopically analyze reflected light from potentially habitable exoplanets. To accomplish this, the optical system must suppress diffracted light from the star to reveal point sources approximately ten orders of magnitude fainter than the host star at small angular separation. Coronagraphs with microdot apodizers achieve the theoretical performance needed to image Earth-like planets with a range of possible telescope designs, including those with obscured and segmented pupils. A test microdot apodizer with various bulk patterns (step functions, gradients, and sinusoids) and 4 different dot sizes (3, 5, 7, and 10 $\mu$m) made of small chrome squares on anti-reflective glass was characterized with microscopy, optical laser interferometry, as well as transmission and reflectance measurements at wavelengths of 600 and 800 nm. Microscopy revealed the microdots were fabricated to high precision. Results from laser interferometry showed that the phase shifts observed in reflection vary with the local microdot fill factor. Transmission measurements showed that microdot fill factor and transmission were linearly related for dot sizes >5 $\mu$m. However, anomalously high transmittance was measured when the dot size is <5x the wavelength and the fill factor is approximately 50%, where the microdot pattern becomes periodic. The transmission excess is not as prominent in the case of larger dot sizes suggesting that it is likely to be caused by the interaction between the incident field and electronic resonances in the surface of the metallic microdots. We used our empirical models of the microdot apodizers to optimize a second generation of reflective apodizer designs and confirmed that the amplitude and phase of the reflected beam closely matches the ideal wavefront.

The Optimal Optical CoronagraphWorkshop at the Lorentz Center in September 2017 in Leiden, the Netherlands gathered a diverse group of 25 researchers working on exoplanet instrumentation to stimulate the emergence and sharing of new ideas. This contribution is the final part of a series of three papers summarizing the outcomes of the workshop, and presents an overview of novel optical technologies and systems that are implemented or considered for high-contrast imaging instruments on both ground-based and space telescopes. The overall objective of high contrast instruments is to provide direct observations and characterizations of exoplanets at contrast levels as extreme as 10^-10. We list shortcomings of current technologies, and identify opportunities and development paths for new technologies that enable quantum leaps in performance. Specifically, we discuss the design and manufacturing of key components like advanced deformable mirrors and coronagraphic optics, and their amalgamation in "adaptive coronagraph" systems. Moreover, we discuss highly integrated system designs that combine contrast-enhancing techniques and characterization techniques (like high-resolution spectroscopy) while minimizing the overall complexity. Finally, we explore extreme implementations using all-photonics solutions for ground-based telescopes and dedicated huge apertures for space telescopes.

The Optimal Optical Coronagraph (OOC) Workshop held at the Lorentz Center in September 2017 in Leiden, the Netherlands, gathered a diverse group of 25 researchers working on exoplanet instrumentation to stimulate the emergence and sharing of new ideas. In this second installment of a series of three papers summarizing the outcomes of the OOC workshop (see also~\citenum{ruane2018,snik2018}), we present an overview of common path wavefront sensing/control and Coherent Differential Imaging techniques, highlight the latest results, and expose their relative strengths and weaknesses. We layout critical milestones for the field with the aim of enhancing future ground/space based high contrast imaging platforms. Techniques like these will help to bridge the daunting contrast gap required to image a terrestrial planet in the zone where it can retain liquid water, in reflected light around a G type star from space.

The Optimal Optical Coronagraph (OOC) Workshop at the Lorentz Center in September 2017 in Leiden, the Netherlands gathered a diverse group of 25 researchers working on exoplanet instrumentation to stimulate the emergence and sharing of new ideas. In this first installment of a series of three papers summarizing the outcomes of the OOC workshop, we present an overview of design methods and optical performance metrics developed for coronagraph instruments. The design and optimization of coronagraphs for future telescopes has progressed rapidly over the past several years in the context of space mission studies for Exo-C, WFIRST, HabEx, and LUVOIR as well as ground-based telescopes. Design tools have been developed at several institutions to optimize a variety of coronagraph mask types. We aim to give a broad overview of the approaches used, examples of their utility, and provide the optimization tools to the community. Though it is clear that the basic function of coronagraphs is to suppress starlight while maintaining light from off-axis sources, our community lacks a general set of standard performance metrics that apply to both detecting and characterizing exoplanets. The attendees of the OOC workshop agreed that it would benefit our community to clearly define quantities for comparing the performance of coronagraph designs and systems. Therefore, we also present a set of metrics that may be applied to theoretical designs, testbeds, and deployed instruments. We show how these quantities may be used to easily relate the basic properties of the optical instrument to the detection significance of the given point source in the presence of realistic noise.

Coronagraph instruments on future space telescopes will enable the direct detection and characterization of Earth-like exoplanets around Sun-like stars for the first time. The quest for the optimal optical coronagraph designs has made rapid progress in recent years thanks to the Segmented Coronagraph Design and Analysis (SCDA) initiative led by the Exoplanet Exploration Program at NASA's Jet Propulsion Laboratory. As a result, several types of high-performance designs have emerged that make use of dual deformable mirrors to (1) correct for optical aberrations and (2) suppress diffracted starlight from obstructions and discontinuities in the telescope pupil. However, the algorithms used to compute the optimal deformable mirror surface tend to be computationally intensive, prohibiting large scale design surveys. Here, we utilize the Fast Linearized Coronagraph Optimizer (FALCO), a tool that allows for rapid optimization of deformable mirror shapes, to explore trade-offs in coronagraph designs for obstructed and segmented space telescopes. We compare designs for representative shaped pupil Lyot and vortex coronagraphs, two of the most promising concepts for the LUVOIR space mission concept. We analyze the optical performance of each design, including their throughput and ability to passively suppress light from partially resolved stars in the presence of low-order aberrations. Our main result is that deformable mirror based apodization can sufficiently suppress diffraction from support struts and inter-segment gaps whose widths are on the order of $\sim$0.1% of the primary mirror diameter to detect Earth-sized planets within a few tens of milliarcseconds from the star.

The Habitable Exoplanet Imaging Mission (HabEx) concept requires an optical coronagraph that provides deep starlight suppression over a broad spectral bandwidth, high throughput for point sources at small angular separation, and insensitivity to temporally-varying, low-order aberrations. Vortex coronagraphs are a promising solution that perform optimally on off-axis, monolithic telescopes and may also be designed for segmented telescopes with minor losses in performance. We describe the key advantages of vortex coronagraphs on off-axis telescopes: 1) Unwanted diffraction due to aberrations is passively rejected in several low-order Zernike modes relaxing the wavefront stability requirements for imaging Earth-like planets from <10 to >100 pm rms. 2) Stars with angular diameters >0.1 $\lambda/D$ may be sufficiently suppressed. 3) The absolute planet throughput is >10%, even for unfavorable telescope architectures. 4) Broadband solutions ($\Delta\lambda/\lambda>0.1$) are readily available for both monolithic and segmented apertures. The latter make use of grayscale apodizers in an upstream pupil plane to provide suppression of diffracted light from amplitude discontinuities in the telescope pupil without inducing additional stroke on the deformable mirrors. We set wavefront stability requirements on the telescope, based on a stellar irradiance threshold set at an angular separation of 3$\pm$0.5 $\lambda/D$ from the star, and discuss how some requirements may be relaxed by trading robustness to aberrations for planet throughput.

The segmented coronagraph design and analysis (SCDA) study is a coordinated effort, led by Stuart Shaklan (JPL) and supported by NASA's Exoplanet Exploration Program (ExEP), to provide efficient coronagraph design concepts for exoplanet imaging with future segmented aperture space telescopes. This document serves as an update on the apodized vortex coronagraph designs devised by the Caltech/JPL SCDA team. Apodized vortex coronagraphs come in two flavors, where the apodization is achieved either by use of 1) a gray-scale semi-transparent pupil mask or 2) a pair of deformable mirrors in series. Each approach has attractive benefits. This document presents a comprehensive review of the former type. Future theoretical investigations will further explore the use of deformable mirrors for apodization.

The detection of molecular species in the atmospheres of earth-like exoplanets orbiting nearby stars requires an optical system that suppresses starlight and maximizes the sensitivity to the weak planet signals at small angular separations. Achieving sufficient contrast performance on a segmented aperture space telescope is particularly challenging due to unwanted diffraction within the telescope from amplitude and phase discontinuities in the pupil. Apodized vortex coronagraphs are a promising solution that theoretically meet the performance needs for high contrast imaging with future segmented space telescopes. We investigate the sensitivity of apodized vortex coronagraphs to the expected aberrations, including segment co-phasing errors in piston and tip/tilt as well as other low-order and mid-spatial frequency aberrations. Coronagraph designs and their associated telescope requirements are identified for conceptual HabEx and LUVOIR telescope designs.

Current state-of-the-art high contrast imaging instruments take advantage of a number of elegant coronagraph designs to suppress starlight and image nearby faint objects, such as exoplanets and circumstellar disks. The ideal performance and complexity of the optical systems depends strongly on the shape of the telescope aperture. Unfortunately, large primary mirrors tend to be segmented and have various obstructions, which limit the performance of most conventional coronagraph designs. We present a new family of vortex coronagraphs with numerically-optimized gray-scale apodizers that provide the sensitivity needed to directly image faint exoplanets with large, segmented aperture telescopes, including the Thirty Meter Telescope (TMT) as well as potential next-generation space telescopes.

We propose an efficient Bayesian MCMC algorithm for estimating cosmological parameters from CMB data without use of likelihood approximations. It builds on a previously developed Gibbs sampling framework that allows for exploration of the joint CMB sky signal and power spectrum posterior, P(s,Cl|d), and addresses a long-standing problem of efficient parameter estimation simultaneously in high and low signal-to-noise regimes. To achieve this, our new algorithm introduces a joint Markov Chain move in which both the signal map and power spectrum are synchronously modified, by rescaling the map according to the proposed power spectrum before evaluating the Metropolis-Hastings accept probability. Such a move was already introduced by Jewell et al. (2009), who used it to explore low signal-to-noise posteriors. However, they also found that the same algorithm is inefficient in the high signal-to-noise regime, since a brute-force rescaling operation does not account for phase information. This problem is mitigated in the new algorithm by subtracting the Wiener filter mean field from the proposed map prior to rescaling, leaving high signal-to-noise information invariant in the joint step, and effectively only rescaling the low signal-to-noise component. To explore the full posterior, the new joint move is then interleaved with a standard conditional Gibbs sky map move. We apply our new algorithm to simplified simulations for which we can evaluate the exact posterior to study both its accuracy and performance, and find good agreement with the exact posterior; marginal means agree to less than 0.006 sigma, and standard deviations to better than 3%. The Markov Chain correlation length is of the same order of magnitude as those obtained by other standard samplers in the field.

As well as primary fluctuations, CMB temperature maps contain a wealth of additional information in the form of secondary anisotropies. Secondary effects that can be identified with individual objects, such as the thermal and kinetic Sunyaev-Zel'dovich (SZ) effects due to galaxy clusters, are difficult to unambiguously disentangle from foreground contamination and the primary CMB however. We develop a Bayesian formalism for rigorously characterising anisotropies that are localised on the sky, taking the TSZ and KSZ effects as an example. Using a Gibbs sampling scheme, we are able to efficiently sample from the joint posterior distribution for a multi-component model of the sky with many thousands of correlated physical parameters. The posterior can then be exactly marginalised to estimate properties of the secondary anisotropies, fully taking into account degeneracies with the other signals in the CMB map. We show that this method is computationally tractable using a simple implementation based on the existing Commander component separation code, and also discuss how other types of secondary anisotropy can be accommodated within our framework.

Planck has mapped the polarized dust emission over the whole sky, making it possible to trace the Galactic magnetic field structure that pervades the interstellar medium (ISM). We combine polarization data from Planck with rotation measure (RM) observations towards a massive star-forming region, the Rosette Nebula in the Monoceros molecular cloud, to study its magnetic field structure and the impact of an expanding HII region on the morphology of the field. We derive an analytical solution for the magnetic field, assumed to evolve from an initially uniform configuration following the expansion of ionized gas and the formation of a shell of swept-up ISM. From the RM data we estimate a mean value of the line-of-sight component of the magnetic field of about 3microG (towards the observer) in the Rosette Nebula, for a uniform electron density of about 12cm-3. The dust shell that surrounds the Rosette HII region is clearly observed in the Planck intensity map at 353 GHz, with a polarization signal significantly different from that of the local background when considered as a whole. The Planck observations constrain the plane-of-the-sky orientation of the magnetic field in the Rosette's parent molecular cloud to be mostly aligned with the large-scale field along the Galactic plane. The Planck data are compared with the analytical model, which predicts the mean polarization properties of a spherical and uniform dust shell for a given orientation of the field. This comparison leads to an upper limit of about 45degr on the angle between the line of sight and the magnetic field in the Rosette complex, for an assumed intrinsic dust polarization fraction of 4%. This field direction can reproduce the RM values detected in the ionized region if the magnetic field strength in the Monoceros molecular cloud is in the range 6.5--9microG.

We revisit the problem of exact CMB likelihood and power spectrum estimation with the goal of minimizing computational cost through linear compression. This idea was originally proposed for CMB purposes by Tegmark et al.\ (1997), and here we develop it into a fully working computational framework for large-scale polarization analysis, adopting \WMAP\ as a worked example. We compare five different linear bases (pixel space, harmonic space, noise covariance eigenvectors, signal-to-noise covariance eigenvectors and signal-plus-noise covariance eigenvectors) in terms of compression efficiency, and find that the computationally most efficient basis is the signal-to-noise eigenvector basis, which is closely related to the Karhunen-Loeve and Principal Component transforms, in agreement with previous suggestions. For this basis, the information in 6836 unmasked \WMAP\ sky map pixels can be compressed into a smaller set of 3102 modes, with a maximum error increase of any single multipole of 3.8\% at $\ell\le32$, and a maximum shift in the mean values of a joint distribution of an amplitude--tilt model of 0.006$\sigma$. This compression reduces the computational cost of a single likelihood evaluation by a factor of 5, from 38 to 7.5 CPU seconds, and it also results in a more robust likelihood by implicitly regularizing nearly degenerate modes. Finally, we use the same compression framework to formulate a numerically stable and computationally efficient variation of the Quadratic Maximum Likelihood implementation that requires less than 3 GB of memory and 2 CPU minutes per iteration for $\ell \le 32$, rendering low-$\ell$ QML CMB power spectrum analysis fully tractable on a standard laptop.

We report the results of a joint analysis of data from BICEP2/Keck Array and Planck. BICEP2 and Keck Array have observed the same approximately 400 deg$^2$ patch of sky centered on RA 0h, Dec. $-57.5\deg$. The combined maps reach a depth of 57 nK deg in Stokes $Q$ and $U$ in a band centered at 150 GHz. Planck has observed the full sky in polarization at seven frequencies from 30 to 353 GHz, but much less deeply in any given region (1.2 $\mu$K deg in $Q$ and $U$ at 143 GHz). We detect 150$\times$353 cross-correlation in $B$-modes at high significance. We fit the single- and cross-frequency power spectra at frequencies $\geq 150$ GHz to a lensed-$\Lambda$CDM model that includes dust and a possible contribution from inflationary gravitational waves (as parameterized by the tensor-to-scalar ratio $r$), using a prior on the frequency spectral behavior of polarized dust emission from previous \planck\ analysis of other regions of the sky. We find strong evidence for dust and no statistically significant evidence for tensor modes. We probe various model variations and extensions, including adding a synchrotron component in combination with lower frequency data, and find that these make little difference to the $r$ constraint. Finally we present an alternative analysis which is similar to a map-based cleaning of the dust contribution, and show that this gives similar constraints. The final result is expressed as a likelihood curve for $r$, and yields an upper limit $r_{0.05}<0.12$ at 95% confidence. Marginalizing over dust and $r$, lensing $B$-modes are detected at $7.0\,\sigma$ significance.

The polarized thermal emission from Galactic dust is the main foreground present in measurements of the polarization of the cosmic microwave background (CMB) at frequencies above 100GHz. We exploit the Planck HFI polarization data from 100 to 353GHz to measure the dust angular power spectra $C_\ell^{EE,BB}$ over the range $40<\ell<600$ well away from the Galactic plane. These will bring new insights into interstellar dust physics and a precise determination of the level of contamination for CMB polarization experiments. We show that statistical properties of the emission can be characterized over large fractions of the sky using $C_\ell$. For the dust, they are well described by power laws in $\ell$ with exponents $\alpha^{EE,BB}=-2.42\pm0.02$. The amplitudes of the polarization $C_\ell$ vary with the average brightness in a way similar to the intensity ones. The dust polarization frequency dependence is consistent with modified blackbody emission with $\beta_d=1.59$ and $T_d=19.6$K. We find a systematic ratio between the amplitudes of the Galactic $B$- and $E$-modes of 0.5. We show that even in the faintest dust-emitting regions there are no "clean" windows where primordial CMB $B$-mode polarization could be measured without subtraction of dust emission. Finally, we investigate the level of dust polarization in the BICEP2 experiment field. Extrapolation of the Planck 353GHz data to 150GHz gives a dust power $\ell(\ell+1)C_\ell^{BB}/(2\pi)$ of $1.32\times10^{-2}\mu$K$_{CMB}^2$ over the $40<\ell<120$ range; the statistical uncertainty is $\pm0.29$ and there is an additional uncertainty (+0.28,-0.24) from the extrapolation, both in the same units. This is the same magnitude as reported by BICEP2 over this $\ell$ range, which highlights the need for assessment of the polarized dust signal even in the cleanest windows of the sky.

This paper presents an all-sky model of dust emission from the Planck 857, 545 and 353 GHz, and IRAS 100 micron data. Using a modified black-body fit to the data we present all-sky maps of the dust optical depth, temperature, and spectral index over the 353-3000 GHz range. This model is a tight representation of the data at 5 arc min. It shows variations of the order of 30 % compared with the widely-used model of Finkbeiner, Davis, and Schlegel. The Planck data allow us to estimate the dust temperature uniformly over the whole sky, providing an improved estimate of the dust optical depth compared to previous all-sky dust model, especially in high-contrast molecular regions. An increase of the dust opacity at 353 GHz, tau_353/N_H, from the diffuse to the denser interstellar medium (ISM) is reported. It is associated with a decrease in the observed dust temperature, T_obs, that could be due at least in part to the increased dust opacity. We also report an excess of dust emission at HI column densities lower than 10^20 cm^-2 that could be the signature of dust in the warm ionized medium. In the diffuse ISM at high Galactic latitude, we report an anti-correlation between tau_353/N_H and T_obs while the dust specific luminosity, i.e., the total dust emission integrated over frequency (the radiance) per hydrogen atom, stays about constant. The implication is that in the diffuse high-latitude ISM tau_353 is not as reliable a tracer of dust column density as we conclude it is in molecular clouds where the correlation of tau_353 with dust extinction estimated using colour excess measurements on stars is strong. To estimate Galactic E(B-V) in extragalactic fields at high latitude we develop a new method based on the thermal dust radiance, instead of the dust optical depth, calibrated to E(B-V) using reddening measurements of quasars deduced from Sloan Digital Sky Survey data.

We discuss the methods employed to photometrically calibrate the data acquired by the Low Frequency Instrument on Planck. Our calibration is based on a combination of the Orbital Dipole plus the Solar Dipole, caused respectively by the motion of the Planck spacecraft with respect to the Sun and by motion of the Solar System with respect to the CMB rest frame. The latter provides a signal of a few mK with the same spectrum as the CMB anisotropies and is visible throughout the mission. In this data release we rely on the characterization of the Solar Dipole as measured by WMAP. We also present preliminary results (at 44GHz only) on the study of the Orbital Dipole, which agree with the WMAP value of the Solar System speed within our uncertainties. We compute the calibration constant for each radiometer roughly once per hour, in order to keep track of changes in the detectors' gain. Since non-idealities in the optical response of the beams proved to be important, we implemented a fast convolution algorithm which considers the full beam response in estimating the signal generated by the dipole. Moreover, in order to further reduce the impact of residual systematics due to sidelobes, we estimated time variations in the calibration constant of the 30GHz radiometers (the ones with the largest sidelobes) using the signal of a reference load. We have estimated the calibration accuracy in two ways: we have run a set of simulations to assess the impact of statistical errors and systematic effects in the instrument and in the calibration procedure, and we have performed a number of consistency checks on the data and on the brightness temperature of Jupiter. Calibration errors for this data release are expected to be about 0.6% at 44 and 70 GHz, and 0.8% at 30 GHz. (Abriged.)

The ESA's Planck satellite, dedicated to studying the early Universe and its subsequent evolution, was launched 14 May 2009 and has been scanning the microwave and submillimetre sky continuously since 12 August 2009. This paper gives an overview of the mission and its performance, the processing, analysis, and characteristics of the data, the scientific results, and the science data products and papers in the release. The science products include maps of the CMB and diffuse extragalactic foregrounds, a catalogue of compact Galactic and extragalactic sources, and a list of sources detected through the SZ effect. The likelihood code used to assess cosmological models against the Planck data and a lensing likelihood are described. Scientific results include robust support for the standard six-parameter LCDM model of cosmology and improved measurements of its parameters, including a highly significant deviation from scale invariance of the primordial power spectrum. The Planck values for these parameters and others derived from them are significantly different from those previously determined. Several large-scale anomalies in the temperature distribution of the CMB, first detected by WMAP, are confirmed with higher confidence. Planck sets new limits on the number and mass of neutrinos, and has measured gravitational lensing of CMB anisotropies at greater than 25 sigma. Planck finds no evidence for non-Gaussianity in the CMB. Planck's results agree well with results from the measurements of baryon acoustic oscillations. Planck finds a lower Hubble constant than found in some more local measures. Some tension is also present between the amplitude of matter fluctuations derived from CMB data and that derived from SZ data. The Planck and WMAP power spectra are offset from each other by an average level of about 2% around the first acoustic peak.

We present the current estimate of instrumental and systematic effect uncertainties for the Planck-Low Frequency Instrument relevant to the first release of the Planck cosmological results. We give an overview of the main effects and of the tools and methods applied to assess residuals in maps and power spectra. We also present an overall budget of known systematic effect uncertainties, which are dominated sidelobe straylight pick-up and imperfect calibration. However, even these two effects are at least two orders of magnitude weaker than the cosmic microwave background (CMB) fluctuations as measured in terms of the angular temperature power spectrum. A residual signal above the noise level is present in the multipole range $\ell<20$, most notably at 30 GHz, and is likely caused by residual Galactic straylight contamination. Current analysis aims to further reduce the level of spurious signals in the data and to improve the systematic effects modelling, in particular with respect to straylight and calibration uncertainties.

We present the first results based on Planck measurements of the CMB temperature and lensing-potential power spectra. The Planck spectra at high multipoles are extremely well described by the standard spatially-flat six-parameter LCDM cosmology. In this model Planck data determine the cosmological parameters to high precision. We find a low value of the Hubble constant, H0=67.3+/-1.2 km/s/Mpc and a high value of the matter density parameter, Omega_m=0.315+/-0.017 (+/-1 sigma errors) in excellent agreement with constraints from baryon acoustic oscillation (BAO) surveys. Including curvature, we find that the Universe is consistent with spatial flatness to percent-level precision using Planck CMB data alone. We present results from an analysis of extensions to the standard cosmology, using astrophysical data sets in addition to Planck and high-resolution CMB data. None of these models are favoured significantly over standard LCDM. The deviation of the scalar spectral index from unity is insensitive to the addition of tensor modes and to changes in the matter content of the Universe. We find a 95% upper limit of r<0.11 on the tensor-to-scalar ratio. There is no evidence for additional neutrino-like relativistic particles. Using BAO and CMB data, we find N_eff=3.30+/-0.27 for the effective number of relativistic degrees of freedom, and an upper limit of 0.23 eV for the summed neutrino mass. Our results are in excellent agreement with big bang nucleosynthesis and the standard value of N_eff=3.046. We find no evidence for dynamical dark energy. Despite the success of the standard LCDM model, this cosmology does not provide a good fit to the CMB power spectrum at low multipoles, as noted previously by the WMAP team. While not of decisive significance, this is an anomaly in an otherwise self-consistent analysis of the Planck temperature data.

This paper presents the characterization of the in-flight beams, the beam window functions and the associated uncertainties for the Planck Low Frequency Instrument (LFI). Knowledge of the beam profiles is necessary for determining the transfer function to go from the observed to the actual sky anisotropy power spectrum. The main beam distortions affect the beam window function, complicating the reconstruction of the anisotropy power spectrum at high multipoles, whereas the sidelobes affect the low and intermediate multipoles. The in-flight assessment of the LFI main beams relies on the measurements performed during Jupiter observations. By stacking the data from multiple Jupiter transits, the main beam profiles are measured down to -20 dB at 30 and 44 GHz, and down to -25 dB at 70 GHz. The main beam solid angles are determined to better than 0.2% at each LFI frequency band. The Planck pre-launch optical model is conveniently tuned to characterize the main beams independently of any noise effects. This approach provides an optical model whose beams fully reproduce the measurements in the main beam region, but also allows a description of the beams at power levels lower than can be achieved by the Jupiter measurements themselves. The agreement between the simulated beams and the measured beams is better than 1% at each LFI frequency band. The simulated beams are used for the computation of the window functions for the effective beams. The error budget for the window functions is estimated from both main beam and sidelobe contributions, and accounts for the radiometer bandshapes. The total uncertainties in the effective beam window functions are: 2% and 1.2% at 30 and 44 GHz, respectively (at $\ell \approx 600$), and 0.7% at 70 GHz (at $\ell \approx 1000$).

We present a multi-level solver for drawing constrained Gaussian realizations or finding the maximum likelihood estimate of the CMB sky, given noisy sky maps with partial sky coverage. The method converges substantially faster than existing Conjugate Gradient (CG) methods for the same problem. For instance, for the 143 GHz Planck frequency channel, only 3 multi-level W-cycles result in an absolute error smaller than 1 microKelvin in any pixel. Using 16 CPU cores, this translates to a computational expense of 6 minutes wall time per realization, plus 8 minutes wall time for a power spectrum-dependent precomputation. Each additional W-cycle reduces the error by more than an order of magnitude, at an additional computational cost of 2 minutes. For comparison, we have never been able to achieve similar absolute convergence with conventional CG methods for this high signal-to-noise data set, even after thousands of CG iterations and employing expensive preconditioners. The solver is part of the Commander 2 code, which is available with an open source license at http://commander.bitbucket.org/.

We describe the data processing pipeline of the Planck Low Frequency Instrument (LFI) data processing centre (DPC) to create and characterize full-sky maps based on the first 15.5 months of operations at 30, 44 and 70 GHz. In particular, we discuss the various steps involved in reducing the data, starting from telemetry packets through to the production of cleaned, calibrated timelines and calibrated frequency maps. Data are continuously calibrated using the modulation induced on the mean temperature of the cosmic microwave background radiation by the proper motion of the spacecraft. Sky signals other than the dipole are removed by an iterative procedure based on simultaneous fitting of calibration parameters and sky maps. Noise properties are estimated from time-ordered data after the sky signal has been removed, using a generalized least square map-making algorithm. A destriping code (Madam) is employed to combine radiometric data and pointing information into sky maps, minimizing the variance of correlated noise. Noise covariance matrices, required to compute statistical uncertainties on LFI and Planck products, are also produced. Main beams are estimated down to the -20 dB level using Jupiter transits, which are also used for the geometrical calibration of the focal plane.

We investigate sets of random variables that can be arranged sequentially such that a given variable only depends conditionally on its immediate predecessor. For such sets, we show that the full joint probability distribution may be expressed exclusively in terms of uni- and bivariate marginals. Under the assumption that the CMB power spectrum likelihood only exhibits correlations within a banded multipole range, \Delta l, we apply this expression to two outstanding problems in CMB likelihood analysis. First, we derive a statistically well-defined hybrid likelihood estimator, merging two independent (e.g., low- and high-l) likelihoods into a single expression that properly accounts for correlations between the two. Applying this expression to the WMAP likelihood, we verify that the effect of correlations on cosmological parameters in the transition region is negligible in terms of cosmological parameters for WMAP; the largest relative shift seen for any parameter is 0.06\sigma. However, because this may not hold for other experimental setups (e.g., for different instrumental noise properties or analysis masks), but must rather be verified on a case-by-case basis, we recommend our new hybridization scheme for future experiments for statistical self-consistency reasons. Second, we use the same expression to improve the convergence rate of the Blackwell-Rao likelihood estimator, reducing the required number of Monte Carlo samples by several orders of magnitude, and thereby extend it to high-l applications.

Rotational transition lines of CO play a major role in molecular radio astronomy and in particular in the study of star formation and the Galactic structure. Although a wealth of data exists in the Galactic plane and some well-known molecular clouds, there is no available CO high sensitivity all-sky survey to date. Such all-sky surveys can be constructed using the \Planck\ HFI data because the three lowest CO rotational transition lines at 115, 230 and 345 GHz significantly contribute to the signal of the 100, 217 and 353 GHz HFI channels respectively. Two different component separation methods are used to extract the CO maps from Planck HFI data. The maps obtained are then compared to one another and to existing external CO surveys. From these quality checks the best CO maps in terms of signal to noise and/or residual foreground contamination are selected. Three sets of velocity-integrated CO emission maps are produced: Type 1 maps of the CO (1-0), (2-1), and (3-2) rotational transitions with low foreground contamination but moderate signal-to-noise ratio; Type 2 maps for the (1-0) and (2-1) transitions with a better signal-to-noise ratio; and one Type 3 map, a line composite map with the best signal-to-noise ratio in order to locate the faintest molecular regions. The maps are described in detail. They are shown to be fully compatible with previous surveys of parts of the Galactic Plane and also of fainter regions out of the Galactic plane. The Planck HFI velocity-integrated CO maps for the (1-0), (2-1), and (3-2) rotational transitions provide an unprecedented all-sky CO view of the Galaxy. These maps are also of great interest to monitor potential CO contamination on CMB \Planck\ studies.

We present the Planck likelihood, a complete statistical description of the two-point correlation function of the CMB temperature fluctuations. We use this likelihood to derive the Planck CMB power spectrum over three decades in l, covering 2 <= l <= 2500. The main source of error at l <= 1500 is cosmic variance. Uncertainties in small-scale foreground modelling and instrumental noise dominate the error budget at higher l's. For l < 50, our likelihood exploits all Planck frequency channels from 30 to 353 GHz through a physically motivated Bayesian component separation technique. At l >= 50, we employ a correlated Gaussian likelihood approximation based on angular cross-spectra derived from the 100, 143 and 217 GHz channels. We validate our likelihood through an extensive suite of consistency tests, and assess the impact of residual foreground and instrumental uncertainties on cosmological parameters. We find good internal agreement among the high-l cross-spectra with residuals of a few uK^2 at l <= 1000. We compare our results with foreground-cleaned CMB maps, and with cross-spectra derived from the 70 GHz Planck map, and find broad agreement in terms of spectrum residuals and cosmological parameters. The best-fit LCDM cosmology is in excellent agreement with preliminary Planck polarisation spectra. The standard LCDM cosmology is well constrained by Planck by l <= 1500. For example, we report a 5.4 sigma deviation from n_s /= 1. Considering various extensions beyond the standard model, we find no indication of significant departures from the LCDM framework. Finally, we report a tension between the best-fit LCDM model and the low-l spectrum in the form of a power deficit of 5-10% at l <~ 40, significant at 2.5-3 sigma. We do not elaborate further on its cosmological implications, but note that this is our most puzzling finding in an otherwise remarkably consistent dataset. (Abridged)

Planck has produced detailed all-sky observations over nine frequency bands between 30 and 857 GHz. These observations allow robust reconstruction of the primordial cosmic microwave background (CMB) temperature fluctuations over nearly the full sky, as well as new constraints on Galactic foregrounds. This paper describes the component separation framework adopted by Planck. We test four foreground-cleaned CMB maps derived using qualitatively different component separation algorithms. The quality of our reconstructions is evaluated through detailed simulations and internal comparisons, and shown through various tests to be internally consistent and robust for CMB power spectrum and cosmological parameter estimation up to l = 2000. The parameter constraints on LambdaCDM cosmologies derived from these maps are consistent with those presented in the cross-spectrum based Planck likelihood analysis. We choose two of the CMB maps for specific scientific goals. We also present maps and frequency spectra of the Galactic low-frequency, CO, and thermal dust emission. The component maps are found to provide a faithful representation of the sky, as evaluated by simulations. For the low-frequency component, the spectral index varies widely over the sky, ranging from about beta = -4 to -2. Considering both morphology and prior knowledge of the low frequency components, the index map allows us to associate a steep spectral index (beta < -3.2) with strong anomalous microwave emission, corresponding to a spinning dust spectrum peaking below 20 GHz, a flat index of beta > -2.3 with strong free-free emission, and intermediate values with synchrotron emission.

We analyse WMAP 7-year temperature data, jointly modeling the cosmic microwave background (CMB) and Galactic foreground emission. We use the Commander code based on Gibbs sampling. Thus, from the WMAP7 data, we derive simultaneously the CMB and Galactic components on scales larger than 1deg with sensitivity improved relative to previous work. We conduct a detailed study of the low-frequency foreground with particular focus on the "microwave haze" emission around the Galactic center. We demonstrate improved performance in quantifying the diffuse galactic emission when Haslam 408MHz data are included together with WMAP7, and the spinning and thermal dust emission is modeled jointly. We also address the question of whether the hypothetical galactic haze can be explained by a spatial variation of the synchrotron spectral index. The excess of emission around the Galactic center appears stable with respect to variations of the foreground model that we study. Our results demonstrate that the new galactic foreground component - the microwave haze - is indeed present.

The scientific performance of the Planck Low Frequency Instrument (LFI) after one year of in-orbit operation is presented. We describe the main optical parameters and discuss photometric calibration, white noise sensitivity, and noise properties. A preliminary evaluation of the impact of the main systematic effects is presented. For each of the performance parameters, we outline the methods used to obtain them from the flight data and provide a comparison with pre-launch ground assessments, which are essentially confirmed in flight.

We describe the processing of data from the Low Frequency Instrument (LFI) used in production of the Planck Early Release Compact Source Catalogue (ERCSC). In particular, we discuss the steps involved in reducing the data from telemetry packets to cleaned, calibrated, time-ordered data (TOD) and frequency maps. Data are continuously calibrated using the modulation of the temperature of the cosmic microwave background radiation induced by the motion of the spacecraft. Noise properties are estimated from TOD from which the sky signal has been removed using a generalized least square map-making algorithm. Measured 1/f noise knee-frequencies range from 100mHz at 30GHz to a few tens of mHz at 70GHz. A destriping code (Madam) is employed to combine radiometric data and pointing information into sky maps, minimizing the variance of correlated noise. Noise covariance matrices required to compute statistical uncertainties on LFI and Planck products are also produced. Main beams are estimated down to the approx -10dB level using Jupiter transits, which are also used for geometrical calibration of the focal plane.

We develop a new Bayesian method for estimating white noise levels in CMB sky maps, and apply this algorithm to the 5-year WMAP data. We assume that the amplitude of the noise RMS is scaled by a constant value, alpha, relative to a pre-specified noise level. We then derive the corresponding conditional density, P(alpha | s, Cl, d), which is subsequently integrated into a general CMB Gibbs sampler. We first verify our code by analyzing simulated data sets, and then apply the framework to the WMAP data. For the foreground-reduced 5-year WMAP sky maps and the nominal noise levels initially provided in the 5-year data release, we find that the posterior means typically range between alpha=1.005 +- 0.001 and alpha=1.010 +- 0.001 depending on differencing assembly, indicating that the noise level of these maps are biased low by 0.5-1.0%. The same problem is not observed for the uncorrected WMAP sky maps. After the preprint version of this letter appeared on astro-ph., the WMAP team has corrected the values presented on their web page, noting that the initially provided values were in fact estimates from the 3-year data release, not from the 5-year estimates. However, internally in their 5-year analysis the correct noise values were used, and no cosmological results are therefore compromised by this error. Thus, our method has already been demonstrated in practice to be both useful and accurate.

A well-tested and validated Gibbs sampling code, that performs component separation and CMB power spectrum estimation, was applied to the {\it WMAP} 5-yr data. Using a simple model consisting of CMB, noise, monopoles and dipoles, a ``per pixel'' low-frequency power-law (fitting for both amplitude and spectral index), and a thermal dust template with fixed spectral index, we found that the low-$\ell$ ($\ell < 50$) CMB power spectrum is in good agreement with the published {\it WMAP}5 results. Residual monopoles and dipoles were found to be small ($\lesssim 3 \mu$K) or negligible in the 5-yr data. We comprehensively tested the assumptions that were made about the foregrounds (e.g. dust spectral index, power-law spectral index prior, templates), and found that the CMB power spectrum was insensitive to these choices. We confirm the asymmetry of power between the north and south ecliptic hemispheres, which appears to be robust against foreground modeling. The map of low frequency spectral indices indicates a steeper spectrum on average ($\beta=-2.97\pm0.21$) relative to those found at low ($\sim$GHz) frequencies.

Exploration of time domain is now a vibrant area of research in astronomy, driven by the advent of digital synoptic sky surveys. While panoramic surveys can detect variable or transient events, typically some follow-up observations are needed; for short-lived phenomena, a rapid response is essential. Ability to automatically classify and prioritize transient events for follow-up studies becomes critical as the data rates increase. We have been developing such methods using the data streams from the Palomar-Quest survey, the Catalina Sky Survey and others, using the VOEventNet framework. The goal is to automatically classify transient events, using the new measurements, combined with archival data (previous and multi-wavelength measurements), and contextual information (e.g., Galactic or ecliptic latitude, presence of a possible host galaxy nearby, etc.); and to iterate them dynamically as the follow-up data come in (e.g., light curves or colors). We have been investigating Bayesian methodologies for classification, as well as discriminated follow-up to optimize the use of available resources, including Naive Bayesian approach, and the non-parametric Gaussian process regression. We will also be deploying variants of the traditional machine learning techniques such as Neural Nets and Support Vector Machines on datasets of reliably classified transients as they build up.

We introduce a new CMB temperature likelihood approximation called the Gaussianized Blackwell-Rao (GBR) estimator. This estimator is derived by transforming the observed marginal power spectrum distributions obtained by the CMB Gibbs sampler into standard univariate Gaussians, and then approximate their joint transformed distribution by a multivariate Gaussian. The method is exact for full-sky coverage and uniform noise, and an excellent approximation for sky cuts and scanning patterns relevant for modern satellite experiments such as WMAP and Planck. A single evaluation of this estimator between l=2 and 200 takes ~0.2 CPU milliseconds, while for comparison, a single pixel space likelihood evaluation between l=2 and 30 for a map with ~2500 pixels requires ~20 seconds. We apply this tool to the 5-year WMAP temperature data, and re-estimate the angular temperature power spectrum, $C_{\ell}$, and likelihood, L(C_l), for l<=200, and derive new cosmological parameters for the standard six-parameter LambdaCDM model. Our spectrum is in excellent agreement with the official WMAP spectrum, but we find slight differences in the derived cosmological parameters. Most importantly, the spectral index of scalar perturbations is n_s=0.973 +/- 0.014, 1.9 sigma away from unity and 0.6 sigma higher than the official WMAP result, n_s = 0.965 +/- 0.014. This suggests that an exact likelihood treatment is required to higher l's than previously believed, reinforcing and extending our conclusions from the 3-year WMAP analysis. In that case, we found that the sub-optimal likelihood approximation adopted between l=12 and 30 by the WMAP team biased n_s low by 0.4 sigma, while here we find that the same approximation between l=30 and 200 introduces a bias of 0.6 sigma in n_s.

We present a new Monte Carlo Markov Chain algorithm for CMB analysis in the low signal-to-noise regime. This method builds on and complements the previously described CMB Gibbs sampler, and effectively solves the low signal-to-noise inefficiency problem of the direct Gibbs sampler. The new algorithm is a simple Metropolis-Hastings sampler with a general proposal rule for the power spectrum, C_l, followed by a particular deterministic rescaling operation of the sky signal. The acceptance probability for this joint move depends on the sky map only through the difference of chi-squared between the original and proposed sky sample, which is close to unity in the low signal-to-noise regime. The algorithm is completed by alternating this move with a standard Gibbs move. Together, these two proposals constitute a computationally efficient algorithm for mapping out the full joint CMB posterior, both in the high and low signal-to-noise regimes.

There is an increasing number of large, digital, synoptic sky surveys, in which repeated observations are obtained over large areas of the sky in multiple epochs. Likewise, there is a growth in the number of (often automated or robotic) follow-up facilities with varied capabilities in terms of instruments, depth, cadence, wavelengths, etc., most of which are geared toward some specific astrophysical phenomenon. As the number of detected transient events grows, an automated, probabilistic classification of the detected variables and transients becomes increasingly important, so that an optimal use can be made of follow-up facilities, without unnecessary duplication of effort. We describe a methodology now under development for a prototype event classification system; it involves Bayesian and Machine Learning classifiers, automated incorporation of feedback from follow-up observations, and discriminated or directed follow-up requests. This type of methodology may be essential for the massive synoptic sky surveys in the future.

We describe and implement an exact, flexible, and computationally efficient algorithm for joint component separation and CMB power spectrum estimation, building on a Gibbs sampling framework. Two essential new features are 1) conditional sampling of foreground spectral parameters, and 2) joint sampling of all amplitude-type degrees of freedom (e.g., CMB, foreground pixel amplitudes, and global template amplitudes) given spectral parameters. Given a parametric model of the foreground signals, we estimate efficiently and accurately the exact joint foreground-CMB posterior distribution, and therefore all marginal distributions such as the CMB power spectrum or foreground spectral index posteriors. The main limitation of the current implementation is the requirement of identical beam responses at all frequencies, which restricts the analysis to the lowest resolution of a given experiment. We outline a future generalization to multi-resolution observations. To verify the method, we analyse simple models and compare the results to analytical predictions. We then analyze a realistic simulation with properties similar to the 3-yr WMAP data, downgraded to a common resolution of 3 degree FWHM. The results from the actual 3-yr WMAP temperature analysis are presented in a companion Letter.

Using a Gibbs sampling algorithm for joint CMB estimation and component separation, we compute the large-scale CMB and foreground posteriors of the 3-yr WMAP temperature data. Our parametric data model includes the cosmological CMB signal and instrumental noise, a single power law foreground component with free amplitude and spectral index for each pixel, a thermal dust template with a single free overall amplitude, and free monopoles and dipoles at each frequency. This simple model yields a surprisingly good fit to the data over the full frequency range from 23 to 94 GHz. We obtain a new estimate of the CMB sky signal and power spectrum, and a new foreground model, including a measurement of the effective spectral index over the high-latitude sky. A particularly significant result is the detection of a common spurious offset in all frequency bands of ~ -13muK, as well as a dipole in the V-band data. Correcting for these is essential when determining the effective spectral index of the foregrounds. We find that our new foreground model is in good agreement with template-based model presented by the WMAP team, but not with their MEM reconstruction. We believe the latter may be at least partially compromised by the residual offsets and dipoles in the data. Fortunately, the CMB power spectrum is not significantly affected by these issues, as our new spectrum is in excellent agreement with that published by the WMAP team. The corresponding cosmological parameters are also virtually unchanged.

We apply a previously developed Gibbs sampling framework to the foreground corrected 3-yr WMAP polarization data and compute the power spectrum and residual foreground template amplitude posterior distributions. We first analyze the co-added Q- and V-band data, and compare our results to the likelihood code published by the WMAP team. We find good agreement, and thus verify the numerics and data processing steps of both approaches. However, we also analyze the Q- and V-bands separately, allowing for non-zero EB cross-correlations and including two individual foreground template amplitudes tracing synchrotron and dust emission. In these analyses, we find tentative evidence of systematics: The foreground tracers correlate with each of the Q- and V-band sky maps individually, although not with the co-added QV map; there is a noticeable negative EB cross-correlation at l <~ 16 in the V-band map; and finally, when relaxing the constraints on EB and BB, noticeable differences are observed between the marginalized band powers in the Q- and V-bands. Further studies of these features are imperative, given the importance of the low-l EE spectrum on the optical depth of reionization tau and the spectral index of scalar perturbations n_s.

We analyze the three-year WMAP temperature anisotropy data seeking to confirm the power spectrum and likelihoods published by the WMAP team. We apply five independent implementations of four algorithms to the power spectrum estimation and two implementations to the parameter estimation. Our single most important result is that we broadly confirm the WMAP power spectrum and analysis. Still, we do find two small but potentially important discrepancies: On large angular scales there is a small power excess in the WMAP spectrum (5-10% at l<~30) primarily due to likelihood approximation issues between 13 <= l <~30. On small angular scales there is a systematic difference between the V- and W-band spectra (few percent at l>~300). Recently, the latter discrepancy was explained by Huffenberger et al. (2006) in terms of over-subtraction of unresolved point sources. As far as the low-l bias is concerned, most parameters are affected by a few tenths of a sigma. The most important effect is seen in n_s. For the combination of WMAP, Acbar and BOOMERanG, the significance of n_s =/ 1 drops from ~2.7 sigma to ~2.3 sigma when correcting for this bias. We propose a few simple improvements to the low-l WMAP likelihood code, and introduce two important extensions to the Gibbs sampling method that allows for proper sampling of the low signal-to-noise regime. Finally, we make the products from the Gibbs sampling analysis publically available, thereby providing a fast and simple route to the exact likelihood without the need of expensive matrix inversions.

Earlier papers introduced a method of accurately estimating the angular cosmic microwave background (CMB) temperature power spectrum based on Gibbs sampling. Here we extend this framework to polarized data. All advantages of the Gibbs sampler still apply, and exact analysis of mega-pixel polarized data sets is thus feasible. These advantages may be even more important for polarization measurements than for temperature measurements. While approximate methods can alias power from the larger E-mode spectrum into the weaker B-mode spectrum, the Gibbs sampler (or equivalently, exact likelihood evaluations) allows for a statistically optimal separation of these modes in terms of power spectra. To demonstrate the method, we analyze two simulated data sets: 1) a hypothetical future CMBPol mission, with the focus on B-mode estimation; and 2) a Planck-like mission, to highlight the computational feasibility of the method.

We present the first results from a Bayesian analysis of the WMAP first year data using a Gibbs sampling technique. Using two independent, parallel supercomputer codes we analyze the WMAP Q, V and W bands. The analysis results in a full probabilistic description of the information the WMAP data set contains about the power spectrum and the all-sky map of the cosmic microwave background anisotropies. We present the complete probability distributions for each C_l including any non-Gaussianities of the power spectrum likelihood. While we find good overall agreement with the previously published WMAP spectrum, our analysis uncovers discrepancies in the power spectrum estimates at low l multipoles. For example we claim the best-fit Lambda-CDM model is consistent with the C_2 inferred from our combined Q+V+W analysis with a 10% probability of an even larger theoretical C_2. Based on our exact analysis we can therefore attribute the "low quadrupole issue" to a statistical fluctuation.

We study the Blackwell-Rao (BR) estimator of the probability distribution of the angular power spectrum, P(C_l|d), by applying it to samples of full-sky no-noise CMB maps generated via Gibbs sampling. We find the estimator, given a set of samples, to be very fast and also highly accurate, as determined by tests with simulated data. We also find that the number of samples required for convergence of the BR estimate rises rapidly with increasing l, at least at low l. Our existing sample chains are only long enough to achieve convergence at l less than about 40. In comparison with P(C_l|d) as reported by the WMAP team we find significant differences at these low l values. These differences lead to up to approximately 0.5 sigma shifts in the estimates of parameters in a 7-parameter Lambda CDM model with non-zero dn_s/dln(k). Fixing dn_s/dln(k)= 0 makes these shifts much less significant. Unlike existing analytic approximations, the BR estimator can be straightforwardly extended for the case of power spectra from correlated fields, such as temperature and polarization. We discuss challenges to extending the procedure to higher l and provide some solutions.

We revisit a recently introduced power spectrum estimation technique based on Gibbs sampling, with the goal of applying it to the high-resolution WMAP data. In order to facilitate this analysis, a number of sophistications have to be introduced, each of which is discussed in detail. We have implemented two independent versions of the algorithm to cross-check the computer codes, and to verify that a particular solution to any given problem does not affect the scientific results. We then apply these programs to simulated data with known properties at intermediate (N_side = 128) and high (N_side = 512) resolutions, to study effects such as incomplete sky coverage and white vs. correlated noise. From these simulations we also establish the Markov chain correlation length as a function of signal-to-noise ratio, and give a few comments on the properties of the correlation matrices involved. Parallelization issues are also discussed, with emphasis on real-world limitations imposed by current super-computer facilities. The scientific results from the analysis of the first-year WMAP data are presented in a companion letter.

Power spectrum estimation and evaluation of associated errors in the presence of incomplete sky coverage; non-homogeneous, correlated instrumental noise; and foreground emission is a problem of central importance for the extraction of cosmological information from the cosmic microwave background. We develop a Monte Carlo approach for the maximum likelihood estimation of the power spectrum. The method is based on an identity for the Bayesian posterior as a marginalization over unknowns. Maximization of the posterior involves the computation of expectation values as a sample average from maps of the cosmic microwave background and foregrounds given some current estimate of the power spectrum or cosmological model, and some assumed statistical characterization of the foregrounds. Maps of the CMB are sampled by a linear transform of a Gaussian white noise process, implemented numerically with conjugate gradient descent. For time series data with N_{t} samples, and N pixels on the sphere, the method has a computational expense $KO[N^{2} +- N_{t} +AFw-log N_{t}], where K is a prefactor determined by the convergence rate of conjugate gradient descent. Preconditioners for conjugate gradient descent are given for scans close to great circle paths, and the method allows partial sky coverage for these cases by numerically marginalizing over the unobserved, or removed, region.

Our ability to extract the maximal amount of information from future observations at gigahertz frequencies depends on our ability to separate the underlying cosmic microwave background (CMB) from galactic and extragalactic foregrounds. We review the separation problem and its formulation within Bayesian inference, give examples of specific solutions with particular choices of prior density, and finally comment on the generalization of Bayesian methods to a multi-resolution framework. We propose a strategy for the regularization of solutions allowing a spatially varying spectral index, and discuss possible computational approaches such as multi-scale stochastic relaxation.