A product of two Gaussians (or normal distributions) is another Gaussian. That's a valuable and useful fact! Here we use it to derive a refactoring of a common product of multivariate Gaussians: The product of a Gaussian likelihood times a Gaussian prior, where some or all of those parameters enter the likelihood only in the mean and only linearly. That is, a linear, Gaussian, Bayesian model. This product of a likelihood times a prior pdf can be refactored into a product of a marginalized likelihood (or a Bayesian evidence) times a posterior pdf, where (in this case) both of these are also Gaussian. The means and variance tensors of the refactored Gaussians are straightforward to obtain as closed-form expressions; here we deliver these expressions, with discussion. The closed-form expressions can be used to speed up and improve the precision of inferences that contain linear parameters with Gaussian priors. We connect these methods to inferences that arise frequently in physics and astronomy. If all you want is the answer, the question is posed and answered at the beginning of Section 3. We show two toy examples, in the form of worked exercises, in Section 4. The solutions, discussion, and exercises in this Note are aimed at someone who is already familiar with the basic ideas of Bayesian inference and probability.

We present SPECULATOR - a fast, accurate, and flexible framework for emulating stellar population synthesis (SPS) models for predicting galaxy spectra and photometry. For emulating spectra, we use principal component analysis to construct a set of basis functions, and neural networks to learn the basis coefficients as a function of the SPS model parameters. For photometry, we parameterize the magnitudes (for the filters of interest) as a function of SPS parameters by a neural network. The resulting emulators are able to predict spectra and photometry under both simple and complicated SPS model parameterizations to percent-level accuracy, giving a factor of $10^3$-$10^4$ speed up over direct SPS computation. They have readily-computable derivatives, making them amenable to gradient-based inference and optimization methods. The emulators are also straightforward to call from a GPU, giving an additional order-of-magnitude speed-up. Rapid SPS computations delivered by emulation offers a massive reduction in the computational resources required to infer the physical properties of galaxies from observed spectra or photometry and simulate galaxy populations under SPS models, whilst maintaining the accuracy required for a range of applications.

Recent works combining neutrino oscillation and cosmological data to determine the neutrino hierarchy found a range of odds in favour of the normal hierarchy. These results arise from differing approaches to incorporating prior knowledge about neutrinos. We develop a hierarchy-agnostic prior and show that the hierarchy cannot be conclusively determined with current data. The determination of the hierarchy is limited by the neutrino mass scale $\Sigma_{\nu}$ measurement. We obtain a target precision of $\sigma(\Sigma_{\nu}) = 0.014$ eV, necessary for conclusively establishing the normal hierarchy with future data.

We introduce a galaxy cluster mass observable, $\mu_\star$, based on the stellar masses of cluster members, and we present results for the Dark Energy Survey (DES) Year 1 observations. Stellar masses are computed using a Bayesian Model Averaging method, and are validated for DES data using simulations and COSMOS data. We show that $\mu_\star$ works as a promising mass proxy by comparing our predictions to X-ray measurements. We measure the X-ray temperature-$\mu_\star$ relation for a total of 150 clusters matched between the wide-field DES Year 1 redMaPPer catalogue, and Chandra and XMM archival observations, spanning the redshift range $0.1<z<0.7$. For a scaling relation which is linear in logarithmic space, we find a slope of $\alpha = 0.488\pm0.043$ and a scatter in the X-ray temperature at fixed $\mu_\star$ of $\sigma_{{\rm ln} T_X|\mu_\star}=0.266^{+0.019}_{-0.020}$ for the joint sample. By using the halo mass scaling relations of the X-ray temperature from the Weighing the Giants program, we further derive the $\mu_\star$-conditioned scatter in mass, finding $\sigma_{{\rm ln} M|\mu_\star}=0.26^{+ 0.15}_{- 0.10}$. These results are competitive with well-established cluster mass proxies used for cosmological analyses, showing that $\mu_\star$ can be used as a reliable and physically motivated mass proxy to derive cosmological constraints.

The cosmological exploitation of modern photometric galaxy surveys requires both accurate (unbiased) and precise (narrow) redshift probability distributions derived from broadband photometry. Existing methodologies do not meet those requirements. Standard template fitting delivers interpretable models and errors, but lacks flexibility to learn inaccuracies in the observed photometry or the spectral templates. Machine learning addresses those issues, but requires representative training data, and the resulting models and uncertainties cannot be interpreted in the context of a physical model or outside of the training data. We present a hierarchical modeling approach simultaneously addressing the issues of flexibility, interpretability, and generalization. It combines template fitting with flexible (machine learning-like) models to correct the spectral templates, model their redshift distributions, and recalibrate the photometric observations. By optimizing the full posterior distribution of the model and solving for its (thousands of) parameters, one can perform a global statistical calibration of the data and the SED model. We apply this approach to the public Dark Energy Survey Science Verification data, and show that it provides more accurate and compact redshift posterior distributions than existing methods, as well as insights into residual photometric and SED systematics. The model is causal, makes predictions for future data (e.g., additional photometric bandpasses), and its internal parameters and components are interpretable. This approach does not formally require the training data to be complete or representative; in principle it can even work in regimes in which few or no spectroscopic redshifts are available.

We describe the creation, content, and validation of the Dark Energy Survey (DES) internal year-one cosmology data set, Y1A1 GOLD, in support of upcoming cosmological analyses. The Y1A1 GOLD data set is assembled from multiple epochs of DES imaging and consists of calibrated photometric zeropoints, object catalogs, and ancillary data products - e.g., maps of survey depth and observing conditions, star-galaxy classification, and photometric redshift estimates - that are necessary for accurate cosmological analyses. The Y1A1 GOLD wide-area object catalog consists of ~137 million objects detected in coadded images covering ~1800 deg$^2$ in the DES grizY filters. The 10{\sigma} limiting magnitude for galaxies is g = 23.4, r = 23.2, i = 22.5, z = 21.8, and Y = 20.1. Photometric calibration of Y1A1 GOLD was performed by combining nightly zeropoint solutions with stellar-locus regression, and the absolute calibration accuracy is better than 2% over the survey area. DES Y1A1 GOLD is the largest photometric data set at the achieved depth to date, enabling precise measurements of cosmic acceleration at z $\lesssim$ 1.

Correlations measured in three dimensions in the Lyman-alpha forest are contaminated by the presence of the damping wings of high column density (HCD) absorbing systems of neutral hydrogen (HI; having column densities $N(\mathrm{HI}) > 1.6\times10^{17}\,\mathrm{atoms}\,\mathrm{cm}^{-2}$), which extend significantly beyond the redshift-space location of the absorber. We measure this effect as a function of the column density of the HCD absorbers and redshift by measuring 3D flux power spectra in cosmological hydrodynamical simulations from the Illustris project. Survey pipelines exclude regions containing the largest damping wings. We find that, even after this procedure, there is a scale-dependent correction to the 3D Lyman-alpha forest flux power spectrum from residual contamination. We model this residual using a simple physical model of the HCD absorbers as linearly biased tracers of the matter density distribution, convolved with their Voigt profiles and integrated over the column density distribution function. We recommend the use of this model over existing models used in data analysis, which approximate the damping wings as top-hats and so miss shape information in the extended wings. The simple 'linear Voigt model' is statistically consistent with our simulation results for a mock residual contamination up to small scales ($|k| < 1\,h\,\mathrm{Mpc}^{-1}$). It does not account for the effect of the highest column density absorbers on the smallest scales (e.g., $|k| > 0.4\,h\,\mathrm{Mpc}^{-1}$ for small damped Lyman-alpha absorbers; HCD absorbers with $N(\mathrm{HI}) \sim 10^{21}\,\mathrm{atoms}\,\mathrm{cm}^{-2}$). However, these systems are in any case preferentially removed from survey data. Our model is appropriate for an accurate analysis of the baryon acoustic oscillations feature. It is additionally essential for reconstructing the full shape of the 3D flux power spectrum.

Multiple stellar systems are ubiquitous in the Milky Way, but are often unresolved and seen as single objects in spectroscopic, photometric, and astrometric surveys. Yet, modeling them is essential for developing a full understanding of large surveys such as Gaia, and connecting them to stellar and Galactic models. In this paper we address this problem by jointly fitting the Gaia and 2MASS photometric and astrometric data using a data-driven Bayesian hierarchical model that includes populations of binary and trinary systems. This allows us to classify observations into singles, binaries, and trinaries, in a robust and efficient manner, without resorting to external models. We are able to identify multiple systems and, in some cases, make strong predictions for the properties of its unresolved stars. We will be able to compare such predictions with Gaia Data Release 4, which will contain astrometric identification and analysis of binary systems.

We measure the effect of high column density absorbing systems of neutral hydrogen (HI) on the one-dimensional (1D) Lyman-alpha forest flux power spectrum using cosmological hydrodynamical simulations from the Illustris project. High column density absorbers (which we define to be those with HI column densities $N(\mathrm{HI}) > 1.6 \times 10^{17}\,\mathrm{atoms}\,\mathrm{cm}^{-2}$) cause broadened absorption lines with characteristic damping wings. These damping wings bias the 1D Lyman-alpha forest flux power spectrum by causing absorption in quasar spectra away from the location of the absorber itself. We investigate the effect of high column density absorbers on the Lyman-alpha forest using hydrodynamical simulations for the first time. We provide templates as a function of column density and redshift, allowing the flexibility to accurately model residual contamination, i.e., if an analysis selectively clips out the largest damping wings. This flexibility will improve cosmological parameter estimation, e.g., allowing more accurate measurement of the shape of the power spectrum, with implications for cosmological models containing massive neutrinos or a running of the spectral index. We provide fitting functions to reproduce these results so that they can be incorporated straightforwardly into a data analysis pipeline.

We construct the largest curved-sky galaxy weak lensing mass map to date from the DES first-year (DES Y1) data. The map, about 10 times larger than previous work, is constructed over a contiguous $\approx1,500 $deg$^2$, covering a comoving volume of $\approx10 $Gpc$^3$. The effects of masking, sampling, and noise are tested using simulations. We generate weak lensing maps from two DES Y1 shear catalogs, Metacalibration and Im3shape, with sources at redshift $0.2<z<1.3,$ and in each of four bins in this range. In the highest signal-to-noise map, the ratio between the mean signal-to-noise in the E-mode and the B-mode map is $\sim$1.5 ($\sim$2) when smoothed with a Gaussian filter of $\sigma_{G}=30$ (80) arcminutes. The second and third moments of the convergence $\kappa$ in the maps are in agreement with simulations. We also find no significant correlation of $\kappa$ with maps of potential systematic contaminants. Finally, we demonstrate two applications of the mass maps: (1) cross-correlation with different foreground tracers of mass and (2) exploration of the largest peaks and voids in the maps.

Distances to individual stars in our own Galaxy are critical in order to piece together the nature of its velocity and spatial structure. Core helium burning red clump (RC) stars have similar luminosities, are abundant throughout the Galaxy, and thus constitute good standard candles. We build a hierarchical probabilistic model to quantify the quality of RC stars as standard candles using parallax measurements from the first Gaia data release. A unique aspect of our methodology is to fully account for (and marginalize over) parallax, photometry, and dust corrections uncertainties, which leads to more robust results than standard approaches. We determine the absolute magnitude and intrinsic dispersion of the RC in 2MASS bands J, H, Ks, Gaia G band, and WISE bands W1, W2, W3, and W4. We find that the absolute magnitude of the RC is $-1.61 \pm$ 0.01 (in Ks), $+0.44 \pm$ 0.01 (in G) , $-0.93 \pm$ 0.01 (in J), $-1.46 \pm$ 0.01 (in H), $-1.68 \pm$ 0.02 (in W1), $-1.69\pm$ 0.02 (in W2), $-1.67 \pm$ 0.02 (in W3), $1.76 \pm$ 0.01 mag (in W4). The mean intrinsic dispersion is $\sim 0.17 \pm$ 0.03 mag across all bands (yielding a typical distance precision of $\sim$ 8%). Thus RC stars are reliable and precise standard candles. In addition, we have also re-calibrated the zero point of the absolute magnitude of the RC in each band, which provide a benchmark for future studies to estimate distances to RC stars. Finally, the parallax error shrinkage in the hierarchical model outlined in this work can be used to obtain more precise parallaxes than Gaia for the most distant RC stars across the Galaxy.

Converting a noisy parallax measurement into a posterior belief over distance requires inference with a prior. Usually this prior represents beliefs about the stellar density distribution of the Milky Way. However, multi-band photometry exists for a large fraction of the \textsl{\small{Gaia}} \textsl{\small{TGAS}} Catalog and is incredibly informative about stellar distances. Here we use \textsl{\small{2MASS}} colors for 1.4 million \textsl{\small{TGAS}} stars to build a noise-deconvolved empirical prior distribution for stars in color--magnitude space. This model contains no knowledge of stellar astrophysics or the Milky Way, but is precise because it accurately generates a large number of noisy parallax measurements under an assumption of stationarity; that is, it is capable of combining the information from many stars. We use the Extreme Deconvolution (\textsl{\small{XD}}) algorithm---an Empirical Bayes approximation to a full hierarchical model of the true parallax and photometry of every star---to construct this prior. The prior is combined with a \textsl{\small{TGAS}} likelihood to infer a precise photometric parallax estimate and uncertainty (and full posterior) for every star. Our parallax estimates are more precise than the \textsl{\small{TGAS}} catalog entries by a median factor of 1.2 (14% are more precise by a factor >2) and are more precise than previous Bayesian distance estimates that use spatial priors. We validate our parallax inferences using members of the Milky Way star cluster M67, which is not visible as a cluster in the \textsl{\small{TGAS}} parallax estimates, but appears as a cluster in our posterior parallax estimates. Our results, including a parallax posterior pdf for each of 1.4 million \textsl{\small{TGAS}} stars, are available in companion electronic tables.

We construct a directional spin wavelet framework on the sphere by generalising the scalar scale-discretised wavelet transform to signals of arbitrary spin. The resulting framework is the only wavelet framework defined natively on the sphere that is able to probe the directional intensity of spin signals. Furthermore, directional spin scale-discretised wavelets support the exact synthesis of a signal on the sphere from its wavelet coefficients and satisfy excellent localisation and uncorrelation properties. Consequently, directional spin scale-discretised wavelets are likely to be of use in a wide range of applications and in particular for the analysis of the polarisation of the cosmic microwave background (CMB). We develop new algorithms to compute (scalar and spin) forward and inverse wavelet transforms exactly and efficiently for very large data-sets containing tens of millions of samples on the sphere. By leveraging a novel sampling theorem on the rotation group developed in a companion article, only half as many wavelet coefficients as alternative approaches need be computed, while still capturing the full information content of the signal under analysis. Our implementation of these algorithms is made publicly available.

We present the first constraints on cosmology from the Dark Energy Survey (DES), using weak lensing measurements from the preliminary Science Verification (SV) data. We use 139 square degrees of SV data, which is less than 3\% of the full DES survey area. Using cosmic shear 2-point measurements over three redshift bins we find $\sigma_8 (\Omega_{\rm m}/0.3)^{0.5} = 0.81 \pm 0.06$ (68\% confidence), after marginalising over 7 systematics parameters and 3 other cosmological parameters. We examine the robustness of our results to the choice of data vector and systematics assumed, and find them to be stable. About $20$\% of our error bar comes from marginalising over shear and photometric redshift calibration uncertainties. The current state-of-the-art cosmic shear measurements from CFHTLenS are mildly discrepant with the cosmological constraints from Planck CMB data; our results are consistent with both datasets. Our uncertainties are $\sim$30\% larger than those from CFHTLenS when we carry out a comparable analysis of the two datasets, which we attribute largely to the lower number density of our shear catalogue. We investigate constraints on dark energy and find that, with this small fraction of the full survey, the DES SV constraints make negligible impact on the Planck constraints. The moderate disagreement between the CFHTLenS and Planck values of $\sigma_8 (\Omega_{\rm m}/0.3)^{0.5}$ is present regardless of the value of $w$.

Convergence maps of the integrated matter distribution are a key science result from weak gravitational lensing surveys. To date, recovering convergence maps has been performed using a planar approximation of the celestial sphere. However, with the increasing area of sky covered by dark energy experiments, such as Euclid, the Large Synoptic Survey Telescope (LSST), and the Wide Field Infrared Survey Telescope (WFIRST), this assumption will no longer be valid. We extend the Kaiser-Squires technique for recovering convergence fields, restricted previously to the plane, to the spherical setting. Through simulations we study the error introduced by planar approximations. Moreover, we examine how best to recover convergence maps in the planar setting, considering a variety of different projections and defining the local rotations that are required when projecting spin fields such as cosmic shear. For the sky coverages typical of future surveys, errors introduced by projection effects can be of order tens of percent, exceeding 50% in some cases. The stereographic projection, which is conformal and so preserves local angles, is the most effective planar projection. In any case, these errors can be avoided entirely by recovering convergence fields directly on the celestial sphere. We apply the spherical Kaiser-Squires mass-mapping method presented to the public Dark Energy Survey (DES) science verification data to recover convergence maps directly on the celestial sphere.

We present a hierarchical probabilistic model for improving geometric stellar distance estimates using color--magnitude information. This is achieved with a data driven model of the color--magnitude diagram, not relying on stellar models but instead on the relative abundances of stars in color--magnitude cells, which are inferred from very noisy magnitudes and parallaxes. While the resulting noise-deconvolved color--magnitude diagram can be useful for a range of applications, we focus on deriving improved stellar distance estimates relying on both parallax and photometric information. We demonstrate the efficiency of this approach on the 1.4 million stars of the Gaia TGAS sample that also have APASS magnitudes. Our hierarchical model has 4~million parameters in total, most of which are marginalized out numerically or analytically. We find that distance estimates are significantly improved for the noisiest parallaxes and densest regions of the color--magnitude diagram. In particular, the average distance signal-to-noise ratio and uncertainty improve by 19~percent and 36~percent, respectively, with 8~percent of the objects improving in SNR by a factor greater than 2. This computationally efficient approach fully accounts for both parallax and photometric noise, and is a first step towards a full hierarchical probabilistic model of the Gaia data.

We compare two rotationally invariant decomposition techniques on linear polarisation data: the spin-2 spherical harmonic decomposition in two opposite parities, the $E$- and $B$-mode, and the multiscale analysis of the gradient of linear polarisation, $|\nabla \mathbf{P}|$. We demonstrate that both decompositions have similar properties in the image domain and the spatial frequency domain. They can be used as complementary tools for turbulence analysis of interstellar magnetic fields in order to develop a better understanding of the origin of energy sources for the turbulence, the origin of peculiar magnetic field structures and their underlying physics. We also introduce a new quantity $|\nabla EB|$ based on the $E$- and $B$-modes and we show that in the intermediate and small scales limit $|\nabla EB| \simeq |\nabla \mathbf{P}|$. Analysis of the 2.3 GHz S-band Polarization All Sky Survey (S -PASS) shows many extended coherent filament-like features appearing as 'double-jumps' in the $|\nabla \mathbf{P}|$ map that are correlated with negative and positive filaments of $B$-type polarisation. These local asymmetries between the two polarisation types, $E$ and $B$, of the non-thermal Galactic synchrotron emission have an influence on the $E$- and $B$-mode power spectra analyses. The wavelet-based formalism of the polarisation gradient analysis allows us to locate the position of $E$- or $B$-mode features responsible for the local asymmetries between the two polarisation types. In analysed subregions, the perturbations of the magnetic field are trigged by star clusters associated with HII regions, the Orion-Eridanus superbubble and the North Polar Spur at low Galactic latitude.

We present a new method for inferring photometric redshifts in deep galaxy and quasar surveys, based on a data driven model of latent spectral energy distributions (SEDs) and a physical model of photometric fluxes as a function of redshift. This conceptually novel approach combines the advantages of both machine-learning and template-fitting methods by building template SEDs directly from the training data. This is made computationally tractable with Gaussian Processes operating in flux--redshift space, encoding the physics of redshift and the projection of galaxy SEDs onto photometric band passes. This method alleviates the need of acquiring representative training data or constructing detailed galaxy SED models; it requires only that the photometric band passes and calibrations be known or have parameterized unknowns. The training data can consist of a combination of spectroscopic and deep many-band photometric data, which do not need to entirely spatially overlap with the target survey of interest or even involve the same photometric bands. We showcase the method on the $i$-magnitude-selected, spectroscopically-confirmed galaxies in the COSMOS field. The model is trained on the deepest bands (from SUBARU and HST) and photometric redshifts are derived using the shallower SDSS optical bands only. We demonstrate that we obtain accurate redshift point estimates and probability distributions despite the training and target sets having very different redshift distributions, noise properties, and even photometric bands. Our model can also be used to predict missing photometric fluxes, or to simulate populations of galaxies with realistic fluxes and redshifts, for example. This method opens a new era in which photometric redshifts for large photometric surveys are derived using a flexible yet physical model of the data trained on all available surveys (spectroscopic and photometric).

We present new methods for mapping the curl-free (E-mode) and divergence-free (B-mode) components of spin 2 signals using spin directional wavelets. Our methods are equally applicable to measurements of the polarisation of the cosmic microwave background (CMB) and the shear of galaxy shapes due to weak gravitational lensing. We derive pseudo and pure wavelet estimators, where E-B mixing arising due to incomplete sky coverage is suppressed in wavelet space using scale- and orientation-dependent masking and weighting schemes. In the case of the pure estimator, ambiguous modes (which have vanishing curl and divergence simultaneously on the incomplete sky) are also cancelled. On simulations, we demonstrate the improvement (i.e., reduction in leakage) provided by our wavelet space estimators over standard harmonic space approaches. Our new methods can be directly interfaced in a coherent and computationally-efficient manner with component separation or feature extraction techniques that also exploit wavelets.

Curvelets are efficient to represent highly anisotropic signal content, such as a local linear and curvilinear structure. First-generation curvelets on the sphere, however, suffered from blocking artefacts. We present a new second-generation curvelet transform, where scale-discretised curvelets are constructed directly on the sphere. Scale-discretised curvelets exhibit a parabolic scaling relation, are well-localised in both spatial and harmonic domains, support the exact analysis and synthesis of both scalar and spin signals, and are free of blocking artefacts. We present fast algorithms to compute the exact curvelet transform, reducing computational complexity from $\mathcal{O}(L^5)$ to $\mathcal{O}(L^3\log_{2}{L})$ for signals band-limited at $L$. The implementation of these algorithms is made publicly available. Finally, we present an illustrative application demonstrating the effectiveness of curvelets for representing directional curve-like features in natural spherical images.

With the steadily improving sensitivity afforded by current and future galaxy surveys, a robust extraction of two-point correlation function measurements may become increasingly hampered by the presence of astrophysical foregrounds or observational systematics. The concept of mode projection has been introduced as a means to remove contaminants for which it is possible to construct a spatial map reflecting the expected signal contribution. Owing to its computational efficiency compared to minimum-variance methods, the sub-optimal pseudo-Cl (PCL) power spectrum estimator is a popular tool for the analysis of high-resolution data sets. Here, we integrate mode projection into the framework of PCL power spectrum estimation. In contrast to results obtained with optimal estimators, we show that the uncorrected projection of template maps leads to biased power spectra. Based on analytical calculations, we find exact closed-form expressions for the expectation value of the bias and demonstrate that they can be recast in a form that allows a numerically efficient evaluation, preserving the favorable O(l_max^3) time complexity of PCL estimator algorithms. Using simulated data sets, we assess the scaling of the bias with various analysis parameters and demonstrate that it can be reliably removed. We conclude that in combination with mode projection, PCL estimators allow for a fast and robust computation of power spectra in the presence of systematic effects -- properties in high demand for the analysis of ongoing and future large scale structure surveys.

We present Spin-SILC, a new foreground component separation method that accurately extracts the cosmic microwave background (CMB) polarisation $E$ and $B$ modes from raw multifrequency Stokes $Q$ and $U$ measurements of the microwave sky. Spin-SILC is an internal linear combination method that uses spin wavelets to analyse the spin-2 polarisation signal $P = Q + iU$. The wavelets are additionally directional (non-axisymmetric). This allows different morphologies of signals to be separated and therefore the cleaning algorithm is localised using an additional domain of information. The advantage of spin wavelets over standard scalar wavelets is to simultaneously and self-consistently probe scales and directions in the polarisation signal $P = Q + iU$ and in the underlying $E$ and $B$ modes, therefore providing the ability to perform component separation and $E$-$B$ decomposition concurrently for the first time. We test Spin-SILC on full-mission Planck simulations and data and show the capacity to correctly recover the underlying cosmological $E$ and $B$ modes. We also demonstrate a strong consistency of our CMB maps with those derived from existing component separation methods. Spin-SILC can be combined with the pseudo- and pure $E$-$B$ spin wavelet estimators presented in a companion paper to reliably extract the cosmological signal in the presence of complicated sky cuts and noise. Therefore, it will provide a computationally-efficient method to accurately extract the CMB $E$ and $B$ modes for future polarisation experiments.

We present measurements of weak gravitational lensing cosmic shear two-point statistics using Dark Energy Survey Science Verification data. We demonstrate that our results are robust to the choice of shear measurement pipeline, either ngmix or im3shape, and robust to the choice of two-point statistic, including both real and Fourier-space statistics. Our results pass a suite of null tests including tests for B-mode contamination and direct tests for any dependence of the two-point functions on a set of 16 observing conditions and galaxy properties, such as seeing, airmass, galaxy color, galaxy magnitude, etc. We furthermore use a large suite of simulations to compute the covariance matrix of the cosmic shear measurements and assign statistical significance to our null tests. We find that our covariance matrix is consistent with the halo model prediction, indicating that it has the appropriate level of halo sample variance. We compare the same jackknife procedure applied to the data and the simulations in order to search for additional sources of noise not captured by the simulations. We find no statistically significant extra sources of noise in the data. The overall detection significance with tomography for our highest source density catalog is 9.7sigma. Cosmological constraints from the measurements in this work are presented in a companion paper (DES et al. 2015).

We present new clean maps of the CMB temperature anisotropies (as measured by Planck) constructed with a novel internal linear combination (ILC) algorithm using directional, scale-discretised wavelets --- Scale-discretised, directional wavelet ILC or SILC. Directional wavelets, when convolved with signals on the sphere, can separate the anisotropic filamentary structures which are characteristic of both the CMB and foregrounds. Extending previous component separation methods, which use the frequency, spatial and harmonic signatures of foregrounds to separate them from the cosmological background signal, SILC can additionally use morphological information in the foregrounds and CMB to better localise the cleaning algorithm. We test the method on Planck data and simulations, demonstrating consistency with existing component separation algorithms, and discuss how to optimise the use of morphological information by varying the number of directional wavelets as a function of spatial scale. We find that combining the use of directional and axisymmetric wavelets depending on scale could yield higher quality CMB temperature maps. Our results set the stage for the application of SILC to polarisation anisotropies through an extension to spin wavelets.

SPHEREx is a proposed SMEX mission selected for Phase A. SPHEREx will carry out the first all-sky spectral survey and provide for every 6.2" pixel a spectra between 0.75 and 4.18 $\mu$m [with R$\sim$41.4] and 4.18 and 5.00 $\mu$m [with R$\sim$135]. The SPHEREx team has proposed three specific science investigations to be carried out with this unique data set: cosmic inflation, interstellar and circumstellar ices, and the extra-galactic background light. It is readily apparent, however, that many other questions in astrophysics and planetary sciences could be addressed with the SPHEREx data. The SPHEREx team convened a community workshop in February 2016, with the intent of enlisting the aid of a larger group of scientists in defining these questions. This paper summarizes the rich and varied menu of investigations that was laid out. It includes studies of the composition of main belt and Trojan/Greek asteroids; mapping the zodiacal light with unprecedented spatial and spectral resolution; identifying and studying very low-metallicity stars; improving stellar parameters in order to better characterize transiting exoplanets; studying aliphatic and aromatic carbon-bearing molecules in the interstellar medium; mapping star formation rates in nearby galaxies; determining the redshift of clusters of galaxies; identifying high redshift quasars over the full sky; and providing a NIR spectrum for most eROSITA X-ray sources. All of these investigations, and others not listed here, can be carried out with the nominal all-sky spectra to be produced by SPHEREx. In addition, the workshop defined enhanced data products and user tools which would facilitate some of these scientific studies. Finally, the workshop noted the high degrees of synergy between SPHEREx and a number of other current or forthcoming programs, including JWST, WFIRST, Euclid, GAIA, K2/Kepler, TESS, eROSITA and LSST.

Accurately characterizing the redshift distributions of galaxies is essential for analysing deep photometric surveys and testing cosmological models. We present a technique to simultaneously infer redshift distributions and individual redshifts from photometric galaxy catalogues. Our model constructs a piecewise constant representation (effectively a histogram) of the distribution of galaxy types and redshifts, the parameters of which are efficiently inferred from noisy photometric flux measurements. This approach can be seen as a generalization of template-fitting photometric redshift methods and relies on a library of spectral templates to relate the photometric fluxes of individual galaxies to their redshifts. We illustrate this technique on simulated galaxy survey data, and demonstrate that it delivers correct posterior distributions on the underlying type and redshift distributions, as well as on the individual types and redshifts of galaxies. We show that even with uninformative priors, large photometric errors and parameter degeneracies, the redshift and type distributions can be recovered robustly thanks to the hierarchical nature of the model, which is not possible with common photometric redshift estimation techniques. As a result, redshift uncertainties can be fully propagated in cosmological analyses for the first time, fulfilling an essential requirement for the current and future generations of surveys.

Accurate statistical measurement with large imaging surveys has traditionally required throwing away a sizable fraction of the data. This is because most measurements have have relied on selecting nearly complete samples, where variations in the composition of the galaxy population with seeing, depth, or other survey characteristics are small. We introduce a new measurement method that aims to minimize this wastage, allowing precision measurement for any class of stars or galaxies detectable in an imaging survey. We have implemented our proposal in Balrog, a software package which embeds fake objects in real imaging in order to accurately characterize measurement biases. We demonstrate this technique with an angular clustering measurement using Dark Energy Survey (DES) data. We first show that recovery of our injected galaxies depends on a wide variety of survey characteristics in the same way as the real data. We then construct a flux-limited sample of the faintest galaxies in DES, chosen specifically for their sensitivity to depth and seeing variations. Using the synthetic galaxies as randoms in the standard Landy-Szalay correlation function estimator suppresses the effects of variable survey selection by at least two orders of magnitude. With this correction, our measured angular clustering is found to be in excellent agreement with that of a matched sample drawn from much deeper, higher-resolution space-based Cosmological Evolution Survey (COSMOS) imaging; over angular scales of $0.004^{\circ} < \theta < 0.2^{\circ}$, we find a best-fit scaling amplitude between the DES and COSMOS measurements of $1.00 \pm 0.09$. We expect this methodology to be broadly useful for extending the statistical reach of measurements in a wide variety of coming imaging surveys.

We measure the cross-correlation between the galaxy density in the Dark Energy Survey (DES) Science Verification data and the lensing of the cosmic microwave background (CMB) as reconstructed with the Planck satellite and the South Pole Telescope (SPT). When using the DES main galaxy sample over the full redshift range $0.2 < z < 1.2$, a cross-correlation signal is detected at $6 \sigma$ and $4\sigma$ with SPT and Planck respectively. We then divide the DES galaxies into five photometric redshift bins, finding significant ($>$$2 \sigma$) detections in all bins. Comparing to the fiducial Planck cosmology, we find the redshift evolution of the signal matches expectations, although the amplitude is consistently lower than predicted across redshift bins. We test for possible systematics that could affect our result and find no evidence for significant contamination. Finally, we demonstrate how these measurements can be used to constrain the growth of structure across cosmic time. We find the data are fit by a model in which the amplitude of structure in the $z<1.2$ universe is $0.73 \pm 0.16$ times as large as predicted in the LCDM Planck cosmology, a $1.7\sigma$ deviation.

We develop a novel sampling theorem for functions defined on the three-dimensional rotation group SO(3) by connecting the rotation group to the three-torus through a periodic extension. Our sampling theorem requires $4L^3$ samples to capture all of the information content of a signal band-limited at $L$, reducing the number of required samples by a factor of two compared to other equiangular sampling theorems. We present fast algorithms to compute the associated Fourier transform on the rotation group, the so-called Wigner transform, which scale as $O(L^4)$, compared to the naive scaling of $O(L^6)$. For the common case of a low directional band-limit $N$, complexity is reduced to $O(N L^3)$. Our fast algorithms will be of direct use in speeding up the computation of directional wavelet transforms on the sphere. We make our SO3 code implementing these algorithms publicly available.

We construct the spin flaglet transform, a wavelet transform to analyze spin signals in three dimensions. Spin flaglets can probe signal content localized simultaneously in space and frequency and, moreover, are separable so that their angular and radial properties can be controlled independently. They are particularly suited to analyzing of cosmological observations such as the weak gravitational lensing of galaxies. Such observations have a unique 3D geometrical setting since they are natively made on the sky, have spin angular symmetries, and are extended in the radial direction by additional distance or redshift information. Flaglets are constructed in the harmonic space defined by the Fourier-Laguerre transform, previously defined for scalar functions and extended here to signals with spin symmetries. Thanks to various sampling theorems, both the Fourier-Laguerre and flaglet transforms are theoretically exact when applied to bandlimited signals. In other words, in numerical computations the only loss of information is due to the finite representation of floating point numbers. We develop a 3D framework relating the weak lensing power spectrum to covariances of flaglet coefficients. We suggest that the resulting novel flaglet weak lensing estimator offers a powerful alternative to common 2D and 3D approaches to accurately capture cosmological information. While standard weak lensing analyses focus on either real or harmonic space representations (i.e., correlation functions or Fourier-Bessel power spectra, respectively), a wavelet approach inherits the advantages of both techniques, where both complicated sky coverage and uncertainties associated with the physical modeling of small scales can be handled effectively. Our codes to compute the Fourier-Laguerre and flaglet transforms are made publicly available.

We study the clustering of galaxies detected at $i<22.5$ in the Science Verification observations of the Dark Energy Survey (DES). Two-point correlation functions are measured using $2.3\times 10^6$ galaxies over a contiguous 116 deg$^2$ region in five bins of photometric redshift width $\Delta z = 0.2$ in the range $0.2 < z < 1.2.$ The impact of photometric redshift errors are assessed by comparing results using a template-based photo-$z$ algorithm (BPZ) to a machine-learning algorithm (TPZ). A companion paper (Leistedt et al 2015) presents maps of several observational variables (e.g. seeing, sky brightness) which could modulate the galaxy density. Here we characterize and mitigate systematic errors on the measured clustering which arise from these observational variables, in addition to others such as Galactic dust and stellar contamination. After correcting for systematic effects we measure galaxy bias over a broad range of linear scales relative to mass clustering predicted from the Planck $\Lambda$CDM model, finding agreement with CFHTLS measurements with $\chi^2$ of 4.0 (8.7) with 5 degrees of freedom for the TPZ (BPZ) redshifts. We test a "linear bias" model, in which the galaxy clustering is a fixed multiple of the predicted non-linear dark-matter clustering. The precision of the data allow us to determine that the linear bias model describes the observed galaxy clustering to $2.5\%$ accuracy down to scales at least $4$ to $10$ times smaller than those on which linear theory is expected to be sufficient.

Measuring the angular clustering of galaxies as a function of redshift is a powerful method for extracting information from the three-dimensional galaxy distribution. The precision of such measurements will dramatically increase with ongoing and future wide-field galaxy surveys. However, these are also increasingly sensitive to observational and astrophysical contaminants. Here, we study the statistical properties of three methods proposed for controlling such systematics -- template subtraction, basic mode projection, and extended mode projection -- all of which make use of externally supplied template maps, designed to characterise and capture the spatial variations of potential systematic effects. Based on a detailed mathematical analysis, and in agreement with simulations, we find that the template subtraction method in its original formulation returns biased estimates of the galaxy angular clustering. We derive closed-form expressions that should be used to correct results for this shortcoming. Turning to the basic mode projection algorithm, we prove it to be free of any bias, whereas we conclude that results computed with extended mode projection are biased. Within a simplified setup, we derive analytical expressions for the bias and discuss the options for correcting it in more realistic configurations. Common to all three methods is an increased estimator variance induced by the cleaning process, albeit at different levels. These results enable unbiased high-precision clustering measurements in the presence of spatially-varying systematics, an essential step towards realising the full potential of current and planned galaxy surveys.

We present photometric redshift estimates for galaxies used in the weak lensing analysis of the Dark Energy Survey Science Verification (DES SV) data. Four model- or machine learning-based photometric redshift methods -- ANNZ2, BPZ calibrated against BCC-Ufig simulations, SkyNet, and TPZ -- are analysed. For training, calibration, and testing of these methods, we construct a catalogue of spectroscopically confirmed galaxies matched against DES SV data. The performance of the methods is evaluated against the matched spectroscopic catalogue, focusing on metrics relevant for weak lensing analyses, with additional validation against COSMOS photo-zs. From the galaxies in the DES SV shear catalogue, which have mean redshift $0.72\pm0.01$ over the range $0.3<z<1.3$, we construct three tomographic bins with means of $z=\{0.45, 0.67, 1.00\}$. These bins each have systematic uncertainties $\delta z \lesssim 0.05$ in the mean of the fiducial SkyNet photo-z $n(z)$. We propagate the errors in the redshift distributions through to their impact on cosmological parameters estimated with cosmic shear, and find that they cause shifts in the value of $\sigma_8$ of approx. 3%. This shift is within the one sigma statistical errors on $\sigma_8$ for the DES SV shear catalog. We further study the potential impact of systematic differences on the critical surface density, $\Sigma_{\mathrm{crit}}$, finding levels of bias safely less than the statistical power of DES SV data. We recommend a final Gaussian prior for the photo-z bias in the mean of $n(z)$ of width $0.05$ for each of the three tomographic bins, and show that this is a sufficient bias model for the corresponding cosmology analysis.

Spatially-varying depth and characteristics of observing conditions, such as seeing, airmass, or sky background, are major sources of systematic uncertainties in modern galaxy survey analyses, in particular in deep multi-epoch surveys. We present a framework to extract and project these sources of systematics onto the sky, and apply it to the Dark Energy Survey (DES) to map the observing conditions of the Science Verification (SV) data. The resulting distributions and maps of sources of systematics are used in several analyses of DES SV to perform detailed null tests with the data, and also to incorporate systematics in survey simulations. We illustrate the complementarity of these two approaches by comparing the SV data with the BCC-UFig, a synthetic sky catalogue generated by forward-modelling of the DES SV images. We analyse the BCC-UFig simulation to construct galaxy samples mimicking those used in SV galaxy clustering studies. We show that the spatially-varying survey depth imprinted in the observed galaxy densities and the redshift distributions of the SV data are successfully reproduced by the simulation and well-captured by the maps of observing conditions. The combined use of the maps, the SV data and the BCC-UFig simulation allows us to quantify the impact of spatial systematics on $N(z)$, the redshift distributions inferred using photometric redshifts. We conclude that spatial systematics in the SV data are mainly due to seeing fluctuations and are under control in current clustering and weak lensing analyses. The framework presented here is relevant to all multi-epoch surveys, and will be essential for exploiting future surveys such as the Large Synoptic Survey Telescope (LSST), which will require detailed null-tests and realistic end-to-end image simulations to correctly interpret the deep, high-cadence observations of the sky.

Weak gravitational lensing allows one to reconstruct the spatial distribution of the projected mass density across the sky. These "mass maps" provide a powerful tool for studying cosmology as they probe both luminous and dark matter. In this paper, we present a weak lensing mass map reconstructed from shear measurements in a 139 sq. deg area from the Dark Energy Survey (DES) Science Verification (SV) data. We compare the distribution of mass with that of the foreground distribution of galaxies and clusters. The overdensities in the reconstructed map correlate well with the distribution of optically detected clusters. We demonstrate that candidate superclusters and voids along the line of sight can be identified, exploiting the tight scatter of the cluster photometric redshifts. We cross-correlate the mass map with a foreground magnitude-limited galaxy sample from the same data. Our measurement gives results consistent with mock catalogs from N-body simulations that include the primary sources of statistical uncertainties in the galaxy, lensing, and photo-z catalogs. The statistical significance of the cross-correlation is at the 6.8-sigma level with 20 arcminute smoothing. A major goal of this study is to investigate systematic effects arising from a variety of sources, including PSF and photo-z uncertainties. We make maps derived from twenty variables that may characterize systematics and find the principal components. We find that the contribution of systematics to the lensing mass maps is generally within measurement uncertainties. In this work, we analyze less than 3% of the final area that will be mapped by the DES; the tools and analysis techniques developed in this paper can be applied to forthcoming larger datasets from the survey.

We introduce redMaGiC, an automated algorithm for selecting Luminous Red Galaxies (LRGs). The algorithm was specifically developed to minimize photometric redshift uncertainties in photometric large-scale structure studies. redMaGiC achieves this by self-training the color-cuts necessary to produce a luminosity-thresholded LRG sample of constant comoving density. We demonstrate that redMaGiC photozs are very nearly as accurate as the best machine-learning based methods, yet they require minimal spectroscopic training, do not suffer from extrapolation biases, and are very nearly Gaussian. We apply our algorithm to Dark Energy Survey (DES) Science Verification (SV) data to produce a redMaGiC catalog sampling the redshift range $z\in[0.2,0.8]$. Our fiducial sample has a comoving space density of $10^{-3}\ (h^{-1} Mpc)^{-3}$, and a median photoz bias ($z_{spec}-z_{photo}$) and scatter $(\sigma_z/(1+z))$ of 0.005 and 0.017 respectively. The corresponding $5\sigma$ outlier fraction is 1.4%. We also test our algorithm with Sloan Digital Sky Survey (SDSS) Data Release 8 (DR8) and Stripe 82 data, and discuss how spectroscopic training can be used to control photoz biases at the 0.1% level.

We present a forward-modelling simulation framework designed to model the data products from the Dark Energy Survey (DES). This forward-model process can be thought of as a transfer function -- a mapping from cosmological and astronomical signals to the final data products used by the scientists. Using output from the cosmological simulations (the Blind Cosmology Challenge), we generate simulated images (the Ultra Fast Image Simulator, Berge et al. 2013) and catalogs representative of the DES data. In this work we simulate the 244 sq. deg coadd images and catalogs in 5 bands for the DES Science Verification (SV) data. The simulation output is compared with the corresponding data to show that major characteristics of the images and catalogs can be captured. We also point out several directions of future improvements. Two practical examples, star/galaxy classification and proximity effects on object detection, are then used to demonstrate how one can use the simulations to address systematics issues in data analysis. With clear understanding of the simplifications in our model, we show that one can use the simulations side-by-side with data products to interpret the measurements. This forward modelling approach is generally applicable for other upcoming and future surveys. It provides a powerful tool for systematics studies which is sufficiently realistic and highly controllable.

We present optimal measurements of the angular power spectrum of the XDQSOz catalogue of photometric quasars from the Sloan Digital Sky Survey. These measurements rely on a quadratic maximum likelihood estimator that simultaneously measures the auto- and cross-power spectra of four redshift samples, and provides minimum-variance, unbiased estimates even at the largest angular scales. Since photometric quasars are known to be strongly affected by systematics such as spatially-varying depth and stellar contamination, we introduce a new framework of extended mode projection to robustly mitigate the impact of systematics on the power spectrum measurements. This technique involves constructing template maps of potential systematics, decorrelating them on the sky, and projecting out modes which are significantly correlated with the data. Our method is able to simultaneously process several thousands of nonlinearly-correlated systematics, and mode projection is performed in a blind fashion. Using our final power spectrum measurements, we find a good agreement with theoretical predictions, and no evidence for further contamination by systematics. Extended mode projection not only obviates the need for aggressive sky and quality cuts, but also provides control over the level of systematics in the measurements, enabling the search for small signals of new physics while avoiding confirmation bias.

We derive robust constraints on primordial non-Gaussianity (PNG) using the clustering of 800,000 photometric quasars from the Sloan Digital Sky Survey in the redshift range $0.5<z<3.5$. These measurements rely on the novel technique of {\it extended mode projection} to control the impact of spatially-varying systematics in a robust fashion, making use of blind analysis techniques. This allows the accurate measurement of quasar halo bias at the largest scales, while discarding as little as possible of the data. The standard local-type PNG parameters $f_\mathrm{NL}$ and $g_\mathrm{NL}$ both imprint a $k^{-2}$ scale-dependent effect in the bias. Constraining these individually, we obtain $-49<f_\mathrm{NL}<31$ and $-2.7\times10^5<g_\mathrm{NL}<1.9\times10^5$, while their joint constraints lead to $-105<f_\mathrm{NL}<72$ and $-4.0\times10^5<g_\mathrm{NL}<4.9\times10^5$ (all at 95% CL) . Introducing a running parameter $n_{f_\mathrm{NL}}$ to constrain $b(k) \propto k^{-2+n_{f_\mathrm{NL}}}$ and a generalised PNG amplitude $\tilde{f}_\mathrm{NL}$, we obtain $-45.5 \exp({3.7\, n_{f_\mathrm{NL}}}) < \tilde{f}_\mathrm{NL} < 34.4 \exp({3.3\, n_{f_\mathrm{NL}}})$ at 95% CL. These results incorporate uncertainties in the cosmological parameters, redshift distributions, shot noise, and the bias prescription used to relate the quasar clustering to the underlying dark matter. These are the strongest constraints obtained to date on PNG using a single population of large-scale structure tracers, and are already at the level of pre-{\it Planck} constraints from the cosmic microwave background. A conservative forecast for a {\it Large Synoptic Survey Telescope}-like survey incorporating mode projection yields $\sigma(f_\mathrm{NL}) \sim 5$ -- competitive with the {\it Planck} result -- highlighting the power of upcoming large scale structure surveys to probe the initial conditions of the universe.

We discuss a new scale-discretised directional wavelet transform to analyse spin signals defined on the sphere, in particular the polarisation of the cosmic microwave background (CMB).

A new spin wavelet transform on the sphere is proposed to analyse the polarisation of the cosmic microwave background (CMB), a spin $\pm 2$ signal observed on the celestial sphere. The scalar directional scale-discretised wavelet transform on the sphere is extended to analyse signals of arbitrary spin. The resulting spin scale-discretised wavelet transform probes the directional intensity of spin signals. A procedure is presented using this new spin wavelet transform to recover E- and B-mode signals from partial-sky observations of CMB polarisation.

It has been claimed recently that massive sterile neutrinos could bring about a new concordance between observations of the cosmic microwave background (CMB), the large-scale structure (LSS) of the Universe, and local measurements of the Hubble constant, $H_0$. We demonstrate that this apparent concordance results from combining datasets which are in significant tension, even within this extended model, possibly indicating remaining systematic biases in the measurements. We further show that this tension remains when the cosmological model is further extended to include significant tensor modes, as suggested by the recent BICEP2 results. Using the Bayesian evidence, we show that the minimal $\Lambda$CDM model is strongly favoured over its neutrino extensions by various combinations of datasets. Robust data combinations yield stringent limits of $\sum m_\nu\lesssim0.3$ eV and $m_{\nu,{\rm sterile}}^{\rm eff} \lesssim 0.3$ eV at $95\%$ CL for the sum of active and sterile neutrinos, respectively.

We describe S2LET, a fast and robust implementation of the scale-discretised wavelet transform on the sphere. Wavelets are constructed through a tiling of the harmonic line and can be used to probe spatially localised, scale-depended features of signals on the sphere. The scale-discretised wavelet transform was developed previously and reduces to the needlet transform in the axisymmetric case. The reconstruction of a signal from its wavelets coefficients is made exact here through the use of a sampling theorem on the sphere. Moreover, a multiresolution algorithm is presented to capture all information of each wavelet scale in the minimal number of samples on the sphere. In addition S2LET supports the HEALPix pixelisation scheme, in which case the transform is not exact but nevertheless achieves good numerical accuracy. The core routines of S2LET are written in C and have interfaces in Matlab, IDL and Java. Real signals can be written to and read from FITS files and plotted as Mollweide projections. The S2LET code is made publicly available, is extensively documented, and ships with several examples in the four languages supported. At present the code is restricted to axisymmetric wavelets but will be extended to directional, steerable wavelets in a future release.

Pressing questions in cosmology such as the nature of dark matter and dark energy can be addressed using large galaxy surveys, which measure the positions, properties and redshifts of galaxies in order to map the large-scale structure of the Universe. We review the Fourier-Laguerre transform, a novel transform in 3D spherical coordinates which is based on spherical harmonics combined with damped Laguerre polynomials and appropriate for analysing galaxy surveys. We also recall the construction of flaglets, 3D wavelets obtained through a tiling of the Fourier-Laguerre space, which can be used to extract scale-dependent, spatially localised features on the ball. We exploit a sampling theorem to obtain exact Fourier-Laguerre and flaglet transforms, such that band-limited signals can analysed and reconstructed at floating point accuracy on a finite number of voxels on the ball. We present a potential application of the flaglet transform for finding voids in galaxy surveys and studying the large-scale structure of the Universe.

The angular power spectrum is a powerful statistic for analysing cosmological signals imprinted in the clustering of matter. However, current galaxy and quasar surveys cover limited portions of the sky, and are contaminated by systematics that can mimic cosmological signatures and jeopardise the interpretation of the measured power spectra. We provide a framework for obtaining unbiased estimates of the angular power spectra of large-scale structure surveys at the largest scales using quadratic estimators. The method is tested by analysing the 600 CMASS mock catalogues constructed by Manera et al. (2013) for the Baryon Oscillation Spectroscopic Survey (BOSS). We then consider the Richards et al. (2009) catalogue of photometric quasars from the Sixth Data Release (DR6) of the Sloan Digital Sky Survey (SDSS), which is known to include significant stellar contamination and systematic uncertainties. Focusing on the sample of ultraviolet-excess (UVX) sources, we show that the excess clustering power present on the largest-scales can be largely mitigated by making use of improved sky masks and projecting out the modes corresponding to the principal systematics. In particular, we find that the sample of objects with photometric redshift $1.3 < z_p < 2.2$ exhibits no evidence of contamination when using our most conservative mask and mode projection. This indicates that any residual systematics are well within the statistical uncertainties. We conclude that, using our approach, this sample can be used for cosmological studies.

We review the Fourier-Laguerre transform, an alternative harmonic analysis on the three-dimensional ball to the usual Fourier-Bessel transform. The Fourier-Laguerre transform exhibits an exact quadrature rule and thus leads to a sampling theorem on the ball. We study the definition of convolution on the ball in this context, showing explicitly how translation on the radial line may be viewed as convolution with a shifted Dirac delta function. We review the exact Fourier-Laguerre wavelet transform on the ball, coined flaglets, and show that flaglets constitute a tight frame.

We summarise the construction of exact axisymmetric scale-discretised wavelets on the sphere and on the ball. The wavelet transform on the ball relies on a novel 3D harmonic transform called the Fourier-Laguerre transform which combines the spherical harmonic transform with damped Laguerre polynomials on the radial half-line. The resulting wavelets, called flaglets, extract scale-dependent, spatially localised features in three-dimensions while treating the tangential and radial structures separately. Both the Fourier-Laguerre and the flaglet transforms are theoretically exact thanks to a novel sampling theorem on the ball. Our implementation of these methods is publicly available and achieves floating-point accuracy when applied to band-limited signals.

We develop an exact wavelet transform on the three-dimensional ball (i.e. on the solid sphere), which we name the flaglet transform. For this purpose we first construct an exact transform on the radial half-line using damped Laguerre polynomials and develop a corresponding quadrature rule. Combined with the spherical harmonic transform, this approach leads to a sampling theorem on the ball and a novel three-dimensional decomposition which we call the Fourier-Laguerre transform. We relate this new transform to the well-known Fourier-Bessel decomposition and show that band-limitedness in the Fourier-Laguerre basis is a sufficient condition to compute the Fourier-Bessel decomposition exactly. We then construct the flaglet transform on the ball through a harmonic tiling, which is exact thanks to the exactness of the Fourier-Laguerre transform (from which the name flaglets is coined). The corresponding wavelet kernels are well localised in real and Fourier-Laguerre spaces and their angular aperture is invariant under radial translation. We introduce a multiresolution algorithm to perform the flaglet transform rapidly, while capturing all information at each wavelet scale in the minimal number of samples on the ball. Our implementation of these new tools achieves floating-point precision and is made publicly available. We perform numerical experiments demonstrating the speed and accuracy of these libraries and illustrate their capabilities on a simple denoising example.

High-precision cosmology requires the analysis of large-scale surveys in 3D spherical coordinates, i.e. spherical Fourier-Bessel decomposition. Current methods are insufficient for future data-sets from wide-field cosmology surveys. The aim of this paper is to present a public code for fast spherical Fourier-Bessel decomposition that can be applied to cosmological data or 3D data in spherical coordinates in other scientific fields. We present an equivalent formulation of the spherical Fourier-Bessel decomposition that separates radial and tangential calculations. We propose the use of the existing pixelisation scheme HEALPix for a rapid calculation of the tangential modes. 3DEX (3D EXpansions) is a public code for fast spherical Fourier-Bessel decomposition of 3D all-sky surveys that takes advantage of HEALPix for the calculation of tangential modes. We perform tests on very large simulations and we compare the precision and computation time of our method with an optimised implementation of the spherical Fourier-Bessel original formulation. For surveys with millions of galaxies, computation time is reduced by a factor 4-12 depending on the desired scales and accuracy. The formulation is also suitable for pre-calculations and external storage of the spherical harmonics, which allows for additional speed improvements. The 3DEX code can accommodate data with masked regions of missing data. 3DEX can also be used in other disciplines, where 3D data are to be analysed in spherical coordinates. The code and documentation can be downloaded at http://ixkael.com/blog/3dex.