We explore an alternative method to the usual shear correlation function approach for the estimation of aperture mass statistics in weak lensing survey data. Our approach builds on the direct estimator method of Schneider (1998). In this paper, to test and validate the methodology, we focus on the aperture mass dispersion. After computing the signal and noise for a weighted set of measured ellipticites we show how the direct estimator can be made into a linear order algorithm that enables a fast and efficient computation. We then investigate the applicability of the direct estimator approach in the presence of a real survey mask with holes and chip gaps. For this we use a large ensemble of full ray-tracing mock simulations. By using various weighting schemes for combining information from different apertures we find that inverse variance weighting the individual aperture estimates with an aperture completeness greater than 70 per cent coverage yields an answer that is in close agreement with the standard correlation function approach. We then apply this approach to the CFHTLenS as pilot scheme and find that our method recovers to high accuracy the Kilbinger (2013) result for the variance of both the E and B mode signal, after we correct the catalogue for the shear bias in the lensfit algorithm for pairs closer than 9". We then explore the cosmological information content of the direct estimator using the Fisher information approach. We show that there is a only modest loss in cosmological information from the rejection of apertures that are of low completeness. This method unlocks the door to fast and efficient methods for recovering higher order aperture mass statistics in linear order operations.

Shear peak statistics has gained a lot of attention recently as a practical alternative to the two point statistics for constraining cosmological parameters. We perform a shear peak statistics analysis of the Dark Energy Survey (DES) Science Verification (SV) data, using weak gravitational lensing measurements from a 139 deg$^2$ field. We measure the abundance of peaks identified in aperture mass maps, as a function of their signal-to-noise ratio, in the signal-to-noise range $0<\mathcal S / \mathcal N<4$. To predict the peak counts as a function of cosmological parameters we use a suite of $N$-body simulations spanning 158 models with varying $\Omega_{\rm m}$ and $\sigma_8$, fixing $w = -1$, $\Omega_{\rm b} = 0.04$, $h = 0.7$ and $n_s=1$, to which we have applied the DES SV mask and redshift distribution. In our fiducial analysis we measure $\sigma_{8}(\Omega_{\rm m}/0.3)^{0.6}=0.77 \pm 0.07$, after marginalising over the shear multiplicative bias and the error on the mean redshift of the galaxy sample. We introduce models of intrinsic alignments, blending, and source contamination by cluster members. These models indicate that peaks with $\mathcal S / \mathcal N>4$ would require significant corrections, which is why we do not include them in our analysis. We compare our results to the cosmological constraints from the two point analysis on the SV field and find them to be in good agreement in both the central value and its uncertainty. We discuss prospects for future peak statistics analysis with upcoming DES data.

The galaxy power spectrum encodes a wealth of information about cosmology and the matter fluctuations. Its unbiased and optimal estimation is therefore of great importance. In this paper we generalise the framework of Feldman et al. (1994) to take into account the fact that galaxies are not simply a Poisson sampling of the underlying dark matter distribution. Besides finite survey-volume effects and flux-limits, our optimal estimation scheme incorporates several of the key tenets of galaxy formation: galaxies form and reside exclusively in dark matter haloes; a given dark matter halo may host several galaxies of various luminosities; galaxies inherit part of their large-scale bias from their host halo. Under these broad assumptions, we prove that the optimal weights "do not" explicitly depend on galaxy luminosity, other than through defining the maximum survey volume and effective galaxy density at a given position. Instead, they depend on the bias associated with the host halo; the first and second factorial moments of the halo occupation distribution; a selection function, which gives the fraction of galaxies that can be observed in a halo of mass M at position r in the survey; and an effective number density of galaxies. If one wishes to reconstruct the matter power spectrum, then, provided the model is correct, this scheme provides the only unbiased estimator. The practical challenges with implementing this approach are also discussed.

The power spectrum of galaxy clusters is an important probe of the cosmological model. In this paper we determine the optimal weighting scheme for maximizing the signal-to-noise ratio for such measurements. We find a closed form analytic expression for the optimal weights. Our expression takes into account: cluster mass, finite survey volume effects, survey masking, and a flux limit. The implementation of this weighting scheme requires knowledge of the measured cluster masses, and analytic models for the bias and space-density of clusters as a function of mass and redshift. Recent studies have suggested that the optimal method for reconstruction of the matter density field from a set of clusters is mass-weighting (Seljak et al 2009, Hamaus et al 2010, Cai et al 2011). We compare our optimal weighting scheme with this approach and also with the original power spectrum scheme of Feldman et al (1994). We show that our optimal weighting scheme outperforms these approaches for both volume- and flux-limited cluster surveys. Finally, we present a new expression for the Fisher information matrix for cluster power spectrum analysis. Our expression shows that for an optimally weighted cluster survey the cosmological information content is boosted, relative to the standard approach of Tegmark (1997).

Measurements of the galaxy power spectrum contain a wealth of information about the Universe. Its optimal extraction is vital if we are to truly understand the micro-physical nature of dark matter and dark energy. In Smith & Marian (2015) we generalized the power spectrum methodology of Feldman et al. (1994) to take into account the key tenets of galaxy formation: galaxies form and reside exclusively in dark matter haloes; a given dark matter halo may host galaxies of various luminosities; galaxies inherit the large-scale bias associated with their host halo. In this paradigm we derived the optimal weighting and reconstruction scheme for maximizing the signal-to-noise on a given band power estimate. For a future all-sky flux-limited galaxy redshift survey of depth b_J ~22, we now demonstrate that the optimal weighting scheme does indeed provide improved S/N at the level of ~20% when compared to Feldman et al. (1994) and ~60% relative to Percival et al. (2003), for scales of order k~0.5 Mpc/h. Using a Fisher matrix approach, we show that the cosmological information yield is also increased relative to these alternate methods -- especially the primordial power spectrum amplitude and dark energy equation of state.

The combination of galaxy-galaxy lensing and galaxy clustering data has the potential to simultaneously constrain both the cosmological and galaxy formation models. In this paper we perform a comprehensive exploration of these signals and their covariances through a combination of analytic and numerical approaches. First, we derive analytic expressions for the projected galaxy correlation function and stacked tangential shear profile and their respective covariances, which include Gaussian and discreteness noise terms. Secondly, we measure these quantities from mock galaxy catalogues obtained from the Millennium-XXL simulation and semi-analytic models of galaxy formation. We find that on large scales (R>10 Mpc/h), the galaxy bias is roughly linear and deterministic. On smaller scales (R<5 Mpc/h) the bias is a complicated function of scale and luminosity, determined by the different spatial distribution and abundance of satellite galaxies present when different magnitude cuts are applied, as well as by the mass dependence of the host haloes on magnitude. Our theoretical model for the covariances provides a reasonably good description of the measured ones on small and large scales. However, on intermediate scales (1<R<10 Mpc/h), the predicted errors are ~2-3 times smaller, suggesting that the inclusion of higher-order, non-Gaussian terms in the covariance will be required for further improvements. Importantly, both our theoretical and numerical methods show that the galaxy-galaxy lensing and clustering signals have a non-zero cross-covariance matrix with significant bin-to-bin correlations. Future surveys aiming to combine these probes must take this into account in order to obtain unbiased and realistic constraints.

Future large-scale structure surveys of the Universe will aim to constrain the cosmological model and the true nature of dark energy with unprecedented accuracy. In order for these surveys to achieve their designed goals, they will require predictions for the nonlinear matter power spectrum to sub-percent accuracy. Through the use of a large ensemble of cosmological N-body simulations, we demonstrate that if we do not understand the uncertainties associated with simulating structure formation, i.e. knowledge of the `true' simulation parameters, and simply seek to marginalize over them, then the constraining power of such future surveys can be significantly reduced. However, for the parameters {n_s, h, Om_b, Om_m}, this effect can be largely mitigated by adding the information from a CMB experiment, like Planck. In contrast, for the amplitude of fluctuations sigma8 and the time-evolving equation of state of dark energy {w_0, w_a}, the mitigation is mild. On marginalizing over the simulation parameters, we find that the dark-energy figure of merit can be degraded by ~2. This is likely an optimistic assessment, since we do not take into account other important simulation parameters. A caveat is our assumption that the Hessian of the likelihood function does not vary significantly when moving from our adopted to the 'true' simulation parameter set. This paper therefore provides strong motivation for rigorous convergence testing of N-body codes to meet the future challenges of precision cosmology.

We study the cosmological information of weak lensing (WL) peaks, focusing on two other statistics besides their abundance: the stacked tangential-shear profiles and the peak-peak correlation function. We use a large ensemble of simulated WL maps with survey specifications relevant to future missions like Euclid and LSST, to explore the three peak probes. We find that the correlation function of peaks with high signal-to-noise (S/N) measured from fields of size 144 sq. deg. has a maximum of ~0.3 at an angular scale ~10 arcmin. For peaks with smaller S/N, the amplitude of the correlation function decreases, and its maximum occurs on smaller angular scales. We compare the peak observables measured with and without shape noise and find that for S/N~3 only ~5% of the peaks are due to large-scale structures, the rest being generated by shape noise. The covariance matrix of the probes is examined: the correlation function is only weakly covariant on scales < 30 arcmin, and slightly more on larger scales; the shear profiles are very correlated for theta > 2 arcmin, with a correlation coefficient as high as 0.7. Using the Fisher-matrix formalism, we compute the cosmological constraints for {Om_m, sig_8, w, n_s} considering each probe separately, as well as in combination. We find that the correlation function of peaks and shear profiles yield marginalized errors which are larger by a factor of 2-4 for {Om_m, sig_8} than the errors yielded by the peak abundance alone, while the errors for {w, n_s} are similar. By combining the three probes, the marginalized constraints are tightened by a factor of ~2 compared to the peak abundance alone, the least contributor to the error reduction being the correlation function. This work therefore recommends that future WL surveys use shear peaks beyond their abundance in order to constrain the cosmological model.

We study the ability of future weak lensing (WL) surveys to constrain primordial non-Gaussianity of the local type. We use a large ensemble of simulated WL maps with survey specifications relevant to Euclid and LSST. The simulations assume Cold Dark Matter cosmologies that vary certain parameters around fiducial values: the non-Gaussianity parameter f_NL, the matter density parameter Omega_m, the amplitude of the matter power spectrum sigma_8, the spectral index of the primordial power spectrum n_s, and the dark-energy equation-of-state parameter w_0. We assess the sensitivity of the cosmic shear correlation functions, the third-order aperture mass statistics, and the abundance of shear peaks to these parameters. We find that each of the considered probes provides unmarginalized constraints of Delta f_NL ~ 20 on f_NL. Marginalized constraints from any individual WL probe are much weaker due to strong correlations between parameters. However, the parameter errors can be substantially reduced by combining information from different WL probes. Combining all WL probes yields the following marginal (68% confidence level) uncertainties: Delta f_NL ~ 50, Delta Omega_m ~ 0.002, Delta sigma_8 ~ 0.004, Delta n_s ~ 0.007, and Delta w_0 ~ 0.03. We examine the bias induced by neglecting f_NL on the constraints on the other parameters. We find sigma_8 and w_0 to be the most affected. Moreover, neglecting non-Gaussianity leads to a severe underestimation of the uncertainties in the other cosmological parameters.

We explore the possibility of detecting primordial non-Gaussianity of the local type using weak lensing peak counts. We measure the peak abundance in sets of simulated weak lensing maps corresponding to three models f_NL={0, +100, -100}. Using survey specifications similar to those of Euclid and without assuming any knowledge of the lens and source redshifts, we find the peak functions of the non-Gaussian models with f_NL=+-100 to differ by up to 15% from the Gaussian peak function at the high-mass end. For the assumed survey parameters, the probability of fitting an f_NL=0 peak function to the f_NL=+-100 peak functions is less than 0.1%. Assuming the other cosmological parameters known, f_NL can be measured with an error \Delta f_NL ~ 13. It is therefore possible that future weak lensing surveys like Euclid and LSST may detect primordial non-Gaussianity from the abundance of peak counts, and provide complementary information to that obtained from the cosmic microwave background.

We present a new method to extract cosmological constraints from weak lensing (WL) peak counts, which we denote as `the hierarchical algorithm'. The idea of this method is to combine information from WL maps sequentially smoothed with a series of filters of different size, from the largest down to the smallest, thus increasing the cosmological sensitivity of the resulting peak function. We compare the cosmological constraints resulting from the peak abundance measured in this way and the abundance obtained by using a filter of fixed size, which is the standard practice in WL peak studies. For this purpose, we employ a large set of WL maps generated by ray-tracing through N-body simulations, and the Fisher matrix formalism. We find that if low-S/N peaks are included in the analysis (S/N ~ 3), the hierarchical method yields constraints significantly better than the single-sized filtering. For a large future survey such as Euclid or LSST, combined with information from a CMB experiment like Planck, the results for the hierarchical (single-sized) method are: \Delta n=0.0039 (0.004); \Delta \Omega m=0.002 (0.0045); \Delta \sigma 8=0.003 (0.006); \Delta w=0.019 (0.0525). This forecast is conservative, as we assume no knowledge of the redshifts of the lenses, and consider a single broad bin for the redshifts of the sources. If only peaks with S/N >= 6 are considered, then there is little difference between the results of the two methods. We also examine the statistical properties of the hierarchical peak function: Its covariance matrix has off-diagonal terms for bins with S/N <= 6 and aperture mass of M < 3 x 1e+14 Ms/h, the higher bins being largely uncorrelated and therefore well described by a Poisson distribution.

We develop the halo model of large-scale structure as an accurate tool for probing primordial non-Gaussianity. In this study we focus on understanding the matter clustering at several redshifts. The primordial non-Gaussianity is modeled as a quadratic correction to the local Gaussian potential, and is characterized by the parameter f_NL. In our formulation of the halo model we pay special attention to the effect of halo exclusion, and show that this can potentially solve the long standing problem of excess power on large scales in this model. The model depends on the mass function, clustering and density profiles of halos. We test these ingredients using a large ensemble of high-resolution Gaussian and non-Gaussian numerical simulations. In particular, we provide a first exploration of how density profiles change in the presence of primordial non-Gaussianities. We find that for f_NL positive/negative high mass halos have an increased/decreased core density, so being more/less concentrated than in the Gaussian case. We also examine the halo bias and show that, if the halo model is correct, then there is a small asymmetry in the scale-dependence of the bias on very large scales, which arises because the Gaussian bias must be renormalized. We show that the matter power spectrum is modified by ~2.5% and ~3.5% on scales k~1.0 h/Mpc at z=0 and z=1, respectively. Our halo model calculation reproduces the absolute amplitude to within 10% and the ratio of non-Gaussian to Gaussian spectra to within 1%. We also measure the matter correlation functions and find similarly good agreement between the model and the data. We anticipate that this modeling will be useful for constraining f_NL from measurements of the shear correlation function in future weak lensing surveys such as Euclid.

We study the covariance matrix of the cluster mass function in cosmology. We adopt a two-line attack: firstly, we employ the counts-in-cells framework to derive an analytic expression for the covariance of the mass function. Secondly, we use a large ensemble of N-body simulations in the LCDM framework to test this. Our theoretical results show that the covariance can be written as the sum of two terms: a Poisson term, which dominates in the limit of rare clusters; and a sample variance term, which dominates for more abundant clusters. Our expressions are analogous to those of Hu & Kravtsov (2003) for multiple cells and a single mass tracer. Calculating the covariance depends on: the mass function and bias of clusters, and the variance of mass fluctuations within the survey volume. The predictions show that there is a strong bin-to-bin covariance between measurements. In terms of the cross-correlation coefficient, we find r~0.5 for haloes with M<3e14 Msol at z=0. Comparison of these predictions with estimates from simulations shows excellent agreement. We use the Fisher matrix formalism to explore the cosmological information content of the counts. We compare the Poisson likelihood model, with the more realistic likelihood model of Lima & Hu (2004), and all terms entering the Fisher matrices are evaluated using the simulations. We find that the Poisson approximation should only be used for the rarest objects, M>3e14 Msol, otherwise the information content of a survey of size V~13.5 [Gpc/h]^3 would be overestimated, resulting in errors that are ~2 times smaller. As an auxiliary result, we show that the bias of clusters, obtained from the cluster-mass cross-variance, is linear on scales >50 Mpc/h, whereas that obtained from the auto-variance is nonlinear.

Large-scale structure projections are an obstacle in converting the shear signal of clusters detected in weak-lensing maps into virial masses. However, this step is not necessary for constraining cosmology with the shear-peak abundance, if we are able to predict its amplitude. We generate a large ensemble of N-body simulations spanning four cosmological models, with total volume V~1 (Gpc/h)^3 per model. Variations to the matter density parameter and amplitude of fluctuations are considered. We measure the abundance of peaks in the mass density projected in ~100 Mpc/h slabs to determine the impact of structures spatially correlated with the simulation clusters, identified by the 3D friends-of-friends algorithm. The halo model shows that the choice of the smoothing filter for the density field is important in reducing the contribution of correlated projections to individual halo masses. Such contributions are less than 2% in the case of the optimal, compensated filter used throughout this analysis. We measure the change in the mass of peaks when projected in slabs of various thicknesses. Peaks in slabs of 26 Mpc/h and 102 Mpc/h suffer an average mass change of less than 2% compared to their mass in slabs of 51 Mpc/h. We then explore the cosmology dependence of the projected-peak mass function, and find that, for a wide range of slab thicknesses (<500 Mpc/h), it scales with cosmology in exactly the same way as the 3D friends-of-friends mass function and the Sheth-Tormen formula. This extends the earlier result of Marian et al. (2009). Finally, we show that for all cosmological models considered, the low and intermediate mass bins of the peak abundance can be described using a modified Sheth-Tormen functional form to within 10%-20% accuracy.

We present the main results of a numerical study of weak lensing cluster counting. We examine the scaling with cosmology of the projected-density-peak mass function. Our main conclusion is that the projected-peak and the three-dimensional mass functions scale with cosmology in an astonishingly close way. This means that, despite being derived from a two-dimensional field, the weak lensing cluster abundance can be used to constrain cosmology in the same way as the three-dimensional mass function probed by other types of surveys.

We analyze the possibility of delensing CMB polarization maps using foreground weak lensing (WL) information. We build an estimator of the CMB lensing potential out of optimally combined projected potential estimators to different source redshift bins. Our estimator is most sensitive to the redshift depth of the WL survey, less so to the shape noise level. Estimators built using galaxy surveys like LSST and SNAP yield a 30-50% reduction in the lensing B-mode power. We illustrate the potential advantages of a 21-cm survey by considering a fiducial WL survey for which we take the redshift depth zmax and the effective angular concentration of sources n as free parameters. For a noise level of 1 muK arcmin in the polarization map itself, as projected for a CMBPol experiment, and a beam with FWHM=10 arcmin, we find that going to zmax=20 at n=100 gal/sqarcmin yields a delensing performance similar to that of a quadratic lensing potential estimator applied to small-scale CMB maps: the lensing B-mode contamination is reduced by almost an order of magnitude. In this case, there is also a reduction by a factor of ~4 in the detectability threshold of the tensor B-mode power. At this CMB noise level, there is little gain from sources with zmax>20. The delensing gains are lost if the CMB beam exceeds ~20 arcmin. The delensing efficiency and useful zmax depend acutely on the CMB map noise level, but beam sizes below 10 arcmin do not help. Delensing via foreground sources does not require arcminute-resolution CMB observations, a substantial practical advantage over the use of CMB observables for delensing.

We study the ability of weak lensing surveys to detect galaxy clusters and constrain cosmological parameters, in particular the equation of state of dark energy. There are two major sources of noise for weak lensing cluster measurements: the ``shape noise'' from the intrinsic ellipticities of galaxies; and the large scale projection noise. We produce a filter for the shear field which optimizes the signal-to-noise of shape-noise-dominated shear measurements. Our Fisher-matrix analysis of this projected-mass observable makes use of the shape of this mass function, and takes into account the Poisson variance, sample variance, shape noise, and projected-mass noise, and also the fact that the conversion of the shear signal into mass is cosmology-dependent. The Fisher analysis is applied to both a nominal 15,000 square degree ground-based survey and a 1000 square degree space-based survey. Assuming a detection threshold of S/N=5, we find both experiments detect \~20,000 clusters, and yield 1-sigma constraints of ~0.07 for w0 and ~0.2 for wa when combined with CMB data (for flat universe). The projection noise exceeds the shape noise only for clusters at z<=0.1 and has little effect on the derived dark-energy constraints. Sample variance does not significantly affect either survey. Finally, we note that all these results are extremely sensitive to the noise levels and detection thresholds that we impose. They can be significantly improved if we combine ground and space surveys as independent experiments and add their corresponding Fisher matrices.