Galaxy-galaxy strong gravitational lenses have become a popular probe of dark matter (DM) by providing a window into structure formation on the smallest scales. In particular, the convergence power spectrum of subhalos within lensing galaxies has been suggested as a promising observable to study DM. However, the distances involved in strong-lensing systems are vast, and we expect the relevant volume to contain line-of-sight (LOS) halos that are not associated with the main lens. We develop a formalism to calculate the effect of LOS halos as an effective convergence power spectrum. The multi-lens plane equation couples the angular deflections of consecutive lens planes, but by assuming that the perturbations due to the LOS halos are small, we show that they can be projected onto the main-lens plane as effective subhalos. We test our formalism by simulating lensing systems using the full multi-plane lens equation and find excellent agreement. We show how the relative contribution of LOS halos and subhalos depends on the source and lens redshift, as well as the assumed halo and subhalo mass functions. For a fiducial system with fraction of DM halo mass in substructure $f_{\rm sub}=0.4\%$ for subhalo masses $[10^5-10^8]\rm{M}_{\odot}$, the interloper contribution to the power spectrum is at least several times greater than that of subhalos for source redshifts $z_s\gtrsim0.5$. Furthermore, it is likely that for the SLACS and BELLS lenses the interloper contribution dominates: $f_{\rm sub}\gtrsim2\%$ ($4\%$) is needed for subhalos to dominate in SLACS (BELLS), which is higher than current upper bounds on $f_{\rm sub}$ for our mass range. Since the halo mass function is better understood from first principles, the dominance of interlopers in galaxy-galaxy lenses with high-quality imaging can be seen as a significant advantage when translating this observable into a constraint on DM.

Fundamental plane of elliptical galaxies can be used to predict the intrinsic size of galaxies and has a number of plausible application to study cosmology and galaxy physics. We present a detailed analysis of the fundamental plane of the SDSS-III BOSS LOWZ and CMASS galaxies. For the standard fundamental plane, we find a strong redshift evolution for the mean residual and show that it is primarily driven by the redshift evolution of the surface brightness of the galaxies. After correcting for the redshift evolution, the FP residuals are strongly correlated with the galaxy properties and some observational systematics. We show that the variations in the FP between the central and satellite galaxies, that have been observed in the literature, can primarily be explained by the correlation of the FP with the galaxy luminosity. We also measure the cross correlations of the FP residuals with the galaxy density field. The amplitude of the cross correlations depends on the galaxy properties and environment with brighter and redder galaxies showing stronger correlation. In general, galaxies in denser environments (higher galaxy bias ) show stronger correlations. We also compare FP amplitude with the amplitudes of intrinsic alignments of galaxy shapes (IA), finding the two to be correlated. Finally, using the FP residuals we also study the impact of intrinsic alignments on the constraint of growth rate using redshift space distortions. We do not observe any significant trends in measurements of the growth rate $f$ as function of the amplitude of FP-density correlations, resulting in null detection of the effects of IA on the RSD measurements.

We present cosmological parameter constraints based on a joint modeling of galaxy-lensing cross correlations and galaxy clustering measurements in the SDSS, marginalizing over small-scale modeling uncertainties using mock galaxy catalogs, without explicit modeling of galaxy bias. We show that our modeling method is robust to the impact of different choices for how galaxies occupy dark matter halos and to the impact of baryonic physics (at the $\sim2\%$ level in cosmological parameters) and test for the impact of covariance on the likelihood analysis and of the survey window function on the theory computations. Applying our results to the measurements using galaxy samples from BOSS and lensing measurements using shear from SDSS galaxies and CMB lensing from Planck, with conservative scale cuts, we obtain $S_8\equiv\left(\frac{\sigma_8}{0.8228}\right)^{0.8}\left(\frac{\Omega_m}{0.307}\right)^{0.6}=0.85\pm0.05$ (stat.) using LOWZ $\times$ SDSS galaxy lensing, and $S_8=0.91\pm0.1$ (stat.) using combination of LOWZ and CMASS $\times$ Planck CMB lensing. We estimate the systematic uncertainty in the galaxy-galaxy lensing measurements to be $\sim6\%$ (dominated by photometric redshift uncertainties) and in the galaxy-CMB lensing measurements to be $\sim3\%$, from small scale modeling uncertainties including baryonic physics.

Normalizing constant (also called partition function, Bayesian evidence, or marginal likelihood) is one of the central goals of Bayesian inference, yet most of the existing methods are both expensive and inaccurate. Here we develop a new approach, starting from posterior samples obtained with a standard Markov Chain Monte Carlo (MCMC). We apply a novel Normalizing Flow (NF) approach to obtain an analytic density estimator from these samples, followed by Optimal Bridge Sampling (OBS) to obtain the normalizing constant. We compare our method which we call Gaussianized Bridge Sampling (GBS) to existing methods such as Nested Sampling (NS) and Annealed Importance Sampling (AIS) on several examples, showing our method is both significantly faster and substantially more accurate than these methods, and comes with a reliable error estimation.

We develop a generative model-based approach to Bayesian inverse problems, such as image reconstruction from noisy and incomplete images. Our framework addresses two common challenges of Bayesian reconstructions: 1) It makes use of complex, data-driven priors that comprise all available information about the uncorrupted data distribution. 2) It enables computationally tractable uncertainty quantification in the form of posterior analysis in latent and data space. The method is very efficient in that the generative model only has to be trained once on an uncorrupted data set, after that, the procedure can be used for arbitrary corruption types.

We present an efficient implementation of Wiener filtering of real-space linear field and optimal quadratic estimator of its power spectrum Band-powers. We first recast the field reconstruction into an optimization problem, which we solve using quasi-Newton optimization. We then recast the power spectrum estimation into the field marginalization problem, from which we obtain an expression that depends on the field reconstruction solution and a determinant term. We develop a novel simulation based method for the latter. We extend the simulations formalism to provide the covariance matrix for the power spectrum. We develop a flexible framework that can be used on a variety of cosmological fields and present results for a variety of test cases, using simulated examples of projected density fields, projected shear maps from galaxy lensing, and observed Cosmic Microwave Background (CMB) temperature anisotropies, with a wide range of map incompleteness and variable noise. For smaller cases where direct numerical inversion is possible, we show that our solution matches that created by direct Wiener Filtering at a fraction of the overall computation cost. Even more significant reduction of computational is achieved by this implementation of optimal quadratic estimator due to the fast evaluation of the Hessian matrix. This technique allows for accurate map and power spectrum reconstruction with complex masks and nontrivial noise properties.

We develop a statistical analysis model of Kepler star flux data in the presence of planet transits, non-Gaussian noise, and star variability. We first develop a model for Kepler noise probability distribution in the presence of outliers, which make the noise probability distribution non-Gaussian. We develop a signal likelihood analysis based on this probability distribution, in which we model the signal as a sum of the star variability and planetary transits. We argue these components need to be modeled together if optimal signal is to be extracted from the data. For the star variability model we develop an optimal Gaussian process analysis using a Fourier based Wiener filter approach, where the power spectrum is non-parametric and learned from the data. We develop high dimensional optimization of the objective function, where we jointly optimize all the model parameters, including thousands of star variability modes, and planet transit parameters. We apply the method to Kepler-90 data and show that it gives a better match to the star variability than the standard spline method, and robustly handles noise outliers. As a consequence, the planet radii have a higher value than the standard spline method.

Generating mocks for future sky surveys requires large volumes and high resolutions, which is computationally expensive even for fast simulations. In this work we try to develop numerical schemes to calibrate various halo and matter statistics in fast low resolution simulations compared to high resolution N-body and hydrodynamic simulations. For the halos, we improve the initial condition accuracy and develop a halo finder "relaxed-FOF", where we allow different linking length for different halo mass and velocity dispersions. We show that our relaxed-FoF halo finder improves the common statistics, such as halo bias, halo mass function, halo auto power spectrum in real space and in redshift space, cross correlation coefficient with the reference halo catalog, and halo-matter cross power spectrum. We also incorporate the potential gradient descent (PGD) method into fast simulations to improve the matter distribution at nonlinear scale. By building a lightcone output, we show that the PGD method significantly improves the weak lensing convergence tomographic power spectrum. With these improvements FastPM is comparable to the high resolution full N-body simulation of the same mass resolution, with two orders of magnitude fewer time steps. These techniques can be used to improve the halo and matter statistics of FastPM simulations for mock catalogs of future surveys such as DESI and LSST.

Statistical inference of analytically non-tractable posteriors is a difficult problem because of marginalization of correlated variables and stochastic methods such as MCMC and VI are commonly used. We argue that stochastic KL divergence minimization used by MCMC and VI is noisy, and we propose instead EL_2O, expectation optimization of L_2 distance squared between the approximate log posterior q and the un-normalized log posterior of p. When sampling from q the solutions agree with stochastic KL divergence minimization based VI in the large sample limit, however EL_2O method is free of sampling noise, has better optimization properties, and requires only as many sample evaluations as the number of parameters we are optimizing if q covers p. As a consequence, increasing the expressivity of q improves both the quality of results and the convergence rate, allowing EL_2O to approach exact inference. Use of automatic differentiation methods enables us to develop Hessian, gradient and gradient free versions of the method, which can determine M(M+2)/2+1, M+1 and 1 parameter(s) of q with a single sample, respectively. EL_2O provides a reliable estimate of the quality of the approximating posterior, and converges rapidly on full rank gaussian approximation for q and extensions beyond it, such as nonlinear transformations and gaussian mixtures. These can handle general posteriors, while still allowing fast analytic marginalizations. We test it on several examples, including a realistic 13 dimensional galaxy clustering analysis, showing that it is several orders of magnitude faster than MCMC, while giving smooth and accurate non-gaussian posteriors, often requiring a few to a few dozen of iterations only.

MegaMapper is a proposed ground-based experiment to measure Inflation parameters and Dark Energy from galaxy redshifts at 2<z<5. A 6.5-m Magellan telescope will be coupled with DESI spectrographs to achieve multiplexing of 20,000. MegaMapper would be located at Las Campanas Observatory to fully access LSST imaging for target selection.

The Simons Observatory (SO) is a ground-based cosmic microwave background (CMB) experiment sited on Cerro Toco in the Atacama Desert in Chile that promises to provide breakthrough discoveries in fundamental physics, cosmology, and astrophysics. Supported by the Simons Foundation, the Heising-Simons Foundation, and with contributions from collaborating institutions, SO will see first light in 2021 and start a five year survey in 2022. SO has 287 collaborators from 12 countries and 53 institutions, including 85 students and 90 postdocs. The SO experiment in its currently funded form ('SO-Nominal') consists of three 0.4 m Small Aperture Telescopes (SATs) and one 6 m Large Aperture Telescope (LAT). Optimized for minimizing systematic errors in polarization measurements at large angular scales, the SATs will perform a deep, degree-scale survey of 10% of the sky to search for the signature of primordial gravitational waves. The LAT will survey 40% of the sky with arc-minute resolution. These observations will measure (or limit) the sum of neutrino masses, search for light relics, measure the early behavior of Dark Energy, and refine our understanding of the intergalactic medium, clusters and the role of feedback in galaxy formation. With up to ten times the sensitivity and five times the angular resolution of the Planck satellite, and roughly an order of magnitude increase in mapping speed over currently operating ("Stage 3") experiments, SO will measure the CMB temperature and polarization fluctuations to exquisite precision in six frequency bands from 27 to 280 GHz. SO will rapidly advance CMB science while informing the design of future observatories such as CMB-S4.

We compute the dipole of the galaxy correlation function at 1-loop in perturbation theory by including all the relevant relativistic contributions. This provides a description and understanding of what the dipole truly measures, in particular in relation to the gravitational redshift effect in Large Scale Structure. In order to develop this perturbative approach we have computed for the first time the relevant relativistic corrections to third order in perturbation theory, including the corresponding non-linear galaxy bias model. This perturbative approach agrees on a wide range of scales with good accuracy with previous numerical results based on geodesic light tracing in N-body simulations. Previous claims of gravitational redshift detection may have neglected several relativistic effects which are comparable with the amplitude of gravitational redshift around 10 Mpc/h scales and which complicate the gravitational redshift interpretation of the measurement.

We present constraints on local primordial non-Gaussianity (PNG), parametrized through $f^{\rm loc}_{\rm NL}$, using the Sloan Digital Sky Survey IV extended Baryon Oscillation Spectroscopic Survey Data Release 14 quasar sample. We measure and analyze the anisotropic clustering of the quasars in Fourier space, testing for the scale-dependent bias introduced by primordial non-Gaussianity on large scales. We derive and employ a power spectrum estimator using optimal weights that account for the redshift evolution of the PNG signal. We find constraints of $-51<f^{\rm loc}_{\rm NL}<21$ at 95% confidence level. These are amont the tightest constraints from Large Scale Structure (LSS) data. Our redshift weighting improves the error bar by 15% in comparison to the unweighted case. If quasars have lower response to PNG, the constraint degrades to $-81<f^{\rm loc}_{\rm NL}<26$, with a 40% improvement over the standard approach. We forecast that the full eBOSS dataset could reach $\sigma_{f^{\rm loc}_{\rm NL}}\simeq 5\text{-}8$ using optimal methods and full range of scales.

The Simons Observatory (SO) is a new cosmic microwave background experiment being built on Cerro Toco in Chile, due to begin observations in the early 2020s. We describe the scientific goals of the experiment, motivate the design, and forecast its performance. SO will measure the temperature and polarization anisotropy of the cosmic microwave background in six frequency bands: 27, 39, 93, 145, 225 and 280 GHz. The initial configuration of SO will have three small-aperture 0.5-m telescopes (SATs) and one large-aperture 6-m telescope (LAT), with a total of 60,000 cryogenic bolometers. Our key science goals are to characterize the primordial perturbations, measure the number of relativistic species and the mass of neutrinos, test for deviations from a cosmological constant, improve our understanding of galaxy evolution, and constrain the duration of reionization. The SATs will target the largest angular scales observable from Chile, mapping ~10% of the sky to a white noise level of 2 $\mu$K-arcmin in combined 93 and 145 GHz bands, to measure the primordial tensor-to-scalar ratio, $r$, at a target level of $\sigma(r)=0.003$. The LAT will map ~40% of the sky at arcminute angular resolution to an expected white noise level of 6 $\mu$K-arcmin in combined 93 and 145 GHz bands, overlapping with the majority of the LSST sky region and partially with DESI. With up to an order of magnitude lower polarization noise than maps from the Planck satellite, the high-resolution sky maps will constrain cosmological parameters derived from the damping tail, gravitational lensing of the microwave background, the primordial bispectrum, and the thermal and kinematic Sunyaev-Zel'dovich effects, and will aid in delensing the large-angle polarization signal to measure the tensor-to-scalar ratio. The survey will also provide a legacy catalog of 16,000 galaxy clusters and more than 20,000 extragalactic sources.

Optimal analyses using the 2-point functions of large-scale structure probes require accurate covariance matrices. A covariance matrix of the 2-point function comprises the disconnected part and the connected part. While the connected covariance only becomes important on small scales, the disconnected covariance is dominant on large scales, where the survey window has a significant impact. In this work, we develop an analytical method to compute the disconnected covariance, accounting for the window effect. Derived under the flat-sky approximation, our formalism is applicable to wide surveys by swapping in the curved-sky window functions. Our method works for both the power spectrum and the correlation function, and applies to the covariances of various probes including the multipoles and the wedges of 3D clustering, the angular and the projected statistics of clustering and shear, as well as the cross covariances between different probes. We verify the analytic covariance against the sample covariance from the galaxy mock simulations in two test cases: (1) the power spectrum multipole covariance, and (2) the joint covariance of the projected correlation function and the correlation function multipoles. Our method achieve good agreement with the mocks, while at a negligible computational cost. Unlike mocks, our analytic covariance is free of sampling noise, which often leads to numerical problems and the need to inflate the errors. In addition, our method can use the best-fit power spectrum as input, in contrast to the standard procedure of using a fiducial model that may deviate significantly from the truth. We also show that a naive diagonal power spectrum covariance underestimates the signal-to-noise ratio compared to our analytic covariance. The code that accompanies this paper is available at https://github.com/eelregit/covdisc.

We present measurements of $E_G$, a probe of gravity from large-scale structure, using BOSS LOWZ and CMASS spectroscopic samples, with lensing measurements from SDSS (galaxy lensing) and Planck (CMB lensing). Using SDSS lensing and the BOSS LOWZ sample, we measure $\langle{E_G}\rangle=0.40^{+0.05}_{-0.04}$ (stat), $\pm 0.026$ (systematic), consistent with the predicted value from the Planck $\Lambda$CDM model, $E_G=0.46$. Using CMB lensing, we measure $\langle{E_G}\rangle=0.46^{+0.08}_{-0.09}$ (stat) for LOWZ (statistically consistent with galaxy lensing and Planck predictions) and $\langle{E_G}\rangle=0.39^{+0.05}_{-0.05}$ (stat) for the CMASS sample, consistent with the Planck prediction of $E_G=0.40$ given the higher redshift of the sample. We also study the redshift evolution of $E_G$ by splitting the LOWZ sample into two samples based on redshift, with results being consistent with model predictions. We estimate systematic uncertainties on the above $\langle{E_G}\rangle$ numbers to be $\sim 6$% (when using galaxy-galaxy lensing) or $\sim 3$% (when using CMB lensing), subdominant to the quoted statistical errors. These systematic error budgets are dominated by observational systematics in galaxy-galaxy lensing and by theoretical modeling uncertainties, respectively. We do not estimate observational systematics in galaxy-CMB lensing cross correlations.

The nature of dark matter (DM) remains unknown despite very precise knowledge of its abundance in the universe. An alternative to new elementary particles postulates DM as made of macroscopic compact halo objects (MACHO) such as black holes formed in the very early universe. Stellar-mass primordial black holes (PBHs) are subject to less robust constraints than other mass ranges and might be connected to gravitational-wave signals detected by the Laser Interferometer Gravitational-Wave Observatory (LIGO). New methods are therefore necessary to constrain the viability of compact objects as a DM candidate. Here we report bounds on the abundance of compact objects from gravitational lensing of type Ia supernovae (SNe). Current SNe datasets constrain compact objects to represent less than 35.2% (Joint Lightcurve Analisis) and 37.2% (Union 2.1) of the total matter content in the universe, at 95% confidence-level. The results are valid for masses larger than $\sim 0.01M_\odot$ (solar-masses), limited by the size SNe relative to the lens Einstein radius. We demonstrate the mass range of the constraints by computing magnification probabilities for realistic SNe sizes and different values of the PBH mass. Our bounds are sensitive to the total abundance of compact objects with $M \lesssim 0.01M_\odot$ and complementary to other observational tests. These results are robust against cosmological parameters, outlier rejection, correlated noise and selection bias. PBHs and other MACHOs are therefore ruled out as the dominant form of DM for objects associated to LIGO gravitational wave detections. These bounds constrain early-universe models that predict stellar-mass PBH production and strengthen the case for lighter forms of DM, including new elementary particles.

The lensing convergence measurable with future CMB surveys like CMB-S4 will be highly correlated with the clustering observed by deep photometric large scale structure (LSS) surveys such as the LSST, with cross-correlation coefficient as high as 95\%. This will enable use of sample variance cancellation techniques to determine cosmological parameters, and use of cross-correlation measurements to break parameter degeneracies. Assuming large sky overlap between CMB-S4 and LSST, we show that a joint analysis of CMB-S4 lensing and LSST clustering can yield very tight constraints on the matter amplitude $\sigma_8(z)$, halo bias, and $f_\mathrm{NL}$, competitive with the best stage IV experiment predictions, but using complementary methods, which may carry different and possibly lower systematics. Having no sky overlap between experiments degrades the precision of $\sigma_8(z)$ by a factor of 20, and that of $f_\mathrm{NL}$ by a factor of 1.5 to 2. Without CMB lensing, the precision always degrades by an order of magnitude or more, showing that a joint analysis is critical. Our results also suggest that CMB lensing in combination with LSS photometric surveys is a competitive probe of the evolution of structure in the redshift range $z\simeq 1-7$, probing a regime that is not well tested observationally. We explore predictions against other surveys and experiment configurations, finding that wide patches with maximal sky overlap between CMB and LSS surveys are most powerful for $\sigma_8(z)$ and $f_\mathrm{NL}$.

The large scale structure (LSS) of the universe is generated by the linear density gaussian modes, which are evolved into the observed nonlinear LSS. The posterior surface of the modes is convex in the linear regime, leading to a unique global maximum (MAP), but this is no longer guaranteed in the nonlinear regime. In this paper we investigate the nature of posterior surface using the recently developed MAP reconstruction method, with a simplified but realistic N-body simulation as the forward model. The reconstruction method uses optimization with analytic gradients from back-propagation through the simulation. For low noise cases we recover the initial conditions well into the nonlinear regime ($k\sim 1$ h/Mpc) nearly perfectly. We show that the large scale modes can be recovered more precisely than the linear expectation, which we argue is a consequence of nonlinear mode coupling. For noise levels achievable with current and planned LSS surveys the reconstruction cannot recover very small scales due to noise. We see some evidence of non-convexity, specially for smaller scales where the non-injective nature of the mappings: several very different initial conditions leading to the same near perfect final data reconstruction. We investigate the nature of these phenomena further using a 1-d toy gravity model, where many well separated local maximas are found to have identical data likelihood but differ in the prior. We also show that in 1-d the prior favors some solutions over the true solution, though no clear evidence of these in 3-d. Our main conclusion is that on very small scales and for a very low noise the posterior surface is multi-modal and the global maximum may be unreachable with standard methods, while for realistic noise levels in the context of the current and next generation LSS surveys MAP optimization method is likely to be nearly optimal.

We present a method to reconstruct the initial conditions of the universe using observed galaxy positions and luminosities under the assumption that the luminosities can be calibrated with weak lensing to give the mean halo mass. Our method relies on following the gradients of forward model and since the standard way to identify halos is non-differentiable and results in a discrete sample of objects, we propose a framework to model the halo position and mass field starting from the non-linear matter field using Neural Networks. We evaluate the performance of our model with multiple metrics. Our model is more than $95\%$ correlated with the halo-mass fields up to $k\sim 0.7 {\rm h/Mpc}$ and significantly reduces the stochasticity over the Poisson shot noise. We develop a data likelihood model that takes our modeling error and intrinsic scatter in the halo mass-light relation into account and show that a displaced log-normal model is a good approximation to it. We optimize over the corresponding loss function to reconstruct the initial density field and develop an annealing procedure to speed up and improve the convergence. We apply the method to halo number densities of $\bar{n} = 2.5\times 10^{-4} -10^{-3}({\rm h/Mpc})^3$, typical of current and future redshift surveys, and recover a Gaussian initial density field, mapping all the higher order information in the data into the power spectrum. We show that our reconstruction improves over the standard reconstruction. For baryonic acoustic oscillations (BAO) the gains are relatively modest because BAO is dominated by large scales where standard reconstruction suffices. We improve upon it by $\sim 15-20\%$ in terms of error on BAO peak as estimated by Fisher analysis at $z=0$. We expect larger gains will be achieved when applying this method to the broadband linear power spectrum reconstruction on smaller scales.

Fast N-body PM simulations with a small number of time steps such as FastPM or COLA have been remarkably successful in modeling the galaxy statistics, but their lack of small scale force resolution and long time steps cannot give accurate halo matter profiles or matter power spectrum. High resolution N-body simulations can improve on this, but lack baryonic effects, which can only be properly included in hydro simulations. Here we present a scheme to calibrate the fast simulations to mimic the precision of the hydrodynamic simulations or high resolution N-body simulations. The scheme is based on a gradient descent of either effective gravitational potential, which mimics the short range force, or of effective enthalpy, which mimics gas hydrodynamics and feedback. The scheme is fast and differentiable, and can be incorporated as a post-processing step into any simulation. It gives very good results for the matter power spectrum for several of the baryonic feedback and dark matter simulations, and also gives improved dark matter halo profiles. The scheme is even able to find the large subhalos, and increase the correlation coefficient between the fast simulations and the high resolution N-body or hydro simulations. It can also be used to add baryonic effects to the high resolution N-body simulations. While the method has free parameters that can be calibrated on various simulations, they can also be viewed as astrophysical nuisance parameters describing baryonic effects that can be marginalized over during the data analysis. In this view these parameters can be viewed as an efficient parametrization of baryonic effects.

We develop a new method to constraint primordial non-Gaussianities of the local kind using unclustered tracers of the Large Scale Structure. We show that in the limit of low noise, zero bias tracers yield large improvement over standard methods, mostly due to vanishing sampling variance. We propose a simple technique to construct such a tracer, using environmental information obtained from the original sample, and validate our method with N-body simulations. Our results indicate that $\sigma_{f_{\mathrm{NL}}^{\mathrm{loc}}}\simeq1$ can be reached using only information on a single tracer of sufficiently high number density.

Inflation is the leading theory of the first instant of the universe. Inflation, which postulates that the universe underwent a period of rapid expansion an instant after its birth, provides convincing explanation for cosmological observations. Recent advancements in detector technology have opened opportunities to explore primordial gravitational waves generated by the inflation through B-mode (divergent-free) polarization pattern embedded in the Cosmic Microwave Background anisotropies. If detected, these signals would provide strong evidence for inflation, point to the correct model for inflation, and open a window to physics at ultra-high energies. LiteBIRD is a satellite mission with a goal of detecting degree-and-larger-angular-scale B-mode polarization. LiteBIRD will observe at the second Lagrange point with a 400 mm diameter telescope and 2,622 detectors. It will survey the entire sky with 15 frequency bands from 40 to 400 GHz to measure and subtract foregrounds. The U.S. LiteBIRD team is proposing to deliver sub-Kelvin instruments that include detectors and readout electronics. A lenslet-coupled sinuous antenna array will cover low-frequency bands (40 GHz to 235 GHz) with four frequency arrangements of trichroic pixels. An orthomode-transducer-coupled corrugated horn array will cover high-frequency bands (280 GHz to 402 GHz) with three types of single frequency detectors. The detectors will be made with Transition Edge Sensor (TES) bolometers cooled to a 100 milli-Kelvin base temperature by an adiabatic demagnetization refrigerator.The TES bolometers will be read out using digital frequency multiplexing with Superconducting QUantum Interference Device (SQUID) amplifiers. Up to 78 bolometers will be multiplexed with a single SQUID amplidier. We report on the sub-Kelvin instrument design and ongoing developments for the LiteBIRD mission.

One of the main unsolved problems of cosmology is how to maximize the extraction of information from nonlinear data. If the data are nonlinear the usual approach is to employ a sequence of statistics (N-point statistics, counting statistics of clusters, density peaks or voids etc.), along with the corresponding covariance matrices. However, this approach is computationally prohibitive and has not been shown to be exhaustive in terms of information content. Here we instead develop a Bayesian approach, expanding the likelihood around the maximum posterior of linear modes, which we solve for using optimization methods. By integrating out the modes using perturbative expansion of the likelihood we construct an initial power spectrum estimator, which for a fixed forward model contains all the cosmological information if the initial modes are gaussian distributed. We develop a method to construct the window and covariance matrix such that the estimator is explicitly unbiased and nearly optimal. We then generalize the method to include the forward model parameters, including cosmological and nuisance parameters, and primordial non-gaussianity. We apply the method in the simplified context of nonlinear structure formation, using either simplified 2-LPT dynamics or N-body simulations as the nonlinear mapping between linear and nonlinear density, and 2-LPT dynamics in the optimization steps used to reconstruct the initial density modes. We demonstrate that the method gives an unbiased estimator of the initial power spectrum, providing among other a near optimal reconstruction of linear baryonic acoustic oscillations.

As a major source of cosmological information, galaxy clustering is susceptible to long-wavelength density and tidal fluctuations. These long modes modulate the growth and expansion rate of local structures, shifting them in both amplitude and scale. These effects are often named the growth and dilation effects, respectively. In particular the dilation shifts the baryon acoustic oscillation (BAO) peak and breaks the assumption of the Alcock-Paczynski (AP) test. This cannot be removed with reconstruction techniques because the effect originates from long modes outside the survey. In redshift space, the long modes generate a large-scale radial peculiar velocity that affects the redshift-space distortion (RSD) signal. We compute the redshift-space response functions of the galaxy power spectrum to long density and tidal modes at leading order in perturbation theory, including both the growth and dilation terms. We validate these response functions against measurements from simulated galaxy mock catalogs. As one application, long density and tidal modes beyond the scale of a survey correlate various observables leading to an excess error known as the super-sample covariance, and thus weaken their constraining power. We quantify the super-sample effect on BAO, AP, and RSD measurements, and study its impact on current and future surveys.

We present nbodykit, an open-source, massively parallel Python toolkit for analyzing large-scale structure (LSS) data. Using Python bindings of the Message Passing Interface (MPI), we provide parallel implementations of many commonly used algorithms in LSS. nbodykit is both an interactive and scalable piece of scientific software, performing well in a supercomputing environment while still taking advantage of the interactive tools provided by the Python ecosystem. Existing functionality includes estimators of the power spectrum, 2 and 3-point correlation functions, a Friends-of-Friends grouping algorithm, mock catalog creation via the halo occupation distribution technique, and approximate N-body simulations via the FastPM scheme. The package also provides a set of distributed data containers, insulated from the algorithms themselves, that enable nbodykit to provide a unified treatment of both simulation and observational data sets. nbodykit can be easily deployed in a high performance computing environment, overcoming some of the traditional difficulties of using Python on supercomputers. We provide performance benchmarks illustrating the scalability of the software. The modular, component-based approach of nbodykit allows researchers to easily build complex applications using its tools. The package is extensively documented at http://nbodykit.readthedocs.io, which also includes an interactive set of example recipes for new users to explore. As open-source software, we hope nbodykit provides a common framework for the community to use and develop in confronting the analysis challenges of future LSS surveys.

We present several methods to accurately estimate Lagrangian bias parameters and substantiate them using simulations. In particular, we focus on the quadratic terms, both the local and the non local ones, and show the first clear evidence for the latter in the simulations. Using Fourier space correlations, we also show for the first time, the scale dependence of the quadratic and non-local bias coefficients. For the linear bias, we fit for the scale dependence and demonstrate the validity of a consistency relation between linear bias parameters. Furthermore we employ real space estimators, using both cross-correlations and the Peak-Background Split argument. This is the first time the latter is used to measure anisotropic bias coefficients. We find good agreement for all the parameters among these different methods, and also good agreement for local bias with ESP$\tau$ theory predictions. We also try to exploit possible relations among the different bias parameters. Finally, we show how including higher order bias reduces the magnitude and scale dependence of stochasticity of the halo field.

We introduce FastPM, a highly-scalable approximated particle mesh N-body solver, which implements the particle mesh (PM) scheme enforcing correct linear displacement (1LPT) evolution via modified kick and drift factors. Employing a 2-dimensional domain decomposing scheme, FastPM scales extremely well with a very large number of CPUs. In contrast to COmoving-LAgrangian (COLA) approach, we do not require to split the force or track separately the 2LPT solution, reducing the code complexity and memory requirements. We compare FastPM with different number of steps ($N_s$) and force resolution factor ($B$) against 3 benchmarks: halo mass function from Friends of Friends halo finder, halo and dark matter power spectrum, and cross correlation coefficient (or stochasticity), relative to a high resolution TreePM simulation. We show that the modified time stepping scheme reduces the halo stochasticity when compared to COLA with the same number of steps and force resolution. While increasing $N_s$ and $B$ improves the transfer function and cross correlation coefficient, for many applications FastPM achieves sufficient accuracy at low $N_s$ and $B$. For example, $N_s=10$ and $B=2$ simulation provides a substantial saving (a factor of 10) of computing time relative to $N_s=40$, $B=3$ simulation, yet the halo benchmarks are very similar at $z=0$. We find that for abundance matched halos the stochasticity remains low even for $N_s=5$. FastPM compares well against less expensive schemes, being only 7 (4) times more expensive than 2LPT initial condition generator for $N_s=10$ ($N_s=5$). Some of the applications where FastPM can be useful are generating a large number of mocks, producing non-linear statistics where one varies a large number of nuisance or cosmological parameters, or serving as part of an initial conditions solver.

We analyse the power spectrum of the Baryon Oscillation Spectroscopic Survey (BOSS), Data Release 12 (DR12) to constrain the relative velocity effect, which represents a potential systematic for measurements of the Baryon Acoustic Oscillation (BAO) scale. The relative velocity effect is sourced by the different evolution of baryon and cold dark matter perturbations before decoupling. Our power spectrum model includes all $1$-loop redshift-space terms corresponding to $v_{\rm bc}$ parameterised by the bias parameter $b_{v^2}$. We also include the linear terms proportional to the relative density, $\delta_{\rm bc}$, and relative velocity dispersion, $\theta_{\rm bc}$, which we parameterise with the bias parameters $b^{\rm bc}_{\delta}$ and $b^{\rm bc}_{\theta}$. Our data does not support a detection of the relative velocity effect in any of these parameters. Combining the low and high redshift bins of BOSS, we find limits of $b_{v^2} = 0.012 \pm 0.015\;(\pm 0.031)$, $b^{\rm bc}_{\delta} = -1.0 \pm 2.5\;(\pm 6.2)$ and $b^{\rm bc}_{\theta} = -114 \pm 55\;(\pm 175)$ with $68\%$ ($95\%$) confidence levels. These constraints restrict the potential systematic shift in $D_A(z)$, $H(z)$ and $f\sigma_8$, due to the relative velocity, to $1\%$, $0.8\%$ and $2\%$, respectively. Given the current uncertainties on the BAO measurements of BOSS these shifts correspond to $0.53\sigma$, $0.5\sigma$ and $0.22\sigma$ for $D_A(z)$, $H(z)$ and $f\sigma_8$, respectively.

We study the covariance properties of real space correlation function estimators -- primarily galaxy-shear correlations, or galaxy-galaxy lensing -- using SDSS data for both shear catalogs and lenses (specifically the BOSS LOWZ sample). Using mock catalogs of lenses and sources, we disentangle the various contributions to the covariance matrix and compare them with a simple analytical model. We show that not subtracting the lensing measurement around random points from the measurement around the lens sample is equivalent to performing the measurement using the lens density field instead of the lens over-density field. While the measurement using the lens density field is unbiased (in the absence of systematics), its error is significantly larger due to an additional term in the covariance. Therefore, this subtraction should be performed regardless of its beneficial effects on systematics. Comparing the error estimates from data and mocks for estimators that involve the over-density, we find that the errors are dominated by the shape noise and lens clustering, that empirically estimated covariances (jackknife and standard deviation across mocks) are consistent with theoretical estimates, and that both the connected parts of the 4-point function and the super-sample covariance can be neglected for the current levels of noise. While the trade-off between different terms in the covariance depends on the survey configuration (area, source number density), the diagnostics that we use in this work should be useful for future works to test their empirically-determined covariances.

We present a new model for the redshift-space power spectrum of galaxies and demonstrate its accuracy in modeling the monopole, quadrupole, and hexadecapole of the galaxy density field down to scales of $k = 0.4 \ h\mathrm{Mpc}^{-1}$. The model describes the clustering of galaxies in the context of a halo model and the clustering of the underlying halos in redshift space using a combination of Eulerian perturbation theory and $N$-body simulations. The modeling of redshift-space distortions is done using the so-called distribution function approach. The final model has 13 free parameters, and each parameter is physically motivated rather than a nuisance parameter, which allows the use of well-motivated priors. We account for the Finger-of-God effect from centrals and both isolated and non-isolated satellites rather than using a single velocity dispersion to describe the combined effect. We test and validate the accuracy of the model on several sets of high-fidelity $N$-body simulations, as well as realistic mock catalogs designed to simulate the BOSS DR12 CMASS data set. The suite of simulations covers a range of cosmologies and galaxy bias models, providing a rigorous test of the level of theoretical systematics present in the model. The level of bias in the recovered values of $f \sigma_8$ is found to be small. When including scales to $k = 0.4 \ h\mathrm{Mpc}^{-1}$, we find 15-30\% gains in the statistical precision of $f \sigma_8$ relative to $k = 0.2 \ h\mathrm{Mpc}^{-1}$ and a roughly 10-15\% improvement for the perpendicular Alcock-Paczynski parameter $\alpha_\perp$. Using the BOSS DR12 CMASS mocks as a benchmark for comparison, we estimate an uncertainty on $f \sigma_8$ that is $\sim$10-20\% larger than other similar Fourier-space RSD models in the literature that use $k \leq 0.2 \ h\mathrm{Mpc}^{-1}$, suggesting that these models likely have a too-limited parametrization.

Measurements of line-of-sight dependent clustering via the galaxy power spectrum's multipole moments constitute a powerful tool for testing theoretical models in large-scale structure. Recent work shows that this measurement, including a moving line-of-sight, can be accelerated using Fast Fourier Transforms (FFTs) by decomposing the Legendre polynomials into products of Cartesian vectors. Here, we present a faster, optimal means of using FFTs for this measurement. We avoid redundancy present in the Cartesian decomposition by using a spherical harmonic decomposition of the Legendre polynomials. Consequently, our method is substantially faster: a given multipole of order $\ell$ requires only $2\ell+1$ FFTs rather than the $(\ell+1)(\ell+2)/2$ FFTs of the Cartesian approach. For the hexadecapole ($\ell = 4$), this translates to $40\%$ fewer FFTs, with increased savings for higher $\ell$. The reduction in wall-clock time enables the calculation of finely-binned wedges in $P(k,\mu)$, obtained by computing multipoles up to a large $\ell_{\rm max}$ and combining them. This transformation has a number of advantages. We demonstrate that by using non-uniform bins in $\mu$, we can isolate plane-of-sky (angular) systematics to a narrow bin at $\mu \simeq 0$ while eliminating the contamination from all other bins. We also show that the covariance matrix of clustering wedges binned uniformly in $\mu$ becomes ill-conditioned when combining multipoles up to large values of $\ell_{\rm max}$, but that the problem can be avoided with non-uniform binning. As an example, we present results using $\ell_{\rm max}=16$, for which our procedure requires a factor of 3.4 fewer FFTs than the Cartesian method, while removing the first $\mu$ bin leads only to a 7% increase in statistical error on $f \sigma_8$, as compared to a 54% increase with $\ell_{\rm max}=4$.

The use of large, X-ray selected galaxy cluster catalogues for cosmological analyses requires a thorough understanding of the X-ray mass estimates. Weak gravitational lensing is an ideal method to shed light on such issues, due to its insensitivity to the cluster dynamical state. We perform a weak lensing calibration of 166 galaxy clusters from the REFLEX and BCS cluster catalogue and compare our results to the X-ray masses based on scaled luminosities from that catalogue. To interpret the weak lensing signal in terms of cluster masses, we compare the lensing signal to simple theoretical Navarro-Frenk-White models and to simulated cluster lensing profiles, including complications such as cluster substructure, projected large-scale structure, and Eddington bias. We find evidence of underestimation in the X-ray masses, as expected, with $\langle M_{\mathrm{X}}/M_{\mathrm{WL}}\rangle = 0.75 \pm 0.07$ stat. $\pm 0.05$ sys. for our best-fit model. The biases in cosmological parameters in a typical cluster abundance measurement that ignores this mass bias will typically exceed the statistical errors.

Thermal Sunyaev-Zeldovich (tSZ) power spectrum is one of the most sensitive methods to constrain cosmological parameters, scaling as the amplitude $\sigma_8^8$. It is determined by the integral over the halo mass function multiplied by the total pressure content of clusters, and further convolved by the cluster gas pressure profile. It has been shown that various feedback effects can change significantly the pressure profile, possibly even pushing the gas out to the virial radius and beyond, strongly affecting the tSZ power spectrum at high $l$. Energetics arguments and SZ-halo mass scaling relations suggest feedback is unlikely to significantly change the total pressure content, making low $l$ tSZ power spectrum more robust against feedback effects. Furthermore, the separation between the cosmic infrared background (CIB) and tSZ is more reliable at low $l$. Low $l$ modes are however probing very small volumes, giving rise to very large non-gaussian sampling variance errors. By computing the trispectrum contribution we identify $90<l<350$ as the minimum variance scale where the combined error is minimized. Using the measurement at this $l$ provides constraints that are almost as strong as using the entire power spectrum. We extend the work by the Planck collaboration by including a full trispectrum and feedback effects in the analysis. We perform a Markov-Chain Monte Carlo analysis over the two dimensional parameter space and find constraints on $\sigma_8$ by marginalizing over the feedback nuisance parameter.We obtain $\sigma_8 =0.820^{+0.021}_{-0.009}\left(\Omega_m/0.31\right)^{0.4}$, when fixing other parameters to Planck cosmology values. Our results suggest it is possible to obtain competitive cosmological constraints from tSZ without cluster redshift information, and that the current tSZ power spectrum shows no evidence for a low amplitude of $\sigma_8$.

DESI (Dark Energy Spectropic Instrument) is a Stage IV ground-based dark energy experiment that will study baryon acoustic oscillations and the growth of structure through redshift-space distortions with a wide-area galaxy and quasar redshift survey. The DESI instrument is a robotically-actuated, fiber-fed spectrograph capable of taking up to 5,000 simultaneous spectra over a wavelength range from 360 nm to 980 nm. The fibers feed ten three-arm spectrographs with resolution $R= \lambda/\Delta\lambda$ between 2000 and 5500, depending on wavelength. The DESI instrument will be used to conduct a five-year survey designed to cover 14,000 deg$^2$. This powerful instrument will be installed at prime focus on the 4-m Mayall telescope in Kitt Peak, Arizona, along with a new optical corrector, which will provide a three-degree diameter field of view. The DESI collaboration will also deliver a spectroscopic pipeline and data management system to reduce and archive all data for eventual public use.

DESI (Dark Energy Spectroscopic Instrument) is a Stage IV ground-based dark energy experiment that will study baryon acoustic oscillations (BAO) and the growth of structure through redshift-space distortions with a wide-area galaxy and quasar redshift survey. To trace the underlying dark matter distribution, spectroscopic targets will be selected in four classes from imaging data. We will measure luminous red galaxies up to $z=1.0$. To probe the Universe out to even higher redshift, DESI will target bright [O II] emission line galaxies up to $z=1.7$. Quasars will be targeted both as direct tracers of the underlying dark matter distribution and, at higher redshifts ($ 2.1 < z < 3.5$), for the Ly-$\alpha$ forest absorption features in their spectra, which will be used to trace the distribution of neutral hydrogen. When moonlight prevents efficient observations of the faint targets of the baseline survey, DESI will conduct a magnitude-limited Bright Galaxy Survey comprising approximately 10 million galaxies with a median $z\approx 0.2$. In total, more than 30 million galaxy and quasar redshifts will be obtained to measure the BAO feature and determine the matter power spectrum, including redshift space distortions.

The Dark Energy Spectroscopic Instrument (DESI), a multiplexed fiber-fed spectrograph, is a Stage-IV ground-based dark energy experiment aiming to measure redshifts for 29 million Emission-Line Galaxies (ELG), 4 million Luminous Red Galaxies (LRG), and 2 million Quasi-Stellar Objects (QSO). The survey design includes a pattern of tiling on the sky and the locations of the fiber positioners in the focal plane of the telescope, with the observation strategy determined by a fiber assignment algorithm that optimizes the allocation of fibers to targets. This strategy allows a given region to be covered on average five times for a five-year survey, but with coverage varying between zero and twelve, which imprints a spatially-dependent pattern on the galaxy clustering. We investigate the systematic effects of the fiber assignment coverage on the anisotropic galaxy clustering of ELGs and show that, in the absence of any corrections, it leads to discrepancies of order ten percent on large scales for the power spectrum multipoles. We introduce a method where objects in a random catalog are assigned a coverage, and the mean density is separately computed for each coverage factor. We show that this method reduces, but does not eliminate the effect. We next investigate the angular dependence of the contaminated signal, arguing that it is mostly localized to purely transverse modes. We demonstrate that the cleanest way to remove the contaminating signal is to perform an analysis of the anisotropic power spectrum $P(k,\mu)$ and remove the lowest $\mu$ bin, leaving $\mu>0$ modes accurate at the few-percent level. Here, $\mu$ is the cosine of the angle between the line-of-sight and the direction of $\vec{k}$. We also investigate two alternative definitions of the random catalog and show they are comparable but less effective than the coverage randoms method.

We evaluate the covariance matrix of the matter power spectrum using perturbation theory up to dominant terms at 1-loop order and compare it to numerical simulations. We decompose the covariance matrix into the disconnected (Gaussian) part, trispectrum from the modes outside the survey (beat coupling or super-sample variance), and trispectrum from the modes inside the survey, and show how the different components contribute to the overall covariance matrix. We find the agreement with the simulations is at a 10\% level up to $k \sim 1 h {\rm Mpc^{-1}}$. We show that all the connected components are dominated by the large-scale modes ($k<0.1 h {\rm Mpc^{-1}}$), regardless of the value of the wavevectors $k,\, k'$ of the covariance matrix, suggesting that one must be careful in applying the jackknife or bootstrap methods to the covariance matrix. We perform an eigenmode decomposition of the connected part of the covariance matrix, showing that at higher $k$ it is dominated by a single eigenmode. The full covariance matrix can be approximated as the disconnected part only, with the connected part being treated as an external nuisance parameter with a known scale dependence, and a known prior on its variance for a given survey volume. Finally, we provide a prescription for how to evaluate the covariance matrix from small box simulations without the need to simulate large volumes.

A strong instrumentation and detector R&D program has enabled the current generation of cosmic frontier surveys. A small investment in R&D will continue to pay dividends and enable new probes to investigate the accelerated expansion of the universe. Instrumentation and detector R&D provide critical training opportunities for future generations of experimentalists, skills that are important across the entire Department of Energy High Energy Physics program.

We explore the relationship between the nonlinear matter power spectrum and the various Lagrangian and Standard Perturbation Theories (LPT and SPT). We first look at it in the context of one dimensional (1-d) dynamics, where 1LPT is exact at the perturbative level and one can exactly resum the SPT series into the 1LPT power spectrum. Shell crossings lead to non-perturbative effects, and the PT ignorance can be quantified in terms of their ratio, which is also the transfer function squared in the absence of stochasticity. At the order of PT we work, this parametrization is equivalent to the results of effective field theory (EFT), and can thus be expanded in terms of the same parameters. We find that its radius of convergence is larger than the SPT loop expansion. The same EFT parametrization applies to all SPT loop terms and, if stochasticity can be ignored, to all N-point correlators. In 3-d, the LPT structure is considerably more complicated, and we find that LPT models with parametrization motivated by the EFT exhibit running with $k$ and that SPT is generally a better choice. Since these transfer function expansions contain free parameters that change with cosmological model their usefulness for broadband power is unclear. For this reason we test the predictions of these models on baryonic acoustic oscillations (BAO) and other primordial oscillations, including string monodromy models, for which we ran a series of simulations with and without oscillations. Most models are successful in predicting oscillations beyond their corresponding PT versions, confirming the basic validity of the model.

Cosmic surveys provide crucial information about high energy physics including strong evidence for dark energy, dark matter, and inflation. Ongoing and upcoming surveys will start to identify the underlying physics of these new phenomena, including tight constraints on the equation of state of dark energy, the viability of modified gravity, the existence of extra light species, the masses of the neutrinos, and the potential of the field that drove inflation. Even after the Stage IV experiments, DESI and LSST, complete their surveys, there will still be much information left in the sky. This additional information will enable us to understand the physics underlying the dark universe at an even deeper level and, in case Stage IV surveys find hints for physics beyond the current Standard Model of Cosmology, to revolutionize our current view of the universe. There are many ideas for how best to supplement and aid DESI and LSST in order to access some of this remaining information and how surveys beyond Stage IV can fully exploit this regime. These ideas flow to potential projects that could start construction in the 2020's.

Amongst standard model parameters that are constrained by cosmic microwave background (CMB) observations, the optical depth $\tau$ stands out as a nuisance parameter. While $\tau$ provides some crude limits on reionization, it also degrades constraints on other cosmological parameters. Here we explore how 21 cm cosmology---as a direct probe of reionization---can be used to independently predict $\tau$ in an effort to improve CMB parameter constraints. We develop two complementary schemes for doing so. The first uses 21 cm power spectrum observations in conjunction with semi-analytic simulations to predict $\tau$. The other uses global 21 cm measurements to directly constrain low redshift (post-reheating) contributions to $\tau$ in a relatively model-independent way. Forecasting the performance of the upcoming Hydrogen Epoch of Reionization Array, we find that significant reductions in the errors on $\tau$ can be achieved. These results are particularly effective at breaking the CMB degeneracy between $\tau$ and the amplitude of the primordial fluctuation spectrum $A_s$, with errors on $\ln (10^{10} A_s)$ reduced by up to a factor of four. Stage 4 CMB constraints on the neutrino mass sum are also improved, with errors potentially reduced to $12\,\textrm{meV}$ regardless of whether CMB experiments can precisely measure the reionization bump in polarization power spectra. Observations of the 21 cm line are therefore capable of improving not only our understanding of reionization astrophysics, but also of cosmology in general.

The standard formalism for the co-evolution of halos and dark matter predicts that any initial halo velocity bias rapidly decays to zero. We argue that, when the purpose is to compute statistics like power spectra etc., the coupling in the momentum conservation equation for the biased tracers must be modified. Our new formulation predicts the constancy in time of any statistical halo velocity bias present in the initial conditions, in agreement with peak theory. We test this prediction by studying the evolution of a conserved halo population in N-body simulations. We establish that the initial simulated halo density and velocity statistics show distinct features of the peak model and, thus, deviate from the simple local Lagrangian bias. We demonstrate, for the first time, that the time evolution of their velocity is in tension with the rapid decay expected in the standard approach.

The Extended Baryon Oscillation Spectroscopic Survey (eBOSS) will conduct novel cosmological observations using the BOSS spectrograph at Apache Point Observatory. Observations will be simultaneous with the Time Domain Spectroscopic Survey (TDSS) designed for variability studies and the Spectroscopic Identification of eROSITA Sources (SPIDERS) program designed for studies of X-ray sources. eBOSS will use four different tracers to measure the distance-redshift relation with baryon acoustic oscillations (BAO). Using more than 250,000 new, spectroscopically confirmed luminous red galaxies at a median redshift z=0.72, we project that eBOSS will yield measurements of $d_A(z)$ to an accuracy of 1.2% and measurements of H(z) to 2.1% when combined with the z>0.6 sample of BOSS galaxies. With ~195,000 new emission line galaxy redshifts, we expect BAO measurements of $d_A(z)$ to an accuracy of 3.1% and H(z) to 4.7% at an effective redshift of z= 0.87. A sample of more than 500,000 spectroscopically-confirmed quasars will provide the first BAO distance measurements over the redshift range 0.9<z<2.2, with expected precision of 2.8% and 4.2% on $d_A(z)$ and H(z), respectively. Finally, with 60,000 new quasars and re-observation of 60,000 quasars known from BOSS, we will obtain new Lyman-alpha forest measurements at redshifts z>2.1; these new data will enhance the precision of $d_A(z)$ and H(z) by a factor of 1.44 relative to BOSS. Furthermore, eBOSS will provide improved tests of General Relativity on cosmological scales through redshift-space distortion measurements, improved tests for non-Gaussianity in the primordial density field, and new constraints on the summed mass of all neutrino species. Here, we provide an overview of the cosmological goals, spectroscopic target sample, demonstration of spectral quality from early data, and projected cosmological constraints from eBOSS.

Theoretical modeling of the redshift-space power spectrum of galaxies is crucially important to correctly extract cosmological information from redshift surveys. The task is complicated by the nonlinear biasing and redshift space distortion effects, which change with halo mass, and by the wide distribution of halo masses and their occupations by galaxies. One of the main modeling challenges is the existence of satellite galaxies that have both radial distribution and large virial velocities inside halos, a phenomenon known as the Finger-of-God effect. We present a model for the galaxy power spectrum of in which we decompose a given galaxy sample into central and satellite galaxies and relate different contributions to 1- and 2-halo terms in a halo model. Our primary goal is to ensure that any parameters that we introduce have physically meaningful values, and are not just fitting parameters. For the 2-halo terms we use the previously developed RSD modeling of halos in the context of distribution function and perturbation theory approach. This term needs to be multiplied by the effect of radial distances and velocities of satellites inside the halo. To this one needs to add the 1-halo terms, which are non-perturbative. We show that the real space 1-halo terms can be modeled as almost constant, with the finite extent of the satellites inside the halo inducing a small k^2R^2 term, where R is related to the size of the halo. We adopt a similar model for FoG in redshift space, ensuring that FoG velocity dispersion is related to the halo mass. For FoG k^2 type expansions do not work and FoG resummation must be used instead. We test several damping functions to model the velocity dispersion FoG effect. Applying the formalism to mock galaxies modeled after the "CMASS" sample of the BOSS survey, we find that our predictions for the redshift-space power spectra are accurate up to k~0.4Mpc/h.

We study the local response to long wavelength fluctuations in cosmological $N$-body simulations, focusing on the matter and halo power spectra, halo abundance and non-linear transformations of the density field. The long wavelength mode is implemented using an effective curved cosmology and a mapping of time and distances. The method provides an alternative, most probably more precise, way to measure the isotropic halo biases. Limiting ourselves to the linear case, we find generally good agreement between the biases obtained from the curvature method and the traditional power spectrum method at the level of a few percent. We also study the response of halo counts to changes in the variance of the field and find that the slope of the relation between the responses to density and variance differs from the naive derivation assuming a universal mass function by 18%. This has implications for measurements of the amplitude of local non-Gaussianity using scale dependent bias. We also analyze the halo power spectrum and halo-dark matter cross-spectrum response to long wavelength fluctuations and derive second order halo bias from it, as well as the super-sample variance contribution to the galaxy power spectrum covariance matrix.

Perturbation theory for dark matter clustering has received a lot of attention in recent years, but its convergence properties remain poorly justified and there is no successful model that works both for correlation function and for power spectrum. Here we present Halo Zeldovich approach combined with perturbation theory (HZPT), in which we use standard perturbation theory at one loop order (SPT) at very low $k$, and connect it to a version of the halo model, for which we adopt the Zeldovich approximation plus a Pade expansion of a compensated one halo term. This low $k$ matching allows us to determine the one halo term amplitude and redshift evolution, both of which are in an excellent agreement with simulations, and approximately agree with the expected value from the halo model. Our Pade expansion approach of the one halo term added to Zeldovich approximation identifies two typical halo scales averaged over the halo mass function, the halo radius scale of order of 1Mpc/h, and the halo mass compensation scale of order 26Mpc/h. The model gives better than one percent accurate predictions for the correlation function above 5Mpc/h at all redshifts, without any free parameters. With three fitted Pade expansion coefficients the agreement in power spectrum is good to a percent up to $k \sim 1$h/Mpc, which can be improved to arbitrary $k$ by adding higher order terms in Pade expansion.

Coherent alignments of galaxy shapes, often called "intrinsic alignments" (IA), are the most significant source of astrophysical uncertainty in weak lensing measurements. We develop the tidal alignment model of IA and demonstrate its success in describing observational data. We also describe a technique to separate IA from galaxy-galaxy lensing measurements. Applying this technique to luminous red galaxy lenses in the Sloan Digital Sky Survey, we constrain potential IA contamination from associated sources to be below a few percent.

We develop an analytic model for galaxy intrinsic alignments (IA) based on the theory of tidal alignment. We calculate all relevant nonlinear corrections at one-loop order, including effects from nonlinear density evolution, galaxy biasing, and source density weighting. Contributions from density weighting are found to be particularly important and lead to bias dependence of the IA amplitude, even on large scales. This effect may be responsible for much of the luminosity dependence in IA observations. The increase in IA amplitude for more highly biased galaxies reflects their locations in regions with large tidal fields. We also consider the impact of smoothing the tidal field on halo scales. We compare the performance of this consistent nonlinear model in describing the observed alignment of luminous red galaxies with the linear model as well as the frequently used "nonlinear alignment model," finding a significant improvement on small and intermediate scales. We also show that the cross-correlation between density and IA (the "GI" term) can be effectively separated into source alignment and source clustering, and we accurately model the observed alignment down to the one-halo regime using the tidal field from the fully nonlinear halo-matter cross correlation. Inside the one-halo regime, the average alignment of galaxies with density tracers no longer follows the tidal alignment prediction, likely reflecting nonlinear processes that must be considered when modeling IA on these scales. Finally, we discuss tidal alignment in the context of cosmic shear measurements.

We explore the effect of applying a non-linear transformation to the Lyman-$\alpha$ forest transmitted flux $F=e^{-\tau}$ and the ability of analytic models to predict the resulting clustering amplitude. Both the large-scale bias of the transformed field (signal) and the amplitude of small scale fluctuations (noise) can be arbitrarily modified, but we were unable to find a transformation that increases significantly the signal-to-noise ratio on large scales using Taylor expansion up to third order. In particular, however, we achieve a 33% improvement in signal to noise for Gaussianized field in transverse direction. On the other hand, we explore an analytic model for the large-scale biasing of the Ly$\alpha$ forest, and present an extension of this model to describe the biasing of the transformed fields. Using hydrodynamic simulations we show that the model works best to describe the biasing with respect to velocity gradients, but is less successful in predicting the biasing with respect to large-scale density fluctuations, especially for very nonlinear transformations.

Clustering of large-scale structure provides significant cosmological information through the power spectrum of density perturbations. Additional information can be gained from higher-order statistics like the bispectrum, especially to break the degeneracy between the linear halo bias $b_1$ and the amplitude of fluctuations $\sigma_8$. We propose new simple, computationally inexpensive bispectrum statistics that are near optimal for the specific applications like bias determination. Corresponding to the Legendre decomposition of nonlinear halo bias and gravitational coupling at second order, these statistics are given by the cross-spectra of the density with three quadratic fields: the squared density, a tidal term, and a shift term. For halos and galaxies the first two have associated nonlinear bias terms $b_2$ and $b_{s^2}$, respectively, while the shift term has none in the absence of velocity bias (valid in the $k \rightarrow 0$ limit). Thus the linear bias $b_1$ is best determined by the shift cross-spectrum, while the squared density and tidal cross-spectra mostly tighten constraints on $b_2$ and $b_{s^2}$ once $b_1$ is known. Since the form of the cross-spectra is derived from optimal maximum-likelihood estimation, they contain the full bispectrum information on bias parameters. Perturbative analytical predictions for their expectation values and covariances agree with simulations on large scales, $k\lesssim 0.09h/\mathrm{Mpc}$ at $z=0.55$ with Gaussian $R=20h^{-1}\mathrm{Mpc}$ smoothing, for matter-matter-matter, and matter-matter-halo combinations. For halo-halo-halo cross-spectra the model also needs to include corrections to the Poisson stochasticity.

Understanding the relation between underlying matter distribution and biased tracers such as galaxy or dark matter halo is essential to extract cosmological information from ongoing or future galaxy redshift surveys. At sufficiently large scales such as the BAO scale, a standard approach for the bias problem on the basis of the perturbation theory (PT) is to assume the `local bias' model in which the density field of biased tracers is deterministically expanded in terms of matter density field at the same position. The higher-order bias parameters are then determined by combining the power spectrum with higher-order statistics such as the bispectrum. As is pointed out by recent studies, however, nonlinear gravitational evolution naturally induces nonlocal bias terms even if initially starting only with purely local bias. As a matter of fact, previous works showed that the second-order nonlocal bias term, which corresponds to the gravitational tidal field, is important to explain the characteristic scale-dependence of the bispectrum. In this paper we extend the nonlocal bias term up to third order, and investigate whether the PT-based model including nonlocal bias terms can simultaneously explain the power spectrum and the bispectrum of simulated halos in $N$-body simulations. We show that the power spectrum, including density and momentum, and the bispectrum between halo and matter in $N$-body simulations can be simultaneously well explained by the model including up to third-order nonlocal bias terms up to k~0.1h/Mpc. Also, the results seem in a good agreement with theoretical predictions of a simple coevolution picture, although the agreement is not perfect. These demonstration clearly shows a failure of the local bias model even at such large scales, and we conclude that nonlocal bias terms should be consistently included in order to model statistics of halos. [abridged]

Current and future galaxy surveys cover a large fraction of the entire sky with a significant redshift range, and the recent theoretical development shows that general relativistic effects are present in galaxy clustering on very large scales. This trend has renewed interest in the wide angle effect in galaxy clustering measurements, in which the distant-observer approximation is often adopted. Using the full wide-angle formula for computing the redshift-space correlation function, we show that compared to the sample variance, the deviation in the redshift-space correlation function from the simple Kaiser formula with the distant-observer approximation is negligible in galaxy surveys such as the SDSS, Euclid and the BigBOSS, if the theoretical prediction from the Kaiser formula is properly averaged over the survey volume. We also find corrections to the wide-angle formula and clarify the confusion in literature between the wide angle effect and the velocity contribution in galaxy clustering. However, when the FKP method is applied, substantial deviations can be present in the power spectrum analysis in future surveys, due to the non-uniform distribution of galaxy pairs.

We apply the convolved Lagrangian perturbation theory (CLPT) formalism, in which one can express the matter density power spectrum in terms of integrals over a function of cumulants of the displacement field, allowing for a resummation of the terms, to evaluate the full one loop power spectrum. We keep the cumulants up to third order, extending the Zel'dovich approximation and providing the power spectrum analogous to the calculations recently performed for the correlation function. We compare the results to the N-body simulations and to the Lagrangian perturbation simulations up to the second order. We find that the analytic calculations are in a good agreement with the LPT simulations, but when compared to full N-body simulations, we find that while one loop calculations improve upon the Zel'dovich approximation in the power spectrum, they still significantly lack power. As found previously in the correlation function one loop CLPT improves slightly against Zel'dovich above 30Mpc/h, but is actually worse than Zel'dovich below that. We investigate the deficiencies of the CLPT approach and argue that main problem of CLPT is its inability to trap particles inside dark matter halos, which leads to an overestimate of the small scale power of the displacement field and to an underestimate of the small scale power from one halo term effects. We model this using the displacement field damped at a nonlinear scale (CLPTs). To explore this in more detail we decompose the power spectrum and correlation function into three additive components: Zel'dovich, residual BAO wiggle, and residual broad band. One loop CLPT predicts small modifications to BAO wiggles that are enhanced in CLPTs, with up to 5\% corrections to correlation function around BAO scale.

We analyze BICEP2 and Planck data using a model that includes CMB lensing, gravity waves, and polarized dust. Planck dust polarization maps have highlighted the difficulty of estimating the dust polarization in low intensity regions, suggesting that the polarization fractions have considerable uncertainties and may be significantly higher than previous predictions. In this paper, we start by assuming nothing about the dust polarization except for the power spectrum shape, which we take to be $C_{l}^{BB} \propto l^{-2.42}$. The resulting joint BICEP2+Planck analysis favors solutions without gravity waves, and the upper limit on the tensor-to-scalar ratio is $r<0.11$, a slight improvement relative to the Planck analysis alone which gives $r<0.13$ (95% c.l.). The estimated amplitude of the dust polarization power spectrum agrees with expectations for this field based on both HI column density and Planck polarization measurements at 353 GHz in the BICEP2 field. Including the latter constraint in our analysis improves the limit further to $r < 0.09$, placing strong constraints on inflation (e.g., models with $r>0.14$ are excluded with 99.5% confidence). We address the cross-correlation analysis of BICEP2 at 150 GHz with BICEP1 at 100 GHz as a test of foreground contamination. We find that the null hypothesis of dust and lensing with $r=0$ gives $\Delta \chi^2<2$ relative to the hypothesis of no dust, so the frequency analysis does not strongly favor either model over the other. We also discuss how more accurate dust polarization maps may improve our constraints. If the dust polarization is measured perfectly, the limit can reach $r<0.05$, but this degrades quickly to almost no improvement if the dust calibration error is 20% or larger or if the dust maps are not processed through the BICEP2 pipeline, inducing sampling variance noise. (Abridged.)

We develop a model for the matter power spectrum as the sum of Zeldovich approximation and even powers of $k$, i.e., $A_0 - A_2k^2 + A_4k^4 - ...$, compensated at low $k$. With terms up to $k^4$ the model can predict the true power spectrum to a few percent accuracy up to $k\sim 0.7 h \rm{Mpc}^{-1}$, over a wide range of redshifts and models. The $A_n$ coefficients contain information about cosmology, in particular amplitude of fluctuations. We write a simple form of the covariance matrix as a sum of Gaussian part and $A_0$ variance, which reproduces the simulations remarkably well. In contrast, we show that one needs an N-body simulation volume of more than 1000 $({\rm Gpc}/h)^3$ to converge to 1\% accuracy on covariance matrix. We investigate the super-sample variance effect and show it can be modeled as an additional parameter that can be determined from the data. This allows a determination of $\sigma_8$ amplitude to about 0.2\% for a survey volume of 1$({\rm Gpc}/h)^3$, compared to 0.4\% otherwise. We explore the sensitivity of these coefficients to baryonic effects using hydrodynamic simulations of van Daalen (2011). We find that because of baryons redistributing matter inside halos all the coefficients $A_{2n}$ for $n>0$ are strongly affected by baryonic effects, while $A_0$ remains almost unchanged, a consequence of halo mass conservation. Our results suggest that observations such as weak lensing power spectrum can be effectively marginalized over the baryonic effects, while still preserving the bulk of the cosmological information contained in $A_0$ and Zeldovich terms.

This is a report on the status and prospects of the quantification of neutrino properties through the cosmological neutrino background for the Cosmic Frontier of the Division of Particles and Fields Community Summer Study long-term planning exercise. Experiments planned and underway are prepared to study the cosmological neutrino background in detail via its influence on distance-redshift relations and the growth of structure. The program for the next decade described in this document, including upcoming spectroscopic galaxy surveys eBOSS and DESI and a new Stage-IV CMB polarization experiment CMB-S4, will achieve sigma(sum m_nu) = 16 meV and sigma(N_eff) = 0.020. Such a mass measurement will produce a high significance detection of non-zero sum m_nu, whose lower bound derived from atmospheric and solar neutrino oscillation data is about 58 meV. If neutrinos have a minimal normal mass hierarchy, this measurement will definitively rule out the inverted neutrino mass hierarchy, shedding light on one of the most puzzling aspects of the Standard Model of particle physics --- the origin of mass. This precise a measurement of N_eff will allow for high sensitivity to any light and dark degrees of freedom produced in the big bang and a precision test of the standard cosmological model prediction that N_eff = 3.046.

Fluctuations in the intensity and polarization of the cosmic microwave background (CMB) and the large-scale distribution of matter in the universe each contain clues about the nature of the earliest moments of time. The next generation of CMB and large-scale structure (LSS) experiments are poised to test the leading paradigm for these earliest moments---the theory of cosmic inflation---and to detect the imprints of the inflationary epoch, thereby dramatically increasing our understanding of fundamental physics and the early universe. A future CMB experiment with sufficient angular resolution and frequency coverage that surveys at least 1% of the sky to a depth of 1 uK-arcmin can deliver a constraint on the tensor-to-scalar ratio that will either result in a 5-sigma measurement of the energy scale of inflation or rule out all large-field inflation models, even in the presence of foregrounds and the gravitational lensing B-mode signal. LSS experiments, particularly spectroscopic surveys such as the Dark Energy Spectroscopic Instrument, will complement the CMB effort by improving current constraints on running of the spectral index by up to a factor of four, improving constraints on curvature by a factor of ten, and providing non-Gaussianity constraints that are competitive with the current CMB bounds.

Direct measurements of peculiar velocities of galaxies and clusters of galaxies can in principle provide explicit information on the three dimensional mass distribution, but this information is modulated by the fact that velocity field is sampled at galaxy positions, and is thus probing galaxy momentum. We derive expressions for the cross power spectrum between the density and momentum field and the auto spectrum of the momentum field in redshift space, by extending the distribution function method to these statistics. The resulting momentum cross and auto power spectra in redshift space are expressed as infinite sums over velocity moment correlators in real space, as is the case for the density power spectrum in redshift space. We compute each correlator using Eulerian perturbation theory (PT) and halo biasing model and compare the resulting redshift-space velocity statistics to those measured from N-body simulations for both dark matter and halos. We find that in redshift space linear theory predictions for the density-momentum cross power spectrum as well as for the momentum auto spectrum fail to predict the N-body results at very large scales. On the other hand, our nonlinear PT prediction for these velocity statistics, together with real-space power spectrum for dark matter from simulations, improves the accuracy for both dark matter and halos. We also present the same analysis in configuration space, computing the redshift-space pairwise mean infall velocities and velocity correlation function and compare to nonlinear PT.

We examine the signature of dynamic (redshift-space) distortions and geometric distortions (including the Alcock-Paczynski effect) in the context of the galaxy power spectrum measured in upcoming galaxy redshift surveys. Information comes from both the baryon acoustic oscillation (BAO) feature and the broadband power spectrum shape. Accurate modeling is required to extract this information without introducing systematic biases in the result. We consider an analytic model for the power spectrum of dark matter halos in redshift space, based on the distribution function expansion, and compare with halo clustering measured in N-body simulations. We forecast that the distribution function model is sufficiently accurate to allow the inclusion of broadband information on scales down to k~0.2 h/Mpc, with somewhat better accuracy for higher bias halos. Compared with a BAO-only analysis with reconstruction, including broadband shape information can improve unbiased constraints on distance measures H(z) and D_A(z) by ~30% and 20%, respectively, for a galaxy sample similar to the DESI luminous red galaxies. The gains in precision are larger in the absence of BAO reconstruction. Furthermore, including broadband shape information allows the measurement of structure growth, through redshift-space distortions. For the same galaxy sample, the distribution function model is able to constrain f*sigma_8 to ~2%, when simultaneously fitting for H(z) and D_A(z). We discuss techniques to optimize the analysis of the power spectrum, including removing modes near the line-of-sight that are particularly challenging to model, and whether these approaches can improve parameter constraints. We find that such techniques are unlikely to significantly improve constraints on geometry, although they may allow higher precision measurements of redshift-space distortions.

We study the effect of the supersonic relative velocity between dark matter and baryons on large-scale galaxy clustering and derive the constraint on the relative velocity bias parameter from the Baryonic Oscillation Spectroscopic Survey (BOSS) power spectrum measurements. Recent work has shown that the relative velocity effect may have a dramatic impact on the star formation at high redshifts, if first stars are formed in minihalos around z~20, or if the effect propagates through secondary effects to stars formed at later redshifts. The relative velocity effect has particularly strong signatures in the large scale clustering of these sources, including the BAO position. Assuming that a small fraction of stars in low-redshift massive galaxies retain the memory of the primordial relative velocity effect, galaxy clustering measurements can be used to constrain the signatures of the first stars. Luminous red galaxies contain some of the oldest stars in the Universe and are ideally suited to search for this effect. Using the BOSS power spectrum measurements from the Sloan Data Release 9, in combination with Planck, we derive the upper limit on the fraction of the stars sensitive to relative velocity effect f_star<3.3% at the 95% confidence level in the CMASS galaxy sample. If additional galaxy sample not sensitive to the effect is available in a given survey, a joint multi-tracer analysis can be applied to construct a sample-variance cancelling combination, providing a model-independent way to verify the presence of the relative velocity effect in the galaxy power spectrum on large scales. Such a multi-tracer analysis in future galaxy surveys can greatly improve the current constraint, achieving a 0.1% level in f_star.

Numerical simulations show that redshift space distortions (RSD) introduce strong scale dependence in the power spectra of halos, with ten percent deviations relative to linear theory predictions even on relatively large scales (k<0.1h/Mpc) and even in the absence of satellites (which induce Fingers-of-God, FoG, effects). If unmodeled these effects prevent one from extracting cosmological information from RSD surveys. In this paper we use perturbation theory (PT) and halo biasing model and apply it to the distribution function approach to RSD, in which RSD is decomposed into several correlators of density weighted velocity moments. We model each of these correlators using PT and compare the results to simulations over a wide range of halo masses and redshifts. We find that with an introduction of a physically motivated halo biasing, and using dark matter power spectra from simulations, we can reproduce the simulation results at a percent level on scales up to k~0.15h/Mpc at z=0, without the need to have free FoG parameters in the model.

The clustering of galaxies in ongoing and upcoming galaxy surveys contains a wealth of cosmological information, but extracting this information is a non-trivial task since galaxies and their host haloes are stochastic tracers of the matter density field. This stochasticity is usually modeled as Poisson shot noise, which is constant as a function of wavenumber with amplitude given by 1/n, where n is the number density of galaxies. Here we use dark matter haloes in N-body simulations to show evidence for deviations from this simple behaviour and develop models that explain the behaviour of the large scale stochasticity. First, haloes are extended, non-overlapping objects, i.e., their correlation function needs to go to -1 on small scales. This leads to a negative correction to the stochasticity relative to the Poisson value at low wavenumber k, decreasing to zero for wavenumbers large compared to the inverse exclusion scale. Second, haloes show a non-linear enhancement of clustering outside the exclusion scale, leading to a positive stochasticity correction. Both of these effects go to zero for high-k, making the stochasticity scale dependent even for k<0.1 h/Mpc. We show that the corrections in the low-k regime are the same in Eulerian and Lagrangian space, but that the transition scale is pushed to smaller scales for haloes observed at present time, relative to the initial conditions. These corrections vary with halo mass and redshift. We also discuss simple applications of these effects to the galaxy samples with non-vanishing satellite fraction, where the stochasticity can again deviate strongly from the fiducial Poisson expectation. Overall these effects affect the clustering of galaxies at a level of a few percent even on very large scales and need to be modelled properly if we want to extract high precision cosmological information from the upcoming galaxy surveys.

We use the Baryon Oscillation Spectroscopic Survey (BOSS) Data Release 9 (DR9) to detect and measure the position of the Baryonic Acoustic Oscillation (BAO) feature in the three-dimensional correlation function in the Lyman-alpha forest flux fluctuations at a redshift z=2.4. The feature is clearly detected at significance between 3 and 5 sigma (depending on the broadband model and method of error covariance matrix estimation) and is consistent with predictions of the standard LCDM model. We assess the biases in our method, stability of the error covariance matrix and possible systematic effects. We fit the resulting correlation function with several models that decouple the broadband and acoustic scale information. For an isotropic dilation factor, we measure 100x(alpha_iso-1) = -1.6 ^{+2.0+4.3+7.4}_{-2.0-4.1-6.8} (stat.) +/- 1.0 (syst.) (multiple statistical errors denote 1,2 and 3 sigma confidence limits) with respect to the acoustic scale in the fiducial cosmological model (flat LCDM with Omega_m=0.27, h=0.7). When fitting separately for the radial and transversal dilation factors we find marginalised constraints 100x(alpha_par-1) = -1.3 ^{+3.5+7.6 +12.3}_{-3.3-6.7-10.2} (stat.) +/- 2.0 (syst.) and 100x(alpha_perp-1) = -2.2 ^{+7.4+17}_{-7.1-15} +/- 3.0 (syst.). The dilation factor measurements are significantly correlated with cross-correlation coefficient of ~ -0.55. Errors become significantly non-Gaussian for deviations over 3 standard deviations from best fit value. Because of the data cuts and analysis method, these measurements give tighter constraints than a previous BAO analysis of the BOSS DR9 Lyman-alpha forest sample, providing an important consistency test of the standard cosmological model in a new redshift regime.

Recent studies have shown that the cross-correlation coefficient between galaxies and dark matter is very close to unity on scales outside a few virial radii of galaxy halos, independent of the details of how galaxies populate dark matter halos. This finding makes it possible to determine the dark matter clustering from measurements of galaxy-galaxy weak lensing and galaxy clustering. We present new cosmological parameter constraints based on large-scale measurements of spectroscopic galaxy samples from the Sloan Digital Sky Survey (SDSS) Data Release 7 (DR7). We generalise the approach of Baldauf et al. (2010) to remove small scale information (below 2 and 4 Mpc/h for lensing and clustering measurements, respectively), where the cross-correlation coefficient differs from unity. We derive constraints for three galaxy samples covering 7131 sq. deg., containing 69150, 62150, and 35088 galaxies with mean redshifts of 0.11, 0.28, and 0.40. We clearly detect scale-dependent galaxy bias for the more luminous galaxy samples, at a level consistent with theoretical expectations. When we vary both \sigma_8 and \Omega_m (and marginalise over non-linear galaxy bias) in a flat LCDM model, the best-constrained quantity is \sigma_8 (\Omega_m/0.25)^{0.57}=0.80 +/- 0.05 (1-sigma, stat. + sys.), where statistical and systematic errors have comparable contributions, and we fixed n_s=0.96 and h=0.7. These strong constraints on the matter clustering suggest that this method is competitive with cosmic shear in current data, while having very complementary and in some ways less serious systematics. We therefore expect that this method will play a prominent role in future weak lensing surveys. When we combine these data with WMAP7 CMB data, constraints on \sigma_8, \Omega_m, H_0, w_{de} and \sum m_{\nu} become 30--80 per cent tighter than with CMB data alone, since our data break several parameter degeneracies.

We develop a perturbative approach to redshift space distortions (RSD) using the phase space distribution function approach and apply it to the dark matter redshift space power spectrum and its moments. RSD can be written as a sum over density weighted velocity moments correlators, with the lowest order being density, momentum density and stress energy density. We use standard and extended perturbation theory (PT) to determine their auto and cross correlators, comparing them to N-body simulations. We show which of the terms can be modeled well with the standard PT and which need additional terms that include higher order corrections which cannot be modeled in PT. Most of these additional terms are related to the small scale velocity dispersion effects, the so called finger of god (FoG) effects, which affect some, but not all, of the terms in this expansion, and which can be approximately modeled using a simple physically motivated ansatz such as the halo model. We point out that there are several velocity dispersions that enter into the detailed RSD analysis with very different amplitudes, which can be approximately predicted by the halo model. In contrast to previous models our approach systematically includes all of the terms at a given order in PT and provides a physical interpretation for the small scale dispersion values. We investigate RSD power spectrum as a function of \mu, the cosine of the angle between the Fourier mode and line of sight, focusing on the lowest order powers of \mu and multipole moments which dominate the observable RSD power spectrum. Overall we find considerable success in modeling many, but not all, of the terms in this expansion.

Using multiple tracers of large-scale structure allows to evade the limitations imposed by sampling variance for some parameters of interest in cosmology. We demonstrate the optimal way of carrying out a multitracer analysis in a galaxy redshift survey by considering the principal components of the shot noise matrix from two-point clustering statistics. We show how to construct two tracers that maximize the benefits of sampling variance and shot noise cancellation using optimal weights. On the basis of high-resolution N-body simulations of dark matter halos we apply this technique to the analysis of redshift-space distortions and demonstrate how constraints on the growth rate of structure formation can be substantially improved. The primary limitation are nonlinear effects, which cause significant biases in the method already at scales of k<0.1h/Mpc, suggesting the need to develop nonlinear models of redshift-space distortions in order to extract the maximum information from future redshift surveys. Nonetheless we find gains of a factor of a few in constraints on the growth rate achievable when merely the linear regime of a galaxy survey like EUCLID is considered.

The proper general relativistic description of the observed galaxy power spectrum is substantially different from the standard Newtonian description on large scales, providing a unique opportunity to test general relativity on horizon scales. Using the Einstein equations, the general relativistic effects can be classified as two new terms that represent the velocity and the gravitational potential, coupling to the time evolution of galaxy number density and Hubble parameter. Compared to the dominant density and velocity redshift-space distortion terms, the former scales as H/k and correlates the real and imaginary parts of the Fourier modes, while the latter scales as (H/k)^2, where k is the comoving wave number and H is the conformal Hubble parameter. We use the recently developed methods to reduce the sampling variance and shot noise to show that in an all sky galaxy redshift survey at low redshift the velocity term can be measured at 10-sigma confidence level, if one can utilize halos of mass M>10^{10} Msun, while the gravitational potential term itself can only be marginally detected. We also demonstrate that the general relativistic effect is not degenerate with the primordial non-Gaussian signature in galaxy bias, and the ability to detect the primordial non-Gaussianity is little compromised.

We explore three different methods based on weak lensing to extract cosmological constraints from the large-scale structure. In the first approach (method I), small-scale galaxy lensing measurements of their halo mass provide a constraint on the halo bias, which can be combined with the large-scale galaxy clustering to measure the dark matter clustering. In the second approach (method II), large-scale galaxy clustering and large-scale galaxy-galaxy lensing can be combined into a direct measurement of the dark matter clustering. These two methods can be combined into one method I+II to make use of lensing measurements on all scales. In the third approach (method III), we add abundance information to the method I. We explore the statistical power of these three approaches as a function of galaxy luminosity to investigate the optimal mass range for each method and their cosmological constraining power. In the case of the SDSS, we find that the three methods give comparable constraints, but not in the same mass range: the method II works best for halos of M~10^13 Msun, and the methods I and III work best for halos of M~10^14 Msun. We discuss the robustness of each method against various systematics. Furthermore, we extend the analysis to the future large-scale galaxy surveys and find that the cluster abundance method is not superior to the combined method I+II, both in terms of statistical power and robustness against systematic errors. The cosmic shear-shear correlation analysis in the future surveys yields constraints as strong as the combined method, but suffer from additional systematic effects. We thus advocate the combined analysis of clustering and lensing (method I+II) as a powerful alternative to other large-scale probes. Our analysis provides a guidance to observers planning large-scale galaxy surveys such as the DES, Euclid, and the LSST.

Kaiser redshift-space distortion formula describes well the clustering of galaxies in redshift surveys on small scales, but there are numerous additional terms that arise on large scales. Some of these terms can be described using Newtonian dynamics and have been discussed in the literature, while the others require proper general relativistic description that was only recently developed. Accounting for these terms in galaxy clustering is the first step toward tests of general relativity on horizon scales. The effects can be classified as two terms that represent the velocity and the gravitational potential contributions. Their amplitude is determined by effects such as the volume and luminosity distance fluctuation effects and the time evolution of galaxy number density and Hubble parameter. We compare the Newtonian approximation often used in the redshift-space distortion literature to the fully general relativistic equation, and show that Newtonian approximation accounts for most of the terms contributing to velocity effect. We perform a Fisher matrix analysis of detectability of these terms and show that in a single tracer survey they are completely undetectable. To detect these terms one must resort to the recently developed methods to reduce sampling variance and shot noise. We show that in an all-sky galaxy redshift survey at low redshift the velocity term can be measured at a few sigma if one can utilize halos of mass M>10^12 Msun (this can increase to 10-sigma or more in some more optimistic scenarios), while the gravitational potential term itself can only be marginally detected. We also demonstrate that the general relativistic effect is not degenerate with the primordial non-Gaussian signature in galaxy bias, and the ability to detect primordial non-Gaussianity is little compromised.

The Sloan Digital Sky Survey III (SDSS-III) presents the first spectroscopic data from the Baryon Oscillation Spectroscopic Survey (BOSS). This ninth data release (DR9) of the SDSS project includes 535,995 new galaxy spectra (median z=0.52), 102,100 new quasar spectra (median z=2.32), and 90,897 new stellar spectra, along with the data presented in previous data releases. These spectra were obtained with the new BOSS spectrograph and were taken between 2009 December and 2011 July. In addition, the stellar parameters pipeline, which determines radial velocities, surface temperatures, surface gravities, and metallicities of stars, has been updated and refined with improvements in temperature estimates for stars with T_eff<5000 K and in metallicity estimates for stars with [Fe/H]>-0.5. DR9 includes new stellar parameters for all stars presented in DR8, including stars from SDSS-I and II, as well as those observed as part of the SDSS-III Sloan Extension for Galactic Understanding and Exploration-2 (SEGUE-2). The astrometry error introduced in the DR8 imaging catalogs has been corrected in the DR9 data products. The next data release for SDSS-III will be in Summer 2013, which will present the first data from the Apache Point Observatory Galactic Evolution Experiment (APOGEE) along with another year of data from BOSS, followed by the final SDSS-III data release in December 2014.

In this paper, we measure the optical-to-virial velocity ratios Vopt/V200c of disk galaxies in the Sloan Digital Sky Survey (SDSS) at a mean redshift of <z> = 0.07 and with stellar masses 10^9 M_sun < M_* < 10^11 M_sun. Vopt/V200c, the ratio of the circular velocity measured at the virial radius of the dark matter halo (\sim150 kpc) to that at the optical radius of the disk (\sim10 kpc), is a powerful observational constraint on disk galaxy formation. It links galaxies to their dark matter haloes dynamically and constrains the total mass profile of disk galaxies over an order of magnitude in length scale. For this measurement, we combine Vopt derived from the Tully-Fisher relation (TFR) from Reyes et al. with V200c derived from halo masses measured with galaxy-galaxy lensing. In anticipation of this combination, we use similarly-selected galaxy samples for both the lensing and TFR analysis. For three M_* bins with lensing-weighted mean stellar masses of 0.6, 2.7, and 6.5 x 10^10 M_sun, we find halo-to-stellar mass ratios M_vir/M_* = 41, 23, and 26, with 1-sigma statistical uncertainties of around 0.1 dex, and Vopt/V200c = 1.27\pm0.08, 1.39\pm0.06, 1.27\pm0.08 (1{\sigma}). Our results suggest that the dark matter and baryonic contributions to the mass within the optical radius are comparable, if the dark matter halo profile has not been significantly modified by baryons. The results obtained in this work will serve as inputs to and constraints on disk galaxy formation models, which will be explored in future work. Finally, we note that this paper presents a new and improved galaxy shape catalogue for weak lensing that covers the full SDSS DR7 footprint.

It was recently shown that the power spectrum in redshift space can be written as a sum of cross-power spectra between number weighted velocity moments. We investigate the properties of these power spectra for simulated galaxies and dark matter halos and compare them to the dark matter power spectra, generalizing the concept of the bias. Because all of the quantities are number weighted this approach is well defined even for sparse systems such as massive halos, in contrasts to the previous approaches to RSD where velocity correlations have been explored. We find that the number density weighting leads to a strong scale dependence of the bias terms for momentum density auto-correlation and cross-correlation with density. This trend becomes more significant for the more biased halos and leads to an enhancement of RSD power relative to the linear theory. Fingers-of-god effects, which in this formalism come from the correlations of the higher order moments beyond the momentum density, lead to smoothing of the power spectrum and can reduce this enhancement of power, but are relatively small for halos with no small-scale velocity dispersion. In comparison, for a more realistic galaxy sample with satellites the velocity dispersion generated by satellite motions inside the halos leads to a larger power suppression on small scales, but this depends on the satellite fraction. We investigate several statistics such as the two-dimensional power spectrum, its multipole moments, its powers of mu^2, and configuration space statistics. Overall we find that the nonlinear effects in realistic galaxy samples such as luminous red galaxies affect the redshift space clustering on very large scales: for example, the quadrupole moment is affected by 10% for k<0.1h/mpc, which means that these effects need to be understood if we want to extract cosmological information from the redshift space distortions.

The coherent physical alignment of galaxies is an important systematic for gravitational lensing studies as well as a probe of the physical mechanisms involved in galaxy formation and evolution. We develop a formalism for treating this intrinsic alignment (IA) in the context of galaxy-galaxy lensing and present an improved method for measuring IA contamination, which can arise when sources physically associated with the lens are placed behind the lens due to photometric redshift scatter. We apply the technique to recent Sloan Digital Sky Survey (SDSS) measurements of Luminous Red Galaxy lenses and typical (L*) source galaxies with photometric redshifts selected from the SDSS imaging data. Compared to previous measurements, this method has the advantage of being fully self-consistent in its treatment of the IA and lensing signals, solving for the two simultaneously. We find an IA signal consistent with zero, placing tight constraints on both the magnitude of the IA effect and its potential contamination to the lensing signal. While these constraints depend on source selection and redshift quality, the method can be applied to any measurement that uses photometric redshifts. We obtain a model-independent upper-limit of roughly 10% IA contamination for projected separations of approximately 0.1-100 Mpc/h. With more stringent photo-z cuts and reasonable assumptions about the physics of intrinsic alignments, this upper limit is reduced to 1-2%. These limits are well below the statistical error of the current lensing measurements. Our results suggest that IA will not present intractable challenges to the next generation of galaxy-galaxy lensing experiments, and the methods presented here should continue to aid in our understanding of alignment processes and in the removal of IA from the lensing signal.

We present a new test of gravitational interactions at the r\sim(0.2-20)Mpc scale, around the virial radius of dark matter halos measured through cluster-galaxy lensing of maxBCG clusters from the Sloan Digital Sky Survey (SDSS). We employ predictions from self-consistent simulations of f(R) gravity to find an upper bound on the background field amplitude of f_R0<3.5x10^-3 at the 1D-marginalized 95% confidence level. As a model-independent assessment of the constraining power of cluster profiles measured through weak gravitational lensing, we also constrain the amplitude F_0 of a phenomenological modification based on the profile enhancement induced by f(R) gravity when not including effects from the increased cluster abundance in f(R). In both scenarios, dark-matter-only simulations of the concordance model corresponding to f_R0=0 and F_0=0 are consistent with the lensing measurements, i.e., at the 68% and 95% confidence level, respectively.

Measurement of redshift-space distortions (RSD) offers an attractive method to directly probe the cosmic growth history of density perturbations. A distribution function approach where RSD can be written as a sum over density weighted velocity moment correlators has recently been developed. We use Nbody simulations to investigate the individual contributions and convergence of this expansion for dark matter. If the series is expanded as a function of powers of mu, cosine of the angle between the Fourier mode and line of sight, there are a finite number of terms contributing at each order. We present these terms and investigate their contribution to the total as a function of wavevector k. For mu^2 the correlation between density and momentum dominates on large scales. Higher order corrections, which act as a Finger-of-God (FoG) term, contribute 1% at k~0.015h/Mpc, 10% at k~0.05h/Mpc at z=0, while for k>0.15h/Mpc they dominate and make the total negative. These higher order terms are dominated by density-energy density correlations which contribute negatively to the power, while the contribution from vorticity part of momentum density auto-correlation is an order of magnitude lower. For mu^4 term the dominant term on large scales is the scalar part of momentum density auto-correlation, while higher order terms dominate for k>0.15h/Mpc. For mu^6 and mu^8 we find it has very little power for k<0.15h/Mpc. We also compare the expansion to the full 2D P^ss(k,mu) as well as to their multipoles. For these statistics an infinite number of terms contribute and we find that the expansion achieves percent level accuracy for kmu<0.15h/Mpc at 6th order, but breaks down on smaller scales because the series is no longer perturbative. We explore resummation of the terms into FoG kernels, which extend the convergence up to a factor of 2 in scale. We find that the FoG kernels are approximately Lorentzian.

The relation between the clustering properties of luminous matter in the form of galaxies and the underlying dark matter distribution is of fundamental importance for the interpretation of ongoing and upcoming galaxy surveys. The so called local bias model, where galaxy density is a function of local matter density, is frequently discussed as a means to infer the matter power spectrum or correlation function from the measured galaxy correlation. However, gravitational evolution generates a term quadratic in the tidal tensor and thus non-local in the density field, even if this term is absent in the initial conditions (Lagrangian space). Because the term is quadratic, it contributes as a loop correction to the power spectrum, so the standard linear bias picture still applies on large scales, however, it contributes at leading order to the bispectrum for which it is significant on all scales. Such a term could also be present in Lagrangian space if halo formation were influenced by the tidal field. We measure the corresponding coupling strengths from the matter-matter-halo bispectrum in numerical simulations and find a non-vanishing coefficient for the tidal tensor term. We find no scale dependence of the bias parameters up to k=0.1 h/Mpc and that the tidal effect is increasing with halo mass. While the Lagrangian bias picture is a better description of our results than the Eulerian bias picture, our results suggest that there might be a tidal tensor bias already in the initial conditions. We also find that the coefficients of the quadratic density term deviate quite strongly from the theoretical predictions based on the spherical collapse model and a universal mass function. Both quadratic density and tidal tensor bias terms must be included in the modeling of galaxy clustering of current and future surveys if one wants to achieve the high precision cosmology promise of these datasets.

The Sloan Digital Sky Survey (SDSS) surveyed 14,555 square degrees, and delivered over a trillion pixels of imaging data. We present a study of galaxy clustering using 900,000 luminous galaxies with photometric redshifts, spanning between $z=0.45$ and $z=0.65$, constructed from the SDSS using methods described in Ross et al. (2011). This data-set spans 11,000 square degrees and probes a volume of $3h^{-3} \rm{Gpc}^3$, making it the largest volume ever used for galaxy clustering measurements. We present a novel treatment of the observational systematics and its applications to the clustering signals from the data set. In this paper, we measure the angular clustering using an optimal quadratic estimator at 4 redshift slices with an accuracy of ~15% with bin size of delta_l = 10 on scales of the Baryon Acoustic Oscillations (BAO) (at l~40-400). We derive cosmological constraints using the full-shape of the power-spectra. For a flat Lambda CDM model, when combined with Cosmic Microwave Background Wilkinson Microwave Anisotropy Probe 7 (WMAP7) and H_0 constraints from 600 Cepheids observed by HST, we find \Omega_\Lambda = 0.73 +/- 0.019 and H_0 to be 70.5 +/- 1.6 km/s/Mpc. For an open Lambda CDM model, when combined with WMAP7 + HST, we find $\Omega_K = 0.0035 +/- 0.0054, improved over WMAP7+HST alone by 40%. For a wCDM model, when combined with WMAP7+HST+SN, we find w = -1.071 +/- 0.078, and H_0 to be 71.3 +/- 1.7 km/s/Mpc, which is competitive with the latest large scale structure constraints from large spectroscopic surveys such as SDSS Data Release 7 (DR7) (Reid et al. 2010, Percival et al. 2010, Montesano et al. 2011) and WiggleZ (Blake et al. 2011). The SDSS-III Data Release 8 (SDSS-III DR8) Angular Clustering Data allows a wide range of investigations into the cosmological model, cosmic expansion (via BAO), Gaussianity of initial conditions and neutrino masses. (abridged)

One of the main signatures of primordial non-Gaussianity of the local type is a scale-dependent correction to the bias of large-scale structure tracers such as galaxies or clusters, whose amplitude depends on the bias of the tracers itself. The dominant source of noise in the power spectrum of the tracers is caused by sampling variance on large scales (where the non-Gaussian signal is strongest) and shot noise arising from their discrete nature. Recent work has argued that one can avoid sampling variance by comparing multiple tracers of different bias, and suppress shot noise by optimally weighting halos of different mass. Here we combine these ideas and investigate how well the signatures of non-Gaussian fluctuations in the primordial potential can be extracted from the two-point correlations of halos and dark matter. On the basis of large $N$-body simulations with local non-Gaussian initial conditions and their halo catalogs we perform a Fisher matrix analysis of the two-point statistics. Compared to the standard analysis, optimal weighting- and multiple-tracer techniques applied to halos can yield up to one order of magnitude improvements in $\fnl$-constraints, even if the underlying dark matter density field is not known. We compare our numerical results to the halo model and find satisfactory agreement. Forecasting the optimal $\fnl$-constraints that can be achieved with our methods when applied to existing and future survey data, we find that a survey of $50h^{-1}\mathrm{Gpc}^3$ volume resolving all halos down to $10^{11}\hMsun$ at $z=1$ will be able to obtain $\sigma_{\fnl}\sim1$ (68% cl), a factor of $\sim20$ improvement over the current limits. Decreasing the minimum mass of resolved halos, increasing the survey volume or obtaining the dark matter maps can further improve these limits, potentially reaching the level of $\sigma_{\fnl}\sim0.1$. (abridged)

On large scales a nonlinear transformation of matter density field can be viewed as a biased tracer of the density field itself. A nonlinear transformation also modifies the redshift space distortions in the same limit, giving rise to a velocity bias. In models with primordial nongaussianity a nonlinear transformation generates a scale dependent bias on large scales. We derive analytic expressions for these for a general nonlinear transformation. These biases can be expressed entirely in terms of the one point distribution function (PDF) of the final field and the parameters of the transformation. Our analysis allows one to devise nonlinear transformations with nearly arbitrary bias properties, which can be used to increase the signal in the large scale clustering limit. We apply the results to the ionizing equilibrium model of Lyman-alpha forest, in which Lyman-alpha flux F is related to the density perturbation delta via a nonlinear transformation. Velocity bias can be expressed as an average over the Lyman-alpha flux PDF. At z=2.4 we predict the velocity bias of -0.1, compared to the observed value of -0.13 +/- 0.03. Bias and primordial nongaussianity bias depend on the parameters of the transformation. Measurements of bias can thus be used to constrain these parameters, and for reasonable values of the ionizing background intensity we can match the predictions to observations. Matching to the observed values we predict the ratio of primordial nongaussianity bias to bias to have the opposite sign and lower magnitude than the corresponding values for the highly biased galaxies, but this depends on the model parameters and can also vanish or change the sign.

Statistical weak lensing by large-scale structure -- cosmic shear -- is a promising cosmological tool, which has motivated the design of several large upcoming surveys. Here, we present a measurement of cosmic shear using coadded Sloan Digital Sky Survey (SDSS) imaging in 168 square degrees of the equatorial region, with r<23.5 and i<22.5, a source number density of 2.2 galaxies per square arcminute and median redshift of 0.52. These coadds were generated using a new method described in the companion Paper I that was intended to minimise systematic errors in the lensing measurement due to coherent PSF anisotropies that are otherwise prevalent in the SDSS imaging data. We present measurements of cosmic shear out to angular separations of 2 degrees, along with systematics tests that (combined with those from Paper I on the catalogue generation) demonstrate that our results are dominated by statistical rather than systematic errors. Assuming a cosmological model corresponding to WMAP7 and allowing only the amplitude of matter fluctuations to vary, we find a best-fit value of sigma_8=0.636 +0.109 -0.154 (1-sigma); without systematic errors this would be sigma_8=0.636 +0.099 -0.137 (1-sigma). Assuming a flat LCDM model, the combined constraints with WMAP7 are sigma_8=0.784 +0.028 -0.026 (1-sigma), +0.055 -0.054 (2-sigma) and Omega_m h^2=0.1303 +0.0047 -0.0048 (1-sigma)+0.009 -0.009 (2-sigma); the 2-sigma error ranges are respectively 14 and 17 per cent smaller than WMAP7 alone. Aside from the intrinsic value of such cosmological constraints from the growth of structure, we identify some important lessons for upcoming surveys that may face similar issues when combining multi-epoch data to measure cosmic shear.

Weak lensing by large-scale structure is an invaluable cosmological tool given that most of the energy density of the concordance cosmology is invisible. Several large ground-based imaging surveys will attempt to measure this effect over the coming decade, but reliable control of the spurious lensing signal introduced by atmospheric turbulence and telescope optics remains a challenging problem. We address this challenge with a demonstration that point-spread function (PSF) effects on measured galaxy shapes in current ground-based surveys can be corrected with existing analysis techniques. In this work, we co-add existing Sloan Digital Sky Survey imaging on the equatorial stripe in order to build a data set with the statistical power to measure cosmic shear, while using a rounding kernel method to null out the effects of the anisotropic PSF. We build a galaxy catalogue from the combined imaging, characterise its photometric properties, and show that the spurious shear remaining in this catalogue after the PSF correction is negligible compared to the expected cosmic shear signal. We identify a new source of systematic error in the shear-shear auto-correlations arising from selection biases related to masking. Finally, we discuss the circumstances in which this method is expected to be useful for upcoming ground-based surveys that have lensing as one of the science goals, and identify the systematic errors that can reduce its efficacy.

Weak gravitational lensing is a valuable probe of galaxy formation and cosmology. Here we quantify the effects of using photometric redshifts (photo-z) in galaxy-galaxy lensing, for both sources and lenses, both for the immediate goal of using galaxies with photo-z as lenses in the Sloan Digital Sky Survey (SDSS) and as a demonstration of methodology for large, upcoming weak lensing surveys that will by necessity be dominated by lens samples with photo-z. We calculate the bias in the lensing mass calibration as well as consequences for absolute magnitude (i.e., k-corrections) and stellar mass estimates, for a large sample of SDSS Data Release 8 (DR8) galaxies. The redshifts are obtained with the template based photo-z code ZEBRA on the SDSS DR8 ugriz photometry. We assemble and characterise the calibration samples (~9k spectroscopic redshifts from four surveys) to obtain photometric redshift errors and lensing biases corresponding to our full SDSS DR8 lens and source catalogues. Our tests of the calibration sample also highlight the impact of observing conditions in the imaging survey when the spectroscopic calibration covers a small fraction of its footprint; atypical imaging conditions in calibration fields can lead to incorrect conclusions regarding the photo-z of the full survey. For the SDSS DR8 catalogue, we find sigma_z/(1+z)=0.096 and 0.113 for the lens and source catalogues, with flux limits of r=21 and r=21.8, respectively. We also explore the systematic uncertainty in the lensing signal calibration when using source photo-z, and both lens and source photo-z; given the size of existing training samples, we can constrain the lensing signal calibration (and therefore the normalization of the surface mass density) to within 2 and 4 per cent, respectively. [ABRIDGED]

Length scales probed by large scale structure surveys are becoming closer to the horizon scale. Further, it has been recently understood that non-Gaussianity in the initial conditions could show up in a scale dependence of the bias of galaxies at the largest distances. It is therefore important to include General Relativistic effects. Here we provide a General Relativistic generalization of the bias, valid both for Gaussian and non-Gaussian initial conditions. The collapse of objects happens on very small scales, while long-wavelength modes are always in the quasi linear regime. Around every collapsing region, it is therefore possible to find a reference frame that is valid for all times and where the space time is almost flat: the Fermi frame. Here the Newtonian approximation is applicable and the equations of motion are the ones of the N-body codes. The effects of long-wavelength modes are encoded in the mapping from the cosmological frame to the local frame. For the linear bias, the effect of the long-wavelength modes on the dynamics is encoded in the local curvature of the Universe, which allows us to define a General Relativistic generalization of the bias in the standard Newtonian setting. We show that the bias due to this effect goes to zero as the squared ratio of the physical wavenumber with the Hubble scale for modes longer than the horizon, as modes longer than the horizon have no dynamical effects. However, the bias due to non-Gaussianities does not need to vanish for modes longer than the Hubble scale, and for non-Gaussianities of the local kind it goes to a constant. As a further application, we show that it is not necessary to perform large N-body simulations to extract information on long-wavelength modes: N-body simulations can be done on small scales and long-wavelength modes are encoded simply by adding curvature to the simulation and rescaling the coordinates.

We develop a phase space distribution function approach to redshift space distortions (RSD), in which the redshift space density can be written as a sum over velocity moments of the distribution function. These moments are density weighted and their lowest orders are density, momentum density, and stress energy density. The series expansion is convergent on large scales. We perform an expansion of these velocity moments into helicity modes, which are eigenmodes under rotation around the axis of Fourier mode direction, generalizing the scalar, vector, tensor decomposition of perturbations to an arbitrary order. We show that only equal helicity moments correlate and derive the angular dependence of the individual contributions to the redshift space power spectrum in terms of angle mu between wave vector and line of sight. We show that the dominant term of mu^2 dependence on large scales is the cross-correlation between the density and scalar part of momentum density, which can be related to the time derivative of the matter power spectrum. Additional terms contributing and dominating on small scales are the vector part of momentum density-momentum density correlations, the energy density-density correlations, and the scalar part of anisotropic stress density-density correlations. Similarly, we identify 7 terms contributing to mu^4 dependence. Some of the advantages of the distribution function approach are that the series expansion converges on large scales and remains valid in multi-stream situations. We finish with a brief discussion of implications for RSD in galaxies relative to dark matter, highlighting the issue of scale dependent bias of velocity moments correlators.

The bispectrum vanishes for linear Gaussian fields and is thus a sensitive probe of non-linearities and non-Gaussianities in the cosmic density field. Hence, a detection of the bispectrum in the halo density field would enable tight constraints on non-Gaussian processes in the early Universe and allow inference of the dynamics driving inflation. We present a tree level derivation of the halo bispectrum arising from non-linear clustering, non-linear biasing and primordial non-Gaussianity. A diagrammatic description is developed to provide an intuitive understanding of the contributing terms and their dependence on scale, shape and the non-Gaussianity parameter fNL. We compute the terms based on a multivariate bias expansion and the peak-background split method and show that non-Gaussian modifications to the bias parameters lead to amplifications of the tree level bispectrum that were ignored in previous studies. Our results are in a good agreement with published simulation measurements of the halo bispectrum. Finally, we estimate the expected signal to noise on fNL and show that the constraint obtainable from the bispectrum analysis significantly exceeds the one obtainable from the power spectrum analysis.

BigBOSS is a Stage IV ground-based dark energy experiment to study baryon acoustic oscillations (BAO) and the growth of structure with a wide-area galaxy and quasar redshift survey over 14,000 square degrees. It has been conditionally accepted by NOAO in response to a call for major new instrumentation and a high-impact science program for the 4-m Mayall telescope at Kitt Peak. The BigBOSS instrument is a robotically-actuated, fiber-fed spectrograph capable of taking 5000 simultaneous spectra over a wavelength range from 340 nm to 1060 nm, with a resolution R = 3000-4800. Using data from imaging surveys that are already underway, spectroscopic targets are selected that trace the underlying dark matter distribution. In particular, targets include luminous red galaxies (LRGs) up to z = 1.0, extending the BOSS LRG survey in both redshift and survey area. To probe the universe out to even higher redshift, BigBOSS will target bright [OII] emission line galaxies (ELGs) up to z = 1.7. In total, 20 million galaxy redshifts are obtained to measure the BAO feature, trace the matter power spectrum at smaller scales, and detect redshift space distortions. BigBOSS will provide additional constraints on early dark energy and on the curvature of the universe by measuring the Ly-alpha forest in the spectra of over 600,000 2.2 < z < 3.5 quasars. BigBOSS galaxy BAO measurements combined with an analysis of the broadband power, including the Ly-alpha forest in BigBOSS quasar spectra, achieves a FOM of 395 with Planck plus Stage III priors. This FOM is based on conservative assumptions for the analysis of broad band power (kmax = 0.15), and could grow to over 600 if current work allows us to push the analysis to higher wave numbers (kmax = 0.3). BigBOSS will also place constraints on theories of modified gravity and inflation, and will measure the sum of neutrino masses to 0.024 eV accuracy.

We investigate the effect of supersonic relative velocities between baryons and dark matter, recently shown to arise generically at high redshift, on baryonic acoustic oscillation (BAO) measurements at low redshift. The amplitude of the relative velocity effect at low redshift is model-dependent, but can be parameterized by using an unknown bias. We find that if unaccounted, the relative velocity effect can shift the BAO peak position and bias estimates of the dark energy equation-of-state due to its non-smooth, out-of-phase oscillation structure around the BAO scale. Fortunately, the relative velocity effect can be easily modeled in constraining cosmological parameters without substantially inflating the error budget. We also demonstrate that the presence of the relative velocity effect gives rise to a unique signature in the galaxy bispectrum, which can be utilized to isolate this effect. Future dark energy surveys can accurately measure the relative velocity effect and subtract it from the power spectrum analysis to constrain dark energy models with high precision.

Weak gravitational lensing has become a powerful probe of large-scale structure and cosmological parameters. Precision weak lensing measurements require an understanding of the intrinsic alignment of galaxy ellipticities, which can in turn inform models of galaxy formation. It is hypothesized that elliptical galaxies align with the background tidal field and that this alignment mechanism dominates the correlation between ellipticities on cosmological scales (in the absence of lensing). We use recent large-scale structure measurements from the Sloan Digital Sky Survey to test this picture with several statistics: (1) the correlation between ellipticity and galaxy overdensity, w_{g+}; (2) the intrinsic alignment auto-correlation functions; (3) the correlation functions of curl-free, E, and divergence-free, B, modes (the latter of which is zero in the linear tidal alignment theory); (4) the alignment correlation function, w_g(r_p,theta), a recently developed statistic that generalizes the galaxy correlation function to account for the angle between the galaxy separation vector and the principle axis of ellipticity. We show that recent measurements are largely consistent with the tidal alignment model and discuss dependence on galaxy luminosity. In addition, we show that at linear order the tidal alignment model predicts that the angular dependence of w_g(r_p,theta) is simply w_{g+}*cos(2*theta) and that this dependence is consistent with recent measurements. We also study how stochastic nonlinear contributions to galaxy ellipticity impact these statistics. We find that a significant fraction of the observed LRG ellipticity can be explained by alignment with the tidal field on scales >~10 h^-1 Mpc. These considerations are relevant to galaxy formation and evolution.

We study cosmological constraints on metric f(R) gravity models that are designed to reproduce the LCDM expansion history with modifications to gravity described by a supplementary cosmological freedom, the Compton wavelength parameter B_0. We conduct a Markov chain Monte Carlo analysis on the parameter space, utilizing the geometrical constraints from supernovae distances, the baryon acoustic oscillation distances, and the Hubble constant, along with all of the cosmic microwave background data, including the largest scales, its correlation with galaxies, and a probe of the relation between weak gravitational lensing and galaxy flows. The strongest constraints, however, are obtained through the inclusion of data from cluster abundance. Using all of the data, we infer a bound of B_0<0.0011 at the 95% C.L.

Recent work has shown that at high redshift, the relative velocity between dark matter and baryonic gas is typically supersonic. This relative velocity suppresses the formation of the earliest baryonic structures like minihalos, and the suppression is modulated on large scales. This effect imprints a characteristic shape in the clustering power spectrum of the earliest structures, with significant power on 100 Mpc scales featuring highly pronounced baryon acoustic oscillations. The amplitude of these oscillations is orders of magnitude larger at z=20 than previously expected. This characteristic signature can allow us to distinguish the effects of minihalos on intergalactic gas at times preceding and during reionization. We illustrate this effect with the example of 21 cm emission and absorption from redshifts during and before reionization. This effect can potentially allow us to probe physics on kpc scales using observations on 100 Mpc scales. We present sensitivity forecasts for FAST and Arecibo. Depending on parameters, this enhanced structure may be detectable by Arecibo at redshifts near z=15-20, and with appropriate instrumentation FAST could measure the BAO power spectrum with high precision. In principle, this effect could also pose a serious challenge for efforts to constrain dark energy using observations of the BAO feature at low redshift.

Cosmic shear surveys have great promise as tools for precision cosmology, but can be subject to systematic errors including intrinsic ellipticity correlations of the source galaxies. The intrinsic alignments are believed to be small for deep surveys, but this is based on intrinsic and lensing distortions being uncorrelated. Here we show that the gravitational lensing shear and intrinsic shear need not be independent: correlations between the tidal field and the intrinsic shear cause the intrinsic shear of nearby galaxies to be correlated with the gravitational shear acting on more distant galaxies. We estimate the magnitude of this effect for two simple intrinsic alignment models: one in which the galaxy ellipticity is linearly related to the tidal field, and one in which it is quadratic in the tidal field as suggested by tidal torque theory. The first model predicts a gravitational-intrinsic (GI) correlation that can be much greater than the intrinsic-intrinsic (II) correlation for broad redshift distributions, and that remains when galaxies pairs at similar redshifts are rejected. The second model, in its simplest form, predicts no gravitational-intrinsic correlation. In the first model and assuming a normalization consistent with recently claimed detections of intrinsic correlations we find that the GI correlation term can exceed the usual II term by >1 order of magnitude and the intrinsic correlation induced B-mode by 2 orders of magnitude. These interference effects can suppress the lensing power spectrum for a single broad redshift bin by of order ~10% at z_s=1 and ~30% at z_s=0.5.

In recent work (Seljak, Hamaus and Desjacques 2009) it was found that weighting central halo galaxies by halo mass can significantly suppress their stochasticity relative to the dark matter, well below the Poisson model expectation. In this paper we extend this study with the goal of finding the optimal mass-dependent halo weighting and use $N$-body simulations to perform a general analysis of halo stochasticity and its dependence on halo mass. We investigate the stochasticity matrix, defined as $C_{ij}\equiv<(\delta_i -b_i\delta_m)(\delta_j-b_j\delta_m)>$, where $\delta_m$ is the dark matter overdensity in Fourier space, $\delta_i$ the halo overdensity of the $i$-th halo mass bin and $b_i$ the halo bias. In contrast to the Poisson model predictions we detect nonvanishing correlations between different mass bins. We also find the diagonal terms to be sub-Poissonian for the highest-mass halos. The diagonalization of this matrix results in one large and one low eigenvalue, with the remaining eigenvalues close to the Poisson prediction $1/\bar{n}$, where $\bar{n}$ is the mean halo number density. The eigenmode with the lowest eigenvalue contains most of the information and the corresponding eigenvector provides an optimal weighting function to minimize the stochasticity between halos and dark matter. We find this optimal weighting function to match linear mass weighting at high masses, while at the low-mass end the weights approach a constant whose value depends on the low-mass cut in the halo mass function. Finally, we employ the halo model to derive the stochasticity matrix and the scale-dependent bias from an analytical perspective. It is remarkably successful in reproducing our numerical results and predicts that the stochasticity between halos and the dark matter can be reduced further when going to halo masses lower than we can resolve in current simulations.

The clustering of matter on cosmological scales is an essential probe for studying the physical origin and composition of our Universe. To date, most of the direct studies have focused on shear-shear weak lensing correlations, but it is also possible to extract the dark matter clustering by combining galaxy-clustering and galaxy-galaxy-lensing measurements. In this study we develop a method that can constrain the dark matter correlation function from galaxy clustering and galaxy-galaxy-lensing measurements, by focusing on the correlation coefficient between the galaxy and matter overdensity fields. To generate a mock galaxy catalogue for testing purposes, we use the Halo Occupation Distribution approach applied to a large ensemble of N-body simulations to model pre-existing SDSS Luminous Red Galaxy sample observations. Using this mock catalogue, we show that a direct comparison between the excess surface mass density measured by lensing and its corresponding galaxy clustering quantity is not optimal. We develop a new statistic that suppresses the small-scale contributions to these observations and show that this new statistic leads to a cross-correlation coefficient that is within a few percent of unity down to 5 Mpc/h. Furthermore, the residual incoherence between the galaxy and matter fields can be explained using a theoretical model for scale-dependent bias, giving us a final estimator that is unbiased to within 1%. We also perform a comprehensive study of other physical effects that can affect the analysis, such as redshift space distortions and differences in radial windows between galaxy clustering and weak lensing observations. We apply the method to a range of cosmological models and show the viability of our new statistic to distinguish between cosmological models.

Primordial non-Gaussianity is a potentially powerful discriminant of the physical mechanisms that generated the cosmological fluctuations observed today. Any detection of significant non-Gaussianity would thus have profound implications for our understanding of cosmic structure formation. The large scale mass distribution in the Universe is a sensitive probe of the nature of initial conditions. Recent theoretical progress together with rapid developments in observational techniques will enable us to critically confront predictions of inflationary scenarios and set constraints as competitive as those from the Cosmic Microwave Background. In this paper, we review past and current efforts in the search for primordial non-Gaussianity in the large scale structure of the Universe.

Primordial non-Gaussianity is a potentially powerful discriminant of the physical mechanisms that generated the cosmological fluctuations observed today. Any detection of non-Gaussianity would have profound implications for our understanding of cosmic structure formation. In this paper, we review past and current efforts in the search for primordial non-Gaussianity in the large scale structure of the Universe.

Although general relativity underlies modern cosmology, its applicability on cosmological length scales has yet to be stringently tested. Such a test has recently been proposed, using a quantity, EG, that combines measures of large-scale gravitational lensing, galaxy clustering and structure growth rate. The combination is insensitive to 'galaxy bias' (the difference between the clustering of visible galaxies and invisible dark matter) and is thus robust to the uncertainty in this parameter. Modified theories of gravity generally predict values of EG different from the general relativistic prediction because, in these theories, the 'gravitational slip' (the difference between the two potentials that describe perturbations in the gravitational metric) is non-zero, which leads to changes in the growth of structure and the strength of the gravitational lensing effect3. Here we report that EG = 0.39 +/- 0.06 on length scales of tens of megaparsecs, in agreement with the general relativistic prediction of EG $\approx$ 0.4. The measured value excludes a model within the tensor-vector-scalar gravity theory, which modifies both Newtonian and Einstein gravity. However, the relatively large uncertainty still permits models within f(R) theory, which is an extension of general relativity. A fivefold decrease in uncertainty is needed to rule out these models.

Weak gravitational lensing has been used extensively in the past decade to constrain the masses of galaxy clusters, and is the most promising observational technique for providing the mass calibration necessary for precision cosmology with clusters. There are several challenges in estimating cluster masses, particularly (a) the sensitivity to astrophysical effects and observational systematics that modify the signal relative to the theoretical expectations, and (b) biases that can arise due to assumptions in the mass estimation method, such as the assumed radial profile of the cluster. All of these challenges are more problematic in the inner regions of the cluster, suggesting that their influence would ideally be suppressed for the purpose of mass estimation. However, at any given radius the differential surface density measured by lensing is sensitive to all mass within that radius, and the corrupted signal from the inner parts is spread out to all scales. We develop a new statistic that is ideal for estimation of cluster masses because it completely eliminates mass contributions below a chosen scale (which we suggest should be about 20 per cent of the virial radius), and thus reduces sensitivity to systematic and astrophysical effects. We use simulated and analytical profiles to quantify systematic biases on the estimated masses for several standard methods of mass estimation, finding that these can lead to significant mass biases that range from ten to over fifty per cent. The mass uncertainties when using our new statistic are reduced by up to a factor of ten relative to the standard methods, while only moderately increasing the statistical errors. This new method of mass estimation will enable a higher level of precision in future science work with weak lensing mass estimates for galaxy clusters.

We explore the effect of a cubic correction gnl*phi^3 on the mass function and bias of dark matter haloes extracted from a series of large N-body simulations and compare it to theoretical predictions. Such cubic terms can be motivated in scenarios like the curvaton model, in which a large cubic correction can be produced while simultaneously keeping the quadratic fnl*phi^2 correction small. The deviation from the Gaussian halo mass function is in reasonable agreement with the theoretical predictions. The scale-dependent bias correction Delta b_kappa(k,gnl) measured from the auto- and cross-power spectrum of haloes, is similar to the correction in fnl models, but the amplitude is lower than theoretical expectations. Using the compilation of LSS data in Slosar et al. (2008), we obtain for the first time a limit on gnl of -3.5*10^5 < gnl < +8.2*10^5 (at 95% CL). This limit will improve with the future LSS data by 1-2 orders of magnitude, which should test many of the scenarios of this type.

We develop an improved mass tracer for clusters of galaxies from optically observed parameters, and calibrate the mass relation using weak gravitational lensing measurements. We employ a sample of ~ 13,000 optically-selected clusters from the Sloan Digital Sky Survey (SDSS) maxBCG catalog, with photometric redshifts in the range 0.1-0.3. The optical tracers we consider are cluster richness, cluster luminosity, luminosity of the brightest cluster galaxy (BCG), and combinations of these parameters. We measure the weak lensing signal around stacked clusters as a function of the various tracers, and use it to determine the tracer with the least amount of scatter. We further use the weak lensing data to calibrate the mass normalization. We find that the best mass estimator for massive clusters is a combination of cluster richness, N_{200}, and the luminosity of the brightest cluster galaxy, L_{BCG}: M_{200\bar{\rho}} = (1.27 +/- 0.08) (N_{200}/20)^{1.20 +/- 0.09} (L_{BCG}/\bar{L}_{BCG}(N_{200}))^{0.71 +/- 0.14} \times 10^{14} h^{-1} M_sun, where $\bar{L}_{BCG}(N_{200})$ is the observed mean BCG luminosity at a given richness. This improved mass tracer will enable the use of galaxy clusters as a more powerful tool for constraining cosmological parameters.

We perform a Markov Chain Monte Carlo analysis of the self-accelerating and normal branch of Dvali-Gabadadze-Porrati braneworld gravity. By adopting a parameterized post-Friedmann description of gravity, we utilize all of the cosmic microwave background data, including the largest scales, and its correlation with galaxies in addition to the geometrical constraints from supernovae distances and the Hubble constant. We find that on both branches brane tension or a cosmological constant is required at high significance with no evidence for the unique Dvali-Gabadadze-Porrati modifications. The cross-over scale must therefore be substantially greater than the Hubble scale H_0 r_c > 3 and 3.5 at the 95% CL with and without uncertainties from spatial curvature. With spatial curvature, the limit from the normal branch is substantially assisted by the galaxy cross-correlation which highlights its importance in constraining infrared modifications to gravity.

We investigate the effect of primordial non-Gaussianity of the local f_NL type on the auto- and cross-power spectrum of dark matter haloes using simulations of the LCDM cosmology. We perform a series of large N-body simulations of both positive and negative f_NL, spanning the range between 10 and 100. Theoretical models predict a scale-dependent bias correction \Delta b(k,f_NL) that depends on the linear halo bias b(M). We measure the power spectra for a range of halo mass and redshifts covering the relevant range of existing galaxy and quasar populations. We show that auto and cross-correlation analyses of bias are consistent with each other. We find that for low wavenumbers with k<0.03 h/Mpc the theory and the simulations agree well with each other for biased haloes with b(M)>1.5. We show that a scale-independent bias correction improves the comparison between theory and simulations on smaller scales, where the scale-dependent effect rapidly becomes negligible. The current limits on f_NL from Slosar et al. (2008) come mostly from very large scales k<0.01 h/Mpc and, therefore, remain valid. For the halo samples with b(M)<1.5-2 we find that the scale- dependent bias from non-Gaussianity actually exceeds the theoretical predictions. Our results are consistent with the bias correction scaling linearly with f_NL.

We investigate the impact of nonlinear evolution of the gravitational potentials in the LCDM model on the Integrated Sachs-Wolfe (ISW) contribution to the CMB temperature power spectrum, and on the cross-power spectrum of the CMB and a set of biased tracers of the mass. We use an ensemble of N-body simulations to directly follow the potentials and compare results to perturbation theory (PT). The predictions from PT match the results to high precision for k<0.2 h/Mpc. We compute the nonlinear corrections to the angular power spectrum and find them to be <10% of linear theory for l<100. These corrections are swamped by cosmic variance. On scales l>100 the departures are more significant, however the CMB signal is more than a factor 10^3 larger at this scale. Nonlinear ISW effects therefore play no role in shaping the CMB power spectrum for l<1500. We analyze the CMB--density tracer cross-spectrum using simulations and renormalized bias PT, and find good agreement. The usual assumption is that nonlinear evolution enhances the growth of structure and counteracts linear ISW on small scales, leading to a change in sign of the CMB-LSS cross-spectrum at small scales. However, PT analysis suggests that this trend reverses at late times when the logarithmic growth rate f(a)=dlnD/dlna<0.5 or om_m(a)<0.3. Numerical results confirm these expectations and we find no sign change in ISW-LSS cross-power for low redshifts. Corrections due to nonlinearity and scale dependence of the bias are found to be <10% for l<100, therefore below the S/N of the current and future measurements. Finally, we estimate the CMB--halo cross-correlation coefficient and show that it can be made to match that for CMB--dark matter to within 5% for thin redshift shells, mitigating the need to model bias evolution.

Galaxy surveys are one of the most powerful means to extract the cosmological information and for a given volume the attainable precision is determined by the galaxy shot noise sigma_n^2 relative to the power spectrum P. It is generally assumed that shot noise is white and given by the inverse of the number density n. In this paper we argue one may be able to considerably improve upon this: in the halo picture of cosmological structure all of the dark matter is in halos of varying mass and galaxies are formed inside these halos, but for the dark matter mass and momentum conservation guarantee that nonlinear effects cannot develop a white noise in the dark matter power spectrum on large scales. This suggests that with a suitable weighting a similar effect may be achieved for galaxies, suppressing their shot noise. We explore this idea with N-body simulations by weighting central halo galaxies by halo mass and find that the resulting shot noise can be reduced dramatically relative to expectations, with a 10-30 suppression at the highest number density of n=4*10^-3 (Mpc/h)^3 resolved in our simulations. For specific applications other weighting schemes may achieve even better results and for n=3*10^-4(Mpc/h)^3 we can reduce sigma_n^2/P by up to a factor of 10 relative to uniform weighting. These results open up new opportunities to extract cosmological information in galaxy surveys, such as the recently proposed multi-tracer approach to cancel sampling variance, and may have important consequences for the planning of future redshift surveys. Taking full advantage of these findings may require better understanding of galaxy formation process to develop accurate tracers of the halo mass.

A new and powerful probe of the origin and evolution of structures in the Universe has emerged and been actively developed over the last decade. In the coming decade, non-Gaussianity, i.e., the study of non-Gaussian contributions to the correlations of cosmological fluctuations, will become an important probe of both the early and the late Universe. Specifically, it will play a leading role in furthering our understanding of two fundamental aspects of cosmology and astrophysics: (i) the physics of the very early universe that created the primordial seeds for large-scale structures, and (ii) the subsequent growth of structures via gravitational instability and gas physics at later times. To date, observations of fluctuations in the Cosmic Microwave Background (CMB) and the Large-Scale Structure of the Universe (LSS) have focused largely on the Gaussian contribution as measured by the two-point correlations (or the power spectrum) of density fluctuations. However, an even greater amount of information is contained in non-Gaussianity and a large discovery space therefore still remains to be explored. Many observational probes can be used to measure non-Gaussianity, including CMB, LSS, gravitational lensing, Lyman-alpha forest, 21-cm fluctuations, and the abundance of rare objects such as clusters of galaxies and high-redshift galaxies. Not only does the study of non-Gaussianity maximize the science return from a plethora of present and future cosmological experiments and observations, but it also carries great potential for important discoveries in the coming decade.

We summarize the utility of precise cosmic microwave background (CMB) polarization measurements as probes of the physics of inflation. We focus on the prospects for using CMB measurements to differentiate various inflationary mechanisms. In particular, a detection of primordial B-mode polarization would demonstrate that inflation occurred at a very high energy scale, and that the inflaton traversed a super-Planckian distance in field space. We explain how such a detection or constraint would illuminate aspects of physics at the Planck scale. Moreover, CMB measurements can constrain the scale-dependence and non-Gaussianity of the primordial fluctuations and limit the possibility of a significant isocurvature contribution. Each such limit provides crucial information on the underlying inflationary dynamics. Finally, we quantify these considerations by presenting forecasts for the sensitivities of a future satellite experiment to the inflationary parameters.

Using the 21 cm line, observed all-sky and across the redshift range from 0 to 5, the large scale structure of the Universe can be mapped in three dimensions. This can be accomplished by studying specific intensity with resolution ~ 10 Mpc, rather than via the usual galaxy redshift survey. The data set can be analyzed to determine Baryon Acoustic Oscillation wavelengths, in order to address the question: 'What is the nature of Dark Energy?' In addition, the study of Large Scale Structure across this range addresses the questions: 'How does Gravity effect very large objects?' and 'What is the composition our Universe?' The same data set can be used to search for and catalog time variable and transient radio sources.

We show how to use multiple tracers of large-scale density with different biases to measure the redshift-space distortion parameter beta=f/b=(dlnD/dlna)/b (where D is the growth rate and a the expansion factor), to a much better precision than one could achieve with a single tracer, to an arbitrary precision in the low noise limit. In combination with the power spectrum of the tracers this allows a much more precise measurement of the bias-free velocity divergence power spectrum, f^2 P_m - in fact, in the low noise limit f^2 P_m can be measured as well as would be possible if velocity divergence was observed directly, with rms improvement factor ~[5.2(beta^2+2 beta+2)/beta^2]^0.5 (e.g., ~10 times better than a single tracer for beta=0.4). This would allow a high precision determination of f D as a function of redshift with an error as low as 0.1%. We find up to two orders of magnitude improvement in Figure of Merit for the Dark Energy equation of state relative to Stage II, a factor of several better than other proposed Stage IV Dark Energy surveys. The ratio b_2/b_1 will be determined with an even greater precision than beta, producing, when measured as a function of scale, an exquisitely sensitive probe of the onset of non-linear bias. We also extend in more detail previous work on the use of the same technique to measure non-Gaussianity. Currently planned redshift surveys are typically designed with signal to noise of unity on scales of interest, and are not optimized for this technique. Our results suggest that this strategy may need to be revisited as there are large gains to be achieved from surveys with higher number densities of galaxies.

We cross-correlate large scale structure (LSS) observations from a number of surveys with CMB anisotropies from WMAP to investigate the Integrated Sachs-Wolfe (ISW) effect as a function of redshift, covering z~0.1-2.5. Our main goal is to go beyond reporting detections towards developing a reliable likelihood analysis that allows one to determine cosmological constraints from ISW observations. With this in mind we spend a considerable amount of effort in determining the redshift-dependent bias and redshift distribution b(z)*dN/dz of these samples by matching with spectroscopic observations where available, and analyzing auto-power spectra and cross-power spectra between the samples. The data sets we use are 2-Micron All Sky Survey (2MASS) samples, Sloan Digital Sky Survey (SDSS) photometric Luminous Red Galaxies, SDSS photometric quasars and NRAO VLA Sky Survey (NVSS) radio sources. We make a joint analysis of all samples constructing a full covariance matrix, which we subsequently use for cosmological parameter fitting. We report a 3.7 sigma detection of ISW combining all the datasets. We combine the ISW likelihood function with weak lensing of CMB and CMB power spectrum to constrain the equation of state of dark energy and the curvature of the Universe. While ISW does not significantly improve the constraints in the simplest 6-parameter flat Lambda CDM model, it improves constraints on 7-parameter models with curvature by a factor of 3.2 (relative to WMAP alone) to Omega_K=-0.004^{+0.014}_{-0.020}, and with dark energy equation of state by 15% to w=-1.01^{+0.30}_{-0.40}. (Abridged.)

Recent work has shown that the local non-Gaussianity parameter f_NL induces a scale-dependent bias, whose amplitude is growing with scale. Here we first rederive this result within the context of peak-background split formalism and show that it only depends on the assumption of universality of mass function, assuming halo bias only depends on mass. We then use extended Press-Schechter formalism to argue that this assumption may be violated and the scale dependent bias will depend on other properties, such as merging history of halos. In particular, in the limit of recent mergers we find the effect is suppressed. Next we use these predictions in conjunction with a compendium of large scale data to put a limit on the value of f_NL. When combining all data assuming that halo occupation depends only on halo mass, we get a limit of -29 ~ (-65)< f_NL < +70 ~(+93) at 95% (99.7%) confidence. While we use a wide range of datasets, our combined result is dominated by the signal from the SDSS photometric quasar sample. If the latter are modeled as recent mergers then the limits weaken to -31 ~(-96) < f_NL < +70 ~ (+96) . These limits are comparable to the strongest current limits from the WMAP 5 year analysis, with no evidence of a positive signal in f_NL. While the method needs to be thoroughly tested against large scale structure simulations with realistic quasar and galaxy formation models, our results indicate that this is a competitive method relative to CMB and should be further pursued both observationally and theoretically.

Non-gaussianity in the initial conditions of the universe is one of the most powerful mechanisms to discriminate among the competing theories of the early universe. Measurements using bispectrum of cosmic microwave background anisotropies are limited by the cosmic variance, i.e. available number of modes. Recent work has emphasized the possibility to probe non-gaussianity of local type using the scale dependence of large scale bias from highly biased tracers of large scale structure. However, this power spectrum method is also limited by cosmic variance, finite number of structures on the largest scales, and by the partial degeneracy with other cosmological parameters that can mimic the same effect. Here we propose an alternative method that solves both of these problems. It is based on the idea that on large scales halos are biased, but not stochastic, tracers of dark matter: by correlating a highly biased tracer of large scale structure against an unbiased tracer one eliminates the cosmic variance error, which can lead to a high signal to noise even from the structures comparable to the size of the survey. The square of error improvement on non-gaussianity parameter f_nl relative to the power spectrum method scales as Pn/2, where P and n is the power spectrum and the number density of the biased tracer, respectively. For an ideal survey out to z=2 the error reduction can be as large as a factor of seven, which should guarantee a detection of non-gaussianity from an all sky survey of this type. The improvements could be even larger if high density tracers that are sensitive to non-gaussianity can be identified and measured over a large volume.

We perform a statistical weak lensing analysis of dark matter profiles around tracers of halo mass from galactic- to cluster-size halos. In this analysis we use 170,640 isolated ~L* galaxies split into ellipticals and spirals, 38,236 groups traced by isolated spectroscopic Luminous Red Galaxies (LRGs) and 13,823 MaxBCG clusters from the Sloan Digital Sky Survey (SDSS) covering a wide range of richness. Together these three samples allow a determination of the density profiles of dark matter halos over three orders of magnitude in mass, from 10^{12} M_{sun} to 10^{15} M_{sun}. The resulting lensing signal is consistent with an NFW or Einasto profile on scales outside the central region. We find that the NFW concentration parameter c_{200b} decreases with halo mass, from around 10 for galactic halos to 4 for cluster halos. Assuming its dependence on halo mass in the form of c_{200b} = c_0 [M/(10^{14}M_{sun}/h)]^{\beta}, we find c_0=4.6 +/- 0.7 (at z=0.22) and \beta=0.13 +/- 0.07, with very similar results for the Einasto profile. The slope (\beta) is in agreement with theoretical predictions, while the amplitude is about two standard deviations below the predictions for this mass and redshift, but we note that the published values in the literature differ at a level of 10-20% and that for a proper comparison our analysis should be repeated in simulations. We discuss the implications of our results for the baryonic effects on the shear power spectrum: since these are expected to increase the halo concentration, the fact that we see no evidence of high concentrations on scales above 20% of the virial radius suggests that baryonic effects are limited to small scales, and are not a significant source of uncertainty for the current weak lensing measurements of the dark matter power spectrum. [ABRIDGED]

We investigate the correlation of gravitational lensing of the cosmic microwave background (CMB) with several tracers of large-scale structure, including luminous red galaxies (LRGs), quasars, and radio sources. The lensing field is reconstructed based on the CMB maps from the Wilkinson Microwave Anisotropy Probe (WMAP) satellite; the LRGs and quasars are observed by the Sloan Digital Sky Survey (SDSS); and the radio sources are observed in the NRAO VLA Sky Survey (NVSS). Combining all three large-scale structure samples, we find evidence for a positive cross-correlation at the $2.5\sigma$ level ($1.8\sigma$ for the SDSS samples and $2.1\sigma$ for NVSS); the cross-correlation amplitude is $1.06\pm 0.42$ times that expected for the WMAP cosmological parameters. Our analysis extends other recent analyses in that we carefully determine bias weighted redshift distribution of the sources, which is needed for a meaningful cosmological interpretation of the detected signal. We investigate contamination of the signal by Galactic emission, extragalactic radio and infrared sources, thermal and kinetic Sunyaev-Zel'dovich effects, and the Rees-Sciama effect, and find all of them to be negligible.

Accurate photometric redshifts are among the key requirements for precision weak lensing measurements. Both the large size of the Sloan Digital Sky Survey (SDSS) and the existence of large spectroscopic redshift samples that are flux-limited beyond its depth have made it the optimal data source for developing methods to properly calibrate photometric redshifts for lensing. Here, we focus on galaxy-galaxy lensing in a survey with spectroscopic lens redshifts, as in the SDSS. We develop statistics that quantify the effect of source redshift errors on the lensing calibration and on the weighting scheme, and show how they can be used in the presence of redshift failure and sampling variance. We then demonstrate their use with 2838 source galaxies with spectroscopy from DEEP2 and zCOSMOS, evaluating several public photometric redshift algorithms, in two cases including a full p(z) for each object, and find lensing calibration biases as low as 1% (due to fortuitous cancellation of two types of bias) or as high as 20% for methods in active use (despite the small mean photoz bias of these algorithms). Our work demonstrates that lensing-specific statistics must be used to reliably calibrate the lensing signal, due to asymmetric effects of (frequently non-Gaussian) photoz errors. We also demonstrate that large-scale structure (LSS) can strongly impact the photoz calibration and its error estimation, due to a correlation between the LSS and the photoz errors, and argue that at least two independent degree-scale spectroscopic samples are needed to suppress its effects. Given the size of our spectroscopic sample, we can reduce the galaxy-galaxy lensing calibration error well below current SDSS statistical errors.

Correlations between intrinsic shear and the density field on large scales, a potentially important contaminant for cosmic shear surveys, have been robustly detected at low redshifts with bright galaxies in SDSS data. Here we present a more detailed characterization of this effect, which can cause anti-correlations between gravitational lensing shear and intrinsic ellipticity (GI correlations). This measurement uses 36278 Luminous Red Galaxies (LRGs) from the SDSS spectroscopic sample with 0.15<z<0.35, split by redshift and luminosity; 7758 LRGs from the 2SLAQ Survey at 0.4<z<0.8; and a variety of other SDSS samples from previous, related work. We find >3sigma detections of the effect for all galaxy subsamples within the SDSS LRG sample; for the 2SLAQ sample, we find a 2sigma detection for a bright subsample, and no detection for a fainter subsample. Fitting formulae are provided for the scaling of the GI correlations with luminosity, transverse separation, and redshift. We estimate contamination in the measurement of sigma_8 for future cosmic shear surveys on the basis of the fitted dependence of GI correlations on galaxy properties. We find contamination to the power spectrum ranging from -1.5 (optimistic) to -33 per cent (pessimistic) for a toy cosmic shear survey using all galaxies to a depth of R=24 using scales l~500. This corresponds to a bias in sigma_8 of Delta sigma_8=-0.004 (optimistic), -0.02 (central), or -0.10 (pessimistic). We provide a prescription for inclusion of this error in cosmological parameter estimation codes. The principal uncertainty is in the treatment of the L<=L* blue galaxies. Characterization of the tidal alignments of these galaxies, especially at redshifts relevant for cosmic shear, should be a high priority for the cosmic shear community. (Abridged)

Cluster abundance measurements are among the most sensitive probes of the amplitude of matter fluctuations in the universe, which in turn can help constrain other cosmological parameters, like the dark energy equation of state or neutrino mass. However, difficulties in calibrating the relation between the cluster observable and halo mass, and the lack of completeness information, make this technique particularly susceptible to systematic errors. Here we argue that a cluster abundance analysis using statistical weak lensing on the stacked clusters leads to a robust lower limit on the amplitude of fluctuations. The method compares the average weak lensing signal measured around the whole cluster sample to a theoretical prediction, assuming that the clusters occupy the centers of all of the most massive halos above some minimum mass threshold. If the amplitude of fluctuations is below a certain limiting value, there are too few massive clusters in this model and the theoretical prediction falls below the observations. Since any effects that modify the model assumptions can only decrease the theoretical prediction, the limiting amplitude becomes a robust lower limit. Here, we apply it to a volume limited sample of 16,000 group/cluster candidates identified from isolated luminous red galaxies (LRGs) in the Sloan Digital Sky Survey (SDSS). We find $\sigma_8 (\Omega_m/0.25)^{0.5}>0.62$ at the 95% c.l. after taking into account observational errors in the lensing analysis. While this is a relatively weak constraint, both the scatter in the LRG luminosity-halo mass relation and the lensing errors are large; the constraints could improve considerably in the future with more sophisticated cluster identification algorithms and smaller errors in the lensing analysis. [Abridged]

We measure the large-scale real-space power spectrum P(k) using luminous red galaxies (LRGs) in the Sloan Digital Sky Survey (SDSS) and use this measurement to sharpen constraints on cosmological parameters from the Wilkinson Microwave Anisotropy Probe (WMAP). We employ a matrix-based power spectrum estimation method using Pseudo-Karhunen-Loeve eigenmodes, producing uncorrelated minimum-variance measurements in 20 k-bands of both the clustering power and its anisotropy due to redshift-space distortions, with narrow and well-behaved window functions in the range 0.01h/Mpc < k < 0.2h/Mpc. Results from the LRG and main galaxy samples are consistent, with the former providing higher signal-to-noise. Our results are robust to omitting angular and radial density fluctuations and are consistent between different parts of the sky. They provide a striking confirmation of the predicted large-scale LCDM power spectrum. Combining only SDSS LRG and WMAP data places robust constraints on many cosmological parameters that complement prior analyses of multiple data sets. The LRGs provide independent cross-checks on Om and the baryon fraction in good agreement with WMAP. Within the context of flat LCDM models, our LRG measurements complement WMAP by sharpening the constraints on the matter density, the neutrino density and the tensor amplitude by about a factor of two, giving Omega_m=0.24+-0.02 (1 sigma), sum m_nu < 0.9 eV (95%) and r<0.3 (95%). Baryon oscillations are clearly detected and provide a robust measurement of the comoving distance to the median survey redshift z=0.35 independent of curvature and dark energy properties. Within the LCDM framework, our power spectrum measurement improves the evidence for spatial flatness, sharpening the curvature constraint Omega_tot=1.05+-0.05 from WMAP alone to Omega_tot=1.003+-0.010. Assuming Omega_tot=1, the equation of state parameter is constrained to w=-0.94+-0.09, indicating the potential for more ambitious future LRG measurements to provide precision tests of the nature of dark energy. All these constraints are essentially independent of scales k>0.1h/Mpc and associated nonlinear complications, yet agree well with more aggressive published analyses where nonlinear modeling is crucial.

We combine the Ly-alpha forest power spectrum (LYA) from the Sloan Digital Sky Survey (SDSS) and high resolution spectra with cosmic microwave background (CMB) including 3-year WMAP, and supernovae (SN) and galaxy clustering constraints to derive new constraints on cosmological parameters. The existing LYA power spectrum analysis is supplemented by constraints on the mean flux decrement derived using a principle component analysis for quasar continua, which improves the LYA constraints on the linear power. We find some tension between the WMAP3 and LYA power spectrum amplitudes, at the ~2 sigma level, which is partially alleviated by the inclusion of other observations: we find \sigma_8=0.85\pm 0.02 compared to sigma_8=0.80 \pm 0.03 without LYA. For the slope we find ns=0.965\pm0.012. We find no evidence for the running of the spectral index in the combined analysis, dn/dln k=-(1.5\pm 1.2) x 10^{-2}, in agreement with inflation. The limits on the sum of neutrino masses are significantly improved: $\sum m_{\nu}<0.17\eV$ at 95% (<0.32eV at 99.9%). This result, when combined with atmospheric and solar neutrino mixing constraints, requires that the neutrino masses cannot be degenerate, m_3/m_1>1.3 (95% c.l.). Assuming a thermalized fourth neutrino we find m_s<0.26\eV at 95% c.l. and such neutrino cannot be an explanation for the LSND results. In the limits of massless neutrinos we obtain the effective number of neutrinos N_\nu^{\rm eff}=5.3^{+0.4}_{-0.6}{}^{+2.1}_{-1.7}{}^{+3.8}_{-2.5} and N_\nu^{\rm eff}=3.04 is allowed only at 2.4-sigma. The constraint on the dark energy equation of state is w=-1.04\pm 0.06. The constraint on curvature is Omega_k=-0.003\pm 0.006. Cosmic strings limits are G\mu <2.3 x 10^{-7} at 95% c.l. and correlated isocurvature models are also tightly constrained.

The Shear TEsting Programme (STEP) is a collaborative project to improve the accuracy and reliability of weak lensing measurement, in preparation for the next generation of wide-field surveys. We review sixteen current and emerging shear measurement methods in a common language, and assess their performance by running them (blindly) on simulated images that contain a known shear signal. We determine the common features of algorithms that most successfully recover the input parameters. We achieve previously unattained discriminatory precision in our analysis, via a combination of more extensive simulations, and pairs of galaxy images that have been rotated with respect to each other, thus removing noise from their intrinsic ellipticities. The robustness of our simulation approach is also confirmed by testing the relative calibration of methods on real data. Weak lensing measurement has improved since the first STEP paper. Several methods now consistently achieve better than 2% precision, and are still being developed. However, the simulations can now distinguish all methods from perfect performance. Our main concern continues to be the potential for a multiplicative shear calibration bias: not least because this can not be internally calibrated with real data. We determine which galaxy populations are responsible and, by adjusting the simulated observing conditions, we also investigate the effects of instrumental and atmospheric parameters. We have isolated several previously unrecognised aspects of galaxy shape measurement, in which focussed development could provide further progress towards the sub-percent level of precision desired for future surveys. [ABRIDGED]

We present results of a measurement of the shape of the density profile of galaxy groups and clusters traced by 43 335 Luminous Red Galaxies (LRGs) with spectroscopic redshifts from the Sloan Digital Sky Survey (SDSS). The galaxies are selected such that they are the brightest within a cylindrical aperture, split into two luminosity samples, and modeled as the sum of stellar and dark matter components. We present a detailed investigation of many possible systematic effects that could contaminate our signal and develop methods to remove them, including a detected intrinsic alignment for galaxies within 100 kpc/h of LRGs which we remove using photometric redshift information. The resulting lensing signal is consistent with NFW profile dark matter halos; the SIS profile is ruled out at the 96 (conservatively) and 99.96 per cent confidence level (CL) for the fainter and brighter lens samples (respectively) when we fit using lensing data between 40 kpc/h and 2 Mpc/h with total signal-to-noise of 19 and 25 for the two lens samples. The lensing signal amplitude suggests that the faint and bright sample galaxies typically reside in haloes of mass (2.9+/-0.4)x10^{13} M_{sun}/h and (6.7+/-0.8)x10^{13} M_{sun}/h respectively, in good agreement with predictions based on halo spatial density with normalization lower than the 'concordance' sigma_8=0.9. When fitting for the concentration parameter in the NFW profile, we find c = 5.0+/-0.6 (stat) +/-1 (sys), and c = 5.6+/-0.6 (stat) +/-1 (sys) for the faint and bright samples, consistent with Lambda-CDM simulations. We also split the bright sample further to determine masses and concentrations for cluster-mass halos, finding mass (1.3+/-0.2)x10^{14} M_{sun}/h for the sample of LRGs brighter than -22.6 in r. (Abridged)

We present the 3D real space clustering power spectrum of a sample of \~600,000 luminous red galaxies (LRGs) measured by the Sloan Digital Sky Survey (SDSS), using photometric redshifts. This sample of galaxies ranges from redshift z=0.2 to 0.6 over 3,528 deg^2 of the sky, probing a volume of 1.5 (Gpc/h)^3, making it the largest volume ever used for galaxy clustering measurements. We measure the angular clustering power spectrum in eight redshift slices and combine these into a high precision 3D real space power spectrum from k=0.005 (h/Mpc) to k=1 (h/Mpc). We detect power on gigaparsec scales, beyond the turnover in the matter power spectrum, on scales significantly larger than those accessible to current spectroscopic redshift surveys. We also find evidence for baryonic oscillations, both in the power spectrum, as well as in fits to the baryon density, at a 2.5 sigma confidence level. The statistical power of these data to constrain cosmology is ~1.7 times better than previous clustering analyses. Varying the matter density and baryon fraction, we find \Omega_M = 0.30 \pm 0.03, and \Omega_b/\Omega_M = 0.18 \pm 0.04, The detection of baryonic oscillations also allows us to measure the comoving distance to z=0.5; we find a best fit distance of 1.73 \pm 0.12 Gpc, corresponding to a 6.5% error on the distance. These results demonstrate the ability to make precise clustering measurements with photometric surveys (abridged).

We present the results of attempts to detect the ellipticity of dark matter halos using galaxy-galaxy weak lensing with SDSS data. We use 2,020,256 galaxies brighter than r=19 with photometric redshifts (divided into colour and luminosity subsamples) as lenses and 31,697,869 source galaxies. We search for and identify several signal contaminants, which if not removed lead to a spurious detection. These include systematic shear that leads to a slight spurious alignment of lens and source ellipticities, intrinsic alignments (due to contamination of the source sample by physically-associated lens source pairs), and anisotropic magnification bias. We develop methods that allow us to remove these contaminants to the signal. We split the analysis into blue (spiral) and red (elliptical) galaxies. Assuming Gaussian errors as in previous work and a power-law profile, we find f_h=e_h/e_g=0.1+/-0.06 for red galaxies and -0.8+/-0.4 for blue galaxies using 20-300 kpc/h, averaged over luminosity. Inclusion of the more realistic non-Gaussian error distributions and of the NFW density profile (which predicts much smaller ellipticity of the shear for scales above the scale radius) yields 0.60+/-0.38 for ellipticals and -1.4+1.7-2.0 for spirals. While there is no concrete detection of alignment in either case, there is a suggestion in the data of a positive alignment in the brightest lens sample of ellipticals. Our results appear to be mildly inconsistent with a previously reported detection by Hoekstra et al. (2004), but more data and further tests are needed to clarify whether the discrepancy is real or a consequence of differences in the lens galaxy samples used and analysis methods.

The relationship between galaxies and dark matter can be characterized by the halo mass of the central galaxy and the fraction of galaxies that are satellites. Here we present observational constraints from the SDSS on these quantities as a function of r-band luminosity and stellar mass using galaxy-galaxy weak lensing, with a total of 351,507 lenses. We use stellar masses derived from spectroscopy and virial halo masses derived from weak gravitational lensing to determine the efficiency with which baryons in the halo of the central galaxy have been converted into stars. We find that an L* galaxy with a stellar mass of 6x10^{10} M_{sun} is hosted by a halo with mass of 1.4x10^{12} M_{sun}/h, independent of morphology, yielding baryon conversion efficiencies of 17_{-5}^{+10} (early types) and 16_{-6}^{+15} (late types) per cent at the 95 per cent CL (statistical, not including systematic uncertainty due to assumption of a universal initial mass function, or IMF). We find that for a given stellar mass, the halo mass is independent of morphology below M_{stellar}=10^{11} M_{sun}, in contrast to typically a factor of two difference in halo mass between ellipticals and spirals at a fixed luminosity. This suggests that stellar mass is a good proxy for halo mass in this range and should be used preferentially whenever a halo mass selected sample is needed. For higher stellar masses, the conversion efficiency is a declining function of stellar mass, and the differences in halo mass between early and late types become larger, reflecting the fact that most group and cluster halos with masses above 10^{13} M_{sun} host ellipticals at the center, while even the brightest central spirals are hosted by halos of mass below 10^{13} M_{sun}. (Abridged)

String models can produce successful inflationary scenarios in the context of brane collisions and in many of these models cosmic strings may also be produced. In scenarios such as KKLMMT the string contribution is naturally predicted to be well below the inflationary signal for cosmic microwave background (CMB) temperature anisotropies, in agreement with the existing limits. We find that for $B$ type polarization of CMB the situation is reversed and the dominant signal comes from vector modes generated by cosmic strings, which exceeds the gravity wave signal from both inflation and strings. The signal can be detected for a broad range of parameter space: future polarization experiments may be able to detect the string signal down to the string tension $G\mu=10^{-9}$, although foregrounds and lensing are likely to worsen these limits. We argue that the optimal scale to search for the string signature is at $\ell\sim 1000$, but in models with high optical depth the signal from reionization peak at large scales is also significant. The shape of the power spectrum allows one to distinguish the string signature from the gravity waves from inflation, but only with a sufficiently high angular resolution experiment

The power spectrum of weak lensing shear caused by large-scale structure is an emerging tool for precision cosmology, in particular for measuring the effects of dark energy on the growth of structure at low redshift. One potential source of systematic error is intrinsic alignments of ellipticities of neighbouring galaxies (II correlation) that could mimic the correlations due to lensing. A related possibility pointed out by Hirata and Seljak (2004) is correlation between the intrinsic ellipticities of galaxies and the density field responsible for gravitational lensing shear (GI correlation). We present constraints on both the II and GI correlations using 265 908 spectroscopic galaxies from the SDSS, and using galaxies as tracers of the mass in the case of the GI analysis. The availability of redshifts in the SDSS allows us to select galaxies at small radial separations, which both reduces noise in the intrinsic alignment measurement and suppresses galaxy- galaxy lensing (which otherwise swamps the GI correlation). While we find no detection of the II correlation, our results are nonetheless statistically consistent with recent detections found using the SuperCOSMOS survey. In contrast, we have a clear detection of GI correlation in galaxies brighter than L* that persists to the largest scales probed (60 Mpc/h) and with a sign predicted by theoretical models. This correlation could cause the existing lensing surveys at z~1 to underestimate the linear amplitude of fluctuations by as much as 20% depending on the source sample used, while for surveys at z~0.5 the underestimation may reach 30%. (Abridged.)

We use the Ly-alpha forest power spectrum measured by the SDSS and high-resolution spectroscopy observations in combination with cosmic microwave background and galaxy clustering constraints to place limits on a sterile neutrino as a dark matter candidate in the warm dark matter (WDM) scenario. Such a neutrino would be created in the early universe through mixing with an active neutrino and would suppress structure on scales smaller than its free streaming scale. We ran a series of high-resolution hydrodynamic simulations with varying neutrino mass to describe the effect of a sterile neutrino on the Ly-alpha forest power spectrum. We find that the mass limit is m_s >14 keV at 95% c.l. (10keV at 99.9%), which is nearly an order of magnitude tighter constraint than previously published limits and is above the upper limit allowed by X-ray constraints, excluding this candidate as dark matter in this model. The corresponding limit for a neutrino that decoupled early while in thermal equilibrium is 2.5keV (95% c.l.).

In inflationary models, gravitational waves are produced and generate B-type polarization in the CMB. Since B polarization is only generated by gravity waves it does not suffer from the cosmic variance. A perfect decomposition of the CMB into B-modes and E-modes would require data from the entire sky, which in practice is not possible because of the foreground contaminants. This leads to mixing of E polarization into B, which introduces cosmic variance conta- mination of B polarization and reduces sensitivity to gravity wave amplitude even in absence of detector noise. We present numerical results for the uncertainty in the tensor-to-scalar ratio using the Fisher matrix formalism for various resolutions, using foreground models based on dust maps and assuming 90 GHz operating frequency. We find that the usual scaling delta(T/S) ~ f_sky^(-1/2) is significantly degraded and becomes delta(T/S) ~ f_sky^(-2) for f_sky>0.7. This dependence is affected only weakly by the choice of sky cuts. To achieve a T/S=10^(-3) detection at 3 sigma one needs to observe 15% of the sky as opposed to naive expectation of 0.3%. To prevent contamination over this large sky area at required level one must be able to remove polarized dust emission at or better than 0.1% of unpolarized intensity, assuming the cleanest part of the sky has been chosen. To achieve T/S=10^(-4) detection at 3 sigma one needs to observe 70% of the sky, which is only possible if dust emission is removed everywhere over this region at 0.01% level. Reaching T/S=10^(-2) should be easier: 1% of the sky is needed over which polarized emission needs to be removed at 1% of total intensity if the cleanest region is chosen. These results suggest that foreground contamination may make it difficult to achieve levels below T/S=10^(-3). (abridged)

We investigate the properties of the pairwise velocity dispersion as a function of galaxy luminosity in the context of a halo model. We derive the distribution of velocities of pairs at a given separation taking into account both one-halo and two-halo contributions. We show that pairwise velocity distribution in real space is a complicated mixture of host-satellite, satellite-satellite and two-halo pairs. The peak value is reached at around 1$h^{-1}$Mpc and does not reflect the velocity dispersion of a typical halo hosting these galaxies, but is instead dominated by the satellite-satellite pairs in high mass clusters. This is true even for cross-correlations between bins separated in luminosity. As a consequence the velocity dispersion at a given separation can decrease with luminosity, even if the underlying typical halo host mass is increasing, in agreement with recent observations. We compare our findings to numerical simulations and find a good agreement. Numerical simulations also suggest a luminosity dependent velocity bias, which depends on the subhalo mass. We develop models of the auto- and cross-correlation function of luminosity subsamples of galaxies in the observable $r_\proj - \pi$ space and calculate the inferred velocity dispersion as a function of wave vector if dispersion model is fit to the redshift space power spectrum. We find that so derived pairwise velocity dispersion also exhibits a bump at $k\sim 1 h/{\rm Mpc}$.

Galaxy-galaxy lensing is a powerful probe of the relation between galaxies and dark matter halos, but its theoretical interpretation requires a careful modeling of various contributions, such as the contribution from central and satellite galaxies. For this purpose, a phenomenological approach based on the halo model has been developed, allowing for fast exploration of the parameter space of models. In this paper, we investigate the ability of the halo model to extract information from the g-g weak lensing signal by comparing it to high-resolution dissipationless simulations that resolve subhalos. We find that the halo model reliably determines parameters such as the host halo mass of central galaxies, the fraction of galaxies that are satellites, and their radial distribution inside larger halos. If there is a significant scatter present in the central galaxy host halo mass distribution, then the mean and median mass of that distribution can differ significantly from one another, and the halo model mass determination lies between the two. This result suggests that when analyzing the data, galaxy subsamples with a narrow central galaxy halo mass distribution, such as those based on stellar mass, should be chosen for a simpler interpretation of the results.

We analyze the SDSS Ly-alpha forest P_F(k,z) measurement to determine the linear theory power spectrum. Our analysis is based on fully hydrodynamic simulations, extended using hydro-PM simulations. We account for the effect of absorbers with damping wings, which leads to an increase in the slope of the linear power spectrum. We break the degeneracy between the mean level of absorption and the linear power spectrum without significant use of external constraints. We infer linear theory power spectrum amplitude Delta^2_L(k_p=0.009s/km,z_p=3.0)=0.452_{-0.057-0.116}^{+0.069+0.141} and slope n_eff=-2.321_{-0.047-0.102}^{+0.055+0.131} (possible systematic errors are included through nuisance parameters in the fit - a factor >~5 smaller errors would be obtained on both parameters if we ignored modeling uncertainties). The errors are correlated and not perfectly Gaussian, so we provide a chi^2 table to accurately describe the results. The result corresponds to sigma_8=0.85, n=0.94, for a LCDM model with Omega_m=0.3, Omega_b=0.04, and h=0.7, but is most useful in a combined fit with the CMB. The inferred curvature of the linear power spectrum and the evolution of its amplitude and slope with redshift are consistent with expectations for LCDM models, with the evolution of the slope, in particular, being tightly constrained. We use this information to constrain systematic contamination, e.g., fluctuations in the UV background. This paper should serve as a starting point for more work to refine the analysis, including technical improvements such as increasing the size and number of the hydrodynamic simulations, and improvements in the treatment of the various forms of feedback from galaxies and quasars.

Weak lensing is emerging as a powerful observational tool to constrain cosmological models, but is at present limited by an incomplete understanding of many sources of systematic error. Many of these errors are multiplicative and depend on the population of background galaxies. We show how the commonly cited geometric test, which is rather insensitive to cosmology, can be used as a ratio test of systematics in the lensing signal at the 1 per cent level. We apply this test to the galaxy-galaxy lensing analysis of the Sloan Digital Sky Survey (SDSS), which at present is the sample with the highest weak lensing signal to noise and has the additional advantage of spectroscopic redshifts for lenses. This allows one to perform meaningful geometric tests of systematics for different subsamples of galaxies at different mean redshifts, such as brighter galaxies, fainter galaxies and high-redshift luminous red galaxies, both with and without photometric redshift estimates. We use overlapping objects between SDSS and the DEEP2 and 2SLAQ spectroscopic surveys to establish accurate calibration of photometric redshifts and to determine the redshift distributions for SDSS. We use these redshift results to compute the projected surface density contrast DeltaSigma around 259 609 spectroscopic galaxies in the SDSS; by measuring DeltaSigma with different source samples we establish consistency of the results at the 10 per cent level (1-sigma). We also use the ratio test to constrain shear calibration biases and other systematics in the SDSS survey data to determine the overall galaxy-galaxy weak lensing signal calibration uncertainty. We find no evidence of any inconsistency among many subsamples of the data.

Many recent analyses have indicated that large scale WMAP data display anomalies that appear inconsistent with the standard cosmological paradigm. However, the effects of foreground contamination, which require elimination of some fraction of the data, have not been carefully investigated due to the complexity in the analysis. Here we develop a general formalism of how to incorporate these effects in any analysis of this type. Our approach is to compute the full multi-dimensional probability distribution function of all possible sky realizations that are consistent with the data and with the allowed level of contamination. As an example we apply this method to compute the joint probability distribution function for the possible realizations of quadrupole and octopole using the WMAP data. This 12 dimensional distribution function is explored using the Markov Chain Monte Carlo technique. The resulting chains are used to asses the statistical significance of the low quadrupole using frequentist methods, the quadrupole-octopole alignment using several methods (angular momentum dispersion, multipole vectors and a new method based of feature matching) and the quadrupole-octopole aligment with ecliptic.

We discuss the construction of a photometric redshift catalogue of Luminous Red Galaxies (LRGs) from the Sloan Digital Sky Survey (SDSS), emphasizing the principal steps necessary for constructing such a catalogue -- (i) photometrically selecting the sample, (ii) measuring photometric redshifts and their error distributions, (iii) and estimating the true redshift distribution. We compare two photometric redshift algorithms for these data and find that they give comparable results. Calibrating against the SDSS and SDSS-2dF spectroscopic surveys, we find that the photometric redshift accuracy is $\sigma \sim 0.03$ for redshifts less than 0.55 and worsens at higher redshift ($\sim 0.06$). These errors are caused by photometric scatter, as well as systematic errors in the templates, filter curves, and photometric zeropoints. We also parametrize the photometric redshift error distribution with a sum of Gaussians, and use this model to deconvolve the errors from the measured photometric redshift distribution to estimate the true redshift distribution. We pay special attention to the stability of this deconvolution, regularizing the method with a prior on the smoothness of the true redshift distribution. The methods we develop are applicable to general photometric redshift surveys.

We investigate the recent suggestions by Barausse et al. (astro-ph/0501152) and Kolb et al. (hep-th/0503117) that the acceleration of the universe could be explained by large superhorizon fluctuations generated by inflation. We show that no acceleration can be produced by this mechanism. We begin by showing how the application of Raychaudhuri equation to inhomogeneous cosmologies results in several ``no go'' theorems for accelerated expansion. Next we derive an exact solution for a specific case of initial perturbations, for which application of the Kolb et al. expressions leads to an acceleration, while the exact solution reveals that no acceleration is present. We show that the discrepancy can be traced to higher order terms that were dropped in the Kolb et al. analysis. We proceed with the analysis of initial value formulation of general relativity to argue that causality severely limits what observable effects can be derived from superhorizon perturbations. By constructing a Riemann normal coordinate system on initial slice we show that no infrared divergence terms arise in this coordinate system. Thus any divergences found previously can be eliminated by a local rescaling of coordinates and are unobservable. We perform an explicit analysis of the variance of the deceleration parameter for the case of single field inflation using usual coordinates and show that the infrared divergent terms found by Barausse et al. and Kolb et al. cancel against several additional terms not considered in their analysis. Finally, we argue that introducing isocurvature perturbations does not alter our conclusion that the accelerating expansion of the universe cannot be explained by superhorizon modes.

We combine the measurements of luminosity dependence of bias with the luminosity dependent weak lensing analysis of dark matter around galaxies to derive the galaxy bias and constrain nonlinear mass and cosmological parameters. We take advantage of theoretical and simulation predictions that predict that while halo bias is rapidly increasing with mass for high masses, it is nearly constant in low mass halos. We use a new weak lensing analysis around the same SDSS galaxies to determine their halo mass probability distribution. These halo mass probability distributions are used to predict the bias for each luminosity subsample and we find an excellent agreement with observed values. The required nonlinear mass suggests slightly lower matter density than usually assumed, Omegam=0.25+/- 0.03 for the simplest models. We combine the bias constraints with those from the WMAP and the SDSS power spectrum analysis to derive new constraints on bias and sigma_8. For the most general parameter space we find sigma_8=0.88+/- 0.06 and b_*=0.99+/- 0.07. In the context of spatially flat models we improve the limit on the neutrino mass for the case of 3 degenerate families from m_nu<0.6eV without bias to m_nu<0.18eV with bias (95% c.l.), which is weakened to m_nu<0.24eV if running is allowed. The corresponding limit for 3 massless + 1 massive neutrino is 1.37eV.

We present a 2.5 sigma detection of the Integrated Sachs-Wolfe (ISW) effect and discuss the constraints it places on cosmological parameters. We cross-correlate microwave temperature maps from the WMAP satellite with a 4000 deg^2 luminous red galaxy (LRG) overdensity map measured by the Sloan Digital Sky Survey. Accurate photometric redshifts allow us to perform a reliable auto-correlation analysis of the LRGs, eliminating the uncertainty in the galaxy bias, and combined with cross correlation signal, constrains cosmological parameters -- in particular, the matter density. We find a 2.5 sigma signal in the Ka, Q, V, and W WMAP bands, after combining the information from multipoles 2 <= l < 400. This is consistent with the expected amplitude of the ISW effect, but requires a lower matter density than is usually assumed: the amplitude, parametrized by the galaxy bias assuming \Omega_M=0.3, \Omega_\Lambda=0.7 and \sigma_8=0.9, is b_g = 4.05 \pm 1.54 for V band, with similar results for the other bands. This should be compared to b_g = 1.82 \pm 0.02 from the auto-correlation analysis. These data provide only a weak confirmation (2.5 sigma) of dark energy, but provide a significant upper limit: \Omega_\Lambda=0.80_{-0.06}^{+0.03} (1 sigma)_{-0.19}^{+0.05} (2 sigma), assuming a cosmology with \Omega_M+\Omega_\Lambda=1, \Omega_b = 0.05, and \sigma_8=0.9, and w=-1. The weak cross-correlation signal rules out low matter density/high dark energy density universes and, in combination with other data, strongly constrains models with w<-1.3. We provide a simple prescription to incorporate these constraints into cosmological parameter estimation methods for (\Omega_M, \sigma_8,w). (abridged)

We present the results of a search for gravitational lensing of the cosmic microwave background (CMB) in cross-correlation with the projected density of luminous red galaxies (LRGs). The CMB lensing reconstruction is performed using the first year of Wilkinson Microwave Anisotropy Probe (WMAP) data, and the galaxy maps are obtained using the Sloan Digital Sky Survey (SDSS) imaging data. We find no detection of lensing; our constraint on the galaxy bias derived from the galaxy-convergence cross-spectrum is $b_g=1.81\pm 1.92$ ($1\sigma$, statistical), as compared to the expected result of $b_g\sim 1.8$ for this sample. We discuss possible instrument-related systematic errors and show that the Galactic foregrounds are not important. We do not find any evidence for point source or thermal Sunyaev-Zel'dovich effect contamination.

On large scales galaxies and their halos are usually assumed to trace the dark matter with a constant bias and dark matter is assumed to trace the linear density field. We test these assumption using several large N-body simulations with 384^3-1024^3 particles and box sizes between 100-1000h/Mpc, which can both resolve the small galactic size halos and sample the large scale fluctuations. We explore the average halo bias relation as a function of halo mass and show that existing fitting formulae overestimate the halo bias by up to 20% in the regime just below the nonlinear mass. We propose a new expression that fits our simulations well. We find that the halo bias is nearly constant, b~0.65-0.7, for masses below one tenth of the nonlinear mass. We explore next the relation between the initial and final dark matter in individual Fourier modes and show that there are significant fluctuations in their ratio, ranging from 10% rms at k~0.03h/Mpc to 50% rms at k~0.1h/Mpc. We argue that these large fluctuations are caused by perturbative effects beyond the linear theory, which are dominated by long wavelength modes with large random fluctuations. Similar or larger fluctuations exist between halos and dark matter and between halos of different mass. While these fluctuations are small compared to the sampling variance, they are significant for attempts to determine the bias by relating directly the maps of galaxies and dark matter or the maps of different galaxy populations, which would otherwise be immune to sampling variance.

A new generation of instruments will reveal the microwave sky at high resolution. We focus on one of these, the Atacama Cosmology Telescope, which probes scales 1000<l<10000, where both primary and secondary anisotropies are important. Including lensing, thermal and kinetic Sunyaev-Zeldovich (SZ) effects, and extragalactic point sources, we simulate the telescope's observations of the CMB in three channels, then extract the power spectra of these components in a multifrequency analysis. We present results for various cases, differing in assumed knowledge of the contaminating point sources. We find that both radio and infrared point sources are important, but can be effectively eliminated from the power spectrum given three (or more) channels and a good understanding of their frequency dependence. However, improper treatment of the scatter in the point source frequency dependence relation may introduce a large systematic bias. Even if all thermal SZ and point source effects are eliminated, the kinetic SZ effect remains and corrupts measurements of the primordial slope and amplitude on small scales. We discuss the non-Gaussianity of the one-point probability distribution function as a way to constrain the kinetic SZ effect, and we develop a method for distinguishing this effect from the CMB in a window where they overlap. This method provides an independent constraint on the variance of the CMB in that window and is complementary to the power spectrum analysis.

We explore several physical effects on the power spectrum of the Lyman-alpha forest transmitted flux. The effects we investigate here are usually not part of hydrodynamic simulations and so need to be estimated separately. The most important effect is that of high column density absorbers with damping wings, which add power on large scales. We compute their effect using the observational constraints on their abundance as a function of column density. Ignoring their effect leads to an underestimation of the slope of the linear theory power spectrum. The second effect we investigate is that of fluctuations in the ionizing radiation field. For this purpose we use a very large high resolution N-body simulation, which allows us to simulate both the fluctuations in the ionizing radiation and the small scale LyaF within the same simulation. We find an enhancement of power on large scales for quasars and a suppression for galaxies. The strength of the effect rapidly increases with increasing redshift, allowing it to be uniquely identified in cases where it is significant. We develop templates which can be used to search for this effect as a function of quasar lifetime, quasar luminosity function, and attenuation length. Finally, we explore the effects of galactic winds using hydrodynamic simulations. We find the wind effects on the LyaF power spectrum to be be degenerate with parameters related to the temperature of the gas that are already marginalized over in cosmological fits. While more work is needed to conclusively exclude all possible systematic errors, our results suggest that, in the context of data analysis procedures where parameters of the LyaF model are properly marginalized over, the flux power spectrum is a reliable tracer of cosmological information.

We combine the constraints from the recent Ly-alpha forest and bias analysis of the SDSS with previous constraints from SDSS galaxy clustering, the latest supernovae, and WMAP . Combining WMAP and the lya we find for the primordial slope n_s=0.98\pm 0.02. We see no evidence of running, dn/d\ln k=-0.003\pm 0.010, a factor of 3 improvement over previous constraints. We also find no evidence of tensors, r<0.36 (95% c.l.). A positive correlation between tensors and primordial slope disfavors chaotic inflation type models with steep slopes: V \propto \phi^4 is outside the 3-sigma contour. For the amplitude we find sigma_8=0.90\pm 0.03 from the lyaf and WMAP alone. We find no evidence of neutrino mass: for the case of 3 massive neutrino families with an inflationary prior, \sum m_{\nu}<0.42eV and the mass of lightest neutrino is m_1<0.13eV at 95% c.l. For the 3 massless + 1 massive neutrino case we find m_{\nu}<0.79eV for the massive neutrino, excluding at 95% c.l. all neutrino mass solutions compatible with the LSND results. We explore dark energy constraints in models with a fairly general time dependence of dark energy equation of state, finding Omega_lambda=0.72\pm 0.02, w(z=0.3)=-0.98^{+0.10}_{-0.12}, the latter changing to w(z=0.3)=-0.92^{+0.09}_{-0.10} if tensors are allowed. We find no evidence for variation of the equation of state with redshift, w(z=1)=-1.03^{+0.21}_{-0.28}. These results rely on the current understanding of the lyaf and other probes, which need to be explored further both observationally and theoretically, but extensive tests reveal no evidence of inconsistency among different data sets used here.

Galaxy-galaxy lensing has emerged as a powerful probe of the dark matter halos of galaxies, but is subject to contamination if intrinsically aligned satellites of the lens galaxy are used as part of the source sample. We present a measurement of this intrinsic shear using 200,747 lens galaxies from the Sloan Digital Sky Survey (SDSS) spectroscopic sample and a sample of satellites selected using photometric redshifts. The mean intrinsic shear at transverse separations of 30--446$h^{-1}$ kpc is constrained to be $-0.0062<\Delta\gamma<+0.0066$ (99.9 per cent confidence, including identified systematics), which limits contamination of the galaxy-galaxy lensing signal to at most $\sim 15$ per cent on these scales. We present these limits as a function of transverse separation and lens luminosity. We furthermore investigate shear calibration biases in the SDSS, which can also affect galaxy-galaxy lensing, and conclude that the shear amplitude is calibrated to better than 18 per cent. This includes noise-induced calibration biases in the ellipticity, which are small for the sample considered here, but which can be more important if low signal-to-noise or poorly resolved source galaxies are used.

We measure the power spectrum, P_F(k,z), of the transmitted flux in the Ly-alpha forest using 3035 high redshift quasar spectra from the Sloan Digital Sky Survey. This sample is almost two orders of magnitude larger than any previously available data set, yielding statistical errors of ~0.6% and ~0.005 on, respectively, the overall amplitude and logarithmic slope of P_F(k,z). This unprecedented statistical power requires a correspondingly careful analysis of the data and of possible systematic contaminations in it. For this purpose we reanalyze the raw spectra to make use of information not preserved by the standard pipeline. We investigate the details of the noise in the data, resolution of the spectrograph, sky subtraction, quasar continuum, and metal absorption. We find that background sources such as metals contribute significantly to the total power and have to be subtracted properly. We also find clear evidence for SiIII correlations with the Ly-alpha forest and suggest a simple model to account for this contribution to the power. While it is likely that our newly developed analysis technique does not eliminate all systematic errors in the P_F(k,z) measurement below the level of the statistical errors, our tests indicate that any residual systematics in the analysis are unlikely to affect the inference of cosmological parameters from P_F(k,z). These results should provide an essential ingredient for all future attempts to constrain modeling of structure formation, cosmological parameters, and theories for the origin of primordial fluctuations.

We use multi-frequency information in first year WMAP data to search for the Sunyaev-Zeldovich (SZ) effect. WMAP has sufficiently broad frequency coverage to constrain SZ without the addition of higher frequency data: the SZ power spectrum amplitude is expected to increase 50% from W to Q frequency band. This, in combination with the low noise in WMAP, allows us to strongly constrain the SZ contribution. We derive an optimal frequency combination of WMAP cross-spectra to extract SZ in the presence of noise, CMB, and radio point sources, which are marginalized over. We find that the SZ contribution is less than 2% (95% c.l.) at the first acoustic peak in W band. Under the assumption that the removed radio point sources are not correlated with SZ this limit implies sigma_8<1.07 at 95% c.l. We investigate the effect on the cosmological parameters of allowing an SZ component. We run Monte Carlo Markov Chains with and without an SZ component and find that the addition of SZ does not affect any of the cosmological conclusions. We conclude that SZ does not contaminate the WMAP CMB or change cosmological parameters, refuting the recent claims that they may be corrupted.

The existing analysis of WMAP data is based on approximations for the likelihood function, which is likely to be inaccurate on large scales. Here we present exact evaluations of the likelihood of the low multipoles by direct inversion of the theoretical covariance matrix for low resolution WMAP maps. We project out the unwanted galactic contaminants rather than subtract them, which can remove some of the cosmological signal and may lead to a suppression of power. We find an increase in power at low multipoles. For the quadrupole the maximum likelihood values are rather uncertain and vary between 140-220\muK^2. On the other hand, the probability distribution away from the peak is robust and, assuming a uniform prior between 0 an 2000\muK^2, the probability of having the true value above 1200\muK^2 (as predicted by the simplest Lambda CDM model) is 10%, a factor of 2.5 higher than predicted by WMAP likelihood code. We develop a fast likelihood evaluation routine that can be used instead of WMAP routines for low l values. We apply it to the MCMC analysis to compare the cosmological parameters between the two cases. The new analysis of WMAP either alone or jointly with SDSS and VSA reduces the reported 2-sigma evidence for running to less than 1-sigma, giving \alpha_s=-0.022\pm 0.033 for the combined case. The new analysis prefers about 1-sigma lower value of Omega_m, a consequence of an increased ISW contribution required by the increase in the spectrum at low l. These results suggest that the details of foreground removal and full likelihood analysis are important for the parameter estimation from WMAP data and these methods should be particularly useful in the analysis of polarisation, where foreground contamination may be much more severe.

We measure cosmological parameters using the three-dimensional power spectrum P(k) from over 200,000 galaxies in the Sloan Digital Sky Survey (SDSS) in combination with WMAP and other data. Our results are consistent with a ``vanilla'' flat adiabatic Lambda-CDM model without tilt (n=1), running tilt, tensor modes or massive neutrinos. Adding SDSS information more than halves the WMAP-only error bars on some parameters, tightening 1 sigma constraints on the Hubble parameter from h~0.74+0.18-0.07 to h~0.70+0.04-0.03, on the matter density from Omega_m~0.25+/-0.10 to Omega_m~0.30+/-0.04 (1 sigma) and on neutrino masses from <11 eV to <0.6 eV (95%). SDSS helps even more when dropping prior assumptions about curvature, neutrinos, tensor modes and the equation of state. Our results are in substantial agreement with the joint analysis of WMAP and the 2dF Galaxy Redshift Survey, which is an impressive consistency check with independent redshift survey data and analysis techniques. In this paper, we place particular emphasis on clarifying the physical origin of the constraints, i.e., what we do and do not know when using different data sets and prior assumptions. For instance, dropping the assumption that space is perfectly flat, the WMAP-only constraint on the measured age of the Universe tightens from t0~16.3+2.3-1.8 Gyr to t0~14.1+1.0-0.9 Gyr by adding SDSS and SN Ia data. Including tensors, running tilt, neutrino mass and equation of state in the list of free parameters, many constraints are still quite weak, but future cosmological measurements from SDSS and other sources should allow these to be substantially tightened.

We present a detailed analytical study of ultra-relativistic neutrinos in cosmological perturbation theory and of the observable signatures of inhomogeneities in the cosmic neutrino background. We note that a modification of perturbation variables that removes all the time derivatives of scalar gravitational potentials from the dynamical equations simplifies their solution notably. The used perturbations of particle number per coordinate, not proper, volume are generally constant on superhorizon scales. In real space an analytical analysis can be extended beyond fluids to neutrinos. The faster cosmological expansion due to the neutrino background changes the acoustic and damping angular scales of the cosmic microwave background (CMB). But we find that equivalent changes can be produced by varying other standard parameters, including the primordial helium abundance. The low-l integrated Sachs-Wolfe effect is also not sensitive to neutrinos. However, the gravity of neutrino perturbations suppresses the CMB acoustic peaks for the multipoles with l>~200 while it enhances the amplitude of matter fluctuations on these scales. In addition, the perturbations of relativistic neutrinos generate a *unique phase shift* of the CMB acoustic oscillations that for adiabatic initial conditions cannot be caused by any other standard physics. The origin of the shift is traced to neutrino free-streaming velocity exceeding the sound speed of the photon-baryon plasma. We find that from a high resolution, low noise instrument such as CMBPOL the effective number of light neutrino species can be determined with an accuracy of sigma(N_nu) = 0.05 to 0.09, depending on the constraints on the helium abundance.

We use statistical inference theory to explore the constraints from future galaxy weak lensing (cosmic shear) surveys combined with the current CMB constraints on cosmological parameters, focusing particularly on the running of the spectral index of the primordial scalar power spectrum, $\alpha_s$. Recent papers have drawn attention to the possibility of measuring $\alpha_s$ by combining the CMB with galaxy clustering and/or the Lyman-$\alpha$ forest. Weak lensing combined with the CMB provides an alternative probe of the primordial power spectrum. We run a series of simulations with variable runnings and compare them to semi-analytic non-linear mappings to test their validity for our calculations. We find that a ``Reference'' cosmic shear survey with $f_{sky}=0.01$ and $6.6\times 10^8$ galaxies per steradian can reduce the uncertainty on $n_s$ and $\alpha_s$ by roughly a factor of 2 relative to the CMB alone. We investigate the effect of shear calibration biases on lensing by including the calibration factor as a parameter, and show that for our Reference Survey, the precision of cosmological parameter determination is only slightly degraded even if the amplitude calibration is uncertain by as much as 5%. We conclude that in the near future weak lensing surveys can supplement the CMB observations to constrain the primordial power spectrum.

We measure the large-scale real-space power spectrum P(k) using a sample of 205,443 galaxies from the Sloan Digital Sky Survey, covering 2417 square degrees with mean redshift z~0.1. We employ a matrix-based method using pseudo-Karhunen-Loeve eigenmodes, producing uncorrelated minimum-variance measurements in 22 k-bands of both the clustering power and its anisotropy due to redshift-space distortions, with narrow and well-behaved window functions in the range 0.02 h/Mpc < k < 0.3h/Mpc. We pay particular attention to modeling, quantifying and correcting for potential systematic errors, nonlinear redshift distortions and the artificial red-tilt caused by luminosity-dependent bias. Our final result is a measurement of the real-space matter power spectrum P(k) up to an unknown overall multiplicative bias factor. Our calculations suggest that this bias factor is independent of scale to better than a few percent for k<0.1h/Mpc, thereby making our results useful for precision measurements of cosmological parameters in conjunction with data from other experiments such as the WMAP satellite. As a simple characterization of the data, our measurements are well fit by a flat scale-invariant adiabatic cosmological model with h Omega_m =0.201+/- 0.017 and L* galaxy sigma_8=0.89 +/- 0.02 when fixing the baryon fraction Omega_b/Omega_m=0.17 and the Hubble parameter h=0.72; cosmological interpretation is given in a companion paper.

Gravity waves (GW) in the early universe generate B-type polarization in the cosmic microwave background (CMB), which can be used as a direct way to measure the energy scale of inflation. Gravitational lensing contaminates the GW signal by converting the dominant E polarization into B polarization. By reconstructing the lensing potential from CMB itself one can decontaminate the B mode induced by lensing. We present results of numerical simulations of B mode delensing using quadratic and iterative maximum-likelihood lensing reconstruction methods as a function of detector noise and beam. In our simulations we find the quadratic method can reduce the lensing B noise power by up to a factor of 7, close to the no noise limit. In contrast, the iterative method shows significant improvements even at the lowest noise levels we tested. We demonstrate explicitly that with this method at least a factor of 40 noise power reduction in lensing induced B power is possible, suggesting that T/S=10^-6 may be achievable in the absence of sky cuts, foregrounds, and instrumental systematics. While we do not find any fundamental lower limit due to lensing, we find that for high-sensitivity detectors residual lensing noise dominates over the detector noise.

Gravitational lensing of the cosmic microwave background (CMB) polarization field has been recognized as a potentially valuable probe of the cosmological density field. We apply likelihood-based techniques to the problem of lensing of CMB polarization and show that if the B-mode polarization is mapped, then likelihood-based techniques allow significantly better lensing reconstruction than is possible using the previous quadratic estimator approach. With this method the ultimate limit to lensing reconstruction is not set by the lensed CMB power spectrum. Second-order corrections are known to produce a curl component of the lensing deflection field that cannot be described by a potential; we show that this does not significantly affect the reconstruction at noise levels greater than 0.25 microK arcmin. The reduction of the mean squared error in the lensing reconstruction relative to the quadratic method can be as much as a factor of two at noise levels of 1.4 microK arcmin to a factor of ten at 0.25 microK arcmin, depending on the angular scale of interest.

We study the variation of the dark matter mass fraction of elliptical galaxies as a function of their luminosity, stellar mass, and size using a sample of 29,469 elliptical galaxies culled from the Sloan Digital Sky Survey. We model ellipticals as a stellar Hernquist profile embedded in an adiabatically compressed dark matter halo. This model allows us to estimate a dynamical mass ($M_{dynm}$) at the half-light radius from the velocity dispersion of the spectra, and to compare these to the stellar mass estimates ($M_{*}$) from Kauffmann et al (2003). We find that $M_{*}/L$ is independent of luminosity, while $M_{dynm}/L$ increases with luminosity, implying that the dark matter fraction increases with luminosity. We also observe that at a fixed luminosity or stellar mass, the dark matter fraction increases with increasing galaxy size or, equivalently, increases with decreasing surface brightness: high surface brightness galaxies show almost no evidence for dark matter, while in low surface brightness galaxies, the dark matter exceeds the stellar mass at the half light radius. We relate this to the fundamental plane of elliptical galaxies, suggesting that the tilt of this plane from simple virial predictions is due to the dark matter in galaxies. We find that a simple model where galaxies are embedded in dark matter halos and have a star formation efficiency independent of their surface brightness explains these trends. We estimate the virial mass of ellipticals as being approximately 7-30 times their stellar mass, with the lower limit suggesting almost all of the gas within the virial radius is converted into stars.

We investigate the promise of the Ly-alpha forest for high precision cosmology in the era of the Sloan Digital Sky Survey using low order N-point statistics. We show that with the existing data one can determine the amplitude, slope and curvature of the slope of the matter power spectrum with a few percent precision. Higher order statistics such as the bispectrum provide independent information that can confirm and improve upon the statistical precision from the power spectrum alone. The achievable precision is comparable to that from the cosmic microwave background with upcoming satellites, and complements it by measuring the power spectrum amplitude and shape at smaller scales. Since the data cover the redshift range 2<z<4, one can also extract the evolution of the growth factor and Hubble parameter over this range, and provide useful constraints on the presence of dark energy at z>2.

We compare three independent, cosmological linear perturbation theory codes to asses the level of agreement between them and to improve upon it by investigating the sources of discrepancy. By eliminating the major sources of numerical instability the final level of agreement between the codes was improved by an order of magnitude. The relative error is now below 0.1% for the dark matter power spectrum. For the cosmic microwave background anisotropies the agreement is below the sampling variance up to l=3000, with close to 0.1% accuracy reached over most of this range of scales. The same level of agreement is also achieved for the polarization spectrum and the temperature-polarization cross-spectrum. Linear perturbation theory codes are thus well prepared for the present and upcoming high precision cosmological observations.

The WMAP team has recently highlighted the usefulness of combining the Ly-alpha forest constraints with those from the cosmic microwave background (CMB). This combination is particularly powerful as a probe of the primordial shape of the power spectrum. Converting between the Ly-alpha forest observations and the linear mass power spectrum requires a careful treatment of nuisance parameters and modeling with cosmological simulations. We point out several issues which lead to an expansion of the errors, the two most important being the range of cosmological parameters explored in simulations and the treatment of the mean transmitted flux constraints. We employ a likelihood calculator for the current Ly-alpha data set based on an extensive 6-dimensional grid of simulations. We show that the current uncertainties in the mean transmission and the flux power spectrum define a degeneracy line in the amplitude-slope plane. The CMB degeneracy due to the primordial power spectrum shape follows a similar relation in this plane. This weakens the statistical significance of the primordial power spectrum shape constraints based on combined CMB+Ly-alpha forest analysis. Using the current data the simplest n=1 scale invariant model with dn/dln k=0 and no tensors has a Delta chi^2=4 compared to the best fitting model in which these 3 parameters are free. Current data therefore do not require relaxing these parameters to improve the fit.

We investigate biases induced by the conversion between the observed image shape to shear distortion in current weak lensing analysis methods. Such overall calibration biases cannot be detected by the standard tests such as E/B decomposition or calibration with stars. We find that the non-Gaussianity of point spread function has a significant effect and can lead to up to 15 per cent error on the linear amplitude of fluctuations sigma_8 depending on the method of analysis. This could explain some of the discrepancies seen in recent amplitude determinations from weak lensing. Using an elliptical Laguerre expansion method we develop a re-Gaussianization method which reduces the error to calibration error of order 1 per cent even for poorly resolved galaxies. We also discuss a new type of shear selection bias which results in up to roughly 8 percent underestimation of the signal. It is expected to scale with redshift, inducing errors in the growth factor extraction if not properly corrected for. Understanding and correcting for such effects is crucial if weak lensing is to become a high precision probe of cosmology.

We explore the connection between halo concentration and the dark matter power spectrum using the halo model. We fit halo model parameters to non-linear power spectra over a large range of cosmological models. We find that the non-linear evolution of the power spectrum generically prefers the concentration at non-linear mass scale to decrease with the effective slope of the linear power spectrum, in agreement with the direct analysis of the halo structure in different cosmological models. Using these analyses, we compute the predictions for non-linear power spectrum beyond the current resolution of N-body simulations. We find that the halo model predictions are generically below the analytical non-linear models, suggesting that the latter may overestimate the amount of power on small scales.

Statistical properties of gas absorption in high redshift quasars such as power spectrum and bispectrum allow one to determine the evolution of structure over the redshift range 2<z<4. Sloan Digital Sky Survey (SDSS) will measure around 10,000 quasar spectra in this redshift range and will allow one to determine the growth factor with a few percent accuracy. This allows one to extend the studies of dark energy to higher redshift and determine the presence of dark energy if Omega_de>0.1-0.2 at z>2. In combination with low redshift studies one can place useful limits on the time evolution of the equation of state.

We present a survey of the cosmological applications of the next generation of weak lensing surveys, paying special attention to the computational challenges presented by the number of galaxies, $N_{gal} ~$ 10$^{5}$. We focus on optimal methods with no pixelization and derive a multigrid $P^3M$ algorithm that performs the relevant computations in $O(N_{gal} \log N_{gal})$ time. We test the algorithm by studying three applications of weak lensing surveys - convergence map reconstruction, cluster detection and $E$ and $B$ power spectrum estimation using realistic 1 deg^{2} simulations derived from N-body simulations. The map reconstruction is able to reconstruct large scale features without artifacts. Detecting clusters using only weak lensing is difficult because of line of sight contamination and noise, with low completeness if one desires low contamination of the sample. A power spectrum analysis of the convergence field is more promising and we are able to reconstruct the convergence spectrum with no loss of information down to the smallest scales. The numerical methods used here can be applied to other data sets with same $O(N\log N)$ scaling and can be generalised to a sphere.

The Deep Lens Survey (DLS) is a deep BVRz' imaging survey of seven 2x2 degree fields, with all data to be made public. The primary scientific driver is weak gravitational lensing, but the survey is also designed to enable a wide array of other astrophysical investigations. A unique feature of this survey is the search for transient phenomena. We subtract multiple exposures of a field, detect differences, classify, and release transients on the Web within about an hour of observation. Here we summarize the scientific goals of the DLS, field and filter selection, observing techniques and current status, data reduction, data products and release, and transient detections. Finally, we discuss some lessons which might apply to future large surveys such as LSST.

The angular power spectrum of the SZ effect, C_l, is a powerful probe of cosmology. It is easier to detect than individual clusters in the field, is insensitive to observational selection effects and does not require a calibration between cluster mass and flux, reducing the systematic errors which dominate the cluster-counting constraints. It receives a dominant contribution from cluster region between 20-40% of the virial radius and is thus insensitive to the poorly known gas physics in the cluster centre, such as cooling or (pre)heating. In this paper we derive a refined analytic prediction for C_l using the universal gas-density and temperature profile and the dark-matter halo mass function. The predicted C_l has no free parameters and fits all of the published hydrodynamic simulation results to better than a factor of two around l=3000. We find that C_l scales as (sigma_8)^7 times (Omega_b h)^2 and is almost independent of all of the other cosmological parameters. This differs from the local cluster abundance studies, which give a relation between sigma_8 and Omega_m. We also compute the covariance matrix of C_l using the halo model and find a good agreement relative to the simulations. We estimate how well we can determine sigma_8 with sampling-variance-limited observations and find that for a several-square-degree survey with 1-2 arcminute resolution one should be able to determine sigma_8 to within a few percent, with the remaining uncertainty dominated by theoretical modelling. If the recent excess of the CMB power on small scales reported by the CBI experiment is due to the SZ effect, then we find sigma_8(Omega_b h/0.029)^0.3 = 1.04 +- 0.12 at the 95% confidence level (statistical) and with a residual 10% systematic (theoretical) uncertainty.

Future experiments will produce high-resolution temperature maps of the cosmic microwave background (CMB) and are expected to reveal the signature of gravitational lensing by intervening large-scale structures. We construct all-sky maximum-likelihood estimators that use the lensing effect to estimate the projected density (convergence) of these structures, its power spectrum, and cross-correlation with other observables. This contrasts with earlier quadratic-estimator approaches that Taylor-expanded the observed CMB temperature to linear order in the lensing deflection angle; these approaches gave estimators for the temperature-convergence correlation in terms of the CMB three-point correlation function and for the convergence power spectrum in terms of the CMB four-point correlation function, which can be biased and non-optimal due to terms beyond the linear order. We show that for sufficiently weak lensing, the maximum-likelihood estimator reduces to the computationally less demanding quadratic estimator. The maximum likelihood and quadratic approaches are compared by evaluating the root-mean-square (RMS) error and bias in the reconstructed convergence map in a numerical simulation; it is found that both the RMS errors and bias are of order 1 percent for the case of Planck and of order 10--20 percent for a 1 arcminute beam experiment. We conclude that for recovering lensing information from temperature data acquired by these experiments, the quadratic estimator is close to optimal, but further work will be required to determine whether this is also the case for lensing of the CMB polarization field.

We present a theoretical analysis of galaxy-galaxy lensing in the context of halo models with CDM motivated dark matter profiles. The model enables us to separate between the central galactic and noncentral group/cluster contributions. We apply the model to the recent SDSS measurements with known redshifts and luminosities of the lenses. This allows one to accurately model the mass distribution of a local galaxy population around and above $L_{\star}$. We find that virial mass of L* galaxy is M*=(5-10)x10^{11}h^{-1}M_{\sun}, depending on the color of the galaxy. This value varies significantly with galaxy morphology with M* for late types being a factor of 10 lower in u', 7 in g' and a factor of 2.5-3 lower in r', i' and z' relative to early types. Fraction of noncentral galaxies in groups and clusters is estimated to be below 10% for late types and around 30% for early types. Using the luminosity dependence of the signal we find that for early types the virial halo mass M scales with luminosity as M \propto L^1.4 in red bands above L*. This shows that the virial mass to light ratio is increasing with luminosity for galaxies above L*, as predicted by theoretical models. The virial mass to light ratio in i' band is 17(45)hM_{\sun}/L_{\sun} at L* for late (early) types. Combining this result with cosmological baryon fraction one finds that 0.7(0.25)h^{-1}\Upsilon_i\Omega_m/12\Omega_b of baryons within the virial radius are converted to stars at L*, where \Upsilon_i is the stellar mass to light ratio in i' band. This indicates that both for early and late type galaxies around L* a significant fraction of all the baryons in the halo is transformed into stars.

We place limits on the mean density of the universe and the slope of the linear power spectrum around a megaparsec scale by comparing the universal mass function to the observed luminosity function. Numerical simulations suggest that the dark matter halo mass function at small scales depends only on Omega_m(n_eff+3) independent of the overall power spectrum normalization. Matching the halo abundance to the observed luminosity function requires knowing the relation between the virial mass and luminosity (separately for early and late type galaxies) and the fraction of galaxies that reside in larger halos such as groups and clusters, all of which can be extracted from the galaxy-galaxy lensing. We apply the recently derived values from SDSS and find Omega_m(n_eff+3)= (0.15 \pm 0.05)/(1-f_dh), where f_dh accounts for the possibility that some fraction of halos may be dark or without a bright central galaxy. A model with Omega_m=0.25 and primordial n=0.8 or with Omega_m=0.2 and n=1 agrees well with these constraints even in the absence of dark halos, although with the current data somewhat higher values for Omega_m and n are also acceptable.

Observations of galaxy-galaxy lensing from Sloan Digital Sky Survey (SDSS) are combined with the Tully-Fisher and fundamental plane relations to derive constraints on galactic halo profiles.We show that both for early and late type galaxies around L* the rotation velocity drops significantly from its peak value at the optical radius to the virial radius, v_opt/v_200 \sim 1.8 with about 20% uncertainty. Such a drop is expected in models in which the halo profile is very concentrated, so that it declines steeper than isothermal at large radii. This large drop can be explained as a result of both a concentrated dark matter profile and a significant stellar contribution to the rotation velocity at the optical radii. We model the stellar component with a thin rotationally supported disk or a Hernquist profile and use adiabatic dark matter response model to place limits on the halo concentration as a function of the stellar mass to light ratio. For reasonable values of the latter we find concentrations consistent with CDM predictions, suggesting there is no evidence for low concentrations for the majority of halos in the universe. We also discuss the origin of Faber-Jackson relation L \propto sigma^4 in light of L \propto v_200^2.5 relation found for early type galaxies from galaxy-galaxy lensing. This leads to a decrease in v_opt/v_{200} with luminosity above L*, so that at 7L_* the ratio is 1.4. This is expected from the fundamental plane relation and implies that relations such as Tully-Fisher and Faber-Jackson are not simply relations between the mass of dark matter halo and galaxy luminosity, but are also significantly influenced by the baryonic effects on the rotation velocity at optical radii.

Abundance of rich clusters in local universe is currently believed to provide the most robust normalization of power spectrum at a scale of 10 Mpc. This normalization depends very sensitively on the calibration between virial mass M and temperature T, which is usually taken from simulations. Uncertainties in the modelling, such as gas cooling and heating, can lead to a factor of two variations in the normalization and are thus not very reliable. Here we use instead an empirical M_{500}-T relation derived from X-ray mass determinations to calibrate the method. We use results from dark matter simulations to relate the virial mass function to the mass function at observed M_{500}. We find that the best fitted value in flat models is sigma_8=(0.7 \pm 0.06) (\Omega_m/0.35)^{-0.44}(\Gamma/0.2)^{0.08}, where only the statistical error is quoted. This is significantly lower than previously obtained values from the local cluster abundance. This lower value for sigma_8 is in a better agreement with cosmic microwave background and large scale structure constraints and helps alleviate small scale problems of CDM models. Presently the systematic uncertainties in the mass determination are still large, but ultimately this method should provide a more reliable way to normalize the M-T relation. This can be achieved by obtaining a larger sample of well measured cluster masses out to a significant fraction of virial radius with BeppoSAX, Chandra and XMM-Newton.

We present new measurements of scaling laws relating the luminosity of galaxies to the amplitude and shape of their dark matter halos. Early imaging and spectroscopic data from the Sloan Digital Sky Survey are used to make weak lensing measurements of the surface mass density contrast Delta Sigma_+ around classes of lens objects. This surface mass density contrast as a function of radius is a measure of the galaxy-mass correlation function (GMCF). Because spectroscopic redshifts are available for all lens objects, the mass and distance scales are well constrained. The GMCF measured around ~31,000 lenses is well fit by a power law of the form Delta Sigma_+ = (2.5+0.7-0.6) (R/1 Mpc)^{-0.8+-0.2} h M_sun pc^-2. We compare this GMCF to galaxy luminosity, type, and environment, and find that it varies strongly with all three. We quantify these variations by comparing the normalization of a fit to the inner 260 h^-1 kpc, M_260, to the galaxy luminosity. While M_260 is not strongly related to luminosity in bluest band u', there is a simple, linear relation between M_260 and luminosity in redder bands (g', r', i', and z'). We test the universality of these mass-to-light scalings by independently measuring them for spiral and elliptical galaxies,and for galaxies in a variety of environments. We find remarkable consistency in these determinations in the red bands, especially i' and z'. This consistency across a wide range of systems suggests that the measured scaling represents an excellent cosmic average, and that the integrated star formation history of galaxies is strongly related to the dark matter environments in which they form.

We present an analytic approach to predict gas density and temperature profiles in dark matter haloes. We assume that the gas density profile traces the dark matter density profile in outer parts of the haloes, as suggested by many hydrodynamic simulations. Under this assumption, the hydrostatic equilibrium uniquely fixes the two free parameters in the model, the mass-temperature normalization and the polytropic index, that determine the temperature profile. This enables us to predict a universal gas profile from any universal dark matter profile. Our results show that gas tracing dark matter in the outer parts of the haloes is inconsistent with gas being isothermal; on the contrary, it requires temperature to decrease slowly with radius, in agreement with observations. We compare our predictions for X-ray surface brightness profiles of the haloes and the mass-temperature relation with observations. We find that they are generally in a good agreement. We compare the universal profile with the beta profile and find that, although the beta profile gives a reasonable fit to our predicted profiles, the deviation from it can explain many of the observed trends, once we take into account the observational selection effects. Our model predicts that the mass-temperature relation does not follow the self-similar relation because of the mass-dependent halo concentration. We also predict surface brightness profiles of the Sunyaev-Zel'dovich (SZ) effect. We find that fitted to the beta profile the core radii and beta inferred from the SZ effect are systematically larger than those from the X-ray measurement.

We analyze scale dependence of redshift space bias $b$ and $\beta \equiv \Omega_m^{0.6}/b$ in the context of the halo model. We show that linear bias is a good approximation only on large scales, for $k<0.1h$Mpc$^{-1}$. On intermediate scales the virial motions of the galaxies cause a suppression of the power spectrum relative to the linear one, which differs from the same effect in dark matter. This suppression can potentially mimic the effect of massive neutrinos and the degeneracy can only be broken if the power spectrum is measured for $k \ll 0.1h$Mpc$^{-1}$. Different methods to determine $\beta$ converge for $k<0.1h$Mpc$^{-1}$, but give drastically different results on smaller scales, which explains some of the trends observed in the real data. We also asses the level of stochasticity by calculating the cross-correlation coefficient between the reconstructed velocity field divergence and the galaxies and show that the two fields decorrelate for $k>0.1h$Mpc$^{-1}$. Most problematic are galaxies predominantly found in groups and clusters, such as bright, red or elliptical galaxies, where we find poor convergence to a constant bias or $\beta$ even on large scales.

We investigate correlations between the long wavelength fluctuations and the small scale power in the Lyman alpha forest. We show that such correlations can be used to discriminate between fluctuations induced by large scale structure and those produced by non-gravitational processes such as fluctuations in the continuum of the quasar or in the temperature of the gas. The correlations observed in Q1422+231 are in agreement with the predictions of numerical simulations, indicating that non-gravitational fluctuations on large scales have to be small compared those induced by the large scale structure of the universe, contributing less than 10 % (95 % confidence) of the observed power. We also show the sensitivity of such statistics to the equation of state of the gas and its mean temperature.

We report a tentative detection of spin correlations in the Tully catalogue of nearby galaxies. We define a simple but nontrivial spin correlation function, and find an analytic estimate of it in the frame of the linear perturbation theory. Then, we present the observed spin correlation signal from the Tully galaxies with error bars. The three dimensional spin correlation turns out to be significant at the 97% confidence level, detected out to a few $h^{-1}$ Mpc. This observed correlation is consistent with the theoretical prediction based on the gravitational instability picture of galaxy formation. An analysis of systematic errors is also presented. The observed strength of correlation may be sufficient to significantly affect blank field of weak lensing searches.

We use semi-analytic models of galaxy formation combined with high resolution N-body simulations to make predictions for galaxy-dark matter correlations and apply them to galaxy-galaxy lensing. We analyze cross-correlation spectra between the dark matter and different galaxy samples selected by luminosity, color or star formation rate. We compare the predictions to the recent detection by SDSS. We show that the correlation amplitude and the mean tangential shear depend strongly on the luminosity of the sample on scales below 1 Mpc, reflecting the correlation between the galaxy luminosity and the halo mass. The cross-correlation cannot however be used to infer the halo profile directly because different halo masses dominate on different scales and because not all galaxies are at the centers of the corresponding halos. We compute the redshift evolution of the cross-correlation amplitude and compare it to those of galaxies and dark matter. We also compute the galaxy-dark matter correlation coefficient and show it is close to unity on scales above r > 1 Mpc for all considered galaxy types. This would allow one to extract the bias and the dark matter power spectrum on large scales from the galaxy and galaxy-dark matter correlations.

We present new methods to minimize the systematic and random errors for measuring the transmission power spectrum from the Lyman-alpha forest. Sources of systematic errors explored include metal line contamination and continuum-fitting. We advocate the technique of trend-removal in place of traditional continuum-fitting -- here, a spectrum is normalized by its (smoothly varying) mean rather than its continuum -- this method is easily automated and removes biases introduced by continuum-fitting. Trend- removal can be easily applied to spectra where continuum-fitting is difficult, such as when the resolution or signal-to-noise is low, or for spectra at high redshifts. Furthermore, a measurement of the continuum power spectrum using trend-removal, from either low redshift quasar spectra or the red-side of Lyman-alpha, allows in principle the removal of spurious power introduced by the continuum and thereby expanding scales probed to larger ones. We also derive expressions for the shot-noise bias and variance of the power spectrum estimate, taking into account the non-Poissonian nature of the shot-noise and the non-Gaussianity of the cosmic fluctuations. An appropriate minimum variance weighting of the data is given. Finally, we give practical suggestions on observing strategy: the desired resolution and S/N for different purposes, and how to distribute one's finite observing time among quasar targets. Also discussed is the quasar spectroscopic study of the Sloan Digital Sky Survey, which has the potential to measure the power spectrum at z ~ 2-4 accurate to better than 1 % per mode -- the techniques presented here will be useful for tackling the anticipated issues of shot-noise and continuum contamination.

We investigate an analytic model to compute nonlinear power spectrum of dark matter, galaxies and their cross-correlation. The model is based on Press-Schechter halos, which cluster and have realistic dark matter profiles. The total power spectrum is a sum of two contributions, one from correlations betwen the halos and one from correlations within the same halo. We show that such a model can give dark matter power spectra which match well with the results of N-body simulations, provided that concentration parameter decreases with the halo mass. Galaxy power spectrum differs from dark matter power spectrum because pair weighted number of galaxies increases less rapidly than the halo mass, as predicted by theoretical models and observed in clusters. In this case the resulting power spectrum becomes a power law with the slope closed to the observed. Such a model also predicts a later onset of nonlinear clustering compared to the dark matter, which is needed to reconcile the CDM models with the data. Generic prediction of this model is that bias is scale dependent and nonmonotonic. For red or elliptical galaxies bias in power spectrum may be scale dependent even on very large scales. Our predictions for galaxy-dark matter correlations, which can be observed through the galaxy-galaxy lensing, show that these cannot be interpreted simply as an average halo profile of a typical galaxy, because different halo masses dominate at different scales and because larger halos host more than one galaxy. We discuss the prospects of using cross-correlations in combination with galaxy clustering to determine the dark matter power spectrum (ABRIDGED).

We use moving mesh hydrodynamical simulations to make maps of Sunyaev-Zeldovich effect. We present these maps for several cosmological models and explore their lowest moments. We find that the first moment, the mean Compton $y$ parameter, is typically between $1-2\times 10^{-6}$ for cluster abundance normalized models, the lower value corresponding to the high density models, and scales as $\sigma_8^{3-4}$. Rms fluctuations at 10' scale have an amplitude $ \Delta T/T \sim 1-3 \times 10^{-6}$ in the Rayleigh-Jeans regime. The amplitude of the power spectrum strongly depends on the power spectrum normalization and scales as $\sigma_8^{6-9}$. On smaller scales ($l>1000$) the spectrum is dominated by halos below $10^{13}M_{\sun}$ and so is sensitive to the thermal history of galactic halo gas. On larger scales ($l<1000$) the power spectrum is less sensitive to nongravitational energy injection, but becomes very noisy, with large field to field variations in the power spectrum caused by rare bright sources in the maps, which dominate in the spectrum over the large scale structure correlations. Cross-correlation power spectrum with weak lensing or projected galaxy distribution is significant and the cross-correlation coefficient is around 0.5 over a wide range of scales. Comparison with Press-Schechter predictions gives very good agreement for all the statistics, indicating that there is no significant contribution to SZ from non-virialized structures. The one point distribution function shows clear deviations from gaussianity and can be well-approximated as log-normal on small scales.

Matter inhomogeneities along the line of sight deflect the cosmic microwave background (CMB) photons originating at the last scattering surface at redshift $z \sim 1100$. These distortions modify the pattern of CMB polarization. We identify specific combinations of Stokes $Q$ and $U$ parameters that correspond to spin 0,$\pm 2$ variables and can be used to reconstruct the projected matter density. We compute the expected signal to noise as a function of detector sensitivity and angular resolution. With Planck satellite the detection would be at a few $\sigma$ level. Several times better detector sensitivity would be needed to measure the projected dark matter power spectrum over a wider range of scales, which could provide an independent confirmation of the projected matter power spectrum as measured from other methods.

We investigate weak lensing by large-scale structure using ray tracing through N-body simulations. Photon trajectories are followed through high resolution simulations of structure formation to make simulated maps of shear and convergence on the sky. Tests with varying numerical parameters are used to calibrate the accuracy of computed lensing statistics on angular scales from about 1 arcminute to a few degrees. Various aspects of the weak lensing approximation are also tested. For fields a few degrees on a side the shear power spectrum is almost entirely in the nonlinear regime and agrees well with nonlinear analytical predictions. Sampling fluctuations in power spectrum estimates are investigated by comparing several ray tracing realizations of a given model. For survey areas smaller than a degree on a side the main source of scatter is nonlinear coupling to modes larger than the survey. We develop a method which uses this effect to estimate the mass density parameter Omega from the scatter in power spectrum estimates for subregions of a larger survey. We show that the power spectrum can be measured accurately from realistically noisy data on scales corresponding to 1-10 Mpc/h. Non-Gaussian features in the one point distribution function of the weak lensing convergence (reconstructed from the shear) are also sensitive to Omega. We suggest several techniques for estimating Omega in the presence of noise and compare their statistical power, robustness and simplicity. With realistic noise Omega can be determined to within 0.1-0.2 from a deep survey of several square degrees.

We extend the cosmological linear perturbation theory code CMBFAST to closed geometries. This completes the implementation of CMBFAST to all types of geometries and allows the user to perform an unlimited search in the parameter space of models. This will be specially useful for placing confidence limits on cosmological parameters from existing and future data. We discuss some of the technical issues regarding the implementation.

Due to the effects of gravitational lensing, the magnification distribution of high redshift supenovae can be a powerful discriminator between smooth dark matter and dark matter consisting of compact objects. We use high resolution N-body simulations in combination with the results of simulations with compact objects to determine the magnification distribution for a Universe with an arbitrary fraction of the dark matter in compact objects. Using these distributions we determine the number of type Ia SNe required to measure the fraction of matter in compact objects. It is possible to determine a 20% fraction of matter in compact objects with 100-400 well measured SNe at $z \sim 1$, assuming the background cosmological model is well determined.

We show that clusters of galaxies induce step-like wiggles on top of the cosmic microwave background (CMB). The direction of the wiggle is parallel to the large scale gradient of CMB allowing one to isolate the effect from other small scale fluctuations. The effect is sensitive to the deflection angle rather than its derivative (shear or magnification) and is thus tracing outer parts of the cluster with higher sensitivity than some other methods. A typical amplitude of the effect is $10\mu K (\sigma_v/1400 kms^{-1})^2$ where $\sigma_v$ is the velocity dispersion of the cluster and several $\mu K$ signals extend out to a fraction of a degree. We derive the expressions for the temperature profile for several simple parameterized cluster models and identify some degeneracies between parameters. Finally, we discuss how to separate this signal from other imprints on CMB using custom designed filters. Detection of this effect is within reach of the next generation of small scale CMB telescopes and could provide information about the cluster density profile beyond the virial radius.

Selected results on estimating cosmological parameters from simulated weak lensing data with noise are presented. Numerical simulations of ray tracing through N-body simulations have been used to generate shear and convergence maps due to lensing by large-scale structure. Noise due to the intrinsic ellipticities of a finite number of galaxies is added. In this contribution we present our main results on estimation of the power spectrum and density parameter Omega from weak lensing data on several degree sized fields. We also show that there are striking morphological differences in the weak lensing maps of clusters of galaxies formed in models with different values of Omega.

We show that time dependent gravitational potential can be directly detected from the cosmic microwave background (CMB) anisotropies. The signature can be measured by cross-correlating the CMB with the projected density field reconstructed from the weak lensing distortions of the CMB itself. The cross-correlation gives a signal whenever there is a time dependent gravitational potential. This method traces dark matter directly and has a well defined redshift distribution of the window projecting over the density perturbations, thereby avoiding the problems plaguing other proposed cross-correlations. We show that both MAP and Planck will be able to probe this effect for observationally relevant curvature and cosmological constant models, which will provide additional constraints on the cosmological parameters.

Gravitational lensing distorts the cosmic microwave background (CMB) anisotropies and imprints a characteristic pattern onto it. The distortions depend on the projected matter density between today and redshift $z \sim 1100$. In this paper we develop a method for a direct reconstruction of the projected matter density from the CMB anisotropies. This reconstruction is obtained by averaging over quadratic combinations of the derivatives of CMB field. We test the method using simulations and show that it can successfully recover projected density profile of a cluster of galaxies if there are measurable anisotropies on scales smaller than the characteristic cluster size. In the absence of sufficient small scale power the reconstructed maps have low signal to noise on individual structures, but can give a positive detection of the power spectrum or when cross correlated with other maps of large scale structure. We develop an analytic method to reconstruct the power spectrum including the effects of noise and beam smoothing. Tests with Monte Carlo simulations show that we can recover the input power spectrum both on large and small scales, provided that we use maps with sufficiently low noise and high angular resolution.

We propose a method to extract the projected power spectrum of density perturbations from the distortions in the cosmic microwave background (CMB). The distortions are imprinted onto the CMB by the gravitational lensing effect and can be extracted using a combination of products of CMB derivatives. We show that future CMB experiments such as Planck will be able to extract the power spectrum with high statistical significance over two orders of magnitude in angle. The method proposed here traces dark matter directly to higher redshift (up to $z \sim 1100$) and larger scale (few Gpc) than any other currently known method. It also traces large scale structure in the linear regime, allowing simple interpretation in terms of cosmological models. By providing additional and complementary information to the one from the primary CMB analysis it will strengthen further the scientific return of future CMB experiments.

We generalize the total angular momentum method for computing Cosmic Microwave Background anisotropies to Friedman-Robertson-Walker (FRW) spaces with arbitrary geometries. This unifies the treatment of temperature and polarization anisotropies generated by scalar, vector and tensor perturbations of the fluid, seed, or a scalar field, in a universe with constant comoving curvature. The resulting formalism generalizes and simplifies the calculation of anisotropies and, in its integral form, allows for a fast calculation of model predictions in linear theory for any FRW metric.

We discuss statistical and physical properties of cosmic microwave background polarization, both in Fourier and in real space. The latter allows for a more intuitive understanding of some of the geometric signatures. We present expressions that relate electric and magnetic type of polarization to the measured Stokes parameters in real space and discuss how can be constructed locally. We discuss necessary conditions to create polarization and present simulated maps and correlation functions for some typical models.

We use numerical simulations of ray tracing through N-body simulations to investigate weak lensing by large-scale structure. These are needed for testing the analytic predictions of two-point correlators, to set error estimates on them and to investigate nonlinear gravitational effects in the weak lensing maps. On scales larger than 1 degree gaussian statistics suffice and can be used to estimate the sampling, noise and aliasing errors on the measured power spectrum. For this case we describe a minimum variance inversion procedure from the 2-d to 3-d power spectrum and discuss a sparse sampling strategy which optimizes the signal to noise on the power spectrum. On degree scales and smaller the shear and convergence statistics lie in the nonlinear regime and have a non-gaussian distribution. For this regime ray tracing simulations are useful to provide reliable error estimates and calibration of the measurements. We show how the skewness and kurtosis can in principle be used to probe the mean density in the universe, but are sensitive to sampling errors and require large observed areas. The probability distribution function is likely to be more useful as a tool to investigate nonlinear effects. In particular, it shows striking differences between models with different values of the mean density $\Omega_m$.

We investigate the effect of gravitational lensing by matter distribution in the universe on the cosmic microwave background (CMB) polarization power spectra and temperature-polarization cross-correlation spectrum. As in the case of temperature spectrum gravitational lensing leads to smoothing of narrow features and enhancement of power on the damping tail of the power spectrum. Because acoustic peaks in polarization spectra are narrower than in the temperature spectrum the smoothing effect is significantly larger and can reach up to 10\% for $l<1000$ and even more above that. A qualitatively new feature is the generation of $B$ type polarization even when only $E$ is intrinsically present, such as in the case of pure scalar perturbations. This may be directly observed with Planck and other future small scale polarization experiments. The gravitational lensing effect is incorporated in the new version (2.4) of CMBFAST code.

Large-scale structure distorts the images of background galaxies, which allows one to measure directly the projected distribution of dark matter in the universe and determine its power spectrum. Here we address the question of how to extract this information from the observations. We derive minimum variance estimators for projected density reconstruction and its power spectrum and apply them to simulated data sets, showing that they give a good agreement with the theoretical minimum variance expectations. The same estimator can also be applied to the cluster reconstruction, where it remains a useful reconstruction technique, although it is no longer optimal for every application. The method can be generalized to include nonlinear cluster reconstruction and photometric information on redshifts of background galaxies in the analysis. We also address the question of how to obtain directly the 3-d power spectrum from the weak lensing data. We derive a minimum variance quadratic estimator, which maximizes the likelihood function for the 3-d power spectrum and can be computed either from the measurements directly or from the 2-d power spectrum. The estimator correctly propagates the errors and provides a full correlation matrix of the estimates. It can be generalized to the case where redshift distribution depends on the galaxy photometric properties, which allows one to measure both the 3-d power spectrum and its time evolution.

We present a unified approach to the problems of reconstruction of large-scale structure distribution in the universe and determination of the underlying power spectrum. These have often been treated as two separate problems and different analysis techniques have been developed for both. We show that there exists a simple relation between the optimal solutions to the two problems, allowing to solve for both within the same formalism. This allows one to apply computational techniques developed for one method to the other, which often leads to a significant reduction in the computational time. It also provides a self consistent treatment of linear reconstruction by optimally computing the power spectrum from the data itself.

We use a high-accuracy computational code to investigate the precision with which cosmological parameters could be reconstructed by future cosmic microwave background (CMB) experiments, in particular the two satellite missions MAP and Planck Surveyor (COBRAS/SAMBA). We identify several parameter combinations that could be determined with a few percent accuracy with MAP and the Planck Surveyor, as well as some degeneracies among the parameters that cannot be accurately resolved with the temperature data alone. These degeneracies can be broken by other astronomical measurements. Polarization measurments can significantly enhance the science return of both missions by allowing accurate determination of cosmological parameters, by enabling the detection of gravity waves and by probing the ionization history of the universe. We also address the question of how gaussian the likelihood function is around the maximum and whether gravitational lensing changes the constraints.

We present an efficient method to compute CMB anisotropies in non-flat universes. First we derive the Boltzmann equation for cosmic microwave background temperature and polarization fluctuations produced by scalar perturbations in a general Robertson-Walker universe. We then apply the integral method to solve this equation, writing temperature and polarization anisotropies as a time integral over a geometrical term and a source term. The geometrical terms can be written using ultra-spherical Bessel functions, which depend on curvature. These cannot be precomputed in advance as in flat space. Instead we solve directly their differential equation for selected values of the multipoles. The resulting computational time is comparable to the flat space case and improves over previous methods by 2-3 orders of magnitude. This allows one to compute highly accurate CMB temperature and polarization spectra, matter transfer functions and their CMB normalizations for any cosmological model, thereby avoiding the need to use various approximate fitting formulae that exist in the literature.

Recent work has emphasised the importance of vector and tensor contributions to the large scale microwave anisotropy fluctuations produced by cosmic defects. In this paper we provide a general discussion of these contributions, and how their magnitude is constrained by the fundamental assumptions of causality, scaling, and statistical isotropy. We discuss an analytic model which illustrates and explains how the ratios of isotropic and anisotropic scalar, vector and tensor microwave anisotropies are determined. This provides a check of the results from large scale numerical simulations, confirming the numerical finding that vector and tensor modes provide substantial contributions to the large angle anisotropies. This leads to a suppression of the scalar normalisation and consequently of the Doppler peaks.

We compute the polarization power spectra for global strings, monopoles, textures and nontopological textures, and compare them to inflationary models. We find that topological defect models predict a significant (1 microK) contribution to magnetic type polarization on degree angular scales, which is produced by the large vector component of the defect source. We also investigate the effect of decoherence on polarization. It leads to a smoothing of acoustic oscillations both in temperature and polarization power spectra and strongly suppresses the cross-correlation between temperature and polarization relative to inflationary models. Presence or absence of magnetic polarization or cross-correlation would be a strong discriminator between the two theories of structure formation and will be testable with the next generation of CMB satellites.

An efficient technique for computing perturbation power spectra in field ordering theories of cosmic structure formation is introduced, enabling computations to be carried out with unprecedented precision. Large scale simulations are used to measure unequal time correlators of the source stress energy, taking advantage of scaling during matter and radiation domination, and causality, to make optimal use of the available dynamic range. The correlators are then re-expressed in terms of a sum of eigenvector products, a representation which we argue is optimal, enabling the computation of the final power spectra to be performed at high accuracy. Microwave anisotropy and matter perturbation power spectra for global strings, monopoles, textures and non-topological textures are presented and compared with recent observations.

Weak lensing by large scale structure induces correlated ellipticities in the images of distant galaxies. The two-point correlation is determined by the matter power spectrum along the line of sight. We use the fully nonlinear evolution of the power spectrum to compute the predicted ellipticity correlation. We present results for different measures of the second moment for angular scales \theta \simeq 1'-3 degrees and for alternative normalizations of the power spectrum, in order to explore the best strategy for constraining the cosmological parameters. Normalizing to observed cluster abundance the rms amplitude of ellipticity within a 15' radius is \simeq 0.01 z_s^{0.6}, almost independent of the cosmological model, with z_s being the median redshift of background galaxies. Nonlinear effects in the evolution of the power spectrum significantly enhance the ellipticity for \theta < 10' -- on 1' the rms ellipticity is \simeq 0.05, which is nearly twice the linear prediction. This enhancement means that the signal to noise for the ellipticity is only weakly increasing with angle for 2'< \theta < 2 degrees, unlike the expectation from linear theory that it is strongly peaked on degree scales. The scaling with cosmological parameters also changes due to nonlinear effects. By measuring the correlations on small (nonlinear) and large (linear) angular scales, different cosmological parameters can be independently constrained to obtain a model independent estimate of both power spectrum amplitude and matter density \Omega_m. Nonlinear effects also modify the probability distribution of the ellipticity. Using second order perturbation theory we find that over most of the range of interest there are significant deviations from a normal distribution.

Polarization induced by cosmological scalar perturbations leads to a typical anisotropy pattern, which can best be analyzed in Fourier domain. This allows one to unambiguously distinguish cosmological signal of polarization from other foregrounds and systematics, as well as from polarization induced by non-scalar perturbations. The precision with which polarization and cross-correlation power spectra can be determined is limited by cosmic variance, noise and foreground residuals. Choice of estimator can significantly improve our capability of extracting cosmological signal and in the noise dominated limit the optimal power spectrum estimator reduces the variance by a factor of two compared to the simplest estimator. If foreground residuals are important then a different estimator can be used, which eliminates systematic effects from foregrounds so that no further foreground subtraction is needed. A particular combination of Stokes $Q$ and $U$ parameters vanishes for scalar induced polarization, thereby allowing an unambiguous determination of tensor modes. Theoretical predictions of polarization in standard models show that one typically expects a signal at the level of 5-10$\mu$K on small angular scales and around 1$\mu$K on large scales ($l<200$). Satellite missions should be able to reach sensitivities needed for an unambiguous detection of polarization, which would help to break the degeneracies in the determination of some of the cosmological parameters.

Using the formalism of spin-weighted functions we present an all-sky analysis of polarization in the Cosmic Microwave Background (CMB). Linear polarization is a second-rank symmetric and traceless tensor, which can be decomposed on a sphere into spin $\pm 2$ spherical harmonics. These are the analog of the spherical harmonics used in the temperature maps and obey the same completeness and orthogonality relations. We show that there exist two linear combinations of spin $\pm 2$ multipole moments which have opposite parities and can be used to fully characterize the statistical properties of polarization in the CMB. Magnetic-type parity combination does not receieve contributions from scalar modes and does not cross-correlate with either temperature or electric-type parity combination, so there are four different power spectra that fully characterize statistical properties of CMB. We present their explicit expressions for scalar and tensor modes in the form of line of sight integral solution and numerically evaluate them for a representative set of models. These general solutions differ from the expressions obtained previously in the small scale limit both for scalar and tensor modes. A method to generate and analyze all sky maps of temperature and polarization is given and the optimal estimators for various power spectra and their corresponding variances are discussed.

Using spin-weighted decomposition of polarization in the Cosmic Microwave Background (CMB) we show that a particular combination of Stokes $Q$ and $U$ parameters vanishes for primordial fluctuations generated by scalar modes, but does not for those generated by primordial gravity waves. Because of this gravity wave detection is not limited by cosmic variance as in the case of temperature fluctuations. We present the exact expressions for various polarization power spectra, which are valid on any scale. Numerical evaluation in inflation-based models shows that the expected signal is of the order of 0.5 $\mu K$, which could be directly tested in future CMB experiments.

Galaxies modeled as singular isothermal ellipsoids with an axis ratio distribution similar to the observed axis ratio distribution of E and S0 galaxies are statistically consistent with both the observed numbers of two-image and four-image lenses and the inferred ellipticities of individual lenses. However, no four-image lens is well fit by the model (typical $\chi^2/N_{dof} \sim 20$), the axis ratio of the model can be significantly different from that of the observed lens galaxy, and the major axes of the model and the galaxy may be slightly misaligned. We found that models with a second, independent, external shear axis could fit the data well (typical $\chi^2/N_{dof} \sim 1$), while adding the same number of extra parameters to the radial mass distribution does not produce such a dramatic improvement in the fit. An independent shear axis can be produced by misalignments between the luminous galaxy and its dark matter halo, or by external shear perturbations due to galaxies and clusters correlated with the primary lens or along the line of sight. We estimate that the external shear perturbations have no significant effect on the expected numbers of two-image and four-image lenses, but that they can be important perturbations in individual lens models. However, the amplitudes of the external shears required to produce the good fits are larger than our estimates for typical external shear perturbations (10-15% shear instead of 1-3% shear) suggesting that the origin of the extra angular structure must be intrinsic to the primary lens galaxy in most cases.

We present a new method for calculating linear cosmic microwave background (CMB) anisotropy spectra based on integration over sources along the photon past light cone. In this approach the temperature anisotropy is written as a time integral over the product of a geometrical term and a source term. The geometrical term is given by radial eigenfunctions which do not depend on the particular cosmological model. The source term can be expressed in terms of photon, baryon and metric perturbations, all of which can be calculated using a small number of differential equations. This split clearly separates between the dynamical and geometrical effects on the CMB anisotropies. More importantly, it allows to significantly reduce the computational time compared to standard methods. This is achieved because the source term, which depends on the model and is generally the most time consuming part of calculation, is a slowly varying function of wavelength and needs to be evaluated only in a small number of points. The geometrical term, which oscillates much more rapidly than the source term, does not depend on the particular model and can be precomputed in advance. Standard methods that do not separate the two terms and require a much higher number of evaluations. The new method leads to about two orders of magnitude reduction in CPU time when compared to standard methods and typically requires a few minutes on a workstation for a single model. The method should be especially useful for accurate determinations of cosmological parameters from CMB anisotropy and polarization measurements that will become possible with the next generation of experiments. A programm implementing this method can be obtained from the authors.

The Rees-Sciama (RS) effect produces fluctuations in the cosmic microwave background (CMB) through the time-dependent gravitational potential in the nonlinear stages of evolution. I investigate the RS effect on the CMB angular power spectrum $C_l$ for several CDM models by combining the results of N-body simulations with second order perturbation theory. The amplitude of the RS fluctuations peaks at $l \sim 100-300$, where it gives $\Delta T /T \sim 10^{-7}-10^{-6}$ for a wide range of models. This is at least an order of magnitude below the COBE normalized primary contribution. RS fluctuations could be a dominant source of anisotropies only on subarcminute scales ($l \approx 5000$) and are below the present day observational sensitivities on all angular scales.

The effect of gravitational lensing on cosmic microwave background (CMB) anisotropies is investigated using the power spectrum approach. The lensing effect can be calculated in any cosmological model by specifying the evolution of gravitational potential. Previous work on this subject is generalized to a non-flat universe and to a nonlinear evolution regime. Gravitational lensing cannot change the gross distribution of CMB anisotropies, but it may redistribute the power and smooth the sharp features in the CMB power spectrum. The magnitude of this effect is estimated using observational constraints on the power spectrum of gravitational potential from galaxy and cluster surveys and also using the limits on correlated ellipticities in distant galaxies. For realistic CMB power spectra the effect on CMB multipole moments is less then a few percent on degree angular scales, but gradually increases towards smaller scales. On arcminute angular scales the acoustic oscillation peaks may be partially or completely smoothed out because of the gravitational lensing.

We present a simple, yet accurate approximation for calculating the cosmic microwave background anisotropy power spectrum in adiabatic models. It consists of solving for the evolution of a two-fluid model until the epoch of recombination and then integrating over the sources to obtain the CMB anisotropy power spectrum. The approximation is useful both for a physical understanding of CMB anisotropies, as well as for a quantitative analysis of cosmological models. Comparison with exact calculations shows that the accuracy is typically better than 20 percent over a large range of angles and cosmological models, including those with curvature and cosmological constant. Using this approximation we investigate the dependence of the CMB anisotropies on the cosmological parameters. We identify six dimensionless parameters that uniquely determine the anisotropy power spectrum within our approximation. CMB experiments on different angular scales could in principle provide information on all these parameters. In particular, mapping of the Doppler peaks would allow an independent determination of baryon mass density, matter mass density and Hubble constant.

We compute the fluctuations in gravitational lens image positions and time delay caused by large scale structure correlations. We show that these fluctuations can be expressed as a simple integral over the density power spectrum. Using the {\sl COBE} normalization we find that positions of objects at cosmological distances are expected to deviate from their true positions by a few arcminutes. These deflections are not directly observable. The positions of the images relative to one another fluctuate by a few percent of the relative separation, implying that one does not expect multiple images to be produced by large scale structures. Nevertheless, the fluctuations are larger than the observational errors on the positions and affect reconstructions of the lens potential. The time delay fluctuations have a geometrical and a gravitational contribution. Both are much larger than the expected time delay from the primary lens, but partially cancel each other. We find that large scale structure weakly affects the time delay and time delay measurements can be used as a probe of the distance scale in the universe.

We use the POTENT reconstruction of the mass density field in the nearby universe to estimate the amplitude of the density fluctuation power spectrum for various cosmological models. We find sigma_8\Omega_m^{0.6}= 1.3^{+0.4}_{-0.3}, almost independently of the power spectrum. This value agrees well with the COBE normalization for the standard CDM model, while some alternative models predict an excessive amplitude compared with COBE. Flat low \Omega_m models and tilted models with spectral index n<0.8 are particularly discordant.

We have used maximum-likelihood estimation to determine the quadrupole amplitude $Q_{\rm rms-PS}$ and the spectral index $n$ of the density fluctuation power spectrum at recombination from the \cobe\ DMR data. We find a strong correlation between the two parameters of the form $Q_{\rm rms-PS}=(15.7\pm 2.6)\exp[0.46(1-n)]\mk$ for fixed $n$. Our result is slightly smaller than and has a smaller statistical uncertainty than the 1992 estimate of Smoot et al.