Data Challenge 1 (DC1) is the first synthetic dataset produced by the Rubin Observatory Legacy Survey of Space and Time (LSST) Dark Energy Science Collaboration (DESC). DC1 is designed to develop and validate data reduction and analysis and to study the impact of systematic effects that will affect the LSST dataset. DC1 is comprised of $r$-band observations of 40 deg$^{2}$ to 10-year LSST depth. We present each stage of the simulation and analysis process: a) generation, by synthesizing sources from cosmological N-body simulations in individual sensor-visit images with different observing conditions; b) reduction using a development version of the LSST Science Pipelines; and c) matching to the input cosmological catalog for validation and testing. We verify that testable LSST requirements pass within the fidelity of DC1. We establish a selection procedure that produces a sufficiently clean extragalactic sample for clustering analyses and we discuss residual sample contamination, including contributions from inefficiency in star-galaxy separation and imperfect deblending. We compute the galaxy power spectrum on the simulated field and conclude that: i) survey properties have an impact of 50\% of the statistical uncertainty for the scales and models used in DC1 ii) a selection to eliminate artifacts in the catalogs is necessary to avoid biases in the measured clustering; iii) the presence of bright objects has a significant impact (2- to 6-$\sigma$) in the estimated power spectra at small scales ($\ell > 1200$), highlighting the impact of blending in studies at small angular scales in LSST;

This work uses hierarchical logistic Gaussian processes to infer true redshift distributions of samples of galaxies, through their cross-correlations with spatially overlapping spectroscopic samples. We demonstrate that this method can accurately estimate these redshift distributions in a fully Bayesian manner jointly with galaxy-dark matter bias models. We forecast how systematic biases in the redshift-dependent galaxy-dark matter bias model affect redshift inference. Using published galaxy-dark matter bias measurements from the Illustris simulation, we compare these systematic biases with the statistical error budget from a forecasted weak gravitational lensing measurement. If the redshift-dependent galaxy-dark matter bias model is mis-specified, redshift inference can be biased. This can propagate into relative biases in the weak lensing convergence power spectrum on the 10% - 30% level. We, therefore, showcase a methodology to detect these sources of error using Bayesian model selection techniques. Furthermore, we discuss the improvements that can be gained from incorporating prior information from Bayesian template fitting into the model, both in redshift prediction accuracy and in the detection of systematic modeling biases.

Forthcoming space-based observations will require high-quality point-spread function (PSF) models for weak gravitational lensing measurements. One approach to generating these models is using a wavefront model based on the known telescope optics. We present an empirical framework for validating such models to confirm that they match the actual PSF to within requirements by comparing the models to the observed light distributions of isolated stars. We apply this framework to Tiny Tim, the standard tool for generating model PSFs for the Hubble Space Telescope (HST), testing its models against images taken by HST's Advanced Camera for Surveys in the Wide Field Channel. We show that Tiny Tim's models, in the default configuration, differ significantly from the observed PSFs, most notably in their sizes. We find that the quality of Tiny Tim PSFs can be improved through fitting the full set of Zernike polynomial coefficients which characterise the optics, to the point where the practical significance of the difference between model and observed PSFs is negligible for most use cases, resulting in additive and multiplicative biases both of order approximately 4e-4. We also show that most of this improvement can be retained through using an updated set of Zernike coefficients, which we provide.

The LSST survey will provide unprecedented statistical power for measurements of dark energy. Consequently, controlling systematic uncertainties is becoming more important than ever. The LSST observing strategy will affect the statistical uncertainty and systematics control for many science cases; here, we focus on weak lensing systematics. The fact that the LSST observing strategy involves hundreds of visits to the same sky area provides new opportunities for systematics mitigation. We explore these opportunities by testing how different dithering strategies (pointing offsets and rotational angle of the camera in different exposures) affect additive weak lensing shear systematics on a baseline operational simulation, using the $\rho-$statistics formalism. Some dithering strategies improve systematics control at the end of the survey by a factor of up to $\sim 3-4$ better than others. We find that a random translational dithering strategy, applied with random rotational dithering at every filter change, is the most effective of those strategies tested in this work at averaging down systematics. Adopting this dithering algorithm, we explore the effect of varying the area of the survey footprint, exposure time, number of exposures in a visit, and exposure to the Galactic plane. We find that any change that increases the average number of exposures (in filters relevant to weak lensing) reduces the additive shear systematics. Some ways to achieve this increase may not be favorable for the weak lensing statistical constraining power or for other probes, and we explore the relative trade-offs between these options given constraints on the overall survey parameters.

We explore synergies between the space-based Wide-Field Infrared Survey Telescope (WFIRST) and the ground-based Rubin Observatory Legacy Survey of Space and Time (LSST). In particular, we consider a scenario where the currently envisioned survey strategy for WFIRST's High Latitude Survey (HLS), i.e., 2000 square degrees in four narrow photometric bands is altered in favor of a strategy that combines rapid coverage of the LSST area (to full LSST depth) in one band. We find that a 5-month WFIRST survey in the W-band can cover the full LSST survey area providing high-resolution imaging for >95% of the LSST Year 10 gold galaxy sample. We explore a second, more ambitious scenario where WFIRST spends 1.5 years covering the LSST area. For this second scenario we quantify the constraining power on dark energy equation of state parameters from a joint weak lensing and galaxy clustering analysis, and compare it to an LSST-only survey and to the Reference WFIRST HLS survey. Our survey simulations are based on the WFIRST exposure time calculator and redshift distributions from the CANDELS catalog. Our statistical uncertainties account for higher-order correlations of the density field, and we include a wide range of systematic effects, such as uncertainties in shape and redshift measurements, and modeling uncertainties of astrophysical systematics, such as galaxy bias, intrinsic galaxy alignment, and baryonic physics. Assuming the 5-month WFIRST wide scenario, we find a significant increase in constraining power for the joint LSST+WFIRST wide survey compared to LSST Y10 (FoM(Wwide)= 2.4 FoM(LSST)) and compared to LSST+WFIRST HLS (FoM(Wwide)= 5.5 FoM(HLS)).

We present cosmological parameter constraints based on a joint modeling of galaxy-lensing cross correlations and galaxy clustering measurements in the SDSS, marginalizing over small-scale modeling uncertainties using mock galaxy catalogs, without explicit modeling of galaxy bias. We show that our modeling method is robust to the impact of different choices for how galaxies occupy dark matter halos and to the impact of baryonic physics (at the $\sim2\%$ level in cosmological parameters) and test for the impact of covariance on the likelihood analysis and of the survey window function on the theory computations. Applying our results to the measurements using galaxy samples from BOSS and lensing measurements using shear from SDSS galaxies and CMB lensing from Planck, with conservative scale cuts, we obtain $S_8\equiv\left(\frac{\sigma_8}{0.8228}\right)^{0.8}\left(\frac{\Omega_m}{0.307}\right)^{0.6}=0.85\pm0.05$ (stat.) using LOWZ $\times$ SDSS galaxy lensing, and $S_8=0.91\pm0.1$ (stat.) using combination of LOWZ and CMASS $\times$ Planck CMB lensing. We estimate the systematic uncertainty in the galaxy-galaxy lensing measurements to be $\sim6\%$ (dominated by photometric redshift uncertainties) and in the galaxy-CMB lensing measurements to be $\sim3\%$, from small scale modeling uncertainties including baryonic physics.

We present measurements of cosmic shear two-point correlation functions (TPCFs) from Hyper Suprime-Cam Subaru Strategic Program (HSC SSP) first-year data, and derived cosmological constraints based on a blind analysis. The HSC first-year shape catalog is divided into four tomographic redshift bins ranging from $z=0.3$ to 1.5 with equal widths of $\Delta z =0.3$. The unweighted galaxy number densities in each tomographic bin are 5.9, 5.9, 4.3, and 2.4 arcmin$^{-2}$ from lower to higher redshifts, respectively. We adopt the standard TPCF estimators, $\xi_\pm$, for our cosmological analysis, given that we find no evidence of the significant B-mode shear. The TPCFs are detected at high significance for all ten combinations of auto- and cross-tomographic bins over a wide angular range, yielding a total signal-to-noise ratio of 19 in the angular ranges adopted in the cosmological analysis, $7'<\theta<56'$ for $\xi_+$ and $28'<\theta<178'$ for $\xi_-$. We perform the standard Bayesian likelihood analysis for cosmological inference from the measured cosmic shear TPCFs, including contributions from intrinsic alignment of galaxies as well as systematic effects from PSF model errors, shear calibration uncertainty, and source redshift distribution errors. We adopt a covariance matrix derived from realistic mock catalogs constructed from full-sky gravitational lensing simulations that fully account for survey geometry and measurement noise. For a flat $\Lambda$ cold dark matter model, we find $S_8 \equiv \sigma_8\sqrt{\Omega_m/0.3}=0.804_{-0.029}^{+0.032}$, and $\Omega_m=0.346_{-0.100}^{+0.052}$. We carefully check the robustness of the cosmological results against astrophysical modeling uncertainties and systematic uncertainties in measurements, and find that none of them has a significant impact on the cosmological constraints.

The Wide-Field InfraRed Survey Telescope (WFIRST) mission is expected to launch in the mid-2020s. Its weak lensing program is designed to enable unprecedented systematics control in photometric measurements, including shear recovery, point-spread function (PSF) correction, and photometric calibration. This will enable exquisite weak lensing science and allow us to adjust to and reliably contribute to the cosmological landscape after the initial years of observations from other concurrent Stage IV dark energy experiments. This potential requires equally careful planning and requirements validation as the mission prepares to enter its construction phase. We present a suite of image simulations based on GalSim that are used to construct a complex, synthetic WFIRST weak lensing survey that incorporates realistic input galaxies and stars, relevant detector non-idealities, and the current reference five-year WFIRST survey strategy. We present a first study to empirically validate the existing WFIRST weak lensing requirements flowdown using a suite of 12 matched image simulations, each representing a different perturbation to the wavefront or image motion model. These are chosen to induce a range of potential static and low- and high-frequency time-dependent PSF model errors. We analyze the measured shapes of galaxies from each of these simulations and compare them to a reference, fiducial simulation to infer the response of the shape measurement to each of these modes in the wavefront model. We then compare this to existing analytic flowdown requirements, and find general agreement between the empirically derived response and that predicted by the analytic model.

We analyze the clustering of galaxies in the first public data release of the HSC Subaru Strategic Program. Despite the relatively small footprints of the observed fields, the data are an excellent proxy for the deep photometric datasets that will be acquired by LSST, and are therefore an ideal test bed for the analysis methods being implemented by the LSST DESC. We select a magnitude limited sample with $i<24.5$ and analyze it in four redshift bins covering $0.15\lesssim z \lesssim1.5$. We carry out a Fourier-space analysis of the two-point clustering of this sample, including all auto- and cross-correlations. We demonstrate the use of map-level deprojection methods to account for fluctuations in the galaxy number density caused by observational systematics. Through an HOD analysis, we place constraints on the characteristic halo masses of this sample, finding a good fit up to scales $k_{\rm max}=1\,{\rm Mpc}^{-1}$, including both auto- and cross-correlations. Our results show monotonically decreasing average halo masses, which can be interpreted in terms of the drop-out of red galaxies at high redshifts for a flux-limited sample. In terms of photometric redshift systematics, we show that additional care is needed in order to marginalize over uncertainties in the redshift distribution in galaxy clustering, and that these uncertainties can be constrained by including cross-correlations. We are able to make a $\sim3\sigma$ detection of lensing magnification in the HSC data. Our results are stable to variations in $\sigma_8$ and $\Omega_c$ and we find constraints that agree well with measurements from Planck and low-redshift probes. Finally, we use our pipeline to study the clustering of galaxies as a function of limiting flux, and provide a simple fitting function for the linear galaxy bias for magnitude limited samples as a function of limiting magnitude and redshift. [abridged]

Galaxy intrinsic alignments (IAs) have long been recognised as a significant contaminant to weak lensing-based cosmological inference. In this paper we seek to quantify the impact of a common modelling assumption in analytic descriptions of intrinsic alignments: that of spherically symmetric dark matter halos. Understanding such effects is important as the current generation of intrinsic alignment models are known to be limited, particularly on small scales, and building an accurate theoretical description will be essential for fully exploiting the information in future lensing data. Our analysis is based on a catalogue of 113,560 galaxies between $z=0.06-1.00$ from MassiveBlack-II, a hydrodynamical simulation of box length $100 h^{-1}$ Mpc. We find satellite anisotropy contributes at the level of $\geq 30-40\%$ to the small scale alignment correlation functions. At separations larger than $1 h^{-1}$ Mpc the impact is roughly scale-independent, inducing a shift in the amplitude of the IA power spectra of $\sim20\%$. These conclusions are consistent across the redshift range and between the MassiveBlack-II and Illustris simulations. The cosmological implications of these results are tested using a simulated likelihood analysis. Synthetic cosmic shear data is constructed with the expected characteristics (depth, area and number density) of a future LSST-like survey. Our results suggest that modelling alignments using a halo model based upon spherical symmetry could potentially induce cosmological parameter biases at the $\sim 1.5\sigma$ level for $S_8$ and $w$.

A fraction of the light observed from edge-on disk galaxies is polarized due to two physical effects: selective extinction by dust grains aligned with the magnetic field, and scattering of the anisotropic starlight field. Since the efficiency of detectors and the response of optical devices depend on the polarization of incoming rays, this optical polarization produces both (a) a selection bias in favor of galaxies with specific orientations and (b) a polarization-dependent PSF. In this work we build toy models to obtain for the first time an estimate for the impact of polarization on PSF shapes and the impact of the selection bias due to the polarization effect on the measurement of the ellipticity used in shear measurements. In particular, we are interested in determining if this effect will be significant for WFIRST. We show that the systematic uncertainties in the ellipticity components are $7\times 10^{-5}$ and $1.1 \times 10^{-4}$ due to the selection bias and PSF errors respectively. Both of these systematic uncertainties are close to the WFIRST tolerance level, and hence more detailed studies of the polarization effects or more stringent requirements on polarization-sensitive instrumentation for WFIRST are required.

Modifications of the matter power spectrum due to baryonic physics are one of the major theoretical uncertainties in cosmological weak lensing measurements. Developing robust mitigation schemes for this source of systematic uncertainty increases the robustness of cosmological constraints, and may increase their precision if they enable the use of information from smaller scales. Here we explore the performance of two mitigation schemes for baryonic effects in weak lensing cosmic shear: the PCA method and the halo-model approach in \textsc{HMcode}. We construct mock tomographic shear power spectra from four hydrodynamical simulations, and run simulated likelihood analyses with \textsc{CosmoLike} assuming LSST-like survey statistics. With an angular scale cut of $\ell_{\rm max}<2000$, both methods successfully remove the biases in cosmological parameters due to the various baryonic physics scenarios, with the PCA method causing less degradation in the parameter constraints than \textsc{HMcode}. For a more aggressive $\ell_{\rm max}=$5000, the PCA method performs well for all but one baryonic physics scenario, requiring additional training simulations to account for the extreme baryonic physics scenario of Illustris; \textsc{HMcode} exhibits tensions in the 2D posterior distributions of cosmological parameters due to lack of freedom in describing the power spectrum for $k > 10\ h^{-1}\mathrm{Mpc}$. We investigate variants of the PCA method and improve the bias mitigation through PCA by accounting for the noise properties in the data via Cholesky decomposition of the covariance matrix. Our improved PCA method allows us to retain more statistical constraining power while effectively mitigating baryonic uncertainties even for a broad range of baryonic physics scenarios.

Constraining the relation between the richness $N$ and the halo mass $M$ over a wide redshift range for optically-selected clusters is a key ingredient for cluster-related science in optical surveys, including the Subaru Hyper Suprime-Cam (HSC) survey. We measure stacked weak lensing profiles around 1747 HSC CAMIRA clusters over a redshift range of $0.1\leq z_{\rm cl}\leq 1.0$ with $N\geq 15$ using the HSC first-year shear catalog covering $\sim$$140$ ${\rm deg^2}$. The exquisite depth and image quality of the HSC survey allow us to measure lensing signals around the high-redshift clusters at $0.7\leq z_{\rm cl}\leq 1.0$ with a signal-to-noise ratio of 19 in the comoving radius range $0.5\lesssim R\lesssim 15 h^{-1}{\rm Mpc}$. We constrain richness-mass relations $P(\ln N|M,z)$ of the HSC CAMIRA clusters assuming a log-normal distribution without informative priors on model parameters, by jointly fitting to the lensing profiles and abundance measurements under both Planck and WMAP cosmological models. We show that our model gives acceptable $p$-values when we add redshift dependent terms which are proportional to $\ln (1+z)$ and $[\ln (1+z)]^{2}$ into the mean and scatter relations of $P(\ln N|M,z)$. Such terms presumably originate from the variation of photometric redshift errors as a function of the redshift. We show that the constraints on the mean relation $\langle M|N \rangle$ are consistent between the Planck and WMAP models, whereas the scatter values $\sigma_{\ln M|N}$ for the Planck model are systematically larger than those for the WMAP model. We also show that the scatter values for the Planck model increase toward lower richness values, whereas those for the WMAP model are consistent with constant values as a function of richness. This result highlights the importance of the scatter in the mass-richness relation for cluster cosmology.

This paper introduces cosmoDC2, a large synthetic galaxy catalog designed to support precision dark energy science with the Large Synoptic Survey Telescope (LSST). CosmoDC2 is the starting point for the second data challenge (DC2) carried out by the LSST Dark Energy Science Collaboration (LSST DESC). The catalog is based on a trillion-particle, 4.225 Gpc^3 box cosmological N-body simulation, the `Outer Rim' run. It covers 440 deg^2 of sky area to a redshift of z=3 and is complete to a magnitude depth of 28 in the r-band. Each galaxy is characterized by a multitude of properties including stellar mass, morphology, spectral energy distributions, broadband filter magnitudes, host halo information and weak lensing shear. The size and complexity of cosmoDC2 requires an efficient catalog generation methodology; our approach is based on a new hybrid technique that combines data-driven empirical approaches with semi-analytic galaxy modeling. A wide range of observation-based validation tests has been implemented to ensure that cosmoDC2 enables the science goals of the planned LSST DESC DC2 analyses. This paper also represents the official release of the cosmoDC2 data set, including an efficient reader that facilitates interaction with the data.

Through the lens of the LSST Science Collaborations' experience, this paper advocates for new and improved ways to fund large, complex collaborations at the interface of data science and astrophysics as they work in preparation for and on peta-scale, complex surveys, of which LSST is a prime example. We advocate for the establishment of programs to support both research and infrastructure development that enables innovative collaborative research on such scales.

Although photometric redshifts (photo-z's) are crucial ingredients for current and upcoming large-scale surveys, the high-quality spectroscopic redshifts currently available to train, validate, and test them are substantially non-representative in both magnitude and color. We investigate the nature and structure of this bias by tracking how objects from a heterogeneous training sample contribute to photo-z predictions as a function of magnitude and color, and illustrate that the underlying redshift distribution at fixed color can evolve strongly as a function of magnitude. We then test the robustness of the galaxy-galaxy lensing signal in 120 deg$^2$ of HSC-SSP DR1 data to spectroscopic completeness and photo-z biases, and find that their impacts are sub-dominant to current statistical uncertainties. Our methodology provides a framework to investigate how spectroscopic incompleteness can impact photo-z-based weak lensing predictions in future surveys such as LSST and WFIRST.

We study the significance of non-Gaussianity in the likelihood of weak lensing shear two-point correlation functions, detecting significantly non-zero skewness and kurtosis in one-dimensional marginal distributions of shear two-point correlation functions in simulated weak lensing data though the full multivariate distributions are relatively more Gaussian. We examine the implications in the context of future surveys, in particular LSST, with derivations of how the non-Gaussianity scales with survey area. We show that there is no significant bias in one-dimensional posteriors of $\Omega_{\rm m}$ and $\sigma_{\rm 8}$ due to the non-Gaussian likelihood distributions of shear correlations functions using the mock data ($100$ deg$^{2}$). We also present a systematic approach to constructing an approximate multivariate likelihood function by decorrelating the data points using principal component analysis (PCA). When using a subset of the PCA components that account for the majority of the cosmological signal as a data vector, the one-dimensional marginal likelihood distributions of those components exhibit less skewness and kurtosis than the original shear correlation functions. We further demonstrate that the difference in cosmological parameter constraints between the multivariate Gaussian likelihood model and more complex non-Gaussian likelihood models would be even smaller for an LSST-like survey due to the area effect. In addition, the PCA approach automatically serves as a data compression method, enabling the retention of the majority of the cosmological information while reducing the dimensionality of the data vector by a factor of $\sim$5.

We investigate the redshift evolution of the intrinsic alignments (IA) of galaxies in the \texttt{MassiveBlackII} (MBII) simulation. We select galaxy samples above fixed subhalo mass cuts ($M_h>10^{11,12,13}~M_{\odot}/h$) at $z=0.6$ and trace their progenitors to $z=3$ along their merger trees. Dark matter components of $z=0.6$ galaxies are more spherical than their progenitors while stellar matter components tend to be less spherical than their progenitors. The distribution of the galaxy-subhalo misalignment angle peaks at $\sim10~\mathrm{deg}$ with a mild increase with time. The evolution of the ellipticity-direction~(ED) correlation amplitude $\omega(r)$ of galaxies (which quantifies the tendency of galaxies to preferentially point towards surrounding matter overdensities) is governed by the evolution in the alignment of underlying dark matter~(DM) subhaloes to the matter density of field, as well as the alignment between galaxies and their DM subhaloes. At scales $\sim1~\mathrm{cMpc}/h$, the alignment between DM subhaloes and matter overdensity gets suppressed with time, whereas the alignment between galaxies and DM subhaloes is enhanced. These competing tendencies lead to a complex redshift evolution of $\omega(r)$ for galaxies at $\sim1~\mathrm{cMpc}/h$. At scales $>1~\mathrm{cMpc}/h$, alignment between DM subhaloes and matter overdensity does not evolve significantly; the evolution of the galaxy-subhalo misalignment therefore leads to an increase in $\omega(r)$ for galaxies by a factor of $\sim4$ from $z=3$ to $0.6$ at scales $>1~\mathrm{cMpc}/h$. The balance between competing physical effects is scale dependant, leading to different conclusions at much smaller scales($\sim0.1~\mathrm{Mpc}/h$).

Astrophysical and cosmological observations currently provide the only robust, empirical measurements of dark matter. Future observations with Large Synoptic Survey Telescope (LSST) will provide necessary guidance for the experimental dark matter program. This white paper represents a community effort to summarize the science case for studying the fundamental physics of dark matter with LSST. We discuss how LSST will inform our understanding of the fundamental properties of dark matter, such as particle mass, self-interaction strength, non-gravitational couplings to the Standard Model, and compact object abundances. Additionally, we discuss the ways that LSST will complement other experiments to strengthen our understanding of the fundamental characteristics of dark matter. More information on the LSST dark matter effort can be found at https://lsstdarkmatter.github.io/ .

Variable stars with well-calibrated period-luminosity relationships provide accurate distance measurements to nearby galaxies and are therefore a vital tool for cosmology and astrophysics. While these measurements typically rely on samples of Cepheid and RR-Lyrae stars, abundant populations of luminous variable stars with longer periods of $10 - 1000$ days remain largely unused. We apply machine learning to derive a mapping between lightcurve features of these variable stars and their magnitude to extend the traditional period-luminosity (PL) relation commonly used for Cepheid samples. Using photometric data for long period variable stars in the Large Magellanic cloud (LMC), we demonstrate that our predictions produce residual errors comparable to those obtained on the corresponding Cepheid population. We show that our model generalizes well to other samples by performing a blind test on photometric data from the Small Magellanic Cloud (SMC). Our predictions on the SMC again show small residual errors and biases, comparable to results that employ PL relations fitted on Cepheid samples. The residual biases are complementary between the long period variable and Cepheid fits, which provides exciting prospects to better control sources of systematic error in cosmological distance measurements. We finally show that the proposed methodology can be used to optimize samples of variable stars as standard candles independent of any prior variable star classification.

Two decades after its discovery, cosmic acceleration remains the most profound mystery in cosmology and arguably in all of physics. Either the Universe is dominated by a form of dark energy with exotic physical properties not predicted by standard model physics, or General Relativity is not an adequate description of gravity over cosmic distances. WFIRST emerged as a top priority of Astro2010 in part because of its ability to address the mystery of cosmic acceleration through both high precision measurements of the cosmic expansion history and the growth of cosmic structures with multiple and redundant probes. We illustrate in this white paper how mission design changes since Astro2010 have made WFIRST an even more powerful dark energy facility and have improved the ability of WFIRST to respond to changes in the experimental landscape. WFIRST is the space-based probe of DE the community needs in the mid-2020s.

Despite two decades of tremendous experimental and theoretical progress, the riddle of the accelerated expansion of the Universe remains to be solved. On the experimental side, our understanding of the possibilities and limitations of the major dark energy probes has evolved; here we summarize the major probes and their crucial challenges. On the theoretical side, the taxonomy of explanations for the accelerated expansion rate is better understood, providing clear guidance to the relevant observables. We argue that: i) improving statistical precision and systematic control by taking more data, supporting research efforts to address crucial challenges for each probe, using complementary methods, and relying on cross-correlations is well motivated; ii) blinding of analyses is difficult but ever more important; iii) studies of dark energy and modified gravity are related; and iv) it is crucial that R&D for a vibrant dark energy program in the 2030s be started now by supporting studies and technical R&D that will allow embryonic proposals to mature. Understanding dark energy, arguably the biggest unsolved mystery in both fundamental particle physics and cosmology, will remain one of the focal points of cosmology in the forthcoming decade.

LSST will open new vistas for cosmology in the next decade, but it cannot reach its full potential without data from other telescopes. Cosmological constraints can be greatly enhanced using wide-field ($>20$ deg$^2$ total survey area), highly-multiplexed optical and near-infrared multi-object spectroscopy (MOS) on 4-15m telescopes. This could come in the form of suitably-designed large surveys and/or community access to add new targets to existing projects. First, photometric redshifts can be calibrated with high precision using cross-correlations of photometric samples against spectroscopic samples at $0 < z < 3$ that span thousands of sq. deg. Cross-correlations of faint LSST objects and lensing maps with these spectroscopic samples can also improve weak lensing cosmology by constraining intrinsic alignment systematics, and will also provide new tests of modified gravity theories. Large samples of LSST strong lens systems and supernovae can be studied most efficiently by piggybacking on spectroscopic surveys covering as much of the LSST extragalactic footprint as possible (up to $\sim20,000$ square degrees). Finally, redshifts can be measured efficiently for a high fraction of the supernovae in the LSST Deep Drilling Fields (DDFs) by targeting their hosts with wide-field spectrographs. Targeting distant galaxies, supernovae, and strong lens systems over wide areas in extended surveys with (e.g.) DESI or MSE in the northern portion of the LSST footprint or 4MOST in the south could realize many of these gains; DESI, 4MOST, Subaru/PFS, or MSE would all be well-suited for DDF surveys. The most efficient solution would be a new wide-field, highly-multiplexed spectroscopic instrument in the southern hemisphere with $>6$m aperture. In two companion white papers we present gains from deep, small-area MOS and from single-target imaging and spectroscopy.

Single-object imaging and spectroscopy on telescopes with apertures ranging from ~4 m to 40 m have the potential to greatly enhance the cosmological constraints that can be obtained from LSST. Two major cosmological probes will benefit greatly from LSST follow-up: accurate spectrophotometry for nearby and distant Type Ia supernovae will expand the cosmological distance lever arm by unlocking the constraining power of high-z supernovae; and cosmology with time delays of strongly-lensed supernovae and quasars will require additional high-cadence imaging to supplement LSST, adaptive optics imaging or spectroscopy for accurate lens and source positions, and IFU or slit spectroscopy to measure detailed properties of lens systems. We highlight the scientific impact of these two science drivers, and discuss how additional resources will benefit them. For both science cases, LSST will deliver a large sample of objects over both the wide and deep fields in the LSST survey, but additional data to characterize both individual systems and overall systematics will be key to ensuring robust cosmological inference to high redshifts. Community access to large amounts of natural-seeing imaging on ~2-4 m telescopes, adaptive optics imaging and spectroscopy on 8-40 m telescopes, and high-throughput single-target spectroscopy on 4-40 m telescopes will be necessary for LSST time domain cosmology to reach its full potential. In two companion white papers we present the additional gains for LSST cosmology that will come from deep and from wide-field multi-object spectroscopy.

Community access to deep (i ~ 25), highly-multiplexed optical and near-infrared multi-object spectroscopy (MOS) on 8-40m telescopes would greatly improve measurements of cosmological parameters from LSST. The largest gain would come from improvements to LSST photometric redshifts, which are employed directly or indirectly for every major LSST cosmological probe; deep spectroscopic datasets will enable reduced uncertainties in the redshifts of individual objects via optimized training. Such spectroscopy will also determine the relationship of galaxy SEDs to their environments, key observables for studies of galaxy evolution. The resulting data will also constrain the impact of blending on photo-z's. Focused spectroscopic campaigns can also improve weak lensing cosmology by constraining the intrinsic alignments between the orientations of galaxies. Galaxy cluster studies can be enhanced by measuring motions of galaxies in and around clusters and by testing photo-z performance in regions of high density. Photometric redshift and intrinsic alignment studies are best-suited to instruments on large-aperture telescopes with wider fields of view (e.g., Subaru/PFS, MSE, or GMT/MANIFEST) but cluster investigations can be pursued with smaller-field instruments (e.g., Gemini/GMOS, Keck/DEIMOS, or TMT/WFOS), so deep MOS work can be distributed amongst a variety of telescopes. However, community access to large amounts of nights for surveys will still be needed to accomplish this work. In two companion white papers we present gains from shallower, wide-area MOS and from single-target imaging and spectroscopy.

Astrophysical observations currently provide the only robust, empirical measurements of dark matter. In the coming decade, astrophysical observations will guide other experimental efforts, while simultaneously probing unique regions of dark matter parameter space. This white paper summarizes astrophysical observations that can constrain the fundamental physics of dark matter in the era of LSST. We describe how astrophysical observations will inform our understanding of the fundamental properties of dark matter, such as particle mass, self-interaction strength, non-gravitational interactions with the Standard Model, and compact object abundances. Additionally, we highlight theoretical work and experimental/observational facilities that will complement LSST to strengthen our understanding of the fundamental characteristics of dark matter.

In recent years, machine learning (ML) methods have remarkably improved how cosmologists can interpret data. The next decade will bring new opportunities for data-driven cosmological discovery, but will also present new challenges for adopting ML methodologies and understanding the results. ML could transform our field, but this transformation will require the astronomy community to both foster and promote interdisciplinary research endeavors.

Previous studies have shown the filamentary structures in the cosmic web influence the alignments of nearby galaxies. We study this effect in the LOWZ sample of the Sloan Digital Sky Survey using the "Cosmic Web Reconstruction" filament catalogue. We find that LOWZ galaxies exhibit a small but statistically significant alignment in the direction parallel to the orientation of nearby filaments. This effect is detectable even in the absence of nearby galaxy clusters, which suggests it is an effect from the matter distribution in the filament. A nonparametric regression model suggests that the alignment effect with filaments extends over separations of 30-40 Mpc. We find that galaxies that are bright and early-forming align more strongly with the directions of nearby filaments than those that are faint and late-forming; however, trends with stellar mass are less statistically significant, within the narrow range of stellar mass of this sample.

We measure cosmic weak lensing shear power spectra with the Subaru Hyper Suprime-Cam (HSC) survey first-year shear catalog covering 137deg$^2$ of the sky. Thanks to the high effective galaxy number density of $\sim$17 arcmin$^{-2}$ even after conservative cuts such as magnitude cut of $i<24.5$ and photometric redshift cut of $0.3\leq z \leq 1.5$, we obtain a high significance measurement of the cosmic shear power spectra in 4 tomographic redshift bins, achieving a total signal-to-noise ratio of 16 in the multipole range $300 \leq \ell \leq 1900$. We carefully account for various uncertainties in our analysis including the intrinsic alignment of galaxies, scatters and biases in photometric redshifts, residual uncertainties in the shear measurement, and modeling of the matter power spectrum. The accuracy of our power spectrum measurement method as well as our analytic model of the covariance matrix are tested against realistic mock shear catalogs. For a flat $\Lambda$ cold dark matter ($\Lambda$CDM) model, we find $S_8\equiv \sigma_8(\Omega_{\rm m}/0.3)^\alpha=0.800^{+0.029}_{-0.028}$ for $\alpha=0.45$ ($S_8=0.780^{+0.030}_{-0.033}$ for $\alpha=0.5$) from our HSC tomographic cosmic shear analysis alone. In comparison with Planck cosmic microwave background constraints, our results prefer slightly lower values of $S_8$, although metrics such as the Bayesian evidence ratio test do not show significant evidence for discordance between these results. We study the effect of possible additional systematic errors that are unaccounted in our fiducial cosmic shear analysis, and find that they can shift the best-fit values of $S_8$ by up to $\sim 0.6\sigma$ in both directions. The full HSC survey data will contain several times more area, and will lead to significantly improved cosmological constraints.

Cosmology is one of the four science pillars of LSST, which promises to be transformative for our understanding of dark energy and dark matter. The LSST Dark Energy Science Collaboration (DESC) has been tasked with deriving constraints on cosmological parameters from LSST data. Each of the cosmological probes for LSST is heavily impacted by the choice of observing strategy. This white paper is written by the LSST DESC Observing Strategy Task Force (OSTF), which represents the entire collaboration, and aims to make recommendations on observing strategy that will benefit all cosmological analyses with LSST. It is accompanied by the DESC DDF (Deep Drilling Fields) white paper (Scolnic et al.). We use a variety of metrics to understand the effects of the observing strategy on measurements of weak lensing, large-scale structure, clusters, photometric redshifts, supernovae, strong lensing and kilonovae. In order to reduce systematic uncertainties, we conclude that the current baseline observing strategy needs to be significantly modified to result in the best possible cosmological constraints. We provide some key recommendations: moving the WFD (Wide-Fast-Deep) footprint to avoid regions of high extinction, taking visit pairs in different filters, changing the 2x15s snaps to a single exposure to improve efficiency, focusing on strategies that reduce long gaps (>15 days) between observations, and prioritizing spatial uniformity at several intervals during the 10-year survey.

We review the measurements of dark energy enabled by observations of the Deep Drilling Fields and the optimization of survey design for cosmological measurements. This white paper is the result of efforts by the LSST DESC Observing Strategy Task Force (OSTF), which represents the entire collaboration, and aims to make recommendations on observing strategy for the DDFs that will benefit all cosmological analyses with LSST. It is accompanied by the DESC-WFD white paper (Lochner et al.). We argue for altering the nominal deep drilling plan to have $>6$ month seasons, interweaving $gri$ and $zy$ observations every 3 days with 2, 4, 8, 25, 4 visits in $grizy$, respectively. These recommendations are guided by metrics optimizing constraints on dark energy and mitigation of systematic uncertainties, including specific requirements on total number of visits after Y1 and Y10 for photometric redshifts (photo-$z$) and weak lensing systematics. We specify the precise locations for the previously-chosen LSST deep fields (ELAIS-S1, XMM-LSS, CDF-S, and COSMOS) and recommend Akari Deep Field South as the planned fifth deep field in order to synergize with Euclid and WFIRST. Our recommended DDF strategy uses $6.2\%$ of the LSST survey time. We briefly discuss synergy with white papers from other collaborations, as well as additional mini-surveys and Target-of-Opportunity programs that lead to better measurements of dark energy.

We present measurements of $E_G$, a probe of gravity from large-scale structure, using BOSS LOWZ and CMASS spectroscopic samples, with lensing measurements from SDSS (galaxy lensing) and Planck (CMB lensing). Using SDSS lensing and the BOSS LOWZ sample, we measure $\langle{E_G}\rangle=0.40^{+0.05}_{-0.04}$ (stat), $\pm 0.026$ (systematic), consistent with the predicted value from the Planck $\Lambda$CDM model, $E_G=0.46$. Using CMB lensing, we measure $\langle{E_G}\rangle=0.46^{+0.08}_{-0.09}$ (stat) for LOWZ (statistically consistent with galaxy lensing and Planck predictions) and $\langle{E_G}\rangle=0.39^{+0.05}_{-0.05}$ (stat) for the CMASS sample, consistent with the Planck prediction of $E_G=0.40$ given the higher redshift of the sample. We also study the redshift evolution of $E_G$ by splitting the LOWZ sample into two samples based on redshift, with results being consistent with model predictions. We estimate systematic uncertainties on the above $\langle{E_G}\rangle$ numbers to be $\sim 6$% (when using galaxy-galaxy lensing) or $\sim 3$% (when using CMB lensing), subdominant to the quoted statistical errors. These systematic error budgets are dominated by observational systematics in galaxy-galaxy lensing and by theoretical modeling uncertainties, respectively. We do not estimate observational systematics in galaxy-CMB lensing cross correlations.

The Large Synoptic Survey Telescope (LSST) Dark Energy Science Collaboration (DESC) will use five cosmological probes: galaxy clusters, large scale structure, supernovae, strong lensing, and weak lensing. This Science Requirements Document (SRD) quantifies the expected dark energy constraining power of these probes individually and together, with conservative assumptions about analysis methodology and follow-up observational resources based on our current understanding and the expected evolution within the field in the coming years. We then define requirements on analysis pipelines that will enable us to achieve our goal of carrying out a dark energy analysis consistent with the Dark Energy Task Force definition of a Stage IV dark energy experiment. This is achieved through a forecasting process that incorporates the flowdown to detailed requirements on multiple sources of systematic uncertainty. Future versions of this document will include evolution in our software capabilities and analysis plans along with updates to the LSST survey strategy.

Galaxy cluster centring is a key issue for precision cosmology studies using galaxy surveys. Mis-identification of central galaxies causes systematics in various studies such as cluster lensing, satellite kinematics, and galaxy clustering. The red-sequence Matched-filter Probabilistic Percolation (redMaPPer) estimates the probability that each member galaxy is central from photometric information rather than specifying one central galaxy. The redMaPPer estimates can be used for calibrating the off-centring effect, however, the centring algorithm has not previously been well-tested. We test the centring probabilities of redMaPPer cluster catalog using the projected cross correlation between redMaPPer clusters with photometric red galaxies and galaxy-galaxy lensing. We focus on the subsample of redMaPPer clusters in which the redMaPPer central galaxies (RMCGs) are not the brightest member galaxies (BMEM) and both of them have spectroscopic redshift. This subsample represents nearly 10% of the whole cluster sample. We find a clear difference in the cross-correlation measurements between RMCGs and BMEMs, and the estimated centring probability is 74$\pm$10% for RMCGs and 13$\pm$4% for BMEMs in the Gaussian offset model and 78$\pm$9% for RMCGs and 5$\pm$5% for BMEMs in the NFW offset model. These values are in agreement with the centring probability values reported by redMaPPer (75% for RMCG and 10% for BMEMs) within 1$\sigma$. Our analysis provides a strong consistency test of the redMaPPer centring probabilities. Our results suggest that redMaPPer centring probabilities are reliably estimated. We confirm that the brightest galaxy in the cluster is not always the central galaxy as has been shown in previous works.

We present results from a set of simulations designed to constrain the weak lensing shear calibration for the Hyper Suprime-Cam (HSC) survey. These simulations include HSC observing conditions and galaxy images from the Hubble Space Telescope (HST), with fully realistic galaxy morphologies and the impact of nearby galaxies included. We find that the inclusion of nearby galaxies in the images is critical to reproducing the observed distributions of galaxy sizes and magnitudes, due to the non-negligible fraction of unrecognized blends in ground-based data, even with the excellent typical seeing of the HSC survey (0.58" in the $i$-band). Using these simulations, we detect and remove the impact of selection biases due to the correlation of weights and the quantities used to define the sample (S/N and apparent size) with the lensing shear. We quantify and remove galaxy property-dependent multiplicative and additive shear biases that are intrinsic to our shear estimation method, including a $\sim 10$ per cent-level multiplicative bias due to the impact of nearby galaxies and unrecognized blends. Finally, we check the sensitivity of our shear calibration estimates to other cuts made on the simulated samples, and find that the changes in shear calibration are well within the requirements for HSC weak lensing analysis. Overall, the simulations suggest that the weak lensing multiplicative biases in the first-year HSC shear catalog are controlled at the 1 per cent level.

In the past few years, several independent collaborations have presented cosmological constraints from tomographic cosmic shear analyses. These analyses differ in many aspects: the datasets, the shear and photometric redshift estimation algorithms, the theory model assumptions, and the inference pipelines. To assess the robustness of the existing cosmic shear results, we present in this paper a unified analysis of four of the recent cosmic shear surveys: the Deep Lens Survey (DLS), the Canada-France-Hawaii Telescope Lensing Survey (CFHTLenS), the Science Verification data from the Dark Energy Survey (DES-SV), and the 450 deg$^{2}$ release of the Kilo-Degree Survey (KiDS-450). By using a unified pipeline, we show how the cosmological constraints are sensitive to the various details of the pipeline. We identify several analysis choices that can shift the cosmological constraints by a significant fraction of the uncertainties. For our fiducial analysis choice, considering a Gaussian covariance, conservative scale cuts, assuming no baryonic feedback contamination, identical cosmological parameter priors and intrinsic alignment treatments, we find the constraints (mean, 16% and 84% confidence intervals) on the parameter $S_{8}\equiv \sigma_{8}(\Omega_{\rm m}/0.3)^{0.5}$ to be $S_{8}=0.94_{-0.045}^{+0.046}$ (DLS), $0.66_{-0.071}^{+0.070}$ (CFHTLenS), $0.84_{-0.061}^{+0.062}$ (DES-SV) and $0.76_{-0.049}^{+0.048}$ (KiDS-450). From the goodness-of-fit and the Bayesian evidence ratio, we determine that amongst the four surveys, the two more recent surveys, DES-SV and KiDS-450, have acceptable goodness-of-fit and are consistent with each other. The combined constraints are $S_{8}=0.79^{+0.042}_{-0.041}$, which is in good agreement with the first year of DES cosmic shear results and recent CMB constraints from the Planck satellite.

Powerful quasars can be seen out to large distances. As they reside in massive dark matter haloes, they provide a useful tracer of large scale structure. We stack Herschel-SPIRE images at 250, 350 and 500 microns at the location of 11,235 quasars in ten redshift bins spanning $0.5 \leq z \leq 3.5$. The unresolved dust emission of the quasar and its host galaxy dominate on instrumental beam scales, while extended emission is spatially resolved on physical scales of order a megaparsec. This emission is due to dusty star-forming galaxies clustered around the dark matter haloes hosting quasars. We measure radial surface brightness profiles of the stacked images to compute the angular correlation function of dusty star-forming galaxies correlated with quasars. We then model the profiles to determine large scale clustering properties of quasars and dusty star-forming galaxies as a function of redshift. We adopt a halo model and parameterize it by the most effective halo mass at hosting star-forming galaxies, finding $\log(M_\mathrm{eff}/M_{\odot}) = 13.8^{+0.1}_{-0.1}$ at $z=2.21-2.32$, and, at $z=0.5-0.81$, the mass is $\log(M_\mathrm{eff}/M_{\odot}) = 10.7^{+1.0}_{-0.2}$. Our results indicate a downsizing of dark matter haloes hosting dusty star-forming galaxies between $0.5 \leq z \leq 2.9$. The derived dark matter halo masses are consistent with other measurements of star-forming and sub-millimeter galaxies. The physical properties of dusty star-forming galaxies inferred from the halo model depend on details of the quasar halo occupation distribution in ways that we explore at $z>2.5$, where the quasar HOD parameters are not well constrained.

The cosmological utility of galaxy cluster catalogues is primarily limited by our ability to calibrate the relation between halo mass and observable mass proxies such as cluster richness, X-ray luminosity or the Sunyaev-Zeldovich signal. Projection effects are a particularly pernicious systematic effect that can impact observable mass proxies; structure along the line of sight can both bias and increase the scatter of the observable mass proxies used in cluster abundance studies. In this work, we develop an empirical method to characterize the impact of projection effects on redMaPPer cluster catalogues. We use numerical simulations to validate our method and illustrate its robustness. We demonstrate that modeling of projection effects is a necessary component for cluster abundance studies capable of reaching $\approx 5\%$ mass calibration uncertainties (e.g. the Dark Energy Survey Year 1 sample). Specifically, ignoring the impact of projection effects in the observable--mass relation --- i.e. marginalizing over a log-normal model only --- biases the posterior of the cluster normalization condition $S_8 \equiv \sigma_8 (\Omega_{\rm m}/0.3)^{1/2}$ by $\Delta S_8 =0.05$, more than twice the uncertainty in the posterior for such an analysis.

We present a new method for measuring the scale dependence of the intrinsic alignment (IA) contamination to the galaxy-galaxy lensing signal, which takes advantage of multiple shear estimation methods applied to the same source galaxy sample. By exploiting the resulting correlation of both shape noise and cosmic variance, our method can provide an increase in the signal-to-noise of the measured IA signal as compared to methods which rely on the difference of the lensing signal from multiple photometric redshift bins. For a galaxy-galaxy lensing measurement which uses LSST sources and DESI lenses, the signal-to-noise on the IA signal from our method is predicted to improve by a factor of $\sim 2$ relative to the method of Blazek et al. 2012, for pairs of shear estimates which yield substantially different measured IA amplitudes and highly correlated shape noise terms. We show that statistical error necessarily dominates the measurement of intrinsic alignments using our method. We also consider a physically motivated extension of the Blazek et al. 2012 method which assumes that all nearby galaxy pairs, rather than only excess pairs, are subject to IA. In this case, the signal-to-noise of the method of Blazek et al. 2012 is improved.

(Abridged) We describe here the most ambitious survey currently planned in the optical, the Large Synoptic Survey Telescope (LSST). A vast array of science will be enabled by a single wide-deep-fast sky survey, and LSST will have unique survey capability in the faint time domain. The LSST design is driven by four main science themes: probing dark energy and dark matter, taking an inventory of the Solar System, exploring the transient optical sky, and mapping the Milky Way. LSST will be a wide-field ground-based system sited at Cerro Pach\'{o}n in northern Chile. The telescope will have an 8.4 m (6.5 m effective) primary mirror, a 9.6 deg$^2$ field of view, and a 3.2 Gigapixel camera. The standard observing sequence will consist of pairs of 15-second exposures in a given field, with two such visits in each pointing in a given night. With these repeats, the LSST system is capable of imaging about 10,000 square degrees of sky in a single filter in three nights. The typical 5$\sigma$ point-source depth in a single visit in $r$ will be $\sim 24.5$ (AB). The project is in the construction phase and will begin regular survey operations by 2022. The survey area will be contained within 30,000 deg$^2$ with $\delta<+34.5^\circ$, and will be imaged multiple times in six bands, $ugrizy$, covering the wavelength range 320--1050 nm. About 90\% of the observing time will be devoted to a deep-wide-fast survey mode which will uniformly observe a 18,000 deg$^2$ region about 800 times (summed over all six bands) during the anticipated 10 years of operations, and yield a coadded map to $r\sim27.5$. The remaining 10\% of the observing time will be allocated to projects such as a Very Deep and Fast time domain survey. The goal is to make LSST data products, including a relational database of about 32 trillion observations of 40 billion objects, available to the public and scientists around the world.

We present weak-lensing measurements using the first-year data from the Hyper Suprime-Cam Strategic Survey Program on the Subaru telescope for eight galaxy clusters selected through their thermal Sunyaev-Zel'dovich (SZ) signal measured at 148 GHz with the Atacama Cosmology Telescope Polarimeter experiment. The overlap between the two surveys in this work is 33.8 square degrees, before masking bright stars. The signal-to-noise ratio of individual cluster lensing measurements ranges from 2.2 to 8.7, with a total of 11.1 for the stacked cluster weak-lensing signal. We fit for an average weak-lensing mass distribution using three different profiles, a Navarro-Frenk-White profile, a dark-matter-only emulated profile, and a full cosmological hydrodynamic emulated profile. We interpret the differences among the masses inferred by these models as a systematic error of 10\%, which is currently smaller than the statistical error. We obtain the ratio of the SZ-estimated mass to the lensing-estimated mass (the so-called hydrostatic mass bias $1-b$) of $0.74^{+0.13}_{-0.12}$, which is comparable to previous SZ-selected clusters from the Atacama Cosmology Telescope and from the {\sl Planck} Satellite. We conclude with a discussion of the implications for cosmological parameters inferred from cluster abundances compared to cosmic microwave background primary anisotropy measurements.

Cosmic acceleration is the most surprising cosmological discovery in many decades. Testing and distinguishing among possible explanations requires cosmological measurements of extremely high precision probing the full history of cosmic expansion and structure growth and, ideally, compare and contrast matter and relativistic tracers of the gravity potential. This program is one of the defining objectives of the Wide-Field Infrared Survey Telescope (WFIRST), as set forth in the New Worlds, New Horizons report (NWNH) in 2010. The WFIRST mission has the ability to improve these measurements by 1-2 orders of magnitude compared to the current state of the art, while simultaneously extending their redshift grasp, greatly improving control of systematic effects, and taking a unified approach to multiple probes that provide complementary physical information and cross-checks of cosmological results. We describe in this annual report the activities of the Science Investigation Team (SIT) "Cosmology with the High Latitude Survey (HLS)" during the year 2017. This team was selected by NASA in December 2015 in order to address the stringent challenges of the WFIRST dark energy (DE) program through the Project's formulation phase. This SIT has elected to jointly address Galaxy Redshift Survey, Weak Lensing and Cluster Growth and thus fully embrace the fact that the imaging and spectroscopic elements of the HLS will be realized as an integrated observing program, and they jointly impose requirements on performance and operations. WFIRST is designed to be able to deliver a definitive result on the origin of cosmic acceleration. It is not optimized for Figure of Merit sensitivity but for control of systematic uncertainties and for having multiple techniques each with multiple cross-checks. Our SIT work focuses on understanding the potential systematics in the WFIRST DE measurements.

Hyper Suprime-Cam (HSC) is a wide-field imaging camera on the prime focus of the 8.2m Subaru telescope on the summit of Maunakea in Hawaii. A team of scientists from Japan, Taiwan and Princeton University is using HSC to carry out a 300-night multi-band imaging survey of the high-latitude sky. The survey includes three layers: the Wide layer will cover 1400 deg$^2$ in five broad bands ($grizy$), with a $5\,\sigma$ point-source depth of $r \approx 26$. The Deep layer covers a total of 26~deg$^2$ in four fields, going roughly a magnitude fainter, while the UltraDeep layer goes almost a magnitude fainter still in two pointings of HSC (a total of 3.5 deg$^2$). Here we describe the instrument, the science goals of the survey, and the survey strategy and data processing. This paper serves as an introduction to a special issue of the Publications of the Astronomical Society of Japan, which includes a large number of technical and scientific papers describing results from the early phases of this survey.

Galaxies exhibit different clustering and quenching properties in clusters, filaments, and the field, but it is still uncertain whether such differences are imprints of the tidal environment on galaxy formation, or if they reflect the variation of the underlying halo mass function across the cosmic web. We measure the dependence of galaxy clustering and quenching on the cosmic web in the Sloan Digital Sky Survey, characterized by the combination of spherical overdensity $\delta_8$ and tidal anisotropy $\alpha_5$ centred on each galaxy. We find that galaxy clustering is a strong function of either $\delta_8$ or $\alpha_5$, and the large-scale galaxy bias shows complex and rich behaviour on the $\delta_8$ vs. $\alpha_5$ plane. Using the mean galaxy colour as a proxy for the average quenched level of galaxies, we find that galaxy quenching is primarily a function of $\delta_8$, with some subtle yet non-trivial dependence on $\alpha_5$ at fixed $\delta_8$. The quenched galaxies generally show stronger small-scale clustering than the star-forming ones at fixed $\delta_8$ or $\alpha_5$, while the characteristic scale at which the amplitude of clustering becomes comparable for both galaxy populations varies with $\delta_8$ and $\alpha_5$. We compare these observed cosmic web dependences of galaxy clustering and quenching with a mock galaxy catalogue constructed from the iHOD model, which places quenched and star-forming galaxies inside dark matter haloes based on the stellar-to-halo mass relation and the halo quenching model --- the $\delta_8$ and $\alpha_5$ dependences of iHOD galaxies are thus solely derived from the cosmic web modulation of the halo mass function. The main observed trends are accounted for extremely well by the iHOD model. Thus any additional direct effect of the large-scale~(${>}5\,h^{-1}{\rm Mpc}$) tidal field on galaxy formation must be extremely weak. [Abridged]

We use ~100 square deg of deep (>28.5 mag arcsec$^{-2}$ in i-band), high-quality (median 0.6 arcsec seeing) imaging data from the Hyper Suprime-Cam (HSC) survey to reveal the halo mass dependence of the surface mass density profiles and outer stellar envelopes of massive galaxies. The i-band images from the HSC survey reach ~4 magnitudes deeper than Sloan Digital Sky Survey and enable us to directly trace stellar mass distributions to 100 kpc without requiring stacking. We conclusively show that, at fixed stellar mass, the stellar profiles of massive galaxies depend on the masses of their dark matter haloes. On average, massive central galaxies with $\log M_{\star, 100\ \mathrm{kpc}}>11.6$ in more massive haloes at 0.3 < z < 0.5 have shallower inner stellar mass density profiles (within ~10-20 kpc) and more prominent outer envelopes. These differences translate into a halo mass dependence of the mass-size relation. Central galaxies in haloes with $\log M_{\rm{Halo}}>14.0$ are ~20% larger in $R_{\mathrm{50}}$ at fixed stellar mass. Such dependence is also reflected in the relationship between the stellar mass within 10 and 100 kpc. Comparing to the mass--size relation, the $\log M_{\star, 100\ \rm{kpc}}$-$\log M_{\star, 10\ \rm{kpc}}$ relation avoids the ambiguity in the definition of size, and can be straightforwardly compared with simulations. Our results demonstrate that, with deep images from HSC, we can quantify the connection between halo mass and the outer stellar halo, which may provide new constraints on the formation and assembly of massive central galaxies.

Understanding cosmic acceleration is one of the key science drivers for astrophysics and high-energy physics in the coming decade (2014 P5 Report). With the Large Synoptic Survey Telescope (LSST) and the Dark Energy Spectroscopic Instrument (DESI) and other new facilities beginning operations soon, we are entering an exciting phase during which we expect an order of magnitude improvement in constraints on dark energy and the physics of the accelerating Universe. This is a key moment for a matching Small Projects portfolio that can (1) greatly enhance the science reach of these flagship projects, (2) have immediate scientific impact, and (3) lay the groundwork for the next stages of the Cosmic Frontier Dark Energy program. In this White Paper, we outline a balanced portfolio that can accomplish these goals through a combination of observational, experimental, and theory and simulation efforts.

The use of high-quality simulated sky catalogs is essential for the success of cosmological surveys. The catalogs have diverse applications, such as investigating signatures of fundamental physics in cosmological observables, understanding the effect of systematic uncertainties on measured signals and testing mitigation strategies for reducing these uncertainties, aiding analysis pipeline development and testing, and survey strategy optimization. The list of applications is growing with improvements in the quality of the catalogs and the details that they can provide. Given the importance of simulated catalogs, it is critical to provide rigorous validation protocols that enable both catalog providers and users to assess the quality of the catalogs in a straightforward and comprehensive way. For this purpose, we have developed the DESCQA framework for the Large Synoptic Survey Telescope Dark Energy Science Collaboration as well as for the broader community. The goal of DESCQA is to enable the inspection, validation, and comparison of an inhomogeneous set of synthetic catalogs via the provision of a common interface within an automated framework. In this paper, we present the design concept and first implementation of DESCQA. In order to establish and demonstrate its full functionality we use a set of interim catalogs and validation tests. We highlight several important aspects, both technical and scientific, that require thoughtful consideration when designing a validation framework, including validation metrics and how these metrics impose requirements on the synthetic sky catalogs.

We study the orientations of satellite galaxies in redMaPPer clusters constructed from the Sloan Digital Sky Survey at $0.1<z<0.35$ to determine whether there is any preferential tendency for satellites to point radially toward cluster centers. We analyze the satellite alignment (SA) signal based on three shape measurement methods (re-Gaussianization, de Vaucouleurs, and isophotal shapes), which trace galaxy light profiles at different radii. The measured SA signal depends on these shape measurement methods. We detect the strongest SA signal in isophotal shapes, followed by de Vaucouleurs shapes. While no net SA signal is detected using re-Gaussianization shapes across the entire sample, the observed SA signal reaches a statistically significant level when limiting to a subsample of higher luminosity satellites. We further investigate the impact of noise, systematics, and real physical isophotal twisting effects in the comparison between the SA signal detected via different shape measurement methods. Unlike previous studies, which only consider the dependence of SA on a few parameters, here we explore a total of 17 galaxy and cluster properties, using a statistical model averaging technique to naturally account for parameter correlations and identify significant SA predictors. We find that the measured SA signal is strongest for satellites with the following characteristics: higher luminosity, smaller distance to the cluster center, rounder in shape, higher bulge fraction, and distributed preferentially along the major axis directions of their centrals. Finally, we provide physical explanations for the identified dependences, and discuss the connection to theories of SA.

We present optimized source galaxy selection schemes for measuring cluster weak lensing (WL) mass profiles unaffected by cluster member dilution from the Subaru Hyper Suprime-Cam Strategic Survey Program (HSC-SSP). The ongoing HSC-SSP survey will uncover thousands of galaxy clusters to $z\lesssim1.5$. In deriving cluster masses via WL, a critical source of systematics is contamination and dilution of the lensing signal by cluster {members, and by foreground galaxies whose photometric redshifts are biased}. Using the first-year CAMIRA catalog of $\sim$900 clusters with richness larger than 20 found in $\sim$140 deg$^2$ of HSC-SSP data, we devise and compare several source selection methods, including selection in color-color space (CC-cut), and selection of robust photometric redshifts by applying constraints on their cumulative probability distribution function (PDF; P-cut). We examine the dependence of the contamination on the chosen limits adopted for each method. Using the proper limits, these methods give mass profiles with minimal dilution in agreement with one another. We find that not adopting either the CC-cut or P-cut methods results in an underestimation of the total cluster mass ($13\pm4\%$) and the concentration of the profile ($24\pm11\%$). The level of cluster contamination can reach as high as $\sim10\%$ at $R\approx 0.24$ Mpc/$h$ for low-z clusters without cuts, while employing either the P-cut or CC-cut results in cluster contamination consistent with zero to within the 0.5% uncertainties. Our robust methods yield a $\sim60\sigma$ detection of the stacked CAMIRA surface mass density profile, with a mean mass of $M_\mathrm{200c} = (1.67\pm0.05({\rm {stat}}))\times 10^{14}\,M_\odot/h$.

We present and characterize the catalog of galaxy shape measurements that will be used for cosmological weak lensing measurements in the Wide layer of the first year of the Hyper Suprime-Cam (HSC) survey. The catalog covers an area of 136.9 deg$^2$ split into six fields, with a mean $i$-band seeing of $0.58$ arcsec and $5\sigma$ point-source depth of $i\sim 26$. Given conservative galaxy selection criteria for first year science, the depth and excellent image quality results in unweighted and weighted source number densities of 24.6 and 21.8 arcmin$^{-2}$, respectively. We define the requirements for cosmological weak lensing science with this catalog, then focus on characterizing potential systematics in the catalog using a series of internal null tests for problems with point-spread function (PSF) modeling, shear estimation, and other aspects of the image processing. We find that the PSF models narrowly meet requirements for weak lensing science with this catalog, with fractional PSF model size residuals of approximately $0.003$ (requirement: 0.004) and the PSF model shape correlation function $\rho_1<3\times 10^{-7}$ (requirement: $4\times 10^{-7}$) at 0.5$^\circ$ scales. A variety of galaxy shape-related null tests are statistically consistent with zero, but star-galaxy shape correlations reveal additive systematics on $>1^\circ$ scales that are sufficiently large as to require mitigation in cosmic shear measurements. Finally, we discuss the dominant systematics and the planned algorithmic changes to reduce them in future data reductions.

Euclid and the Large Synoptic Survey Telescope (LSST) are poised to dramatically change the astronomy landscape early in the next decade. The combination of high cadence, deep, wide-field optical photometry from LSST with high resolution, wide-field optical photometry and near-infrared photometry and spectroscopy from Euclid will be powerful for addressing a wide range of astrophysical questions. We explore Euclid/LSST synergy, ignoring the political issues associated with data access to focus on the scientific, technical, and financial benefits of coordination. We focus primarily on dark energy cosmology, but also discuss galaxy evolution, transient objects, solar system science, and galaxy cluster studies. We concentrate on synergies that require coordination in cadence or survey overlap, or would benefit from pixel-level co-processing that is beyond the scope of what is currently planned, rather than scientific programs that could be accomplished only at the catalog level without coordination in data processing or survey strategies. We provide two quantitative examples of scientific synergies: the decrease in photo-z errors (benefitting many science cases) when high resolution Euclid data are used for LSST photo-z determination, and the resulting increase in weak lensing signal-to-noise ratio from smaller photo-z errors. We briefly discuss other areas of coordination, including high performance computing resources and calibration data. Finally, we address concerns about the loss of independence and potential cross-checks between the two missions and potential consequences of not collaborating.

We present a joint X-ray, optical and weak-lensing analysis for X-ray luminous galaxy clusters selected from the MCXC (Meta-Catalog of X-Ray Detected Clusters of Galaxies) cluster catalog in the Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP) survey field with S16A data, As a pilot study of our planned series papers, we measure hydrostatic equilibrium (H.E.) masses using XMM-Newton data for four clusters in the current coverage area out of a sample of 22 MCXC clusters. We additionally analyze a non-MCXC cluster associated with one MCXC cluster. We show that H.E. masses for the MCXC clusters are correlated with cluster richness from the CAMIRA catalog (Oguri et al. 2017), while that for the non-MCXC cluster deviates from the scaling relation. The mass normalization of the relationship between the cluster richness and H.E. mass is compatible with one inferred by matching CAMIRA cluster abundance with a theoretical halo mass function. The mean gas mass fraction based on H.E. masses for the MCXC clusters is $\langle f_{\rm gas} \rangle = 0.125\pm0.012$ at spherical overdensity $\Delta=500$, which is $\sim80-90$ percent of the cosmic mean baryon fraction, $\Omega_b/\Omega_m$, measured by cosmic microwave background experiments. We find that the mean baryon fraction estimated from X-ray and HSC-SSP optical data is comparable to $\Omega_b/\Omega_m$. A weak-lensing shear catalog of background galaxies, combined with photometric redshifts, is currently available only for three clusters in our sample. Hydrostatic equilibrium masses roughly agree with weak-lensing masses, albeit with large uncertainty. This study demonstrates that further multiwavelength study for a large sample of clusters using X-ray, HSC-SSP optical and weak lensing data will enable us to understand cluster physics and utilize cluster-based cosmology.

Weak gravitational lensing, the deflection of light by mass, is one of the best tools to constrain the growth of cosmic structure with time and reveal the nature of dark energy. I discuss the sources of systematic uncertainty in weak lensing measurements and their theoretical interpretation, including our current understanding and other options for future improvement. These include long-standing concerns such as the estimation of coherent shears from galaxy images or redshift distributions of galaxies selected based on photometric redshifts, along with systematic uncertainties that have received less attention to date because they are subdominant contributors to the error budget in current surveys. I also discuss methods for automated systematics detection using survey data of the 2020s. The goal of this review is to describe the current state of the field and what must be done so that if weak lensing measurements lead toward surprising conclusions about key questions such as the nature of dark energy, those conclusions will be credible.

We present a statistical study of the redshift evolution of the cluster galaxy population over a wide redshift range from 0.1 to 1.1, using $\sim 1900$ optically-selected CAMIRA clusters from $\sim 232$~deg$^2$ of the Hyper Suprime-Cam (HSC) Wide S16A data. Our stacking technique with a statistical background subtraction reveals color-magnitude diagrams of red-sequence and blue cluster galaxies down to faint magnitudes of $m_z\sim 24$. We find that the linear relation of red-sequence galaxies in the color-magnitude diagram extends down to the faintest magnitudes we explore with a small intrinsic scatter $\sigma_{\rm int}(g-r)<0.1$. The scatter does not evolve significantly with redshift. The stacked color-magnitude diagrams are used to define red and blue galaxies in clusters for studying their radial number density profiles without resorting to photometric redshifts of individual galaxies. We find that red galaxies are significantly more concentrated toward cluster centers and blue galaxies dominate the outskirt of clusters. We explore the fraction of red galaxies in clusters as a function of redshift, and find that the red fraction decreases with increasing distances from cluster centers. The red fraction exhibits a moderate decrease with increasing redshift. The radial number density profiles of cluster member galaxies are also used to infer the location of the steepest slope in the three dimensional galaxy density profiles. For a fixed threshold in richness, we find little redshift evolution in this location.

We study the covariance properties of real space correlation function estimators -- primarily galaxy-shear correlations, or galaxy-galaxy lensing -- using SDSS data for both shear catalogs and lenses (specifically the BOSS LOWZ sample). Using mock catalogs of lenses and sources, we disentangle the various contributions to the covariance matrix and compare them with a simple analytical model. We show that not subtracting the lensing measurement around random points from the measurement around the lens sample is equivalent to performing the measurement using the lens density field instead of the lens over-density field. While the measurement using the lens density field is unbiased (in the absence of systematics), its error is significantly larger due to an additional term in the covariance. Therefore, this subtraction should be performed regardless of its beneficial effects on systematics. Comparing the error estimates from data and mocks for estimators that involve the over-density, we find that the errors are dominated by the shape noise and lens clustering, that empirically estimated covariances (jackknife and standard deviation across mocks) are consistent with theoretical estimates, and that both the connected parts of the 4-point function and the super-sample covariance can be neglected for the current levels of noise. While the trade-off between different terms in the covariance depends on the survey configuration (area, source number density), the diagnostics that we use in this work should be useful for future works to test their empirically-determined covariances.

The Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP) is a three-layered imaging survey aimed at addressing some of the most outstanding questions in astronomy today, including the nature of dark matter and dark energy. The survey has been awarded 300 nights of observing time at the Subaru Telescope and it started in March 2014. This paper presents the first public data release of HSC-SSP. This release includes data taken in the first 1.7 years of observations (61.5 nights) and each of the Wide, Deep, and UltraDeep layers covers about 108, 26, and 4 square degrees down to depths of i~26.4, ~26.5, and ~27.0 mag, respectively (5sigma for point sources). All the layers are observed in five broad bands (grizy), and the Deep and UltraDeep layers are observed in narrow bands as well. We achieve an impressive image quality of 0.6 arcsec in the i-band in the Wide layer. We show that we achieve 1-2 per cent PSF photometry (rms) both internally and externally (against Pan-STARRS1), and ~10 mas and 40 mas internal and external astrometric accuracy, respectively. Both the calibrated images and catalogs are made available to the community through dedicated user interfaces and database servers. In addition to the pipeline products, we also provide value-added products such as photometric redshifts and a collection of public spectroscopic redshifts. Detailed descriptions of all the data can be found online. The data release website is https://hsc-release.mtk.nao.ac.jp/.

We present wide-field (167 deg$^2$) weak lensing mass maps from the Hyper Supreme-Cam Subaru Strategic Program (HSC-SSP). We compare these weak lensing based dark matter maps with maps of the distribution of the stellar mass associated with luminous red galaxies. We find a strong correlation between these two maps with a correlation coefficient of $\rho=0.54\pm0.03$ (for a smoothing size of $8'$). This correlation is detected even with a smaller smoothing scale of $2'$ ($\rho=0.34\pm 0.01$). This detection is made uniquely possible because of the high source density of the HSC-SSP weak lensing survey ($\bar{n}\sim 25$ arcmin$^{-2}$). We also present a variety of tests to demonstrate that our maps are not significantly affected by systematic effects. By using the photometric redshift information associated with source galaxies, we reconstruct a three-dimensional mass map. This three-dimensional mass map is also found to correlate with the three-dimensional galaxy mass map. Cross-correlation tests presented in this paper demonstrate that the HSC-SSP weak lensing mass maps are ready for further science analyses.

Recently, several studies have discovered a strong discrepancy between the large-scale clustering biases of two subsamples of galaxy clusters at the same halo mass, split by their average projected membership distances $R_{\mathrm{mem}}$. The level of this discrepancy significantly exceeds the maximum halo assembly bias signal predicted by LCDM. In this study, we explore whether some of the clustering bias differences could be caused by biases in $R_{\mathrm{mem}}$ due to projection effects from other systems along the line-of-sight. We thoroughly investigate the halo assembly bias of the photometrically-detected redMaPPer clusters in SDSS, by defining a new variant of the average membership distance estimator $\tilde{R}_{\mathrm{mem}}$ that is more robust against projection effects in the cluster membership identification. Using the angular mark correlation functions of clusters, we show that the large-scale bias differences when splitting by $R_{\mathrm{mem}}$ can be largely attributed to such projection effects. After splitting by $\tilde{R}_{\mathrm{mem}}$, the anomalously large signal is reduced, giving a ratio of $1.02\pm0.14$ between the two clustering biases as measured from weak lensing. Using a realistic mock cluster catalog, we predict that the bias ratio between two $\tilde{R}_{\mathrm{mem}}$-split subsamples should be $<1.10$, which is at least 60% weaker than the maximum halo assembly bias signal (1.24) when split by halo concentration. Therefore, our results demonstrate that the level of halo assembly bias exhibited by redMaPPer clusters in SDSS is consistent with the LCDM prediction. With a ten-fold increase in cluster numbers, deeper ongoing surveys will enable a more robust detection of halo assembly bias. Our findings also have important implications for how projection effects and their impact on cluster cosmology can be quantified in photometric cluster catalogs.

In this paper, we describe the optical imaging data processing pipeline developed for the Subaru Telescope's Hyper Suprime-Cam (HSC) instrument. The HSC Pipeline builds on the prototype pipeline being developed by the Large Synoptic Survey Telescope's Data Management system, adding customizations for HSC, large-scale processing capabilities, and novel algorithms that have since been reincorporated into the LSST codebase. While designed primarily to reduce HSC Subaru Strategic Program (SSP) data, it is also the recommended pipeline for reducing general-observer HSC data. The HSC pipeline includes high level processing steps that generate coadded images and science-ready catalogs as well as low-level detrending and image characterizations.

The Subaru Strategic Program (SSP) is an ambitious multi-band survey using the Hyper Suprime-Cam (HSC) on the Subaru telescope. The Wide layer of the SSP is both wide and deep, reaching a detection limit of i~26.0 mag. At these depths, it is challenging to achieve accurate, unbiased, and consistent photometry across all five bands. The HSC data are reduced using a pipeline that builds on the prototype pipeline for the Large Synoptic Survey Telescope. We have developed a Python-based, flexible framework to inject synthetic galaxies into real HSC images called SynPipe. Here we explain the design and implementation of SynPipe and generate a sample of synthetic galaxies to examine the photometric performance of the HSC pipeline. For stars, we achieve 1% photometric precision at i~19.0 mag and 6% precision at i~25.0 in the i-band. For synthetic galaxies with single-Sersic profiles, forced CModel photometry achieves 13% photometric precision at i~20.0 mag and 18% precision at i~25.0 in the i-band. We show that both forced PSF and CModel photometry yield unbiased color estimates that are robust to seeing conditions. We identify several caveats that apply to the version of HSC pipeline used for the first public HSC data release (DR1) that need to be taking into consideration. First, the degree to which an object is blended with other objects impacts the overall photometric performance. This is especially true for point sources. Highly blended objects tend to have larger photometric uncertainties, systematically underestimated fluxes and slightly biased colors. Second, >20% of stars at 22.5< i < 25.0 mag can be misclassified as extended objects. Third, the current CModel algorithm tends to strongly underestimate the half-light radius and ellipticity of galaxy with i>21.5 mag.

Recent studies suggest that the quenching properties of galaxies are correlated over several mega-parsecs. The large-scale "galactic conformity" phenomenon around central galaxies has been regarded as a potential signature of "galaxy assembly bias" or "pre-heating", both of which interpret conformity as a result of direct environmental effects acting on galaxy formation. Building on the iHOD halo quenching framework developed in Zu & Mandelbaum (2015, 2016), we discover that our fiducial halo mass quenching model, without any galaxy assembly bias, can successfully explain the overall environmental dependence and the conformity of galaxy colours in SDSS, as measured by the mark correlation functions of galaxy colours and the red galaxy fractions around isolated primaries, respectively. Our fiducial iHOD halo quenching mock also correctly predicts the differences in the spatial clustering and galaxy-galaxy lensing signals between the more vs. less red galaxy subsamples, split by the red-sequence ridge-line at fixed stellar mass. Meanwhile, models that tie galaxy colours fully or partially to halo assembly bias have difficulties in matching all these observables simultaneously. Therefore, we demonstrate that the observed environmental dependence of galaxy colours can be naturally explained by the combination of 1) halo quenching and 2) the variation of halo mass function with environment --- an indirect environmental effect mediated by two separate physical processes.

We perform a measurement of the mass--richness relation of the redMaPPer galaxy cluster catalogue using weak lensing data from the Sloan Digital Sky Survey. We have carefully characterized a broad range of systematic uncertainties, including shear calibration errors, photo-$z$ biases, dilution by member galaxies, source obscuration, magnification bias, incorrect assumptions about cluster mass profiles, cluster centering, halo triaxiality, and projection effects. We also compare measurements of the lensing signal from two independently-produced shear and photometric redshift catalogues to characterize systematic errors in the lensing signal itself. Using a sample of 5,570 clusters from $0.1\le z\le 0.33$, the normalization of our power-law mass vs.\ $\lambda$ relation is $\log_{10}[M_{200m}/h^{-1}\ M_{\odot}]$ = $14.344 \pm 0.021$ (statistical) $\pm 0.023$ (systematic) at a richness $\lambda=40$, a 7 per cent calibration uncertainty, with a power-law index of $1.33^{+0.09}_{-0.10}$ ($1\sigma$). The detailed systematics characterization in this work renders it the definitive weak lensing mass calibration for SDSS redMaPPer clusters at this time.

The use of large, X-ray selected galaxy cluster catalogues for cosmological analyses requires a thorough understanding of the X-ray mass estimates. Weak gravitational lensing is an ideal method to shed light on such issues, due to its insensitivity to the cluster dynamical state. We perform a weak lensing calibration of 166 galaxy clusters from the REFLEX and BCS cluster catalogue and compare our results to the X-ray masses based on scaled luminosities from that catalogue. To interpret the weak lensing signal in terms of cluster masses, we compare the lensing signal to simple theoretical Navarro-Frenk-White models and to simulated cluster lensing profiles, including complications such as cluster substructure, projected large-scale structure, and Eddington bias. We find evidence of underestimation in the X-ray masses, as expected, with $\langle M_{\mathrm{X}}/M_{\mathrm{WL}}\rangle = 0.75 \pm 0.07$ stat. $\pm 0.05$ sys. for our best-fit model. The biases in cosmological parameters in a typical cluster abundance measurement that ignores this mass bias will typically exceed the statistical errors.

Galaxy-scale strong gravitational lensing is not only a valuable probe of the dark matter distribution of massive galaxies, but can also provide valuable cosmological constraints, either by studying the population of strong lenses or by measuring time delays in lensed quasars. Due to the rarity of galaxy-scale strongly lensed systems, fast and reliable automated lens finding methods will be essential in the era of large surveys such as LSST, Euclid, and WFIRST. To tackle this challenge, we introduce CMU DeepLens, a new fully automated galaxy-galaxy lens finding method based on Deep Learning. This supervised machine learning approach does not require any tuning after the training step which only requires realistic image simulations of strongly lensed systems. We train and validate our model on a set of 20,000 LSST-like mock observations including a range of lensed systems of various sizes and signal-to-noise ratios (S/N). We find on our simulated data set that for a rejection rate of non-lenses of 99%, a completeness of 90% can be achieved for lenses with Einstein radii larger than 1.4" and S/N larger than 20 on individual $g$-band LSST exposures. Finally, we emphasize the importance of realistically complex simulations for training such machine learning methods by demonstrating that the performance of models of significantly different complexities cannot be distinguished on simpler simulations. We make our code publicly available at https://github.com/McWilliamsCenter/CMUDeepLens .

One of the primary limiting sources of systematic uncertainty in forthcoming weak lensing measurements is systematic uncertainty in the quantitative relationship between the distortions due to gravitational lensing and the measurable properties of galaxy images. We present a statistically principled, general solution to this problem. Our technique infers multiplicative shear calibration parameters by modifying the actual survey data to simulate the effects of a known shear. It can be applied to any shear estimation method based on weighted averages of galaxy shape measurements, which includes all methods used to date for shear estimation with real data. Use of the real images mitigates uncertainty due to unknown galaxy morphology, which is a serious concern for calibration of shear estimates based on image simulations. We test our results on simulated images from the GREAT3 challenge, and show that the method eliminates calibration biases for several different shape measurement techniques at the level of precision measurable with the GREAT3 simulations (a few tenths of a percent).

We study the effects of filaments on galaxy properties in the Sloan Digital Sky Survey (SDSS) Data Release 12 using filaments from the `Cosmic Web Reconstruction' catalogue (Chen et al. 2016), a publicly available filament catalogue for SDSS. Since filaments are tracers of medium-to-high density regions, we expect that galaxy properties associated with the environment are dependent on the distance to the nearest filament. Our analysis demonstrates that a red galaxy or a high-mass galaxy tend to reside closer to filaments than a blue or low-mass galaxy. After adjusting the effect from stellar mass, on average, early-forming galaxies or large galaxies have a shorter distance to filaments than late-forming galaxies or small galaxies. For the Main galaxy sample (MGS), all signals are very significant ($>6\sigma$). For the LOWZ and CMASS sample, the stellar mass and size are significant ($>2 \sigma$). The filament effects we observe persist until $z = 0.7$ (the edge of the CMASS sample). Comparing our results to those using the galaxy distances from redMaPPer galaxy clusters as a reference, we find a similar result between filaments and clusters. Moreover, we find that the effect of clusters on the stellar mass of nearby galaxies depends on the galaxy's filamentary environment. Our findings illustrate the strong correlation of galaxy properties with proximity to density ridges, strongly supporting the claim that density ridges are good tracers of filaments.

We measure a combination of gravitational lensing, galaxy clustering, and redshift-space distortions called $E_G$. The quantity $E_G$ probes both parts of metric potential and is insensitive to galaxy bias and $\sigma_8$. These properties make it an attractive statistic to test $\Lambda$CDM, General Relativity and its alternate theories. We have combined CMASS DR11 with CFHTLenS and recent measurements of $\beta$ from RSD analysis, and find $E_G(z = 0.57) = 0.42 \pm 0.056$, an 13\% measurement in agreement with the prediction of general relativity $E_G(z = 0.57) = 0.396 \pm 0.011$ using the Planck 2015 cosmological parameters. We have corrected our measurement for various observational and theoretical systematics. Our measurement is consistent with the first measurement of $E_G$ using CMB lensing in place of galaxy lensing (Pullen et. al. 2015a) at small scales, but shows 2.8$\sigma$ tension when compared with their final results including large scales. This analysis with future surveys will provide improved statistical error and better control over systematics to test General Relativity and its alternate theories.

Understanding the nature of dark energy, the mysterious force driving the accelerated expansion of the Universe, is a major challenge of modern cosmology. The next generation of cosmological surveys, specifically designed to address this issue, rely on accurate measurements of the apparent shapes of distant galaxies. However, shape measurement methods suffer from various unavoidable biases and therefore will rely on a precise calibration to meet the accuracy requirements of the science analysis. This calibration process remains an open challenge as it requires large sets of high quality galaxy images. To this end, we study the application of deep conditional generative models in generating realistic galaxy images. In particular we consider variations on conditional variational autoencoder and introduce a new adversarial objective for training of conditional generative networks. Our results suggest a reliable alternative to the acquisition of expensive high quality observations for generating the calibration data needed by the next generation of cosmological surveys.

We present high signal-to-noise galaxy-galaxy lensing measurements of the BOSS CMASS sample using 250 square degrees of weak lensing data from CFHTLenS and CS82. We compare this signal with predictions from mock catalogs trained to match observables including the stellar mass function and the projected and two dimensional clustering of CMASS. We show that the clustering of CMASS, together with standard models of the galaxy-halo connection, robustly predicts a lensing signal that is 20-40% larger than observed. Detailed tests show that our results are robust to a variety of systematic effects. Lowering the value of $S_{\rm 8}=\sigma_{\rm 8} \sqrt{\Omega_{\rm m}/0.3}$ compared to Planck2015 reconciles the lensing with clustering. However, given the scale of our measurement ($r<10$ $h^{-1}$ Mpc), other effects may also be at play and need to be taken into consideration. We explore the impact of baryon physics, assembly bias, massive neutrinos, and modifications to general relativity on $\Delta\Sigma$ and show that several of these effects may be non-negligible given the precision of our measurement. Disentangling cosmological effects from the details of the galaxy-halo connection, the effects of baryons, and massive neutrinos, is the next challenge facing joint lensing and clustering analyses. This is especially true in the context of large galaxy samples from Baryon Acoustic Oscillation surveys with precise measurements but complex selection functions.

The Large Synoptic Survey Telescope (LSST) will be a discovery machine for the astronomy and physics communities, revealing astrophysical phenomena from the Solar System to the outer reaches of the observable Universe. While many discoveries will be made using LSST data alone, taking full scientific advantage of LSST will require ground-based optical-infrared (OIR) supporting capabilities, e.g., observing time on telescopes, instrumentation, computing resources, and other infrastructure. This community-based study identifies, from a science-driven perspective, capabilities that are needed to maximize LSST science. Expanding on the initial steps taken in the 2015 OIR System Report, the study takes a detailed, quantitative look at the capabilities needed to accomplish six representative LSST-enabled science programs that connect closely with scientific priorities from the 2010 decadal surveys. The study prioritizes the resources needed to accomplish the science programs and highlights ways that existing, planned, and future resources could be positioned to accomplish the science goals.

We present results from cross-correlating Planck CMB lensing maps with the Sloan Digital Sky Survey (SDSS) galaxy lensing shape catalog and BOSS galaxy catalogs. For galaxy position vs. CMB lensing cross-correlations, we measure the convergence signal around the galaxies in configuration space, using the BOSS LOWZ ($z\sim0.30$) and CMASS ($z\sim0.57$) samples. With fixed Planck 2015 cosmology, doing a joint fit with the galaxy clustering measurement, for the LOWZ (CMASS) sample we find a galaxy bias $b_g=1.75\pm0.04$ ($1.95\pm 0.02$) and galaxy-matter cross-correlation coefficient $r_{cc}=1.0\pm0.2$ ($0.8\pm 0.1$) using $20<r_p<70h^{-1}$Mpc, consistent with results from galaxy-galaxy lensing. Using the same scales and including the galaxy-galaxy lensing measurements, we constrain $\Omega_m=0.284\pm0.024$ and relative calibration bias between the CMB lensing and galaxy lensing to be $b_\gamma=0.82^{+0.15}_{-0.14}$. The combination of galaxy lensing and CMB lensing also allows us to measure the cosmological distance ratios (with $z_l\sim0.3$, $z_s\sim0.5$) $\mathcal R=\frac{D_s D_{l,*}}{D_* D_{l,s}}=2.68\pm0.29$, consistent with predictions from the Planck 2015 cosmology ($\mathcal R=2.35$). We detect the galaxy position-CMB convergence cross-correlation at small scales, $r_p<1h^{-1}$Mpc, and find consistency with lensing by NFW halos of mass $M_h\sim10^{13}h^{-1}M_\odot$. Finally, we measure the CMB lensing-galaxy shear cross-correlation, finding an amplitude of $A=0.76\pm0.23$ ($z_\text{eff}=0.35$, $\theta<2^\circ$) with respect to Planck 2015 $\Lambda$CDM predictions ($1\sigma$-level consistency). We do not find evidence for relative systematics between the CMB and SDSS galaxy lensing.

The shapes of cluster central galaxies are not randomly oriented, but rather exhibit coherent alignments with the shapes of their parent clusters as well as with the surrounding large-scale structures. In this work, we aim to identify the galaxy and cluster quantities that most strongly predict the central galaxy alignment phenomenon among a large parameter space with a sample of 8237 clusters and 94817 members within 0.1<z<0.35, based on the redMaPPer cluster catalog constructed from the Sloan Digital Sky Survey. We first quantify the alignment between the projected central galaxy shapes and the distribution of member satellites, to understand what central galaxy and cluster properties most strongly correlate with these alignments. Next, we investigate the angular segregation of satellites with respect to their central galaxy major axis directions, to identify the satellite properties that most strongly predict their angular segregation. We find that central galaxies are more aligned with their member galaxy distributions in clusters that are more elongated and have higher richness, and for central galaxies with larger physical size, higher luminosity and centering probability, and redder color. Satellites with redder color, higher luminosity, located closer to the central galaxy, and with smaller ellipticity show a stronger angular segregation toward their central galaxy major axes. Finally, we provide physical explanations for some of the identified correlations, and discuss the connection to theories of central galaxy alignments, the impact of primordial alignments with tidal fields, and the importance of anisotropic accretion.

We study the shapes and intrinsic alignments of disks and elliptical galaxies in the MassiveBlack-II (MBII) and Illustris cosmological hydrodynamic simulations, with volumes of $(100h^{-1}Mpc)^{3}$ and $(75h^{-1}Mpc)^{3}$ respectively. We find that simulated disk galaxies are more oblate in shape and more misaligned with the shape of their host dark matter subhalo when compared with ellipticals. The disk major axis is found to be oriented towards the location of nearby elliptical galaxies. We also find that the disks are thinner in MBII and misalignments with dark matter halo orientations are smaller in both disks and ellipticals when compared with Illustris. As a result, the intrinsic alignment correlation functions at fixed mass have a higher amplitude in MBII than in Illustris. Finally, at scales above $\sim 0.1$\hmpc, the intrinsic alignment two-point correlation functions for disk galaxies in both simulations are consistent with a null detection, unlike those for ellipticals. Despite significant differences in the treatments of hydrodynamics and baryonic physics in the simulations, we find that the $w_{\delta +}$ correlation function scales similarly with transverse separation. However, the less massive galaxies show different scale dependence in the ED correlation. This result indicates that, while hydrodynamic simulations are a promising tool to study intrinsic alignments, further study is needed to understand the impact of differences in the implementations of hydrodynamics and baryonic feedback.

Unlike optical CCDs, near-infrared detectors, which are based on CMOS hybrid readout technology, typically suffer from electrical crosstalk between the pixels. The interpixel capacitance (IPC) responsible for the crosstalk affects the point-spread function (PSF) of the telescope, increasing the size and modifying the shape of all objects in the images while correlating the Poisson noise. Upcoming weak lensing surveys that use these detectors, such as WFIRST, place stringent requirements on the PSF size and shape (and the level at which these are known), which in turn must be translated into requirements on IPC. To facilitate this process, we present a first study of the effect of IPC on WFIRST PSF sizes and shapes. Realistic PSFs are forward-simulated from physical principles for each WFIRST bandpass. We explore how the PSF size and shape depends on the range of IPC coupling with pixels that are connected along an edge or corner; for the expected level of IPC in WFIRST, IPC increases the PSF sizes by $\sim$5\%. We present a linear fitting formula that describes the uncertainty in the PSF size or shape due to uncertainty in the IPC, which could arise for example due to unknown time evolution of IPC as the detectors age or due to spatial variation of IPC across the detector. We also study of the effect of a small anisotropy in the IPC, which further modifies the PSF shapes. Our results are a first, critical step in determining the hardware and characterization requirements for the detectors used in the WFIRST survey.

Weak gravitational lensing (WL) is one of the most powerful techniques to learn about the dark sector of the universe. To extract the WL signal from astronomical observations, galaxy shapes must be measured and corrected for the point spread function (PSF) of the imaging system with extreme accuracy. Future WL missions (such as the Wide-Field Infrared Survey Telescope, WFIRST) will use a family of hybrid nearinfrared CMOS detectors (HAWAII-4RG) that are untested for accurate WL measurements. Like all image sensors, these devices are subject to conversion gain nonlinearities (voltage response to collected photo-charge) that bias the shape and size of bright objects such as reference stars that are used in PSF determination. We study this type of detector nonlinearity (NL) and show how to derive requirements on it from WFIRST PSF size and ellipticity requirements. We simulate the PSF optical profiles expected for WFIRST and measure the fractional error in the PSF size and the absolute error in the PSF ellipticity as a function of star magnitude and the NL model. For our nominal NL model (a quadratic correction), we find that, uncalibrated, NL can induce an error of 0.01 (fractional size) and 0.00175 (absolute ellipticity error) in the H158 bandpass for the brightest unsaturated stars in WFIRST. In addition, our simulations show that to limit the bias of the size and ellipticity errors in the H158 band to approximately 10% of the estimated WFIRST error budget, the parameter of our quadratic NL model must be calibrated to about 1% and 2.4%, respectively. We present a fitting formula that can be used to estimate WFIRST detector NL requirements once a true PSF error budget is established.

Measurements of intrinsic alignments of galaxy shapes with the large-scale density field, and the inferred intrinsic alignments model parameters, are sensitive to the shape measurement methods used. In this paper we measure the intrinsic alignments of the Sloan Digital Sky Survey-III (SDSS-III) Baryon Oscillation Spectroscopic Survey (BOSS) LOWZ galaxies using three different shape measurement methods (re-Gaussianization, isophotal, and de Vaucouleurs), identifying a variation in the inferred intrinsic alignments amplitude at the 40% level between these methods, independent of the galaxy luminosity or other properties. We also carry out a suite of systematics tests on the shapes and their two-point correlation functions, identifying a pronounced contribution from additive PSF systematics in the de Vaucouleurs shapes. Since different methods measure galaxy shapes at different effective radii, the trends we identify in the intrinsic alignments amplitude are consistent with the interpretation that the outer regions of galaxy shapes are more responsive to tidal fields, resulting in isophote twisting and stronger alignments for isophotal shapes. We observe environment dependence of ellipticity, with brightest galaxies in groups being rounder on average compared to satellite and field galaxies. We also study the anisotropy in intrinsic alignments measurements introduced by projected shapes, finding effects consistent with predictions of the nonlinear alignment model and hydrodynamic simulations. The large variations seen using the different shape measurement methods have important implications for intrinsic alignments forecasting and mitigation with future surveys.

The fact that the clustering of dark matter halos depends not only on their mass, but also the formation epoch, is a prominent, albeit subtle, feature of the cold dark matter structure formation theory, and is known as assembly bias. At low mass scales ($\sim 10^{12}\,h^{-1}M_\odot$), early-forming halos are predicted to be more strongly clustered than the late-forming ones. In this study we aim to robustly detect the signature of assembly bias observationally, making use of formation time indicators of central galaxies in low mass halos as a proxy for the halo formation history. Weak gravitational lensing is employed to ensure our early- and late-forming halo samples have similar masses, and are free of contamination of satellites from more massive halos. For the two formation time indicators used (resolved star formation history and current specific star formation rate), we do not find convincing evidence of assembly bias. For a pair of early- and late-forming galaxy samples with mean mass $M_{200c} \approx 9\times10^{11}\,h^{-1}M_\odot$, the relative bias is $1.00\pm 0.12$. We attribute the lack of detection to the possibilities that either the current measurements of these indicators are too noisy, or they do not correlate well with the halo formation history. Alternative proxies for the halo formation history that should perform better are suggested for future studies.

We present significant evidence of halo assembly bias for SDSS redMaPPer galaxy clusters in the redshift range $[0.1, 0.33]$. By dividing the 8,648 clusters into two subsamples based on the average member galaxy separation from the cluster center, we first show that the two subsamples have very similar halo mass of $M_{\rm 200m}\simeq 1.9\times 10^{14}~h^{-1}M_\odot$ based on the weak lensing signals at small radii $R<\sim 10~h^{-1}{\rm Mpc}$. However, their halo bias inferred from both the large-scale weak lensing and the projected auto-correlation functions differs by a factor of $\sim$1.5, which is a signature of assembly bias. The same bias hypothesis for the two subsamples is excluded at 2.5$\sigma$ in the weak lensing and 4.4$\sigma$ in the auto-correlation data, respectively. This result could bring a significant impact on both galaxy evolution and precision cosmology.

We show that the projected number density profiles of SDSS photometric galaxies around galaxy clusters displays strong evidence for the splashback radius, a sharp halo edge corresponding to the location of the first orbital apocenter of satellite galaxies after their infall. We split the clusters into two subsamples with different mean projected radial distances of their members, $\langle R_{\rm mem}\rangle$, at fixed richness and redshift, and show that the sample with smaller $\langle R_{\rm mem}\rangle$ has a smaller ratio of the splashback radius to the traditional halo boundary $R_{\rm 200m}$, than the subsample with larger $\langle R_{\rm mem}\rangle$, indicative of different mass accretion rates for the two subsamples. The same cluster samples were recently used by Miyatake et al. to show that their large-scale clustering differs despite their similar weak lensing masses, demonstrating strong evidence for halo assembly bias. We expand on this result by presenting a 6.6-$\sigma$ detection of halo assembly bias using the cluster-photometric galaxy cross-correlations. Our measured splashback radii are smaller, while the strength of the assembly bias signal is stronger, than expectations from N-body simulations based on the $\Lambda$-dominated, cold dark matter structure formation model. Dynamical friction or cluster-finding systematics such as miscentering or projection effects are not likely to be the sole source of these discrepancies.

We use galaxy-galaxy lensing to study the dark matter halos surrounding a sample of Locally Brightest Galaxies (LBGs) selected from the Sloan Digital Sky Survey. We measure mean halo mass as a function of the stellar mass and colour of the central galaxy. Mock catalogues constructed from semi-analytic galaxy formation simulations demonstrate that most LBGs are the central objects of their halos, greatly reducing interpretation uncertainties due to satellite contributions to the lensing signal. Over the full stellar mass range, $10.3 < \log [M_*/M_\odot] < 11.6$, we find that passive central galaxies have halos that are at least twice as massive as those of star-forming objects of the same stellar mass. The significance of this effect exceeds $3\sigma$ for $\log [M_*/M_\odot] > 10.7$. Tests using the mock catalogues and on the data themselves clarify the effects of LBG selection and show that it cannot artificially induce a systematic dependence of halo mass on LBG colour. The bimodality in halo mass at fixed stellar mass is reproduced by the astrophysical model underlying our mock catalogue, but the sign of the effect is inconsistent with recent, nearly parameter-free age-matching models. The sign and magnitude of the effect can, however, be reproduced by halo occupation distribution models with a simple (few-parameter) prescription for type-dependence.

The robust estimation of the tiny distortions (shears) of galaxy shapes caused by weak gravitational lensing in the presence of much larger shape distortions due to the point-spread function (PSF) has been widely investigated. One major problem is that most galaxy shape measurement methods are subject to bias due to pixel noise in the images ("noise bias"). Noise bias is usually characterized using uncorrelated noise fields; however, real images typically have low-level noise correlations due to galaxies below the detection threshold, and some types of image processing can induce further noise correlations. We investigate the effective detection significance and its impact on noise bias in the presence of correlated noise for one method of galaxy shape estimation. For a fixed noise variance, the biases in galaxy shape estimates can differ substantially for uncorrelated versus correlated noise. However, use of an estimate of detection significance that accounts for the noise correlations can almost entirely remove these differences, leading to consistent values of noise bias as a function of detection significance for correlated and uncorrelated noise. We confirm the robustness of this finding to properties of the galaxy, the PSF, and the noise field, and quantify the impact of anisotropy in the noise correlations. Our results highlight the importance of understanding the pixel noise model and its impact on detection significances when correcting for noise bias on weak lensing.

The shapes of galaxies are not randomly oriented on the sky. During the galaxy formation and evolution process, environment has a strong influence, as tidal gravitational fields in the large-scale structure tend to align nearby galaxies. Additionally, events such as galaxy mergers affect the relative alignments of both the shapes and angular momenta of galaxies throughout their history. These "intrinsic galaxy alignments" are known to exist, but are still poorly understood. This review will offer a pedagogical introduction to the current theories that describe intrinsic galaxy alignments, including the apparent difference in intrinsic alignment between early- and late-type galaxies and the latest efforts to model them analytically. It will then describe the ongoing efforts to simulate intrinsic alignments using both N-body and hydrodynamic simulations. Due to the relative youth of this field, there is still much to be done to understand intrinsic galaxy alignments and this review summarises the current state of the field, providing a solid basis for future work.

The alignments between galaxies, their underlying matter structures, and the cosmic web constitute vital ingredients for a comprehensive understanding of gravity, the nature of matter, and structure formation in the Universe. We provide an overview on the state of the art in the study of these alignment processes and their observational signatures, aimed at a non-specialist audience. The development of the field over the past one hundred years is briefly reviewed. We also discuss the impact of galaxy alignments on measurements of weak gravitational lensing, and discuss avenues for making theoretical and observational progress over the coming decade.

Galaxy shapes are not randomly oriented, rather they are statistically aligned in a way that can depend on formation environment, history and galaxy type. Studying the alignment of galaxies can therefore deliver important information about the physics of galaxy formation and evolution as well as the growth of structure in the Universe. In this review paper we summarise key measurements of galaxy alignments, divided by galaxy type, scale and environment. We also cover the statistics and formalism necessary to understand the observations in the literature. With the emergence of weak gravitational lensing as a precision probe of cosmology, galaxy alignments have taken on an added importance because they can mimic cosmic shear, the effect of gravitational lensing by large-scale structure on observed galaxy shapes. This makes galaxy alignments, commonly referred to as intrinsic alignments, an important systematic effect in weak lensing studies. We quantify the impact of intrinsic alignments on cosmic shear surveys and finish by reviewing practical mitigation techniques which attempt to remove contamination by intrinsic alignments.

The fundamental plane (FP) is a widely used tool to investigate the properties of early-type galaxies, and the tight relation between its parameters has spawned several cosmological applications, including its use as a distance indicator for peculiar velocity surveys and as a means to suppress intrinsic noise in cosmic size magnification measurements. Systematic trends with the large-scale structure across the FP could cause serious biases for these cosmological probes, but may also yield new insights into the early-type population. Here we report the first detection of spatial correlations among offsets in galaxy size from an FP that explicitly accounts for redshift trends, using a sample of about $95,000$ elliptical galaxies from the Sloan Digital Sky Survey. We show that these offsets correlate with the density field out to at least $10h^{-1}$Mpc at $4\sigma$ significance in a way that cannot be explained by systematic errors in galaxy size estimates. We propose a physical explanation for the correlations by dividing the sample into central, satellite, and field galaxies, identifying trends for each galaxy type separately. Central (satellite) galaxies lie on average above (below) the FP, which we argue could be due to a higher (lower) than average mass-to-light ratio. We fit a simple model to the correlations of FP residuals and use it to predict the impact on peculiar velocity power spectra, finding a contamination larger than $10\,\%$ for $k>0.04\,h/$Mpc. Moreover, cosmic magnification measurements based on an FP could be severely contaminated over a wide range of scales by the intrinsic FP correlations.

We use weak gravitational lensing to measure mean mass profiles around Locally Brightest Galaxies (LBGs). These are selected from the SDSS/DR7 spectroscopic and photometric catalogues to be brighter than any neighbour projected within 1.0 Mpc and differing in redshift by $<1000$ km/s. Most ($> 83\%$) are expected to be the central galaxies of their dark matter halos. Previous stacking analyses have used this LBG sample to measure mean Sunyaev-Zeldovich flux and mean X-ray luminosity as a function of LBG stellar mass. In both cases, a simulation of the formation of the galaxy population was used to estimate effective halo mass for LBGs of given stellar mass, allowing the derivation of scaling relations between the gas properties of halos and their mass. By comparing results from a variety of simulations to our lensing data, we show that this procedure has significant model dependence reflecting: (i) the failure of any given simulation to reproduce observed galaxy abundances exactly; (ii) a dependence on the cosmology underlying the simulation; and (iii) a dependence on the details of how galaxies populate halos. We use our lensing results to recalibrate the scaling relations, eliminating most of this model dependence and explicitly accounting both for residual modelling uncertainties and for observational uncertainties in the lensing results. The resulting scaling relations link the mean gas properties of dark halos to their mass over an unprecedentedly wide range, $10^{12.5}<M_{500}/ \mathrm{M_\odot}<10^{14.5}$, and should fairly and robustly represent the full halo population.

We develop a simple yet comprehensive method to distinguish the underlying drivers of galaxy quenching, using the clustering and galaxy-galaxy lensing of red and blue galaxies in SDSS. Building on the iHOD framework developed by Zu & Mandelbaum (2015a), we consider two quenching scenarios: 1) a "halo" quenching model in which halo mass is the sole driver for turning off star formation in both centrals and satellites; and 2) a "hybrid" quenching model in which the quenched fraction of galaxies depends on their stellar mass while the satellite quenching has an extra dependence on halo mass. The two best-fit models describe the red galaxy clustering and lensing equally well, but halo quenching provides significantly better fits to the blue galaxies above $10^{11} M_\odot/h^2$. The halo quenching model also correctly predicts the average halo mass of the red and blue centrals, showing excellent agreement with the direct weak lensing measurements of locally brightest galaxies. Models in which quenching is not tied to halo mass, including an age-matching model in which galaxy colour depends on halo age at fixed $M_*$, fail to reproduce the observed halo mass for massive blue centrals. We find similar critical halo masses responsible for the quenching of centrals and satellites (~$1.5\times10^{12} M\odot/h^2$), hinting at a uniform quenching mechanism for both, e.g., the virial shock-heating of infalling gas. The success of the iHOD halo quenching model provides strong evidence that the physical mechanism that quenches star formation in galaxies is tied principally to the masses of their dark matter halos rather than the properties of their stellar components.

In this paper, we study the filamentary structures and the galaxy alignment along filaments at redshift $z=0.06$ in the MassiveBlack-II simulation, a state-of-the-art, high-resolution hydrodynamical cosmological simulation which includes stellar and AGN feedback in a volume of (100 Mpc$/h$)$^3$. The filaments are constructed using the subspace constrained mean shift (SCMS; Ozertem & Erdogmus (2011) and Chen et al. (2015a)). First, we show that reconstructed filaments using galaxies and reconstructed filaments using dark matter particles are similar to each other; over $50\%$ of the points on the galaxy filaments have a corresponding point on the dark matter filaments within distance $0.13$ Mpc$/h$ (and vice versa) and this distance is even smaller at high-density regions. Second, we observe the alignment of the major principal axis of a galaxy with respect to the orientation of its nearest filament and detect a $2.5$ Mpc$/h$ critical radius for filament's influence on the alignment when the subhalo mass of this galaxy is between $10^9M_\odot/h$ and $10^{12}M_\odot/h$. Moreover, we find the alignment signal to increase significantly with the subhalo mass. Third, when a galaxy is close to filaments (less than $0.25$ Mpc$/h$), the galaxy alignment toward the nearest galaxy group depends on the galaxy subhalo mass. Finally, we find that galaxies close to filaments or groups tend to be rounder than those away from filaments or groups.

We compare the shapes and intrinsic alignments of galaxies in the MassiveBlack-II cosmological hydrodynamic simulation (MBII) to those in a dark matter-only (DMO) simulation performed with the same volume (100$h^{-1}$Mpc)$^{3}$, cosmological parameters, and initial conditions. Understanding the impact of baryonic physics on galaxy shapes and alignments and their relation to the dark matter distribution should prove useful to map the intrinsic alignments of galaxies from hydrodynamic to dark matter-only simulations. We find that dark matter subhalos are typically rounder in MBII, and the shapes of stellar matter in low mass galaxies are more misaligned with the shapes of the dark matter of the corresponding subhalos in the DMO simulation. At $z=0.06$, the fractional difference in the mean misalignment angle between MBII and DMO simulations varies from $\sim 28 \% - 12 \%$ in the mass range $10^{10.8} - 6.0 \times 10^{14} h^{-1}M_{\odot}$. We study the dark matter halo shapes and alignments as a function of radius, and find that while galaxies in MBII are more aligned with the inner parts of their dark matter subhalos, there is no radial trend in their alignments with the corresponding subhalo in the DMO simulation. This result highlights the importance of baryonic physics in determining the alignment of the galaxy with respect to the inner parts of the halo. Finally, we compare the ellipticity-direction (ED) correlation for galaxies to that for dark matter halos, finding that it is suppressed on all scales by stellar-dark matter misalignment. In the projected shape-density correlation ($w_{\delta+}$), which includes ellipticity weighting, this effect is partially canceled by the higher mean ellipticities of the stellar component, but differences of order $30-40\%$ remain on scales $> 1$ Mpc over a range of subhalo masses, with scale-dependent effects below $1$ Mpc.

The mapping between the distributions of the observed galaxy stellar mass and the underlying dark matter halos provides the crucial link from theories of large-scale structure formation to interpreting the complex phenomena of galaxy formation and evolution. We develop a novel statistical method, based on the Halo Occupation Distribution model (HOD), to solve for this mapping by jointly fitting the galaxy clustering and the galaxy-galaxy lensing measured from the Sloan Digital Sky Survey (SDSS). The method, called the iHOD model, extracts maximum information from the survey by including ~80% more galaxies than the traditional HOD methods, and takes into account the incompleteness of the stellar mass samples in a statistically consistent manner. The derived stellar-to-halo mass relation not only explains the clustering and lensing of SDSS galaxies over almost four decades in stellar mass, but also successfully predicts the stellar mass functions observed in SDSS. Due to its capability of modelling significantly more galaxies, the iHOD is able to break the degeneracy between the logarithmic scatter in the stellar mass at fixed halo mass and the slope of the stellar-to-halo mass relation at high mass end, without the need to assume a strong prior on the scatter and/or use the stellar mass function as an input. We detect a decline of the scatter with halo mass, from 0.22 dex at below 10^{12} Msun to 0.18 dex at 10^{14} Msun. The model also enables stringent constraints on the satellite stellar mass functions at fixed halo mass, predicting a departure from the Schechter functional form in high mass halos. The iHOD model can be easily applied to existing and future spectroscopic datasets, greatly improving the statistical constraint on the stellar-to-halo mass relation compared to the traditional HOD methods within the same survey.

Luminous Red Galaxies (LRG) from the Sloan Digital Sky Survey are considered among the best understood samples of galaxies, and they are employed in a broad range of cosmological studies. Because they form a relatively homogeneous population, with high stellar masses and red colors, they are expected to occupy halos in a relatively simple way. In this paper, we study how LRGs occupy massive halos via direct counts in clusters and we reveal several unexpected trends suggesting that the connection between LRGs and dark matter halos may not be straightforward. Using the redMaPPer cluster catalog, we derive the central occupation of LRGs as a function richness, Ncen({\lambda}). Assuming no correlation between cluster mass and central galaxy luminosity at fixed richness, we show that clusters contain a significantly lower fraction of central LRGs than predicted from the two-point correlation function. At halo masses of 10^14.5 Msun, we find Ncen=0.73, compared to Ncen of 0.89 from correlation studies. Our central occupation function for LRGs converges to 0.95 at large halo masses. A strong anti-correlation between central luminosity and cluster mass at fixed richness is required to reconcile our results with those based on clustering studies. We also derive P_BNC, the probability that the brightest cluster member is not the central galaxy. We find P_BNC ~ 20-30% which is a factor of ~2 lower than the value found by Skibba et al. 2011. Finally, we study the radial offsets of bright non-central LRGs from cluster centers and show that bright non-central LRGs follow a different radial distribution compared to red cluster members, which follow a Navarro-Frank-White profile. This work demonstrates that even the most massive clusters do not always have an LRG at the center, and that the brightest galaxy in a cluster is not always the central galaxy.

Coherent alignments of galaxy shapes, often called "intrinsic alignments" (IA), are the most significant source of astrophysical uncertainty in weak lensing measurements. We develop the tidal alignment model of IA and demonstrate its success in describing observational data. We also describe a technique to separate IA from galaxy-galaxy lensing measurements. Applying this technique to luminous red galaxy lenses in the Sloan Digital Sky Survey, we constrain potential IA contamination from associated sources to be below a few percent.

Intrinsic alignments (IA) of galaxies, i.e. correlations of galaxy shapes with each other or with the density field, are a major astrophysical source of contamination for weak lensing surveys. We present the results of IA measurements of galaxies on 0.1- 200 Mpc/h scales using the SDSS-III BOSS LOWZ sample, in the redshift range 0.16<z<0.36. We extend the existing IA measurements for spectroscopic LRGs to lower luminosities, and show that the luminosity dependence of large-scale IA can be well-described by a power law. Within the limited redshift and color range of our sample, we observe no significant redshift or color dependence of IA. We measure the halo mass of LOWZ galaxies using galaxy-galaxy lensing, and show that the mass dependence of large-scale IA is also well described by a power law. We detect variation in the scale dependence of IA with mass and luminosity, which underscores the need to use flexible templates in order to remove the IA signal. We also study the environment dependence of IA by splitting the sample into field and group galaxies, which are further split into satellite and central galaxies. We show that group central galaxies are aligned with their halos at small scales and also are aligned with the tidal fields out to large scales. We also detect the radial alignments of satellite galaxies within groups, which results in a null detection of large-scale intrinsic alignments for satellites. These results can be used to construct better intrinsic alignment models for removal of this contaminant to the weak lensing signal.

We present first results from the third GRavitational lEnsing Accuracy Testing (GREAT3) challenge, the third in a sequence of challenges for testing methods of inferring weak gravitational lensing shear distortions from simulated galaxy images. GREAT3 was divided into experiments to test three specific questions, and included simulated space- and ground-based data with constant or cosmologically-varying shear fields. The simplest (control) experiment included parametric galaxies with a realistic distribution of signal-to-noise, size, and ellipticity, and a complex point spread function (PSF). The other experiments tested the additional impact of realistic galaxy morphology, multiple exposure imaging, and the uncertainty about a spatially-varying PSF; the last two questions will be explored in Paper II. The 24 participating teams competed to estimate lensing shears to within systematic error tolerances for upcoming Stage-IV dark energy surveys, making 1525 submissions overall. GREAT3 saw considerable variety and innovation in the types of methods applied. Several teams now meet or exceed the targets in many of the tests conducted (to within the statistical errors). We conclude that the presence of realistic galaxy morphology in simulations changes shear calibration biases by $\sim 1$ per cent for a wide range of methods. Other effects such as truncation biases due to finite galaxy postage stamps, and the impact of galaxy type as measured by the S\'{e}rsic index, are quantified for the first time. Our results generalize previous studies regarding sensitivities to galaxy size and signal-to-noise, and to PSF properties such as seeing and defocus. Almost all methods' results support the simple model in which additive shear biases depend linearly on PSF ellipticity.

We present a pedagogical review of the weak gravitational lensing measurement process and its connection to major scientific questions such as dark matter and dark energy. Then we describe common ways of parametrizing systematic errors and understanding how they affect weak lensing measurements. Finally, we discuss several instrumental systematics and how they fit into this context, and conclude with some future perspective on how progress can be made in understanding the impact of instrumental systematics on weak lensing measurements.

We perform a joint analysis of the abundance, the clustering and the galaxy-galaxy lensing signal of galaxies measured from Data Release 11 of the Sloan Digital Sky Survey III Baryon Oscillation Spectroscopic Survey (SDSS III-BOSS) in our companion paper, Miyatake et al. (2014). The lensing signal was obtained by using the shape catalog of background galaxies from the Canada France Hawaii Telescope Legacy Survey, which was made publicly available by the CFHTLenS collaboration, with an area overlap of about 105 deg$^2$. We analyse the data in the framework of the halo model in order to fit halo occupation parameters and cosmological parameters ($\Omega_{\rm m}$ and $\sigma_8$) to these observables simultaneously, and thus break the degeneracy between galaxy bias and cosmology. Adopting a flat $\Lambda$CDM cosmology with priors on $\Omega_b h^2$, $n_{\rm s}$ and $h$ from the analysis of WMAP 9-year data, we obtain constraints on the stellar mass-halo mass relation of galaxies in our sample. Marginalizing over the halo occupation distribution parameters and a number of other nuisance parameters in our model, we obtain $\Omega_{\rm m}=0.310^{+0.019}_{-0.020}$ and $\sigma_8=0.785^{+0.044}_{-0.044}$ (68% confidence). We demonstrate the robustness of our results with respect to sample selection and a variety of systematics such as the halo off-centering effect and possible incompleteness in our sample. Our constraints are consistent, complementary and competitive with those obtained using other independent probes of these cosmological parameters. The cosmological analysis is the first of its kind to be performed at a redshift as high as $0.53$.

A joint analysis of the clustering of galaxies and their weak gravitational lensing signal is well-suited to simultaneously constrain the galaxy-halo connection as well as the cosmological parameters by breaking the degeneracy between galaxy bias and the amplitude of clustering signal. In a series of two papers, we perform such an analysis at the highest redshift ($z\sim0.53$) in the literature using CMASS galaxies in the Sloan Digital Sky Survey-III Baryon Oscillation Spectroscopic Survey Eleventh Data Release (SDSS-III/BOSS DR11) catalog spanning 8300~deg$^2$. In this paper, we present details of the clustering and weak lensing measurements of these galaxies. We define a subsample of 400,916 CMASS galaxies based on their redshifts and stellar mass estimates so that the galaxies constitute an approximately volume-limited and similar population over the redshift range $0.47\le z\le 0.59$. We obtain a signal-to-noise ratio $S/N\simeq 56$ for the galaxy clustering measurement. We also explore the redshift and stellar mass dependence of the clustering signal. For the weak lensing measurement, we use existing deeper imaging data from the CFHTLS with publicly available shape and photometric redshift catalogs from CFHTLenS, but only in a 105~deg$^2$ area which overlaps with BOSS. This restricts the lensing measurement to only 5,084 CMASS galaxies. After careful systematic tests, we find a highly significant detection of the CMASS weak lensing signal, with total $S/N\simeq 26$. These measurements form the basis of the halo occupation distribution and cosmology analysis presented in More et al. (Paper II).

Upcoming weak lensing surveys will survey large cosmological volumes to measure the growth of cosmological structure with time and thereby constrain dark energy. One major systematic uncertainty in this process is the calibration of the weak lensing shape distortions, or shears. Most upcoming surveys plan to test several aspects of their shear estimation algorithms using sophisticated image simulations that include realistic galaxy populations based on high-resolution data from the Hubble Space Telescope (HST). However, existing datasets from the (HST) cover very small cosmological volumes, so cosmic variance could cause the galaxy populations in them to be atypical. A narrow redshift slice from such surveys could be dominated by a single large overdensity or underdensity. In that case, the morphology-density relation could alter the local galaxy populations and yield an incorrect calibration of shear estimates as a function of redshift. We directly test this scenario using the COSMOS survey, the largest-area (HST) survey to date, and show how the statistical distributions of galaxy shapes and morphological parameters (e.g., S\'{e}rsic $n$) are influenced by redshift-dependent cosmic variance. The typical variation in RMS ellipticity due to environmental effects is 5 per cent (absolute, not relative) for redshift bins of width $\Delta z=0.05$, which could result in uncertain shear calibration at the 1 per cent level. We conclude that the cosmic variance effects are large enough to exceed the systematic error budget of future surveys, but can be mitigated with careful choice of training dataset and sufficiently large redshift binning.

The focus of this report is on the opportunities enabled by the combination of LSST, Euclid and WFIRST, the optical surveys that will be an essential part of the next decade's astronomy. The sum of these surveys has the potential to be significantly greater than the contributions of the individual parts. As is detailed in this report, the combination of these surveys should give us multi-wavelength high-resolution images of galaxies and broadband data covering much of the stellar energy spectrum. These stellar and galactic data have the potential of yielding new insights into topics ranging from the formation history of the Milky Way to the mass of the neutrino. However, enabling the astronomy community to fully exploit this multi-instrument data set is a challenging technical task: for much of the science, we will need to combine the photometry across multiple wavelengths with varying spectral and spatial resolution. We identify some of the key science enabled by the combined surveys and the key technical challenges in achieving the synergies.

GALSIM is a collaborative, open-source project aimed at providing an image simulation tool of enduring benefit to the astronomical community. It provides a software library for generating images of astronomical objects such as stars and galaxies in a variety of ways, efficiently handling image transformations and operations such as convolution and rendering at high precision. We describe the GALSIM software and its capabilities, including necessary theoretical background. We demonstrate that the performance of GALSIM meets the stringent requirements of high precision image analysis applications such as weak gravitational lensing, for current datasets and for the Stage IV dark energy surveys of the Large Synoptic Survey Telescope, ESA's Euclid mission, and NASA's WFIRST-AFTA mission. The GALSIM project repository is public and includes the full code history, all open and closed issues, installation instructions, documentation, and wiki pages (including a Frequently Asked Questions section). The GALSIM repository can be found at https://github.com/GalSim-developers/GalSim .

The intrinsic alignment of galaxies with the large-scale density field is an important astrophysical contaminant in upcoming weak lensing surveys. We present detailed measurements of the galaxy intrinsic alignments and associated ellipticity-direction (ED) and projected shape ($w_{g+}$) correlation functions for galaxies in the cosmological hydrodynamic MassiveBlack-II (MB-II) simulation. We carefully assess the effects on galaxy shapes, misalignment of the stellar component with the dark matter shape and two-point statistics of iterative weighted (by mass and luminosity) definitions of the (reduced and unreduced) inertia tensor. We find that iterative procedures must be adopted for a reliable measurement of the reduced tensor but that luminosity versus mass weighting has only negligible effects. Both ED and $w_{g+}$ correlations increase in amplitude with subhalo mass (in the range of $10^{10} - 6.0\times 10^{14}h^{-1}M_{\odot}$), with a weak redshift dependence (from $z=1$ to $z=0.06$) at fixed mass. At $z \sim 0.3$, we predict a $w_{g+}$ that is in reasonable agreement with SDSS LRG measurements and that decreases in amplitude by a factor of $\sim 5$--18 for galaxies in the LSST survey. We also compared the intrinsic alignments of centrals and satellites, with clear detection of satellite radial alignments within their host halos. Finally, we show that $w_{g+}$ (using subhalos as tracers of density) and $w_{\delta+}$ (using dark matter density) predictions from the simulations agree with that of non-linear alignment models (NLA) at scales where the 2-halo term dominates in the correlations (and tabulate associated NLA fitting parameters). The 1-halo term induces a scale dependent bias at small scales which is not modeled in the NLA model.

We present a maximum-likelihood weak lensing analysis of the mass distribution in optically selected spectroscopic Galaxy Groups (G$^3$Cv5) in the Galaxy And Mass Assembly (GAMA) survey, using background Sloan Digital Sky Survey (SDSS) photometric galaxies. The scaling of halo mass, $M_h$, with various group observables is investigated. Our main results are: 1) the measured relations of halo mass with group luminosity, virial volume and central galaxy stellar mass, $M_\star$, agree very well with predictions from mock group catalogues constructed from a GALFORM semi-analytical galaxy formation model implemented in the Millennium $\Lambda$CDM N-body simulation; 2) the measured relations of halo mass with velocity dispersion and projected half-abundance radius show weak tension with mock predictions, hinting at problems in the mock galaxy dynamics and their small scale distribution; 3) the median $M_h|M_\star$ measured from weak lensing depends more sensitively on the lognormal dispersion in $M_\star$ at fixed $M_h$ than it does on the median $M_\star|M_h$. Our measurements suggest an intrinsic dispersion of $\sigma_{\log(M_\star)}\sim 0.15$; 4) Comparing our mass estimates with those in the catalogue, we find that the G$^3$Cv5 mass can give biased results when used to select subsets of the group sample. Of the various new halo mass estimators that we calibrate using our weak lensing measurements, group luminosity is the best single-proxy estimator of group mass.

Intrinsic alignments of galaxies have been shown to contaminate weak gravitational lensing observables on linear scales, $r>$ 10 $h^{-1}$Mpc, but studies of alignments in the non-linear regime have thus far been inconclusive. We present an estimator for extracting the intrinsic alignment signal of galaxies around stacked clusters of galaxies from multiband imaging data. Our estimator removes the contamination caused by galaxies that are gravitationally lensed by the clusters and scattered in redshift space due to photometric redshift uncertainties. It uses posterior probability distributions for the redshifts of the galaxies in the sample and it is easily extended to obtain the weak gravitational lensing signal while removing the intrinsic alignment contamination. We apply this algorithm to groups and clusters of galaxies identified in the Sloan Digital Sky Survey `Stripe 82' coadded imaging data over $\sim 150$ deg$^2$. We find that the intrinsic alignment signal around stacked clusters in the redshift range $0.1<z<0.4$ is consistent with zero. In terms of the tidal alignment model of Catelan et al. (2001), we set joint constraints on the strength of the alignment and the bias of the lensing groups and clusters on scales between 0.1 and $10\,h^{-1}$ Mpc, $b_LC_1\rho_{\rm crit} = -2_{-14}^{+14} \times 10^{-4}$. This constrains the contamination fraction of alignment to lensing signal to the range between $[-18,23]$ per cent below scales of 1 $h^{-1}$ Mpc at 95 per cent confidence level, and this result depends on our photometric redshift quality and selection criteria used to identify background galaxies. Our results are robust to the choice of photometric band in which the shapes are measured ($i$ and $r$) and to centring on the Brightest Cluster Galaxy or on the geometrical centre of the clusters.

In this review, I discuss the use of galaxy-galaxy weak lensing measurements to study the masses of dark matter halos in which galaxies reside. After summarizing how weak gravitational lensing measurements can be interpreted in terms of halo mass, I review measurements that were used to derive the relationship between optical galaxy mass tracers, such as stellar mass or luminosity, and dark matter halo mass. Measurements of galaxy-galaxy lensing from the past decade have led to increasingly tight constraints on the connection between dark matter halo mass and optical mass tracers, including both the mean relationships between these quantities and the intrinsic scatter between them. I also review some of the factors that can complicate analysis, such as the choice of modeling procedure, and choices made when dividing up samples of lens galaxies.

Lensing magnification and stacked shear measurements of galaxy clusters rely on measuring the density of background galaxies behind the clusters. The most common ways of measuring this quantity ignore the fact that some fraction of the sky is obscured by the cluster galaxies themselves, reducing the area in which background galaxies can be observed. We discuss the size of this effect in the Sloan Digital Sky Survey (SDSS) and the Canada-France-Hawaii Telescope Lensing Survey (CFHTLenS), finding a minimum 1 per cent effect at $0.1h^{-1}$Mpc from the centers of clusters in SDSS; the effect is an order of magnitude higher in CFHTLenS. The resulting biases on cluster mass and concentration measurements are of the same order as the size of the obscuration effect, which is below the statistical errors for cluster lensing in SDSS but likely exceeds them for CFHTLenS. We also forecast the impact of this systematic error on cluster mass and magnification measurements in several upcoming surveys, and find that it typically exceeds the statistical errors. We conclude that future surveys must account for this effect in stacked lensing and magnification measurements in order to avoid being dominated by systematic error.

The GRavitational lEnsing Accuracy Testing 3 (GREAT3) challenge is an image analysis competition that aims to test algorithms to measure weak gravitational lensing from astronomical images. The challenge started in October 2013 and ends 30 April 2014. The challenge focuses on testing the impact on weak lensing measurements of realistically complex galaxy morphologies, realistic point spread function, and combination of multiple different exposures. It includes simulated ground- and space-based data. The details of the challenge are described in [15], and the challenge website and its leader board can be found at http://great3challenge.info and http://great3.projects.phys.ucl.ac.uk/leaderboard/, respectively.

The intrinsic alignment of galaxy shapes with the large-scale density field is a contaminant to weak lensing measurements, as well as being an interesting signature of galaxy formation and evolution (albeit one that is difficult to predict theoretically). Here we investigate the shapes and relative orientations of the stars and dark matter of halos and subhalos (central and satellite) extracted from the MassiveBlack-II simulation, a state-of-the-art high resolution hydrodynamical cosmological simulation which includes stellar and AGN feedback in a volume of $(100{h^{-1}\mathrm{Mpc}})^3$. We consider redshift evolution from $z=1$ to $0.06$ and mass evolution within the range of subhalo masses, $10^{10} -6.0 \times 10^{14.0}{h^{-1}M_{\odot}}$. The shapes of the dark matter distributions are generally more round than the shapes defined by stellar matter. The projected root-mean-square (RMS) ellipticity per component for stellar matter is measured to be $e_\text{rms} = 0.28$ at $z=0.3$ for $M_{subhalo}> 10^{12.0}{h^{-1}M_{\odot}}$, which compares favourably with observational measurements. We find that the shapes of stellar and dark matter are more round for less massive subhalos and at lower redshifts. By directly measuring the relative orientation of the stellar matter and dark matter of subgroups, we find that, on average, the misalignment between the two components is larger for less massive subhalos. The mean misalignment angle varies from $\sim 30^{\circ}-10^{\circ}$ for $M \sim 10^{10} - 10^{14} {h^{-1}M_{\odot}}$ and shows a weak dependence on redshift. We also compare the misalignment angles in central and satellite subhalos at fixed subhalo mass, and find that centrals are more misaligned than satellites. We present fitting formulae for the shapes of dark and stellar matter in subhalos and also the probability distributions of misalignment angles.

The GRavitational lEnsing Accuracy Testing 3 (GREAT3) challenge is the third in a series of image analysis challenges, with a goal of testing and facilitating the development of methods for analyzing astronomical images that will be used to measure weak gravitational lensing. This measurement requires extremely precise estimation of very small galaxy shape distortions, in the presence of far larger intrinsic galaxy shapes and distortions due to the blurring kernel caused by the atmosphere, telescope optics, and instrumental effects. The GREAT3 challenge is posed to the astronomy, machine learning, and statistics communities, and includes tests of three specific effects that are of immediate relevance to upcoming weak lensing surveys, two of which have never been tested in a community challenge before. These effects include realistically complex galaxy models based on high-resolution imaging from space; spatially varying, physically-motivated blurring kernel; and combination of multiple different exposures. To facilitate entry by people new to the field, and for use as a diagnostic tool, the simulation software for the challenge is publicly available, though the exact parameters used for the challenge are blinded. Sample scripts to analyze the challenge data using existing methods will also be provided. See http://great3challenge.info and http://great3.projects.phys.ucl.ac.uk/leaderboard/ for more information.

(Abridged) We present a HST weak-lensing study of the merging galaxy cluster "El Gordo" (ACT-CL J0102-4915) at z=0.87 discovered by the Atacama Cosmology Telescope collaboration as the strongest SZ decrement in its ~1000 sq. deg survey. Our weak-lensing analysis confirms that ACT-CL J0102-4915 is indeed an extreme system consisting of two massive (~10^15 Msun each) subclusters with a projected separation of ~0.7 Mpc. This binary mass structure revealed by our lensing study is consistent with the cluster galaxy distribution and the dynamical study carried out with 89 spectroscopic members. We estimate the mass of ACT-CL J0102-4915 by simultaneously fitting two axisymmetric NFW profiles allowing their centers to vary. Our MCMC analysis shows that the masses of the northwestern (NW) and the southeastern (SE) components are M200c=(1.38+-0.22) x 10^15 Msun and (0.78+-0.20) x 10^15 Msun, respectively. The lensing-based velocity dispersions are consistent with their spectroscopic measurements. The centroids of both components are tightly constrained (~4") and close to the optical luminosity centers. The X-ray and mass peaks are spatially offset by ~8" (~62 kpc), which is significant at the ~2 sigma confidence level and confirms that the baryonic and dark matter in this cluster are disassociated. The dark matter peak, however, does not lead the gas peak in the direction expected if we are viewing the cluster soon after first core passage during a high speed merger. Under the assumption that the merger is happening in the plane of the sky, extrapolation of the two NFW halos to a radius r200a=2.4 Mpc yields a combined mass of M200a=(3.13+-0.56) x 10^15 Msun. This extrapolated total mass is consistent with our two-component-based dynamical analysis and previous X-ray measurements, projecting ACT-CL J0102-4915 to be the most massive cluster at z>0.6 known to date.

The quantity and quality of cosmic structure observations have greatly accelerated in recent years. Further leaps forward will be facilitated by imminent projects, which will enable us to map the evolution of dark and baryonic matter density fluctuations over cosmic history. The way that these fluctuations vary over space and time is sensitive to the nature of dark matter and dark energy. Dark energy and gravity both affect how rapidly structure grows; the greater the acceleration, the more suppressed the growth of structure, while the greater the gravity, the more enhanced the growth. While distance measurements also constrain dark energy, the comparison of growth and distance data tests whether General Relativity describes the laws of physics accurately on large scales. Modified gravity models are able to reproduce the distance measurements but at the cost of altering the growth of structure (these signatures are described in more detail in the accompanying paper on Novel Probes of Gravity and Dark Energy). Upcoming surveys will exploit these differences to determine whether the acceleration of the Universe is due to dark energy or to modified gravity. To realize this potential, both wide field imaging and spectroscopic redshift surveys play crucial roles. Projects including DES, eBOSS, DESI, PFS, LSST, Euclid, and WFIRST are in line to map more than a 1000 cubic-billion-light-year volume of the Universe. These will map the cosmic structure growth rate to 1% in the redshift range 0<z<2, over the last 3/4 of the age of the Universe.

Large sets of objects with spectroscopic redshift measurements will be needed for imaging dark energy experiments to achieve their full potential, serving two goals:_training_, i.e., the use of objects with known redshift to develop and optimize photometric redshift algorithms; and_calibration_, i.e., the characterization of moments of redshift (or photo-z error) distributions. Better training makes cosmological constraints from a given experiment stronger, while highly-accurate calibration is needed for photo-z systematics not to dominate errors. In this white paper, we investigate the required scope of spectroscopic datasets which can serve both these purposes for ongoing and next-generation dark energy experiments, as well as the time required to obtain such data with instruments available in the next decade. Large time allocations on kilo-object spectrographs will be necessary, ideally augmented by infrared spectroscopy from space. Alternatively, precision calibrations could be obtained by measuring cross-correlation statistics using samples of bright objects from a large baryon acoustic oscillation experiment such as DESI. We also summarize the additional work on photometric redshift methods needed to prepare for ongoing and future dark energy experiments.

Nonlinear redshift-space distortions, the Finger-of-God (FoG) effect, can complicate the interpretation of the galaxy power spectrum. Here, we demonstrate the method proposed by Hikage et al. (2012) to use complimentary observations to directly constrain this effect on the data. We use catalogs of Luminous Red Galaxies (LRGs) and photometric galaxies from the SDSS DR7 to measure the redshift-space power spectrum of LRGs, the cross-correlation of LRGs with the shapes of background photometric galaxies (galaxy-galaxy weak lensing), and the projected cross-correlation of LRGs with photometric galaxies having similar photometric redshifts to the LRG spectroscopic redshift. All of these measurements use a reconstructed halo field. While we use the position of each LRG for single LRG systems, we compare the measurements using different halo-center proxies for multiple-LRG systems (4.5 per cent of all the halos): the brightest LRG position (BLRG), the faintest LRG position (FLRG) and their arithmetical mean position (Mean), respectively, in each system. We find significant differences in the measured correlations of different centers, showing consistent off-centering effects in the three observables. By comparing the measurements with a halo model that treats the satellite photometric galaxies as being distributed according to a generalized NFW profile, we find that about 40 (70) per cent of BLRGs (FLRGs) are off-centered satellite galaxies in the multiple-LRG systems. The satellite LRGs have typical off-centering radius of about 400 kpc/h, and velocity dispersion of about 500 km/s in host halos with a mean mass of 1.6x10^14 Ms/h. We show that, if LRGs in the single LRG systems have similar offsets, the residual FoG contamination in the LRG power spectrum can be significant at k>0.1 h/Mpc, which may cause a bias in cosmological parameters such as the neutrino mass.

We constrain the distributions of projected radial alignment angles of satellite galaxy shapes within the Galaxy And Mass Assembly survey group catalogue. We identify the galaxy groups using spectroscopic redshifts and measure galaxy projected ellipticities from Sloan Digital Sky Survey imaging. With a sample of 3,850 groups with 13,655 satellite galaxies with high quality shape measurements, we find a less than 2-sigma signal of radial alignments in the mean projected ellipticity components and the projected position angle when using galaxy shape estimates optimized for weak lensing measurements. Our radial alignment measurement increases to greater than 3-sigma significance relative to the expectation for no alignments if we use 2-D S\'ersic model fits to define galaxy orientations. Our weak measurement of radial alignments is in conflict with predictions from dark matter N-body simulations, which we interpret as evidence for large mis-alignments of baryons and dark matter in group and cluster satellites. Within our uncertainties, that are dominated by our small sample size, we find only weak and marginally significant trends of the radial alignment angle distributions on projected distance from the group centre, host halo mass, and redshift that could be consistent with a tidal torquing mechanism for radial alignments. Using our lensing optimized shape estimators, we estimate that intrinsic alignments of galaxy group members may contribute a systematic error to the mean differential projected surface mass density of groups inferred from weak lensing observations by -1 +/- 20% at scales around 300 kpc/h from the group centre assuming a photometric redshift r.m.s. error of 10%, and given our group sample with median redshift of 0.17 and median virial masses ~10^{13} h^{-1}M_{sun}.

We present the first strong-lensing (SL) analysis of the galaxy cluster ACT-CL J0102-4915 (\emph{El Gordo}), in recent \emph{HST}/ACS images, revealing a prominent strong lens at a redshift of $z=0.87$. This finding adds to the already-established unique properties of \emph{El Gordo}: it is the most massive, hot, X-ray luminous, and bright Sunyaev-Zeldovich effect cluster at $z\gtrsim0.6$, and the only `bullet'-like merging cluster known at these redshifts. The lens consists of two merging massive clumps, where for a source redshift of $z_{s}\sim2$ each clump exhibits only a small, separate critical area, with a total area of $0.69\pm0.11\sq\arcmin$ over the two clumps. For a higher source redshift, $z_{s}\sim4$, the critical curves of the two clumps merge together into one bigger and very elongated lens (axis ratio $\simeq5.5$), enclosing an effective area of $1.44\pm0.22\sq\arcmin$. The critical curves continue expanding with increasing redshift so that for high-redshift sources ($z_{s}\gtrsim9$) they enclose an area of $\sim1.91\pm0.30\sq\arcmin$ (effective $\theta_{e}\simeq46.8\pm3.7\arcsec$) and a mass of $6.09\pm1.04\times10^{14}M_{\odot}$. According to our model, the area of high magnification ($\mu>10$) for such high redshift sources is $\simeq1.2\sq\arcmin$, and the area with $\mu>5$ is $\simeq2.3\sq\arcmin$, making \emph{El Gordo} a compelling target for studying the high-redshift Universe. We obtain a strong lower limit on the total mass of \emph{El Gordo}, $\gtrsim1.7\times10^{15}M_{\odot}$ from the SL regime alone, suggesting a total mass of, roughly, $M_{200}\sim2.3\times10^{15}M_{\odot}$. Our results should be revisited when additional spectroscopic and \emph{HST} imaging data are available.

Recent studies have shown that the cross-correlation coefficient between galaxies and dark matter is very close to unity on scales outside a few virial radii of galaxy halos, independent of the details of how galaxies populate dark matter halos. This finding makes it possible to determine the dark matter clustering from measurements of galaxy-galaxy weak lensing and galaxy clustering. We present new cosmological parameter constraints based on large-scale measurements of spectroscopic galaxy samples from the Sloan Digital Sky Survey (SDSS) Data Release 7 (DR7). We generalise the approach of Baldauf et al. (2010) to remove small scale information (below 2 and 4 Mpc/h for lensing and clustering measurements, respectively), where the cross-correlation coefficient differs from unity. We derive constraints for three galaxy samples covering 7131 sq. deg., containing 69150, 62150, and 35088 galaxies with mean redshifts of 0.11, 0.28, and 0.40. We clearly detect scale-dependent galaxy bias for the more luminous galaxy samples, at a level consistent with theoretical expectations. When we vary both \sigma_8 and \Omega_m (and marginalise over non-linear galaxy bias) in a flat LCDM model, the best-constrained quantity is \sigma_8 (\Omega_m/0.25)^{0.57}=0.80 +/- 0.05 (1-sigma, stat. + sys.), where statistical and systematic errors have comparable contributions, and we fixed n_s=0.96 and h=0.7. These strong constraints on the matter clustering suggest that this method is competitive with cosmic shear in current data, while having very complementary and in some ways less serious systematics. We therefore expect that this method will play a prominent role in future weak lensing surveys. When we combine these data with WMAP7 CMB data, constraints on \sigma_8, \Omega_m, H_0, w_{de} and \sum m_{\nu} become 30--80 per cent tighter than with CMB data alone, since our data break several parameter degeneracies.

The Baryon Oscillation Spectroscopic Survey (BOSS) is designed to measure the scale of baryon acoustic oscillations (BAO) in the clustering of matter over a larger volume than the combined efforts of all previous spectroscopic surveys of large scale structure. BOSS uses 1.5 million luminous galaxies as faint as i=19.9 over 10,000 square degrees to measure BAO to redshifts z<0.7. Observations of neutral hydrogen in the Lyman alpha forest in more than 150,000 quasar spectra (g<22) will constrain BAO over the redshift range 2.15<z<3.5. Early results from BOSS include the first detection of the large-scale three-dimensional clustering of the Lyman alpha forest and a strong detection from the Data Release 9 data set of the BAO in the clustering of massive galaxies at an effective redshift z = 0.57. We project that BOSS will yield measurements of the angular diameter distance D_A to an accuracy of 1.0% at redshifts z=0.3 and z=0.57 and measurements of H(z) to 1.8% and 1.7% at the same redshifts. Forecasts for Lyman alpha forest constraints predict a measurement of an overall dilation factor that scales the highly degenerate D_A(z) and H^{-1}(z) parameters to an accuracy of 1.9% at z~2.5 when the survey is complete. Here, we provide an overview of the selection of spectroscopic targets, planning of observations, and analysis of data and data quality of BOSS.

We present a new measurement of the optical Quasar Luminosity Function (QLF), using data from the Sloan Digital Sky Survey-III: Baryon Oscillation Spectroscopic Survey (SDSS-III: BOSS). From the SDSS-III Data Release Nine (DR9), we select a uniform sample of 22,301 i<=21.8 quasars over an area of 2236 sq. deg with confirmed spectroscopic redshifts between 2.2<z<3.5, filling in a key part of the luminosity-redshift plane for optical quasar studies. We derive the completeness of the survey through simulated quasar photometry, and check this completeness estimate using a sample of quasars selected by their photometric variability within the BOSS footprint. We investigate the level of systematics associated with our quasar sample using the simulations, in the process generating color-redshift relations and a new quasar k-correction. We probe the faint end of the QLF to M_i(z=2.2) = -24.5 and see a clear break in the QLF at all redshifts up to z=3.5. We find that a log-linear relation (in log[Phi*] - M*) for a luminosity and density evolution (LEDE) model adequately describes our data within the range 2.2<z<3.5; across this interval the break luminosity increases by a factor of ~2.3 while Phi* declines by a factor of ~6. At z<2.2 our data is reasonably well fit by a pure luminosity evolution (PLE) model. We see only a weak signature of "AGN downsizing", in line with recent studies of the hard X-ray luminosity function. We compare our measured QLF to a number of theoretical models and find that models making a variety of assumptions about quasar triggering and halo occupation can fit our data over a wide range of redshifts and luminosities.

We present a Subaru weak lensing measurement of ACT-CL J0022.2-0036, one of the most luminous, high-redshift (z=0.81) Sunyaev-Zel'dovich (SZ) clusters discovered in the 268 deg^2 equatorial region survey of the Atacama Cosmology Telescope. For the weak lensing analysis using i'-band images, we use a model-fitting (Gauss-Laguerre shapelet) method to measure shapes of galaxy images, where we fit galaxy images in different exposures simultaneously to obtain best-fit ellipticities taking into account the different PSFs in each exposure. We also take into account the astrometric distortion effect on galaxy images by performing the model fitting in the world coordinate system. To select background galaxies behind the cluster at z=0.81, we use photometric redshift (photo-z) estimates for every galaxy derived from the co-added images of multi-passband Br'i'z'Y, with PSF matching/homogenization. After a photo-z cut for background galaxy selection, we detect the tangential weak lensing distortion signal with a total signal-to-noise ratio of about 3.7. By fitting a Navarro-Frenk-White model to the measured shear profile, we find the cluster mass to be M_200\bar{\rho}_m = [7.5^+3.2_-2.8(stat.)^+1.3_-0.6(sys.)] x 10^14 M_\odot/h. The weak lensing-derived mass is consistent with previous mass estimates based on the SZ observation, with assumptions of hydrostatic equilibrium and virial theorem, as well as with scaling relations between SZ signal and mass derived from weak lensing, X-ray, and velocity dispersion, within the measurement errors. We also show that the existence of ACT-CL J0022.2-0036 at z=0.81 is consistent with the cluster abundance prediction of the \Lambda-dominated cold dark matter structure formation model. We thus demonstrate the capability of Subaru-type ground-based images for studying weak lensing of high-redshift clusters.

The Sloan Digital Sky Survey III (SDSS-III) presents the first spectroscopic data from the Baryon Oscillation Spectroscopic Survey (BOSS). This ninth data release (DR9) of the SDSS project includes 535,995 new galaxy spectra (median z=0.52), 102,100 new quasar spectra (median z=2.32), and 90,897 new stellar spectra, along with the data presented in previous data releases. These spectra were obtained with the new BOSS spectrograph and were taken between 2009 December and 2011 July. In addition, the stellar parameters pipeline, which determines radial velocities, surface temperatures, surface gravities, and metallicities of stars, has been updated and refined with improvements in temperature estimates for stars with T_eff<5000 K and in metallicity estimates for stars with [Fe/H]>-0.5. DR9 includes new stellar parameters for all stars presented in DR8, including stars from SDSS-I and II, as well as those observed as part of the SDSS-III Sloan Extension for Galactic Understanding and Exploration-2 (SEGUE-2). The astrometry error introduced in the DR8 imaging catalogs has been corrected in the DR9 data products. The next data release for SDSS-III will be in Summer 2013, which will present the first data from the Apache Point Observatory Galactic Evolution Experiment (APOGEE) along with another year of data from BOSS, followed by the final SDSS-III data release in December 2014.

In this paper, we measure the optical-to-virial velocity ratios Vopt/V200c of disk galaxies in the Sloan Digital Sky Survey (SDSS) at a mean redshift of <z> = 0.07 and with stellar masses 10^9 M_sun < M_* < 10^11 M_sun. Vopt/V200c, the ratio of the circular velocity measured at the virial radius of the dark matter halo (\sim150 kpc) to that at the optical radius of the disk (\sim10 kpc), is a powerful observational constraint on disk galaxy formation. It links galaxies to their dark matter haloes dynamically and constrains the total mass profile of disk galaxies over an order of magnitude in length scale. For this measurement, we combine Vopt derived from the Tully-Fisher relation (TFR) from Reyes et al. with V200c derived from halo masses measured with galaxy-galaxy lensing. In anticipation of this combination, we use similarly-selected galaxy samples for both the lensing and TFR analysis. For three M_* bins with lensing-weighted mean stellar masses of 0.6, 2.7, and 6.5 x 10^10 M_sun, we find halo-to-stellar mass ratios M_vir/M_* = 41, 23, and 26, with 1-sigma statistical uncertainties of around 0.1 dex, and Vopt/V200c = 1.27\pm0.08, 1.39\pm0.06, 1.27\pm0.08 (1{\sigma}). Our results suggest that the dark matter and baryonic contributions to the mass within the optical radius are comparable, if the dark matter halo profile has not been significantly modified by baryons. The results obtained in this work will serve as inputs to and constraints on disk galaxy formation models, which will be explored in future work. Finally, we note that this paper presents a new and improved galaxy shape catalogue for weak lensing that covers the full SDSS DR7 footprint.

The coherent physical alignment of galaxies is an important systematic for gravitational lensing studies as well as a probe of the physical mechanisms involved in galaxy formation and evolution. We develop a formalism for treating this intrinsic alignment (IA) in the context of galaxy-galaxy lensing and present an improved method for measuring IA contamination, which can arise when sources physically associated with the lens are placed behind the lens due to photometric redshift scatter. We apply the technique to recent Sloan Digital Sky Survey (SDSS) measurements of Luminous Red Galaxy lenses and typical (L*) source galaxies with photometric redshifts selected from the SDSS imaging data. Compared to previous measurements, this method has the advantage of being fully self-consistent in its treatment of the IA and lensing signals, solving for the two simultaneously. We find an IA signal consistent with zero, placing tight constraints on both the magnitude of the IA effect and its potential contamination to the lensing signal. While these constraints depend on source selection and redshift quality, the method can be applied to any measurement that uses photometric redshifts. We obtain a model-independent upper-limit of roughly 10% IA contamination for projected separations of approximately 0.1-100 Mpc/h. With more stringent photo-z cuts and reasonable assumptions about the physics of intrinsic alignments, this upper limit is reduced to 1-2%. These limits are well below the statistical error of the current lensing measurements. Our results suggest that IA will not present intractable challenges to the next generation of galaxy-galaxy lensing experiments, and the methods presented here should continue to aid in our understanding of alignment processes and in the removal of IA from the lensing signal.

We present a new test of gravitational interactions at the r\sim(0.2-20)Mpc scale, around the virial radius of dark matter halos measured through cluster-galaxy lensing of maxBCG clusters from the Sloan Digital Sky Survey (SDSS). We employ predictions from self-consistent simulations of f(R) gravity to find an upper bound on the background field amplitude of f_R0<3.5x10^-3 at the 1D-marginalized 95% confidence level. As a model-independent assessment of the constraining power of cluster profiles measured through weak gravitational lensing, we also constrain the amplitude F_0 of a phenomenological modification based on the profile enhancement induced by f(R) gravity when not including effects from the increased cluster abundance in f(R). In both scenarios, dark-matter-only simulations of the concordance model corresponding to f_R0=0 and F_0=0 are consistent with the lensing measurements, i.e., at the 68% and 95% confidence level, respectively.

We present measurements of galaxy clustering from the Baryon Oscillation Spectroscopic Survey (BOSS), which is part of the Sloan Digital Sky Survey III (SDSS-III). These use the Data Release 9 (DR9) CMASS sample, which contains 264,283 massive galaxies covering 3275 square degrees with an effective redshift z=0.57 and redshift range 0.43 < z < 0.7. Assuming a concordance Lambda-CDM cosmological model, this sample covers an effective volume of 2.2 Gpc^3, and represents the largest sample of the Universe ever surveyed at this density, n = 3 x 10^-4 h^-3 Mpc^3. We measure the angle-averaged galaxy correlation function and power spectrum, including density-field reconstruction of the baryon acoustic oscillation (BAO) feature. The acoustic features are detected at a significance of 5\sigma in both the correlation function and power spectrum. Combining with the SDSS-II Luminous Red Galaxy Sample, the detection significance increases to 6.7\sigma. Fitting for the position of the acoustic features measures the distance to z=0.57 relative to the sound horizon DV /rs = 13.67 +/- 0.22 at z=0.57. Assuming a fiducial sound horizon of 153.19 Mpc, which matches cosmic microwave background constraints, this corresponds to a distance DV(z=0.57) = 2094 +/- 34 Mpc. At 1.7 per cent, this is the most precise distance constraint ever obtained from a galaxy survey. We place this result alongside previous BAO measurements in a cosmological distance ladder and find excellent agreement with the current supernova measurements. We use these distance measurements to constrain various cosmological models, finding continuing support for a flat Universe with a cosmological constant.

We measure the large-scale intrinsic alignments of galaxy clusters in the Sloan Digital Sky Survey (SDSS) using subsets of two cluster catalogues: 6625 clusters with 0.1<z<0.3 from the maxBCG cluster catalogue (Koester et al. 2007, 7500 sq. deg.), and 8081 clusters with 0.08<z<0.44 from the Adaptive Matched Filter catalogue (Dong et al. 2008, 6500 sq. deg.). We search for two types of cluster alignments using pairs of clusters: the alignment between the projected major axes of the clusters (`correlation' alignment), and the alignment between one cluster major axis and the line connecting it to the other cluster in the pair (`pointing' alignment). In each case, we use the cluster member galaxy distribution as a tracer of the cluster shape. All measurements are carried out with each catalogue separately, to check for dependence on cluster selection procedure. We find a strong detection of the pointing alignment on scales up to 100 Mpc/h, at the 6 or 10-sigma level depending on the cluster selection algorithm used. The correlation alignment is only marginally detected up to ~20 Mpc/h, at the 2 or 2.5-sigma level. These results support our current theoretical understanding of galaxy cluster intrinsic alignments in the LCDM paradigm, although further work will be needed to understand the impact of cluster selection effects and observational measurement errors on the amplitude of the detection.

Statistical weak lensing by large-scale structure -- cosmic shear -- is a promising cosmological tool, which has motivated the design of several large upcoming surveys. Here, we present a measurement of cosmic shear using coadded Sloan Digital Sky Survey (SDSS) imaging in 168 square degrees of the equatorial region, with r<23.5 and i<22.5, a source number density of 2.2 galaxies per square arcminute and median redshift of 0.52. These coadds were generated using a new method described in the companion Paper I that was intended to minimise systematic errors in the lensing measurement due to coherent PSF anisotropies that are otherwise prevalent in the SDSS imaging data. We present measurements of cosmic shear out to angular separations of 2 degrees, along with systematics tests that (combined with those from Paper I on the catalogue generation) demonstrate that our results are dominated by statistical rather than systematic errors. Assuming a cosmological model corresponding to WMAP7 and allowing only the amplitude of matter fluctuations to vary, we find a best-fit value of sigma_8=0.636 +0.109 -0.154 (1-sigma); without systematic errors this would be sigma_8=0.636 +0.099 -0.137 (1-sigma). Assuming a flat LCDM model, the combined constraints with WMAP7 are sigma_8=0.784 +0.028 -0.026 (1-sigma), +0.055 -0.054 (2-sigma) and Omega_m h^2=0.1303 +0.0047 -0.0048 (1-sigma)+0.009 -0.009 (2-sigma); the 2-sigma error ranges are respectively 14 and 17 per cent smaller than WMAP7 alone. Aside from the intrinsic value of such cosmological constraints from the growth of structure, we identify some important lessons for upcoming surveys that may face similar issues when combining multi-epoch data to measure cosmic shear.

GRavitational lEnsing Accuracy Testing 2010 (GREAT10) is a public image analysis challenge aimed at the development of algorithms to analyze astronomical images. Specifically, the challenge is to measure varying image distortions in the presence of a variable convolution kernel, pixelization and noise. This is the second in a series of challenges set to the astronomy, computer science and statistics communities, providing a structured environment in which methods can be improved and tested in preparation for planned astronomical surveys. GREAT10 extends upon previous work by introducing variable fields into the challenge. The "Galaxy Challenge" involves the precise measurement of galaxy shape distortions, quantified locally by two parameters called shear, in the presence of a known convolution kernel. Crucially, the convolution kernel and the simulated gravitational lensing shape distortion both now vary as a function of position within the images, as is the case for real data. In addition, we introduce the "Star Challenge" that concerns the reconstruction of a variable convolution kernel, similar to that in a typical astronomical observation. This document details the GREAT10 Challenge for potential participants. Continually updated information is also available from http://www.greatchallenges.info.

Weak lensing by large-scale structure is an invaluable cosmological tool given that most of the energy density of the concordance cosmology is invisible. Several large ground-based imaging surveys will attempt to measure this effect over the coming decade, but reliable control of the spurious lensing signal introduced by atmospheric turbulence and telescope optics remains a challenging problem. We address this challenge with a demonstration that point-spread function (PSF) effects on measured galaxy shapes in current ground-based surveys can be corrected with existing analysis techniques. In this work, we co-add existing Sloan Digital Sky Survey imaging on the equatorial stripe in order to build a data set with the statistical power to measure cosmic shear, while using a rounding kernel method to null out the effects of the anisotropic PSF. We build a galaxy catalogue from the combined imaging, characterise its photometric properties, and show that the spurious shear remaining in this catalogue after the PSF correction is negligible compared to the expected cosmic shear signal. We identify a new source of systematic error in the shear-shear auto-correlations arising from selection biases related to masking. Finally, we discuss the circumstances in which this method is expected to be useful for upcoming ground-based surveys that have lensing as one of the science goals, and identify the systematic errors that can reduce its efficacy.

Weak gravitational lensing is a valuable probe of galaxy formation and cosmology. Here we quantify the effects of using photometric redshifts (photo-z) in galaxy-galaxy lensing, for both sources and lenses, both for the immediate goal of using galaxies with photo-z as lenses in the Sloan Digital Sky Survey (SDSS) and as a demonstration of methodology for large, upcoming weak lensing surveys that will by necessity be dominated by lens samples with photo-z. We calculate the bias in the lensing mass calibration as well as consequences for absolute magnitude (i.e., k-corrections) and stellar mass estimates, for a large sample of SDSS Data Release 8 (DR8) galaxies. The redshifts are obtained with the template based photo-z code ZEBRA on the SDSS DR8 ugriz photometry. We assemble and characterise the calibration samples (~9k spectroscopic redshifts from four surveys) to obtain photometric redshift errors and lensing biases corresponding to our full SDSS DR8 lens and source catalogues. Our tests of the calibration sample also highlight the impact of observing conditions in the imaging survey when the spectroscopic calibration covers a small fraction of its footprint; atypical imaging conditions in calibration fields can lead to incorrect conclusions regarding the photo-z of the full survey. For the SDSS DR8 catalogue, we find sigma_z/(1+z)=0.096 and 0.113 for the lens and source catalogues, with flux limits of r=21 and r=21.8, respectively. We also explore the systematic uncertainty in the lensing signal calibration when using source photo-z, and both lens and source photo-z; given the size of existing training samples, we can constrain the lensing signal calibration (and therefore the normalization of the surface mass density) to within 2 and 4 per cent, respectively. [ABRIDGED]

Current and upcoming wide-field, ground-based, broad-band imaging surveys promise to address a wide range of outstanding problems in galaxy formation and cosmology. Several such uses of ground-based data, especially weak gravitational lensing, require highly precise measurements of galaxy image statistics with careful correction for the effects of the point-spread function (PSF). In this paper, we introduce the SHERA (SHEar Reconvolution Analysis) software to simulate ground-based imaging data with realistic galaxy morphologies and observing conditions, starting from space-based data (from COSMOS, the Cosmological Evolution Survey) and accounting for the effects of the space-based PSF. This code simulates ground-based data, optionally with a weak lensing shear applied, in a model-independent way using a general Fourier space formalism. The utility of this pipeline is that it allows for a precise, realistic assessment of systematic errors due to the method of data processing, for example in extracting weak lensing galaxy shape measurements or galaxy radial profiles, given user-supplied observational conditions and real galaxy morphologies. Moreover, the simulations allow for the empirical test of error estimates and determination of parameter degeneracies, via generation of many noise maps. The public release of this software, along with a large sample of cleaned COSMOS galaxy images (corrected for charge transfer inefficiency), should enable upcoming ground-based imaging surveys to achieve their potential in the areas of precision weak lensing analysis, galaxy profile measurement, and other applications involving detailed image analysis.

We present redshift probability distributions for galaxies in the SDSS DR8 imaging data. We used the nearest-neighbor weighting algorithm presented in Lima et al. 2008 and Cunha et al. 2009 to derive the ensemble redshift distribution N(z), and individual redshift probability distributions P(z) for galaxies with r < 21.8. As part of this technique, we calculated weights for a set of training galaxies with known redshifts such that their density distribution in five dimensional color-magnitude space was proportional to that of the photometry-only sample, producing a nearly fair sample in that space. We then estimated the ensemble N(z) of the photometric sample by constructing a weighted histogram of the training set redshifts. We derived P(z) s for individual objects using the same technique, but limiting to training set objects from the local color-magnitude space around each photometric object. Using the P(z) for each galaxy, rather than an ensemble N(z), can reduce the statistical error in measurements that depend on the redshifts of individual galaxies. The spectroscopic training sample is substantially larger than that used for the DR7 release, and the newly added PRIMUS catalog is now the most important training set used in this analysis by a wide margin. We expect the primary source of error in the N(z) reconstruction is sample variance: the training sets are drawn from relatively small volumes of space. Using simulations we estimated the uncertainty in N(z) at a given redshift is 10-15%. The uncertainty on calculations incorporating N(z) or P(z) depends on how they are used; we discuss the case of weak lensing measurements. The P(z) catalog is publicly available from the SDSS website.

Building on the legacy of the Sloan Digital Sky Survey (SDSS-I and II), SDSS-III is a program of four spectroscopic surveys on three scientific themes: dark energy and cosmological parameters, the history and structure of the Milky Way, and the population of giant planets around other stars. In keeping with SDSS tradition, SDSS-III will provide regular public releases of all its data, beginning with SDSS DR8 (which occurred in Jan 2011). This paper presents an overview of the four SDSS-III surveys. BOSS will measure redshifts of 1.5 million massive galaxies and Lya forest spectra of 150,000 quasars, using the BAO feature of large scale structure to obtain percent-level determinations of the distance scale and Hubble expansion rate at z<0.7 and at z~2.5. SEGUE-2, which is now completed, measured medium-resolution (R=1800) optical spectra of 118,000 stars in a variety of target categories, probing chemical evolution, stellar kinematics and substructure, and the mass profile of the dark matter halo from the solar neighborhood to distances of 100 kpc. APOGEE will obtain high-resolution (R~30,000), high signal-to-noise (S/N>100 per resolution element), H-band (1.51-1.70 micron) spectra of 10^5 evolved, late-type stars, measuring separate abundances for ~15 elements per star and creating the first high-precision spectroscopic survey of all Galactic stellar populations (bulge, bar, disks, halo) with a uniform set of stellar tracers and spectral diagnostics. MARVELS will monitor radial velocities of more than 8000 FGK stars with the sensitivity and cadence (10-40 m/s, ~24 visits per star) needed to detect giant planets with periods up to two years, providing an unprecedented data set for understanding the formation and dynamical evolution of giant planet systems. (Abridged)

We study the morphology of luminous and massive galaxies at 0.3<z<0.7 targeted in the Baryon Oscillation Spectroscopic Survey (BOSS) using publicly available Hubble Space Telescope imaging from COSMOS. Our sample (240 objects) provides a unique opportunity to check the visual morphology of these galaxies which were targeted based solely on stellar population modelling. We find that the majority (74+/-6%) possess an early-type morphology (elliptical or S0), while the remainder have a late-type morphology. This is as expected from the goals of the BOSS target selection which aimed to predominantly select slowly evolving galaxies, for use as cosmological probes, while still obtaining a fair fraction of actively star forming galaxies for galaxy evolution studies. We show that a colour cut of (g-i)>2.35 selects a sub-sample of BOSS galaxies with 90% early-type morphology - more comparable to the earlier Luminous Red Galaxy (LRG) samples of SDSS-I/II. The remaining 10% of galaxies above this cut have a late-type morphology and may be analogous to the "passive spirals" found at lower redshift. We find that 23+/-4% of the early-type galaxies are unresolved multiple systems in the SDSS imaging. We estimate that at least 50% of these are real associations (not projection effects) and may represent a significant "dry merger" fraction. We study the SDSS pipeline sizes of BOSS galaxies which we find to be systematically larger (by 40%) than those measured from HST images, and provide a statistical correction for the difference. These details of the BOSS galaxies will help users of the data fine-tune their selection criteria, dependent on their science applications. For example, the main goal of BOSS is to measure the cosmic distance scale and expansion rate of the Universe to percent-level precision - a point where systematic effects due to the details of target selection may become important.

Correlations between the intrinsic shapes of galaxies and the large-scale galaxy density field provide an important tool to investigate galaxy intrinsic alignments, which constitute a major astrophysical systematic in cosmological weak lensing (cosmic shear) surveys, but also yield insight into the formation and evolution of galaxies. We measure galaxy position-shape correlations in the MegaZ-LRG sample for more than 800,000 luminous red galaxies, making the first such measurement with a photometric redshift sample. In combination with a re-analysis of several spectroscopic SDSS samples, we constrain an intrinsic alignment model for early-type galaxies over long baselines in redshift (z ~ 0.7) and luminosity (4mag). We develop and test the formalism to incorporate photometric redshift scatter in the modelling. For r_p > 6 Mpc/h, the fits to galaxy position-shape correlation functions are consistent with the scaling with r_p and redshift of a revised, nonlinear version of the linear alignment model for all samples. An extra redshift dependence proportional to (1+z)^n is constrained to n=-0.3+/-0.8 (1sigma). To obtain consistent amplitudes for all data, an additional dependence on galaxy luminosity proportional to L^b with b=1.1+0.3-0.2 is required. The normalisation of the intrinsic alignment power spectrum is found to be (0.077 +/- 0.008)/rho_{cr} for galaxies at redshift 0.3 and r band magnitude of -22 (k- and evolution-corrected to z=0). Assuming zero intrinsic alignments for blue galaxies, we assess the bias on cosmological parameters for a tomographic CFHTLS-like lensing survey. Both the resulting mean bias and its uncertainty are smaller than the 1sigma statistical errors when using the constraints from all samples combined. The addition of MegaZ-LRG data reduces the uncertainty in intrinsic alignment bias on cosmological parameters by factors of three to seven. (abridged)

In this paper, we derive scaling relations between photometric observable quantities and disk galaxy rotation velocity V_rot, or Tully-Fisher relations (TFRs). Our methodology is dictated by our purpose of obtaining purely photometric, minimal-scatter estimators of V_rot applicable to large galaxy samples from imaging surveys. To achieve this goal, we have constructed a sample of 189 disk galaxies at redshifts z<0.1 with long-slit H-alpha spectroscopy from Pizagno et al. (2007) and new observations. By construction, this sample is a fair subsample of a large, well-defined parent disk sample of ~170 000 galaxies selected from the Sloan Digital Sky Survey Data Release 7 (SDSS DR7). The optimal photometric estimator of V_rot we find is stellar mass M_* from Bell et al. (2003), based on the linear combination of a luminosity and a colour. Assuming a Kroupa IMF, we find: log [V_{80}/(km s^-1)] = (2.142 +/- 0.004)+(0.278 +/- 0.010)[log (M_*/M_sun)-10.10], where V_{80} is the rotation velocity measured at the radius R_{80} containing 80 per cent of the i-band galaxy light. This relation has an intrinsic Gaussian scatter of 0.036 +/- 0.005 dex and a measured scatter of 0.056 dex in log V_{80}. For a fixed IMF, we find that the dynamical-to-stellar mass ratios within R_{80}, (M_dyn/M_*)(R_{80}), decrease from approximately 10 to 3, as stellar mass increases from M_* ~ 10^9 to 10^{11} M_sun. At a fixed stellar mass, (M_dyn/M_*)(R_{80}) increases with disk size, so that it correlates more tightly with stellar surface density than with stellar mass or disk size alone. In future work, we will use these results to study disk galaxy formation and evolution, and perform a fair, statistical analysis of the dynamics and masses of a photometrically-selected sample of disk galaxies. [Abridged]

The Sloan Digital Sky Survey (SDSS) started a new phase in August 2008, with new instrumentation and new surveys focused on Galactic structure and chemical evolution, measurements of the baryon oscillation feature in the clustering of galaxies and the quasar Ly alpha forest, and a radial velocity search for planets around ~8000 stars. This paper describes the first data release of SDSS-III (and the eighth counting from the beginning of the SDSS). The release includes five-band imaging of roughly 5200 deg^2 in the Southern Galactic Cap, bringing the total footprint of the SDSS imaging to 14,555 deg^2, or over a third of the Celestial Sphere. All the imaging data have been reprocessed with an improved sky-subtraction algorithm and a final, self-consistent photometric recalibration and flat-field determination. This release also includes all data from the second phase of the Sloan Extension for Galactic Understanding and Evolution (SEGUE-2), consisting of spectroscopy of approximately 118,000 stars at both high and low Galactic latitudes. All the more than half a million stellar spectra obtained with the SDSS spectrograph have been reprocessed through an improved stellar parameters pipeline, which has better determination of metallicity for high metallicity stars.

Correlations between the intrinsic shapes of galaxy pairs, and between the intrinsic shapes of galaxies and the large-scale density field, may be induced by tidal fields. These correlations, which have been detected at low redshifts (z<0.35) for bright red galaxies in the Sloan Digital Sky Survey (SDSS), and for which upper limits exist for blue galaxies at z~0.1, provide a window into galaxy formation and evolution, and are also an important contaminant for current and future weak lensing surveys. Measurements of these alignments at intermediate redshifts (z~0.6) that are more relevant for cosmic shear observations are very important for understanding the origin and redshift evolution of these alignments, and for minimising their impact on weak lensing measurements. We present the first such intermediate-redshift measurement for blue galaxies, using galaxy shape measurements from SDSS and spectroscopic redshifts from the WiggleZ Dark Energy Survey. Our null detection allows us to place upper limits on the contamination of weak lensing measurements by blue galaxy intrinsic alignments that, for the first time, do not require significant model-dependent extrapolation from the z~0.1 SDSS observations. Also, combining the SDSS and WiggleZ constraints gives us a long redshift baseline with which to constrain intrinsic alignment models and contamination of the cosmic shear power spectrum. Assuming that the alignments can be explained by linear alignment with the smoothed local density field, we find that a measurement of \sigma_8 in a blue-galaxy dominated, CFHTLS-like survey would be contaminated by at most +/-0.02 (95% confidence level, SDSS and WiggleZ) or +/-0.03 (WiggleZ alone) due to intrinsic alignments. [Abridged]

The clustering of matter on cosmological scales is an essential probe for studying the physical origin and composition of our Universe. To date, most of the direct studies have focused on shear-shear weak lensing correlations, but it is also possible to extract the dark matter clustering by combining galaxy-clustering and galaxy-galaxy-lensing measurements. In this study we develop a method that can constrain the dark matter correlation function from galaxy clustering and galaxy-galaxy-lensing measurements, by focusing on the correlation coefficient between the galaxy and matter overdensity fields. To generate a mock galaxy catalogue for testing purposes, we use the Halo Occupation Distribution approach applied to a large ensemble of N-body simulations to model pre-existing SDSS Luminous Red Galaxy sample observations. Using this mock catalogue, we show that a direct comparison between the excess surface mass density measured by lensing and its corresponding galaxy clustering quantity is not optimal. We develop a new statistic that suppresses the small-scale contributions to these observations and show that this new statistic leads to a cross-correlation coefficient that is within a few percent of unity down to 5 Mpc/h. Furthermore, the residual incoherence between the galaxy and matter fields can be explained using a theoretical model for scale-dependent bias, giving us a final estimator that is unbiased to within 1%. We also perform a comprehensive study of other physical effects that can affect the analysis, such as redshift space distortions and differences in radial windows between galaxy clustering and weak lensing observations. We apply the method to a range of cosmological models and show the viability of our new statistic to distinguish between cosmological models.

Although general relativity underlies modern cosmology, its applicability on cosmological length scales has yet to be stringently tested. Such a test has recently been proposed, using a quantity, EG, that combines measures of large-scale gravitational lensing, galaxy clustering and structure growth rate. The combination is insensitive to 'galaxy bias' (the difference between the clustering of visible galaxies and invisible dark matter) and is thus robust to the uncertainty in this parameter. Modified theories of gravity generally predict values of EG different from the general relativistic prediction because, in these theories, the 'gravitational slip' (the difference between the two potentials that describe perturbations in the gravitational metric) is non-zero, which leads to changes in the growth of structure and the strength of the gravitational lensing effect3. Here we report that EG = 0.39 +/- 0.06 on length scales of tens of megaparsecs, in agreement with the general relativistic prediction of EG $\approx$ 0.4. The measured value excludes a model within the tensor-vector-scalar gravity theory, which modifies both Newtonian and Einstein gravity. However, the relatively large uncertainty still permits models within f(R) theory, which is an extension of general relativity. A fivefold decrease in uncertainty is needed to rule out these models.

Weak gravitational lensing has been used extensively in the past decade to constrain the masses of galaxy clusters, and is the most promising observational technique for providing the mass calibration necessary for precision cosmology with clusters. There are several challenges in estimating cluster masses, particularly (a) the sensitivity to astrophysical effects and observational systematics that modify the signal relative to the theoretical expectations, and (b) biases that can arise due to assumptions in the mass estimation method, such as the assumed radial profile of the cluster. All of these challenges are more problematic in the inner regions of the cluster, suggesting that their influence would ideally be suppressed for the purpose of mass estimation. However, at any given radius the differential surface density measured by lensing is sensitive to all mass within that radius, and the corrupted signal from the inner parts is spread out to all scales. We develop a new statistic that is ideal for estimation of cluster masses because it completely eliminates mass contributions below a chosen scale (which we suggest should be about 20 per cent of the virial radius), and thus reduces sensitivity to systematic and astrophysical effects. We use simulated and analytical profiles to quantify systematic biases on the estimated masses for several standard methods of mass estimation, finding that these can lead to significant mass biases that range from ten to over fifty per cent. The mass uncertainties when using our new statistic are reduced by up to a factor of ten relative to the standard methods, while only moderately increasing the statistical errors. This new method of mass estimation will enable a higher level of precision in future science work with weak lensing mass estimates for galaxy clusters.

We study the profiles of 75 086 elliptical galaxies from the Sloan Digital Sky Survey (SDSS) at both large (50-500 kpc/h) and small (~3 kpc/h) scales. Weak lensing observations in the outskirts of the halo are combined with measurements of the stellar velocity dispersion in the interior regions of the galaxy for stacked galaxy samples. The weak lensing measurements are well characterized by a Navarro, Frenk and White (NFW) profile. The dynamical mass measurements exceed the extrapolated NFW profile even after the estimated stellar masses are subtracted, providing evidence for the modification of the dark matter profile by the baryons. This excess mass is quantitatively consistent with the predictions of the adiabatic contraction (AC) hypothesis. Our finding suggests that the effects of AC during galaxy formation are stable to subsequent bombardment from major and minor mergers. We explore several theoretical and observational systematics and conclude that they cannot account for the inferred mass excess. The most significant source of systematic error is in the IMF, which would have to increase the stellar mass estimates by a factor of two relative to masses from the Kroupa IMF to fully explain the mass excess without AC. Such an increase would create tension with results from SAURON (Cappellari et al. 2006). We demonstrate a connection between the level of contraction of the dark matter halo profile and scatter in the size-luminosity relation, which is a projection of the fundamental plane. Whether or not AC is the mechanism supplying the excess mass, models of galaxy formation and evolution must reconcile the observed halo masses from weak lensing with the comparatively large dynamical masses at the half light radii of the galaxies.

A survey that can cover the sky in optical bands over wide fields to faint magnitudes with a fast cadence will enable many of the exciting science opportunities of the next decade. The Large Synoptic Survey Telescope (LSST) will have an effective aperture of 6.7 meters and an imaging camera with field of view of 9.6 deg^2, and will be devoted to a ten-year imaging survey over 20,000 deg^2 south of +15 deg. Each pointing will be imaged 2000 times with fifteen second exposures in six broad bands from 0.35 to 1.1 microns, to a total point-source depth of r~27.5. The LSST Science Book describes the basic parameters of the LSST hardware, software, and observing plans. The book discusses educational and outreach opportunities, then goes on to describe a broad range of science that LSST will revolutionize: mapping the inner and outer Solar System, stellar populations in the Milky Way and nearby galaxies, the structure of the Milky Way disk and halo and other objects in the Local Volume, transient and variable objects both at low and high redshift, and the properties of normal and active galaxies at low and high redshift. It then turns to far-field cosmological topics, exploring properties of supernovae to z~1, strong and weak lensing, the large-scale distribution of galaxies and baryon oscillations, and how these different probes may be combined to constrain cosmological models and the physics of dark energy.

We develop an improved mass tracer for clusters of galaxies from optically observed parameters, and calibrate the mass relation using weak gravitational lensing measurements. We employ a sample of ~ 13,000 optically-selected clusters from the Sloan Digital Sky Survey (SDSS) maxBCG catalog, with photometric redshifts in the range 0.1-0.3. The optical tracers we consider are cluster richness, cluster luminosity, luminosity of the brightest cluster galaxy (BCG), and combinations of these parameters. We measure the weak lensing signal around stacked clusters as a function of the various tracers, and use it to determine the tracer with the least amount of scatter. We further use the weak lensing data to calibrate the mass normalization. We find that the best mass estimator for massive clusters is a combination of cluster richness, N_{200}, and the luminosity of the brightest cluster galaxy, L_{BCG}: M_{200\bar{\rho}} = (1.27 +/- 0.08) (N_{200}/20)^{1.20 +/- 0.09} (L_{BCG}/\bar{L}_{BCG}(N_{200}))^{0.71 +/- 0.14} \times 10^{14} h^{-1} M_sun, where $\bar{L}_{BCG}(N_{200})$ is the observed mean BCG luminosity at a given richness. This improved mass tracer will enable the use of galaxy clusters as a more powerful tool for constraining cosmological parameters.

We present the results of the GREAT08 Challenge, a blind analysis challenge to infer weak gravitational lensing shear distortions from images. The primary goal was to stimulate new ideas by presenting the problem to researchers outside the shear measurement community. Six GREAT08 Team methods were presented at the launch of the Challenge and five additional groups submitted results during the 6 month competition. Participants analyzed 30 million simulated galaxies with a range in signal to noise ratio, point-spread function ellipticity, galaxy size, and galaxy type. The large quantity of simulations allowed shear measurement methods to be assessed at a level of accuracy suitable for currently planned future cosmic shear observations for the first time. Different methods perform well in different parts of simulation parameter space and come close to the target level of accuracy in several of these. A number of fresh ideas have emerged as a result of the Challenge including a re-examination of the process of combining information from different galaxies, which reduces the dependence on realistic galaxy modelling. The image simulations will become increasingly sophisticated in future GREAT challenges, meanwhile the GREAT08 simulations remain as a benchmark for additional developments in shear measurement algorithms.

[Abridged] Many current and future astronomical surveys will rely on samples of strong gravitational lens systems to draw conclusions about galaxy mass distributions. We use a new strong lensing pipeline (presented in Paper I of this series) to explore selection biases that may cause the population of strong lensing systems to differ from the general galaxy population. Our focus is on point-source lensing by early-type galaxies with two mass components (stellar and dark matter) that have a variety of density profiles and shapes motivated by observational and theoretical studies of galaxy properties. We seek not only to quantify but also to understand the physics behind selection biases related to: galaxy mass, orientation and shape; dark matter profile parameters such as inner slope and concentration; and adiabatic contraction. We study how all of these properties affect the lensing Einstein radius, total cross-section, quad/double ratio, and image separation distribution. We find significant (factors of several) selection biases with mass; orientation, for a given galaxy shape at fixed mass; cusped dark matter profile inner slope and concentration; concentration of the stellar and dark matter deprojected Sersic models. Interestingly, the intrinsic shape of a galaxy does not strongly influence its lensing cross-section when we average over viewing angles. Our results are an important first step towards understanding how strong lens systems relate to the general galaxy population.

Studies of strong gravitational lensing in current and upcoming wide and deep photometric surveys, and of stellar kinematics from (integral-field) spectroscopy at increasing redshifts, promise to provide valuable constraints on galaxy density profiles and shapes. However, both methods are affected by various selection and modelling biases, whch we aim to investigate in a consistent way. In this first paper in a series we develop a flexible but efficient pipeline to simulate lensing by realistic galaxy models. These galaxy models have separate stellar and dark matter components, each with a range of density profiles and shapes representative of early-type, central galaxies without significant contributions from other nearby galaxies. We use Fourier methods to calculate the lensing properties of galaxies with arbitrary surface density distributions, and Monte Carlo methods to compute lensing statistics such as point-source lensing cross-sections. Incorporating a variety of magnification bias modes lets us examine different survey limitations in image resolution and flux. We rigorously test the numerical methods for systematic errors and sensitivity to basic assumptions. We also determine the minimum number of viewing angles that must be sampled in order to recover accurate orientation-averaged lensing quantities. We find that for a range of non-isothermal stellar and dark matter density profiles typical of elliptical galaxies, the combined density profile and corresponding lensing properties are surprisingly close to isothermal around the Einstein radius. The converse implication is that constraints from strong lensing and/or stellar kinematics, which are indeed consistent with isothermal models near the Einstein radius, cannot trivially be extrapolated to smaller and larger radii.

The GRavitational lEnsing Accuracy Testing 2008 (GREAT08) Challenge focuses on a problem that is of crucial importance for future observations in cosmology. The shapes of distant galaxies can be used to determine the properties of dark energy and the nature of gravity, because light from those galaxies is bent by gravity from the intervening dark matter. The observed galaxy images appear distorted, although only slightly, and their shapes must be precisely disentangled from the effects of pixelisation, convolution and noise. The worldwide gravitational lensing community has made significant progress in techniques to measure these distortions via the Shear TEsting Program (STEP). Via STEP, we have run challenges within our own community, and come to recognise that this particular image analysis problem is ideally matched to experts in statistical inference, inverse problems and computational learning. Thus, in order to continue the progress seen in recent years, we are seeking an infusion of new ideas from these communities. This document details the GREAT08 Challenge for potential participants. Please visit http://www.great08challenge.info for the latest information.

In order to attract and retain excellent researchers and diverse individuals in astrophysics, we recommend action be taken in several key areas impacting young scientists: (1) Maintain balance between large collaborations and individual projects through distribution of funding; encourage public releases of observational and simulation data for use by a broader community. (2) Improve the involvement of women, particularly at leading institutions. (3) Address the critical shortage of child care options and design reasonable profession-wide parental leave policies. (4) Streamline the job application and hiring process. We summarize our reasons for bringing these areas to the attention of the committee, and we suggest several practical steps that can be taken to address them.

The Cold Dark Matter theory of gravitationally-driven hierarchical structure formation has earned its status as a paradigm by explaining the distribution of matter over large spans of cosmic distance and time. However, its central tenet, that most of the matter in the universe is dark and exotic, is still unproven; the dark matter hypothesis is sufficiently audacious as to continue to warrant a diverse battery of tests. While local searches for dark matter particles or their annihilation signals could prove the existence of the substance itself, studies of cosmological dark matter in situ are vital to fully understand its role in structure formation and evolution. We argue that gravitational lensing provides the cleanest and farthest-reaching probe of dark matter in the universe, which can be combined with other observational techniques to answer the most challenging and exciting questions that will drive the subject in the next decade: What is the distribution of mass on sub-galactic scales? How do galaxy disks form and bulges grow in dark matter halos? How accurate are CDM predictions of halo structure? Can we distinguish between a need for a new substance (dark matter) and a need for new physics (departures from General Relativity)? What is the dark matter made of anyway? We propose that the central tool in this program should be a wide-field optical imaging survey, whose true value is realized with support in the form of high-resolution, cadenced optical/infra-red imaging, and massive-throughput optical spectroscopy.

The coming decade will be an exciting period for dark energy research, during which astronomers will address the question of what drives the accelerated cosmic expansion as first revealed by type Ia supernova (SN) distances, and confirmed by later observations. The mystery of dark energy poses a challenge of such magnitude that, as stated by the Dark Energy Task Force (DETF), "nothing short of a revolution in our understanding of fundamental physics will be required to achieve a full understanding of the cosmic acceleration." The lack of multiple complementary precision observations is a major obstacle in developing lines of attack for dark energy theory. This lack is precisely what next-generation surveys will address via the powerful techniques of weak lensing (WL) and baryon acoustic oscillations (BAO) -- galaxy correlations more generally -- in addition to SNe, cluster counts, and other probes of geometry and growth of structure. Because of their unprecedented statistical power, these surveys demand an accurate understanding of the observables and tight control of systematics. This white paper highlights the opportunities, approaches, prospects, and challenges relevant to dark energy studies with wide-deep multiwavelength photometric redshift surveys. Quantitative predictions are presented for a 20000 sq. deg. ground-based 6-band (ugrizy) survey with 5-sigma depth of r~27.5, i.e., a Stage 4 survey as defined by the DETF.

We compute two-point correlation functions and measure the shear signal due to galaxy-galaxy lensing for 80,000 optically identified and 5,700 radio-loud AGN from Data Release 4 (DR4) of the Sloan Digital Sky Survey. Halo occupation models are used to estimate halo masses and satellite fractions for these two types of AGN. The large sample size allows us to separate AGN according to the stellar mass of their host galaxies. We study how the halo masses of optical and radio AGN differ from those of the parent population at fixed M*. Halo masses deduced from clustering and from lensing agree satisfactorily. Radio AGN are found in more massive halos than optical AGN: in our samples their mean halo masses are 1.6 x 10^{13} and 8 x 10^{11} M_{sun}/h, respectively. Optical AGN follow the same relation between stellar mass and halo mass as galaxies selected without regard to nuclear properties, but radio-loud AGN deviate significantly from this relation. The dark matter halos of radio-loud AGN are about twice as massive as those of control galaxies of the same stellar mass. This boost is independent of radio luminosity, and persists even when our analysis is restricted to field galaxies. The large-scale gaseous environment of the galaxy clearly plays a crucial role in producing observable radio emission. The dark matter halo masses that we derive for the AGN in our two samples are in good agreement with recent models in which feedback from radio AGN becomes dominant in halos where gas cools quasi-statically.

We perform a statistical weak lensing analysis of dark matter profiles around tracers of halo mass from galactic- to cluster-size halos. In this analysis we use 170,640 isolated ~L* galaxies split into ellipticals and spirals, 38,236 groups traced by isolated spectroscopic Luminous Red Galaxies (LRGs) and 13,823 MaxBCG clusters from the Sloan Digital Sky Survey (SDSS) covering a wide range of richness. Together these three samples allow a determination of the density profiles of dark matter halos over three orders of magnitude in mass, from 10^{12} M_{sun} to 10^{15} M_{sun}. The resulting lensing signal is consistent with an NFW or Einasto profile on scales outside the central region. We find that the NFW concentration parameter c_{200b} decreases with halo mass, from around 10 for galactic halos to 4 for cluster halos. Assuming its dependence on halo mass in the form of c_{200b} = c_0 [M/(10^{14}M_{sun}/h)]^{\beta}, we find c_0=4.6 +/- 0.7 (at z=0.22) and \beta=0.13 +/- 0.07, with very similar results for the Einasto profile. The slope (\beta) is in agreement with theoretical predictions, while the amplitude is about two standard deviations below the predictions for this mass and redshift, but we note that the published values in the literature differ at a level of 10-20% and that for a proper comparison our analysis should be repeated in simulations. We discuss the implications of our results for the baryonic effects on the shear power spectrum: since these are expected to increase the halo concentration, the fact that we see no evidence of high concentrations on scales above 20% of the virial radius suggests that baryonic effects are limited to small scales, and are not a significant source of uncertainty for the current weak lensing measurements of the dark matter power spectrum. [ABRIDGED]

This is the first in a series of papers on the weak lensing effect caused by clusters of galaxies in Sloan Digital Sky Survey. The photometrically selected cluster sample, known as MaxBCG, includes ~130,000 objects between redshift 0.1 and 0.3, ranging in size from small groups to massive clusters. We split the clusters into bins of richness and luminosity and stack the surface density contrast to produce mean radial profiles. The mean profiles are detected over a range of scales, from the inner halo (25 kpc/h) well into the surrounding large scale structure (30 Mpc/h), with a significance of 15 to 20 in each bin. The signal over this large range of scales is best interpreted in terms of the cluster-mass cross-correlation function. We pay careful attention to sources of systematic error, correcting for them where possible. The resulting signals are calibrated to the ~10% level, with the dominant remaining uncertainty being the redshift distribution of the background sources. We find that the profiles scale strongly with richness and luminosity. We find the signal within a given richness bin depends upon luminosity, suggesting that luminosity is more closely correlated with mass than galaxy counts. We split the samples by redshift but detect no significant evolution. The profiles are not well described by power laws. In a subsequent series of papers we invert the profiles to three-dimensional mass profiles, show that they are well fit by a halo model description, measure mass-to-light ratios and provide a cosmological interpretation.

Accurate photometric redshifts are among the key requirements for precision weak lensing measurements. Both the large size of the Sloan Digital Sky Survey (SDSS) and the existence of large spectroscopic redshift samples that are flux-limited beyond its depth have made it the optimal data source for developing methods to properly calibrate photometric redshifts for lensing. Here, we focus on galaxy-galaxy lensing in a survey with spectroscopic lens redshifts, as in the SDSS. We develop statistics that quantify the effect of source redshift errors on the lensing calibration and on the weighting scheme, and show how they can be used in the presence of redshift failure and sampling variance. We then demonstrate their use with 2838 source galaxies with spectroscopy from DEEP2 and zCOSMOS, evaluating several public photometric redshift algorithms, in two cases including a full p(z) for each object, and find lensing calibration biases as low as 1% (due to fortuitous cancellation of two types of bias) or as high as 20% for methods in active use (despite the small mean photoz bias of these algorithms). Our work demonstrates that lensing-specific statistics must be used to reliably calibrate the lensing signal, due to asymmetric effects of (frequently non-Gaussian) photoz errors. We also demonstrate that large-scale structure (LSS) can strongly impact the photoz calibration and its error estimation, due to a correlation between the LSS and the photoz errors, and argue that at least two independent degree-scale spectroscopic samples are needed to suppress its effects. Given the size of our spectroscopic sample, we can reduce the galaxy-galaxy lensing calibration error well below current SDSS statistical errors.

Correlations between intrinsic shear and the density field on large scales, a potentially important contaminant for cosmic shear surveys, have been robustly detected at low redshifts with bright galaxies in SDSS data. Here we present a more detailed characterization of this effect, which can cause anti-correlations between gravitational lensing shear and intrinsic ellipticity (GI correlations). This measurement uses 36278 Luminous Red Galaxies (LRGs) from the SDSS spectroscopic sample with 0.15<z<0.35, split by redshift and luminosity; 7758 LRGs from the 2SLAQ Survey at 0.4<z<0.8; and a variety of other SDSS samples from previous, related work. We find >3sigma detections of the effect for all galaxy subsamples within the SDSS LRG sample; for the 2SLAQ sample, we find a 2sigma detection for a bright subsample, and no detection for a fainter subsample. Fitting formulae are provided for the scaling of the GI correlations with luminosity, transverse separation, and redshift. We estimate contamination in the measurement of sigma_8 for future cosmic shear surveys on the basis of the fitted dependence of GI correlations on galaxy properties. We find contamination to the power spectrum ranging from -1.5 (optimistic) to -33 per cent (pessimistic) for a toy cosmic shear survey using all galaxies to a depth of R=24 using scales l~500. This corresponds to a bias in sigma_8 of Delta sigma_8=-0.004 (optimistic), -0.02 (central), or -0.10 (pessimistic). We provide a prescription for inclusion of this error in cosmological parameter estimation codes. The principal uncertainty is in the treatment of the L<=L* blue galaxies. Characterization of the tidal alignments of these galaxies, especially at redshifts relevant for cosmic shear, should be a high priority for the cosmic shear community. (Abridged)

Cluster abundance measurements are among the most sensitive probes of the amplitude of matter fluctuations in the universe, which in turn can help constrain other cosmological parameters, like the dark energy equation of state or neutrino mass. However, difficulties in calibrating the relation between the cluster observable and halo mass, and the lack of completeness information, make this technique particularly susceptible to systematic errors. Here we argue that a cluster abundance analysis using statistical weak lensing on the stacked clusters leads to a robust lower limit on the amplitude of fluctuations. The method compares the average weak lensing signal measured around the whole cluster sample to a theoretical prediction, assuming that the clusters occupy the centers of all of the most massive halos above some minimum mass threshold. If the amplitude of fluctuations is below a certain limiting value, there are too few massive clusters in this model and the theoretical prediction falls below the observations. Since any effects that modify the model assumptions can only decrease the theoretical prediction, the limiting amplitude becomes a robust lower limit. Here, we apply it to a volume limited sample of 16,000 group/cluster candidates identified from isolated luminous red galaxies (LRGs) in the Sloan Digital Sky Survey (SDSS). We find $\sigma_8 (\Omega_m/0.25)^{0.5}>0.62$ at the 95% c.l. after taking into account observational errors in the lensing analysis. While this is a relatively weak constraint, both the scatter in the LRG luminosity-halo mass relation and the lensing errors are large; the constraints could improve considerably in the future with more sophisticated cluster identification algorithms and smaller errors in the lensing analysis. [Abridged]

The Shear TEsting Programme (STEP) is a collaborative project to improve the accuracy and reliability of weak lensing measurement, in preparation for the next generation of wide-field surveys. We review sixteen current and emerging shear measurement methods in a common language, and assess their performance by running them (blindly) on simulated images that contain a known shear signal. We determine the common features of algorithms that most successfully recover the input parameters. We achieve previously unattained discriminatory precision in our analysis, via a combination of more extensive simulations, and pairs of galaxy images that have been rotated with respect to each other, thus removing noise from their intrinsic ellipticities. The robustness of our simulation approach is also confirmed by testing the relative calibration of methods on real data. Weak lensing measurement has improved since the first STEP paper. Several methods now consistently achieve better than 2% precision, and are still being developed. However, the simulations can now distinguish all methods from perfect performance. Our main concern continues to be the potential for a multiplicative shear calibration bias: not least because this can not be internally calibrated with real data. We determine which galaxy populations are responsible and, by adjusting the simulated observing conditions, we also investigate the effects of instrumental and atmospheric parameters. We have isolated several previously unrecognised aspects of galaxy shape measurement, in which focussed development could provide further progress towards the sub-percent level of precision desired for future surveys. [ABRIDGED]

We present results of a measurement of the shape of the density profile of galaxy groups and clusters traced by 43 335 Luminous Red Galaxies (LRGs) with spectroscopic redshifts from the Sloan Digital Sky Survey (SDSS). The galaxies are selected such that they are the brightest within a cylindrical aperture, split into two luminosity samples, and modeled as the sum of stellar and dark matter components. We present a detailed investigation of many possible systematic effects that could contaminate our signal and develop methods to remove them, including a detected intrinsic alignment for galaxies within 100 kpc/h of LRGs which we remove using photometric redshift information. The resulting lensing signal is consistent with NFW profile dark matter halos; the SIS profile is ruled out at the 96 (conservatively) and 99.96 per cent confidence level (CL) for the fainter and brighter lens samples (respectively) when we fit using lensing data between 40 kpc/h and 2 Mpc/h with total signal-to-noise of 19 and 25 for the two lens samples. The lensing signal amplitude suggests that the faint and bright sample galaxies typically reside in haloes of mass (2.9+/-0.4)x10^{13} M_{sun}/h and (6.7+/-0.8)x10^{13} M_{sun}/h respectively, in good agreement with predictions based on halo spatial density with normalization lower than the 'concordance' sigma_8=0.9. When fitting for the concentration parameter in the NFW profile, we find c = 5.0+/-0.6 (stat) +/-1 (sys), and c = 5.6+/-0.6 (stat) +/-1 (sys) for the faint and bright samples, consistent with Lambda-CDM simulations. We also split the bright sample further to determine masses and concentrations for cluster-mass halos, finding mass (1.3+/-0.2)x10^{14} M_{sun}/h for the sample of LRGs brighter than -22.6 in r. (Abridged)

We present the results of attempts to detect the ellipticity of dark matter halos using galaxy-galaxy weak lensing with SDSS data. We use 2,020,256 galaxies brighter than r=19 with photometric redshifts (divided into colour and luminosity subsamples) as lenses and 31,697,869 source galaxies. We search for and identify several signal contaminants, which if not removed lead to a spurious detection. These include systematic shear that leads to a slight spurious alignment of lens and source ellipticities, intrinsic alignments (due to contamination of the source sample by physically-associated lens source pairs), and anisotropic magnification bias. We develop methods that allow us to remove these contaminants to the signal. We split the analysis into blue (spiral) and red (elliptical) galaxies. Assuming Gaussian errors as in previous work and a power-law profile, we find f_h=e_h/e_g=0.1+/-0.06 for red galaxies and -0.8+/-0.4 for blue galaxies using 20-300 kpc/h, averaged over luminosity. Inclusion of the more realistic non-Gaussian error distributions and of the NFW density profile (which predicts much smaller ellipticity of the shear for scales above the scale radius) yields 0.60+/-0.38 for ellipticals and -1.4+1.7-2.0 for spirals. While there is no concrete detection of alignment in either case, there is a suggestion in the data of a positive alignment in the brightest lens sample of ellipticals. Our results appear to be mildly inconsistent with a previously reported detection by Hoekstra et al. (2004), but more data and further tests are needed to clarify whether the discrepancy is real or a consequence of differences in the lens galaxy samples used and analysis methods.

The relationship between galaxies and dark matter can be characterized by the halo mass of the central galaxy and the fraction of galaxies that are satellites. Here we present observational constraints from the SDSS on these quantities as a function of r-band luminosity and stellar mass using galaxy-galaxy weak lensing, with a total of 351,507 lenses. We use stellar masses derived from spectroscopy and virial halo masses derived from weak gravitational lensing to determine the efficiency with which baryons in the halo of the central galaxy have been converted into stars. We find that an L* galaxy with a stellar mass of 6x10^{10} M_{sun} is hosted by a halo with mass of 1.4x10^{12} M_{sun}/h, independent of morphology, yielding baryon conversion efficiencies of 17_{-5}^{+10} (early types) and 16_{-6}^{+15} (late types) per cent at the 95 per cent CL (statistical, not including systematic uncertainty due to assumption of a universal initial mass function, or IMF). We find that for a given stellar mass, the halo mass is independent of morphology below M_{stellar}=10^{11} M_{sun}, in contrast to typically a factor of two difference in halo mass between ellipticals and spirals at a fixed luminosity. This suggests that stellar mass is a good proxy for halo mass in this range and should be used preferentially whenever a halo mass selected sample is needed. For higher stellar masses, the conversion efficiency is a declining function of stellar mass, and the differences in halo mass between early and late types become larger, reflecting the fact that most group and cluster halos with masses above 10^{13} M_{sun} host ellipticals at the center, while even the brightest central spirals are hosted by halos of mass below 10^{13} M_{sun}. (Abridged)

The power spectrum of weak lensing shear caused by large-scale structure is an emerging tool for precision cosmology, in particular for measuring the effects of dark energy on the growth of structure at low redshift. One potential source of systematic error is intrinsic alignments of ellipticities of neighbouring galaxies (II correlation) that could mimic the correlations due to lensing. A related possibility pointed out by Hirata and Seljak (2004) is correlation between the intrinsic ellipticities of galaxies and the density field responsible for gravitational lensing shear (GI correlation). We present constraints on both the II and GI correlations using 265 908 spectroscopic galaxies from the SDSS, and using galaxies as tracers of the mass in the case of the GI analysis. The availability of redshifts in the SDSS allows us to select galaxies at small radial separations, which both reduces noise in the intrinsic alignment measurement and suppresses galaxy- galaxy lensing (which otherwise swamps the GI correlation). While we find no detection of the II correlation, our results are nonetheless statistically consistent with recent detections found using the SuperCOSMOS survey. In contrast, we have a clear detection of GI correlation in galaxies brighter than L* that persists to the largest scales probed (60 Mpc/h) and with a sign predicted by theoretical models. This correlation could cause the existing lensing surveys at z~1 to underestimate the linear amplitude of fluctuations by as much as 20% depending on the source sample used, while for surveys at z~0.5 the underestimation may reach 30%. (Abridged.)

Galaxy-galaxy lensing is a powerful probe of the relation between galaxies and dark matter halos, but its theoretical interpretation requires a careful modeling of various contributions, such as the contribution from central and satellite galaxies. For this purpose, a phenomenological approach based on the halo model has been developed, allowing for fast exploration of the parameter space of models. In this paper, we investigate the ability of the halo model to extract information from the g-g weak lensing signal by comparing it to high-resolution dissipationless simulations that resolve subhalos. We find that the halo model reliably determines parameters such as the host halo mass of central galaxies, the fraction of galaxies that are satellites, and their radial distribution inside larger halos. If there is a significant scatter present in the central galaxy host halo mass distribution, then the mean and median mass of that distribution can differ significantly from one another, and the halo model mass determination lies between the two. This result suggests that when analyzing the data, galaxy subsamples with a narrow central galaxy halo mass distribution, such as those based on stellar mass, should be chosen for a simpler interpretation of the results.

Weak lensing is emerging as a powerful observational tool to constrain cosmological models, but is at present limited by an incomplete understanding of many sources of systematic error. Many of these errors are multiplicative and depend on the population of background galaxies. We show how the commonly cited geometric test, which is rather insensitive to cosmology, can be used as a ratio test of systematics in the lensing signal at the 1 per cent level. We apply this test to the galaxy-galaxy lensing analysis of the Sloan Digital Sky Survey (SDSS), which at present is the sample with the highest weak lensing signal to noise and has the additional advantage of spectroscopic redshifts for lenses. This allows one to perform meaningful geometric tests of systematics for different subsamples of galaxies at different mean redshifts, such as brighter galaxies, fainter galaxies and high-redshift luminous red galaxies, both with and without photometric redshift estimates. We use overlapping objects between SDSS and the DEEP2 and 2SLAQ spectroscopic surveys to establish accurate calibration of photometric redshifts and to determine the redshift distributions for SDSS. We use these redshift results to compute the projected surface density contrast DeltaSigma around 259 609 spectroscopic galaxies in the SDSS; by measuring DeltaSigma with different source samples we establish consistency of the results at the 10 per cent level (1-sigma). We also use the ratio test to constrain shear calibration biases and other systematics in the SDSS survey data to determine the overall galaxy-galaxy weak lensing signal calibration uncertainty. We find no evidence of any inconsistency among many subsamples of the data.

We combine the measurements of luminosity dependence of bias with the luminosity dependent weak lensing analysis of dark matter around galaxies to derive the galaxy bias and constrain nonlinear mass and cosmological parameters. We take advantage of theoretical and simulation predictions that predict that while halo bias is rapidly increasing with mass for high masses, it is nearly constant in low mass halos. We use a new weak lensing analysis around the same SDSS galaxies to determine their halo mass probability distribution. These halo mass probability distributions are used to predict the bias for each luminosity subsample and we find an excellent agreement with observed values. The required nonlinear mass suggests slightly lower matter density than usually assumed, Omegam=0.25+/- 0.03 for the simplest models. We combine the bias constraints with those from the WMAP and the SDSS power spectrum analysis to derive new constraints on bias and sigma_8. For the most general parameter space we find sigma_8=0.88+/- 0.06 and b_*=0.99+/- 0.07. In the context of spatially flat models we improve the limit on the neutrino mass for the case of 3 degenerate families from m_nu<0.6eV without bias to m_nu<0.18eV with bias (95% c.l.), which is weakened to m_nu<0.24eV if running is allowed. The corresponding limit for 3 massless + 1 massive neutrino is 1.37eV.

Galaxy-galaxy lensing has emerged as a powerful probe of the dark matter halos of galaxies, but is subject to contamination if intrinsically aligned satellites of the lens galaxy are used as part of the source sample. We present a measurement of this intrinsic shear using 200,747 lens galaxies from the Sloan Digital Sky Survey (SDSS) spectroscopic sample and a sample of satellites selected using photometric redshifts. The mean intrinsic shear at transverse separations of 30--446$h^{-1}$ kpc is constrained to be $-0.0062<\Delta\gamma<+0.0066$ (99.9 per cent confidence, including identified systematics), which limits contamination of the galaxy-galaxy lensing signal to at most $\sim 15$ per cent on these scales. We present these limits as a function of transverse separation and lens luminosity. We furthermore investigate shear calibration biases in the SDSS, which can also affect galaxy-galaxy lensing, and conclude that the shear amplitude is calibrated to better than 18 per cent. This includes noise-induced calibration biases in the ellipticity, which are small for the sample considered here, but which can be more important if low signal-to-noise or poorly resolved source galaxies are used.

We investigate the promise of the Ly-alpha forest for high precision cosmology in the era of the Sloan Digital Sky Survey using low order N-point statistics. We show that with the existing data one can determine the amplitude, slope and curvature of the slope of the matter power spectrum with a few percent precision. Higher order statistics such as the bispectrum provide independent information that can confirm and improve upon the statistical precision from the power spectrum alone. The achievable precision is comparable to that from the cosmic microwave background with upcoming satellites, and complements it by measuring the power spectrum amplitude and shape at smaller scales. Since the data cover the redshift range 2<z<4, one can also extract the evolution of the growth factor and Hubble parameter over this range, and provide useful constraints on the presence of dark energy at z>2.

Statistical properties of gas absorption in high redshift quasars such as power spectrum and bispectrum allow one to determine the evolution of structure over the redshift range 2<z<4. Sloan Digital Sky Survey (SDSS) will measure around 10,000 quasar spectra in this redshift range and will allow one to determine the growth factor with a few percent accuracy. This allows one to extend the studies of dark energy to higher redshift and determine the presence of dark energy if Omega_de>0.1-0.2 at z>2. In combination with low redshift studies one can place useful limits on the time evolution of the equation of state.