The Complete Calibration of the Colour-Redshift Relation survey (C3R2) is a spectroscopic effort involving ESO and Keck facilities designed to empirically calibrate the galaxy colour-redshift relation - P(z|C) to the Euclid depth (i_AB=24.5) and is intimately linked to upcoming Stage IV dark energy missions based on weak lensing cosmology. The aim is to build a spectroscopic calibration sample that is as representative as possible of the galaxies of the Euclid weak lensing sample. In order to minimise the number of spectroscopic observations to fill the gaps in current knowledge of the P(z|C), self-organising map (SOM) representations of the galaxy colour space have been constructed. Here we present the first results of an ESO@ VLT Large Programme approved in the context of C3R2, which makes use of the two VLT optical and near-infrared multi-object spectrographs, FORS2 and KMOS. This paper focuses on high-quality spectroscopic redshifts of high-z galaxies observed with the KMOS spectrograph in the H- and K-bands. A total of 424 highly-reliable z are measured in the 1.3<=z<=2.5 range, with total success rates of 60.7% in the H-band and 32.8% in the K-band. The newly determined z fill 55% of high and 35% of lower priority empty SOM grid cells. We measured Halpha fluxes in a 1."2 radius aperture from the spectra of the spectroscopically confirmed galaxies and converted them into star formation rates. In addition, we performed an SED fitting analysis on the same sample in order to derive stellar masses, E(B-V), total magnitudes, and SFRs. We combine the results obtained from the spectra with those derived via SED fitting, and we show that the spectroscopic failures come from either weakly star-forming galaxies (at z<1.7, i.e. in the H-band) or low S/N spectra (in the K-band) of z>2 galaxies.

Cosmic shear is a primary cosmological probe for several present and upcoming surveys investigating dark matter and dark energy, such as Euclid or WFIRST. The probe requires an extremely accurate measurement of the shapes of millions of galaxies based on imaging data. Crucially, the shear measurement must address and compensate for a range of interwoven nuisance effects related to the instrument optics and detector, noise, unknown galaxy morphologies, colors, blending of sources, and selection effects. This paper explores the use of supervised machine learning (ML) as a tool to solve this inverse problem. We present a simple architecture that learns to regress shear point estimates and weights via shallow artificial neural networks. The networks are trained on simulations of the forward observing process, and take combinations of moments of the galaxy images as inputs. A challenging peculiarity of this ML application is the combination of the noisiness of the input features and the requirements on the accuracy of the inverse regression. To address this issue, the proposed training algorithm minimizes bias over multiple realizations of individual source galaxies, reducing the sensitivity to properties of the overall sample of source galaxies. Importantly, an observational selection function of these source galaxies can be straightforwardly taken into account via the weights. We first introduce key aspects of our approach using toy-model simulations, and then demonstrate its potential on images mimicking Euclid data. Finally, we analyze images from the GREAT3 challenge, obtaining competitively low shear biases despite the use of a simple training set. We conclude that the further development of ML approaches is of high interest to meet the stringent requirements on the shear measurement in current and future surveys. A demonstration implementation of our technique is publicly available.

We present a public suite of weak lensing mock data, extending the Scinet Light Cone Simulations (SLICS) to simulate cross-correlation analyses with different cosmological probes. These mocks include KiDS-450- and LSST-like lensing data, cosmic microwave background lensing maps and simulated spectroscopic surveys that emulate the GAMA, BOSS and 2dFLenS galaxy surveys. With 844 independent realisations, our mocks are optimised for combined-probe covariance estimation, which we illustrate for the case of a joint measurement involving cosmic shear, galaxy-galaxy lensing and galaxy clustering from KiDS-450 and BOSS data. With their high spatial resolution, the SLICS are also optimal for predicting the signal for novel lensing estimators, for the validation of analysis pipelines, and for testing a range of systematic effects such as the impact of neighbour-exclusion bias on the measured tomographic cosmic shear signal. For surveys like KiDS and DES, where the rejection of neighbouring galaxies occurs within ~2 arcseconds, we show that the measured cosmic shear signal will be biased low, but by less than a percent on the angular scales that are typically used in cosmic shear analyses. The amplitude of the neighbour-exclusion bias doubles in deeper, LSST-like data. The simulation products described in this paper are made available at http://slics.roe.ac.uk/.

We measure the projected galaxy clustering and galaxy-galaxy lensing signals using the Galaxy And Mass Assembly (GAMA) survey and Kilo-Degree Survey (KiDS) to study galaxy bias. We use the concept of non-linear and stochastic galaxy biasing in the framework of halo occupation statistics to constrain the parameters of the halo occupation statistics and to unveil the origin of galaxy biasing. The bias function $\Gamma_{\text{gm}}(r_{\text{p}})$, where $r_{\text{p}}$ is the projected comoving separation, is evaluated using the analytical halo model from which the scale dependence of $\Gamma_{\text{gm}}(r_{\text{p}})$, and the origin of the non-linearity and stochasticity in halo occupation models can be inferred. Our observations unveil the physical reason for the non-linearity and stochasticity, further explored using hydrodynamical simulations, with the stochasticity mostly originating from the non-Poissonian behaviour of satellite galaxies in the dark matter haloes and their spatial distribution, which does not follow the spatial distribution of dark matter in the halo. The observed non-linearity is mostly due to the presence of the central galaxies, as was noted from previous theoretical work on the same topic. We also see that overall, more massive galaxies reveal a stronger scale dependence, and out to a larger radius. Our results show that a wealth of information about galaxy bias is hidden in halo occupation models. These models should therefore be used to determine the influence of galaxy bias in cosmological studies.

We present cosmological parameter constraints from a joint analysis of three cosmological probes: the tomographic cosmic shear signal in $\sim$450 deg$^2$ of data from the Kilo Degree Survey (KiDS), the galaxy-matter cross-correlation signal of galaxies from the Galaxies And Mass Assembly (GAMA) survey determined with KiDS weak lensing, and the angular correlation function of the same GAMA galaxies. We use fast power spectrum estimators that are based on simple integrals over the real-space correlation functions, and show that they are practically unbiased over relevant angular frequency ranges. We test our full pipeline on numerical simulations that are tailored to KiDS and retrieve the input cosmology. By fitting different combinations of power spectra, we demonstrate that the three probes are internally consistent. For all probes combined, we obtain $S_8\equiv \sigma_8 \sqrt{\Omega_{\rm m}/0.3}=0.800_{-0.027}^{+0.029}$, consistent with Planck and the fiducial KiDS-450 cosmic shear correlation function results. Marginalising over wide priors on the mean of the tomographic redshift distributions yields consistent results for $S_8$ with an increase of $28\%$ in the error. The combination of probes results in a $26\%$ reduction in uncertainties of $S_8$ over using the cosmic shear power spectra alone. The main gain from these additional probes comes through their constraining power on nuisance parameters, such as the galaxy intrinsic alignment amplitude or potential shifts in the redshift distributions, which are up to a factor of two better constrained compared to using cosmic shear alone, demonstrating the value of large-scale structure probe combination.

We study the statistics of peaks in a weak lensing reconstructed mass map of the first 450 square degrees of the Kilo Degree Survey. The map is computed with aperture masses directly applied to the shear field with an NFW-like compensated filter. We compare the peak statistics in the observations with that of simulations for various cosmologies to constrain the cosmological parameter $S_8 = \sigma_8 \sqrt{\Omega_{\rm m}/0.3}$, which probes the ($\Omega_{\rm m}, \sigma_8$) plane perpendicularly to its main degeneracy. We estimate $S_8=0.750\pm0.059$, using peaks in the signal-to-noise range $0 \leq {\rm S/N} \leq 4$, and accounting for various systematics, such as multiplicative shear bias, mean redshift bias, baryon feedback, intrinsic alignment, and shear-position coupling. These constraints are $\sim25\%$ tighter than the constraints from the high significance peaks alone ($3 \leq {\rm S/N} \leq 4$) which typically trace single-massive halos. This demonstrates the gain of information from low-S/N peaks. However we find that including ${\rm S/N} < 0$ peaks does not add further information. Our results are in good agreement with the tomographic shear two-point correlation function measurement in KiDS-450. Combining shear peaks with non-tomographic measurements of the shear two-point correlation functions yields a $\sim20\%$ improvement in the uncertainty on $S_8$ compared to the shear two-point correlation functions alone, highlighting the great potential of peaks as a cosmological probe.

In recent years, multiple studies have reported substantial populations of large, low-surface-brightness galaxies in local galaxy clusters. Various theories that aim to explain the presence of such ultra-diffuse galaxies (UDGs) have since been proposed. A key question that will help to differentiate between models is whether UDGs have counterparts in lower-mass host haloes, and what their abundance as a function of halo mass is. In this study we extend our previous study of UDGs in galaxy clusters to galaxy groups. We measure the abundance of UDGs in 325 spectroscopically-selected groups from the Galaxy And Mass Assembly (GAMA) survey. We make use of the overlapping imaging from the ESO Kilo-Degree Survey (KiDS), from which we can identify galaxies with mean surface brightnesses within their effective radii down to ~25.5 mag arcsec$^{-2}$ in the r-band. We are able to measure a significant overdensity of UDGs (with sizes r_eff > 1.5 kpc) in galaxy groups down to M200=10^12 Msun, a regime where approximately only 1 in 10 groups contains a UDG that we can detect. We combine measurements of the abundance of UDGs in haloes that cover three orders of magnitude in halo mass, finding that their numbers scale quite steeply with halo mass; N_UDG (R<R200) $\propto$ M200^(1.11+/-0.07). To better interpret this, we also measure the mass-richness relation for brighter galaxies down to $M^*_r$+2.5 in the same GAMA groups, and find a much shallower relation of N_Bright (R<R200) $\propto$ M200^(0.78+/-0.05). This shows that UDGs are relatively more abundant, compared to bright galaxies, in massive clusters than in groups. We discuss implications, but whether this difference is related to a higher destruction rate of UDGs in groups, or whether massive haloes have a positive effect on their formation, is not yet clear.

The Kilo-Degree Survey (KiDS) is an ongoing optical wide-field imaging survey with the OmegaCAM camera at the VLT Survey Telescope. It aims to image 1500 square degrees in four filters (ugri). The core science driver is mapping the large-scale matter distribution in the Universe, using weak lensing shear and photometric redshift measurements. Further science cases include galaxy evolution, Milky Way structure, detection of high-redshift clusters, and finding rare sources such as strong lenses and quasars. Here we present the third public data release (DR3) and several associated data products, adding further area, homogenized photometric calibration, photometric redshifts and weak lensing shear measurements to the first two releases. A dedicated pipeline embedded in the Astro-WISE information system is used for the production of the main release. Modifications with respect to earlier releases are described in detail. Photometric redshifts have been derived using both Bayesian template fitting, and machine-learning techniques. For the weak lensing measurements, optimized procedures based on the THELI data reduction and lensfit shear measurement packages are used. In DR3 stacked ugri images, weight maps, masks, and source lists for 292 new survey tiles (~300 sq.deg) are made available. The multi-band catalogue, including homogenized photometry and photometric redshifts, covers the combined DR1, DR2 and DR3 footprint of 440 survey tiles (447 sq.deg). Limiting magnitudes are typically 24.3, 25.1, 24.9, 23.8 (5 sigma in a 2 arcsec aperture) in ugri, respectively, and the typical r-band PSF size is less than 0.7 arcsec. The photometric homogenization scheme ensures accurate colors and an absolute calibration stable to ~2% for gri and ~3% in u. Separately released are a weak lensing shear catalogue and photometric redshifts based on two different machine-learning techniques.

We constrain the average halo ellipticity of ~2 600 galaxy groups from the Galaxy And Mass Assembly (GAMA) survey, using the weak gravitational lensing signal measured from the overlapping Kilo Degree Survey (KiDS). To do so, we quantify the azimuthal dependence of the stacked lensing signal around seven different proxies for the orientation of the dark matter distribution, as it is a priori unknown which one traces the orientation best. On small scales, the major axis of the brightest group/cluster member (BCG) provides the best proxy, leading to a clear detection of an anisotropic signal. In order to relate that to a halo ellipticity, we have to adopt a model density profile. We derive new expressions for the quadrupole moments of the shear field given an elliptical model surface mass density profile. Modeling the signal with an elliptical Navarro-Frenk-White (NFW) profile on scales < 250 kpc, which roughly corresponds to half the virial radius, and assuming that the BCG is perfectly aligned with the dark matter, we find an average halo ellipticity of e_h=0.38 +/- 0.12. This agrees well with results from cold-dark-matter-only simulations, which typically report values of e_h ~ 0.3. On larger scales, the lensing signal around the BCGs does not trace the dark matter distribution well, and the distribution of group satellites provides a better proxy for the halo's orientation instead, leading to a 3--4 sigma detection of a non-zero halo ellipticity at scales between 250 kpc and 750 kpc. Our results suggest that the distribution of stars enclosed within a certain radius forms a good proxy for the orientation of the dark matter within that radius, which has also been observed in hydrodynamical simulations.

We study the stellar-to-halo mass relation of central galaxies in the range 9.7<log_10(M_*/h^-2 M_sun)<11.7 and z<0.4, obtained from a combined analysis of the Kilo Degree Survey (KiDS) and the Galaxy And Mass Assembly (GAMA) survey. We use ~100 deg^2 of KiDS data to study the lensing signal around galaxies for which spectroscopic redshifts and stellar masses were determined by GAMA. We show that lensing alone results in poor constraints on the stellar-to-halo mass relation due to a degeneracy between the satellite fraction and the halo mass, which is lifted when we simultaneously fit the stellar mass function. At M_sun>5x10^10 h^-2 M_sun, the stellar mass increases with halo mass as ~M_h^0.25. The ratio of dark matter to stellar mass has a minimum at a halo mass of 8x10^11 h^-1 M_sun with a value of M_h/M_*=56_-10^+16 [h]. We also use the GAMA group catalogue to select centrals and satellites in groups with five or more members, which trace regions in space where the local matter density is higher than average, and determine for the first time the stellar-to-halo mass relation in these denser environments. We find no significant differences compared to the relation from the full sample, which suggests that the stellar-to-halo mass relation does not vary strongly with local density. Furthermore, we find that the stellar-to-halo mass relation of central galaxies can also be obtained by modelling the lensing signal and stellar mass function of satellite galaxies only, which shows that the assumptions to model the satellite contribution in the halo model do not significantly bias the stellar-to-halo mass relation. Finally, we show that the combination of weak lensing with the stellar mass function can be used to test the purity of group catalogues.

We investigate possible signatures of halo assembly bias for spectroscopically selected galaxy groups from the GAMA survey using weak lensing measurements from the spatially overlapping regions of the deeper, high-imaging-quality photometric KiDS survey. We use GAMA groups with an apparent richness larger than 4 to identify samples with comparable mean host halo masses but with a different radial distribution of satellite galaxies, which is a proxy for the formation time of the haloes. We measure the weak lensing signal for groups with a steeper than average and with a shallower than average satellite distribution and find no sign of halo assembly bias, with the bias ratio of $0.85^{+0.37}_{-0.25}$, which is consistent with the $\Lambda$CDM prediction. Our galaxy groups have typical masses of $10^{13} M_{\odot}/h$, naturally complementing previous studies of halo assembly bias on galaxy cluster scales.

We determine the accuracy of galaxy redshift distributions as estimated from photometric redshift probability distributions $p(z)$. Our method utilises measurements of the angular cross-correlation between photometric galaxies and an overlapping sample of galaxies with spectroscopic redshifts. We describe the redshift leakage from a galaxy photometric redshift bin $j$ into a spectroscopic redshift bin $i$ using the sum of the $p(z)$ for the galaxies residing in bin $j$. We can then predict the angular cross-correlation between photometric and spectroscopic galaxies due to intrinsic galaxy clustering when $i \neq j$ as a function of the measured angular cross-correlation when $i=j$. We also account for enhanced clustering arising from lensing magnification using a halo model. The comparison of this prediction with the measured signal provides a consistency check on the validity of using the summed $p(z)$ to determine galaxy redshift distributions in cosmological analyses, as advocated by the Canada-France-Hawaii Telescope Lensing Survey (CFHTLenS). We present an analysis of the photometric redshifts measured by CFHTLenS, which overlaps the Baryon Oscillation Spectroscopic Survey (BOSS). We also analyse the Red-sequence Cluster Lensing Survey (RCSLenS), which overlaps both BOSS and the WiggleZ Dark Energy Survey. We find that the summed $p(z)$ from both surveys are generally biased with respect to the true underlying distributions. If unaccounted for, this bias would lead to errors in cosmological parameter estimation from CFHTLenS by less than $\sim 4\%$. For photometric redshift bins which spatially overlap in 3-D with our spectroscopic sample, we determine redshift bias corrections which can be used in future cosmological analyses that rely on accurate galaxy redshift distributions.

Verlinde (2016) proposed that the observed excess gravity in galaxies and clusters is the consequence of Emergent Gravity (EG). In this theory the standard gravitational laws are modified on galactic and larger scales due to the displacement of dark energy by baryonic matter. EG gives an estimate of the excess gravity (described as an apparent dark matter density) in terms of the baryonic mass distribution and the Hubble parameter. In this work we present the first test of EG using weak gravitational lensing, within the regime of validity of the current model. Although there is no direct description of lensing and cosmology in EG yet, we can make a reasonable estimate of the expected lensing signal of low redshift galaxies by assuming a background LambdaCDM cosmology. We measure the (apparent) average surface mass density profiles of 33,613 isolated central galaxies, and compare them to those predicted by EG based on the galaxies' baryonic masses. To this end we employ the ~180 square degrees overlap of the Kilo-Degree Survey (KiDS) with the spectroscopic Galaxy And Mass Assembly (GAMA) survey. We find that the prediction from EG, despite requiring no free parameters, is in good agreement with the observed galaxy-galaxy lensing profiles in four different stellar mass bins. Although this performance is remarkable, this study is only a first step. Further advancements on both the theoretical framework and observational tests of EG are needed before it can be considered a fully developed and solidly tested theory.

We present cosmological parameter constraints from a tomographic weak gravitational lensing analysis of ~450deg$^2$ of imaging data from the Kilo Degree Survey (KiDS). For a flat $\Lambda$CDM cosmology with a prior on $H_0$ that encompasses the most recent direct measurements, we find $S_8\equiv\sigma_8\sqrt{\Omega_{\rm m}/0.3}=0.745\pm0.039$. This result is in good agreement with other low redshift probes of large scale structure, including recent cosmic shear results, along with pre-Planck cosmic microwave background constraints. A $2.3$-$\sigma$ tension in $S_8$ and `substantial discordance' in the full parameter space is found with respect to the Planck 2015 results. We use shear measurements for nearly 15 million galaxies, determined with a new improved `self-calibrating' version of $lens$fit validated using an extensive suite of image simulations. Four-band $ugri$ photometric redshifts are calibrated directly with deep spectroscopic surveys. The redshift calibration is confirmed using two independent techniques based on angular cross-correlations and the properties of the photometric redshift probability distributions. Our covariance matrix is determined using an analytical approach, verified numerically with large mock galaxy catalogues. We account for uncertainties in the modelling of intrinsic galaxy alignments and the impact of baryon feedback on the shape of the non-linear matter power spectrum, in addition to the small residual uncertainties in the shear and redshift calibration. The cosmology analysis was performed blind. Our high-level data products, including shear correlation functions, covariance matrices, redshift distributions, and Monte Carlo Markov Chains are available at http://kids.strw.leidenuniv.nl.

We present the Red-sequence Cluster Lensing Survey (RCSLenS), an application of the methods developed for the Canada France Hawaii Telescope Lensing Survey (CFHTLenS) to the ~785deg$^2$, multi-band imaging data of the Red-sequence Cluster Survey 2 (RCS2). This project represents the largest public, sub-arcsecond seeing, multi-band survey to date that is suited for weak gravitational lensing measurements. With a careful assessment of systematic errors in shape measurements and photometric redshifts we extend the use of this data set to allow cross-correlation analyses between weak lensing observables and other data sets. We describe the imaging data, the data reduction, masking, multi-colour photometry, photometric redshifts, shape measurements, tests for systematic errors, and a blinding scheme to allow for more objective measurements. In total we analyse 761 pointings with r-band coverage, which constitutes our lensing sample. Residual large-scale B-mode systematics prevent the use of this shear catalogue for cosmic shear science. The effective number density of lensing sources over an unmasked area of 571.7deg$^2$ and down to a magnitude limit of r~24.5 is 8.1 galaxies per arcmin$^2$ (weighted: 5.5 arcmin$^{-2}$) distributed over 14 patches on the sky. Photometric redshifts based on 4-band griz data are available for 513 pointings covering an unmasked area of 383.5 deg$^2$ We present weak lensing mass reconstructions of some example clusters as well as the full survey representing the largest areas that have been mapped in this way. All our data products are publicly available through CADC at http://www.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/en/community/rcslens/query.html in a format very similar to the CFHTLenS data release.

We measure the cross-correlation signature between the Planck CMB lensing map and the weak lensing observations from both the Red-sequence Cluster Lensing Survey (RCSLenS) and the Canada-France-Hawai Telescope Lensing Survey (CFHTLenS). In addition to a Fourier analysis, we include the first configuration-space detection, based on the estimators $\langle \kappa_{\rm CMB} \kappa_{\rm gal} \rangle$ and $\langle \kappa_{\rm CMB} \gamma_{t} \rangle$. Combining 747.2 deg$^2$ from both surveys, we find a detection significance that exceeds $4.2\sigma$ in both Fourier- and configuration-space analyses. Scaling the predictions by a free parameter $A$, we obtain $A^{\rm Planck}_{\rm CFHT}= 0.68\pm 0.31 $ and $A^{\rm Planck}_{\rm RCS}= 1.31\pm 0.33$. In preparation for the next generation of measurements similar to these, we quantify the impact of different analysis choices on these results. First, since none of these estimators probes the exact same dynamical range, we improve our detection by combining them. Second, we carry out a detailed investigation on the effect of apodization, zero-padding and mask multiplication, validated on a suite of high-resolution simulations, and find that the latter produces the largest systematic bias in the cosmological interpretation. Finally, we show that residual contamination from intrinsic alignment and the effect of photometric redshift error are both largely degenerate with the characteristic signal from massive neutrinos, however the signature of baryon feedback might be easier to distinguish. The three lensing datasets are now publicly available.

Galaxies and their dark matter haloes are part of a complex network of mass structures, collectively called the cosmic web. Using the tidal tensor prescription these structures can be classified into four cosmic environments: voids, sheets, filaments and knots. As the cosmic web may influence the formation and evolution of dark matter haloes and the galaxies they host, we aim to study the effect of these cosmic environments on the average mass of galactic haloes. To this end we measure the galaxy-galaxy lensing profile of 91,195 galaxies, within 0.039 < z < 0.263, from the spectroscopic Galaxy And Mass Assembly (GAMA) survey, using ~100 square degrees of overlapping data from the Kilo-Degree Survey (KiDS). In each of the four cosmic environments we model the contributions from group centrals, satellites and neighbouring groups to the stacked galaxy-galaxy lensing profiles. After correcting the lens samples for differences in the stellar mass distribution, we find no dependence of the average halo mass of central galaxies on their cosmic environment. We do find a significant increase in the average contribution of neighbouring groups to the lensing profile in increasingly dense cosmic environments. We show, however, that the observed effect can be entirely attributed to the galaxy density at much smaller scales (within 4 Mpc/h), which is correlated with the density of the cosmic environments. Within our current uncertainties we find no direct dependence of galaxy halo mass on their cosmic environment.

The unknown nature of dark energy motivates continued cosmological tests of large-scale gravitational physics. We present a new consistency check based on the relative amplitude of non-relativistic galaxy peculiar motions, measured via redshift-space distortion, and the relativistic deflection of light by those same galaxies traced by galaxy-galaxy lensing. We take advantage of the latest generation of deep, overlapping imaging and spectroscopic datasets, combining the Red Cluster Sequence Lensing Survey (RCSLenS), the Canada-France-Hawaii Telescope Lensing Survey (CFHTLenS), the WiggleZ Dark Energy Survey and the Baryon Oscillation Spectroscopic Survey (BOSS). We quantify the results using the "gravitational slip" statistic E_G, which we estimate as 0.48 +/- 0.10 at z=0.32 and 0.30 +/- 0.07 at z=0.57, the latter constituting the highest redshift at which this quantity has been determined. These measurements are consistent with the predictions of General Relativity, for a perturbed Friedmann-Robertson-Walker metric in a Universe dominated by a cosmological constant, which are E_G = 0.41 and 0.36 at these respective redshifts. The combination of redshift-space distortion and gravitational lensing data from current and future galaxy surveys will offer increasingly stringent tests of fundamental cosmology.

We present measurements of the galaxy bias $b$ and the galaxy-matter cross-correlation coefficient $r$ for the BOSS LOWZ luminous red galaxy sample. Using a new statistical weak lensing analysis of the Red Sequence Cluster Lensing Survey (RCSLenS) we find the bias properties of this sample to be higher than previously reported with $b=2.45^{+0.05}_{-0.05}$ and $r=1.64^{+0.17}_{-0.16}$ on scales between $3'$ and $20'$. We repeat the measurement for angular scales of $20'\leq \vartheta \leq70'$, which yields $b=2.39^{+0.07}_{-0.07}$ and $r=1.24^{+0.26}_{-0.25}$. This is the first application of a data compression analysis using a complete set of discrete estimators for galaxy-galaxy lensing and galaxy clustering. As cosmological data sets grow, our new method of data compression will become increasingly important in order to interpret joint weak lensing and galaxy clustering measurements and to estimate the data covariance. In future studies this formalism can be used as a tool to study the large-scale structure of the Universe to yield a precise determination of cosmological parameters.

In this paper we present results of applying the shear-ratio method to the RCSLenS data. The method takes the ratio of the mean of the weak lensing tangential shear signal about galaxy clusters, averaged over all clusters of the same redshift, in multiple background redshift bins. In taking a ratio the mass-dependency of the shear signal is cancelled-out leaving a statistic that is dependent on the geometric part of the lensing kernel only. We apply this method to 535 clusters and measure a cosmology-independent distance-redshift relation to redshifts z~1. In combination with Planck data the method lifts the degeneracies in the CMB measurements, resulting in cosmological parameter constraints of OmegaM=0.31 +/- 0.10 and w0 = -1.02 +/- 0.37, for a flat wCDM cosmology.

The Kilo-Degree Survey (KiDS) is a multi-band imaging survey designed for cosmological studies from weak lensing and photometric redshifts. It uses the ESO VLT Survey Telescope with its wide-field camera OmegaCAM. KiDS images are taken in four filters similar to the SDSS ugri bands. The best-seeing time is reserved for deep r-band observations that reach a median 5-sigma limiting AB magnitude of 24.9 with a median seeing that is better than 0.7arcsec. Initial KiDS observations have concentrated on the GAMA regions near the celestial equator, where extensive, highly complete redshift catalogues are available. A total of 109 survey tiles, one square degree each, form the basis of the first set of lensing analyses, which focus on measurements of halo properties of GAMA galaxies. 9 galaxies per square arcminute enter the lensing analysis, for an effective inverse shear variance of 69 per square arcminute. Accounting for the shape measurement weight, the median redshift of the sources is 0.53. KiDS data processing follows two parallel tracks, one optimized for galaxy shape measurement (for weak lensing), and one for accurate matched-aperture photometry in four bands (for photometric redshifts). This technical paper describes how the lensing and photometric redshift catalogues have been produced (including an extensive description of the Gaussian Aperture and Photometry pipeline), summarizes the data quality, and presents extensive tests for systematic errors that might affect the lensing analyses. We also provide first demonstrations of the suitability of the data for cosmological measurements, and explain how the shear catalogues were blinded to prevent confirmation bias in the scientific analyses. The KiDS shear and photometric redshift catalogues, presented in this paper, are released to the community through http://kids.strw.leidenuniv.nl .

We use the first 100 sq. deg. of overlap between the Kilo-Degree Survey (KiDS) and the Galaxy And Mass Assembly (GAMA) survey to determine the galaxy halo mass of ~10,000 spectroscopically-confirmed satellite galaxies in massive ($M > 10^{13}h^{-1}{\rm M}_\odot$) galaxy groups. Separating the sample as a function of projected distance to the group centre, we jointly model the satellites and their host groups with Navarro-Frenk-White (NFW) density profiles, fully accounting for the data covariance. The probed satellite galaxies in these groups have total masses $\log M_{\rm sub} /(h^{-1}{\rm M}_\odot) \approx 11.7 - 12.2$ consistent across group-centric distance within the errorbars. Given their typical stellar masses, $\log M_{\rm \star,sat}/(h^{-2}{\rm M}_\odot) \sim 10.5$, such total masses imply stellar mass fractions of $M_{\rm \star,sat} /M_{\rm sub} \approx 0.04 h^{-1}$ . The average subhalo hosting these satellite galaxies has a mass $M_{\rm sub} \sim 0.015M_{\rm host}$ independent of host halo mass, in broad agreement with the expectations of structure formation in a $\Lambda$CDM universe.

The Kilo-Degree Survey (KiDS) is an optical wide-field imaging survey carried out with the VLT Survey Telescope and the OmegaCAM camera. KiDS will image 1500 square degrees in four filters (ugri), and together with its near-infrared counterpart VIKING will produce deep photometry in nine bands. Designed for weak lensing shape and photometric redshift measurements, the core science driver of the survey is mapping the large-scale matter distribution in the Universe back to a redshift of ~0.5. Secondary science cases are manifold, covering topics such as galaxy evolution, Milky Way structure, and the detection of high-redshift clusters and quasars. KiDS is an ESO Public Survey and dedicated to serving the astronomical community with high-quality data products derived from the survey data, as well as with calibration data. Public data releases will be made on a yearly basis, the first two of which are presented here. For a total of 148 survey tiles (~160 sq.deg.) astrometrically and photometrically calibrated, coadded ugri images have been released, accompanied by weight maps, masks, source lists, and a multi-band source catalog. A dedicated pipeline and data management system based on the Astro-WISE software system, combined with newly developed masking and source classification software, is used for the data production of the data products described here. The achieved data quality and early science projects based on the data products in the first two data releases are reviewed in order to validate the survey data. Early scientific results include the detection of nine high-z QSOs, fifteen candidate strong gravitational lenses, high-quality photometric redshifts and galaxy structural parameters for hundreds of thousands of galaxies. (Abridged)

The Kilo-Degree Survey (KiDS) is an optical wide-field survey designed to map the matter distribution in the Universe using weak gravitational lensing. In this paper, we use these data to measure the density profiles and masses of a sample of $\sim \mathrm{1400}$ spectroscopically identified galaxy groups and clusters from the Galaxy And Mass Assembly (GAMA) survey. We detect a highly significant signal (signal-to-noise-ratio $\sim$ 120), allowing us to study the properties of dark matter haloes over one and a half order of magnitude in mass, from $M \sim 10^{13}-10^{14.5} h^{-1}\mathrm{M_{\odot}}$. We interpret the results for various subsamples of groups using a halo model framework which accounts for the mis-centring of the Brightest Cluster Galaxy (used as the tracer of the group centre) with respect to the centre of the group's dark matter halo. We find that the density profiles of the haloes are well described by an NFW profile with concentrations that agree with predictions from numerical simulations. In addition, we constrain scaling relations between the mass and a number of observable group properties. We find that the mass scales with the total r-band luminosity as a power-law with slope $1.16 \pm 0.13$ (1-sigma) and with the group velocity dispersion as a power-law with slope $1.89 \pm 0.27$ (1-sigma). Finally, we demonstrate the potential of weak lensing studies of groups to discriminate between models of baryonic feedback at group scales by comparing our results with the predictions from the Cosmo-OverWhelmingly Large Simulations (Cosmo-OWLS) project, ruling out models without AGN feedback.

We present first results from the third GRavitational lEnsing Accuracy Testing (GREAT3) challenge, the third in a sequence of challenges for testing methods of inferring weak gravitational lensing shear distortions from simulated galaxy images. GREAT3 was divided into experiments to test three specific questions, and included simulated space- and ground-based data with constant or cosmologically-varying shear fields. The simplest (control) experiment included parametric galaxies with a realistic distribution of signal-to-noise, size, and ellipticity, and a complex point spread function (PSF). The other experiments tested the additional impact of realistic galaxy morphology, multiple exposure imaging, and the uncertainty about a spatially-varying PSF; the last two questions will be explored in Paper II. The 24 participating teams competed to estimate lensing shears to within systematic error tolerances for upcoming Stage-IV dark energy surveys, making 1525 submissions overall. GREAT3 saw considerable variety and innovation in the types of methods applied. Several teams now meet or exceed the targets in many of the tests conducted (to within the statistical errors). We conclude that the presence of realistic galaxy morphology in simulations changes shear calibration biases by $\sim 1$ per cent for a wide range of methods. Other effects such as truncation biases due to finite galaxy postage stamps, and the impact of galaxy type as measured by the S\'{e}rsic index, are quantified for the first time. Our results generalize previous studies regarding sensitivities to galaxy size and signal-to-noise, and to PSF properties such as seeing and defocus. Almost all methods' results support the simple model in which additive shear biases depend linearly on PSF ellipticity.

We develop a method of stochastic differential equation to simulate electron acceleration at astrophysical shocks. Our method is based on It\^{o}'s stochastic differential equations coupled with a particle splitting, employing a skew Brownian motion where an asymmetric shock crossing probability is considered. Using this code, we perform simulations of electron acceleration at stationary plane parallel shock with various parameter sets, and studied how the cutoff shape, which is characterized by cutoff shape parameter $a$, changes with the momentum dependence of the diffusion coefficient $\beta$. In the age-limited cases, we reproduce previous results of other authors, $a\approx2\beta$. In the cooling-limited cases, the analytical expectation $a\approx\beta+1$ is roughly reproduced although we recognize deviations to some extent. In the case of escape-limited acceleration, numerical result fits analytical stationary solution well, but deviates from the previous asymptotic analytical formula $a\approx\beta$.

GALSIM is a collaborative, open-source project aimed at providing an image simulation tool of enduring benefit to the astronomical community. It provides a software library for generating images of astronomical objects such as stars and galaxies in a variety of ways, efficiently handling image transformations and operations such as convolution and rendering at high precision. We describe the GALSIM software and its capabilities, including necessary theoretical background. We demonstrate that the performance of GALSIM meets the stringent requirements of high precision image analysis applications such as weak gravitational lensing, for current datasets and for the Stage IV dark energy surveys of the Large Synoptic Survey Telescope, ESA's Euclid mission, and NASA's WFIRST-AFTA mission. The GALSIM project repository is public and includes the full code history, all open and closed issues, installation instructions, documentation, and wiki pages (including a Frequently Asked Questions section). The GALSIM repository can be found at https://github.com/GalSim-developers/GalSim .

The GRavitational lEnsing Accuracy Testing 3 (GREAT3) challenge is the third in a series of image analysis challenges, with a goal of testing and facilitating the development of methods for analyzing astronomical images that will be used to measure weak gravitational lensing. This measurement requires extremely precise estimation of very small galaxy shape distortions, in the presence of far larger intrinsic galaxy shapes and distortions due to the blurring kernel caused by the atmosphere, telescope optics, and instrumental effects. The GREAT3 challenge is posed to the astronomy, machine learning, and statistics communities, and includes tests of three specific effects that are of immediate relevance to upcoming weak lensing surveys, two of which have never been tested in a community challenge before. These effects include realistically complex galaxy models based on high-resolution imaging from space; spatially varying, physically-motivated blurring kernel; and combination of multiple different exposures. To facilitate entry by people new to the field, and for use as a diagnostic tool, the simulation software for the challenge is publicly available, though the exact parameters used for the challenge are blinded. Sample scripts to analyze the challenge data using existing methods will also be provided. See http://great3challenge.info and http://great3.projects.phys.ucl.ac.uk/leaderboard/ for more information.

Recent studies have shown that the cross-correlation coefficient between galaxies and dark matter is very close to unity on scales outside a few virial radii of galaxy halos, independent of the details of how galaxies populate dark matter halos. This finding makes it possible to determine the dark matter clustering from measurements of galaxy-galaxy weak lensing and galaxy clustering. We present new cosmological parameter constraints based on large-scale measurements of spectroscopic galaxy samples from the Sloan Digital Sky Survey (SDSS) Data Release 7 (DR7). We generalise the approach of Baldauf et al. (2010) to remove small scale information (below 2 and 4 Mpc/h for lensing and clustering measurements, respectively), where the cross-correlation coefficient differs from unity. We derive constraints for three galaxy samples covering 7131 sq. deg., containing 69150, 62150, and 35088 galaxies with mean redshifts of 0.11, 0.28, and 0.40. We clearly detect scale-dependent galaxy bias for the more luminous galaxy samples, at a level consistent with theoretical expectations. When we vary both \sigma_8 and \Omega_m (and marginalise over non-linear galaxy bias) in a flat LCDM model, the best-constrained quantity is \sigma_8 (\Omega_m/0.25)^{0.57}=0.80 +/- 0.05 (1-sigma, stat. + sys.), where statistical and systematic errors have comparable contributions, and we fixed n_s=0.96 and h=0.7. These strong constraints on the matter clustering suggest that this method is competitive with cosmic shear in current data, while having very complementary and in some ways less serious systematics. We therefore expect that this method will play a prominent role in future weak lensing surveys. When we combine these data with WMAP7 CMB data, constraints on \sigma_8, \Omega_m, H_0, w_{de} and \sum m_{\nu} become 30--80 per cent tighter than with CMB data alone, since our data break several parameter degeneracies.

In this paper, we measure the optical-to-virial velocity ratios Vopt/V200c of disk galaxies in the Sloan Digital Sky Survey (SDSS) at a mean redshift of <z> = 0.07 and with stellar masses 10^9 M_sun < M_* < 10^11 M_sun. Vopt/V200c, the ratio of the circular velocity measured at the virial radius of the dark matter halo (\sim150 kpc) to that at the optical radius of the disk (\sim10 kpc), is a powerful observational constraint on disk galaxy formation. It links galaxies to their dark matter haloes dynamically and constrains the total mass profile of disk galaxies over an order of magnitude in length scale. For this measurement, we combine Vopt derived from the Tully-Fisher relation (TFR) from Reyes et al. with V200c derived from halo masses measured with galaxy-galaxy lensing. In anticipation of this combination, we use similarly-selected galaxy samples for both the lensing and TFR analysis. For three M_* bins with lensing-weighted mean stellar masses of 0.6, 2.7, and 6.5 x 10^10 M_sun, we find halo-to-stellar mass ratios M_vir/M_* = 41, 23, and 26, with 1-sigma statistical uncertainties of around 0.1 dex, and Vopt/V200c = 1.27\pm0.08, 1.39\pm0.06, 1.27\pm0.08 (1{\sigma}). Our results suggest that the dark matter and baryonic contributions to the mass within the optical radius are comparable, if the dark matter halo profile has not been significantly modified by baryons. The results obtained in this work will serve as inputs to and constraints on disk galaxy formation models, which will be explored in future work. Finally, we note that this paper presents a new and improved galaxy shape catalogue for weak lensing that covers the full SDSS DR7 footprint.

The coherent physical alignment of galaxies is an important systematic for gravitational lensing studies as well as a probe of the physical mechanisms involved in galaxy formation and evolution. We develop a formalism for treating this intrinsic alignment (IA) in the context of galaxy-galaxy lensing and present an improved method for measuring IA contamination, which can arise when sources physically associated with the lens are placed behind the lens due to photometric redshift scatter. We apply the technique to recent Sloan Digital Sky Survey (SDSS) measurements of Luminous Red Galaxy lenses and typical (L*) source galaxies with photometric redshifts selected from the SDSS imaging data. Compared to previous measurements, this method has the advantage of being fully self-consistent in its treatment of the IA and lensing signals, solving for the two simultaneously. We find an IA signal consistent with zero, placing tight constraints on both the magnitude of the IA effect and its potential contamination to the lensing signal. While these constraints depend on source selection and redshift quality, the method can be applied to any measurement that uses photometric redshifts. We obtain a model-independent upper-limit of roughly 10% IA contamination for projected separations of approximately 0.1-100 Mpc/h. With more stringent photo-z cuts and reasonable assumptions about the physics of intrinsic alignments, this upper limit is reduced to 1-2%. These limits are well below the statistical error of the current lensing measurements. Our results suggest that IA will not present intractable challenges to the next generation of galaxy-galaxy lensing experiments, and the methods presented here should continue to aid in our understanding of alignment processes and in the removal of IA from the lensing signal.

Weak gravitational lensing is a valuable probe of galaxy formation and cosmology. Here we quantify the effects of using photometric redshifts (photo-z) in galaxy-galaxy lensing, for both sources and lenses, both for the immediate goal of using galaxies with photo-z as lenses in the Sloan Digital Sky Survey (SDSS) and as a demonstration of methodology for large, upcoming weak lensing surveys that will by necessity be dominated by lens samples with photo-z. We calculate the bias in the lensing mass calibration as well as consequences for absolute magnitude (i.e., k-corrections) and stellar mass estimates, for a large sample of SDSS Data Release 8 (DR8) galaxies. The redshifts are obtained with the template based photo-z code ZEBRA on the SDSS DR8 ugriz photometry. We assemble and characterise the calibration samples (~9k spectroscopic redshifts from four surveys) to obtain photometric redshift errors and lensing biases corresponding to our full SDSS DR8 lens and source catalogues. Our tests of the calibration sample also highlight the impact of observing conditions in the imaging survey when the spectroscopic calibration covers a small fraction of its footprint; atypical imaging conditions in calibration fields can lead to incorrect conclusions regarding the photo-z of the full survey. For the SDSS DR8 catalogue, we find sigma_z/(1+z)=0.096 and 0.113 for the lens and source catalogues, with flux limits of r=21 and r=21.8, respectively. We also explore the systematic uncertainty in the lensing signal calibration when using source photo-z, and both lens and source photo-z; given the size of existing training samples, we can constrain the lensing signal calibration (and therefore the normalization of the surface mass density) to within 2 and 4 per cent, respectively. [ABRIDGED]

Weak gravitational lensing is one of the key probes of the cosmological model, dark energy, and dark matter, providing insight into both the cosmic expansion history and large scale structure growth history. Taking into account a broad spectrum of physics affecting growth - dynamical dark energy, extended gravity, neutrino masses, and spatial curvature - we analyze the cosmological constraints. Similarly we consider the effects of a range of systematic uncertainties, in shear measurement, photometric redshifts, and the nonlinear power spectrum, on cosmological parameter extraction. We also investigate, and provide fitting formulas for, the influence of survey parameters such as redshift depth, galaxy number densities, and sky area. Finally, we examine the robustness of results for different fiducial cosmologies.

We report the first detection of asymmetry in a supernova (SN) photosphere based on SN light echo (LE) spectra of Cas A from the different perspectives of dust concentrations on its LE ellipsoid. New LEs are reported based on difference images, and optical spectra of these LEs are analyzed and compared. After properly accounting for the effects of finite dust-filament extent and inclination, we find one field where the He I and H alpha features are blueshifted by an additional ~4000 km/s relative to other spectra and to the spectra of the Type IIb SN 1993J. That same direction does not show any shift relative to other Cas A LE spectra in the Ca II near-infrared triplet feature. We compare the perspectives of the Cas A LE dust concentrations with recent three-dimensional modeling of the SN remnant (SNR) and note that the location having the blueshifted He I and H alpha features is roughly in the direction of an Fe-rich outflow and in the opposite direction of the motion of the compact object at the center of the SNR. We conclude that Cas A was an intrinsically asymmetric SN. Future LE spectroscopy of this object, and of other historical SNe, will provide additional insight into the connection of explosion mechanism to SN to SNR, as well as give crucial observational evidence regarding how stars explode.

We present a detailed strong lensing analysis of an HST/ACS legacy dataset for the first gravitational lens, Q0957+561. With deep imaging we identify 24 new strongly lensed features, which we use to constrain mass models. We model the stellar component of the lens galaxy using the observed luminosity distribution, and the dark matter halo using several different density profiles. We draw on the weak lensing analysis by Nakajima et al. (2009) to constrain the mass sheet and environmental terms in the lens potential. Adopting the well-measured time delay, we find H_0 = 85 (+14/-13) km/s/Mpc (68% CL) using lensing constraints alone. The principal uncertainties in H_0 are tied to the stellar mass-to-light ratio (a variant of the radial profile degeneracy in lens models). Adding constraints from stellar population synthesis models, we obtain H_0 = 79.3 (+6.7/-8.5) km/s/Mpc (68% CL). We infer that the lens galaxy has a rising rotation curve and a dark matter distribution with an inner core. Intriguingly, we find the quasar flux ratios predicted by our models to be inconsistent with existing radio measurements, suggesting the presence of substructure in the lens.

The GRavitational lEnsing Accuracy Testing 2008 (GREAT08) Challenge focuses on a problem that is of crucial importance for future observations in cosmology. The shapes of distant galaxies can be used to determine the properties of dark energy and the nature of gravity, because light from those galaxies is bent by gravity from the intervening dark matter. The observed galaxy images appear distorted, although only slightly, and their shapes must be precisely disentangled from the effects of pixelisation, convolution and noise. The worldwide gravitational lensing community has made significant progress in techniques to measure these distortions via the Shear TEsting Program (STEP). Via STEP, we have run challenges within our own community, and come to recognise that this particular image analysis problem is ideally matched to experts in statistical inference, inverse problems and computational learning. Thus, in order to continue the progress seen in recent years, we are seeking an infusion of new ideas from these communities. This document details the GREAT08 Challenge for potential participants. Please visit http://www.great08challenge.info for the latest information.

Attempts to constrain the Hubble constant using the strong gravitational lens system Q0957+561 are limited by systematic uncertainties in the mass model, since the time delay is known very precisely. One important systematic effect is the mass sheet degeneracy, which arises because strong lens modeling cannot constrain the presence or absence of a uniform mass sheet $\kappa$, which rescales $H_0$ by the factor $(1-\kappa)$. In this paper we present new constraints on the mass sheet derived from a weak-lensing analysis of the Hubble Space Telescope imaging of a 6 arcmin square region surrounding the lensed quasar. The average mass sheet within a circular aperture (the strong lens model region) is constrained by integrating the tangential weak gravitational shear over the surrounding area. We find the average convergence within a $30"$ radius around the lens galaxy to be $\kappa(<30") = 0.166\pm0.056$ ($1\sigma$ confidence level), normalized to the quasar redshift. This includes contributions from both the lens galaxy and the surrounding cluster. We also constrain a few other low-order terms in the lens potential by applying a multipole aperture mass formalism to the gravitational shear in an annulus around the strong lensing region. Implications for strong lens models and the Hubble constant are discussed in an accompanying paper.

In this paper we address the consumption of energy by astronomers while performing their professional duties. Although we find that astronomy uses a negligible fraction of the US energy budget, the rate at which energy is consumed by an average astronomer is similar to that of a typical high-flying businessperson. We review some of the ways in which astronomers are already acting to reduce their energy consumption. In the coming decades, all citizens will have to reduce their energy consumption to conserve fossil fuel reserves and to help avert a potentially catastrophic change in the Earth's climate. The challenges are the same for astronomers as they are for everyone: decreasing the distances we travel and investing in energy-efficient infrastructure. The high profile of astronomy in the media, and the great public interest in our field, can play a role in promoting energy-awareness to the wider population. Our specific recommendations are therefore to 1) reduce travel when possible, through efficient meeting organization, and by investing in high-bandwidth video conference facilities and virtual-world software, 2) create energy-efficient observatories, computing centers and workplaces, powered by sustainable energy resources, and 3) actively publicize these pursuits.

The gravitational lensing equations for convergence, potential, shear, and flexion are simple in polar coordinates and separate under a multipole expansion once the shear and flexion spinors are rotated into a ``tangential'' basis. We use this to investigate whether the useful monopole aperture-mass shear formulae generalize to all multipoles and to flexions. We re-derive the result of Schneider and Bartelmann that the shear multipole m at radius R is completely determined by the mass multipole at R, plus specific moments Q^m_in and Q^m_out of the mass multipoles internal and external, respectively, to R. The m>=0 multipoles are independent of Q_out. But in contrast to the monopole, the m<0 multipoles are independent of Q_in. These internal and external mass moments can be determined by shear (and/or flexion) data on the complementary portion of the plane, which has practical implications for lens modelling. We find that the ease of E/B separation in the monopole aperture moments does {\em not} generalize to m!=0: the internal monopole moment is the {\em only} non-local E/B discriminant available from lensing observations. We have also not found practical local E/B discriminants beyond the monopole, though they could exist. We show also that the use of weak-lensing data to constrain a constant shear term near a strong-lensing system is impractical without strong prior constraints on the neighboring mass distribution.

The Shear TEsting Programme (STEP) is a collaborative project to improve the accuracy and reliability of weak lensing measurement, in preparation for the next generation of wide-field surveys. We review sixteen current and emerging shear measurement methods in a common language, and assess their performance by running them (blindly) on simulated images that contain a known shear signal. We determine the common features of algorithms that most successfully recover the input parameters. We achieve previously unattained discriminatory precision in our analysis, via a combination of more extensive simulations, and pairs of galaxy images that have been rotated with respect to each other, thus removing noise from their intrinsic ellipticities. The robustness of our simulation approach is also confirmed by testing the relative calibration of methods on real data. Weak lensing measurement has improved since the first STEP paper. Several methods now consistently achieve better than 2% precision, and are still being developed. However, the simulations can now distinguish all methods from perfect performance. Our main concern continues to be the potential for a multiplicative shear calibration bias: not least because this can not be internally calibrated with real data. We determine which galaxy populations are responsible and, by adjusting the simulated observing conditions, we also investigate the effects of instrumental and atmospheric parameters. We have isolated several previously unrecognised aspects of galaxy shape measurement, in which focussed development could provide further progress towards the sub-percent level of precision desired for future surveys. [ABRIDGED]

We implement the Elliptical Gauss-Laguerre (EGL) galaxy-shape measurement method proposed by Bernstein & Jarvis (2002) and quantify the shear recovery accuracy in weak lensing analysis. This method uses a deconvolution fitting scheme to remove the effects of the point-spread function (PSF). The test simulates >10^7 noisy galaxy images convolved with anisotropic PSFs, and attempts to recover an input shear. The tests are designed to be immune to shape noise, selection biases, and crowding. The systematic error in shear recovery is divided into two classes, calibration (multiplicative) and additive, with the latter arising from PSF anisotropy. At S/N > 50, the deconvolution method measures the galaxy shape and input shear to ~ 1% multiplicative accuracy, and suppresses > 99% of the PSF anisotropy. These systematic errors increase to ~ 4% for the worst conditions, with poorly resolved galaxies at S/N ~ 20. The EGL weak lensing analysis has the best demonstrated accuracy to date, sufficient for the next generation of weak lensing surveys.

The Shear TEsting Programme, STEP, is a collaborative project to improve the accuracy and reliability of all weak lensing measurements in preparation for the next generation of wide-field surveys. In this first STEP paper we present the results of a blind analysis of simulated ground-based observations of relatively simple galaxy morphologies. The most successful methods are shown to achieve percent level accuracy. From the cosmic shear pipelines that have been used to constrain cosmology, we find weak lensing shear measured to an accuracy that is within the statistical errors of current weak lensing analyses, with shear measurements accurate to better than 7%. The dominant source of measurement error is shown to arise from calibration uncertainties where the measured shear is over or under-estimated by a constant multiplicative factor. This is of concern as calibration errors cannot be detected through standard diagnostic tests. The measured calibration errors appear to result from stellar contamination, false object detection, the shear measurement method itself, selection bias and/or the use of biased weights. Additive systematics (false detections of shear) resulting from residual point-spread function anisotropy are, in most cases, reduced to below an equivalent shear of 0.001, an order of magnitude below cosmic shear distortions on the scales probed by current surveys. Our results provide a snapshot view of the accuracy of current ground-based weak lensing methods and a benchmark upon which we can improve. To this end we provide descriptions of each method tested and include details of the eight different implementations of the commonly used Kaiser, Squires and Broadhurst (1995) method (KSB+) to aid the improvement of future KSB+ analyses.

We measure cosmological parameters using the three-dimensional power spectrum P(k) from over 200,000 galaxies in the Sloan Digital Sky Survey (SDSS) in combination with WMAP and other data. Our results are consistent with a ``vanilla'' flat adiabatic Lambda-CDM model without tilt (n=1), running tilt, tensor modes or massive neutrinos. Adding SDSS information more than halves the WMAP-only error bars on some parameters, tightening 1 sigma constraints on the Hubble parameter from h~0.74+0.18-0.07 to h~0.70+0.04-0.03, on the matter density from Omega_m~0.25+/-0.10 to Omega_m~0.30+/-0.04 (1 sigma) and on neutrino masses from <11 eV to <0.6 eV (95%). SDSS helps even more when dropping prior assumptions about curvature, neutrinos, tensor modes and the equation of state. Our results are in substantial agreement with the joint analysis of WMAP and the 2dF Galaxy Redshift Survey, which is an impressive consistency check with independent redshift survey data and analysis techniques. In this paper, we place particular emphasis on clarifying the physical origin of the constraints, i.e., what we do and do not know when using different data sets and prior assumptions. For instance, dropping the assumption that space is perfectly flat, the WMAP-only constraint on the measured age of the Universe tightens from t0~16.3+2.3-1.8 Gyr to t0~14.1+1.0-0.9 Gyr by adding SDSS and SN Ia data. Including tensors, running tilt, neutrino mass and equation of state in the list of free parameters, many constraints are still quite weak, but future cosmological measurements from SDSS and other sources should allow these to be substantially tightened.

We measure the large-scale real-space power spectrum P(k) using a sample of 205,443 galaxies from the Sloan Digital Sky Survey, covering 2417 square degrees with mean redshift z~0.1. We employ a matrix-based method using pseudo-Karhunen-Loeve eigenmodes, producing uncorrelated minimum-variance measurements in 22 k-bands of both the clustering power and its anisotropy due to redshift-space distortions, with narrow and well-behaved window functions in the range 0.02 h/Mpc < k < 0.3h/Mpc. We pay particular attention to modeling, quantifying and correcting for potential systematic errors, nonlinear redshift distortions and the artificial red-tilt caused by luminosity-dependent bias. Our final result is a measurement of the real-space matter power spectrum P(k) up to an unknown overall multiplicative bias factor. Our calculations suggest that this bias factor is independent of scale to better than a few percent for k<0.1h/Mpc, thereby making our results useful for precision measurements of cosmological parameters in conjunction with data from other experiments such as the WMAP satellite. As a simple characterization of the data, our measurements are well fit by a flat scale-invariant adiabatic cosmological model with h Omega_m =0.201+/- 0.017 and L* galaxy sigma_8=0.89 +/- 0.02 when fixing the baryon fraction Omega_b/Omega_m=0.17 and the Hubble parameter h=0.72; cosmological interpretation is given in a companion paper.