This paper studies the relative spatial distribution of red-sequence and blue-cloud galaxies, and their relation to the dark matter distribution in the COMBO-17 survey as function of scale down to z~1. We measure the 2nd-order auto- and cross-correlation functions of galaxy clustering and express the relative biasing by using aperture statistics. Also estimated is the relation between the galaxies and the dark matter distribution exploiting galaxy-galaxy lensing (GGL). All observables are further interpreted in terms of a halo model. To fully explain the galaxy clustering cross-correlation function with a halo model, we need to introduce a new parameter,R, that describes the statistical relation between numbers of red and blue galaxies within the same halo. We find that red and blue galaxies are clearly differently clustered, a significant evolution of the relative clustering with redshift was not found. There is evidence for a scale-dependence of relative biasing. The relative clustering, the GGL and, with some tension, the galaxy numbers can be explained consistently within a halo model. For the cross-correlation function one requires a HOD variance that becomes Poisson even for relatively small occupancy numbers. For our sample, this rules out with high confidence a "Poisson satellite" scenario as found in semi-analytical models. Red galaxies have to be concentrated towards the halo centre, either by a central red galaxy or by a concentration parameter above that for dark matter.The value of R depends on the presence or absence of central galaxies: If no central galaxies or only red central galaxies are allowed, R is consistent with zero, whereas a positive correlation $R=+0.5\pm0.2$ is needed if both blue and red galaxies can have central galaxies.[ABRIDGED]

We present a cosmic shear analysis of the 100 square degree weak lensing survey, combining data from the CFHTLS-Wide, RCS, VIRMOS-DESCART and GaBoDS surveys. Spanning ~100 square degrees, with a median source redshift z~0.78, this combined survey allows us to place tight joint constraints on the matter density parameter Omega_m, and the amplitude of the matter power spectrum sigma_8, finding sigma_8*(Omega_m/0.24)^0.59 = 0.84+/-0.05. Tables of the measured shear correlation function and the calculated covariance matrix for each survey are included. The accuracy of our results is a marked improvement on previous work owing to three important differences in our analysis; we correctly account for cosmic variance errors by including a non-Gaussian contribution estimated from numerical simulations; we correct the measured shear for a calibration bias as estimated from simulated data; we model the redshift distribution, n(z), of each survey from the largest deep photometric redshift catalogue currently available from the CFHTLS-Deep. This catalogue is randomly sampled to reproduce the magnitude distribution of each survey with the resulting survey dependent n(z) parametrised using two different models. While our results are consistent for the n(z) models tested, we find that our cosmological parameter constraints depend weakly (at the 5% level) on the inclusion or exclusion of galaxies with low confidence photometric redshift estimates (z>1.5). These high redshift galaxies are relatively few in number but contribute a significant weak lensing signal. It will therefore be important for future weak lensing surveys to obtain near-infra-red data to reliably determine the number of high redshift galaxies in cosmic shear analyses.

This is the first paper of a series describing our measurement of weak lensing by large-scale structure using archival observations from the Advanced Camera for Surveys (ACS) on board the Hubble Space Telescope (HST). In this work we present results from a pilot study testing the capabilities of the ACS for cosmic shear measurements with early parallel observations and presenting a re-analysis of HST/ACS data from the GEMS survey and the GOODS observations of the Chandra Deep Field South (CDFS). We describe our new correction scheme for the time-dependent ACS PSF based on observations of stellar fields. This is currently the only technique which takes the full time variation of the PSF between individual ACS exposures into account. We estimate that our PSF correction scheme reduces the systematic contribution to the shear correlation functions due to PSF distortions to < 2*10^{-6} for galaxy fields containing at least 10 stars. We perform a number of diagnostic tests indicating that the remaining level of systematics is consistent with zero for the GEMS and GOODS data confirming the success of our PSF correction scheme. For the parallel data we detect a low level of remaining systematics which we interpret to be caused by a lack of sufficient dithering of the data. Combining the shear estimate of the GEMS and GOODS observations using 96 galaxies arcmin^{-2} with the photometric redshift catalogue of the GOODS-MUSIC sample, we determine a local single field estimate for the mass power spectrum normalisation sigma_{8,CDFS}=0.52^{+0.11}_{-0.15} (stat) +/- 0.07 (sys) (68% confidence assuming Gaussian cosmic variance) at fixed Omega_m=0.3 for a LambdaCDM cosmology. We interpret this exceptionally low estimate to be due to a local under-density of the foreground structures in the CDFS.

[ABRIDGED] The weak gravitational lensing effect is used to infer matter density fluctuations within the field-of-view of the Garching-Bonn Deep Survey (GaBoDS). This information is employed for a statistical comparison of the galaxy distribution to the total matter distribution. The result of this comparison is expressed by means of the linear bias factor, b, the ratio of density fluctuations, and the correlation factor $r$ between density fluctuations. The total galaxy sample is divided into three sub-samples using R-band magnitudes and the weak lensing analysis is applied separately for each sub-sample. Together with the photometric redshifts from the related COMBO-17 survey we estimate the typical mean redshifts of these samples with $\bar{z}=0.35, 0.47, 0.61$, respectively. For all three samples, a slight galaxy anti-bias, b~0.8+-0.1, on scales of a few Mpc/h is found; the bias factor shows evidence for a slight scale-dependence. The correlation between galaxy and (dark) matter distribution is high, r~0.6+-0.2, indicating a non-linear or/and stochastic biasing relation between matter and galaxies. Between the three samples no significant evolution with redshift is found.

The Shear TEsting Programme (STEP) is a collaborative project to improve the accuracy and reliability of weak lensing measurement, in preparation for the next generation of wide-field surveys. We review sixteen current and emerging shear measurement methods in a common language, and assess their performance by running them (blindly) on simulated images that contain a known shear signal. We determine the common features of algorithms that most successfully recover the input parameters. We achieve previously unattained discriminatory precision in our analysis, via a combination of more extensive simulations, and pairs of galaxy images that have been rotated with respect to each other, thus removing noise from their intrinsic ellipticities. The robustness of our simulation approach is also confirmed by testing the relative calibration of methods on real data. Weak lensing measurement has improved since the first STEP paper. Several methods now consistently achieve better than 2% precision, and are still being developed. However, the simulations can now distinguish all methods from perfect performance. Our main concern continues to be the potential for a multiplicative shear calibration bias: not least because this can not be internally calibrated with real data. We determine which galaxy populations are responsible and, by adjusting the simulated observing conditions, we also investigate the effects of instrumental and atmospheric parameters. We have isolated several previously unrecognised aspects of galaxy shape measurement, in which focussed development could provide further progress towards the sub-percent level of precision desired for future surveys. [ABRIDGED]

The aim of the present work is the construction of a mass-selected galaxy cluster sample based on weak gravitational lensing methods. This sample will be subject to spectroscopic follow-up observations. We apply the mass aperture statistics and a derivative of it to 19 square degrees of high quality, single colour wide field imaging data obtained with the WFI@MPG/ESO 2.2m telescope. For the statistics a family of filter functions is used that approximates the expected tangential radial shear profile and thus allows for the efficient detection of mass concentrations. We identify 158 possible mass concentrations. This is the first time that such a large and blindly selected sample is published. 72 of the detections are associated with concentrations of bright galaxies. For about 22 of those we found spectra in the literature, indicating or proving that the galaxies seen are indeed spatially concentrated. 15 of those were previously known to be clusters or have meanwhile been secured as such. We currently follow-up a larger number of them spectroscopically to obtain deeper insight into their physical properties. The remaining 55% of the possible mass concentrations found are not associated with any optical light, or could not be classified unambiguously. We show that those "dark" detections are to a significant degree due to noise, and appear preferentially in shallow data.

Aims. We present a cosmic shear analysis and data validation of 15 square degree high-quality R-band data of the Garching-Bonn Deep Survey obtained with the Wide Field Imager of the MPG/ESO 2.2m telescope. Methods. We measure the two-point shear correlation functions to calculate the aperture mass dispersion. Both statistics are used to perform the data quality control. Combining the cosmic shear signal with a photometric redshift distribution of a galaxy sub-sample obtained from two square degree of UBVRI-band observations of the Deep Public Survey we determine constraints for the matter density Omega_m, the mass power spectrum normalisation sigma_8 and the dark energy density Omega_Lambda in the magnitude interval R in [21.5,24.5]. In this magnitude interval the effective number density of source galaxies is n=12.5/sq. arcmin, and their mean redshift is z_m=0.78. To estimate the posterior likelihood we employ the Monte Carlo Markov Chain method. Results. Using the aperture mass dispersion we obtain for the mass power spectrum normalisation sigma_8=0.80 +- 0.10 (1 sigma statistical error) at a fixed matter density Omega_m=0.30 assuming a flat universe with negligible baryon content and marginalising over the Hubble parameter and the uncertainties in the fitted redshift distribution.

Aims. In this paper the optical data of the ESO Deep-Public-Survey observed with the Wide Field Imager and reduced with the THELI pipeline are described. Methods. Here we present 63 fully reduced and stacked images. The astrometric and photometric calibrations are discussed and the properties of the images are compared to images released by the ESO Imaging Survey team covering a subset of our data. Results. These images are publicly released to the community. Our main scientific goals with this survey are to study the high-redshift universe by optically pre-selecting high-redshift objects from imaging data and to use VLT instruments for follow-up spectroscopy as well as weak lensing applications.

The Shear TEsting Programme, STEP, is a collaborative project to improve the accuracy and reliability of all weak lensing measurements in preparation for the next generation of wide-field surveys. In this first STEP paper we present the results of a blind analysis of simulated ground-based observations of relatively simple galaxy morphologies. The most successful methods are shown to achieve percent level accuracy. From the cosmic shear pipelines that have been used to constrain cosmology, we find weak lensing shear measured to an accuracy that is within the statistical errors of current weak lensing analyses, with shear measurements accurate to better than 7%. The dominant source of measurement error is shown to arise from calibration uncertainties where the measured shear is over or under-estimated by a constant multiplicative factor. This is of concern as calibration errors cannot be detected through standard diagnostic tests. The measured calibration errors appear to result from stellar contamination, false object detection, the shear measurement method itself, selection bias and/or the use of biased weights. Additive systematics (false detections of shear) resulting from residual point-spread function anisotropy are, in most cases, reduced to below an equivalent shear of 0.001, an order of magnitude below cosmic shear distortions on the scales probed by current surveys. Our results provide a snapshot view of the accuracy of current ground-based weak lensing methods and a benchmark upon which we can improve. To this end we provide descriptions of each method tested and include details of the eight different implementations of the commonly used Kaiser, Squires and Broadhurst (1995) method (KSB+) to aid the improvement of future KSB+ analyses.

Application of the aperture mass (Map-) statistics provides a weak lensing method for the detection of cluster-sized dark matter halos. We present a new aperture filter function and maximise the effectiveness of the Map-statistics to detect cluster-sized halos using analytical models. We then use weak lensing mock catalogues generated from ray-tracing through N-body simulations, to analyse the effect of image treatment on the expected number density of halos. Using the Map-statistics, the aperture radius is typically several arcminutes, hence the aperture often lies partly outside a data field, consequently the signal-to-noise ratio of a halo detection decreases. We study these border effects analytically and by using mock catalogues. We find that the expected number density of halos decreases by a factor of two if the size of a field is comparable to the diameter of the aperture used. We finally report on the results of a weak lensing cluster search applying the Map-statistics to 50 randomly selected fields which were observed with FORS1 at the VLT. Altogether the 50 VLT fields cover an area of 0.64 square degrees. The I-band images were taken under excellent seeing conditions (average seeing 0.6 arcsec.) which results in a high number density of galaxies used for the weak lensing analysis (26/sq.arcmin). In five of the VLT fields, we detect a significant Map-signal which coincides with an overdensity of the light distribution. These detections are thus excellent candidates for shear-selected clusters.

We present first results of our search for high-redshift galaxies in deep CCD mosaic images. As a pilot study for a larger survey, very deep images of the Chandra Deep Field South (CDFS), taken withWFI@MPG/ESO2.2m, are used to select large samples of 1070 U-band and 565 B-band dropouts with the Lyman-break method. The data of these Lyman-break galaxies are made public as an electronic table. These objects are good candidates for galaxies at z~3 and z~4 which is supported by their photometric redshifts. The distributions of apparent magnitudes and the clustering properties of the two populations are analysed, and they show good agreement to earlier studies. We see no evolution in the comoving clustering scale length from z~3 to z~4. The techniques presented here will be applied to a much larger sample of U-dropouts from the whole survey in near future.

We present our image processing system for the reduction of optical imaging data from multi-chip cameras. In the framework of the Garching Bonn Deep Survey (GaBoDS; Schirmer et al. 2003) consisting of about 20 square degrees of high-quality data from WFI@MPG/ESO 2.2m, our group developed an imaging pipeline for the homogeneous and efficient processing of this large data set. Having weak gravitational lensing as the main science driver, our algorithms are optimised to produce deep co-added mosaics from individual exposures obtained from empty field observations. However, the modular design of our pipeline allows an easy adaption to different scientific applications. Our system has already been ported to a large variety of optical instruments and its products have been used in various scientific contexts. In this paper we give a thorough description of the algorithms used and a careful evaluation of the accuracies reached. This concerns the removal of the instrumental signature, the astrometric alignment, photometric calibration and the characterisation of final co-added mosaics. In addition we give a more general overview on the image reduction process and comment on observing strategies where they have significant influence on the data quality.