The Complete Calibration of the Colour-Redshift Relation survey (C3R2) is a spectroscopic effort involving ESO and Keck facilities designed to empirically calibrate the galaxy colour-redshift relation - P(z|C) to the Euclid depth (i_AB=24.5) and is intimately linked to upcoming Stage IV dark energy missions based on weak lensing cosmology. The aim is to build a spectroscopic calibration sample that is as representative as possible of the galaxies of the Euclid weak lensing sample. In order to minimise the number of spectroscopic observations to fill the gaps in current knowledge of the P(z|C), self-organising map (SOM) representations of the galaxy colour space have been constructed. Here we present the first results of an ESO@ VLT Large Programme approved in the context of C3R2, which makes use of the two VLT optical and near-infrared multi-object spectrographs, FORS2 and KMOS. This paper focuses on high-quality spectroscopic redshifts of high-z galaxies observed with the KMOS spectrograph in the H- and K-bands. A total of 424 highly-reliable z are measured in the 1.3<=z<=2.5 range, with total success rates of 60.7% in the H-band and 32.8% in the K-band. The newly determined z fill 55% of high and 35% of lower priority empty SOM grid cells. We measured Halpha fluxes in a 1."2 radius aperture from the spectra of the spectroscopically confirmed galaxies and converted them into star formation rates. In addition, we performed an SED fitting analysis on the same sample in order to derive stellar masses, E(B-V), total magnitudes, and SFRs. We combine the results obtained from the spectra with those derived via SED fitting, and we show that the spectroscopic failures come from either weakly star-forming galaxies (at z<1.7, i.e. in the H-band) or low S/N spectra (in the K-band) of z>2 galaxies.

Forthcoming space-based observations will require high-quality point-spread function (PSF) models for weak gravitational lensing measurements. One approach to generating these models is using a wavefront model based on the known telescope optics. We present an empirical framework for validating such models to confirm that they match the actual PSF to within requirements by comparing the models to the observed light distributions of isolated stars. We apply this framework to Tiny Tim, the standard tool for generating model PSFs for the Hubble Space Telescope (HST), testing its models against images taken by HST's Advanced Camera for Surveys in the Wide Field Channel. We show that Tiny Tim's models, in the default configuration, differ significantly from the observed PSFs, most notably in their sizes. We find that the quality of Tiny Tim PSFs can be improved through fitting the full set of Zernike polynomial coefficients which characterise the optics, to the point where the practical significance of the difference between model and observed PSFs is negligible for most use cases, resulting in additive and multiplicative biases both of order approximately 4e-4. We also show that most of this improvement can be retained through using an updated set of Zernike coefficients, which we provide.

We provide predictions of the yield of $7<z<9$ quasars from the Euclid wide survey, updating the calculation presented in the Euclid Red Book in several ways. We account for revisions to the Euclid near-infrared filter wavelengths; we adopt steeper rates of decline of the quasar luminosity function (QLF; $\Phi$) with redshift, $\Phi\propto10^{k(z-6)}$, $k=-0.72$, and a further steeper rate of decline, $k=-0.92$; we use better models of the contaminating populations (MLT dwarfs and compact early-type galaxies); and we use an improved Bayesian selection method, compared to the colour cuts used for the Red Book calculation, allowing the identification of fainter quasars, down to $J_{AB}\sim23$. Quasars at $z>8$ may be selected from Euclid $OYJH$ photometry alone, but selection over the redshift interval $7<z<8$ is greatly improved by the addition of $z$-band data from, e.g., Pan-STARRS and LSST. We calculate predicted quasar yields for the assumed values of the rate of decline of the QLF beyond $z=6$. For the case that the decline of the QLF accelerates beyond $z=6$, with $k=-0.92$, Euclid should nevertheless find over 100 quasars with $7.0<z<7.5$, and $\sim25$ quasars beyond the current record of $z=7.5$, including $\sim8$ beyond $z=8.0$. The first Euclid quasars at $z>7.5$ should be found in the DR1 data release, expected in 2024. It will be possible to determine the bright-end slope of the QLF, $7<z<8$, $M_{1450}<-25$, using 8m class telescopes to confirm candidates, but follow-up with JWST or E-ELT will be required to measure the faint-end slope. Contamination of the candidate lists is predicted to be modest even at $J_{AB}\sim23$. The precision with which $k$ can be determined over $7<z<8$ depends on the value of $k$, but assuming $k=-0.72$ it can be measured to a 1 sigma uncertainty of 0.07.

Our aim is to quantify the impact of systematic effects on the inference of cosmological parameters from cosmic shear. We present an end-to-end approach that introduces sources of bias in a modelled weak lensing survey on a galaxy-by-galaxy level. Residual biases are propagated through a pipeline from galaxy properties (one end) through to cosmic shear power spectra and cosmological parameter estimates (the other end), to quantify how imperfect knowledge of the pipeline changes the maximum likelihood values of dark energy parameters. We quantify the impact of an imperfect correction for charge transfer inefficiency (CTI) and modelling uncertainties of the point spread function (PSF) for Euclid, and find that the biases introduced can be corrected to acceptable levels.

The Euclid space telescope will measure the shapes and redshifts of galaxies to reconstruct the expansion history of the Universe and the growth of cosmic structures. Estimation of the expected performance of the experiment, in terms of predicted constraints on cosmological parameters, has so far relied on different methodologies and numerical implementations, developed for different observational probes and for their combination. In this paper we present validated forecasts, that combine both theoretical and observational expertise for different cosmological probes. This is presented to provide the community with reliable numerical codes and methods for Euclid cosmological forecasts. We describe in detail the methodology adopted for Fisher matrix forecasts, applied to galaxy clustering, weak lensing and their combination. We estimate the required accuracy for Euclid forecasts and outline a methodology for their development. We then compare and improve different numerical implementations, reaching uncertainties on the errors of cosmological parameters that are less than the required precision in all cases. Furthermore, we provide details on the validated implementations that can be used by the reader to validate their own codes if required. We present new cosmological forecasts for Euclid. We find that results depend on the specific cosmological model and remaining freedom in each setup, i.e. flat or non-flat spatial cosmologies, or different cuts at nonlinear scales. The validated numerical implementations can now be reliably used for any setup. We present results for an optimistic and a pessimistic choice of such settings. We demonstrate that the impact of cross-correlations is particularly relevant for models beyond a cosmological constant and may allow us to increase the dark energy Figure of Merit by at least a factor of three.

In modern weak-lensing surveys, the common approach to correct for residual systematic biases in the shear is to calibrate shape measurement algorithms using simulations. These simulations must fully capture the complexity of the observations to avoid introducing any additional bias. In this paper we study the importance of faint galaxies below the observational detection limit of a survey. We simulate simplified Euclid VIS images including and excluding this faint population, and measure the shift in the multiplicative shear bias between the two sets of simulations. We measure the shear with three different algorithms: a moment-based approach, model fitting, and machine learning. We find that for all methods, a spatially uniform random distribution of faint galaxies introduces a shear multiplicative bias of the order of a few times $10^{-3}$. This value increases to the order of $10^{-2}$ when including the clustering of the faint galaxies, as measured in the Hubble Space Telescope Ultra-Deep Field. The magnification of the faint background galaxies due to the brighter galaxies along the line of sight is found to have a negligible impact on the multiplicative bias. We conclude that the undetected galaxies must be included in the calibration simulations with proper clustering properties down to magnitude 28 in order to reach a residual uncertainty on the multiplicative shear bias calibration of a few times $10^{-4}$, in line with the $2\times10^{-3}$ total accuracy budget required by the scientific objectives of the Euclid survey. We propose two complementary methods for including faint galaxy clustering in the calibration simulations.

Forthcoming large-scale surveys will soon attempt to measure cosmic shear to an unprecedented level of accuracy, requiring a similarly high level of accuracy in the shear measurements of galaxies. Factors such as pixelisation, imperfect point-spread function (PSF) correction, and pixel noise can all directly or indirectly lead to biases in shear measurements, and so it can be necessary for shear measurement methods to be calibrated against internal, external, or simulated data to minimize bias. It is thus important to understand the nature of this calibration. In this paper, we show that a typical calibration procedure will on average leave no residual additive bias, but will leave a residual multiplicative bias. Additionally, the errors on the post-calibration bias parameters will be changed, and on average increased, from the errors on the pre-calibration measurements of these parameters, but that this is generally worth the benefit in decreasing the expected value of the multiplicative bias. We find that in most typical cases, it is worthwhile to apply a first-order bias correction, while a higher-order bias correction is only worthwhile for methods with intrinsically high multiplicative bias ($>10$ per cent) or when the simulation size is very small ($<10^6$ simulated galaxies).

Accurate shape measurements are essential to infer cosmological parameters from large area weak gravitational lensing studies. The compact diffraction-limited point-spread function (PSF) in space-based observations is greatly beneficial, but its chromaticity for a broad band observation can lead to new subtle effects that could hitherto be ignored: the PSF of a galaxy is no longer uniquely defined and spatial variations in the colours of galaxies result in biases in the inferred lensing signal. Taking Euclid as a reference, we show that this colourgradient bias (CG bias) can be quantified with high accuracy using available multi-colour Hubble Space Telescope (HST) data. In particular we study how noise in the HST observations might impact such measurements and find this to be negligible. We determine the CG bias using HST observations in the F606W and F814W filters and observe a correlation with the colour, in line with expectations, whereas the dependence with redshift is weak. The biases for individual galaxies are generally well below 1%, which may be reduced further using morphological information from the Euclid data. Our results demonstrate that CG bias should not be ignored, but it is possible to determine its amplitude with sufficient precision, so that it will not significantly bias the weak lensing measurements using Euclid data.

We present a derivation of a generalized optimally-weighted estimator for the weak lensing magnification signal, including a calculation of errors. With this estimator, we present a local method for optimally estimating the local effects of magnification from weak gravitational lensing, using a comparison of number counts in an arbitrary region of space to the expected unmagnified number counts. We show that when equivalent lens and source samples are used, this estimator is simply related to the optimally-weighted correlation function estimator used in past work and vice-versa, but this method has the benefits that it can calculate errors with significantly less computational time, that it can handle overlapping lens and source samples, and that it can easily be extended to mass-mapping. We present a proof-of-principle test of this method on data from the CFHTLenS, showing that its calculated magnification signals agree with predictions from model fits to shear data. Finally, we investigate how magnification data can be used to supplement shear data in determining the best-fit model mass profiles for galaxy dark matter haloes. We find that at redshifts greater than z ~ 0.6, the inclusion of magnification can often significantly improve the constraints on the components of the mass profile which relate to galaxies' local environments relative to shear alone, and in high-redshift, low- and medium-mass bins, it can have a higher signal-to-noise than the shear signal.

Galaxy-galaxy weak lensing is a direct probe of the mean matter distribution around galaxies. The depth and sky coverage of the CFHT Legacy Survey yield statistically significant galaxy halo mass measurements over a much wider range of stellar masses ($10^{8.75}$ to $10^{11.3} M_{\odot}$) and redshifts ($0.2 < z < 0.8$) than previous weak lensing studies. At redshift $z \sim 0.5$, the stellar-to-halo mass ratio (SHMR) reaches a maximum of $4.0\pm0.2$ percent as a function of halo mass at $\sim 10^{12.25} M_{\odot}$. We find, for the first time from weak lensing alone, evidence for significant evolution in the SHMR: the peak ratio falls as a function of cosmic time from $4.5 \pm 0.3$ percent at $z \sim 0.7$ to $3.4 \pm 0.2$ percent at $z \sim 0.3$, and shifts to lower stellar mass haloes. These evolutionary trends are dominated by red galaxies, and are consistent with a model in which the stellar mass above which star formation is quenched "downsizes" with cosmic time. In contrast, the SHMR of blue, star-forming galaxies is well-fit by a power law that does not evolve with time. This suggests that blue galaxies form stars at a rate that is balanced with their dark matter accretion in such a way that they evolve along the SHMR locus. The redshift dependence of the SHMR can be used to constrain the evolution of the galaxy population over cosmic time.

We use weak gravitational lensing to analyse the dark matter halos around satellite galaxies in galaxy groups in the CFHTLenS dataset. This dataset is derived from the CFHTLS-Wide survey, and encompasses 154 sq. deg of high-quality shape data. Using the photometric redshifts, we divide the sample of lens galaxies with stellar masses in the range 10^9 Msun to 10^10.5 Msun into those likely to lie in high-density environments (HDE) and those likely to lie in low-density environments (LDE). Through comparison with galaxy catalogues extracted from the Millennium Simulation, we show that the sample of HDE galaxies should primarily (~61%) consist of satellite galaxies in groups, while the sample of LDE galaxies should consist of mostly (~87%) non-satellite (field and central) galaxies. Comparing the lensing signals around samples of HDE and LDE galaxies matched in stellar mass, the lensing signal around HDE galaxies clearly shows a positive contribution from their host groups on their lensing signals at radii of ~500--1000 kpc, the typical separation between satellites and group centres. More importantly, the subhalos of HDE galaxies are less massive than those around LDE galaxies by a factor 0.65 +/- 0.12, significant at the 2.9 sigma level. A natural explanation is that the halos of satellite galaxies are stripped through tidal effects in the group environment. Our results are consistent with a typical tidal truncation radius of ~40 kpc.

We demonstrate the possibility of detecting tidal stripping of dark matter subhalos within galaxy groups using weak gravitational lensing. We have run ray-tracing simulations on galaxy catalogues from the Millennium Simulation to generate mock shape catalogues. The ray-tracing catalogues assume a halo model for galaxies and groups, using various models with different distributions of mass between galaxy and group halos to simulate different stages of group evolution. Using these mock catalogues, we forecast the lensing signals that will be detected around galaxy groups and satellite galaxies, as well as test two different methods for isolating the satellites' lensing signals. A key challenge is to determine the accuracy to which group centres can be identified. We show that with current and ongoing surveys, it will possible to detect stripping in groups of mass 10^12--10^15 Msun.

We present data products from the Canada-France-Hawaii Telescope Lensing Survey (CFHTLenS). CFHTLenS is based on the Wide component of the Canada-France-Hawaii Telescope Legacy Survey (CFHTLS). It encompasses 154 deg^2 of deep, optical, high-quality, sub-arcsecond imaging data in the five optical filters u^*g'r'i'z'. The article presents our data processing of the complete CFHTLenS data set. We were able to obtain a data set with very good image quality and high-quality astrometric and photometric calibration. Our external astrometric accuracy is between 60-70 mas with respect to SDSS data and the internal alignment in all filters is around 30 mas. Our average photometric calibration shows a dispersion on the order of 0.01 to 0.03 mag for g'r'i'z' and about 0.04 mag for u^* with respect to SDSS sources down to i <= 21. In the spirit of the CFHTLS all our data products are released to the astronomical community via the Canadian Astronomy Data Centre. We give a description and how-to manuals of the public products which include image pixel data, source catalogues with photometric redshift estimates and all relevant quantities to perform weak lensing studies.

We present a galaxy group-finding algorithm, the Photo-z Probability Peaks (P3) algorithm, optimized for locating small galaxy groups using photometric redshift data by searching for peaks in the signal-to-noise of the local overdensity of galaxies in a three-dimensional grid. This method is an improvement over similar two-dimensional matched-filter methods in reducing background contamination through the use of redshift information, allowing it to accurately detect groups at lower richness. We present the results of tests of our algorithm on galaxy catalogues from the Millennium Simulation. Using a minimum S/N of 3 for detected groups, a group aperture size of 0.25 Mpc/h, and assuming photometric redshift accuracy of sigma_z = 0.05 it attains a purity of 84% and detects ~295 groups/deg.^2 with an average group richness of 8.6 members. Assuming photometric redshift accuracy of sigma_z = 0.02, it attains a purity of 97% and detects ~143 groups/deg.^2 with an average group richness of 12.5 members. We also test our algorithm on data available for the COSMOS field and the presently-available fields from the CFHTLS-Wide survey, presenting preliminary results of this analysis.

Here we introduce PHAT, the PHoto-z Accuracy Testing programme, an international initiative to test and compare different methods of photo-z estimation. Two different test environments are set up, one (PHAT0) based on simulations to test the basic functionality of the different photo-z codes, and another one (PHAT1) based on data from the GOODS survey. The accuracy of the different methods is expressed and ranked by the global photo-z bias, scatter, and outlier rates. Most methods agree well on PHAT0 but produce photo-z scatters that can differ by up to a factor of two even in this idealised case. A larger spread in accuracy is found for PHAT1. Few methods benefit from the addition of mid-IR photometry. Remaining biases and systematic effects can be explained by shortcomings in the different template sets and the use of priors on the one hand and an insufficient training set on the other hand. Scatters of 4-8% in Delta_z/(1+z) were obtained, consistent with other studies. However, somewhat larger outlier rates (>7.5% with Delta_z/(1+z)>0.15; >4.5% after cleaning) are found for all codes. There is a general trend that empirical codes produce smaller biases than template-based codes. The systematic, quantitative comparison of different photo-z codes presented here is a snapshot of the current state-of-the-art of photo-z estimation and sets a standard for the assessment of photo-z accuracy in the future. The rather large outlier rates reported here for PHAT1 on real data should be investigated further since they are most probably also present (and possibly hidden) in many other studies. The test data sets are publicly available and can be used to compare new methods to established ones and help in guiding future photo-z method development. (abridged)