The Complete Calibration of the Colour-Redshift Relation survey (C3R2) is a spectroscopic effort involving ESO and Keck facilities designed to empirically calibrate the galaxy colour-redshift relation - P(z|C) to the Euclid depth (i_AB=24.5) and is intimately linked to upcoming Stage IV dark energy missions based on weak lensing cosmology. The aim is to build a spectroscopic calibration sample that is as representative as possible of the galaxies of the Euclid weak lensing sample. In order to minimise the number of spectroscopic observations to fill the gaps in current knowledge of the P(z|C), self-organising map (SOM) representations of the galaxy colour space have been constructed. Here we present the first results of an ESO@ VLT Large Programme approved in the context of C3R2, which makes use of the two VLT optical and near-infrared multi-object spectrographs, FORS2 and KMOS. This paper focuses on high-quality spectroscopic redshifts of high-z galaxies observed with the KMOS spectrograph in the H- and K-bands. A total of 424 highly-reliable z are measured in the 1.3<=z<=2.5 range, with total success rates of 60.7% in the H-band and 32.8% in the K-band. The newly determined z fill 55% of high and 35% of lower priority empty SOM grid cells. We measured Halpha fluxes in a 1."2 radius aperture from the spectra of the spectroscopically confirmed galaxies and converted them into star formation rates. In addition, we performed an SED fitting analysis on the same sample in order to derive stellar masses, E(B-V), total magnitudes, and SFRs. We combine the results obtained from the spectra with those derived via SED fitting, and we show that the spectroscopic failures come from either weakly star-forming galaxies (at z<1.7, i.e. in the H-band) or low S/N spectra (in the K-band) of z>2 galaxies.

We introduce the skew-spectrum statistic for weak lensing convergence $\kappa$ maps and test it against state-of-the-art high-resolution all-sky numerical simulations. We perform the analysis as a function of source redshift and smoothing angular scale for individual tomographic bins. We also analyse the cross-correlation between different tomographic bins. We compare the numerical results to fitting-functions used to model the bispectrum of the underlying density field as a function of redshift and scale. We derive a closed form expression for the skew-spectrum for gravity-induced secondary non-Gaussianity. We also compute the skew-spectrum for the projected $\kappa$ inferred from Cosmic Microwave Background (CMB) studies. As opposed to the low redshift case we find the post-Born corrections to be important in the modelling of the skew-spectrum for such studies. We show how the presence of a mask and noise can be incorporated in the estimation of a skew-spectrum.

The significant increase in precision that will be achieved by Stage IV cosmic shear surveys means that several currently used theoretical approximations may cease to be valid. An additional layer of complexity arises from the fact that many of these approximations are interdependent; the procedure to correct for one involves making another. Two such approximations that must be relaxed for upcoming experiments are the reduced shear approximation and the effect of neglecting magnification bias. Accomplishing this involves the calculation of the convergence bispectrum; typically subject to the Limber approximation. In this work, we compute the post-Limber convergence bispectrum, and the post-Limber reduced shear and magnification bias corrections to the angular power spectrum for a Euclid-like survey. We find that the Limber approximation significantly overestimates the bispectrum when any side of the bispectrum triangle, $\ell_i<60$. However, the resulting changes in the reduced shear and magnification bias corrections are well below the sample variance for $\ell\leq5000$. We also compute a worst-case scenario for the additional biases on $w_0w_a$CDM cosmological parameters that result from the difference between the post-Limber and Limber approximated forms of the corrections. These further demonstrate that the reduced shear and magnification bias corrections can safely be treated under the Limber approximation for upcoming surveys.

The data from the Euclid mission will enable the measurement of the photometric redshifts, angular positions, and weak lensing shapes for over a billion galaxies. This large dataset will allow for cosmological analyses using the angular clustering of galaxies and cosmic shear. The cross-correlation (XC) between these probes can tighten constraints and it is therefore important to quantify their impact for Euclid. In this study we carefully quantify the impact of XC not only on the final parameter constraints for different cosmological models, but also on the nuisance parameters. In particular, we aim at understanding the amount of additional information that XC can provide for parameters encoding systematic effects, such as galaxy bias or intrinsic alignments (IA). We follow the formalism presented in Euclid Collaboration: Blanchard et al. (2019) and make use of the codes validated therein. We show that XC improves the dark energy Figure of Merit (FoM) by a factor $\sim 5$, whilst it also reduces the uncertainties on galaxy bias by $\sim 17\%$ and the uncertainties on IA by a factor $\sim 4$. We observe that the role of XC on the final parameter constraints is qualitatively the same irrespective of the galaxy bias model used. We also show that XC can help in distinguishing between different IA models, and that if IA terms are neglected then this can lead to significant biases on the cosmological parameters. We find that the XC terms are necessary to extract the full information content from the data in future analyses. They help in better constraining the cosmological model, and lead to a better understanding of the systematic effects that contaminate these probes. Furthermore, we find that XC helps in constraining the mean of the photometric-redshift distributions, but it requires a more precise knowledge of this mean in order not to degrade the final FoM. [Abridged]

Context. Future weak lensing surveys, such as the Euclid mission, will attempt to measure the shapes of billions of galaxies in order to derive cosmological information. These surveys will attain very low levels of statistical error, and systematic errors must be extremely well controlled. In particular, the point spread function (PSF) must be estimated using stars in the field, and recovered with high accuracy. Aims. The aims of this paper are twofold. Firstly, we took steps toward a nonparametric method to address the issue of recovering the PSF field, namely that of finding the correct PSF at the position of any galaxy in the field, applicable to Euclid. Our approach relies solely on the data, as opposed to parametric methods that make use of our knowledge of the instrument. Secondly, we studied the impact of imperfect PSF models on the shape measurement of galaxies themselves, and whether common assumptions about this impact hold true in an Euclid scenario. Methods. We extended the recently proposed resolved components analysis approach, which performs super-resolution on a field of under-sampled observations of a spatially varying, image-valued function. We added a spatial interpolation component to the method, making it a true 2-dimensional PSF model. We compared our approach to PSFEx, then quantified the impact of PSF recovery errors on galaxy shape measurements through image simulations. Results. Our approach yields an improvement over PSFEx in terms of the PSF model and on observed galaxy shape errors, though it is at present far from reaching the required Euclid accuracy. We also find that the usual formalism used for the propagation of PSF model errors to weak lensing quantities no longer holds in the case of an Euclid-like PSF. In particular, different shape measurement approaches can react differently to the same PSF modeling errors.

We use a recently introduced statistic called {\em Integrated Bispectrum} (IB) to probe the gravity-induced non-Gaussianity at the level of the bispectrum from weak lensing convergence or $\kappa$ maps. We generalize the concept of the IB to spherical coordinates. This result is next connected to the response function approach. Finally, we use the Euclid Flagship simulations to compute the IB as a function of redshift and wave number. We also outline how the IB can be computed using a variety of analytical approaches including the ones based on Effective Field Theory (EFT), {\em Halo models} and models based on the {\em Separate Universe approach} in projection or two-dimension (2D). Comparing these results against simulations we find that the existing theoretical models tend to over-predict the numerical value of the IB. We emphasize the role of the finite volume effect in the numerical estimation of the IB. We introduced the concept of squeezed and collapsed tripsectrum for 2D $\kappa$ maps. We derive the IB for many parameterized theories of modified gravity including the Horndeskii and beyond-Horndeskii theories specifically for the non-degenerate scenarios that are also known as the Gleyzes-Langlois-Piazza-Venizzi or GPLV theories. In addition, the cosmological models with clustering quintessence and models involving massive neutrinos are also derived.

To date weak gravitational lensing surveys have typically been restricted to small fields of view, such that the $\textit{flat-sky approximation}$ has been sufficiently satisfied. However, with Stage IV surveys ($\textit{e.g. LSST}$ and $\textit{Euclid}$) imminent, extending mass-mapping techniques to the sphere is a fundamental necessity. As such, we extend the sparse hierarchical Bayesian mass-mapping formalism presented in previous work to the spherical sky. For the first time, this allows us to construct $\textit{maximum a posteriori}$ spherical weak lensing dark-matter mass-maps, with principled Bayesian uncertainties, without imposing or assuming Gaussianty. We solve the spherical mass-mapping inverse problem in the analysis setting adopting a sparsity promoting Laplace-type wavelet prior, though this theoretical framework supports all log-concave posteriors. Our spherical mass-mapping formalism facilitates principled statistical interpretation of reconstructions. We apply our framework to convergence reconstruction on high resolution N-body simulations with pseudo-Euclid masking, polluted with a variety of realistic noise levels, and show a dramatic increase in reconstruction fidelity compared to standard approaches. Furthermore we perform the largest joint reconstruction to date of all publically available shear observational datasets (combining DESY1, KiDS450 and CFHTLens) and find that our formalism recovers a convergence map with significantly enhanced small-scale detail. Within our Bayesian framework we validate, in a statistically rigourous manner, the community's intuition regarding the need to smooth spherical Kaiser-Squies estimates to provide physically meaningful convergence maps. Such approaches cannot reveal the small-scale physical structures that we recover within our framework.

Stage IV weak lensing experiments will offer more than an order of magnitude leap in precision. We must therefore ensure that our analyses remain accurate in this new era. Accordingly, previously ignored systematic effects must be addressed. In this work, we evaluate the impact of the reduced shear approximation and magnification bias, on the information obtained from the angular power spectrum. To first-order, the statistics of reduced shear, a combination of shear and convergence, are taken to be equal to those of shear. However, this approximation can induce a bias in the cosmological parameters that can no longer be neglected. A separate bias arises from the statistics of shear being altered by the preferential selection of galaxies and the dilution of their surface densities, in high-magnification regions. The corrections for these systematic effects take similar forms, allowing them to be treated together. We calculated the impact of neglecting these effects on the cosmological parameters that would be determined from Euclid, using cosmic shear tomography. To do so, we employed the Fisher matrix formalism, and included the impact of the super-sample covariance. We also demonstrate how the reduced shear correction can be calculated using a lognormal field forward modelling approach. These effects cause significant biases in Omega_m, sigma_8, n_s, Omega_DE, w_0, and w_a of -0.53 sigma, 0.43 sigma, -0.34 sigma, 1.36 sigma, -0.68 sigma, and 1.21 sigma, respectively. We then show that these lensing biases interact with another systematic: the intrinsic alignment of galaxies. Accordingly, we develop the formalism for an intrinsic alignment-enhanced lensing bias correction. Applying this to Euclid, we find that the additional terms introduced by this correction are sub-dominant.

Using a suite of hydrodynamical simulations with cold dark matter, baryons, and neutrinos, we present a detailed study of the effect of massive neutrinos on the 1-D and 3-D flux power spectra of the Lyman-$\alpha$ (Ly$\alpha$) forest. The presence of massive neutrinos in cosmology induces a scale- and time-dependent suppression of structure formation that is strongest on small scales. Measuring this suppression is a key method for inferring neutrino masses from cosmological data, and is one of the main goals of ongoing and future surveys like eBOSS, DES, LSST, Euclid or DESI. The clustering in the Ly$\alpha$ forest traces the quasi-linear power at late times and on small scales. In combination with observations of the cosmic microwave background, the forest therefore provides some of the tightest constraints on the sum of the neutrino masses. However there is a well-known degeneracy between $\Sigma m_{\nu}$ and the amplitude of perturbations in the linear matter power spectrum. We study the corresponding degeneracy in the 1-D flux power spectrum of the Ly$\alpha$ forest, and for the first time also study this degeneracy in the 3-D flux power spectrum. We show that the non-linear effects of massive neutrinos on the Ly$\alpha$ forest, beyond the effect of linear power amplitude suppression, are negligible, and this degeneracy persists in the Ly$\alpha$ forest observables to a high precision. We discuss the implications of this degeneracy for choosing parametrisations of the Ly$\alpha$ forest for cosmological analysis.

The Euclid mission will observe well over a billion galaxies out to $z\sim6$ and beyond. This will offer an unrivalled opportunity to investigate several key questions for understanding galaxy formation and evolution. The first step for many of these studies will be the selection of a sample of quiescent and star-forming galaxies, as is often done in the literature by using well known colour techniques such as the `UVJ' diagram. However, given the limited number of filters available for the Euclid telescope, the recovery of such rest-frame colours will be challenging. We therefore investigate the use of observed Euclid colours, on their own and together with ground-based u-band observations, for selecting quiescent and star-forming galaxies. The most efficient colour combination, among the ones tested in this work, consists of the (u-VIS) and (VIS-J) colours. We find that this combination allows users to select a sample of quiescent galaxies complete to above $\sim70\%$ and with less than 15$\%$ contamination at redshifts in the range $0.75<z<1$. For galaxies at high-z or without the u-band complementary observations, the (VIS-Y) and (J-H) colours represent a valid alternative, with $>65\%$ completeness level and contamination below 20$\%$ at $1<z<2$ for finding quiescent galaxies. In comparison, the sample of quiescent galaxies selected with the traditional UVJ technique is only $\sim20\%$ complete at $z<3$, when recovering the rest-frame colours using mock Euclid observations. This shows that our new methodology is the most suitable one when only Euclid bands, along with u-band imaging, are available.

We study the alignments of satellite galaxies, and their anisotropic distribution, with respect to location and orientation of their host central galaxy in MassiveBlack-II and IllustrisTNG simulations. We find that: the shape of the satellite system in halos of mass ($> 10^{13}h^{-1}M_{\odot}$) is well aligned with the shape of the central galaxy at $z=0.06$ with the mean alignment between the major axes being $\sim \Delta \theta = 12^{\circ}$ when compared to a uniform random distribution; that satellite galaxies tend to be anisotropically distributed along the major axis of the central galaxy with a stronger alignment in halos of higher mass or luminosity; and that the satellite distribution is more anisotropic for central galaxies with lower star formation rate, which are spheroidal, and for red central galaxies.Radially we find that satellites tend to be distributed along the major axis of the shape of the stellar component of central galaxies at smaller scales and the dark matter component on larger scales. We find that the dependence of satellite anisotropy on central galaxy properties and the radial distance is similar in both the simulations with a larger amplitude in MassiveBlack-II. The orientation of satellite galaxies tends to point toward the location of the central galaxy at small scales and this correlation decreases with increasing distance, and the amplitude of satellite alignment is higher in high mass halos. However, the projected ellipticities do not exhibit a scale-dependent radial alignment, as has been seen in some observational measurements.

We present an approach for automatic extraction of measured values from the astrophysical literature, using the Hubble constant for our pilot study. Our rules-based model -- a classical technique in natural language processing -- has successfully extracted 298 measurements of the Hubble constant, with uncertainties, from the 208,541 available arXiv astrophysics papers. We have also created an artificial neural network classifier to identify papers in arXiv which report novel measurements. From the analysis of our results we find that reporting measurements with uncertainties and the correct units is critical information when distinguishing novel measurements in free text. Our results correctly highlight the current tension for measurements of the Hubble constant and recover the $3.5\sigma$ discrepancy -- demonstrating that the tool presented in this paper is useful for meta-studies of astrophysical measurements from a large number of publications.

We provide predictions of the yield of $7<z<9$ quasars from the Euclid wide survey, updating the calculation presented in the Euclid Red Book in several ways. We account for revisions to the Euclid near-infrared filter wavelengths; we adopt steeper rates of decline of the quasar luminosity function (QLF; $\Phi$) with redshift, $\Phi\propto10^{k(z-6)}$, $k=-0.72$, and a further steeper rate of decline, $k=-0.92$; we use better models of the contaminating populations (MLT dwarfs and compact early-type galaxies); and we use an improved Bayesian selection method, compared to the colour cuts used for the Red Book calculation, allowing the identification of fainter quasars, down to $J_{AB}\sim23$. Quasars at $z>8$ may be selected from Euclid $OYJH$ photometry alone, but selection over the redshift interval $7<z<8$ is greatly improved by the addition of $z$-band data from, e.g., Pan-STARRS and LSST. We calculate predicted quasar yields for the assumed values of the rate of decline of the QLF beyond $z=6$. For the case that the decline of the QLF accelerates beyond $z=6$, with $k=-0.92$, Euclid should nevertheless find over 100 quasars with $7.0<z<7.5$, and $\sim25$ quasars beyond the current record of $z=7.5$, including $\sim8$ beyond $z=8.0$. The first Euclid quasars at $z>7.5$ should be found in the DR1 data release, expected in 2024. It will be possible to determine the bright-end slope of the QLF, $7<z<8$, $M_{1450}<-25$, using 8m class telescopes to confirm candidates, but follow-up with JWST or E-ELT will be required to measure the faint-end slope. Contamination of the candidate lists is predicted to be modest even at $J_{AB}\sim23$. The precision with which $k$ can be determined over $7<z<8$ depends on the value of $k$, but assuming $k=-0.72$ it can be measured to a 1 sigma uncertainty of 0.07.

Our aim is to quantify the impact of systematic effects on the inference of cosmological parameters from cosmic shear. We present an end-to-end approach that introduces sources of bias in a modelled weak lensing survey on a galaxy-by-galaxy level. Residual biases are propagated through a pipeline from galaxy properties (one end) through to cosmic shear power spectra and cosmological parameter estimates (the other end), to quantify how imperfect knowledge of the pipeline changes the maximum likelihood values of dark energy parameters. We quantify the impact of an imperfect correction for charge transfer inefficiency (CTI) and modelling uncertainties of the point spread function (PSF) for Euclid, and find that the biases introduced can be corrected to acceptable levels.

The Euclid space telescope will measure the shapes and redshifts of galaxies to reconstruct the expansion history of the Universe and the growth of cosmic structures. Estimation of the expected performance of the experiment, in terms of predicted constraints on cosmological parameters, has so far relied on different methodologies and numerical implementations, developed for different observational probes and for their combination. In this paper we present validated forecasts, that combine both theoretical and observational expertise for different cosmological probes. This is presented to provide the community with reliable numerical codes and methods for Euclid cosmological forecasts. We describe in detail the methodology adopted for Fisher matrix forecasts, applied to galaxy clustering, weak lensing and their combination. We estimate the required accuracy for Euclid forecasts and outline a methodology for their development. We then compare and improve different numerical implementations, reaching uncertainties on the errors of cosmological parameters that are less than the required precision in all cases. Furthermore, we provide details on the validated implementations that can be used by the reader to validate their own codes if required. We present new cosmological forecasts for Euclid. We find that results depend on the specific cosmological model and remaining freedom in each setup, i.e. flat or non-flat spatial cosmologies, or different cuts at nonlinear scales. The validated numerical implementations can now be reliably used for any setup. We present results for an optimistic and a pessimistic choice of such settings. We demonstrate that the impact of cross-correlations is particularly relevant for models beyond a cosmological constant and may allow us to increase the dark energy Figure of Merit by at least a factor of three.

Recent studies have demonstrated that {\em secondary} non-Gaussianity induced by gravity will be detected with a high signal-to-noise (S/N) by future and even by on-going weak lensing surveys. One way to characterise such non-Gaussianity is through the detection of a non-zero three-point correlation function of the lensing convergence field, or of its harmonic transform, the bispectrum. A recent study analysed the properties of the squeezed configuration of the bispectrum, when two wavenumbers are much larger than the third one. We extend this work by estimating the amplitude of the (reduced) bispectrum in four generic configurations, i.e., {\em squeezed, equilateral, isosceles} and {\em folded}, and for four different source redshifts $z_s=0.5,1.0,1.5,2.0$, by using an ensemble of all-sky high-resolution simulations. We compare these results against theoretical predictions. We find that, while the theoretical expectations based on widely used fitting functions can predict the general trends of the reduced bispectra, a more accurate theoretical modelling will be required to analyse the next generation of all-sky weak lensing surveys. The disagreement is particularly pronounced in the squeezed limit.

Dust lanes bisect the plane of a typical edge-on spiral galaxy as a dark optical absorption feature. Their appearance is linked to the gravitational stability of spiral disks; the fraction of edge-on galaxies that displays a dust lane is a direct indicator of the typical vertical balance between gravity and turbulence; a balance struck between the energy input from star-formation and the gravitational pull into the plane of the disk. Based on morphological classifications by the Galaxy~Zoo project on the Kilo-Degree Survey (KiDS) imaging data in the Galaxy and Mass Assembly (GAMA) fields, we explore the relation of dust lanes to the galaxy characteristics, most of which were determined using the {\sc magphys} spectral energy distribution fitting tool: stellar mass, total and specific star-formation rates, and several parameters describing the cold dust component. We find that the fraction of dust lanes does depend on the stellar mass of the galaxy; they start to appear at $M^* \sim 10^9 M_\odot$. A dust lane also implies strongly a dust mass of at least $10^5 M_\odot$, but otherwise does not correlate with cold dust mass parameters of the {\sc magphys} spectral energy distribution analysis, nor is there a link with star-formation rate, specific or total. Dust lane identification does not depend on disk ellipticity (disk thickness) or Sersic profile but correlates with bulge morphology; a round bulge favors dust lane votes. The central component along the line of sight that produces the dust lane is not associated with either one of the components fit by {\sc magphys}, the cold diffuse component or the localized, heated component in HII regions, but a mix of these two.

The act of projecting data sampled on the surface of the celestial sphere onto a regular grid on the plane can introduce error and a loss of information. This paper evaluates the effects of different planar projections on non-Gaussian statistics of weak lensing convergence maps. In particular we investigate the effect of projection on peak counts and Minkowski Functionals (MFs) derived from convergence maps and the suitability of a number of projections at matching the peak counts and MFs obtained from a sphere. We find that the peak counts derived from planar projections consistently overestimate the counts at low SNR thresholds and underestimate at high SNR thresholds across the projections evaluated, although the difference is reduced when smoothing of the maps is increased. In the case of the Minkowski Functionals, V0 is minimally affected by projection used, while projected V1 and V2 are consistently overestimated with respect to the spherical case.

Galaxy mergers and interactions are an integral part of our basic understanding of how galaxies grow and evolve over time. However, the effect that galaxy mergers have on star formation rates (SFR) is contested, with observations of galaxy mergers showing reduced, enhanced and highly enhanced star formation. We aim to determine the effect of galaxy mergers on the SFR of galaxies using statistically large samples of galaxies, totalling over 200\,000, over a large redshift range, 0.0 to 4.0. We train and use convolutional neural networks to create binary merger identifications (merger or non-merger) in the SDSS, KiDS and CANDELS imaging surveys. We then compare the galaxy main sequence subtracted SFR of the merging and non-merging galaxies to determine what effect, if any, a galaxy merger has on SFR. We find that the SFR of merging galaxies are not significantly different from the SFR of non-merging systems. The changes in the average SFR seen in the star forming population when a galaxy is merging are small, of the order of a factor of 1.2. However, the higher the SFR above the galaxy main sequence, the higher the fraction of galaxy mergers. Galaxy mergers have little effect on the SFR of the majority of merging galaxies compared to the non-merging galaxies. The typical change in SFR is less than 0.1~dex in either direction. Larger changes in SFR can be seen but are less common. The increase in merger fraction as the distance above the galaxy main sequence increases demonstrates that galaxy mergers can induce starbursts.

(Abridged summary) Responding to ESA's Voyage 2050 call to define the long-term plan for the future space missions that will address the astrophysics science questions during the 2035-2050 cycle, we propose a dedicated, ultra-deep spectroscopic survey in the near infrared (NIR), that will target a mass-limited sample of galaxies during two of the most fundamental epochs of cosmic evolution: the formation of the first galaxies (at z>6; cosmic dawn), and at the peak of galaxy formation activity (between redshift z=1 and 3; cosmic noon). By way of NIR observations, it is possible to study the Lyman-alpha region in the former, and the optical rest-frame in the latter, allowing us to extract fundamental observables such as gas and stellar kinematics, chemical abundances, and ages, providing a unique legacy database covering these two crucial stages of cosmic evolution. A dedicated, space-based facility will overcome the challenges faced by ground-based telescopes, no matter how large the aperture, or the reduced field of view and low multiplex factor of the best space-based instrument in the near future, namely NIRSpec at the JWST. Our project (codename Chronos) aims to produce about 1 million high quality spectra, with a high S/N in the continuum, where information about the underlying stellar populations is encoded.

Density-estimation likelihood-free inference (DELFI) has recently been proposed as an efficient method for simulation-based cosmological parameter inference. Compared to the standard likelihood-based Markov Chain Monte Carlo (MCMC) approach, DELFI has several advantages: it is highly parallelizable, there is no need to assume a possibly incorrect functional form for the likelihood and complicated effects (e.g the mask and detector systematics) are easier to handle with forward models. In light of this, we present two DELFI pipelines to perform weak lensing parameter inference with lognormal realizations of the tomographic shear field -- using the C_l summary statistic. The first pipeline accounts for the non-Gaussianities of the shear field, intrinsic alignments and photometric-redshift error. We validate that it is accurate enough for Stage III experiments and estimate that O(1000) simulations are needed to perform inference on Stage IV data. By comparing the second DELFI pipeline, which makes no assumption about the functional form of the likelihood, with the standard MCMC approach, which assumes a Gaussian likelihood, we test the impact of the Gaussian likelihood approximation in the MCMC analysis. We find it has a negligible impact on Stage IV parameter constraints. Our pipeline is a step towards seamlessly propagating all data-processing, instrumental, theoretical and astrophysical systematics through to the final parameter constraints.

In this paper we derive a full expression for the propagation of multiplicative and additive shape measurement biases into the cosmic shear power spectrum. In doing so we identify several new terms that are associated with selection effects, as well as cross-correlation terms between the multiplicative and additive biases and the shear field. The computation of the resulting bias in the shear power spectrum scales as the fifth power of the maximum multipole considered. Consequently the calculation is unfeasible for large l-modes, and the only tractable way to assess the full impact of shape measurement biases on cosmic shear power spectrum is through forward modelling of the effects. To linear order in bias parameters the shear power spectrum is only affected by the mean of the multiplicative bias field over a survey and the cross correlation between the additive bias field and the shear field. If the mean multiplicative bias is zero then second order convolutive terms are expected to be orders of magnitude smaller.

We present a method to measure the growth of structure and the background geometry of the Universe -- with no a priori assumption about the underlying cosmological model. Using Canada-France-Hawaii Lensing Survey (CFHTLenS) shear data we simultaneously reconstruct the lensing amplitude, the linear intrinsic alignment amplitude, the redshift evolving matter power spectrum, P(k,z), and the co-moving distance, r(z). We find that lensing predominately constrains a single global power spectrum amplitude and several co-moving distance bins. Our approach can localise precise scales and redshifts where Lambda-Cold Dark Matter (LCDM) fails -- if any. We find that below z = 0.4, the measured co-moving distance r (z) is higher than that expected from the Planck LCDM cosmology by ~1.5 sigma, while at higher redshifts, our reconstruction is fully consistent. To validate our reconstruction, we compare LCDM parameter constraints from the standard cosmic shear likelihood analysis to those found by fitting to the non-parametric information and we find good agreement.

In this paper we address the problem of finding optimal cosmic shear tomographic bins. We generalise the definition of a cosmic shear tomographic bin to be a set of commonly labelled voxels in photometric colour space; rather than bins defined directly in redshift. We explore this approach by using a self-organising map to define the multi-dimensional colour space, and a we define a 'label space' of connected regions on the self-organising map using overlapping elliptical disks. This allows us to then find optimal labelling schemes by searching the label space. We use a metric that is the signal-to-noise ratio of a dark energy equation of state measurement, and in this case we find that for up to five tomographic bins the optimal colour-space labelling is an approximation of an equally-spaced binning in redshift; that is in all cases the best configuration. We also show that such a redefinition is more robust to photometric redshift outliers than a standard tomographic bin selection.

Polarization of radiation is a powerful tool to study cosmic magnetism and analysis of polarization can be used as a diagnostic tool for large-scale structures. In this paper, we present a solid theoretical foundation for using polarized light to investigate large-scale magnetic field structures: the cosmological polarized radiative transfer (CPRT) formulation. The CPRT formulation is fully covariant. It accounts for cosmological and relativistic effects in a self-consistent manner and explicitly treats Faraday rotation, as well as Faraday conversion, emission, and absorption processes. The formulation is derived from the first principles of conservation of phase-space volume and photon number. Without loss of generality, we consider a flat Friedmann-Robertson-Walker (FRW) space-time metric and construct the corresponding polarized radiative transfer equations. We propose an all-sky CPRT calculation algorithm, based on a ray-tracing method, which allows cosmological simulation results to be incorporated and, thereby, model templates of polarization maps to be constructed. Such maps will be crucial in our interpretation of polarized data, such as those to be collected by the Square Kilometer Array (SKA). We describe several tests which are used for verifying the code and demonstrate applications in the study of the polarization signatures in different distributions of electron number density and magnetic fields. We present a pencil-beam CPRT calculation and an all-sky calculation, using a simulated galaxy cluster or a model magnetized universe obtained from GCMHD+ simulations as the respective input structures. The implications on large-scale magnetic field studies are discussed; remarks on the standard methods using rotation measure are highlighted.

Weak lensing convergence maps - upon which higher order statistics can be calculated - can be recovered from observations of the shear field by solving the lensing inverse problem. For typical surveys this inverse problem is ill-posed (often seriously) leading to substantial uncertainty on the recovered convergence maps. In this paper we propose novel methods for quantifying the Bayesian uncertainty in the location of recovered features and the uncertainty in the cumulative peak statistic - the peak count as a function of signal to noise ratio (SNR). We adopt the sparse hierarchical Bayesian mass-mapping framework developed in previous work, which provides robust reconstructions and principled statistical interpretation of reconstructed convergence maps without the need to assume or impose Gaussianity. We demonstrate our uncertainty quantification techniques on both Bolshoi N-body (cluster scale) and Buzzard V-1.6 (large scale structure) N-body simulations. For the first time, this methodology allows one to recover approximate Bayesian upper and lower limits on the cumulative peak statistic at well defined confidence levels.

Until recently mass-mapping techniques for weak gravitational lensing convergence reconstruction have lacked a principled statistical framework upon which to quantify reconstruction uncertainties, without making strong assumptions of Gaussianity. In previous work we presented a sparse hierarchical Bayesian formalism for convergence reconstruction that addresses this shortcoming. Here, we draw on the concept of local credible intervals (cf. Bayesian error bars) as an extension of the uncertainty quantification techniques previously detailed. These uncertainty quantification techniques are benchmarked against those recovered via Px-MALA - a state of the art proximal Markov Chain Monte Carlo (MCMC) algorithm. We find that typically our recovered uncertainties are everywhere conservative, of similar magnitude and highly correlated (Pearson correlation coefficient $\geq 0.85$) with those recovered via Px-MALA. Moreover, we demonstrate an increase in computational efficiency of $\mathcal{O}(10^6)$ when using our sparse Bayesian approach over MCMC techniques. This computational saving is critical for the application of Bayesian uncertainty quantification to large-scale stage IV surveys such as LSST and Euclid.

A crucial aspect of mass-mapping, via weak lensing, is quantification of the uncertainty introduced during the reconstruction process. Properly accounting for these errors has been largely ignored to date. We present results from a new method that reconstructs maximum a posteriori (MAP) convergence maps by formulating an unconstrained Bayesian inference problem with Laplace-type $\ell_1$-norm sparsity-promoting priors, which we solve via convex optimization. Approaching mass-mapping in this manner allows us to exploit recent developments in probability concentration theory to infer theoretically conservative uncertainties for our MAP reconstructions, without relying on assumptions of Gaussianity. For the first time these methods allow us to perform hypothesis testing of structure, from which it is possible to distinguish between physical objects and artifacts of the reconstruction. Here we present this new formalism, demonstrate the method on illustrative examples, before applying the developed formalism to two observational datasets of the Abel-520 cluster. In our Bayesian framework it is found that neither Abel-520 dataset can conclusively determine the physicality of individual local massive substructure at significant confidence. However, in both cases the recovered MAP estimators are consistent with both sets of data.

Cosmic shear - the weak gravitational lensing effect generated by fluctuations of the gravitational tidal fields of the large-scale structure - is one of the most promising tools for current and future cosmological analyses. The spherical-Bessel decomposition of the cosmic shear field ("3D cosmic shear") is one way to maximise the amount of redshift information in a lensing analysis and therefore provides a powerful tool to investigate in particular the growth of cosmic structure that is crucial for dark energy studies. However, the computation of simulated 3D cosmic shear covariance matrices presents numerical difficulties, due to the required integrations over highly oscillatory functions. We present and compare two numerical methods and relative implementations to perform these integrations. We then show how to generate 3D Gaussian random fields on the sky in spherical coordinates, starting from the 3D cosmic shear covariances. To validate our field-generation procedure, we calculate the Minkowski functionals associated with our random fields, compare them with the known expectation values for the Gaussian case and demonstrate parameter inference from Minkowski functionals from a cosmic shear survey. This is a first step towards producing fully 3D Minkowski functionals for a lognormal field in 3D to extract Gaussian and non-Gaussian information from the cosmic shear field, as well as towards the use of Minkowski functionals as a probe of cosmology beyond the commonly used two-point statistics.

If left unchecked modeling uncertainties at small scales, due to poorly understood baryonic physics and non-linear structure formation, will significantly bias Stage IV cosmic shear two-point statistic parameter constraints. While it is perhaps possible to run N-body or hydrodynamical simulations to determine the impact of these effects this approach is computationally expensive; especially to test a large number of theories of gravity. Instead we propose directly removing sensitivity to small-scale structure from the lensing spectrum, creating a statistic that is robust to these uncertainties. We do this by taking a redshift-dependent l-cut after applying the Bernardeau-Nishimichi-Taruya (BNT) nulling scheme. This reorganizes the information in the lensing spectrum to make the relationship between the angular scale, l, and the structure scale, k, much clearer compared to standard cosmic shear power spectra -- for which no direct relationship exists. We quantify the effectiveness of this method at removing sensitivity to small scales and compute the predicted Fisher error on the dark energy equation of state, w0, for different k-cuts in the matter power spectrum.

We investigate the use of estimators of weak lensing power spectra based on a flat-sky implementation of the Pseudo-Cl (PCl) technique, where the masked shear field is transformed without regard for masked regions of sky. This masking mixes power, and E-convergence and B-modes. To study the accuracy of forward-modelling and full-sky power spectrum recovery we consider both large-area survey geometries, and small-scale masking due to stars and a checkerboard model for field-of-view gaps. The power spectrum for the large-area survey geometry is sparsely-sampled and highly oscillatory, which makes modelling problematic. Instead, we derive an overall calibration for large-area mask bias using simulated fields. The effects of small-area star masks can be accurately corrected for, while the checkerboard mask has oscillatory and spiky behaviour which leads to percent biases. Apodisation of the masked fields leads to increased biases and a loss of information. We find that we can construct an unbiased forward-model of the raw PCls, and recover the full-sky convergence power to within a few percent accuracy for both Gaussian and lognormal-distributed shear fields. Propagating this through to cosmological parameters using a Fisher-Matrix formalism, we find we can make unbiased estimates of parameters for surveys up to 1,200 deg$^2$ with 30 galaxies per arcmin$^2$, beyond which the percent biases become larger than the statistical accuracy. This implies a flat-sky PCl analysis is accurate for current surveys but a Euclid-like survey will require higher accuracy.

Upcoming photometric lensing surveys will considerably tighten constraints on the neutrino mass and the dark energy equation of state. Nevertheless it remains an open question of how to optimally extract the information and how well the matter power spectrum must be known to obtain unbiased cosmological parameter estimates. By performing a Principal Component Analysis (PCA), we quantify the sensitivity of 3D cosmic shear and tomography with different binning strategies to different regions of the lensing kernel and matter power spectrum, and hence the background geometry and growth of structure in the Universe. We find that a large number of equally spaced tomographic bins in redshift can extract nearly all the cosmological information without the additional computational expense of 3D cosmic shear. Meanwhile a large fraction of the information comes from small poorly understood scales in the matter power spectrum, that can lead to biases on measurements of cosmological parameters. In light of this, we define and compute a cosmology-independent measure of the bias due to imperfect knowledge of the power spectrum. For a Euclid-like survey, we find that the power spectrum must be known to an accuracy of less than 1% on scales with k = 7 h /Mpc This requirement is not absolute since the bias depends on the magnitude of modelling errors, where they occur in k-z space, and the correlation between them, all of which are specific to any particular model. We therefore compute the bias in several of the most likely modelling scenarios and introduce a general formalism and public code, RequiSim, to compute the expected bias from any non-linear model.

The Large Synoptic Survey Telescope (LSST) Dark Energy Science Collaboration (DESC) will use five cosmological probes: galaxy clusters, large scale structure, supernovae, strong lensing, and weak lensing. This Science Requirements Document (SRD) quantifies the expected dark energy constraining power of these probes individually and together, with conservative assumptions about analysis methodology and follow-up observational resources based on our current understanding and the expected evolution within the field in the coming years. We then define requirements on analysis pipelines that will enable us to achieve our goal of carrying out a dark energy analysis consistent with the Dark Energy Task Force definition of a Stage IV dark energy experiment. This is achieved through a forecasting process that incorporates the flowdown to detailed requirements on multiple sources of systematic uncertainty. Future versions of this document will include evolution in our software capabilities and analysis plans along with updates to the LSST survey strategy.

We introduce the Generalised Lensing and Shear Spectra GLaSS code which is available for download from https://github.com/astro-informatics/GLaSS It is a fast and flexible public code, written in Python, that computes generalized spherical cosmic shear spectra. The commonly used tomographic and spherical Bessel lensing spectra come as built-in run-mode options. GLaSS is integrated into the Cosmosis modular cosmological pipeline package. We outline several computational choices that accelerate the computation of cosmic shear power spectra. Using GLaSS, we test whether the assumption that using the lensing and projection kernels for a spatially-flat universe -- in a universe with a small amount of spatial curvature -- negligibly impacts the lensing spectrum. We refer to this assumption as The Spatially-Flat Universe Approximation, that has been implicitly assumed in all cosmic shear studies to date. We confirm that The Spatially-Flat Universe Approximation has a negligible impact on Stage IV cosmic shear experiments.

The number of observed dwarf galaxies, with dark matter mass $\lesssim 10^{11}$ M$_{\odot}$ in the Milky Way or the Andromeda galaxy does not agree with predictions from the successful $\Lambda$CDM paradigm. To alleviate this problem a suppression of dark matter clustering power on very small scales has been conjectured. However, the abundance of dark matter halos outside our immediate neighbourhood (the Local Group) seem to agree with the $\Lambda$CDM--expected abundance. Here we connect these problems to observations of weak lensing cosmic shear, pointing out that cosmic shear can make significant statements about the missing satellites problem in a statistical way. As an example and pedagogical application we use recent constraints on small-scales power suppression from measurements of the CFHTLenS data. We find that, on average, in a region of $\sim $Gpc$^3$ there is no significant small-scale power suppression. This implies that suppression of small-scale power is not a viable solution to the `missing satellites problem' or, alternatively, that on average in this volume there is no `missing satellites problem' for dark matter masses $\gtrsim 5 \times 10^9$ M$_{\odot}$. Further analysis of current and future weak lensing surveys will probe much smaller scales, $k > 10h$ Mpc$^{-1}$ corresponding roughly to masses $M < 10^9 M_{\odot}$.

We present cosmological parameter constraints from a joint analysis of three cosmological probes: the tomographic cosmic shear signal in $\sim$450 deg$^2$ of data from the Kilo Degree Survey (KiDS), the galaxy-matter cross-correlation signal of galaxies from the Galaxies And Mass Assembly (GAMA) survey determined with KiDS weak lensing, and the angular correlation function of the same GAMA galaxies. We use fast power spectrum estimators that are based on simple integrals over the real-space correlation functions, and show that they are practically unbiased over relevant angular frequency ranges. We test our full pipeline on numerical simulations that are tailored to KiDS and retrieve the input cosmology. By fitting different combinations of power spectra, we demonstrate that the three probes are internally consistent. For all probes combined, we obtain $S_8\equiv \sigma_8 \sqrt{\Omega_{\rm m}/0.3}=0.800_{-0.027}^{+0.029}$, consistent with Planck and the fiducial KiDS-450 cosmic shear correlation function results. Marginalising over wide priors on the mean of the tomographic redshift distributions yields consistent results for $S_8$ with an increase of $28\%$ in the error. The combination of probes results in a $26\%$ reduction in uncertainties of $S_8$ over using the cosmic shear power spectra alone. The main gain from these additional probes comes through their constraining power on nuisance parameters, such as the galaxy intrinsic alignment amplitude or potential shifts in the redshift distributions, which are up to a factor of two better constrained compared to using cosmic shear alone, demonstrating the value of large-scale structure probe combination.

Euclid and the Large Synoptic Survey Telescope (LSST) are poised to dramatically change the astronomy landscape early in the next decade. The combination of high cadence, deep, wide-field optical photometry from LSST with high resolution, wide-field optical photometry and near-infrared photometry and spectroscopy from Euclid will be powerful for addressing a wide range of astrophysical questions. We explore Euclid/LSST synergy, ignoring the political issues associated with data access to focus on the scientific, technical, and financial benefits of coordination. We focus primarily on dark energy cosmology, but also discuss galaxy evolution, transient objects, solar system science, and galaxy cluster studies. We concentrate on synergies that require coordination in cadence or survey overlap, or would benefit from pixel-level co-processing that is beyond the scope of what is currently planned, rather than scientific programs that could be accomplished only at the catalog level without coordination in data processing or survey strategies. We provide two quantitative examples of scientific synergies: the decrease in photo-z errors (benefitting many science cases) when high resolution Euclid data are used for LSST photo-z determination, and the resulting increase in weak lensing signal-to-noise ratio from smaller photo-z errors. We briefly discuss other areas of coordination, including high performance computing resources and calibration data. Finally, we address concerns about the loss of independence and potential cross-checks between the two missions and potential consequences of not collaborating.

In the last decade, astronomers have found a new type of supernova called `superluminous supernovae' (SLSNe) due to their high peak luminosity and long light-curves. These hydrogen-free explosions (SLSNe-I) can be seen to z~4 and therefore, offer the possibility of probing the distant Universe. We aim to investigate the possibility of detecting SLSNe-I using ESA's Euclid satellite, scheduled for launch in 2020. In particular, we study the Euclid Deep Survey (EDS) which will provide a unique combination of area, depth and cadence over the mission. We estimated the redshift distribution of Euclid SLSNe-I using the latest information on their rates and spectral energy distribution, as well as known Euclid instrument and survey parameters, including the cadence and depth of the EDS. We also applied a standardization method to the peak magnitudes to create a simulated Hubble diagram to explore possible cosmological constraints. We show that Euclid should detect approximately 140 high-quality SLSNe-I to z ~ 3.5 over the first five years of the mission (with an additional 70 if we lower our photometric classification criteria). This sample could revolutionize the study of SLSNe-I at z>1 and open up their use as probes of star-formation rates, galaxy populations, the interstellar and intergalactic medium. In addition, a sample of such SLSNe-I could improve constraints on a time-dependent dark energy equation-of-state, namely w(a), when combined with local SLSNe-I and the expected SN Ia sample from the Dark Energy Survey. We show that Euclid will observe hundreds of SLSNe-I for free. These luminous transients will be in the Euclid data-stream and we should prepare now to identify them as they offer a new probe of the high-redshift Universe for both astrophysics and cosmology.

We discuss the effects on the CMB, CIB, and thermal SZ effect due to the peculiar motion of an observer with respect to the CMB rest frame, which induces boosting effects. We investigate the scientific perspectives opened by future CMB space missions, focussing on the CORE proposal. The improvements in sensitivity offered by a mission like CORE, together with its high resolution over a wide frequency range, will provide a more accurate estimate of the CMB dipole. The extension of boosting effects to polarization and cross-correlations will enable a more robust determination of purely velocity-driven effects that are not degenerate with the intrinsic CMB dipole, allowing us to achieve a S/N ratio of 13; this improves on the Planck detection and essentially equals that of an ideal cosmic-variance-limited experiment up to a multipole l of 2000. Precise inter-frequency calibration will offer the opportunity to constrain or even detect CMB spectral distortions, particularly from the cosmological reionization, because of the frequency dependence of the dipole spectrum, without resorting to precise absolute calibration. The expected improvement with respect to COBE-FIRAS in the recovery of distortion parameters (in principle, a factor of several hundred for an ideal experiment with the CORE configuration) ranges from a factor of several up to about 50, depending on the quality of foreground removal and relative calibration. Even for 1% accuracy in both foreground removal and relative calibration at an angular scale of 1 deg, we find that dipole analyses for a mission like CORE will be able to improve the recovery of the CIB spectrum amplitude by a factor of 17 in comparison with current results based on FIRAS. In addition to the scientific potential of a mission like CORE for these analyses, synergies with other planned and ongoing projects are also discussed.

We present integral field spectroscopy of galaxy cluster Abell 3827, using ALMA and VLT/MUSE. It reveals an unusual configuration of strong gravitational lensing in the cluster core, with at least seven lensed images of a single background spiral galaxy. Lens modelling based on HST imaging had suggested that the dark matter associated with one of the cluster's central galaxies may be offset. The new spectroscopic data enable better subtraction of foreground light, and better identification of multiple background images. The inferred distribution of dark matter is consistent with being centered on the galaxies, as expected by LCDM. Each galaxy's dark matter also appears to be symmetric. Whilst we do not find an offset between mass and light (suggestive of self-interacting dark matter) as previously reported, the numerical simulations that have been performed to calibrate Abell 3827 indicate that offsets and asymmetry are still worth looking for in collisions with particular geometries. Meanwhile, ALMA proves exceptionally useful for strong lens image identifications.

We present an analysis of the main systematic effects that could impact the measurement of CMB polarization with the proposed CORE space mission. We employ timeline-to-map simulations to verify that the CORE instrumental set-up and scanning strategy allow us to measure sky polarization to a level of accuracy adequate to the mission science goals. We also show how the CORE observations can be processed to mitigate the level of contamination by potentially worrying systematics, including intensity-to-polarization leakage due to bandpass mismatch, asymmetric main beams, pointing errors and correlated noise. We use analysis techniques that are well validated on data from current missions such as Planck to demonstrate how the residual contamination of the measurements by these effects can be brought to a level low enough not to hamper the scientific capability of the mission, nor significantly increase the overall error budget. We also present a prototype of the CORE photometric calibration pipeline, based on that used for Planck, and discuss its robustness to systematics, showing how CORE can achieve its calibration requirements. While a fine-grained assessment of the impact of systematics requires a level of knowledge of the system that can only be achieved in a future study phase, the analysis presented here strongly suggests that the main areas of concern for the CORE mission can be addressed using existing knowledge, techniques and algorithms.

Lensing of the CMB is now a well-developed probe of large-scale clustering over a broad range of redshifts. By exploiting the non-Gaussian imprints of lensing in the polarization of the CMB, the CORE mission can produce a clean map of the lensing deflections over nearly the full-sky. The number of high-S/N modes in this map will exceed current CMB lensing maps by a factor of 40, and the measurement will be sample-variance limited on all scales where linear theory is valid. Here, we summarise this mission product and discuss the science that it will enable. For example, the summed mass of neutrinos will be determined to an accuracy of 17 meV combining CORE lensing and CMB two-point information with contemporaneous BAO measurements, three times smaller than the minimum total mass allowed by neutrino oscillations. In the search for B-mode polarization from primordial gravitational waves with CORE, lens-induced B-modes will dominate over instrument noise, limiting constraints on the gravitational wave power spectrum amplitude. With lensing reconstructed by CORE, one can "delens" the observed polarization internally, reducing the lensing B-mode power by 60%. This improves to 70% by combining lensing and CIB measurements from CORE, reducing the error on the gravitational wave amplitude by 2.5 compared to no delensing (in the null hypothesis). Lensing measurements from CORE will allow calibration of the halo masses of the 40000 galaxy clusters that it will find, with constraints dominated by the clean polarization-based estimators. CORE can accurately remove Galactic emission from CMB maps with its 19 frequency channels. We present initial findings that show that residual Galactic foreground contamination will not be a significant source of bias for lensing power spectrum measurements with CORE. [abridged]

We demonstrate that, for the baseline design of the CORE satellite mission, the polarized foregrounds can be controlled at the level required to allow the detection of the primordial cosmic microwave background (CMB) $B$-mode polarization with the desired accuracy at both reionization and recombination scales, for tensor-to-scalar ratio values of ${r\gtrsim 5\times 10^{-3}}$. We consider detailed sky simulations based on state-of-the-art CMB observations that consist of CMB polarization with $\tau=0.055$ and tensor-to-scalar values ranging from $r=10^{-2}$ to $10^{-3}$, Galactic synchrotron, and thermal dust polarization with variable spectral indices over the sky, polarized anomalous microwave emission, polarized infrared and radio sources, and gravitational lensing effects. Using both parametric and blind approaches, we perform full component separation and likelihood analysis of the simulations, allowing us to quantify both uncertainties and biases on the reconstructed primordial $B$-modes. Under the assumption of perfect control of lensing effects, CORE would measure an unbiased estimate of $r=\left(5 \pm 0.4\right)\times 10^{-3}$ after foreground cleaning. In the presence of both gravitational lensing effects and astrophysical foregrounds, the significance of the detection is lowered, with CORE achieving a $4\sigma$-measurement of $r=5\times 10^{-3}$ after foreground cleaning and $60$% delensing. For lower tensor-to-scalar ratios ($r=10^{-3}$) the overall uncertainty on $r$ is dominated by foreground residuals, not by the 40% residual of lensing cosmic variance. Moreover, the residual contribution of unprocessed polarized point-sources can be the dominant foreground contamination to primordial B-modes at this $r$ level, even on relatively large angular scales, $\ell \sim 50$. Finally, we report two sources of potential bias for the detection of the primordial $B$-modes.[abridged]

Future observations of cosmic microwave background (CMB) polarisation have the potential to answer some of the most fundamental questions of modern physics and cosmology. In this paper, we list the requirements for a future CMB polarisation survey addressing these scientific objectives, and discuss the design drivers of the CORE space mission proposed to ESA in answer to the "M5" call for a medium-sized mission. The rationale and options, and the methodologies used to assess the mission's performance, are of interest to other future CMB mission design studies. CORE is designed as a near-ultimate CMB polarisation mission which, for optimal complementarity with ground-based observations, will perform the observations that are known to be essential to CMB polarisation scienceand cannot be obtained by any other means than a dedicated space mission.

We describe a space-borne, multi-band, multi-beam polarimeter aiming at a precise and accurate measurement of the polarization of the Cosmic Microwave Background. The instrument is optimized to be compatible with the strict budget requirements of a medium-size space mission within the Cosmic Vision Programme of the European Space Agency. The instrument has no moving parts, and uses arrays of diffraction-limited Kinetic Inductance Detectors to cover the frequency range from 60 GHz to 600 GHz in 19 wide bands, in the focal plane of a 1.2 m aperture telescope cooled at 40 K, allowing for an accurate extraction of the CMB signal from polarized foreground emission. The projected CMB polarization survey sensitivity of this instrument, after foregrounds removal, is 1.7 {\mu}K$\cdot$arcmin. The design is robust enough to allow, if needed, a downscoped version of the instrument covering the 100 GHz to 600 GHz range with a 0.8 m aperture telescope cooled at 85 K, with a projected CMB polarization survey sensitivity of 3.2 {\mu}K$\cdot$arcmin.

We discuss the potential of a next generation space-borne Cosmic Microwave Background (CMB) experiment for studies of extragalactic sources. Our analysis has particular bearing on the definition of the future space project, CORE, that has been submitted in response to ESA's call for a Medium-size mission opportunity as the successor of the Planck satellite. Even though the effective telescope size will be somewhat smaller than that of Planck, CORE will have a considerably better angular resolution at its highest frequencies, since, in contrast with Planck, it will be diffraction limited at all frequencies. The improved resolution implies a considerable decrease of the source confusion, i.e. substantially fainter detection limits. In particular, CORE will detect thousands of strongly lensed high-z galaxies distributed over the full sky. The extreme brightness of these galaxies will make it possible to study them, via follow-up observations, in extraordinary detail. Also, the CORE resolution matches the typical sizes of high-z galaxy proto-clusters much better than the Planck resolution, resulting in a much higher detection efficiency; these objects will be caught in an evolutionary phase beyond the reach of surveys in other wavebands. Furthermore, CORE will provide unique information on the evolution of the star formation in virialized groups and clusters of galaxies up to the highest possible redshifts. Finally, thanks to its very high sensitivity, CORE will detect the polarized emission of thousands of radio sources and, for the first time, of dusty galaxies, at mm and sub-mm wavelengths, respectively.

In this paper we discuss the commonly-used limiting cases, or approximations, for two-point cosmic shear statistics. We discuss the most prominent assumptions in this statistic: the flat-sky (small angle limit), the Limber (Bessel-to-delta function limit) and the Hankel transform (large l-mode limit) approximations; that the vast majority of cosmic shear results to date have used simultaneously. We find that the combined effect of these approximations can suppress power by >1% on scales of l<40. A fully non-approximated cosmic shear study should use a spherical-sky, non-Limber-approximated power spectrum analysis; and a transform involving Wigner small-d matrices in place of the Hankel transform. These effects, unaccounted for, would constitute at least 11% of the total budget for systematic effects for a power spectrum analysis of a Euclid-like experiment; but they are unnecessary.

We forecast the scientific capabilities to improve our understanding of cosmic inflation of CORE, a proposed CMB space satellite submitted in response to the ESA fifth call for a medium-size mission opportunity. The CORE satellite will map the CMB anisotropies in temperature and polarization in 19 frequency channels spanning the range 60-600 GHz. CORE will have an aggregate noise sensitivity of $1.7 \mu$K$\cdot \,$arcmin and an angular resolution of 5' at 200 GHz. We explore the impact of telescope size and noise sensitivity on the inflation science return by making forecasts for several instrumental configurations. This study assumes that the lower and higher frequency channels suffice to remove foreground contaminations and complements other related studies of component separation and systematic effects, which will be reported in other papers of the series "Exploring Cosmic Origins with CORE." We forecast the capability to determine key inflationary parameters, to lower the detection limit for the tensor-to-scalar ratio down to the $10^{-3}$ level, to chart the landscape of single field slow-roll inflationary models, to constrain the epoch of reheating, thus connecting inflation to the standard radiation-matter dominated Big Bang era, to reconstruct the primordial power spectrum, to constrain the contribution from isocurvature perturbations to the $10^{-3}$ level, to improve constraints on the cosmic string tension to a level below the presumptive GUT scale, and to improve the current measurements of primordial non-Gaussianities down to the $f_{NL}^{\rm local} < 1$ level. For all the models explored, CORE alone will improve significantly on the present constraints on the physics of inflation. Its capabilities will be further enhanced by combining with complementary future cosmological observations.

We forecast the main cosmological parameter constraints achievable with the CORE space mission which is dedicated to mapping the polarisation of the Cosmic Microwave Background (CMB). CORE was recently submitted in response to ESA's fifth call for medium-sized mission proposals (M5). Here we report the results from our pre-submission study of the impact of various instrumental options, in particular the telescope size and sensitivity level, and review the great, transformative potential of the mission as proposed. Specifically, we assess the impact on a broad range of fundamental parameters of our Universe as a function of the expected CMB characteristics, with other papers in the series focusing on controlling astrophysical and instrumental residual systematics. In this paper, we assume that only a few central CORE frequency channels are usable for our purpose, all others being devoted to the cleaning of astrophysical contaminants. On the theoretical side, we assume LCDM as our general framework and quantify the improvement provided by CORE over the current constraints from the Planck 2015 release. We also study the joint sensitivity of CORE and of future Baryon Acoustic Oscillation and Large Scale Structure experiments like DESI and Euclid. Specific constraints on the physics of inflation are presented in another paper of the series. In addition to the six parameters of the base LCDM, which describe the matter content of a spatially flat universe with adiabatic and scalar primordial fluctuations from inflation, we derive the precision achievable on parameters like those describing curvature, neutrino physics, extra light relics, primordial helium abundance, dark matter annihilation, recombination physics, variation of fundamental constants, dark energy, modified gravity, reionization and cosmic birefringence. (ABRIDGED)

We examine the cosmological constraints that can be achieved with a galaxy cluster survey with the future CORE space mission. Using realistic simulations of the millimeter sky, produced with the latest version of the Planck Sky Model, we characterize the CORE cluster catalogues as a function of the main mission performance parameters. We pay particular attention to telescope size, key to improved angular resolution, and discuss the comparison and the complementarity of CORE with ambitious future ground-based CMB experiments that could be deployed in the next decade. A possible CORE mission concept with a 150 cm diameter primary mirror can detect of the order of 50,000 clusters through the thermal Sunyaev-Zeldovich effect (SZE). The total yield increases (decreases) by 25% when increasing (decreasing) the mirror diameter by 30 cm. The 150 cm telescope configuration will detect the most massive clusters ($>10^{14}\, M_\odot$) at redshift $z>1.5$ over the whole sky, although the exact number above this redshift is tied to the uncertain evolution of the cluster SZE flux-mass relation; assuming self-similar evolution, CORE will detect $\sim 500$ clusters at redshift $z>1.5$. This changes to 800 (200) when increasing (decreasing) the mirror size by 30 cm. CORE will be able to measure individual cluster halo masses through lensing of the cosmic microwave background anisotropies with a 1-$\sigma$ sensitivity of $4\times10^{14} M_\odot$, for a 120 cm aperture telescope, and $10^{14} M_\odot$ for a 180 cm one. [abridged]

Convergence maps of the integrated matter distribution are a key science result from weak gravitational lensing surveys. To date, recovering convergence maps has been performed using a planar approximation of the celestial sphere. However, with the increasing area of sky covered by dark energy experiments, such as Euclid, the Large Synoptic Survey Telescope (LSST), and the Wide Field Infrared Survey Telescope (WFIRST), this assumption will no longer be valid. We extend the Kaiser-Squires technique for recovering convergence fields, restricted previously to the plane, to the spherical setting. Through simulations we study the error introduced by planar approximations. Moreover, we examine how best to recover convergence maps in the planar setting, considering a variety of different projections and defining the local rotations that are required when projecting spin fields such as cosmic shear. For the sky coverages typical of future surveys, errors introduced by projection effects can be of order tens of percent, exceeding 50% in some cases. The stereographic projection, which is conformal and so preserves local angles, is the most effective planar projection. In any case, these errors can be avoided entirely by recovering convergence fields directly on the celestial sphere. We apply the spherical Kaiser-Squires mass-mapping method presented to the public Dark Energy Survey (DES) science verification data to recover convergence maps directly on the celestial sphere.

Measurements of the power spectrum from large-scale structure surveys have to date assumed an equal-time approximation, where the full cross-correlation power spectrum of the matter density field evaluated at different times (or distances) has been approximated either by the power spectrum at a fixed time, or in an improved fashion, by a geometric mean $P(k; r_1, r_2)=[P(k; r_1) P(k; r_2)]^{1/2}$. In this paper we investigate the expected impact of the geometric mean ansatz, and present an application in assessing the impact on weak gravitational lensing cosmological parameter inference, using a perturbative unequal-time correlator. As one might expect, we find that the impact of this assumption is greatest at large separations in redshift $\Delta z > 0.3$ where the change in the amplitude of the matter power spectrum can be as much as $10$ percent for $k > 5h$Mpc$^{-1}$. However, of more concern is that the corrections for small separations, where the clustering is not close to zero, may not be negligibly small. In particular, we find that for a Euclid- or LSST-like weak lensing experiment the assumption of equal-time correlators may result in biased predictions of the cosmic shear power spectrum, and that the impact is strongly dependent on the amplitude of the intrinsic alignment signal. To compute unequal-time correlations to sufficient accuracy will require advances in either perturbation theory to high $k$-modes, or extensive use of simulations.

Curvelets are efficient to represent highly anisotropic signal content, such as a local linear and curvilinear structure. First-generation curvelets on the sphere, however, suffered from blocking artefacts. We present a new second-generation curvelet transform, where scale-discretised curvelets are constructed directly on the sphere. Scale-discretised curvelets exhibit a parabolic scaling relation, are well-localised in both spatial and harmonic domains, support the exact analysis and synthesis of both scalar and spin signals, and are free of blocking artefacts. We present fast algorithms to compute the exact curvelet transform, reducing computational complexity from $\mathcal{O}(L^5)$ to $\mathcal{O}(L^3\log_{2}{L})$ for signals band-limited at $L$. The implementation of these algorithms is made publicly available. Finally, we present an illustrative application demonstrating the effectiveness of curvelets for representing directional curve-like features in natural spherical images.

Euclid-VIS is the large format visible imager for the ESA Euclid space mission in their Cosmic Vision program, scheduled for launch in 2020. Together with the near infrared imaging within the NISP instrument, it forms the basis of the weak lensing measurements of Euclid. VIS will image in a single r+i+z band from 550-900 nm over a field of view of ~0.5 deg2. By combining 4 exposures with a total of 2260 sec, VIS will reach to deeper than mAB=24.5 (10sigma) for sources with extent ~0.3 arcsec. The image sampling is 0.1 arcsec. VIS will provide deep imaging with a tightly controlled and stable point spread function (PSF) over a wide survey area of 15000 deg2 to measure the cosmic shear from nearly 1.5 billion galaxies to high levels of accuracy, from which the cosmological parameters will be measured. In addition, VIS will also provide a legacy dataset with an unprecedented combination of spatial resolution, depth and area covering most of the extra-Galactic sky. Here we will present the results of the study carried out by the Euclid Consortium during the period up to the Critical Design Review.

We present the Red-sequence Cluster Lensing Survey (RCSLenS), an application of the methods developed for the Canada France Hawaii Telescope Lensing Survey (CFHTLenS) to the ~785deg$^2$, multi-band imaging data of the Red-sequence Cluster Survey 2 (RCS2). This project represents the largest public, sub-arcsecond seeing, multi-band survey to date that is suited for weak gravitational lensing measurements. With a careful assessment of systematic errors in shape measurements and photometric redshifts we extend the use of this data set to allow cross-correlation analyses between weak lensing observables and other data sets. We describe the imaging data, the data reduction, masking, multi-colour photometry, photometric redshifts, shape measurements, tests for systematic errors, and a blinding scheme to allow for more objective measurements. In total we analyse 761 pointings with r-band coverage, which constitutes our lensing sample. Residual large-scale B-mode systematics prevent the use of this shear catalogue for cosmic shear science. The effective number density of lensing sources over an unmasked area of 571.7deg$^2$ and down to a magnitude limit of r~24.5 is 8.1 galaxies per arcmin$^2$ (weighted: 5.5 arcmin$^{-2}$) distributed over 14 patches on the sky. Photometric redshifts based on 4-band griz data are available for 513 pointings covering an unmasked area of 383.5 deg$^2$ We present weak lensing mass reconstructions of some example clusters as well as the full survey representing the largest areas that have been mapped in this way. All our data products are publicly available through CADC at http://www.cadc-ccda.hia-iha.nrc-cnrc.gc.ca/en/community/rcslens/query.html in a format very similar to the CFHTLenS data release.

Euclid is a European Space Agency medium class mission selected for launch in 2020 within the Cosmic Vision 2015 2025 program. The main goal of Euclid is to understand the origin of the accelerated expansion of the universe. Euclid will explore the expansion history of the universe and the evolution of cosmic structures by measuring shapes and redshifts of galaxies as well as the distribution of clusters of galaxies over a large fraction of the sky. Although the main driver for Euclid is the nature of dark energy, Euclid science covers a vast range of topics, from cosmology to galaxy evolution to planetary research. In this review we focus on cosmology and fundamental physics, with a strong emphasis on science beyond the current standard models. We discuss five broad topics: dark energy and modified gravity, dark matter, initial conditions, basic assumptions and questions of methodology in the data analysis. This review has been planned and carried out within Euclid's Theory Working Group and is meant to provide a guide to the scientific themes that will underlie the activity of the group during the preparation of the Euclid mission.

With the advent of large-scale weak lensing surveys there is a need to understand how realistic, scale-dependent systematics bias cosmic shear and dark energy measurements, and how they can be removed. Here we describe how spatial variations in the amplitude and orientation of realistic image distortions convolve with the measured shear field, mixing the even-parity convergence and odd-parity modes, and bias the shear power spectrum. Many of these biases can be removed by calibration to external data, the survey itself, or by modelling in simulations. The uncertainty in the calibration must be marginalised over and we calculate how this propagates into parameter estimation, degrading the dark energy Figure-of-Merit. We find that noise-like biases affect dark energy measurements the most, while spikes in the bias power have the least impact, reflecting their correlation with the effect of cosmological parameters. We argue that in order to remove systematic biases in cosmic shear surveys and maintain statistical power effort should be put into improving the accuracy of the bias calibration rather than minimising the size of the bias. In general, this appears to be a weaker condition for bias removal. We also investigate how to minimise the size of the calibration set for a fixed reduction in the Figure-of-Merit. These results can be used to model the effect of biases and calibration on a cosmic shear survey accurately, assess their impact on the measurement of modified gravity and dark energy models, and to optimise surveys and calibration requirements.

We measure the cross-correlation signature between the Planck CMB lensing map and the weak lensing observations from both the Red-sequence Cluster Lensing Survey (RCSLenS) and the Canada-France-Hawai Telescope Lensing Survey (CFHTLenS). In addition to a Fourier analysis, we include the first configuration-space detection, based on the estimators $\langle \kappa_{\rm CMB} \kappa_{\rm gal} \rangle$ and $\langle \kappa_{\rm CMB} \gamma_{t} \rangle$. Combining 747.2 deg$^2$ from both surveys, we find a detection significance that exceeds $4.2\sigma$ in both Fourier- and configuration-space analyses. Scaling the predictions by a free parameter $A$, we obtain $A^{\rm Planck}_{\rm CFHT}= 0.68\pm 0.31 $ and $A^{\rm Planck}_{\rm RCS}= 1.31\pm 0.33$. In preparation for the next generation of measurements similar to these, we quantify the impact of different analysis choices on these results. First, since none of these estimators probes the exact same dynamical range, we improve our detection by combining them. Second, we carry out a detailed investigation on the effect of apodization, zero-padding and mask multiplication, validated on a suite of high-resolution simulations, and find that the latter produces the largest systematic bias in the cosmological interpretation. Finally, we show that residual contamination from intrinsic alignment and the effect of photometric redshift error are both largely degenerate with the characteristic signal from massive neutrinos, however the signature of baryon feedback might be easier to distinguish. The three lensing datasets are now publicly available.

The covariance matrix of the matter power spectrum is a key element of the statistical analysis of galaxy clustering data. Independent realisations of observational measurements can be used to sample the covariance, nevertheless statistical sampling errors will propagate into the cosmological parameter inference potentially limiting the capabilities of the upcoming generation of galaxy surveys. The impact of these errors as function of the number of independent realisations has been previously evaluated for Gaussian distributed data. However, non-linearities in the late time clustering of matter cause departures from Gaussian statistics. Here, we address the impact of non-Gaussian errors on the sample covariance and precision matrix errors using a large ensemble of numerical N-body simulations. In the range of modes where finite volume effects are negligible ($0.1\lesssim k\,[h\,{\rm Mpc^{-1}}]\lesssim 1.2$) we find deviations of the estimated variance of the sample covariance with respect to Gaussian predictions above $\sim 10\%$ level. These reduce to about $\sim 5\%$ in the case of the precision matrix. Finally, we perform a Fisher analysis to estimate the effect of covariance errors on the cosmological parameter constraints. In particular, assuming Euclid-like survey characteristics we find that a number of independent realisation larger than $\gtrsim 5000$ is necessary to reduce the contribution of sample covariance errors to the cosmological parameter uncertainties at sub-percent level. We also show that restricting the analysis to large scales $k\lesssim0.2\,h\,{\rm Mpc^{-1}}$ results in a considerable loss in constraining power, while using the linear covariance to include smaller scales leads to an underestimation of the errors on the cosmological parameters.

There is currently a discrepancy in the measured value of the amplitude of matter clustering, parameterised using $\sigma_8$, inferred from galaxy weak lensing, and cosmic microwave background data, which could be an indication of new physics, such as massive neutrinos or a modification to the gravity law, or baryon feedback. In this paper we make the assumption that the cosmological parameters are well determined by Planck, and use weak lensing data to investigate the implications for baryon feedback and massive neutrinos, as well as possible contributions from intrinsic alignments and biases in photometric redshifts. We apply a non-parametric approach to model the baryonic feedback on the dark matter clustering, which is flexible enough to reproduce the OWLS and Illustris simulation results. The statistic we use, 3D cosmic shear, is a method that extracts cosmological information from weak lensing data using a spherical-Bessel function power spectrum approach. We analyse the CFHTLenS weak lensing data and, assuming best fit cosmological parameters from the Planck CMB experiment, find that there is no evidence for baryonic feedback on the dark matter power spectrum, but there is evidence for a bias in the photometric redshifts in the CFHTLenS data, consistent with a completely independent analysis by Choi et al. (2015), based on spectroscopic redshifts; and that these conclusions are robust to assumptions about the intrinsic alignment systematic. We also find an upper limit on the sum of neutrino masses conditional on other $\Lambda$CDM parameters being fixed, of $< 0.28$ eV ($1\sigma$).

Galaxy shapes are not randomly oriented, rather they are statistically aligned in a way that can depend on formation environment, history and galaxy type. Studying the alignment of galaxies can therefore deliver important information about the physics of galaxy formation and evolution as well as the growth of structure in the Universe. In this review paper we summarise key measurements of galaxy alignments, divided by galaxy type, scale and environment. We also cover the statistics and formalism necessary to understand the observations in the literature. With the emergence of weak gravitational lensing as a precision probe of cosmology, galaxy alignments have taken on an added importance because they can mimic cosmic shear, the effect of gravitational lensing by large-scale structure on observed galaxy shapes. This makes galaxy alignments, commonly referred to as intrinsic alignments, an important systematic effect in weak lensing studies. We quantify the impact of intrinsic alignments on cosmic shear surveys and finish by reviewing practical mitigation techniques which attempt to remove contamination by intrinsic alignments.

The alignments between galaxies, their underlying matter structures, and the cosmic web constitute vital ingredients for a comprehensive understanding of gravity, the nature of matter, and structure formation in the Universe. We provide an overview on the state of the art in the study of these alignment processes and their observational signatures, aimed at a non-specialist audience. The development of the field over the past one hundred years is briefly reviewed. We also discuss the impact of galaxy alignments on measurements of weak gravitational lensing, and discuss avenues for making theoretical and observational progress over the coming decade.

The shapes of galaxies are not randomly oriented on the sky. During the galaxy formation and evolution process, environment has a strong influence, as tidal gravitational fields in the large-scale structure tend to align nearby galaxies. Additionally, events such as galaxy mergers affect the relative alignments of both the shapes and angular momenta of galaxies throughout their history. These "intrinsic galaxy alignments" are known to exist, but are still poorly understood. This review will offer a pedagogical introduction to the current theories that describe intrinsic galaxy alignments, including the apparent difference in intrinsic alignment between early- and late-type galaxies and the latest efforts to model them analytically. It will then describe the ongoing efforts to simulate intrinsic alignments using both N-body and hydrodynamic simulations. Due to the relative youth of this field, there is still much to be done to understand intrinsic galaxy alignments and this review summarises the current state of the field, providing a solid basis for future work.

We construct the spin flaglet transform, a wavelet transform to analyze spin signals in three dimensions. Spin flaglets can probe signal content localized simultaneously in space and frequency and, moreover, are separable so that their angular and radial properties can be controlled independently. They are particularly suited to analyzing of cosmological observations such as the weak gravitational lensing of galaxies. Such observations have a unique 3D geometrical setting since they are natively made on the sky, have spin angular symmetries, and are extended in the radial direction by additional distance or redshift information. Flaglets are constructed in the harmonic space defined by the Fourier-Laguerre transform, previously defined for scalar functions and extended here to signals with spin symmetries. Thanks to various sampling theorems, both the Fourier-Laguerre and flaglet transforms are theoretically exact when applied to bandlimited signals. In other words, in numerical computations the only loss of information is due to the finite representation of floating point numbers. We develop a 3D framework relating the weak lensing power spectrum to covariances of flaglet coefficients. We suggest that the resulting novel flaglet weak lensing estimator offers a powerful alternative to common 2D and 3D approaches to accurately capture cosmological information. While standard weak lensing analyses focus on either real or harmonic space representations (i.e., correlation functions or Fourier-Bessel power spectra, respectively), a wavelet approach inherits the advantages of both techniques, where both complicated sky coverage and uncertainties associated with the physical modeling of small scales can be handled effectively. Our codes to compute the Fourier-Laguerre and flaglet transforms are made publicly available.

The shapes of galaxies can be quantified by ratios of their quadrupole moments. For faint galaxies, observational noise can make the denominator close to zero, so the ratios become ill-defined. Knowledge of these ratios (i.e. their measured standard deviation) is commonly used to assess the efficiency of weak gravitational lensing surveys. Since the requirements cannot be formally tested for faint galaxies, we explore two complementary mitigation strategies. In many weak lensing contexts, the most problematic sources can be removed by a cut in measured size. We investigate how a size cuts affects the required precision of the charge transfer inefficiency model and find slightly wider tolerance margins compared to the full size distribution. However, subtle biases in the data analysis chain may be introduced. Instead, as our second strategy, we propose requirements directly on the quadrupole moments themselves. To optimally exploit a Stage-IV dark energy survey, we find that the mean and standard deviation of a population of galaxies' quadrupole moments must to be known to better than $1.4\times10^{-3}$ arcsec$^{2}$, or the Stokes parameters to $1.9\times10^{-3}$ arcsec$^2$. This testable requirement can now form the basis for future performance validation, or for proportioning the requirements between subsystems to ensure unbiased cosmological parameter inference.

In this paper we present results of applying the shear-ratio method to the RCSLenS data. The method takes the ratio of the mean of the weak lensing tangential shear signal about galaxy clusters, averaged over all clusters of the same redshift, in multiple background redshift bins. In taking a ratio the mass-dependency of the shear signal is cancelled-out leaving a statistic that is dependent on the geometric part of the lensing kernel only. We apply this method to 535 clusters and measure a cosmology-independent distance-redshift relation to redshifts z~1. In combination with Planck data the method lifts the degeneracies in the CMB measurements, resulting in cosmological parameter constraints of OmegaM=0.31 +/- 0.10 and w0 = -1.02 +/- 0.37, for a flat wCDM cosmology.

Euclid is a European Space Agency medium class mission selected for launch in 2019 within the Cosmic Vision 2015-2025 programme. The main goal of Euclid is to understand the origin of the accelerated expansion of the Universe. Euclid will explore the expansion history of the Universe and the evolution of cosmic structures by measuring shapes and redshifts of galaxies as well as the distribution of clusters of galaxies over a large fraction of the sky. Although the main driver for Euclid is the nature of dark energy, Euclid science covers a vast range of topics, from cosmology to galaxy evolution to planetary research. In this review we focus on cosmology and fundamental physics, with a strong emphasis on science beyond the current standard models. We discuss five broad topics: dark energy and modified gravity, dark matter, initial conditions, basic assumptions and questions of methodology in the data analysis. This review has been planned and carried out within Euclid's Theory Working Group and is meant to provide a guide to the scientific themes that will underlie the activity of the group during the preparation of the Euclid mission.

We present weak lensing constraints on the ellipticity of galaxy-scale matter haloes and the galaxy-halo misalignment. Using data from the Canada-France-Hawaii Telescope Lensing Survey (CFHTLenS), we measure the weighted-average ratio of the aligned projected ellipticity components of galaxy matter haloes and their embedded galaxies, $f_\mathrm{h}$, split by galaxy type. We then compare our observations to measurements taken from the Millennium Simulation, assuming different models of galaxy-halo misalignment. Using the Millennium Simulation we verify that the statistical estimator used removes contamination from cosmic shear. We also detect an additional signal in the simulation, which we interpret as the impact of intrinsic shape-shear alignments between the lenses and their large-scale structure environment. These alignments are likely to have caused some of the previous observational constraints on $f_\mathrm{h}$ to be biased high. From CFHTLenS we find $f_\mathrm{h}=-0.04 \pm 0.25$ for early-type galaxies, which is consistent with current models for the galaxy-halo misalignment predicting $f_\mathrm{h}\simeq 0.20$. For late-type galaxies we measure $f_\mathrm{h}=0.69_{-0.36}^{+0.37}$ from CFHTLenS. This can be compared to the simulated results which yield $f_\mathrm{h}\simeq 0.02$ for misaligned late-type models.

Dark energy may be the first sign of new fundamental physics in the Universe, taking either a physical form or revealing a correction to Einsteinian gravity. Weak gravitational lensing and galaxy peculiar velocities provide complementary probes of General Relativity, and in combination allow us to test modified theories of gravity in a unique way. We perform such an analysis by combining measurements of cosmic shear tomography from the Canada-France Hawaii Telescope Lensing Survey (CFHTLenS) with the growth of structure from the WiggleZ Dark Energy Survey and the Six-degree-Field Galaxy Survey (6dFGS), producing the strongest existing joint constraints on the metric potentials that describe general theories of gravity. For scale-independent modifications to the metric potentials which evolve linearly with the effective dark energy density, we find present-day cosmological deviations in the Newtonian potential and curvature potential from the prediction of General Relativity to be (Delta Psi)/Psi = 0.05 \pm 0.25 and (Delta Phi)/Phi = -0.05 \pm 0.3 respectively (68 per cent CL).

One of the most powerful techniques to study the dark sector of the Universe is weak gravitational lensing. In practice, to infer the reduced shear, weak lensing measures galaxy shapes, which are the consequence of both the intrinsic ellipticity of the sources and of the integrated gravitational lensing effect along the line of sight. Hence, a very large number of galaxies is required in order to average over their individual properties and to isolate the weak lensing cosmic shear signal. If this `shape noise' can be reduced, significant advances in the power of a weak lensing surveys can be expected. This paper describes a general method for extracting the probability distributions of parameters from catalogues of data using Voronoi cells, which has several applications, and has synergies with Bayesian hierarchical modelling approaches. This allows us to construct a probability distribution for the variance of the intrinsic ellipticity as a function of galaxy property using only photometric data, allowing a reduction of shape noise. As a proof of concept the method is applied to the CFHTLenS survey data. We use this approach to investigate trends of galaxy properties in the data and apply this to the case of weak lensing power spectra.

The Kilo-Degree Survey (KiDS) is a multi-band imaging survey designed for cosmological studies from weak lensing and photometric redshifts. It uses the ESO VLT Survey Telescope with its wide-field camera OmegaCAM. KiDS images are taken in four filters similar to the SDSS ugri bands. The best-seeing time is reserved for deep r-band observations that reach a median 5-sigma limiting AB magnitude of 24.9 with a median seeing that is better than 0.7arcsec. Initial KiDS observations have concentrated on the GAMA regions near the celestial equator, where extensive, highly complete redshift catalogues are available. A total of 109 survey tiles, one square degree each, form the basis of the first set of lensing analyses, which focus on measurements of halo properties of GAMA galaxies. 9 galaxies per square arcminute enter the lensing analysis, for an effective inverse shear variance of 69 per square arcminute. Accounting for the shape measurement weight, the median redshift of the sources is 0.53. KiDS data processing follows two parallel tracks, one optimized for galaxy shape measurement (for weak lensing), and one for accurate matched-aperture photometry in four bands (for photometric redshifts). This technical paper describes how the lensing and photometric redshift catalogues have been produced (including an extensive description of the Gaussian Aperture and Photometry pipeline), summarizes the data quality, and presents extensive tests for systematic errors that might affect the lensing analyses. We also provide first demonstrations of the suitability of the data for cosmological measurements, and explain how the shear catalogues were blinded to prevent confirmation bias in the scientific analyses. The KiDS shear and photometric redshift catalogues, presented in this paper, are released to the community through http://kids.strw.leidenuniv.nl .

The Kilo-Degree Survey (KiDS) is an optical wide-field imaging survey carried out with the VLT Survey Telescope and the OmegaCAM camera. KiDS will image 1500 square degrees in four filters (ugri), and together with its near-infrared counterpart VIKING will produce deep photometry in nine bands. Designed for weak lensing shape and photometric redshift measurements, the core science driver of the survey is mapping the large-scale matter distribution in the Universe back to a redshift of ~0.5. Secondary science cases are manifold, covering topics such as galaxy evolution, Milky Way structure, and the detection of high-redshift clusters and quasars. KiDS is an ESO Public Survey and dedicated to serving the astronomical community with high-quality data products derived from the survey data, as well as with calibration data. Public data releases will be made on a yearly basis, the first two of which are presented here. For a total of 148 survey tiles (~160 sq.deg.) astrometrically and photometrically calibrated, coadded ugri images have been released, accompanied by weight maps, masks, source lists, and a multi-band source catalog. A dedicated pipeline and data management system based on the Astro-WISE software system, combined with newly developed masking and source classification software, is used for the data production of the data products described here. The achieved data quality and early science projects based on the data products in the first two data releases are reviewed in order to validate the survey data. Early scientific results include the detection of nine high-z QSOs, fifteen candidate strong gravitational lenses, high-quality photometric redshifts and galaxy structural parameters for hundreds of thousands of galaxies. (Abridged)

In this paper we investigate the impact that realistic scale-dependence systematic effects may have on cosmic shear tomography. We model spatially varying residual ellipticity and size variations in weak lensing measurements and propagate these through to predicted changes in the uncertainty and bias of cosmological parameters. We show that the survey strategy - whether it is regular or randomised - is an important factor in determining the impact of a systematic effect: a purely randomised survey strategy produces the smallest biases, at the expense of larger parameter uncertainties, and a very regularised survey strategy produces large biases, but unaffected uncertainties. However, by removing, or modelling, the affected scales (l-modes) in the regular cases the biases are reduced to negligible levels. We find that the integral of the systematic power spectrum is not a good metric for dark energy performance, and we advocate that systematic effects should be modelled accurately in real space, where they enter the measurement process, and their effect subsequently propagated into power spectrum contributions.

Here we present a Bayesian formalism for the goodness-of-fit that is the evidence for a fixed functional form over the evidence for all functions that are a general perturbation about this form. This is done under the assumption that the statistical properties of the data can be modelled by a multivariate Gaussian distribution. We use this to show how one can optimise an experiment to find evidence for a fixed function over perturbations about this function. We apply this formalism to an illustrative problem of measuring perturbations in the dark energy equation of state about a cosmological constant.

Collisions between galaxy clusters provide a test of the non-gravitational forces acting on dark matter. Dark matter's lack of deceleration in the `bullet cluster collision' constrained its self-interaction cross-section \sigma_DM/m < 1.25cm2/g (68% confidence limit) for long-ranged forces. Using the Chandra and Hubble Space Telescopes we have now observed 72 collisions, including both `major' and `minor' mergers. Combining these measurements statistically, we detect the existence of dark mass at 7.6\sigma significance. The position of the dark mass has remained closely aligned within 5.8+/-8.2 kpc of associated stars: implying a self-interaction cross-section \sigma_DM/m < 0.47 cm2/g (95% CL) and disfavoring some proposed extensions to the standard model.

Galaxy cluster Abell 3827 hosts the stellar remnants of four almost equally bright elliptical galaxies within a core of radius 10kpc. Such corrugation of the stellar distribution is very rare, and suggests recent formation by several simultaneous mergers. We map the distribution of associated dark matter, using new Hubble Space Telescope imaging and VLT/MUSE integral field spectroscopy of a gravitationally lensed system threaded through the cluster core. We find that each of the central galaxies retains a dark matter halo, but that (at least) one of these is spatially offset from its stars. The best-constrained offset is 1.62+/-0.48kpc, where the 68% confidence limit includes both statistical error and systematic biases in mass modelling. Such offsets are not seen in field galaxies, but are predicted during the long infall to a cluster, if dark matter self-interactions generate an extra drag force. With such a small physical separation, it is difficult to definitively rule out astrophysical effects operating exclusively in dense cluster core environments - but if interpreted solely as evidence for self-interacting dark matter, this offset implies a cross-section sigma/m=(1.7+/-0.7)x10^{-4}cm^2/g x (t/10^9yrs)^{-2}, where t is the infall duration.

We present weak lensing and X-ray analysis of 12 low mass clusters from the CFHTLenS and XMM-CFHTLS surveys. We combine these systems with high-mass systems from CCCP and low-mass systems from COSMOS to obtain a sample of 70 systems, spanning over two orders of magnitude in mass. We measure core-excised Lx-Tx, M-Lx and M-Tx scaling relations and include corrections for observational biases. By providing fully bias corrected relations, we give the current limitations for Lx and Tx as cluster mass proxies. We demonstrate that Tx benefits from a significantly lower intrinsic scatter at fixed mass than Lx. By studying the residuals of the bias corrected relations, we show for the first time using weak lensing masses that galaxy groups seem more luminous and warmer for their mass than clusters. This implies a steepening of the M-Lx and M-Tx relations at low masses. We verify the inferred steepening using a different high mass sample from the literature and show that variance between samples is the dominant effect leading to discrepant scaling relations. We divide our sample into subsamples of merging and relaxed systems, and find that mergers may have enhanced scatter in lensing measurements, most likely due to stronger triaxiality and more substructure. For the Lx-Tx relation, which is unaffected by lensing measurements, we find the opposite trend in scatter. We also explore the effects of X-ray cross-calibration and find that Chandra calibration leads to flatter Lx-Tx and M-Tx relations than XMM-Newton.

We study the correlations of the shear signal between triplets of sources in the Canada-France-Hawaii Lensing Survey (CFHTLenS) to probe cosmological parameters via the matter bispectrum. In contrast to previous studies, we adopted a non-Gaussian model of the data likelihood which is supported by our simulations of the survey. We find that for state-of-the-art surveys, similar to CFHTLenS, a Gaussian likelihood analysis is a reasonable approximation, albeit small differences in the parameter constraints are already visible. For future surveys we expect that a Gaussian model becomes inaccurate. Our algorithm for a refined non-Gaussian analysis and data compression is then of great utility especially because it is not much more elaborate if simulated data are available. Applying this algorithm to the third-order correlations of shear alone in a blind analysis, we find a good agreement with the standard cosmological model: $\Sigma_8$=$\sigma_8$ $(\Omega_{\rm m}/0.27)^{0.64}$=$0.79^{+0.08}_{-0.11}$ for a flat $\Lambda\rm CDM$ cosmology with $h=0.7\pm0.04$ ($68\%$ credible interval). Nevertheless our models provide only moderately good fits as indicated by $\chi^2/{\rm dof}=2.9$, including a $20\%$ r.m.s. uncertainty in the predicted signal amplitude. The models cannot explain a signal drop on scales around 15 arcmin, which may be caused by systematics. It is unclear whether the discrepancy can be fully explained by residual PSF systematics of which we find evidence at least on scales of a few arcmin. Therefore we need a better understanding of higher-order correlations of cosmic shear and their systematics to confidently apply them as cosmological probes.

We present new constraints on the relationship between galaxies and their host dark matter halos, measured from the location of the peak of the stellar-to-halo mass ratio (SHMR), up to the most massive galaxy clusters at redshift $z\sim0.8$ and over a volume of nearly 0.1~Gpc$^3$. We use a unique combination of deep observations in the CFHTLenS/VIPERS field from the near-UV to the near-IR, supplemented by $\sim60\,000$ secure spectroscopic redshifts, analysing galaxy clustering, galaxy-galaxy lensing and the stellar mass function. We interpret our measurements within the halo occupation distribution (HOD) framework, separating the contributions from central and satellite galaxies. We find that the SHMR for the central galaxies peaks at $M_{\rm h, peak} = 1.9^{+0.2}_{-0.1}\times10^{12} M_{\odot}$ with an amplitude of $0.025$, which decreases to $\sim0.001$ for massive halos ($M_{\rm h} > 10^{14} M_{\odot}$). Compared to central galaxies only, the total SHMR (including satellites) is boosted by a factor 10 in the high-mass regime (cluster-size halos), a result consistent with cluster analyses from the literature based on fully independent methods. After properly accounting for differences in modelling, we have compared our results with a large number of results from the literature up to $z=1$: we find good general agreement, independently of the method used, within the typical stellar-mass systematic errors at low to intermediate mass (${M}_{\star} < 10^{11} M_{\odot}$) and the statistical errors above. We have also compared our SHMR results to semi-analytic simulations and found that the SHMR is tilted compared to our measurements in such a way that they over- (under-) predict star formation efficiency in central (satellite) galaxies.

In this paper we present a power spectrum formalism that combines the full three-dimensional information from the galaxy ellipticity field, with information from the cosmic microwave background (CMB). We include in this approach galaxy cosmic shear and galaxy intrinsic alignments, CMB deflection, CMB temperature and CMB polarisation data; including the inter-datum power spectra between all quantities. We apply this to forecasting cosmological parameter errors for CMB and imaging surveys for Euclid-like, Planck, ACTPoL, and CoRE-like experiments. We show that the additional covariance between the CMB and ellipticity measurements can improve dark energy equation of state measurements by 15%, and the combination of cosmic shear and the CMB, from Euclid-like and CoRE-like experiments, could in principle measure the sum of neutrino masses with an error of 0.003 eV.

Euclid is the next ESA mission devoted to cosmology. It aims at observing most of the extragalactic sky, studying both gravitational lensing and clustering over $\sim$15,000 square degrees. The mission is expected to be launched in year 2020 and to last six years. The sheer amount of data of different kinds, the variety of (un)known systematic effects and the complexity of measures require efforts both in sophisticated simulations and techniques of data analysis. We review the mission main characteristics, some aspects of the the survey and highlight some of the areas of interest to this meeting

Over the past few years two of the largest and highest fidelity experiments conceived have been approved for construction: Euclid is an ESA M-Class mission that will map three-quarters of the extra galactic sky with Hubble Space Telescope resolution optical and NIR imaging, and NIR spectroscopy, its scientific aims (amongst others) are to create a map of the dark Universe and to determine the nature of dark energy. The Square Kilometre Array (SKA) has similar scientific aims (and others) using radio wavelength observations. The two experiments are synergistic in several respects, both through the scientific objectives and through the control of systematic effects. SKA Phase-1 and Euclid will be commissioned on similar timescales offering an exciting opportunity to exploit synergies between these facilities.

In this paper we present the testing of a back-illuminated development Euclid Visible Instrument (VIS) Charge-Coupled Device (CCD) to measure the intrinsic CCD Point Spread Function (PSF) characteristics using a novel modelling technique. We model the optical spot projection system and the CCD273-84 PSF jointly. We fit a model using Bayesian posterior probability density function, sampling to all available data simultaneously. The generative model fitting is shown, using simulated data, to allow good parameter estimations even when these data are not well sampled. Using available spot data we characterise a CCD273-84 PSF as a function of wavelength and intensity. The CCD PSF kernel size was found to increase with increasing intensity and decreasing wavelength.

We investigate the capabilities of various stages of the SKA to perform world-leading weak gravitational lensing surveys. We outline a way forward to develop the tools needed for pursuing weak lensing in the radio band. We identify the key analysis challenges and the key pathfinder experiments that will allow us to address them in the run up to the SKA. We identify and summarize the unique and potentially very powerful aspects of radio weak lensing surveys, facilitated by the SKA, that can solve major challenges in the field of weak lensing. These include the use of polarization and rotational velocity information to control intrinsic alignments, and the new area of weak lensing using intensity mapping experiments. We show how the SKA lensing surveys will both complement and enhance corresponding efforts in the optical wavebands through cross-correlation techniques and by way of extending the reach of weak lensing to high redshift.

We give an overview of complementarity and synergy in cosmology between the Square Kilometre Array and future survey projects in other wavelengths. In the SKA era, precision cosmology will be limited by systematic errors and cosmic variance, rather than statistical errors. However, combining and/or cross-correlating multi-wavelength data, from the SKA to the cosmic microwave background, optical/infrared and X-ray, substantially reduce these limiting factors. In this chapter, we summarize future survey projects and show highlights of complementarity and synergy, which can be very powerful to probe major cosmological problems such as dark energy, modified gravity and primordial non-Gaussianity.

This paper presents the first application of 3D cosmic shear to a wide-field weak lensing survey. 3D cosmic shear is a technique that analyses weak lensing in three dimensions using a spherical harmonic approach, and does not bin data in the redshift direction. This is applied to CFHTLenS, a 154 square degree imaging survey with a median redshift of 0.7 and an effective number density of 11 galaxies per square arcminute usable for weak lensing. To account for survey masks we apply a 3D pseudo-Cl approach on weak lensing data, and to avoid uncertainties in the highly non-linear regime, we separately analyse radial wave numbers k<=1.5h/Mpc and k<=5.0h/Mpc, and angular wavenumbers l~400-5000. We show how one can recover 2D and tomographic power spectra from the full 3D cosmic shear power spectra and present a measurement of the 2D cosmic shear power spectrum, and measurements of a set of 2-bin and 6-bin cosmic shear tomographic power spectra; in doing so we find that using the 3D power in the calculation of such 2D and tomographic power spectra from data naturally accounts for a minimum scale in the matter power spectrum. We use 3D cosmic shear to constrain cosmologies with parameters OmegaM, OmegaB, sigma8, h, ns, w0, wa. For a non-evolving dark energy equation of state, and assuming a flat cosmology, lensing combined with WMAP7 results in h=0.78+/-0.12, OmegaM=0.252+/-0.079, sigma8=0.88+/-0.23 and w=-1.16+/-0.38 using only scales k<=1.5h/Mpc. We also present results of lensing combined with first year Planck results, where we find no tension with the results from this analysis, but we also find no significant improvement over the Planck results alone. We find evidence of a suppression of power compared to LCDM on small scales 1.5 < k < 5.0 h/Mpc in the lensing data, which is consistent with predictions of the effect of baryonic feedback on the matter power spectrum.

We present the cluster mass-richness scaling relation calibrated by a weak lensing analysis of >18000 galaxy cluster candidates in the Canada-France-Hawaii Telescope Lensing Survey (CFHTLenS). Detected using the 3D-Matched-Filter cluster-finder of Milkeraitis et al., these cluster candidates span a wide range of masses, from the small group scale up to $\sim10^{15} M_{\odot}$, and redshifts 0.2 $\lesssim z\lesssim$ 0.9. The total significance of the stacked shear measurement amounts to 54$\sigma$. We compare cluster masses determined using weak lensing shear and magnification, finding the measurements in individual richness bins to yield 1$\sigma$ compatibility, but with magnification estimates biased low. This first direct mass comparison yields important insights for improving the systematics handling of future lensing magnification work. In addition, we confirm analyses that suggest cluster miscentring has an important effect on the observed 3D-MF halo profiles, and we quantify this by fitting for projected cluster centroid offsets, which are typically $\sim$ 0.4 arcmin. We bin the cluster candidates as a function of redshift, finding similar cluster masses and richness across the full range up to $z \sim$ 0.9. We measure the 3D-MF mass-richness scaling relation $M_{200} = M_0 (N_{200} / 20)^\beta$. We find a normalization $M_0 \sim (2.7^{+0.5}_{-0.4}) \times 10^{13} M_{\odot}$, and a logarithmic slope of $\beta \sim 1.4 \pm 0.1$, both of which are in 1$\sigma$ agreement with results from the magnification analysis. We find no evidence for a redshift-dependence of the normalization. The CFHTLenS 3D-MF cluster catalogue is now available at cfhtlens.org.

Galaxy-galaxy weak lensing is a direct probe of the mean matter distribution around galaxies. The depth and sky coverage of the CFHT Legacy Survey yield statistically significant galaxy halo mass measurements over a much wider range of stellar masses ($10^{8.75}$ to $10^{11.3} M_{\odot}$) and redshifts ($0.2 < z < 0.8$) than previous weak lensing studies. At redshift $z \sim 0.5$, the stellar-to-halo mass ratio (SHMR) reaches a maximum of $4.0\pm0.2$ percent as a function of halo mass at $\sim 10^{12.25} M_{\odot}$. We find, for the first time from weak lensing alone, evidence for significant evolution in the SHMR: the peak ratio falls as a function of cosmic time from $4.5 \pm 0.3$ percent at $z \sim 0.7$ to $3.4 \pm 0.2$ percent at $z \sim 0.3$, and shifts to lower stellar mass haloes. These evolutionary trends are dominated by red galaxies, and are consistent with a model in which the stellar mass above which star formation is quenched "downsizes" with cosmic time. In contrast, the SHMR of blue, star-forming galaxies is well-fit by a power law that does not evolve with time. This suggests that blue galaxies form stars at a rate that is balanced with their dark matter accretion in such a way that they evolve along the SHMR locus. The redshift dependence of the SHMR can be used to constrain the evolution of the galaxy population over cosmic time.

Higher-order, non-Gaussian aspects of the large-scale structure carry valuable information on structure formation and cosmology, which is complementary to second-order statistics. In this work we measure second- and third-order weak-lensing aperture-mass moments from CFHTLenS and combine those with CMB anisotropy probes. The third moment is measured with a significance of $2\sigma$. The combined constraint on $\Sigma_8 = \sigma_8 (\Omega_{\rm m}/0.27)^\alpha$ is improved by 10%, in comparison to the second-order only, and the allowed ranges for $\Omega_{\rm m}$ and $\sigma_8$ are substantially reduced. Including general triangles of the lensing bispectrum yields tighter constraints compared to probing mainly equilateral triangles. Second- and third-order CFHTLenS lensing measurements improve Planck CMB constraints on $\Omega_{\rm m}$ and $\sigma_8$ by 26% for flat $\Lambda$CDM. For a model with free curvature, the joint CFHTLenS-Planck result is $\Omega_{\rm m} = 0.28 \pm 0.02$ (68% confidence), which is an improvement of 43% compared to Planck alone. We test how our results are potentially subject to three astrophysical sources of contamination: source-lens clustering, the intrinsic alignment of galaxy shapes, and baryonic effects. We explore future limitations of the cosmological use of third-order weak lensing, such as the nonlinear model and the Gaussianity of the likelihood function.

In this paper we derive an exact full expression for the 2D probability distribution of the ellipticity of an object measured from data, only assuming Gaussian noise in pixel values. This is a generalisation of the probability distribution for the ratio of single random variables, that is well-known, to the multivariate case. This expression is derived within the context of the measurement of weak gravitational lensing from noisy galaxy images. We find that the third flattening, or epsilon-ellipticity, has a biased maximum likelihood but an unbiased mean; and that the third eccentricity, or normalised polarisation chi, has both a biased maximum likelihood and a biased mean. The very fact that the bias in the ellipticity is itself a function of the ellipticity requires an accurate knowledge of the intrinsic ellipticity distribution of the galaxies in order to properly calibrate shear measurements. We use this expression to explore strategies for calibration of biases caused by measurement processes in weak gravitational lensing. We find that upcoming weak lensing surveys like KiDS or DES require calibration fields of order of several square degrees and 1.2 magnitude deeper than the wide survey in order to correct for the noise bias. Future surveys like Euclid will require calibration fields of order 40 square degree and several magnitude deeper than the wide survey. We also investigate the use of the Stokes parameters to estimate the shear as an alternative to the ellipticity. We find that they can provide unbiased shear estimates at the cost of a very large variance in the measurement. The python code used to compute the distributions presented in the paper and to perform the numerical calculations are available on request.

We outline the prospects for performing pioneering radio weak gravitational lensing analyses using observations from a potential forthcoming JVLA Sky Survey program. A large-scale survey with the JVLA can offer interesting and unique opportunities for performing weak lensing studies in the radio band, a field which has until now been the preserve of optical telescopes. In particular, the JVLA has the capacity for large, deep radio surveys with relatively high angular resolution, which are the key characteristics required for a successful weak lensing study. We highlight the potential advantages and unique aspects of performing weak lensing in the radio band. In particular, the inclusion of continuum polarisation information can greatly reduce noise in weak lensing reconstructions and can also remove the effects of intrinsic galaxy alignments, the key astrophysical systematic effect that limits weak lensing at all wavelengths. We identify a VLASS "deep fields" program (total area ~10-20 square degs), to be conducted at L-band and with high-resolution (A-array configuration), as the optimal survey strategy from the point of view of weak lensing science. Such a survey will build on the unique strengths of the JVLA and will remain unsurpassed in terms of its combination of resolution and sensitivity until the advent of the Square Kilometre Array. We identify the best fields on the JVLA-accessible sky from the point of view of overlapping with existing deep optical and near infra-red data which will provide crucial redshift information and facilitate a host of additional compelling multi-wavelength science.

We develop a statistical method to measure the interaction cross-section of Dark Matter, exploiting the continuous minor merger events in which small substructures fall into galaxy clusters. We find that by taking the ratio of the distances between the galaxies and Dark Matter, and galaxies and gas in accreting sub-halos, we form a quantity that can be statistically averaged over a large sample of systems whilst removing any inherent line-of-sight projections. In order to interpret this ratio as a cross-section of Dark Matter we derive an analytical description of sub-halo infall which encompasses; the force of the main cluster potential, the drag on a gas sub-halo, a model for Dark Matter self-interactions and the resulting sub-halo drag, the force on the gas and galaxies due to the Dark Matter sub-halo potential, and finally the buoyancy on the gas and Dark Matter. We create mock observations from cosmological simulations of structure formation and find that collisionless Dark Matter becomes physically separated from X-ray gas by up to 20h^-1 kpc. Adding realistic levels of noise, we are able to predict achievable constraints from observational data. Current archival data should be able to detect a difference in the dynamical behaviour of Dark Matter and standard model particles at 6 sigma, and measure the total interaction cross-section sigma/m with 68% confidence limits of +/- 1cm2g^-1. We note that this method is not restricted by the limited number of major merging events and is easily extended to large samples of clusters from future surveys which could potentially push statistical errors to 0.1cm^2g^-1.

We present the results and conclusions from the citizen science competition `Observing Dark Worlds', where we asked participants to calculate the positions of dark matter halos from 120 catalogues of simulated weak lensing galaxy data, using computational methods. In partnership with Kaggle (http://www.kaggle.com), 357 users participated in the competition which saw 2278 downloads of the data and 3358 submissions. We found that the best algorithms improved on the benchmark code, LENSTOOL by > 30% and could measure the positions of > 3x10^14MSun halos to less than 5'' and < 10^14MSun to within 1'. In this paper, we present a brief overview of the winning algorithms with links to available code. We also discuss the implications of the experiment for future citizen science competitions.

We present a study of the relation between dark matter halo mass and the baryonic content of host galaxies, quantified via luminosity and stellar mass. Our investigation uses 154 deg2 of Canada-France-Hawaii Telescope Lensing Survey (CFHTLenS) lensing and photometric data, obtained from the CFHT Legacy Survey. We employ a galaxy-galaxy lensing halo model which allows us to constrain the halo mass and the satellite fraction. Our analysis is limited to lenses at redshifts between 0.2 and 0.4. We express the relationship between halo mass and baryonic observable as a power law. For the luminosity-halo mass relation we find a slope of 1.32+/-0.06 and a normalisation of 1.19+0.06-0.07x10^13 h70^-1 Msun for red galaxies, while for blue galaxies the best-fit slope is 1.09+0.20-0.13 and the normalisation is 0.18+0.04-0.05x10^13 h70^-1 Msun. Similarly, we find a best-fit slope of 1.36+0.06-0.07 and a normalisation of 1.43+0.11-0.08x10^13 h70^-1 Msun for the stellar mass-halo mass relation of red galaxies, while for blue galaxies the corresponding values are 0.98+0.08-0.07 and 0.84+0.20-0.16x10^13 h70^-1 Msun. For red lenses, the fraction which are satellites tends to decrease with luminosity and stellar mass, with the sample being nearly all satellites for a stellar mass of 2x10^9 h70^-2 Msun. The satellite fractions are generally close to zero for blue lenses, irrespective of luminosity or stellar mass. This, together with the shallower relation between halo mass and baryonic tracer, is a direct confirmation from galaxy-galaxy lensing that blue galaxies reside in less clustered environments than red galaxies. We also find that the halo model, while matching the lensing signal around red lenses well, is prone to over-predicting the large-scale signal for faint and less massive blue lenses. This could be a further indication that these galaxies tend to be more isolated than assumed. [abridged]

Chronos is our response to ESA's call for white papers to define the science for the future L2, L3 missions. Chronos targets the formation and evolution of galaxies, by collecting the deepest NIR spectroscopic data, from the formation of the first galaxies at z~10 to the peak of formation activity at z~1-3. The strong emission from the atmospheric background makes this type of survey impossible from a ground-based observatory. The spectra of galaxies represent the equivalent of a DNA fingerprint, containing information about the past history of star formation and chemical enrichment. The proposed survey will allow us to dissect the formation process of galaxies including the timescales of quenching triggered by star formation or AGN activity, the effect of environment, the role of infall/outflow processes, or the connection between the galaxies and their underlying dark matter haloes. To provide these data, the mission requires a 2.5m space telescope optimised for a campaign of very deep NIR spectroscopy. A combination of a high multiplex and very long integration times will result in the deepest, largest, high-quality spectroscopic dataset of galaxies from z=1 to 12, spanning the history of the Universe, from 400 million to 6 billion years after the big bang, i.e. covering the most active half of cosmic history.

We present a quantitative analysis of the largest contiguous maps of projected mass density obtained from gravitational lensing shear. We use data from the 154 deg2 covered by the Canada-France-Hawaii Telescope Lensing Survey. Our study is the first attempt to quantitatively characterize the scientific value of lensing maps, which could serve in the future as a complementary approach to the study of the dark universe with gravitational lensing. We show that mass maps contain unique cosmological information beyond that of traditional two-points statistical analysis techniques. Using a series of numerical simulations, we first show how, reproducing the CFHTLenS observing conditions, gravitational lensing inversion provides a reliable estimate of the projected matter distribution of large scale structure. We validate our analysis by quantifying the robustness of the maps with various statistical estimators. We then apply the same process to the CFHTLenS data. We find that the 2-points correlation function of the projected mass is consistent with the cosmological analysis performed on the shear correlation function discussed in the CFHTLenS companion papers. The maps also lead to a significant measurement of the third order moment of the projected mass, which is in agreement with analytic predictions, and to a marginal detection of the fourth order moment. Tests for residual systematics are found to be consistent with zero for the statistical estimators we used. A new approach for the comparison of the reconstructed mass map to that predicted from the galaxy distribution reveals the existence of giant voids in the dark matter maps as large as 3 degrees on the sky. Our analysis shows that lensing mass maps can be used for new techniques such as peak statistics and the morphological analysis of the projected dark matter distribution.

This paper describes the definition of a typical next-generation space-based weak gravitational lensing experiment. We first adopt a set of top-level science requirements from the literature, based on the scale and depth of the galaxy sample, and the avoidance of systematic effects in the measurements which would bias the derived shear values. We then identify and categorise the contributing factors to the systematic effects, combining them with the correct weighting, in such a way as to fit within the top-level requirements. We present techniques which permit the performance to be evaluated and explore the limits at which the contributing factors can be managed. Besides the modelling biases resulting from the use of weighted moments, the main contributing factors are the reconstruction of the instrument point spread function (PSF), which is derived from the stellar images on the image, and the correction of the charge transfer inefficiency (CTI) in the CCD detectors caused by radiation damage.

Direct evidence for the existence of dark matter and measurements of its interaction cross-section have been provided by the physical offset between dark matter and intra- cluster gas in merging systems like the Bullet Cluster. Although a smaller signal, this effect is more abundant in minor mergers where infalling substructure dark matter and gas are segregated. In such low-mass systems the gravitational lensing signal comes primarily from weak lensing. A fundamental step in determining such an offset in sub- structure is the ability to accurately measure the positions of dark matter sub-peaks. Using simulated Hubble Space Telescope observations, we make a first assessment of the precision and accuracy with which we can measure infalling groups using weak gravitational lensing. We demonstrate that using an existing and well-used mass re- construction algorithm can measure the positions of 1.5x1013 M substructures that have parent halos ten times more massive with a bias of less than 0.3 . In this regime, our analysis suggests the precision is sufficient to detect (at 3 {\sigma} statistical significance) the expected mean offset between dark matter and baryonic gas in infalling groups from a sample of 50 massive clusters.

We present a finely-binned tomographic weak lensing analysis of the Canada-France-Hawaii Telescope Lensing Survey, CFHTLenS, mitigating contamination to the signal from the presence of intrinsic galaxy alignments via the simultaneous fit of a cosmological model and an intrinsic alignment model. CFHTLenS spans 154 square degrees in five optical bands, with accurate shear and photometric redshifts for a galaxy sample with a median redshift of zm =0.70. We estimate the 21 sets of cosmic shear correlation functions associated with six redshift bins, each spanning the angular range of 1.5<theta<35 arcmin. We combine this CFHTLenS data with auxiliary cosmological probes: the cosmic microwave background with data from WMAP7, baryon acoustic oscillations with data from BOSS, and a prior on the Hubble constant from the HST distance ladder. This leads to constraints on the normalisation of the matter power spectrum sigma_8 = 0.799 +/- 0.015 and the matter density parameter Omega_m = 0.271 +/- 0.010 for a flat Lambda CDM cosmology. For a flat wCDM cosmology we constrain the dark energy equation of state parameter w = -1.02 +/- 0.09. We also provide constraints for curved Lambda CDM and wCDM cosmologies. We find the intrinsic alignment contamination to be galaxy-type dependent with a significant intrinsic alignment signal found for early-type galaxies, in contrast to the late-type galaxy sample for which the intrinsic alignment signal is found to be consistent with zero.

In this paper we present results from the weak lensing shape measurement GRavitational lEnsing Accuracy Testing 2010 (GREAT10) Galaxy Challenge. This marks an order of magnitude step change in the level of scrutiny employed in weak lensing shape measurement analysis. We provide descriptions of each method tested and include 10 evaluation metrics over 24 simulation branches. GREAT10 was the first shape measurement challenge to include variable fields; both the shear field and the Point Spread Function (PSF) vary across the images in a realistic manner. The variable fields enable a variety of metrics that are inaccessible to constant shear simulations including a direct measure of the impact of shape measurement inaccuracies, and the impact of PSF size and ellipticity, on the shear power spectrum. To assess the impact of shape measurement bias for cosmic shear we present a general pseudo-Cl formalism, that propagates spatially varying systematics in cosmic shear through to power spectrum estimates. We also show how one-point estimators of bias can be extracted from variable shear simulations. The GREAT10 Galaxy Challenge received 95 submissions and saw a factor of 3 improvement in the accuracy achieved by shape measurement methods. The best methods achieve sub-percent average biases. We find a strong dependence in accuracy as a function of signal-to-noise, and indications of a weak dependence on galaxy type and size. Some requirements for the most ambitious cosmic shear experiments are met above a signal-to-noise ratio of 20. These results have the caveat that the simulated PSF was a ground-based PSF. Our results are a snapshot of the accuracy of current shape measurement methods and are a benchmark upon which improvement can continue. This provides a foundation for a better understanding of the strengths and limitations of shape measurement methods.

We use weak gravitational lensing to analyse the dark matter halos around satellite galaxies in galaxy groups in the CFHTLenS dataset. This dataset is derived from the CFHTLS-Wide survey, and encompasses 154 sq. deg of high-quality shape data. Using the photometric redshifts, we divide the sample of lens galaxies with stellar masses in the range 10^9 Msun to 10^10.5 Msun into those likely to lie in high-density environments (HDE) and those likely to lie in low-density environments (LDE). Through comparison with galaxy catalogues extracted from the Millennium Simulation, we show that the sample of HDE galaxies should primarily (~61%) consist of satellite galaxies in groups, while the sample of LDE galaxies should consist of mostly (~87%) non-satellite (field and central) galaxies. Comparing the lensing signals around samples of HDE and LDE galaxies matched in stellar mass, the lensing signal around HDE galaxies clearly shows a positive contribution from their host groups on their lensing signals at radii of ~500--1000 kpc, the typical separation between satellites and group centres. More importantly, the subhalos of HDE galaxies are less massive than those around LDE galaxies by a factor 0.65 +/- 0.12, significant at the 2.9 sigma level. A natural explanation is that the halos of satellite galaxies are stripped through tidal effects in the group environment. Our results are consistent with a typical tidal truncation radius of ~40 kpc.

The goal of the .Astronomy conference series is to bring together astronomers, educators, developers and others interested in using the Internet as a medium for astronomy. Attendance at the event is limited to approximately 50 participants, and days are split into mornings of scheduled talks, followed by 'unconference' afternoons, where sessions are defined by participants during the course of the event. Participants in unconference sessions are discouraged from formal presentations, with discussion, workshop-style formats or informal practical tutorials encouraged. The conference also designates one day as a 'hack day', in which attendees collaborate in groups on day-long projects for presentation the following morning. These hacks are often a way of concentrating effort, learning new skills, and exploring ideas in a practical fashion. The emphasis on informal, focused interaction makes recording proceedings more difficult than for a normal meeting. While the first .Astronomy conference is preserved formally in a book, more recent iterations are not documented. We therefore, in the spirit of .Astronomy, report 'unproceedings' from .Astronomy 4, which was held in Heidelberg in July 2012.

We investigate the extent to which cosmic size magnification may be used to com- plement cosmic shear in weak gravitational lensing surveys, with a view to obtaining high-precision estimates of cosmological parameters. Using simulated galaxy images, we find that size estimation can be an excellent complement, finding that unbiased estimation of the convergence field is possible with galaxies with angular sizes larger than the point-spread function (PSF) and signal-to-noise ratio in excess of 10. The statistical power is similar to, but not quite as good as, cosmic shear, and it is subject to different systematic effects. Application to ground-based data will be challeng- ing, with relatively large empirical corrections required to account for with biases for galaxies which are smaller than the PSF, but for space-based data with 0.1 arcsecond resolution, the size distribution of galaxies brighter than i=24 is ideal for accurate estimation of cosmic size magnification.

We present the first direct measurement of the galaxy-matter bispectrum as a function of galaxy luminosity, stellar mass, and SED type. Our analysis uses a galaxy-galaxy-galaxy lensing technique (G3L), on angular scales between 9 arcsec to 50 arcmin, to quantify (i) the excess surface mass density around galaxy pairs (excess mass hereafter) and (ii) the excess shear-shear correlations around single galaxies, both of which yield a measure of two types of galaxy-matter bispectra. We apply our method to the state-of-the-art Canada-France-Hawaii Telescope Lensing Survey (CFHTLenS), spanning 154 square degrees. This survey allows us to detect a significant change of the bispectra with lens properties. Measurements for lens populations with distinct redshift distributions become comparable by a newly devised normalisation technique. That will also aid future comparisons to other surveys or simulations. A significant dependence of the normalised G3L statistics on luminosity within -23<M_r<-18 and stellar mass within 5x10^9 M_sol<M_star<2x10^11 M_sol is found (h=0.73). Both bispectra exhibit a stronger signal for more luminous lenses or those with higher stellar mass (up to a factor 2-3). This is accompanied by a steeper equilateral bispectrum for more luminous or higher stellar mass lenses for the excess mass. Importantly, we find the excess mass to be very sensitive to galaxy type as recently predicted with semi-analytic galaxy models: luminous (M_r<-21) late-type galaxies show no detectable signal, while all excess mass detected for luminous galaxies seems to be associated with early-type galaxies. We also present the first observational constraints on third-order stochastic galaxy biasing parameters.

We present cosmological constraints from 2D weak gravitational lensing by the large-scale structure in the Canada-France Hawaii Telescope Lensing Survey (CFHTLenS) which spans 154 square degrees in five optical bands. Using accurate photometric redshifts and measured shapes for 4.2 million galaxies between redshifts of 0.2 and 1.3, we compute the 2D cosmic shear correlation function over angular scales ranging between 0.8 and 350 arcmin. Using non-linear models of the dark-matter power spectrum, we constrain cosmological parameters by exploring the parameter space with Population Monte Carlo sampling. The best constraints from lensing alone are obtained for the small-scale density-fluctuations amplitude sigma_8 scaled with the total matter density Omega_m. For a flat LambdaCDM model we obtain sigma_8(Omega_m/0.27)^0.6 = 0.79+-0.03. We combine the CFHTLenS data with WMAP7, BOSS and an HST distance-ladder prior on the Hubble constant to get joint constraints. For a flat LambdaCDM model, we find Omega_m = 0.283+-0.010 and sigma_8 = 0.813+-0.014. In the case of a curved wCDM universe, we obtain Omega_m = 0.27+-0.03, sigma_8 = 0.83+-0.04, w_0 = -1.10+-0.15 and Omega_K = 0.006+0.006-0.004. We calculate the Bayesian evidence to compare flat and curved LambdaCDM and dark-energy CDM models. From the combination of all four probes, we find models with curvature to be at moderately disfavoured with respect to the flat case. A simple dark-energy model is indistinguishable from LambdaCDM. Our results therefore do not necessitate any deviations from the standard cosmological model.

Cosmological parameter estimation requires that the likelihood function of the data is accurately known. Assuming that cosmological large-scale structure power spectra data are multivariate Gaussian-distributed, we show the accuracy of parameter estimation is limited by the accuracy of the inverse data covariance matrix - the precision matrix. If the data covariance and precision matrices are estimated by sampling independent realisations of the data, their statistical properties are described by the Wishart and Inverse-Wishart distributions, respectively. Independent of any details of the survey, we show that the fractional error on a parameter variance, or a Figure-of-Merit, is equal to the fractional variance of the precision matrix. In addition, for the only unbiased estimator of the precision matrix, we find that the fractional accuracy of the parameter error depends only on the difference between the number of independent realisations and the number of data points, and so can easily diverge. For a 5% error on a parameter error and N_D << 100 data-points, a minimum of 200 realisations of the survey are needed, with 10% accuracy for the data covariance. If the number of data-points N_D >>100 we need N_S > N_D realisations and a fractional accuracy of <sqrt[2/N_D] in the data covariance. As the number of power spectra data points grows to N_D>10^4 -10^6 this approach will be problematic. We discuss possible ways to relax these conditions: improved theoretical modelling; shrinkage methods; data-compression; simulation and data resampling methods.

The Canada-France-Hawaii Telescope Lensing Survey (CFHTLenS) comprises deep multi-colour (u*g'r'i'z') photometry spanning 154 square degrees, with accurate photometric redshifts and shape measurements. We demonstrate that the redshift probability distribution function summed over galaxies provides an accurate representation of the galaxy redshift distribution accounting for random and catastrophic errors for galaxies with best fitting photometric redshifts z_p < 1.3. We present cosmological constraints using tomographic weak gravitational lensing by large-scale structure. We use two broad redshift bins 0.5 < z_p <= 0.85 and 0.85 < z_p <= 1.3 free of intrinsic alignment contamination, and measure the shear correlation function on angular scales in the range ~1-40 arcmin. We show that the problematic redshift scaling of the shear signal, found in previous CFHTLS data analyses, does not afflict the CFHTLenS data. For a flat Lambda-CDM model and a fixed matter density Omega_m=0.27, we find the normalisation of the matter power spectrum sigma_8=0.771 \pm 0.041. When combined with cosmic microwave background data (WMAP7), baryon acoustic oscillation data (BOSS), and a prior on the Hubble constant from the HST distance ladder, we find that CFHTLenS improves the precision of the fully marginalised parameter estimates by an average factor of 1.5-2. Combining our results with the above cosmological probes, we find Omega_m=0.2762 \pm 0.0074 and sigma_8=0.802 \pm 0.013.

The travel time required for one civilisation to explore the Milky Way using probes is a crucial component of Fermi's Paradox. Previous attempts to estimate this travel time have assumed that the probe's motion is simple, moving at a constant maximum velocity, with powered flight producing the necessary change in velocity required at each star to complete its chosen trajectory. This approach ignores lessons learned from interplanetary exploration, where orbital slingshot maneouvres can provide significant velocity boosts at little to no fuel cost. It is plausible that any attempt to explore the Galaxy would utilise such economising techniques, despite there being an upper limit to these velocity boosts, related to the escape velocity of the object being used to provide the slingshot. In order to investigate the effects of these techniques, we present multiple realisations of single probes exploring a small patch of the Milky Way. We investigate 3 separate scenarios, studying the slingshot effect on trajectories defined by simple heuristics. These scenarios are: i) standard powered flight to the nearest unvisited star without using slingshot techniques; ii) flight to the nearest unvisited star using slingshot techniques, and iii) flight to the next unvisited star which provides the maximal velocity boost under a slingshot trajectory. We find that adding slingshot velocity boosts can decrease the travel time by up to two orders of magnitude over simple powered flight. In the third case, selecting a route which maximises velocity boosts also reduces the travel time relative to powered flight, but by a much reduced factor. From these simulations, we suggest that adding realistic probe trajectories tends to strengthen Fermi's Paradox.

The spatial variation of the colour of a galaxy may introduce a bias in the measurement of its shape if the PSF profile depends on wavelength. We study how this bias depends on the properties of the PSF and the galaxies themselves. The bias depends on the scales used to estimate the shape, which may be used to optimise methods to reduce the bias. Here we develop a general approach to quantify the bias. Although applicable to any weak lensing survey, we focus on the implications for the ESA Euclid mission. Based on our study of synthetic galaxies we find that the bias is a few times 10^-3 for a typical galaxy observed by Euclid. Consequently, it cannot be neglected and needs to be accounted for. We demonstrate how one can do so using spatially resolved observations of galaxies in two filters. We show that HST observations in the F606W and F814W filters allow us to model and reduce the bias by an order of magnitude, sufficient to meet Euclid's scientific requirements. The precision of the correction is ultimately determined by the number of galaxies for which spatially-resolved observations in at least two filters are available. We use results from the Millennium Simulation to demonstrate that archival HST data will be sufficient for the tomographic cosmic shear analysis with the Euclid dataset.

We present data products from the Canada-France-Hawaii Telescope Lensing Survey (CFHTLenS). CFHTLenS is based on the Wide component of the Canada-France-Hawaii Telescope Legacy Survey (CFHTLS). It encompasses 154 deg^2 of deep, optical, high-quality, sub-arcsecond imaging data in the five optical filters u^*g'r'i'z'. The article presents our data processing of the complete CFHTLenS data set. We were able to obtain a data set with very good image quality and high-quality astrometric and photometric calibration. Our external astrometric accuracy is between 60-70 mas with respect to SDSS data and the internal alignment in all filters is around 30 mas. Our average photometric calibration shows a dispersion on the order of 0.01 to 0.03 mag for g'r'i'z' and about 0.04 mag for u^* with respect to SDSS sources down to i <= 21. In the spirit of the CFHTLS all our data products are released to the astronomical community via the Canadian Astronomy Data Centre. We give a description and how-to manuals of the public products which include image pixel data, source catalogues with photometric redshift estimates and all relevant quantities to perform weak lensing studies.

A likelihood-based method for measuring weak gravitational lensing shear in deep galaxy surveys is described and applied to the Canada-France-Hawaii Telescope (CFHT) Lensing Survey (CFHTLenS). CFHTLenS comprises 154 sq deg of multicolour optical data from the CFHT Legacy Survey, with lensing measurements being made in the i' band to a depth i'(AB)<24.7, for galaxies with signal-to-noise ratio greater than about 10. The method is based on the lensfit algorithm described in earlier papers, but here we describe a full analysis pipeline that takes into account the properties of real surveys. The method creates pixel-based models of the varying point spread function (PSF) in individual image exposures. It fits PSF-convolved two-component (disk plus bulge) models, to measure the ellipticity of each galaxy, with bayesian marginalisation over model nuisance parameters of galaxy position, size, brightness and bulge fraction. The method allows optimal joint measurement of multiple, dithered image exposures, taking into account imaging distortion and the alignment of the multiple measurements. We discuss the effects of noise bias on the likelihood distribution of galaxy ellipticity. Two sets of image simulations that mirror the observed properties of CFHTLenS have been created, to establish the method's accuracy and to derive an empirical correction for the effects of noise bias.

The first half of this paper explores the origin of systematic biases in the measurement of weak gravitational lensing. Compared to previous work, we expand the investigation of PSF instability and fold in for the first time the effects of non-idealities in electronic imaging detectors and imperfect galaxy shape measurement algorithms. Together, these now explain the additive A(l) and multiplicative M(l) systematics typically reported in current lensing measurements. We find that overall performance is driven by a product of a telescope/camera's *absolute performance*, and our *knowledge about its performance*. The second half of this paper propagates any residual shear measurement biases through to their effect on cosmological parameter constraints. Fully exploiting the statistical power of Stage IV weak lensing surveys will require additive biases A<1.8e-12 and multiplicative biases M<4.0e-3. These can be allocated between individual budgets in hardware, calibration data and software, using results from the first half of the paper. If instrumentation is stable and well-calibrated, we find extant shear measurement software from GREAT10 already meet requirements on galaxies detected at S/N=40. Averaging over a population of galaxies with a realistic distribution of sizes, it also meets requirements for a 2D cosmic shear analysis from space. If used on fainter galaxies or for 3D cosmic shear tomography, existing algorithms would need calibration on simulations to avoid introducing bias at a level similar to the statistical error. Requirements on hardware and calibration data are discussed in more detail in a companion paper. Our analysis is intentionally general, but is specifically being used to drive the hardware and ground segment performance budget for the design of the European Space Agency's recently-selected Euclid mission.

We present the results from the first public blind PSF reconstruction challenge, the GRavitational lEnsing Accuracy Testing 2010 (GREAT10) Star Challenge. Reconstruction of a spatially varying PSF, sparsely sampled by stars, at non-star positions is a critical part in the image analysis for weak lensing where inaccuracies in the modelled ellipticity and size-squared can impact the ability to measure the shapes of galaxies. This is of importance because weak lensing is a particularly sensitive probe of dark energy, and can be used to map the mass distribution of large scale structure. Participants in the challenge were presented with 27,500 stars over 1300 images subdivided into 26 sets, where in each set a category change was made in the type or spatial variation of the PSF. Thirty submissions were made by 9 teams. The best methods reconstructed the PSF with an accuracy of ~0.00025 in ellipticity and ~0.00074 in size squared. For a fixed pixel scale narrower PSFs were found to be more difficult to model than larger PSFs, and the PSF reconstruction was severely degraded with the inclusion of an atmospheric turbulence model (although this result is likely to be a strong function of the amplitude of the turbulence power spectrum).

We present the Canada-France-Hawaii Telescope Lensing Survey (CFHTLenS) that accurately determines a weak gravitational lensing signal from the full 154 square degrees of deep multi-colour data obtained by the CFHT Legacy Survey. Weak gravitational lensing by large-scale structure is widely recognised as one of the most powerful but technically challenging probes of cosmology. We outline the CFHTLenS analysis pipeline, describing how and why every step of the chain from the raw pixel data to the lensing shear and photometric redshift measurement has been revised and improved compared to previous analyses of a subset of the same data. We present a novel method to identify data which contributes a non-negligible contamination to our sample and quantify the required level of calibration for the survey. Through a series of cosmology-insensitive tests we demonstrate the robustness of the resulting cosmic shear signal, presenting a science-ready shear and photometric redshift catalogue for future exploitation.

Euclid is an ESA Cosmic-Vision wide-field-space mission which is designed to explain the origin of the acceleration of Universe expansion. The mission will investigate at the same time two primary cosmological probes: Weak gravitational Lensing (WL) and Galaxy Clustering (in particular Baryon Acoustic Oscillations, BAO). The extreme precision requested on primary science objectives can only be achieved by observing a large number of galaxies distributed over the whole sky in order to probe the distribution of dark matter and galaxies at all scales. The extreme accuracy needed requires observation from space to limit all observational biases in the measurements. The definition of the Euclid survey, aiming at detecting billions of galaxies over 15 000 square degrees of the extragalactic sky, is a key parameter of the mission. It drives its scientific potential, its duration and the mass of the spacecraft. The construction of a Reference Survey derives from the high level science requirements for a Wide and a Deep survey. The definition of a main sequence of observations and the associated calibrations were indeed a major achievement of the Definition Phase. Implementation of this sequence demonstrated the feasibility of covering the requested area in less than 6 years while taking into account the overheads of space segment observing and maneuvering sequence. This reference mission will be used for sizing the spacecraft consumables needed for primary science. It will also set the framework for optimizing the time on the sky to fulfill the primary science and maximize the Euclid legacy.

Euclid-VIS is a large format visible imager for the ESA Euclid space mission in their Cosmic Vision program, scheduled for launch in 2019. Together with the near infrared imaging within the NISP instrument it forms the basis of the weak lensing measurements of Euclid. VIS will image in a single r+i+z band from 550-900 nm over a field of view of ~0.5 deg2. By combining 4 exposures with a total of 2240 sec, VIS will reach to V=24.5 (10{\sigma}) for sources with extent ~0.3 arcsec. The image sampling is 0.1 arcsec. VIS will provide deep imaging with a tightly controlled and stable point spread function (PSF) over a wide survey area of 15000 deg2 to measure the cosmic shear from nearly 1.5 billion galaxies to high levels of accuracy, from which the cosmological parameters will be measured. In addition, VIS will also provide a legacy imaging dataset with an unprecedented combination of spatial resolution, depth and area covering most of the extra-Galactic sky. Here we will present the results of the study carried out by the Euclid Consortium during the Euclid Definition phase.

We describe a simple and fast method to correct ellipticity measurements of galaxies from the distortion by the instrumental and atmospheric point spread function (PSF), in view of weak lensing shear measurements. The method performs a classification of galaxies and associated PSFs according to measured shape parameters, and corrects the measured galaxy ellipticites by querying a large lookup table (LUT), built by supervised learning. We have applied this new method to the GREAT10 image analysis challenge, and present in this paper a refined solution that obtains the competitive quality factor of Q = 104, without any shear power spectrum denoising or training. Of particular interest is the efficiency of the method, with a processing time below 3 ms per galaxy on an ordinary CPU.

It is a firm prediction of the concordance Cold Dark Matter (CDM) cosmological model that galaxy clusters live at the intersection of large-scale structure filaments. The thread-like structure of this "cosmic web" has been traced by galaxy redshift surveys for decades. More recently the Warm-Hot Intergalactic Medium (WHIM) residing in low redshift filaments has been observed in emission and absorption. However, a reliable direct detection of the underlying Dark Matter skeleton, which should contain more than half of all matter, remained elusive, as earlier candidates for such detections were either falsified or suffered from low signal-to-noise ratios and unphysical misalignements of dark and luminous matter. Here we report the detection of a dark matter filament connecting the two main components of the Abell 222/223 supercluster system from its weak gravitational lensing signal, both in a non-parametric mass reconstruction and in parametric model fits. This filament is coincident with an overdensity of galaxies and diffuse, soft X-ray emission and contributes mass comparable to that of an additional galaxy cluster to the total mass of the supercluster. Combined with X-ray observations, we place an upper limit of 0.09 on the hot gas fraction, the mass of X-ray emitting gas divided by the total mass, in the filament.

We present a method for attaining sub-arcsecond pointing stability during sub- orbital balloon flights, as designed for in the High Altitude Lensing Observatory (HALO) concept. The pointing method presented here has the potential to perform near-space quality optical astronomical imaging at 1-2% of the cost of space-based missions. We also discuss an architecture that can achieve sufficient thermomechanical stability to match the pointing stability. This concept is motivated by advances in the development and testing of Ultra Long Duration Balloon (ULDB) flights which promise to allow observation campaigns lasting more than three months. The design incorporates a multi-stage pointing architecture comprising: a gondola coarse azimuth control system, a multi-axis nested gimbal frame structure with arcsecond stability, a telescope de-rotator to eliminate field rotation, and a fine guidance stage consisting of both a telescope mounted angular rate sensor and guide CCDs in the focal plane to drive a fast-steering mirror. We discuss the results of pointing tests together with a preliminary thermo-mechanical analysis required for sub-arcsecond pointing at high altitude. Possible future applications in the areas of wide-field surveys and exoplanet searches are also discussed.

In this paper we present results from the Mapping Dark Matter competition that expressed the weak lensing shape measurement task in its simplest form and as a result attracted over 700 submissions in 2 months and a factor of 3 improvement in shape measurement accuracy on high signal to noise galaxies, over previously published results, and a factor 10 improvement over methods tested on constant shear blind simulations. We also review weak lensing shape measurement challenges, including the Shear TEsting Programmes (STEP1 and STEP2) and the GRavitational lEnsing Accuracy Testing competitions (GREAT08 and GREAT10).

Here we present the results of various approaches to measure accurate colours and photometric redshifts (photo-z's) from wide-field imaging data. We use data from the Canada-France-Hawaii-Telescope Legacy Survey (CFHTLS) which have been re- processed by the CFHT Lensing Survey (CFHTLenS) team in order to carry out a number of weak gravitational lensing studies. An emphasis is put on the correction of systematic effects in the photo-z's arising from the different Point Spread Functions (PSF) in the five optical bands. Different ways of correcting these effects are discussed and the resulting photo-z accuracies are quantified by comparing the photo-z's to large spectroscopic redshift (spec-z) data sets. Careful homogenisation of the PSF between bands leads to increased overall accuracy of photo-z's. The gain is particularly pronounced at fainter magnitudes where galaxies are smaller and flux measurements are affected more by PSF-effects. We also study possible re- calibrations of the photometric zeropoints (ZPs) with the help of galaxies with known spec-z's. We find that if PSF-effects are properly taken into account, a re-calibration of the ZPs becomes much less important suggesting that previous such re-calibrations described in the literature could in fact be mostly corrections for PSF-effects rather than corrections for real inaccuracies in the ZPs. The implications of this finding for future surveys like KiDS, DES, LSST, or Euclid are mixed. On the one hand, ZP re-calibrations with spec-z's might not be as accurate as previously thought. On the other hand, careful PSF homogenisation might provide a way out and yield accurate, homogeneous photometry without the need for full spectroscopic coverage. This is the first paper in a series describing the technical aspects of CFHTLenS. (abridged)

High precision cosmology with weak gravitational lensing requires a precise measure of the Point Spread Function across the imaging data where the accuracy to which high spatial frequency variation can be modelled is limited by the stellar number density across the field. We analyse dense stellar fields imaged at the Canada-France-Hawaii Telescope to quantify the degree of high spatial frequency variation in ground-based imaging Point Spread Functions and compare our results to models of atmospheric turbulence. The data shows an anisotropic turbulence pattern with an orientation independent of the wind direction and wind speed. We find the amplitude of the high spatial frequencies to decrease with increasing exposure time as $t^{-1/2}$, and find a negligibly small atmospheric contribution to the Point Spread Function ellipticity variation for exposure times $t>180$ seconds. For future surveys analysing shorter exposure data, this anisotropic turbulence will need to be taken into account as the amplitude of the correlated atmospheric distortions becomes comparable to a cosmological lensing signal on scales less than $\sim 10$ arcminutes. This effect could be mitigated, however, by correlating galaxy shear measured on exposures imaged with a time separation greater than 50 seconds, for which we find the spatial turbulence patterns to be uncorrelated.

GRavitational lEnsing Accuracy Testing 2010 (GREAT10) is a public image analysis challenge aimed at the development of algorithms to analyze astronomical images. Specifically, the challenge is to measure varying image distortions in the presence of a variable convolution kernel, pixelization and noise. This is the second in a series of challenges set to the astronomy, computer science and statistics communities, providing a structured environment in which methods can be improved and tested in preparation for planned astronomical surveys. GREAT10 extends upon previous work by introducing variable fields into the challenge. The "Galaxy Challenge" involves the precise measurement of galaxy shape distortions, quantified locally by two parameters called shear, in the presence of a known convolution kernel. Crucially, the convolution kernel and the simulated gravitational lensing shape distortion both now vary as a function of position within the images, as is the case for real data. In addition, we introduce the "Star Challenge" that concerns the reconstruction of a variable convolution kernel, similar to that in a typical astronomical observation. This document details the GREAT10 Challenge for potential participants. Continually updated information is also available from http://www.greatchallenges.info.

Gravitational lensing can provide pure geometric tests of the structure of space-time, for instance by determining empirically the angular diameter distance-redshift relation. This geometric test has been demonstrated several times using massive clusters which produce a large lensing signal. In this case, matter at a single redshift dominates the lensing signal, so the analysis is straightforward. It is less clear how weaker signals from multiple sources at different redshifts can be stacked to demonstrate the geometric dependence. We introduce a simple measure of relative shear which for flat cosmologies separates the effect of lens and source positions into multiplicative terms, allowing signals from many different source-lens pairs to be combined. Applying this technique to a sample of groups and low-mass clusters in the COSMOS survey, we detect a clear variation of shear with distance behind the lens. This represents the first detection of the geometric effect using weak lensing by multiple, low-mass systems. The variation of distance with redshift is measured with sufficient precision to constrain the equation of state of the universe under the assumption of flatness, equivalent to a detection of a dark energy component Omega_X at greater than 99% confidence for an equation-of-state parameter -2.5 < w < -0.1. For the case w = -1, we find a value for the cosmological constant density parameter Omega_Lambda = 0.85+0.044-0.19 (68% C.L.), and detect cosmic acceleration (q_0 < 0) at the 98% C.L.. We consider the systematic uncertainties associated with this technique and discuss the prospects for applying it in forthcoming weak-lensing surveys.

Euclid is a space-based survey mission from the European Space Agency designed to understand the origin of the Universe's accelerating expansion. It will use cosmological probes to investigate the nature of dark energy, dark matter and gravity by tracking their observational signatures on the geometry of the universe and on the cosmic history of structure formation. The mission is optimised for two independent primary cosmological probes: Weak gravitational Lensing (WL) and Baryonic Acoustic Oscillations (BAO). The Euclid payload consists of a 1.2 m Korsch telescope designed to provide a large field of view. It carries two instruments with a common field-of-view of ~0.54 deg2: the visual imager (VIS) and the near infrared instrument (NISP) which contains a slitless spectrometer and a three bands photometer. The Euclid wide survey will cover 15,000 deg2 of the extragalactic sky and is complemented by two 20 deg2 deep fields. For WL, Euclid measures the shapes of 30-40 resolved galaxies per arcmin2 in one broad visible R+I+Z band (550-920 nm). The photometric redshifts for these galaxies reach a precision of dz/(1+z) < 0.05. They are derived from three additional Euclid NIR bands (Y, J, H in the range 0.92-2.0 micron), complemented by ground based photometry in visible bands derived from public data or through engaged collaborations. The BAO are determined from a spectroscopic survey with a redshift accuracy dz/(1+z) =0.001. The slitless spectrometer, with spectral resolution ~250, predominantly detects Ha emission line galaxies. Euclid is a Medium Class mission of the ESA Cosmic Vision 2015-2025 programme, with a foreseen launch date in 2019. This report (also known as the Euclid Red Book) describes the outcome of the Phase A study.

Cosmic shear has been identified as the method with the most potential to constrain dark energy. To capitalise on this potential it is necessary to measure galaxy shapes with great accuracy, which in turn requires a detailed model for the image blurring, the Point Spread Function (PSF). In general the PSF varies with wavelength and therefore the PSF integrated over an observing filter depends on the spectrum of the object. For a typical galaxy the spectrum varies across the galaxy image, thus the PSF depends on the position within the image. We estimate the bias on the shear due to such colour gradients by modelling galaxies using two co-centered, co-elliptical Sersic profiles, each with a different spectrum. We estimate the effect of ignoring colour gradients and find the shear bias from a single galaxy can be very large depending on the properties of the galaxy. We find that halving the filter width reduces the shear bias by a factor of about 5. We show that, to first order, tomographic cosmic shear two point statistics depend on the mean shear bias over the galaxy population at a given redshift. For a single broad filter, and averaging over a small galaxy catalogue, we find a mean shear bias which is subdominant to the predicted statistical errors for future cosmic shear surveys. However, the true mean shear bias may exceed the statistical errors, depending on how accurately the catalogue represents the observed distribution of galaxies in the cosmic shear survey. We then investigate the bias on the shear for two-filter imaging and find that the bias is reduced by at least an order of magnitude. Lastly, we find that it is possible to calibrate galaxies for which colour gradients were ignored using two-filter imaging of a fair sample of noisy galaxies, if the galaxy model is known. For a S/N of 25 the number of galaxies required in each tomographic redshift bin is of order 1e4.

Aims: The interactive software package iCosmo, designed to perform cosmological calculations is described. Methods: iCosmo is a software package to perform interactive cosmological calculations for the low redshift universe. Computing distance measures, the matter power spectrum, and the growth factor is supported for any values of the cosmological parameters. It also computes derived observed quantities for several cosmological probes such as cosmic shear, baryon acoustic oscillations and type Ia supernovae. The associated errors for these observables can be derived for customised surveys, or for pre-set values corresponding to current or planned instruments. The code also allows for the calculation of cosmological forecasts with Fisher matrices which can be manipulated to combine different surveys and cosmological probes. The code is written in the IDL language and thus benefits from the convenient interactive features and scientific library available in this language. iCosmo can also be used as an engine to perform cosmological calculations in batch mode, and forms a convenient adaptive platform for the development of further cosmological modules. With its extensive documentation, it may also serve as a useful resource for teaching and for newcomers in the field of cosmology. Results: The iCosmo package is described with various examples and command sequences. The code is freely available with documentation at http://www.icosmo.org, along with an interactive web interface and is part of the Initiative for Cosmology, a common archive for cosmological resources.

We present parameter estimation forecasts for future 3D cosmic shear surveys for a class of Unified Dark Matter (UDM) models, where a single scalar field mimics both Dark Matter (DM) and Dark Energy (DE). These models have the advantage that they can describe the dynamics of the Universe with a single matter component providing an explanation for structure formation and cosmic acceleration. A crucial feature of the class of UDM models we use in this work is characterised by a parameter, c_inf (in units of the speed of light c=1), that is the value of the sound speed at late times, and on which structure formation depends. We demonstrate that the properties of the DM-like behaviour of the scalar field can be estimated with very high precision with large-scale, fully 3D weak lensing surveys. We found that 3D weak lensing significantly constrains c_inf, and we find minimal errors 0.00003, for the fiducial value c_inf=0.001, and 0.000026, for c_inf=0.012. Moreover, we compute the Bayesian evidence for UDM models over the LCDM model as a function of c_inf. For this purpose, we can consider the LCDM model as a UDM model with c_inf=0. We find that the expected evidence clearly shows that the survey data would unquestionably favour UDM models over the LCDM model, for the values c_inf>0.001.

Here we present a number of improvements to weak lensing 3D power spectrum analysis, 3D cosmic shear, that uses the shape and redshift information of every galaxy to constrain cosmological parameters. We show how photometric redshift probability distributions for individual galaxies can be directly included in this statistic with no averaging. We also include the Limber approximation, considerably simplifying full 3D cosmic shear analysis, and we investigate its range of applicability. Finally we show the relationship between weak lensing tomography and the 3D cosmic shear field itself; the steps connecting them being the Limber approximation, a harmonic-space transform and a discretisation in wavenumber. Each method has its advantages: 3D cosmic shear analysis allows straightforward inclusion of all relevant modes, thus ensuring minimum error bars, and direct control of the range of physical wavenumbers probed, to avoid the uncertain highly nonlinear regime. On the other hand, tomography is more convenient for checking systematics through direct investigation of the redshift dependence of the signal. Finally, for tomography, we suggest that the angular modes probed should be redshift-dependent, to recover some of the 3D advantages.

Here we present an investigation into using nested sampling algorithms in cosmological likelihood analysis. We present a new nested sampling algorithm, ESNested, that uses Evolution Strategies for sample proposals. This quickly finds the maximum for complex likelihoods and provides an accurate measure of the Bayesian evidence, with no prior assumptions about the shape of the likelihood surface. We present the first cosmological constraints using Evolution Strategies, from WMAP 7, HST and SNIa data using likelihood and data provided with CosmoMC. We find a significantly higher maximum likelihood than that found with other methods. We compare the performance of ESNested with the publicly available MultiNest and CosmoNest algorithms, in i) finding the maximum likelihood ii) calculating confidence contours in projected parameter spaces and iii) calculating the Bayesian evidence. We find that none of the algorithms provide a single solution for all of these products in general. Our recommendation is that multiple sampling methods should be used in cosmological likelihood analysis and that algorithms should be tailored to perform optimally for each of these requirements. These results have a resonance with the well-known No Free Lunch theorem.

The unique properties of dark matter are revealed during collisions between clusters of galaxies, like the bullet cluster (1E 0657-56) and baby bullet (MACSJ0025-12). These systems provide evidence for an additional, invisible mass in the separation between the distribution of their total mass, measured via gravitational lensing, and their ordinary 'baryonic' matter, measured via its X-ray emission. Unfortunately, the information available from these systems is limited by their rarity. Constraints on the properties of dark matter, such as its interaction cross-section, are therefore restricted by uncertainties in the individual systems' impact velocity, impact parameter and orientation with respect to the line of sight. Here we develop a complementary, statistical measurement in which every piece of substructure falling into every massive cluster is treated as a bullet. We define 'bulleticity' as the mean separation between dark matter and ordinary matter, and we measure the signal in hydrodynamical simulations. The phase space of substructure orbits also exhibits symmetries that provide an equivalent control test. Any detection of bulleticity in real data would indicate a difference in the interaction cross-sections of baryonic and dark matter that may rule out hypotheses of non-particulate dark matter that are otherwise able to model individual systems. A subsequent measurement of bulleticity could constrain the dark matter cross-section. Even with conservative estimates, the existing HST archive should yield an independent constraint tighter than that from the bullet cluster. This technique is then trivially extendable to, and benefits enormously from larger, future surveys.

We introduce a collection of statistics appropriate for the study of spinorial quantities defined in three dimensions, focussing on applications to cosmological weak gravitational lensing studies in 3D. In particular, we concentrate on power spectra associated with three- and four-point statistics, which have the advantage of compressing a large number of typically very noisy modes into a convenient data set. It has been shown previously by \cite{MuHe09} that, for non--Gaussianity studies in the microwave background, such compression can be lossless for certain purposes, so we expect the statistics we define here to capture the bulk of the cosmological information available in these higher-order statistics. We consider the effects of a sky mask and noise, and use Limber's approximation to show how, for high-frequency angular modes, confrontation of the statistics with theory can be achieved efficiently and accurately. We focus on scalar and spinorial fields including convergence, shear and flexion of 3D weak lensing, but many of the results apply for general spin fields.

We present a new method that deals with the uncertainty in matter-clustering in cosmic shear power spectrum analysis that arises mainly due to poorly understood nonlinear baryonic processes on small-scales. We show that the majority of information about dark energy physics contained in the shear power comes from these small-scales; removing these nonlinear scales from a cosmic shear analysis results in a 50% cut in the accuracy of measurements of dark energy parameters, marginalizing over all other parameters. In this paper we propose a method to recover the information on small-scales by allowing cosmic shear surveys to measure the nonlinear matter power spectrum themselves and marginalize over all possible power spectra using path integrals. Information is still recoverable in these nonlinear regimes from the geometric part of weak lensing. In this self-calibration regime we find we recover 90% of the information on dark energy. Including an informative prior, we find the nonlinear matter power spectrum needs to be accurately known to 1% down to k=50 h/Mpc to recover 99% of the dark energy information. This presents a significant theoretical challenge to understand baryonic effects on the scale of galaxy haloes. However self-calibration from weak lensing may also provide observational input to help constrain baryon physics.

Given a standard model to test, an experiment can be designed to: (i) measure the standard model parameters; (ii) extend the standard model; or (iii) look for evidence of deviations from the standard model. To measure (or extend) the standard model, the Fisher matrix is widely used in cosmology to predict expected parameter errors for future surveys under Gaussian assumptions. In this article, we present a frame- work that can be used to design experiments such that it maximises the chance of finding a deviation from the standard model. Using a simple illustrative example, discussed in the appendix, we show that the optimal experimental configuration can depend dramatically on the optimisation approach chosen. We also show some simple cosmology calculations, where we study Baryonic Acoustic Oscillation and Supernove surveys. In doing so, we also show how external data, such as the positions of the CMB peaks measured by WMAP, and theory priors can be included in the analysis. In the cosmological cases that we have studied (DETF Stage III), we find that the three optimisation approaches yield similar results, which is reassuring and indicates that the choice of optimal experiment is fairly robust at this level. However, this may not be the case as we move to more ambitious future surveys.

We present a path-integral likelihood formalism that extends parameterized likelihood analyses to include continuous functions. The method finds the maximum likelihood point in function-space, and marginalizes over all possible functions, under the assumption of a Gaussian-distributed function-space. We apply our method to the problem of removing unknown systematic functions in two topical problems for dark energy research : scale-dependent galaxy bias in redshift surveys; and galaxy intrinsic alignments in cosmic shear surveys. We find that scale-dependent galaxy bias will degrade information on cosmological parameters unless the fractional variance in the bias function is known to 10%. Measuring and removing intrinsic alignments from cosmic shear surveys with a flat-prior can reduce the dark energy Figure-of-Merit by 20%, however provided that the scale and redshift-dependence is known to better than 10% with a Gaussian-prior, the dark energy Figure-of-Merit can be enhanced by a factor of two with no extra assumptions.

We review progress in understanding dark matter by astrophysics, and particularly via the effect of gravitational lensing. Evidence from many different directions now all imply that five sixths of the material content of the universe is in this mysterious form, separate from and beyond the ordinary "baryonic" particles in the standard model of particle physics. Dark matter appears not to interact via the electromagnetic force, and therefore neither emits nor reflects light. However, it definitely does interact via gravity, and has played the most important role in shaping the Universe on large scales. The most successful technique with which to investigate it has so far been the effect of gravitational lensing. The curvature of space-time near any gravitating mass (including dark matter) deflects passing rays of light - observably shifting, distorting and magnifying the images of background galaxies. Measurements of such effects currently provide constraints on the mean density of dark matter, and its density relative to baryonic matter; the size and mass of individual dark matter particles; and its cross section under various fundamental forces.

Cosmological probes are steadily reducing the total neutrino mass window, resulting in constraints on the neutrino-mass degeneracy as the most significant outcome. In this work we explore the discovery potential of cosmological probes to constrain the neutrino hierarchy, and point out some subtleties that could yield spurious claims of detection. This has an important implication for next generation of double beta decay experiments, that will be able to achieve a positive signal in the case of degenerate or inverted hierarchy of Majorana neutrinos. We find that cosmological experiments that nearly cover the whole sky could in principle distinguish the neutrino hierarchy by yielding 'substantial' evidence for one scenario over the another, via precise measurements of the shape of the matter power spectrum from large scale structure and weak gravitational lensing.

We present general, analytic methods for Cosmological likelihood analysis and solve the "many-parameters" problem in Cosmology. Maxima are found by Newton's Method, while marginalization over nuisance parameters, and parameter errors and covariances are estimated by analytic marginalization of an arbitrary likelihood function with flat or Gaussian priors. We show that information about remaining parameters is preserved by marginalization. Marginalizing over all parameters, we find an analytic expression for the Bayesian evidence for model selection. We apply these methods to data described by Gaussian likelihoods with parameters in the mean and covariance. This method can speed up conventional likelihood analysis by orders of magnitude when combined with Monte-Carlo Markov Chain methods, while Bayesian model selection becomes effectively instantaneous.

Weak gravitational lensing provides a sensitive probe of cosmology by measuring the mass distribution and the geometry of the low redshift universe. We show how an all-sky weak lensing tomographic survey can jointly constrain different sets of cosmological parameters describing dark energy, massive neutrinos (hot dark matter), and the primordial power spectrum. In order to put all sectors on an equal footing, we introduce a new parameter $\beta$, the second order running spectral index. Using the Fisher matrix formalism with and without CMB priors, we examine how the constraints vary as the parameter set is enlarged. We find that weak lensing with CMB priors provides robust constraints on dark energy parameters and can simultaneously provide strong constraints on all three sectors. We find that the dark energy sector is largely insensitive to the inclusion of the other cosmological sectors. Implications for the planning of future surveys are discussed.

The energy density of the Universe is dominated by dark energy and dark matter, two mysterious components which pose some of the most important questions in fundamental science today. Euclid is a high-precision survey mission designed to answer these questions by mapping the geometry of the dark Universe. Euclid's Visible-NIR imaging and spectroscopy of the entire extragalactic sky will further produce extensive legacy science for various fields of astronomy. Over the 2008-2009 period, Euclid has been the object of an ESA Assessment Phase in which the study of the Euclid Imaging instrument was under the responsibility of the Euclid Imaging Consortium (EIC). The EIC Science Book presents the studies done by the EIC science working groups in the context of this study phase. We first give a brief description of the Euclid mission and of the imaging instrument and surveys. We then summarise the primary and legacy science which will be achieved with the Euclid imaging surveys, along with the simulations and data handling scheme which have been developed to optimise the instrument and ensure its science performance.

In the absence of any compelling physical model, cosmological systematics are often misrepresented as statistical effects and the approach of marginalising over extra nuisance systematic parameters is used to gauge the effect of the systematic. In this article we argue that such an approach is risky at best since the key choice of function can have a large effect on the resultant cosmological errors. As an alternative we present a functional form filling technique in which an unknown, residual, systematic is treated as such. Since the underlying function is unknown we evaluate the effect of every functional form allowed by the information available (either a hard boundary or some data). Using a simple toy model we introduce the formalism of functional form filling. We show that parameter errors can be dramatically affected by the choice of function in the case of marginalising over a systematic, but that in contrast the functional form filling approach is independent of the choice of basis set. We then apply the technique to cosmic shear shape measurement systematics and show that a shear calibration bias of |m(z)|< 0.001(1+z)^0.7 is required for a future all-sky photometric survey to yield unbiased cosmological parameter constraints to percent accuracy. A module associated with the work in this paper is available through the open source iCosmo code available at http://www.icosmo.org .

Within the context of constraining an expansion of the dark energy equation of state w(z) we show that the eigendecomposition of Fisher matrices is sensitive to both the maximum order of the expansion and the basis set choice. We investigate the Fisher matrix formalism in the case that a particular function is expanded in some basis set. As an example we show results for an all sky weak lensing tomographic experiment. We show that the set of eigenfunctions is not unique and that the best constrained functions are only reproduced accurately at very higher order N > 100, a tophat basis set requires an even higher order. We show that the common approach used for finding the marginalised eigenfunction errors is sensitive to the choice of non-w(z) parameters and priors. The eigendecomposition of Fisher matrices is a potentially useful tool that can be used to determine the predicted accuracy with which an experiment could constrain w(z). It also allows for the reconstruction of the redshift sensitivity of the experiment to changes in w(z). However the technique is sensitive to both the order and the basis set choice. Publicly available code is available as part of iCosmo at http://www.icosmo.org .

We present the results of the GREAT08 Challenge, a blind analysis challenge to infer weak gravitational lensing shear distortions from images. The primary goal was to stimulate new ideas by presenting the problem to researchers outside the shear measurement community. Six GREAT08 Team methods were presented at the launch of the Challenge and five additional groups submitted results during the 6 month competition. Participants analyzed 30 million simulated galaxies with a range in signal to noise ratio, point-spread function ellipticity, galaxy size, and galaxy type. The large quantity of simulations allowed shear measurement methods to be assessed at a level of accuracy suitable for currently planned future cosmic shear observations for the first time. Different methods perform well in different parts of simulation parameter space and come close to the target level of accuracy in several of these. A number of fresh ideas have emerged as a result of the Challenge including a re-examination of the process of combining information from different galaxies, which reduces the dependence on realistic galaxy modelling. The image simulations will become increasingly sophisticated in future GREAT challenges, meanwhile the GREAT08 simulations remain as a benchmark for additional developments in shear measurement algorithms.

The combination of current large scale structure and cosmic microwave background (CMB) anisotropies data can place strong constraints on the sum of the neutrino masses. Here we show that future cosmic shear experiments, in combination with CMB constraints, can provide the statistical accuracy required to answer questions about differences in the mass of individual neutrino species. Allowing for the possibility that masses are non-degenerate we combine Fisher matrix forecasts for a weak lensing survey like Euclid with those for the forthcoming Planck experiment. Under the assumption that neutrino mass splitting is described by a normal hierarchy we find that the combination Planck and Euclid will possibly reach enough sensitivity to put a constraint on the mass of a single species. Using a Bayesian evidence calculation we find that such future experiments could provide strong evidence for either a normal or an inverted neutrino hierachy. Finally we show that if a particular neutrino hierachy is assumed then this could bias cosmological parameter constraints, for example the dark energy equation of state parameter, by > 1\sigma, and the sum of masses by 2.3\sigma.

The GRavitational lEnsing Accuracy Testing 2008 (GREAT08) Challenge focuses on a problem that is of crucial importance for future observations in cosmology. The shapes of distant galaxies can be used to determine the properties of dark energy and the nature of gravity, because light from those galaxies is bent by gravity from the intervening dark matter. The observed galaxy images appear distorted, although only slightly, and their shapes must be precisely disentangled from the effects of pixelisation, convolution and noise. The worldwide gravitational lensing community has made significant progress in techniques to measure these distortions via the Shear TEsting Program (STEP). Via STEP, we have run challenges within our own community, and come to recognise that this particular image analysis problem is ideally matched to experts in statistical inference, inverse problems and computational learning. Thus, in order to continue the progress seen in recent years, we are seeking an infusion of new ideas from these communities. This document details the GREAT08 Challenge for potential participants. Please visit http://www.great08challenge.info for the latest information.

Astronomy and cosmology have embraced the internet. We routinely and successfully use the internet as a repository for sharing code, publications and information, and as a computational resource. However the interactive nature of the web, for use as an alternative to downloading code has been largely overlooked. In this article we will outline a simple framework in which a cosmological code can be turned into an interactive web interface. This is presented as a result of creating http://www.icosmo.org which is a front-end for the open-source software iCosmo. We explain how an HTML page can be created and how a cosmological code can be incorporated into a web environment using CGI scripts. We outline how plots and downloadable text can be made, and describe how help and documentation can be created. By using simple HTML and CGI scripts a basic web interface for any cosmological code can be created easily. We provide a worked example of the methods outlined, which can be used as a simple template by any researcher who wants to share their work online.

The Baryon Acoustic Oscillations (BAOs) or baryon wiggles which are present in the galaxy power spectrum at scales 100-150Mpc/h are powerful features with which to constrain cosmology. The potential of these probes is such that these are now included as primary science goals in the planning of several future galaxy surveys. However, there is not a uniquely defined BAO Method in the literature but a range of implementations. We study the assumptions and cosmological performances of three different BAO methods: the full Fourier space power spectrum [P(k)], the `wiggles only' in Fourier space and the spherical harmonics power spectrum [C(l)]. We contrast the power of each method to constrain cosmology for two fiducial surveys taken from the Dark Energy Task Force (DETF) report and equivalent to future ground and space based spectroscopic surveys. We find that, depending on the assumptions used, the dark energy Figure of Merit (FoM) can change by up to a factor of 35 for a given fiducial model and survey. We compare our results with the DETF implementation and, discuss the robustness of each probe, by quantifying the dependence of the FoM with the wavenumber range. The more information used by a method, the higher its statistical performance, but the higher its sensitivity to systematics and implementations details.

We extend the Bayesian model fitting shape measurement method presented in Miller et al. (2007) and use the method to estimate the shear from the Shear TEsting Programme simulations (STEP). The method uses a fast model fitting algorithm which uses realistic galaxy profiles and analytically marginalises over the position and amplitude of the model by doing the model fitting in Fourier space. This is used to find the full posterior probability in ellipticity so that the shear can be estimated in a fully Bayesian way. The Bayesian shear estimation allows measurement bias arising from the presence of random noise to be removed. In this paper we introduce an iterative algorithm that can be used to estimate the intrinsic ellipticity prior and show that this is accurate and stable. By using the method to estimate the shear from the STEP1 simulations we find the method to have a shear bias of m ~ 0.005 and a variation in shear offset with PSF type of sigma_c ~ 0.0002. These values are smaller than for any method presented in the STEP1 publication that behaves linearly with shear. Using the method to estimate the shear from the STEP2 simulations we find than the shear bias and offset are m ~ 0.002 and c ~ -0.0007 respectively. In addition we find that the bias and offset are stable to changes in magnitude and size of the galaxies. Such biases should yield any cosmological constraints from future weak lensing surveys robust to systematic effects in shape measurement.

In this paper we investigate the potential of 3D cosmic shear to constrain massive neutrino parameters. We find that if the total mass is substantial (near the upper limits from LSS, but setting aside the Ly alpha limit for now), then 3D cosmic shear + Planck is very sensitive to neutrino mass and one may expect that a next generation photometric redshift survey could constrain the number of neutrinos N_nu and the sum of their masses m_nu to an accuracy of dN_nu ~ 0.08 and dm_nu ~ 0.03 eV respectively. If in fact the masses are close to zero, then the errors weaken to dN_nu ~ 0.10 and dm_nu~0.07 eV. In either case there is a factor 4 improvement over Planck alone. We use a Bayesian evidence method to predict joint expected evidence for N_nu and m_nu. We find that 3D cosmic shear combined with a Planck prior could provide `substantial' evidence for massive neutrinos and be able to distinguish `decisively' between many competing massive neutrino models. This technique should `decisively' distinguish between models in which there are no massive neutrinos and models in which there are massive neutrinos with |N_nu-3| > 0.35 and m_nu > 0.25 eV. We introduce the notion of marginalised and conditional evidence when considering evidence for individual parameter values within a multi-parameter model.

We present an investigation into the potential effect of systematics inherent in multi-band wide field surveys on the dark energy equation of state determination for two 3D weak lensing methods. The weak lensing methods are a geometric shear-ratio method and 3D cosmic shear. The analysis here uses an extension of the Fisher matrix framework to jointly include photometric redshift systematics, shear distortion systematics and intrinsic alignments. We present results for DUNE and Pan-STARRS surveys. We show that assuming systematic parameters are fixed, but possibly biased, results in potentially large biases in dark energy parameters. We quantify any potential bias by defining a Bias Figure of Merit. We also show the effect on the dark energy Figure of Merit of marginalising over each systematic parameter individually. We find that the largest effect on the Figure of Merit comes from uncertainty in the photometric redshift systematic parameters. These can reduce the Figure of Merit by up to a factor of 2 to 4 in both 3D weak lensing methods, if no informative prior on the systematic parameters is applied. Shear distortion systematics have a smaller overall effect. Intrinsic alignment effects can reduce the Figure of Merit by up to a further factor of 2. This, however, is a worst case scenario. By including prior information on systematic parameters the Figure of Merit can be recovered to a large extent. We conclude that, as a rule of thumb, given a realistic current understanding of intrinsic alignments and photometric redshifts, then including all three primary systematic effects reduces the Figure of Merit by at most a factor of 2, but that in reality this factor should be much less. [abridged]

The principles of measuring the shapes of galaxies by a model-fitting approach are discussed in the context of shape-measurement for surveys of weak gravitational lensing. It is argued that such an approach should be optimal, allowing measurement with maximal signal-to-noise, coupled with estimation of measurement errors. The distinction between likelihood-based and Bayesian methods is discussed. Systematic biases in the Bayesian method may be evaluated as part of the fitting process, and overall such an approach should yield unbiased shear estimation without requiring external calibration from simulations. The principal disadvantage of model-fitting for large surveys is the computational time required, but here an algorithm is presented that enables large surveys to be analysed in feasible computation times. The method and algorithm is tested on simulated galaxies from the Shear TEsting Program (STEP).

The Fisher matrix approach (Fisher 1935) allows one to calculate in advance how well a given experiment will be able to estimate model parameters, and has been an invaluable tool in experimental design. In the same spirit, we present here a method to predict how well a given experiment can distinguish between different models, regardless of their parameters. From a Bayesian viewpoint, this involves computation of the Bayesian evidence. In this paper, we generalise the Fisher matrix approach from the context of parameter fitting to that of model testing, and show how the expected evidence can be computed under the same simplifying assumption of a gaussian likelihood as the Fisher matrix approach for parameter estimation. With this `Laplace approximation' all that is needed to compute the expected evidence is the Fisher matrix itself. We illustrate the method with a study of how well upcoming and planned experiments should perform at distinguishing between Dark Energy models and modified gravity theories. In particular we consider the combination of 3D weak lensing, for which planned and proposed wide-field multi-band imaging surveys will provide suitable data, and probes of the expansion history of the Universe, such as proposed supernova and baryonic acoustic oscillations surveys. We find that proposed large-scale weak lensing surveys from space should be able readily to distinguish General Relativity from modified gravity models.

We present the first application of the 3D cosmic shear method developed in Heavens et al. (2006) and the geometric shear-ratio analysis developed in Taylor et al. (2006), to the COMBO-17 data set. 3D cosmic shear has been used to analyse galaxies with redshift estimates from two random COMBO-17 fields covering 0.52 square degrees in total, providing a conditional constraint in the (sigma_8, Omega_m) plane as well as a conditional constraint on the equation of state of dark energy, parameterised by a constant w= p/rho c^2. The (sigma_8, Omega_m) plane analysis constrained the relation between sigma_8 and Omega_m to be sigma_8(Omega_m/0.3)^{0.57 +- 0.19}=1.06 +0.17 -0.16, in agreement with a 2D cosmic shear analysis of COMBO-17. The 3D cosmic shear conditional constraint on w using the two random fields is w=-1.27 +0.64 -0.70. The geometric shear-ratio analysis has been applied to the A901/2 field, which contains three small galaxy clusters. Combining the analysis from the A901/2 field, using the geometric shear-ratio analysis, and the two random fields, using 3D cosmic shear, w is conditionally constrained to w=-1.08 +0.63 -0.58. The errors presented in this paper are shown to agree with Fisher matrix predictions made in Heavens et al. (2006) and Taylor et al. (2006). When these methods are applied to large datasets, as expected soon from surveys such as Pan-STARRS and VST-KIDS, the dark energy equation of state could be constrained to an unprecedented degree of accuracy.

We present parameter estimation forecasts for present and future 3D cosmic shear surveys. We demonstrate that, in conjunction with results from cosmic microwave background (CMB) experiments, the properties of dark energy can be estimated with very high precision with large-scale, fully 3D weak lensing surveys. In particular, a 5-band, 10,000 square degree ground-based survey to a median redshift of zm=0.7 could achieve 1-$\sigma$ marginal statistical errors, in combination with the constraints expected from the CMB Planck Surveyor, of $\Delta$w0=0.108 and $\Delta$wa=0.099 where we parameterize w by w(a)=w0+wa(1-a) where a is the scale factor. Such a survey is achievable with a wide-field camera on a 4 metre class telescope. The error on the value of w at an intermediate pivot redshift of z=0.368 is constrained to $\Delta$w(z=0.368)=0.0175. We compare and combine the 3D weak lensing constraints with the cosmological and dark energy parameters measured from planned Baryon Acoustic Oscillation (BAO) and supernova Type Ia experiments, and find that 3D weak lensing significantly improves the marginalized errors. A combination of 3D weak lensing, CMB and BAO experiments could achieve $\Delta$w0=0.037 and $\Delta$wa=0.099. Fully 3D weak shear analysis avoids the loss of information inherent in tomographic binning, and we show that the sensitivity to systematic errors is much less. In conjunction with the fact that the physics of lensing is very soundly based, this analysis demonstrates that deep, wide-angle 3D weak lensing surveys are extremely promising for measuring dark energy properties.

We adapt the Jain--Taylor (2003) shear-ratio geometric lensing method to measure the dark energy equation of state, and its time derivative from dark matter haloes in cosmologies with arbitrary spatial curvature. The full shear-ratio covariance matrix is calculated for lensed sources, including the intervening large-scale structure and photometric redshift errors as additional sources of noise, and a maximum likelihood method for applying the test is presented. Combining with the expected results from the CMB we design an optimal survey for probing dark energy. A targeted survey imaging 60 of the largest clusters in a hemisphere with 5-band optical photometric redshifts to a median galaxy depth of zm=0.9 could measure w0 to a marginal 1-sigma error of $\Delta$w0=0.5. We marginalize over all other parameters including wa, where the equation of state is parameterized in terms of scale factor a as w(a)=w0+wa(1-a). For higher accuracy a large-scale photometric redshift survey is required. Such a near-future 5-band survey covering 10,000 square degrees to z_m=0.7 could measure w0 to $\Delta$w0=0.075 and $\Delta$wa=0.33. A stronger combined constraint is measured at a pivot redshift zp=0.27 of $\Delta$w(zp)=0.0298. We compare and combine the geometric test with the cosmological and dark energy parameters measured from planned Baryon Acoustic Oscillation (BAO) and supernova Type Ia experiments, and find that the geometric test results combine with a significant reduction in errors due to different degeneracies. A combination of geometric lensing, CMB and BAO experiments could achieve a pivot redshift constraint of $\Delta$w(zp)=0.020 at zp=0.62. Simple relations are presented that show how our lensing results can be scaled to other telescope classes and survey parameters.

We present a comprehensive full-sky 3-dimensional analysis of the weak-lensing fields and their corresponding power spectra. Using the formalism of spin-weight spherical harmonics and spherical Bessel functions, we relate the two-point statistics of the harmonic expansion coefficients of the weak lensing shear and convergence to the power spectrum of the matter density perturbations, and derive small-angle limits. Such a study is relevant in view of the next generation of large-scale weak lensing surveys which will provide distance information about the sources through photometric redshifts. This opens up the possibility of accurate cosmological parameter estimation via weak lensing, with an emphasis on the equation of state of dark energy.