Due to instrumental limitations, the nature of which vary from case to case, spectroscopic galaxy redshift surveys usually do not collect redshifts for all galaxies in the population of potential targets. Especially problematic is the entanglement between this incompleteness and the true cosmological signal, arising from the fact that the proportion of successful observations is typically lower in regions with higher density of galaxies. The result is a fictitious suppression of the galaxy clustering that, if not properly corrected, can impact severely on cosmological-parameter inference. Recent developments in the field have shown that an unbiased estimate of the 2-point correlation function in the presence of missing observations can be obtained by weighting each pair by its inverse probability of being targeted. In this work we expand on the concept of probability weights by developing a more mature statistical formalism, which provides us with a deeper understanding of their fundamental properties. We take advantage of this novel perspective to handle the problem of estimating the inverse probability, specifically, we discuss how to efficiently determine the weights from a finite set of realisations of the targeting and how to model exactly the resulting sampling effects. This allows us to derive an inverse-probability-based estimator for the power spectrum, which is the main result of this work, but also to improve robustness and computational efficiency of the already existing configuration-space estimator. Finally, we propose a strategy to further extend the concept of inverse probability, providing examples of how traditional missing-observation countermeasures can be included in this more general picture. The effectiveness of the different models and weighting schemes discussed in this work is demonstrated using realisations of an idealised simple survey strategy.

Likelihood fitting to two-point clustering statistics made from galaxy surveys usually assumes a multivariate normal distribution for the measurements, with justification based on the central limit theorem given the large number of overdensity modes. However, this assumption cannot hold on the largest scales where the number of modes is low. Whilst more accurate distributions have previously been developed in idealized cases, we derive a procedure suitable for analysing measured monopole power spectra with window effects, stochastic shot noise, and the dependence of the covariance matrix on the model being fitted all taken into account. A data transformation is proposed to give an approximately Gaussian likelihood, with a variance--correlation decomposition of the covariance matrix to account for its cosmological dependence. By comparing with the modified-$t$ likelihood derived under the usual normality assumption, we find in numerical tests that our new procedure gives more accurate constraints on the local non-Gaussianity parameter $f_\mathrm{NL}$, which is sensitive to the large-scale power. A simple data analysis pipeline is provided for straightforward application of this new approach in preparation for forthcoming large galaxy surveys such as DESI and Euclid.

The Dark Energy Spectroscopic Instrument (DESI) Bright Galaxy Survey (BGS) will be a survey of bright, low redshift galaxies, which is planned to cover an area of ~14,000 sq deg in 3 passes. Each pass will cover the survey area with ~2000 pointings, each of area ~8 sq deg. The BGS is currently proposed to consist of a bright high priority sample to an r-band magnitude limit r ~ 19.5, with a fainter low priority sample to r ~ 20. The geometry of the DESI fibre positioners in the focal plane of the telescope affects the completeness of the survey, and has a non-trivial impact on clustering measurements. Using a BGS mock catalogue, we show that completeness due to fibre assignment primarily depends on the surface density of galaxies. Completeness is high (>95%) in low density regions, but very low (<10%) in the centre of massive clusters. We apply the pair inverse probability (PIP) weighting correction to clustering measurements from a BGS mock which has been through the fibre assignment algorithm. This method is only unbiased if it is possible to observe every galaxy pair. To facilitate this, we randomly promote a small fraction of the fainter sample to be high priority, and dither the set of tile positions by a small angle. We show that inverse pair weighting combined with angular upweighting provides an unbiased correction to galaxy clustering measurements for the complete 3 pass survey, and also after 1 pass, which is highly incomplete.

The Emission Line Galaxy survey made by the Dark Energy Spectroscopic Instrument (DESI) survey will be created from five passes of the instrument on the sky. On each pass, the constrained mobility of the ends of the fibres in the DESI focal plane means that the angular-distribution of targets that can be observed is limited. Thus, the clustering of samples constructed using a limited number of passes will be strongly affected by missing targets. In two recent papers, we showed how the effect of missing galaxies can be corrected when calculating the correlation function using a weighting scheme for pairs. Using mock galaxy catalogues we now show that this method provides an unbiased estimator of the true correlation function for the DESI survey after any number of passes. We use multiple mocks to determine the expected errors given one to four passes, compared to an idealised survey observing an equivalent number of randomly selected targets. On BAO scales, we find that the error is a factor 2 worse after one pass, but that after three or more passes, the errors are very similar. Thus we find that the fibre assignment strategy enforced by the design of DESI will not affect the cosmological measurements to be made by the survey, and can be removed as a potential risk for this experiment.

The VIPERS galaxy survey has measured the clustering of $0.5<z<1.2$ galaxies, enabling a number of measurements of galaxy properties and cosmological redshift-space distortions (RSD). Because the measurements were made using one-pass of the VIMOS instrument on the Very Large Telescope (VLT), the galaxies observed only represent approximately 47\% of the parent target sample, with a distribution imprinted with the pattern of the VIMOS slitmask. Correcting for the effect on clustering has previously been achieved using an approximate approach developed using mock catalogues. Pairwise inverse probability (PIP) weighting has recently been proposed by Bianchi & Percival to correct for missing galaxies, and we apply it to mock VIPERS catalogues to show that it accurately corrects the clustering for the VIMOS effects, matching the clustering measured from the observed sample to that of the parent. We then apply PIP-weighting to the VIPERS data, and fit the resulting monopole and quadrupole moments of the galaxy two-point correlation function with respect to the line-of-sight, making measurements of RSD. The results are close to previous measurements, showing that the previous approximate methods used by the VIPERS team are sufficient given the errors obtained on the RSD parameter.

Galaxy redshift surveys are one of the pillars of the current standard cosmological model and remain a key tool in the experimental effort to understand the origin of cosmic acceleration. To this end, the next generation of surveys aim at achieving sub-percent precision in the measurement of the equation of state of dark energy $w(z)$ and the growth rate of structure $f(z)$. This however requires comparable control over systematic errors, stressing the need for improved modelling methods. In this contribution we review at the introductory level some highlights of the work done in this direction by the {\it Darklight} project. Supported by an ERC Advanced Grant, {\it Darklight} developed novel techniques for clustering analysis, which were tested through numerical simulations before being finally applied to galaxy data as in particular those of the recently completed VIPERS redshift survey. We focus in particular on: (a) advances on estimating the growth rate of structure from redshift-space distortions; (b) parameter estimation through global Bayesian reconstruction of the density field from survey data; (c) impact of massive neutrinos on large-scale structure measurements. Overall, {\it Darklight} has contributed to paving the way for forthcoming high-precision experiments, such as {\it Euclid}, the next ESA cosmological mission.

In order to be efficient, spectroscopic galaxy redshift surveys do not obtain redshifts for all galaxies in the population targeted. The missing galaxies are often clustered, commonly leading to a lower proportion of successful observations in dense regions. One example is the close-pair issue for SDSS spectroscopic galaxy surveys, which have a deficit of pairs of observed galaxies with angular separation closer than the hardware limit on placing neighbouring fibers. Spatially clustered missing observations will exist in the next generations of surveys. Various schemes have previously been suggested to mitigate these effects, but none works for all situations. We argue that the solution is to link the missing galaxies to those observed with statistically equivalent clustering properties, and that the best way to do this is to rerun the targeting algorithm, varying the angular position of the observations. Provided that every pair has a non-zero probability of being observed in one realisation of the algorithm, then a pair-upweighting scheme linking targets to successful observations, can correct these issues. We present such a scheme, and demonstrate its validity using realisations of an idealised simple survey strategy.

Three dimensional galaxy clustering measurements provide a wealth of cosmological information. However, obtaining spectra of galaxies is expensive, and surveys often only measure redshifts for a subsample of a target galaxy population. Provided that the spectroscopic data is representative, we argue that angular pair upweighting should be used in these situations to improve the 3D clustering measurements. We present a toy model showing mathematically how such a weighting can improve measurements, and provide a practical example of its application using mocks created for the Baryon Oscillation Spectroscopic Survey (BOSS). Our analysis of mocks suggests that, if an angular clustering measurement is available over twice the area covered spectroscopically, weighting gives a $\sim$10-20% reduction of the variance of the monopole correlation function on the BAO scale.

We develop a model for the redshift-space correlation function, valid for both dark matter particles and halos on scales $>5\,h^{-1}$Mpc. In its simplest formulation, the model requires the knowledge of the first three moments of the line-of-sight pairwise velocity distribution plus two well-defined dimensionless parameters. The model is obtained by extending the Gaussian-Gaussianity prescription for the velocity distribution, developed in a previous paper, to a more general concept allowing for local skewness, which is required to match simulations. We compare the model with the well known Gaussian streaming model and the more recent Edgeworth streaming model. Using N-body simulations as a reference, we show that our model gives a precise description of the redshift-space clustering over a wider range of scales. We do not discuss the theoretical prescription for the evaluation of the velocity moments, leaving this topic to further investigation.

We investigate the use of the cross-correlation between galaxies and galaxy groups to measure redshift-space distortions (RSD) and thus probe the growth rate of cosmological structure. This is compared to the classical approach based on using galaxy auto-correlation. We make use of realistic simulated galaxy catalogues that have been constructed by populating simulated dark matter haloes with galaxies through halo occupation prescriptions. We adapt the classical RSD dispersion model to the case of the group-galaxy cross-correlation function and estimate the RSD parameter $\beta$ by fitting both the full anisotropic correlation function $\xi(r_p,\pi)$ and its multipole moments. In addition, we define a modified version of the latter statistics by truncating the multipole moments to exclude strongly non-linear distortions at small transverse scales. We fit these three observable quantities in our set of simulated galaxy catalogues and estimate statistical and systematic errors on $\beta$ for the case of galaxy-galaxy, group-group, and group-galaxy correlation functions. When ignoring off-diagonal elements of the covariance matrix in the fitting, the truncated multipole moments of the group-galaxy cross-correlation function provide the most accurate estimate, with systematic errors below 3% when fitting transverse scales larger than $10Mpc/h$. Including the full data covariance enlarges statistical errors but keep unchanged the level of systematic error. Although statistical errors are generally larger for groups, the use of group-galaxy cross-correlation can potentially allow the reduction of systematics while using simple linear or dispersion models.

Observed galaxy clustering exhibits local transverse statistical isotropy around the line-of-sight (LOS). The variation of the LOS across a galaxy survey complicates the measurement of the observed clustering as a function of the angle to the LOS, as fast Fourier transforms (FFTs) based on Cartesian grids, cannot individually allow for this. Recent advances in methodology for calculating LOS-dependent clustering in Fourier space include the realization that power spectrum LOS-dependent moments can be constructed from sums over galaxies, based on approximating the LOS to each pair of galaxies by the LOS to one of them. We show that we can implement this method using multiple FFTs, each measuring the LOS-weighted clustering along different axes. The N log(N) nature of FFTs means that the computational speed-up is a factor of >1000 compared with summing over galaxies. This development should be beneficial for future projects such as DESI and Euclid which will provide an order of magnitude more galaxies than current surveys.

Among the possible alternatives to the standard cosmological model ($\Lambda$CDM), coupled Dark Energy models postulate that Dark Energy (DE), seen as a dynamical scalar field, may interact with Dark Matter (DM), giving rise to a "fifth-force", felt by DM particles only. In this paper, we study the impact of these cosmologies on the statistical properties of galaxy populations by combining high-resolution numerical simulations with semi-analytic models (SAM) of galaxy formation and evolution. New features have been implemented in the reference SAM in order to have it run self-consistently and calibrated on these cosmological simulations. They include an appropriate modification of the mass temperature relation and of the baryon fraction in DM haloes, due to the different virial scalings and to the gravitational bias, respectively. Our results show that the predictions of our coupled-DE SAM do not differ significantly from theoretical predictions obtained with standard SAMs applied to a reference $\Lambda$CDM simulation, implying that the statistical properties of galaxies provide only a weak probe for these alternative cosmological models. On the other hand, we show that both galaxy bias and the galaxy pairwise velocity distribution are sensitive to coupled DE models: this implies that these probes might be successfully applied to disentangle among quintessence, $f(R)$-Gravity and coupled DE models.

As a step towards a more accurate modelling of redshift-space distortions in galaxy surveys, we develop a general description of the probability distribution function of galaxy pairwise velocities within the framework of the so-called streaming model. For a given galaxy separation $\vec{r}$, such function can be described as a superposition of virtually infinite local distributions. We characterize these in terms of their moments and then consider the specific case in which they are Gaussian functions, each with its own mean $\mu$ and dispersion $\sigma$. Based on physical considerations, we make the further crucial assumption that these two parameters are in turn distributed according to a bivariate Gaussian, with its own mean and covariance matrix. Tests using numerical simulations explicitly show that with this compact description one can correctly model redshift-space distorsions on all scales, fully capturing the overall linear and nonlinear dynamics of the galaxy flow at different separations. In particular, we naturally obtain Gaussian/exponential, skewed/unskewed distribution functions, depending on separation as observed in simulations and data. Also, the recently proposed single-Gaussian description of redshift-space distortions is included in this model as a limiting case, when the bivariate Gaussian is collapsed to a two-dimensional Dirac delta function. We also show how this description naturally allows for the Taylor expansion of $1+\xi_S(\vec{s})$ around $1+\xi_R(r)$, which leads to the Kaiser linear formula when truncated to second order, expliciting its connection with the moments of the velocity distribution functions. More work is needed, but these results indicate a very promising path to make definitive progress in our program to improve RSD estimators.

The constraints on neutrino masses led to the revision of their cosmological role, since the existence of a cosmological neutrino background is a clear prediction of the standard cosmological model. In this paper, we study the impact of such background on the spatial distribution of both Dark Matter (DM) and galaxies, by coupling $N$-body numerical simulations with semi-analytic models (SAMs) of galaxy formation. Cosmological simulations including massive neutrinos predict a slower evolution of DM perturbations with respect to the $\Lambda$CDM runs with the same initial conditions and a suppression on the matter power spectrum on small and intermediate scales, thus impacting on the predicted properties of galaxy populations. We explicitly show that most of these deviations are driven by the different $\sigma_8$ predicted for cosmologies including a massive neutrino background. We conclude that independent estimates of $\sigma_8$ are needed, in order to unambiguously characterise the effect of this background on the growth of structures. Galaxy properties alone are a weak tracer of deviations with respect to the $\Lambda$CDM run, but their combination with the overall matter distribution at all scales allows to disentangle between different cosmological models. Moreover, these deviations go on opposite direction with respect to competing models like modified gravity, thus weakening any detectable cosmological signal. Given the ubiquitous presence of a neutrino background, these effects have to be taken into account in future missions aimed at constraining the properties of the "Dark" components of the Universe.

Modifications of the equations of general relativity at large distances offer one possibility to explain the observed properties of our Universe without invoking a cosmological constant. Numerous proposals for such modified gravity cosmologies exist, but often their consequences for structure formation in the non-linear sector are not yet accurately known. In this work, we employ high-resolution numerical simulations of f(R)-gravity models coupled with a semi-analytic model (SAM) for galaxy formation to obtain detailed predictions for the evolution of galaxy properties. The f(R)-gravity models imply the existence of a `fifth-force', which is however locally suppressed, preserving the successes of general relativity on solar system scales. We show that dark matter haloes in f(R)-gravity models are characterized by a modified virial scaling with respect to the LCDM scenario, reflecting a higher dark matter velocity dispersion at a given mass. This effect is taken into account in the SAM by an appropriate modification of the mass--temperature relation. We find that the statistical properties predicted for galaxies (such as the stellar mass function and the cosmic star formation rate) in f(R)-gravity show generally only very small differences relative to LCDM, smaller than the dispersion between the results of different SAM models, which can be viewed as a measure of their systematic uncertainty. We also demonstrate that galaxy bias is not able to disentangle between f(R)-gravity and the standard cosmological scenario. However, f(R)-gravity imprints modifications in the linear growth rate of cosmic structures at large scale, which can be recovered from the statistical properties of large galaxy samples.

We investigate the impact of statistical and systematic errors on measurements of linear redshift-space distortions (RSD) in future cosmological surveys, analyzing large catalogues of dark-matter halos from the BASICC simulation. These allow us to estimate the dependence of errors on typical survey properties, as volume, galaxy density and mass (i.e. bias factor) of the adopted tracer. We find that measures of the specific growth rate \beta=f/b using the Hamilton/Kaiser harmonic expansion of the redshift-space correlation function \xi(r_p,\pi) on scales larger than 3/h Mpc are typically under-estimated by up to 10% for galaxy sized halos. This is significantly larger than the corresponding statistical errors, which amount to a few percent, indicating the importance of non-linear improvements to the Kaiser model to obtain accurate measurements of the growth rate. We compare the statistical errors to predictions obtained with the Fisher information matrix, based on the usual FKP prescription for the errors on the power spectrum. We show that this produces parameter errors fairly similar to the standard deviations from the halo catalogues, but only if applied to strictly linear scales in Fourier space (k<0.2 h/Mpc). Finally, we present an accurate scaling formula describing the relative error on {\beta} as a function of the survey parameters, which closely matches the simulation results in all explored regimes. This provides a handy and plausibly more realistic alternative to the Fisher matrix approach, to quickly and accurately predict RSD statistical errors expected from future surveys.

We investigate the impact of different observational effects affecting a precise and accurate measurement of the growth rate of fluctuations from the anisotropy of clustering in galaxy redshift surveys. We focus on redshift measurement errors, on the reconstruction of the underlying real-space clustering and on the apparent degeneracy existing with the geometrical distortions induced by the cosmology-dependent conversion of redshifts into distances. We use a suite of mock catalogues extracted from large N-body simulations, focusing on the analysis of intermediate, mildly non-linear scales and apply the standard linear dispersion model to fit the anisotropy of the observed correlation function. We verify that redshift errors up to ~0.2% have a negligible impact on the precision with which the specific growth rate beta can be measured. Larger redshift errors introduce a positive systematic error, which can be alleviated by adopting a Gaussian distribution function of pairwise velocities. This is, in any case, smaller than the systematic error of up to 10% due to the limitations of the linear dispersion model, which is studied in a separate paper. We then show that 50% of the statistical error budget on beta depends on the deprojection procedure through which the real-space correlation function is obtained. Finally, we demonstrate that the degeneracy with geometric distortions can in fact be circumvented. This is obtained through a modified version of the Alcock-Paczynski test in redshift-space, which successfully recovers the correct cosmology by searching for the solution that optimizes the description of dynamical redshift distortions. For a flat cosmology, we obtain largely independent, robust constraints on beta and OmegaM. In a volume of 2.4(Gpc/h)^3, the correct OmegaM is obtained with ~12% error and negligible bias, once the real-space correlation function is properly reconstructed.

Euclid is a space-based survey mission from the European Space Agency designed to understand the origin of the Universe's accelerating expansion. It will use cosmological probes to investigate the nature of dark energy, dark matter and gravity by tracking their observational signatures on the geometry of the universe and on the cosmic history of structure formation. The mission is optimised for two independent primary cosmological probes: Weak gravitational Lensing (WL) and Baryonic Acoustic Oscillations (BAO). The Euclid payload consists of a 1.2 m Korsch telescope designed to provide a large field of view. It carries two instruments with a common field-of-view of ~0.54 deg2: the visual imager (VIS) and the near infrared instrument (NISP) which contains a slitless spectrometer and a three bands photometer. The Euclid wide survey will cover 15,000 deg2 of the extragalactic sky and is complemented by two 20 deg2 deep fields. For WL, Euclid measures the shapes of 30-40 resolved galaxies per arcmin2 in one broad visible R+I+Z band (550-920 nm). The photometric redshifts for these galaxies reach a precision of dz/(1+z) < 0.05. They are derived from three additional Euclid NIR bands (Y, J, H in the range 0.92-2.0 micron), complemented by ground based photometry in visible bands derived from public data or through engaged collaborations. The BAO are determined from a spectroscopic survey with a redshift accuracy dz/(1+z) =0.001. The slitless spectrometer, with spectral resolution ~250, predominantly detects Ha emission line galaxies. Euclid is a Medium Class mission of the ESA Cosmic Vision 2015-2025 programme, with a foreseen launch date in 2019. This report (also known as the Euclid Red Book) describes the outcome of the Phase A study.