High resolution spectroscopy (HRS) has been used to detect a number of species in the atmospheres of hot Jupiters. Key to such detections is accurately and precisely modelled spectra for cross-correlation against the R$\gtrsim$20,000 observations. There is a need for the latest generation of opacities which form the basis for high signal-to-noise detections using such spectra. In this study we present and make publicly available cross sections for six molecular species, H$_2$O, CO, HCN, CH$_4$, NH$_3$ and CO$_2$ using the latest line lists most suitable for low- and high-resolution spectroscopy. We focus on the infrared (0.95-5~$\mu$m) and between 500-1500~K where these species have strong spectral signatures. We generate these cross sections on a grid of pressures and temperatures typical for the photospheres of super Earth, warm Neptunes and hot Jupiters using the latest H$_2$ and He pressure broadening. We highlight the most prominent infrared spectral features by modelling three representative exoplanets, GJ~1214~b, GJ~3470~b and HD~189733~b, which encompass a wide range in temperature, mass and radii. In addition, we verify the line lists for H$_2$O, CO and HCN with previous high resolution observations of hot Jupiters. However, we are unable to detect CH$_4$ with our new cross sections from HRS observations of HD~102195~b. These high accuracy opacities are critical for atmospheric detections with HRS and will be continually updated as new data becomes available.

A new hot line list for $^{14}$NH$_3$ is presented. The line list CoYuTe was constructed using an accurate, empirically refined potential energy surface and a CCSD(T)/aug-cc-pVQZ ab initio dipole moment surface of ammonia, previously reported. The line list is an improvement of the ammonia line list BYTe [Yurchenko et al., Mon. Not. R. Astron. Soc., 413, 1828 (2011)]. The CoYuTe line list covers wavenumbers up to 20000 cm$^{-1}$, i.e. wavelengths beyond 0.5 $\mu$m for temperatures up to 1500 K. Comparisons with the high temperature experimental data from the literature show excellent agrement for wavenumbers below 6000 cm$^{-1}$. The CoYuTe line list contains 16.9 billion transitions and is available from the ExoMol website (www.exomol.com) and the CDS database.

Calculations are reported on the rotation-vibration energy levels of the arsine molecule with associated transition intensities. A potential energy surface (PES) obtained from \textit{ab initio} electronic structure calculations is refined to experimental data, and the resulting energy levels display sub-wavenumber accuracy for all reliably known $J=0$ term values under 6500 cm$^{-1}$. After a small empirical adjustment of the band centres, our calculated ($J=1-6$) rovibrational states reproduce 578 experimentally derived energies with a root-mean-square error of 0.122 cm$^{-1}$. Absolute line intensities are computed using the refined PES and a new dipole moment surface (DMS) for transitions between states with energies up to 10~500 cm$^{-1}$ and rotational quantum number $J=30$. The computed DMS reproduces experimental line intensities to within 10\% uncertainty for the $\nu_1$ and $\nu_3$ bands. Furthermore, our calculated absorption cross-sections display good agreement with the main absorption features recorded in Pacific Northwest National Laboratory (PNNL) for the complete range of $600-6500$ cm$^{-1}$.

An analysis of currently available ammonia (NH$_3$) visible-to-near-infrared gas absorption data was recently undertaken by Irwin et al. (Icarus, 302 (2018) 426) to help interpret Very Large Telescope (VLT) MUSE observations of Jupiter from 0.48 - 0.93 $\mu$m, made in support of the NASA/Juno mission. Since this analysis a newly revised set of ammonia line data, covering the previously poorly constrained range 0.5 - 0.833 $\mu$m, has been released by the ExoMol project, "C2018" (Coles et al., JQSRT 219, 199 - 122, 2018), which demonstrates significant advantages over previously available data sets, and providing for the first time complete line data for the previously poorly constrained 5520- and 6475-\AA\ bands of NH$_3$. In this paper we compare spectra calculated using the ExoMol-C2018 data set (Coles et al., JQSRT 219, 199 - 122, 2018) with spectra calculated from previous sources to demonstrate its advantages. We conclude that at the present time the ExoMol-C2018 dataset provides the most reliable ammonia absorption source for analysing low- to medium-resolution spectra of Jupiter in the visible/near-IR spectral range, but note that the data are less able to model high-resolution spectra owing to small, but significant inaccuracies in the line wavenumber estimates. This work is of significance not only for solar system planetary physics, but for future proposed observations of Jupiter-like planets orbiting other stars, such as with NASA's planned Wide-Field Infrared Survey Telescope (WFIRST).

The ExoMol database (www.exomol.com) provides extensive line lists of molecular transitions which are valid over extended temperatures ranges. The status of the current release of the database is reviewed and a new data structure is specified. This structure augments the provision of energy levels (and hence transition frequencies) and Einstein $A$ coefficients with other key properties, including lifetimes of individual states, temperature-dependent cooling functions, Land\'e $g$-factors, partition functions, cross sections, $k$-coefficients and transition dipoles with phase relations. Particular attention is paid to the treatment of pressure broadening parameters. The new data structure includes a definition file which provides the necessary information for utilities accessing ExoMol through its application programming interface (API). Prospects for the inclusion of new species into the database are discussed.

A comprehensive, hyperfine-resolved rotation-vibration line list for the ammonia molecule ($^{14}$NH$_3$) is presented. The line list, which considers hyperfine nuclear quadrupole coupling effects, has been computed using robust, first principles methodologies based on a highly accurate empirically refined potential energy surface. Transitions between levels with energies below $8000$~cm$^{-1}$ and total angular momentum $F\leq14$ are considered. The line list shows excellent agreement with a range of experimental data and will significantly assist future high-resolution measurements of NH$_3$, both astronomically and in the laboratory.

The position-dependent power spectrum has been recently proposed as a descriptor of gravitationally induced non-Gaussianity in galaxy clustering, as it is sensitive to the "soft limit" of the bispectrum (i.e. when one of the wave number tends to zero). We generalise this concept to higher order and clarify their relationship to other known statistics such as the skew-spectrum, the kurt-spectra and their real-space counterparts the cumulants correlators. Using the {\em Hierarchical Ansatz} (HA) as a toy model for the higher order correlation hierarchy, we show how in the soft limit, polyspectra at a given order can be identified with lower order polyspectra with the same geometrical dependence but with {\em renormalised} amplitudes expressed in terms of amplitudes of the original polyspectra. We extend the concept of position-dependent bispectrum to bispectrum of the divergence of the velocity field $\Theta$ and mixed multispectra involving $\delta$ and $\Theta$ in the 3D perturbative regime. To quantify the effects of transients in numerical simulations, we also present results for lowest order in Lagrangian perturbation theory (LPT) or the Zel'dovich approximation (ZA). Finally, we discuss how to extend the position-dependent spectrum concept to encompass cross-spectra. And finally study the application of this concept to two dimensions (2D), for projected galaxy maps, convergence $\kappa$ maps from weak-lensing surveys or maps of CMB secondaries e.g. the frequency cleaned $y$ - parameter maps of thermal Sunyaev-Zel'dovich (tSZ) effect from CMB surveys.

We explore the dynamical behaviour of cosmological models involving a scalar field (with an exponential potential and a canonical kinetic term) and a matter fluid with spatial curvature included in the equations of motion. Using appropriately defined parameters to describe the evolution of the scalar field energy in this situation, we find that there are two extra fixed points that are not present in the case without curvature. We also analyse the evolution of the effective equation-of-state parameter for different initial values of the curvature.

Lensing of the Cosmic Microwave Background (CMB) changes the morphology of pattern of temperature fluctuations, so topological descriptors such as Minkowski Functionals can probe the gravity model responsible for the lensing. We show how the recently introduced two-to-two and three-to-one kurt-spectra (and their associated correlation functions), which depend on the power spectrum of the lensing potential, can be used to probe modified gravity theories such as $f({R})$ theories of gravity and quintessence models. We also investigate models based on effective field theory, which include the constant-$\Omega$ model, and low-energy Ho\vrava theories. Estimates of the cumulative signal-to-noise for detection of lensing-induced morphology changes, reaches ${\cal O}(10^3)$ for the future planned CMB polarization mission COrE$^{+}$. Assuming foreground removal is possible to $\ell_{max}=3000$, we show that many modified gravity theories can be rejected with a high level of significance, making this technique comparable in power to galaxy weak lensing or redshift surveys. These topological estimators are also useful in distinguishing {\em lensing} from other scattering secondaries at the level of the four-point function or trispectrum. Examples include the kinetic Sunyaev-Zel'dovich (kSZ) effect which shares, with lensing, a lack of spectral distortion. We also discuss the complication of foreground contamination from unsubtracted point sources.

We propose a novel technique to separate the late-time, post-reionization component of the kinetic Sunyaev-Zeldovich (kSZ) effect from the contribution to it from a (poorly understood and probably patchy) reionization history. The kSZ effect is one of the most promising probe of the {\em missing baryons} in the Universe. We study the possibility of reconstructing it in three dimensions (3D), using future spectroscopic surveys such as the Euclid survey. By reconstructing a 3D template from galaxy density and peculiar velocity fields from spectroscopic surveys we cross-correlate the estimator against CMB maps. The resulting cross-correlation can help us to map out the kSZ contribution to CMB in 3D as a function of redshift thereby extending previous results which use tomographic reconstruction. This allows the separation of the late time effect from the contribution owing to reionization. By construction, it avoids contamination from foregrounds, primary CMB, tSZ effect as well as from star forming galaxies. Due to a high number density of galaxies the signal-to-noise (S/N) for such cross-correlational studies are higher, compared to the studies involving CMB power spectrum analysis. Using a spherical Bessel-Fourier (sFB) transform we introduce a pair of 3D power-spectra: ${\cal C}^{\parallel}_\ell(k)$ and ${\cal C}^{\perp}_\ell(k)$ that can be used for this purpose. We find that in a future spectroscopic survey with near all-sky coverage and a survey depth of $z\approx 1$, reconstruction of ${\cal C}^{\perp}_\ell(k)$ can be achieved in a few radial wave bands $k\approx(0.01-0.5 h^{-1}\rm Mpc)$ with a S/N of upto ${\cal O}(10)$ for angular harmonics in the range $\ell=(200-2000)$ (abrdiged).

We study Modified Gravity (MG) theories by modelling the redshifted matter power spectrum in a spherical Fourier-Bessel (sFB) basis. We use a fully non-linear description of the real-space matter power-spectrum and include the lowest-order redshift-space correction (Kaiser effect), taking into account some additional non-linear contributions. Ignoring relativistic corrections, which are not expected to play an important role for a shallow survey, we analyse two different modified gravity scenarios, namely the generalised Dilaton scalar-tensor theories and the $f({R})$ models in the large curvature regime. We compute the 3D power spectrum ${\cal C}^s_{\ell}(k_1,k_2)$ for various such MG theories with and without redshift space distortions, assuming precise knowledge of background cosmological parameters. Using an all-sky spectroscopic survey with Gaussian selection function $\varphi(r)\propto \exp(-{r^2 / r^2_0})$, $r_0 = 150 \, h^{-1} \, {\textrm{Mpc}}$, and number density of galaxies $\bar {\textrm{N}} =10^{-4}\;{\textrm{Mpc}}^{-3}$, we use a $\chi^2$ analysis, and find that the lower-order $(\ell \leq 25)$ multipoles of ${\cal C}^s_\ell(k,k')$ (with radial modes restricted to $k < 0.2 \, h \,{\textrm{Mpc}}^{-1}$) can constraint the parameter $f_{R_0}$ at a level of $2\times 10^{-5} (3\times 10^{-5})$ with $3 \sigma$ confidence for $n=1(2)$. Combining constraints from higher $\ell > 25$ modes can further reduce the error bars and thus in principle make cosmological gravity constraints competitive with solar system tests. However this will require an accurate modelling of non-linear redshift space distortions. Using a tomographic $\beta(a)$-$m(a)$ parameterization we also derive constraints on specific parameters describing the Dilaton models of modified gravity.

We use the cosmic shear data from the Canada-France-Hawaii Telescope Lensing Survey to place constraints on $f(R)$ and {\it Generalized Dilaton} models of modified gravity. This is highly complimentary to other probes since the constraints mainly come from the non-linear scales: maximal deviations with respects to the General-Relativity + $\Lambda$CDM scenario occurs at $k\sim1 h \mbox{Mpc}^{-1}$. At these scales, it becomes necessary to account for known degeneracies with baryon feedback and massive neutrinos, hence we place constraints jointly on these three physical effects. To achieve this, we formulate these modified gravity theories within a common tomographic parameterization, we compute their impact on the clustering properties relative to a GR universe, and propagate the observed modifications into the weak lensing $\xi_{\pm}$ quantity. Confronted against the cosmic shear data, we reject the $f(R)$ $\{ |f_{R_0}|=10^{-4}, n=1\}$ model with more than 99.9% confidence interval (CI) when assuming a $\Lambda$CDM dark matter only model. In the presence of baryonic feedback processes and massive neutrinos with total mass up to 0.2eV, the model is disfavoured with at least 94% CI in all different combinations studied. Constraints on the $\{ |f_{R_0}|=10^{-4}, n=2\}$ model are weaker, but nevertheless disfavoured with at least 89% CI. We identify several specific combinations of neutrino mass, baryon feedback and $f(R)$ or Dilaton gravity models that are excluded by the current cosmic shear data. Notably, universes with three massless neutrinos and no baryon feedback are strongly disfavoured in all modified gravity scenarios studied. These results indicate that competitive constraints may be achieved with future cosmic shear data.

We show how cross-correlating a high redshift external tracer field, such as the 21cm neutral hydrogen distribution and product maps involving Cosmic Microwave Background (CMB) temperature and polarisation fields, that probe mixed bispectrum involving these fields, can help to determine the reionization history of the Universe, beyond what can be achieved from cross-spectrum analysis. Taking clues from recent studies for the detection of primordial non-Gaussianity (Munshi & Heavens 2010), we develop a set of estimators that can study reionization using a power spectrum associated with the bispectrum (or skew-spectrum). We use the matched filtering inherent in this method to investigate different reionization histories. We check to what extent they can be used to rule out various models of reionization and study cross contamination from different sources such as the lensing of the CMB. The estimators can be fine-tuned to optimize study of a specific reionization history. We consider three different types of tracers in our study, namely: proto-galaxies; 21cm maps of neutral hydrogen; quasars. We also consider four alternative models of reionization. We find that the cumulative signal-to-noise (S/N) for detection at $\ell_{max}=2000$ can reach $\mathcal{O}(70)$ for cosmic variance limited all-sky experiments. Combining 100GHz, 143GHz and 217GHz channels of the Planck experiment, we find that the (S/N) lies in the range $\mathcal{O}(5)-\mathcal{O}(35)$. The (S/N) depends on the specific choice of a tracer field, and multiple tracers can be effectively used to map out the entire reionization history with reasonable S/N. Contamination from weak lensing is investigated and found to be negligible, and the effects of Thomson scattering from patchy reionizationare also considered.

We use the optimised skew-spectrum as well as the skew-spectra associated with the Minkowski Functionals (MFs) to test the possibility of using the cross-correlation of the Integrated Sachs-Wolfe effect (ISW) and lensing of the cosmic microwave background (CMB) radiation to detect deviations in the theory of gravity away from General Relativity (GR). We find that the although both statistics can put constraints on modified gravity, the optimised skew-spectra are especially sensitive to the parameter $\rm B_0$ that denotes the the {\em Compton wavelength} of the scalaron at the present epoch. We investigate three modified gravity theories, namely: the Post-Parametrised Friedmanian (PPF) formalism; the Hu-Sawicki (HS) model; and the Bertschinger-Zukin (BZ) formalism. Employing a likelihood analysis for an experimental setup similar to ESA's Planck mission, we find that, assuming GR to be the correct model, we expect the constraints from the first two skew-spectra, $S_{\ell}^{(0)}$ and $S_{\ell}^{(1)}$, to be the same: $\rm B_0<0.45$ at $95%$ confidence level (CL), and $\rm B_0<0.67$ at $99%$ CL in the BZ model. The third skew-spectrum does not give any meaningful constraint. We find that the optimal skew-spectrum provides much more powerful constraint, giving $\rm B_0<0.071$ at $95%$ CL and $\rm B_0<0.15$ at $99%$ CL, which is essentially identical to what can be achieved using the full bispectrum.

We present novel statistical tools to cross-correlate frequency cleaned thermal Sunyaev-Zel'dovich (tSZ) maps and tomographic weak lensing (wl) convergence maps. Moving beyond the lowest order cross-correlation, we introduce a hierarchy of mixed higher-order statistics, the cumulants and cumulant correlators, to analyze non-Gaussianity in real space, as well as corresponding polyspectra in the harmonic domain. Using these moments, we derive analytical expressions for the joint two-point probability distribution function (2PDF) for smoothed tSZ (y_s) and convergence (\kappa_s) maps. The presence of tomographic information allows us to study the evolution of higher order {\em mixed} tSZ-weak lensing statistics with redshift. We express the joint PDFs p_{\kappa y}(\kappa_s,y_s) in terms of individual one-point PDFs (p_{\kappa}(\kappa_s), p_y(y_s)) and the relevant bias functions (b_{\kappa}(\kappa_s), b_y(y_s)). Analytical results for two different regimes are presented that correspond to the small and large angular smoothing scales. Results are also obtained for corresponding {\em hot spots} in the tSZ and convergence maps. In addition to results based on hierarchical techniques and perturbative methods, we present results of calculations based on the lognormal approximation. The analytical expressions derived here are generic and applicable to cross-correlation studies of arbitrary tracers of large scale structure including e.g. that of tSZ and soft X-ray background.

Motivated by recent suggestions that a number of observed galaxy clusters have masses which are too high for their given redshift to occur naturally in a standard model cosmology, we use Extreme Value Statistics to construct confidence regions in the mass-redshift plane for the most extreme objects expected in the universe. We show how such a diagram not only provides a way of potentially ruling out the concordance cosmology, but also allows us to differentiate between alternative models of enhanced structure formation. We compare our theoretical prediction with observations, placing currently observed high and low redshift clusters on a mass-redshift diagram and find -- provided we consider the full sky to avoid a posteriori selection effects -- that none are in significant tension with concordance cosmology.

We generalize the concept of the ordinary skew-spectrum to probe the effect of non-Gaussianity on the morphology of Cosmic Microwave Background (CMB) maps in several domains: in real-space (where they are commonly known as cumulant-correlators), and in harmonic and needlet bases. The essential aim is to retain more information than normally contained in these statistics, in order to assist in determining the source of any measured non-Gaussianity, in the same spirit as Munshi & Heavens (2010) skew-spectra were used to identify foreground contaminants to the CMB bispectrum in Planck data. Using a perturbative series to construct the Minkowski Functionals (MFs), we provide a pseudo-Cl based approach in both harmonic and needlet representations to estimate these spectra in the presence of a mask and inhomogeneous noise. Assuming homogeneous noise we present approx- imate expressions for error covariance for the purpose of joint estimation of these spectra. We present specific results for four different models of primordial non-Gaussianity local, equilateral, orthogonal and enfolded models, as well as non-Gaussianity caused by unsubtracted point sources. Closed form results of next-order corrections to MFs too are obtained in terms of a quadruplet of kurt-spectra. We also use the method of modal decomposition of the bispectrum and trispectrum to reconstruct the MFs as an alternative method of reconstruction of morphological properties of CMB maps. Finally, we introduce the odd-parity skew-spectra to probe the odd-parity bispectrum and its impact on the morphology of the CMB sky. Although developed for the CMB, the generic results obtained here can be useful in other areas of cosmology.

At high angular frequencies, beyond the damping tail of the primary power spectrum, the dominant contribution to the power spectrum of cosmic microwave background (CMB) temperature fluctuations is the thermal Sunyaev-Zel'dovich (tSZ) effect. We investigate various important statistical properties of the Sunyaev-Zel'dovich maps, using well-motivated models for dark matter clustering to construct statistical descriptions of the tSZ effect to all orders enabling us to determine the entire probability distribution function (PDF). Any generic deterministic biasing scheme can be incorporated in our analysis and the effects of projection, biasing and the underlying density distribution can be analysed separately and transparently in this approach. We introduce the cumulant correlators as tools to analyse tSZ catalogs and relate them to corresponding statistical descriptors of the underlying density distribution. The statistics of hot spots in frequency-cleaned tSZ maps are also developed in a self-consistent way to an arbitrary order, to obtain results complementary to those found using the halo model. We also consider different beam sizes, to check the extent to which the PDF can be extracted from various observational configurations. The formalism is presented with two specific models for underlying matter clustering: (1) the hierarchical ansatz; and (2) the lognormal distribution. We find both models to be in very good agreement with the simulation results, though the lognormal model has an edge over the hierarchical model.

Secondary contributions to the anisotropy of the Cosmic Microwave Background (CMB), such as the integrated Sachs-Wolfe (ISW) effect, the thermal Sunyaev-Zel'dovich effect (tSZ), and the effect of gravitational lensing, have distinctive non-Gaussian signatures, and full descriptions therefore require information beyond that contained in their power spectra. In this paper we use the recently introduced skew-spectra associated with the Minkowski Functionals (MF) to probe the topology of CMB maps to probe the secondary non-Gaussianity as a function of beam-smoothing in order to separate various contributions. We devise estimators for these spectra in the presence of a realistic observational masks and present expressions for their covariance as a function of instrumental noise. Specific results are derived for the mixed ISW-lensing and tSZ-lensing bispectra as well as contamination due to point sources for noise levels that correspond to the Planck (143 GHz channel) and EPIC (150 GHz channel) experiments. The cumulative signal to noise ration $S/N$ for one-point generalized skewness-parameters can reach an order of ${\cal O}(10)$ for Planck and two orders of magnitude higher for EPIC, i.e. ${\cal O}(10^3)$. We also find that these three spectra skew-spectra are correlated, having correlation coefficients $r \sim 0.5-1.0$; higher $l$ modes are more strongly correlated. Though the values of $S/N$ increase with decreasing noise, the triplets of skew-spectra that determine the MFs bcome more correlated; the $S/N$ ratios of lensing-induced skew-spectra are smaller compared to that of a frequency-cleaned tSZ map.

The identification of strong gravitational lenses in large surveys has historically been a rather time consuming exercise. Early data from the Herschel Astrophysical Terahertz Large Area Survey (Herschel-ATLAS) demonstrate that lenses can be identified efficiently at submillimetre wavelengths using a simple flux criteria. Motivated by that development, this work considers the statistical properties of strong gravitational lens systems which have been, and will be, found by the Herschel-ATLAS. Analytical models of lens statistics are tested with the current best estimates for the various model ingredients. These include the cosmological parameters, the mass function and the lens density profile, for which we consider the singular isothermal sphere (SIS) and the Navarro, Frenk & White (NFW) approximations. The five lenses identified in the Herschel-ATLAS Science Demonstration Phase suggest a SIS density profile is preferred, but cannot yet constrain \Omega_\Lambda to an accuracy comparable with other methods. The complete Herschel-ATLAS data set should be sufficient to yield competitive constraints on \Omega_\Lambda. Whilst this huge number of lenses has great potential for constraining cosmological parameters, they will be most powerful in constraining uncertainty in astrophysical processes. Further investigation is needed to fully exploit this unprecedented data set.

We study the effect of the non-Gaussianity induced by gravitational evolution upon the statistical properties of absorption in quasar (QSO) spectra. Using the generic hierarchical ansatz and the lognormal approximation we derive the analytical expressions for the one-point PDF as well as for the joint two-point probability distribution (2PDF) of transmitted fluxes in two neighbouring QSOs. These flux PDFs are constructed in 3D as well as in projection (i.e. in 2D). The PDFs are constructed by relating the lower-order moments, i.e. cumulants and cumulant correlators, of the fluxes to the 3D neutral hydrogen distribution which is, in turn, expressed as a function of the underlying dark matter distribution. The lower-order moments are next modelled using a generating function formalism in the context of a {\em minimal tree-model} for the higher-order correlation hierarchy. These different approximations give nearly identical results for the range of redshifts probed, and we also find a very good agreement between our predictions and outputs of hydrodynamical simulations. The formalism developed here for the joint statistics of flux-decrements concerning two lines of sight can be extended to multiple lines of sight, which could be particularly important for the 3D reconstruction of the cosmic web from QSO spectra (e.g. in the BOSS survey). These statistics probe the underlying projected neutral hydrogen field and are thus linked to "hot-spots" of absorption. The results for the PDF and the bias presented here use the same functional forms of scaling functions that have previously been employed for the modelling of other cosmological observation such as the Sunyaev-Zel'dovich effect.

Extending previous studies, we derive generic predictions for lower order cumulants and their correlators for individual tomographic bins as well as between two different bins. We derive the corresponding one- and two-point joint probability distribution function for the tomographic convergence maps from different bins as a function of angular smoothing scale. The modelling of weak lensing statistics is obtained by adopting a detailed prescription for the underlying density contrast. In this paper we concentrate on the convergence field $\kappa$ and use top-hat filter; though the techniques presented can readily be extended to model the PDF of shear components or to include other windows such as the compensated filter. The functional form for the underlying PDF and bias is modelled in terms of the non-linear or the quasilinear form depending on the smoothing angular scale. Results from other semi-analytical models e.g. the lognormal distribution are also presented. Introducing a reduced convergence for individual bins, we are able to show that the tomographic PDFs and bias for each bin sample the same functional form of the underlying PDF of density contrast but with varying variance. The joint probability distribution of the convergence maps that correspond to two different tomographic bins can be constructed from individual tomographic PDF and bias. We study their dependence on cosmological parameters for source distributions corresponding to the realistic surveys such as LSST and DES. We briefly outline how photometric redshift information can be incorporated in our computation of cumulants, cumulant correlators and the PDFs. Connection of our results to the full 3D calculations is elucidated. Analytical results for inclusion of realistic noise and finite survey size are presented in detail.

Motivated by observations that suggest the presence of extremely massive clusters at uncomfortably high redshifts for the standard cosmological model to explain, we develop a theoretical framework for the study of the most massive haloes, e.g. the most massive cluster found in a given volume, based on Extreme Value Statistics (EVS). We proceed from the exact distribution of the extreme values drawn from a known underlying distribution, rather than relying on asymptotic theory (which is independent of the underlying form), arguing that the former is much more likely to furnish robust statistical results. We illustrate this argument with a discussion of the use of extreme value statistics as a probe of primordial non-Gaussianity.

At high angular frequencies the thermal Sunyaev-Zel'dovich (tSZ) effect constitutes the dominant signal in the CMB sky. The tSZ effect is caused by large scale pressure fluctuations in the baryonic distribution in the Universe so its statistical properties provide estimates of corresponding properties of the projected 3D pressure fluctuations. It's power spectrum is a sensitive probe of the density fluctuations, and the bispectrum can be used to separate the bias associated with pressure. The bispectrum is often probed with a one-point real-space analogue, the skewness. In addition to the skewness the morphological properties, as probed by the well known Minkowski Functionals (MFs), also require the generalized one-point statistics, which at the lowest order are identical to the skewness parameters. The concept of generalized skewness parameters can be extended to define a set of three associated generalized skew-spectra. We use these skew-spectra to probe the morphology of the tSZ sky or the y-sky. We show how these power spectra can be recovered from the data in the presence of arbitrary mask and noise templates using the well known Pseudo-Cl (PCL) approach for arbitrary beam shape. We also employ an approach based on the halo model to compute the tSZ bispectrum. The bispectrum from each of these models is then used to construct the generalized skew-spectra. We consider the performance of an all-sky survey with Planck-type noise and compare the results against a noise-free ideal experiment using a range of smoothing angles. We find that the skew-spectra can be estimated with very high signal-to-noise ratio from future frequency cleaned tSZ maps that will be available from experiments such as Planck. This will allow their mode by mode estimation for a wide range of angular frequencies and will help us to differentiate them from various other sources of non-Gaussianity.

We present a new harmonic-domain approach for extracting morphological information, in the form of Minkowski Functionals (MFs), from weak lensing (WL) convergence maps. Using a perturbative expansion of the MFs, which is expected to be valid for the range of angular scales probed by most current weak-lensing surveys, we show that the study of three generalized skewness parameters is equivalent to the study of the three MFs defined in two dimensions. We then extend these skewness parameters to three associated skew-spectra which carry more information about the convergence bispectrum than their one-point counterparts. We discuss various issues such as noise and incomplete sky coverage in the context of estimation of these skew-spectra from realistic data. Our technique provides an alternative to the pixel-space approaches typically used in the estimation of MFs, and it can be particularly useful in the presence of masks with non-trivial topology. Analytical modeling of weak lensing statistics relies on an accurate modeling of the statistics of underlying density distribution. We apply three different formalisms to model the underlying dark-matter bispectrum: the hierarchical ansatz, halo model and a fitting function based on numerical simulations; MFs resulting from each of these formalisms are computed and compared. We investigate the extent to witch late-time gravity-induced non-Gaussianity (to which weak lensing is primarily sensitive) can be separated from primordial non-Gaussianity and how this separation depends on source redshift and angular scale.

The first and third year data releases from the WMAP provide evidence of an anomalous Cold Spot (CS) at galactic latitude b=-57deg and longitude l=209deg. We have examined the properties of the CS in some detail in order to assess its cosmological significance. We have performed a cluster analysis of the local extrema in the CMB signal to show that the CS is actually associated with a large group of extrema rather than just one. In the light of this we have re-examined the properties of the WMAP ILC and co-added "cleaned" WCM maps, which have previously been used for the analysis of the properties of the signal in the vicinity of the CS. These two maps have remarkably similar properties on equal latitude rings for |b|>30deg, as well as in the vicinity of the CS. We have also checked the idea that the CMB signal has a non-Gaussian tail, localized in the low multipole components of the signal. For each ring we apply a linear filter with characteristic scale R, dividing the CMB signal in two parts: the filtered part, with characteristic scale above that of the filter R, and the difference between the initial and filtered signal. Using the filter scale as a variable, we can maximize the skewness and kurtosis of the smoothed signal and minimize these statistics for the difference between initial and filtered signal. We have discovered that the shape of the CS is formed primarily by the components of the CMB signal represented by multipoles between 10<=L<=20, with a corresponding angular scale about 5-10 degs. This signal leads to modulation of the whole CMB sky, clearly seen at |b|>30deg in both the ILC and WCM maps, rather than a single localized feature. After subtraction of this modulation, the remaining part of the CMB signal appears to be consistent with statistical homogeneity and Gaussianity.

We consider the issue of characterizing the coherent large-scale patterns from CMB temperature maps in globally anisotropic cosmologies. The methods we investigate are reasonably general; the particular models we test them on are the homogeneous but anisotropic relativistic cosmologies described by the Bianchi classification. Although the temperature variations produced in these models are not stochastic, they give rise to a "non-Gaussian" distribution of temperature fluctuations over the sky that is a partial diagnostic of the model. We explore two methods for quantifying non-Gaussian and/or non-stationary fluctuation fields in order to see how they respond to the Bianchi models.We first investigate the behavior of phase correlations between the spherical harmonic modes of the maps. Then we examine the behavior of the multipole vectors of the temperature distribution which, though defined in harmonic space, can indicate the presence of a preferred direction in real space, i.e. on the 2-sphere. These methods give extremely clear signals of the presence of anisotropy when applied to the models we discuss, suggesting that they have some promise as diagnostics of the presence of global asymmetry in the Universe.

We discuss and compare two alternative models for the two-point angular correlation function of galaxies detected through the sub-millimetre emission using the Herschel Space Observatory. The first, now-standard Halo Model, which represents the angular correlations as arising from one-halo and two-halo contributions, is flexible but complex and rather unwieldy. The second model is based on a much simpler approach: we incorporate a fitting function method to estimate the matter correlation function with approximate model of the bias inferred from the estimated redshift distribution to find the galaxy angular correlation function. We find that both models give a good account of the shape of the correlation functions obtained from published preliminary studies of the HerMES and H-ATLAS surveys performed using Herschel, and yield consistent estimates of the minimum halo mass within which the sub-millimetre galaxies must reside. We note also that both models predict an inflection in the correlation function at intermediate angular scales, so the presence of the feature in the measured correlation function does not unambiguously indicate the presence of intra-halo correlations. The primary barrier to more detailed interpretation of these clustering measurements lies in the substantial uncertainty surrounding the redshift distribution of the sources.

We introduce a collection of statistics appropriate for the study of spinorial quantities defined in three dimensions, focussing on applications to cosmological weak gravitational lensing studies in 3D. In particular, we concentrate on power spectra associated with three- and four-point statistics, which have the advantage of compressing a large number of typically very noisy modes into a convenient data set. It has been shown previously by \cite{MuHe09} that, for non--Gaussianity studies in the microwave background, such compression can be lossless for certain purposes, so we expect the statistics we define here to capture the bulk of the cosmological information available in these higher-order statistics. We consider the effects of a sky mask and noise, and use Limber's approximation to show how, for high-frequency angular modes, confrontation of the statistics with theory can be achieved efficiently and accurately. We focus on scalar and spinorial fields including convergence, shear and flexion of 3D weak lensing, but many of the results apply for general spin fields.

A large sub-mm survey with Herschel will enable many exciting science opportunities, especially in an era of wide-field optical and radio surveys and high resolution cosmic microwave background experiments. The Herschel-SPIRE Legacy Survey (HSLS), will lead to imaging data over 4000 sq. degrees at 250, 350, and 500 micron. Major Goals of HSLS are: (a) produce a catalog of 2.5 to 3 million galaxies down to 26, 27 and 33 mJy (50% completeness; 5 sigma confusion noise) at 250, 350 and 500 micron, respectively, in the southern hemisphere (3000 sq. degrees) and in an equatorial strip (1000 sq. degrees), areas which have extensive multi-wavelength coverage and are easily accessible from ALMA. Two thirds of the of the sources are expected to be at z > 1, one third at z > 2 and about a 1000 at z > 5. (b) Remove point source confusion in secondary anisotropy studies with Planck and ground-based CMB data. (c) Find at least 1200 strongly lensed bright sub-mm sources leading to a 2% test of general relativity. (d) Identify 200 proto-cluster regions at z of 2 and perform an unbiased study of the environmental dependence of star formation. (e) Perform an unbiased survey for star formation and dust at high Galactic latitude and make a census of debris disks and dust around AGB stars and white dwarfs.

We study the coherent temperature and polarization patterns produced in homogeneous but anisotropic cosmological models. We show results for all Bianchi types with a Friedman-Robertson-Walker limit (i.e. Types I, V, VII$_{0}$, VII$_{h}$ and IX) to illustrate the range of possible behaviour. We discuss the role of spatial curvature, shear and rotation in the geodesic equations for each model and establish some basic results concerning the symmetries of the patterns produced. We also give examples of the time-evolution of these patterns in terms of the Stokes parameters $I$, $Q$ and $U$.

All-sky maps of the cosmic microwave background temperature fluctuations are usually represented by a spherical harmonic decomposition involving modes labelled by their degree l and order m (where -l < m < +l). The zonal modes (i.e those with m = 0) are of particular interest because they vary only with galactic latitude; any anomalous behaviour in them might therefore be an indication of erroneous foreground substraction. We perform a simple statistical analysis of the modes with low l for sky maps derived via different cleaning procedures from the Wilkinson Microwave Anisotropy Probe (WMAP) and show that the zonal modes provide a useful diagnostic of possible systematics.

Owing to their more extensive sky coverage and tighter control on systematic errors, future deep weak lensing surveys should provide a better statistical picture of the dark matter clustering beyond the level of the power spectrum. In this context, the study of non-Gaussianity induced by gravity can help tighten constraints on the background cosmology by breaking parameter degeneracies, as well as throwing light on the nature of dark matter, dark energy or alternative gravity theories. Analysis of the shear or flexion properties of such maps is more complicated than the simpler case of the convergence due to the spinorial nature of the fields involved. Here we develop analytical tools for the study of higher-order statistics such as the bispectrum (or trispectrum) directly using such maps at different source redshift. The statistics we introduce can be constructed from cumulants of the shear or flexions, involving the cross-correlation of squared and cubic maps at different redshifts. Typically, the low signal-to-noise ratio prevents recovery of the bispectrum or trispectrum mode by mode. We define power spectra associated with each multi- spectra which compresses some of the available information of higher order multispectra. We show how these can be recovered from a noisy observational data even in the presence of arbitrary mask, which introduces mixing between Electric (E-type) and Magnetic (B-type) polarization, in an unbiased way. We also introduce higher order cross-correlators which can cross-correlate lensing shear with different tracers of large scale structures.

We explore a systematic approach to the analysis of primordial non-Gaussianity using fluctuations in temperature and polarization of the Cosmic Microwave Background (CMB). Following Munshi & Heavens (2009), we define a set of power-spectra as compressed forms of the bispectrum and trispectrum derived from CMB temperature and polarization maps; these spectra compress the information content of the corresponding full multispectra and can be useful in constraining early Universe theories. We generalize the standard pseudo-C_l estimators in such a way that they apply to these spectra involving both spin-0 and spin-2 fields, developing explicit expressions which can be used in the practical implementation of these estimators. While these estimators are suboptimal, they are nevertheless unbiased and robust hence can provide useful diagnostic tests at a relatively small computational cost. We next consider approximate inverse-covariance weighting of the data and construct a set of near-optimal estimators based on that approach. Instead of combining all available information from the entire set of mixed bi- or trispectra, i.e multispectra describing both temperature and polarization information, we provide analytical constructions for individual estimators, associated with particular multispectra. The bias and scatter of these estimators can be computed using Monte-Carlo techniques. Finally, we provide estimators which are completely optimal for arbitrary scan strategies and involve inverse covariance weighting; we present the results of an error analysis performed using a Fisher-matrix formalism at both the one-point and two-point level.

Weak gravitational lensing on a cosmological scales can provide strong constraints both on the nature of dark matter and the dark energy equation of state. Most current weak lensing studies are restricted to (two-dimensional) projections, but tomographic studies with photometric redshifts have started, and future surveys offer the possibility of probing the evolution of structure with redshift. In future we will be able to probe the growth of structure in 3D and put tighter constraints on cosmological models than can be achieved by the use of galaxy redshift surveys alone. Earlier studies in this direction focused mainly on evolution of the 3D power spectrum, but extension to higher-order statistics can lift degeneracies as well as providing information on primordial non-gaussianity. We present analytical results for specific higher-order descriptors, the bispectrum and trispectrum, as well as collapsed multi-point statistics derived from them, i.e. cumulant correlators. We also compute quantities we call the power spectra associated with the bispectrum and trispectrum, the Fourier transforms of the well-known cumulant correlators. We compute the redshift dependence of these objects and study their performance in the presence of realistic noise and photometric redshift errors.

The Herschel ATLAS is the largest open-time key project that will be carried out on the Herschel Space Observatory. It will survey 510 square degrees of the extragalactic sky, four times larger than all the other Herschel surveys combined, in five far-infrared and submillimetre bands. We describe the survey, the complementary multi-wavelength datasets that will be combined with the Herschel data, and the six major science programmes we are undertaking. Using new models based on a previous submillimetre survey of galaxies, we present predictions of the properties of the ATLAS sources in other wavebands.

Cosmic microwave background studies of non-Gaussianity involving higher-order multispectra can distinguish between early universe theories that predict nearly identical power spectra. However, the recovery of higher-order multispectra is difficult from realistic data due to their complex response to inhomogeneous noise and partial sky coverage, which are often difficult to model analytically. A traditional alternative is to use one-point cumulants of various orders, which collapse the information present in a multispectrum to one number. The disadvantage of such a radical compression of the data is a loss of information as to the source of the statistical behaviour. A recent study by Munshi & Heavens (2009) has shown how to define the skew spectrum (the power spectra of a certain cubic field, related to the bispectrum) in an optimal way and how to estimate it from realistic data. The skew spectrum retains some of the information from the full configuration-dependence of the bispectrum, and can contain all the information on non-Gaussianity. In the present study, we extend the results of the skew spectrum to the case of two degenerate power-spectra related to the trispectrum. We also explore the relationship of these power-spectra and cumulant correlators previously used to study non-Gaussianity in projected galaxy surveys or weak lensing surveys. We construct nearly optimal estimators for quick tests and generalise them to estimators which can handle realistic data with all their complexity in a completely optimal manner. We show how these higher-order statistics and the related power spectra are related to the Taylor expansion coefficients of the potential in inflation models, and demonstrate how the trispectrum can constrain both the quadratic and cubic terms.

A thermal gravitational wave background can be produced in the early Universe if a radiation dominated epoch precedes the usual inflationary stage. This background provides a unique way to study the initial state of the Universe. We discuss the imprint of this thermal spectra of gravitons on the cosmic microwave background (CMB) power spectra, and its possible detection by CMB observations. Assuming the inflationary stage is a pure de Sitter expansion we find that, if the number of e-folds of inflation is smaller than 65, the signal of this thermal spectrum can be detected by the observations of Planck and PolarBear experiments, or the planned EPIC experiments. This bound can be even looser if inflation-like stage is the sub-exponential.

We calculate the temperature and polarization patterns generated in anisotropic cosmological models drawn from the Bianchi classification. We show that localized features in the temperature pattern, perhaps similar to the cold spot observed in the Wilkinson Microwave Anisotropy Probe (WMAP) data, can be generated in models with negative spatial curvature, i.e. Bianchi types V and VII$_{h}$. Both these models also generate coherent polarization patterns. In Bianchi VII$_h$, however, rotation of the polarization angle as light propagates along geodesics can convert E modes into B modes but in Bianchi V this is not necessarily the case. It is in principle possible, therefore, to generate localized temperature features without violating existing observational constraints on the odd-parity component of the polarization of the cosmic microwave background.

We study the extent to which one can distinguish primordial non--Gaussianity (NG) arising from adiabatic and isocurvature perturbations. We make a joint analysis of different NG models based on various inflationary scenarios: local-type and equilateral-type NG from adiabatic perturbations and local-type and quadratic-type NG from isocurvature perturbations together with a foreground contamination by point sources. We separate the Fisher information of the bispectrum of CMB temperature and polarization maps by l for the skew spectrum estimator introduced by Munshi & Heavens (2009) to study the scale dependence of the signal-to-noise ratio of different NG components and their correlations. We find that the adiabatic and the isocurvature modes are strongly correlated, though the phase difference of acoustic oscillations helps to distinguish them. The correlation between local-and equilateral-type is weak, but the two isocurvature modes are too strongly correlated to be discriminated. Point source contamination, to the extent to which it can be regarded as white noise, can be almost completely separated from the primordial components for l>100. Including correlations among the different components, we find that the errors of the NG parameters increase by 20-30% for the WMAP 5-year observation, but 5% for Planck observations.

We investigate a simple model for a galactic halo under the assumption that it is dominated by a dark matter component in the form of a Bose-Einstein condensate involving an ultra-light scalar particle. In particular we discuss the possibility if the dark matter is in superfluid state then a rotating galactic halo might contain quantised vortices which would be low-energy analogues of cosmic strings. Using known solutions for the density profiles of such vortices we compute the self-gravitational interactions in such halos and place bounds on the parameters describing such models, such as the mass of the particles involved.

We present an analysis of the Minkowski Functionals (MFs) describing the WMAP three-year temperature maps to place limits on possible levels of primordial non-Gaussianity. In particular, we apply perturbative formulae for the MFs to give constraints on the usual non-linear coupling constant fNL. The theoretical predictions are found to agree with the MFs of simulated CMB maps including the full effects of radiative transfer. The agreement is also very good even when the simulation maps include various observational artifacts, including the pixel window function, beam smearing, inhomogeneous noise and the survey mask. We find accordingly that these analytical formulae can be applied directly to observational measurements of fNL without relying on non-Gaussian simulations. Considering the bin-to-bin covariance of the MFs in WMAP in a chi-square analysis, we find that the primordial non-Gaussianity parameter is constrained to lie in the range -70<fNL<91 at 95% C.L. using the Q+V+W co-added maps.

We study the effect of primordial non-Gaussianity on the development of large-scale cosmic structure using high-resolution N-body simulations. In particular, we focus on the topological properties of the "cosmic web", quantitatively characterized by the Minkowski Functionals, for models with quadratic non-linearities with different values of the usual non-Gaussianity parameter fNL. In the weakly non-linear regime, we find that analytic formulae derived from perturbation theory agree with the numerical results within a few percent of the amplitude of each MF when |fNL|<1000. In the non-linear regime, the detailed behavior of the MFs as functions of threshold density deviates more strongly from the analytical curves, while the overall amplitude of the primordial non-Gaussian effect remains comparable to the perturbative prediction. When smaller-scale information is included, the influence of primordial non-Gaussianity becomes increasingly significant statistically due to decreasing sample variance. We find that the effect of the primordial non-Gaussianity with |fNL|=50 is comparable to the sample variance of mass density fields with a volume of 0.125(Gpc/h)^3 when they are smoothed by Gaussian filter at a scale of 5Mpc/h. The detectability of this effect in actual galaxy surveys will strongly depend upon residual uncertainties in cosmological parameters and galaxy biasing.

The quadrupole power of cosmic microwave background (CMB) temperature anisotropies seen in the WMAP data is puzzlingly low. In this paper we demonstrate that Minimum Variance Optimization (MVO), a technique used by many authors (including the WMAP science team) to separate the CMB from contaminating foregrounds, has the effect of forcing the extracted CMB map to have zero statistical correlation with the foreground emission. Over an ensemble of universes the true CMB and foreground are indeed expected to be uncorrelated, but any particular sky pattern (such as the one we happen to observe) will generate non-zero measured correlations simply by chance. We call this effect "cosmic covariance" and it is a possible source of bias in the CMB maps cleaned using the MVO technique. We show that the presence of cosmic covariance is expected to artificially suppress the variance of the Internal Linear Combination (ILC) map obtained via MVO. It also propagates into the multipole expansion of the ILC map, generating a quadrupole deficit with more than 90% confidence. Since we do not know the CMB and the foregrounds a priori, there is therefore an unknown contribution to the uncertainty in the measured quadrupole power, over and above the usual cosmic variance contribution. Using the MVO on a series of Monte Carlo simulations that assume Gaussian CMB fluctuations, we estimate that the real quadrupole power of the CMB lies in the range [305.16,400.40] microKelvin^2 (at the 1-sigma level).

We present a simple heuristic model to demonstrate how feedback related to the galaxy formation process can result in a scale-dependent bias of mass versus light, even on very large scales. The model invokes the idea that galaxies form initially in locations determined by the local density field, but the subsequent formation of galaxies is also influenced by the presence of nearby galaxies that have already formed. The form of bias that results possesses some features that are usually described in terms of stochastic effects, but our model is entirely deterministic once the density field is specified. Features in the large-scale galaxy power spectrum (such as wiggles that might in an extreme case mimic the effect of baryons on the primordial transfer function) could, at least in principle, arise from spatial modulations of the galaxy formation process that arise naturally in our model. We also show how this fully deterministic model gives rise to apparently stochasticity in the galaxy distribution.

Scale transformations have played an extremely successful role in studies of cosmological large-scale structure by relating the non-linear spectrum of cosmological density fluctuations to the linear primordial power at longer wavelengths. Here we generalize this approach to investigate the usefulness of scale transformations for nonlinear higher-order statistics, specifically the bispectrum. We find that the bispectrum predicted by perturbation theory at tree-level can be rescaled to match the results of full numerical simulations in the weakly and intermediately nonlinear regimes, especially at high redshifts, with an accuracy that is surprising given the simplicity of the procedure used. This discovery not only offers a simple practical way of calculating the matter bispectrum, but also suggests that scale transformations may yet yield even deeper insights into the physics of hierarchical clustering.

We make use of a flat, axisymmetric Bianchi I metric to investigate the effects of a magnetic field upon the dynamics of the universe for the case in which the accompanying fluid is a cosmological constant and derive two exact solutions to the dynamical equations for this situation. We examine the behaviour of the scale factor perpendicular and parallel to the field lines, A(t) and W(t) respectively, and find the expected behaviour. The field has the strongest effect when A(t) is small, decelerating collapse perpendicular to the field lines, due to magnetic pressure, and accelerating collapse along the field lines, due to magnetic tension, while the vacuum energy dominates at late time, driving accelerated expansion.

We employ the one-dimensional Fourier representation (1DFR) to analyze the 3-year WMAP de-biased internal linear combination (DILC) map and its possible contamination by galactic foregrounds. The 1DFR is a representation of the spherical harmonic coefficients for each l mode using an inverse Fourier transform into one-dimensional curves. Based on the a priori assumption that the CMB signal should be statistically independent of, and consequently have no significant correlation with, any foregrounds, we cross-correlate the 1DFR curves of 2 <= l <= 10 modes, which are claimed by the WMAP team to be free of contamination and suitable for whole sky analysis. We find that 8 out of the 9 modes are negatively cross correlated with the foreground maps, an event which has a probability of only 9/512 ~ 0.0176 for uncorrelated signals. Furthermore, the local extrema of the 1DFR curves between the DILC and those of the foregrounds for l=2 and 6 are correlated with significance level below 0.04. We also discuss the minimum variance optimization method and use the properties of the measured cross-correlation to estimate the possible level of contamination present in the DILC map.

The dynamical equations describing the evolution of a self-gravitating fluid of cold dark matter (CDM) can be written in the form of a Schrodinger equation coupled to a Poisson equation describing Newtonian gravity. It has recently been shown that, in the quasi-linear regime, the Schrodinger equation can be reduced to the exactly solvable free-particle Schrodinger equation. The free-particle Schrodinger equation forms the basis of a new approximation scheme -the free-particle approximation - that is capable of evolving cosmological density perturbations into the quasi-linear regime. The free-particle approximation is essentially an alternative to the adhesion model in which the artificial viscosity term in Burgers' equation is replaced by a non-linear term known as the quantum pressure. Simple one-dimensional tests of the free-particle method have yielded encouraging results. In this paper we comprehensively test the free-particle approximation in a more cosmologically relevant scenario by appealing to an N-body simulation. We compare our results with those obtained from two established methods: the linearized fluid approach and the Zeldovich approximation. We find that the free-particle approximation comprehensively out-performs both of these approximation schemes in all tests carried out and thus provides another useful analytical tool for studying structure formation on cosmological scales.

We explore a novel approach to the study of large-scale structure formation in which self-gravitating cold dark matter (CDM) is represented by a complex scalar field whose dynamics are governed by coupled Schrodinger and Poisson equations. We show that, in the quasi-linear regime, the Schrodinger equation can be reduced to the free-particle Schrodinger equation. We advocate using the free-particle Schrodinger equation as the basis of a new approximation method - the free-particle approximation - that is similar in spirit to the successful adhesion model. In this paper we test the free-particle approximation by appealing to a planar collapse scenario and find that our results are in excellent agreement with those of the Zeldovich approximation, provided care is taken when choosing a value for the effective Planck constant in the theory. We also discuss how extensions of the free-particle approximation are likely to require the inclusion of a time-dependent potential in the Schrodinger equation. Since the Schrodinger equation with a time-dependent potential is typically impossible to solve exactly, we investigate whether standard quantum-mechanical approximation techniques can be used, in a cosmological setting, to obtain useful solutions of the Schrodinger equation. In this paper we focus on one particular approximation method: time-dependent perturbation theory (TDPT). We elucidate the properties of perturbative solutions of the Schrodinger equation by considering a simple example: the gravitational evolution of a plane-symmetric density fluctuation. We use TDPT to calculate an approximate solution of the relevant Schrodinger equation and show that this perturbative solution can be used to successfully follow gravitational collapse beyond the linear regime, but there are several pitfalls to be avoided.

We follow the growth of baryonic structure in the presence of a magnetic field within an approximate cosmological magneto-hydrodynamic simulation, produced by adding an (isotropic) magnetic pressure related to the local gas pressure. We perform an ensemble of these simulations to follow the amplification of the field with time. By using a variety of initial field strengths and changing the slope of the power law that governs the way the field grows with increasing density we span the range of current observations and demonstrate the size of the effect realistic magnetic fields could have on the central density of groups and clusters. A strong magnetic field significantly reduces the central gas density which, in turn, reduces observable quantities such as the X-ray luminosity.

We test the hypothesis that the temperature of the cosmic microwave background is consistent with a Gaussian random field defined on the celestial sphere, using de-biased internal linear combination (DILC) map produced from the 3-year WMAP data. We test the phases for spherical harmonic modes with l <= 10 (which should be the cleanest) for their uniformity, randomness, and correlation with those of the foreground templates. The phases themselves are consistent with a uniform distribution, but not for l <= 5, and the differences between phases are not consistent with uniformity. For l=3 and l=6, the phases of the CMB maps cross-correlate with the foregrounds, suggestion the presence of residual contamination in the DLC map even on these large scales. We also use a one-dimensional Fourier representation to assemble a_lm into the \Delta T_l(\phi) for each l mode, and test the positions of the resulting maxima and minima for consistency with uniformity randomness on the unit circle. The results show significant departures at the 0.5% level, with the one-dimensional peaks being concentrated around \phi=180 degs. This strongly significant alignment with the Galactic meridian, together with the cross-correlation of DILC phases with the foreground maps, strongly suggests that even the lowest spherical harmonic modes in the map are significantly contaminated with foreground radiation.

The extraction of cosmological parameters from microwave background observations relies on specific assumptions about the statistical properties of the data, in particular that the p-point distributions of temperature fluctuations are jointly-normal. Using a battery of statistical tests, we assess the multivariate Gaussian nature of the Wilkinson Microwave Anisotropy Probe (WMAP) 1st year data. The statistics we use fall into three classes which test different aspects of joint-normality: the first set assess the normality of marginal (one-point) distributions using familiar univariate methods; the second involves statistics that directly assess joint-normality; and the third explores the evidence of non-linearity in the relationship between variates. We applied these tests to frequency maps, `foreground-cleaned' assembly maps and all-sky CMB-only maps. The assembly maps are of particular interest as when combined with the kp2 mask, we recreate the region used in the computation of the angular power spectrum. Significant departures from normality were found in all the maps. In particular, the kurtosis coefficient, D'Agostino's statistic and bivariate kurtosis calculated from temperature pairs extracted from all the assembly maps were found to be non-normal at 99% confidence level. We found that the results were unaffected by the size of the Galactic cut and were evident on either hemisphere of the CMB sky. The latter suggests that the non-Gaussianity is not simply related to previous claims of north-south asymmetry or localized abnormalities detected through wavelet techniques.

We investigate the properties of the (complex) coefficients obtained in a spherical harmonic representation of temperature maps of the cosmic microwave background (CMB). We study the effect of the coefficient phase only, as well as the combined effects of phase and amplitude. The method used to check for anomalies is to construct a ``random walk'' trajectory in the complex plane where the step length and direction are given by the amplitude and phase (respectively) of the harmonic coefficient. If the fluctuations comprise a homogeneous and isotropic Gaussian random field on the sky, the path so obtained should be a classical ``Rayleigh flight'' with very well known statistical properties. We illustrate the use of this random-walk representation by using the net walk length as a test statistic, and apply the method to the coefficients obtained from a Wilkinson Microwave Anisotropy Probe (WMAP) preliminary sky temperature map.

If a magnetic field is frozen into a plasma that undergoes spherical compression then the magnetic field B varies with the plasma density \rho according to B \propto \rho^{2/3}. In the gravitational collapse of cosmological density perturbations, however, quasi-spherical evolution is very unlikely. In anisotropic collapses the magnetic field can be a much steeper function of gas density than in the isotropic case. We investigate the distribution of amplifications in realistic gravitational collapses from Gaussian initial fluctuations using the Zel'dovich approximation. Representing our results using a relation of the form B\propto \rho^{\alpha}, we show that the median value of \alpha can be much larger than the \alpha=2/3 resulting from spherical collapse, even if there is no initial correlation between magnetic field and principal collapse directions. These analytic arguments go some way towards understanding the results of numerical simulations.

Using a set of compilations of measurements for extragalactic radio sources we construct all-sky maps of the Faraday Rotation produced by the Galactic magnetic field. In order to generate the maps we treat the radio source positions as a kind of "mask" and construct combinations of spherical harmonic modes that are orthogonal on the masked sky. As long as relatively small multipoles are used the resulting maps are quite stable to changes in selection criteria for the sources, and show clearly the structure of the local Galactic magnetic field. We also suggest the use of these maps as templates for CMB foreground analysis, illustrating the idea with a cross-correlation analysis between the Wilkinson Microwave Anisotropy Probe (WMAP) data and our maps. We find a significant cross-correlation, indicating the presence of significant residual contamination.

We present a new technique for constraining the topology of the universe. The method exploits the existence of correlations in the phases of the spherical harmonic coefficients of the CMB temperature pattern associated with matched pairs of circles seen in the sky in universes with non-trivial topology. The method is computationally faster than all other statistics developed to hunt for these matched circles. We applied the method to a range of simulations with topologies of various forms and on different scales. A characteristic form of phase correlation is found in the simulations. We also applied the method to preliminary CMB maps derived from WMAP, but the separation of topological effects from, e.g., foregrounds is not straightforward.

In these lecture notes I discussed the importance of phase correlations for the morphology of large-scale structure and how phase analysis can probe primordial non-Gaussianity and/or foreground contamination in CMB temperature maps. I illustrate the ideas with application to the preliminary WMAP first-year data. I also briefly introduce topological characteristics such as the genus and Minkowski functionals, and how they provide a real-space diagnostic of phase correlations.

A standard theoretical paradigm for the formation of large-scale structure in the distribution of galaxies has now been established, based on the gravitational instability of cold dark matter in a background cosmology dominated by vacuum energy. Significant uncertainties remain in the modelling of complex astrophysical processes involved in galaxy formation, perhaps most fundamentally in the relationship between the distributions of luminous galaxies and the underlying dark matter. I argue that the Square Kilometre Array is likely to provide information crucial to understanding this relationship and how it evolves with time.

We study the statistical properties of spherical harmonic modes of temperature maps of the cosmic microwave background. Unlike other studies, which focus mainly on properties of the amplitudes of these modes, we look instead at their phases. In particular, we present a simple measure of phase correlation that can be diagnostic of departures from the standard assumption that primordial density fluctuations constitute a statistically homogeneous and isotropic Gaussian random field, which should possess phases that are uniformly random on the unit circle. The method we discuss checks for the uniformity of the distribution of phase angles using a non-parametric descriptor based on the use order statistics, which is known as Kuiper's statistic. The particular advantage of the method we present is that, when coupled to the judicious use of Monte Carlo simulations, it can deliver very interesting results from small data samples. In particular, it is useful for studying the properties of spherical harmonics at low l for which there are only small number of independent values of m and which therefore furnish only a small number of phases for analysis. We apply the method to the COBE-DMR and WMAP sky maps, and find departures from uniformity in both. In the case of WMAP, our results probably reflect Galactic contamination or the known variation of signal-to-noise across the sky rather than primordial non-Gaussianity.

We present a diagnostic test of possible Galactic contamination of cosmic microwave background sky maps designed to provide an independent check on the methods used to compile these maps. The method involves a non-parametric measurement of cross-correlation between the Faraday rotation measure (RM) of extragalactic sources and the measured microwave signal at the same angular position. We argue that statistical properties of the observed distribution of rotation measures are consistent with a Galactic origin, an argument reinforced by a direct measurement of cross-correlation between dust, free-free and synchrotron foreground maps and RM values with the strongest correlation being for dust and free-free. We do not find any statistically compelling evidence for correlations between the RM values and the COBE DMR maps at any frequency, so there is no evidence of residual contamination in these CMB maps. On the other hand, there is a statistically significant correlation of RM with the preliminary WMAP individual frequency maps which remains significant in the Tegmark et al. Wiener-filtered map but not in the Internal Linear Combination map produced by the WMAP team.

The large-scale structure of the Universe is thought to evolve by a process of gravitational amplification from low-amplitude Gaussian noise generated in the early Universe. The later, non-linear stages of gravitation-induced clustering produce phase correlations with well-defined statistical properties. In particular, the distribution of phase differences $D$ between neighboring Fourier modes provides useful insights into the clustering phenomenon. Here we develop an approximate theory for the probability distribution $D$ and test it using a large battery of numerical simulations. We find a remarkable universal form for the distribution which is well described by theoretical arguments.

The dynamical equations describing the evolution of a self-gravitating fluid can be rewritten in the form of a Schrodinger equation coupled to a Poisson equation determining the gravitational potential. This wave-mechanical representation allows an approach to cosmological gravitational instability that has numerous advantages over standard fluid-based methods. We explore the usefulness of the Schrodinger approach by applying it to a number of simple examples of self-gravitating systems in the weakly non-linear regime. We show that consistent description of a cold self-gravitating fluid requires an extra "quantum pressure" term to be added to the usual Schrodinger equation and we give examples of the effect of this term on the development of gravitational instability. We also show how the simple wave equation can be modified by the addition of a non-linear term to incorporate the effects of gas pressure described by a polytropic equation-of-state.

In the standard paradigm for cosmological structure formation, clustering develops from initially random-phase (Gaussian) density fluctuations in the early Universe by a process of gravitational instability. The later, non-linear stages of this process involve Fourier mode-mode interactions that result in a complex pattern of non-random phases. We present a novel mapping technique that reveals mode coupling induced by this form of nonlinear interaction and allows it to be quantified statistically. The phase mapping technique circumvents the difficulty of the circular characteristic of phi_k and illustrates the statistical significance of phase difference at the same time. This generalized method on phases allows us to detect weak coupling of phases on any Delta k scales.

In the very near future, weak lensing surveys will map the projected density of the universe in an unbiased way over large regions of the sky. In order to interpret the results of studies it is helpful to develop an understanding of the errors associated with quantities extracted from the observations. In a generalization of one of our earlier works, we present estimators of the cumulants and cumulant correlators of the weak lensing convergence field, and compute the variance associated with these estimators. By restricting ourselves to so-called compensated filters we are able to derive quite simple expressions for the errors on these estimates. We also separate contributions from cosmic variance, shot noise and intrinsic ellipticity of the source galaxies.

In this pedagogical lecture, I introduce some of the basic terminology and description of fluctuating fields as they occur on cosmology. I define various statistical, cosmological and sample homogeneity and explain what is meant by the fair sample hypothesis and cosmic variance. I illustrate these concepts using the simplest second-order statistics, i.e. the two--point correlation function and its Fourier transform the power-spectrum. I then give a brief overview of the properties of information relating to the properties of the phases of the Fourier modes of cosmological fluctuations which is not contained in these simpler statistics. Specifically, I explain how phase information of a particular form (called quadratic phase coupling) is encoded in the three--point correlation function (or, equivalently, the bispectrum).

I review the basic ``gravitational instability'' model for the growth of structure in the expanding Universe. This model requires the existence of small initial irregularities in the density of a largely uniform universe. These grow through linear and non-linear stages to form a complex network of clusters, filaments and voids. The dynamical equations describing the evolution of a self-gravitating fluid can be rewritten in the form of a Schrodinger equation coupled to a Poisson equation determining the gravitational potential. This approach has a number of interesting features, many of which were pointed out in a seminal paper by Widrow & Kaiser (1993). I argue that this approach has the potential to yield useful analytic insights into the dynamical growth of large-scale structure. As a particular example, I show that this approach yields an elegant reformulation of an idea due to Jones (1999) concerning the origin of lognormal intermittency in the galaxy distribution.

This paper considers some simple surface brightness (SB) estimates for galaxies in the Automated Plate Measuring Machine (APM) catalogue in order to derive homogeneous SB data for a very large sample of faint galaxies. The isophotal magnitude and area are used to estimate the central surface brightness and total magnitude based on the assumption of an exponential SB profile. The surface brightness measurements are corrected for field effects on each UK Schmidt plate and the zero-point of each plate is adjusted to give a uniform sample of SB and total magnitude estimates over the whole survey. Results are obtained for 2.4 million galaxies with blue photographic magnitudes brighter than b_J = 20.5 covering 4300 deg^2 in the region of the south galactic cap. Almost all galaxies in our sample have central surface brightness in the range 20 to 24 b_J mag per arcsec^2. The SB measurements we obtain are compared to previous SB measurements and we find an acceptable level of error of +/- 0.2 b_J mag per arcsec^2. The distribution of SB profiles is considered for different galaxy morphologies for the bright APM galaxies. We find that early-type galaxies have more centrally concentrated profiles.

Primordial fluctuations in the cosmic density are usually assumed to take the form of a Gaussian random field that evolves under the action of gravitational instability. In the early stages, while they have low amplitude, the fluctuations grow linearly. During this phase the Gaussian character of the fluctuations is preserved. Later on, when the fluctuations have amplitude of order the mean density or larger, non-linear effects cause departures from Gaussianity. In Fourier space, non-linearity is responsible for coupling Fourier modes and altering the initially random distribution of phases that characterizes Gaussian initial conditions. In this paper we investigate some of the effects of quadratic non-linearity on basic statistical properties of cosmological fluctuations. We demonstrate how this form of non-linearity can affect asymptotic properties of density fields such as homogeneity, ergodicity, and behaviour under smoothing. We also show how quadratic density fluctuations give rise to a particular relationship between the phases of different Fourier modes which, in turn, leads to the generation of a non-vanishing bispectrum. We thus elucidate the relationship between higher-order power spectra and phase distributions.

The identification and extraction of non-Gaussian signals is one of the main cosmological challenges facing future experimental measurements of the cosmic microwave background temperature pattern. We present a generalized statistical measure based on a novel technique representation of Fourier phases using the return map. We show that this method is both robust and powerful in comparison, for example, with morphological measures.

The analysis of redshift surveys with fractal tools requires one to apply some form of statistical correction for galaxies lying near the geometric boundary of the sample. In this paper we compare three different methods of performing such a correction upon estimates of the correlation integral in order to assess the extent to which estimates may be biased by boundary terms. We apply the corrections illustrative examples, including a simple fractal set (L\'{e}vy flight), a random $\beta$-model, and a subset of the CfA2 Southern Cap survey. This study shows that the new ``angular'' correction method we present is more generally applicable than the other methods used to date: the conventional ``capacity'' correction imposes a bias towards homogeneity, and the ``deflation'' method discards large-scale information, and consequently reduces the statistical usefulness of data sets. The ``angular'' correction method is effective at recovering true fractal dimensions, although the extent to which boundary corrections are important depends on the form of fractal distribution assumed as well as the details of the survey geometry. We also show that the CfA2 Southern sample does not show any real evidence of a transition to homogeneity. We then revisit the IRAS PSCz survey and ``mock'' PSCz catalogues made using N-body simulations of two different cosmologies. The results we obtain from the PSCz survey are not significantly affected by the form of boundary correction used, confirming that the transition from fractal to homogeneous behaviour reported by Pan & Coles (2000) is real.

The dynamical equations describing the evolution of a self-gravitating fluid can be rewritten in the form of a Schrodinger equation coupled to a Poisson equation determining the gravitational potential. This approach has a number of interesting features, many of which were pointed out in a seminal paper by Widrow & Kaiser (1993). In particular we show that this approach yields an elegant reformulation of an idea due to Jones (1999) concerning the origin of lognormal intermittency in the galaxy distribution.

I review the standard paradigm for understanding the formation and evolution of cosmic structure, based on the gravitational instability of dark matter, but many variations on this basic theme are viable. Despite the great progress that has undoubtedly been made, steps are difficult because of uncertainties in the cosmological parameters, in the modelling of relevant physical processes involved in galaxy formation, and perhaps most fundamentally in the relationship between galaxies and the underlying distribution of matter. For the foreseeable future, therefore, this field will be led by observational developments allowing model parameters to be tuned and, hopefully, particular scenarios falsified. In these lectures I focus on two ingredients in this class of models: (i) the role of galaxy bias in interpreting clustering data; and (ii) the statistical properties of the initial fluctuations. In the later case, I discuss some ideas as to how the standard assumption - that the primordial density fluctuations constitute a Gaussian random field - can be tested using measurements galaxy clustering and the cosmic microwave background.

The modern era of cosmology began with the publication of Einstein's general theory of relativity in 1915. The first experimental test of this theory was Eddington's famous expedition to measure the bending of light at a total solar eclipse in 1919. So famous is this experiment, and so dramatic was the impact on Einstein himself, that history tends not to recognize the controversy that surrounded the results at the time. In this paper I discuss the experiment in its historical and sociological context and show that it provides valuable lessons for modern astronomy and cosmology.

In the standard picture of structure formation, initially random-phase fluctuations are amplified by non-linear gravitational instability to produce a final distribution of mass which is highly non-Gaussian and has highly coupled Fourier phases. Second-order statistics, such as the power spectrum, are blind to this kind of phase association. We discuss the information contained in the phases of cosmological density fluctuations and their possible use in statistical analysis tools. In particular, we show how the bispectrum measures a particular form of phase association called quadratic phase coupling, show how to visualise phase association using colour models. These techniques offer the prospect of more complete tests of initial non-Gaussianity than those available at present.

We investigate the behaviour of galaxy clustering on large scales using the PSCz catalogue. In particular, we ask whether there is any evidence of large-scale fractal behaviour in this catalogue. We find the correlation dimension in this survey varies with scale, consistent with other analyses. For example, our results on small and intermediate scales are consistent those obtained from the QDOT sample, but the larger PSCz sample allows us to extend the analysis out to much larger scales. We find firm evidence that the sample becomes homogeneous at large scales; the correlation dimension of the sample is D_2=2.992(3) for r>30 h^{-1} Mpc. This provides strong evidence in favour of a Universe which obeys the Cosmological Principle.

The local Universe displays a rich hierarchical pattern of galaxy clusters and superclusters. The early Universe, however, was almost smooth, with only slight 'ripples' seen in the cosmic microwave background radiation. Models of the evolution of structure link these observations through the effect of gravity, because the small initially overdense fluctuations attract additional mass as the Universe expands. During the early stages, the ripples evolve independently, like linear waves on the surface of deep water. As the structures grow in mass, they interact with other in non-linear ways, more like waves breaking in shallow water. We have recently shown how cosmic structure can be characterized by phase correlations associated with these non-linear interactions, but hitherto there was no way to use that information to reach quantitative insights into the growth of structures. Here we report a method of revealing phase information, and quantify how this relates to the formation of a filaments, sheets and clusters of galaxies by non-linear collapse. We use a new statistic based on information entropy to separate linear from non-linear effects and thereby are able to disentangle those aspects of galaxy clustering that arise from initial conditions (the ripples) from the subsequent dynamical evolution.

Many recent studies have demonstrated that scaling arguments, such as the so-called hierarchical {\em ansatz}, are extremely useful in understanding the statistical properties of weak gravitational lensing. This is especially true on small angular scales (i.e. at high resolution), where the usual perturbative calculations of matter clustering no longer apply. We build on these studies in order to develop a complete picture of weak lensing at small smoothing angles. In particular, we study the full probability distribution function, bias and other multipoint statistics for the ``hot spots'' of the convergence field induced by weak lensing, and relate these to the statistics of overdense regions in underlying mass distribution. It is already known that weak lensing can constrain the background geometry of the Universe, but we further show that it can also provide valuable information about the statistics of collapsed objects and the physics of collisionless clustering. Our results are particularly important for future observations which will, at least initially, focus on small smoothing angles.

We investigate the effect of weak gravitational lensing in the limit of small angular scales where projected galaxy clustering is strongly nonlinear. This is the regime likely to be probed by future weak lensing surveys. We use well-motivated hierarchical scaling arguments and the plane-parallel approximation to study multi-point statistical properties of the convergence field. These statistics can be used to compute the vertex amplitudes in tree models of hierarchical clustering; these can be compared with similar measurements from galaxy surveys, leading to a powerful probe of galaxy bias.

The Fourier transform of cosmological density perturbations can be represented in terms of amplitudes and phases for each Fourier mode. We investigate the phase evolution of these modes using a mixture of analytical and numerical techniques. Using a toy model of one-dimensional perturbations evolving under the Zel'dovich approximation as an initial motivation, we develop a statistic that quantifies the information content of the distribution of phases. Using numerical simulations beginning with more realistic Gaussian random-phase initial conditions, we show that the information content of the phases grows from zero in the initial conditions, first slowly and then rapidly when structures become non-linear. This growth of phase information can be expressed in terms of an effective entropy: Gaussian initial conditions are a maximum entropy realisation of the initial power spectrum, gravitational evolution decreases the phase entropy. We show that our definition of phase entropy results in a statistic that explicitly quantifies the information stored in the phases of density perturbations (rather than their amplitudes) and that this statistic displays interesting scaling behaviour for self-similar initial conditions.

It is now well established that galaxies are biased tracers of the distribution of matter, although it is still not known what form this bias takes. In local bias models the propensity for a galaxy to form at a point depends only on the overall density of matter at that point. Hierarchical scaling arguments allow one to build a fully-specified model of the underlying distribution of matter and to explore the effects of local bias in the regime of strong clustering. Using a generating-function method developed by Bernardeau & Schaeffer (1992), we show that hierarchical models lead one directly to the conclusion that a local bias does not alter the shape of the galaxy correlation function relative to the matter correlation function on large scales. This provides an elegant extension of a result first obtained by Coles (1993) for Gaussian underlying fields and confirms the conclusions of Scherrer & Weinberg (1998) obtained using a different approach. We also argue that particularly dense regions in a hierarchical density field display a form of bias that is different from that obtained by selecting such peaks in Gaussian fields: they are themselves hierarchically distributed with scaling parameters $S_p=p^{(p-2)}$. This kind of bias is also factorizable, thus in principle furnishing a simple test of this class of models.

We develop a diagrammatic technique to represent the multi-point cumulative probability density function (CPDF) of mass fluctuations in terms of the statistical properties of individual collapsed objects and relate this to other statistical descriptors such as cumulants, cumulant correlators and factorial moments. We use this approach to establish key scaling relations describing various measurable statistical quantities if clustering follows a simple general scaling ansatz, as expected in hierarchical models. We test these detailed predictions against high-resolution numerical simulations. We show that, when appropriate variables are used, the count probability distribution function (CPDF) and void probability distribution function (VPF) shows clear scaling properties in the non-linear regime. Generalising the results to the two-point count probability distribution function (2CPDF), and the bivariate void probability function (2VPF) we find good match with numerical simulations. We explore the behaviour of the bias associated with collapsed objects in limit of large separations, finding that it depends only on the intrinsic scaling parameter associated with collapsed objects and that the bias for two different objects can be expressed as a product of the individual biases of the objects. Finally we use hierarchal ansatz to develop a novel technique for correcting finite-volume effects in the estimation of multi-point statistical quantities from observational data (abridged).

The highly nonlinear regime of gravitational clustering is characterized by the presence of scale-invariant form of many-body correlation functions. Useful insights can be obtained by investigating the consequences of a generic scaling {\em ansatz}. Extending earlier studies by Bernardeau & Schaeffer (1992) we calculate the detailed consequences of such scaling. We generalise the two-point cumulant correlators to a hierarchy of multi-point cumulant correlators (MCC). We introduce the concept of reduced cumulant correlators (RCC) and their related generating functions. Using analytical and diagrammatic method we show that every new vertex of the tree representation of higher-order correlations has its own reduced cumulant correlator. In the limit of large separations, MCCs of arbitrary order can be expressed in terms of RCCs of the same and lower order. We relate the generating functions of RCCs with the statistics of {\em collapsed} objects. We develop the hierarchy for the correlation functions of overdense regions. In this vein, we compute the lower-order cumulants and cumulant correlators for overdense regions. Our study shows how they vary as a function of the initial power spectrum of primordial density fluctuations (abridged).

The cumulant correlators, $C_{pq}$, are statistical quantities that generalise the better-known $S_p$ parameters; the former are obtained from the two-point probability distribution function of the density fluctuations while the latter describe only the one-point distribution. If galaxy clustering develops from Gaussian initial fluctuations and a small-angle approximation is adopted, standard perturbative methods suggest a particular hierarchical relationship of the $C_{pq}$ for projected clustering data, such as the APM survey. We establish the usefulness of the two-point cumulants for describing hierarchical clustering by comparing such calculations against available measurements from projected catalogs, finding very good agreement. We extend the idea of cumulant correlators to multi-point {\em generalised} cumulant correlators (related to the higher-order correlation functions). We extend previous studies in the highly nonlinear regime to express the generalised cumulant correlators in terms of the underlying ``tree amplitudes'' of hierarchical scaling models. Such considerations lead to a technique for determining these hierarchical amplitudes, to arbitrary order, from galaxy catalogs and numerical simulations. Knowledge of these amplitudes yields important clues about the phenomenology of gravitational clustering. For instance, we show that three-point cumulant correlator can be used to separate the tree amplitudes up to sixth order. We also combine the particular hierarchical {\em ansatz} of Bernardeau & Schaeffer (1992) with extended and hyperextended perturbation theory to infer values of the tree amplitudes in the highly nonlinear regime.

We calculate the statistical clustering of Lyman-break galaxies predicted in a selection of currently-fashionable structure formation scenarios. These models are all based on the cold dark matter model, but vary in the amount of dark matter, the initial perturbation spectrum, the background cosmology and in the presence or absence of a cosmological constant term. If Lyman-break galaxies form as a result of hierarchical merging, the amplitude of clustering depends quite sensitively on the minimum halo mass that can host such a galaxy. Interpretation of the recent observations by Giavalisco et al. (1998) would therefore be considerably clarified by a direct determination of the relevant halo properties. For a typical halo mass around $10^{11} h^{-1} M_\odot$ the observations do not discriminate strongly between cosmological models, but if the appropriate mass is larger, say $10^{12} ~h^{-1} M_\odot$ (which seems likely on theoretical grounds), then the data strongly favour models with a low matter-density.

We discuss the theoretical interpretation of observational data concerning the clustering of galaxies at high redshifts. Building on the theoretical machinery developed by Matarrese et al. (1997), we make detailed quantitative predictions of galaxy clustering statistics for a variety of cosmological models, taking into account differences in spatial geometry and initial fluctuation spectra and exploring the role of bias as a complicating factor in these calculations. We demonstrate that the usual description of evolution (in terms of the parameters $\epsilon$ and $r_0$) is not useful for realistic galaxy clustering models. We compare the detailed predictions of the variation of correlation functions with redshift against current observational data to constrain available models of structure formation. Theories that fit the present-day abundance of rich clusters are generally compatible with the observed redshift evolution of galaxy clustering if galaxies are no more than slightly biased at $z\sim 1$. We also discuss the interpretation of a concentration of Lyman-break galaxies found by Steidel et al. (1998), coming to the conclusion that such concentrations are not unexpected in `standard' models of structure formation.

We compare the statistical properties of structures normal and transverse to the line of sight which appear in theoretical N-body simulations of structure formation, and seem also to be present in observational data from redshift surveys. We present a statistic which can quantify this effect in a conceptually different way from standard analyses of distortions of the power-spectrum or correlation function. From tests with $N$--body experiments, we argue that this statistic represents a new and potentially powerful diagnostic of the cosmological density parameter, $\Omega_0$.

We investigate the sampling and dipole convergence properties of flux-limited samples of mock X-ray clusters in relation to their underlying ``parent'' cluster distribution. To this purpose, we resort to numerical simulations of the cluster distribution and extract samples resembling the main observational features of X-ray selected cluster samples. The flux-limited samples, being quite sparse, underestimate the amplitude of the ``parent'' cluster dipole by approximately 15 per cent on average for Local Group-like observers. However, the general shape of their dipole amplitude profiles are in relatively good agreement. We also calculate the expected contribution of clusters, selected according to the relevant criteria, to the soft (0.1-2.4 keV) extragalactic X-ray background, using the ESO Key Project X-ray luminosity function, assuming a flat universe with vanishing cosmological constant. We obtain a value of about 10 per cent of the observed XRB flux.

We study the geometry and topology of the large-scale structure traced by galaxy clusters in numerical simulations of a box of side 320 $h^{-1}$ Mpc, and compare them with available data on real clusters. The simulations we use are generated by the Zel'dovich approximation, using the same methods as we have used in the first three papers in this series. We consider the following models to see if there are measurable differences in the topology and geometry of the superclustering they produce: (i) the standard CDM model (SCDM); (ii) a CDM model with $\Omega_0=0.2$ (OCDM); (iii) a CDM model with a `tilted' power spectrum having $n=0.7$ (TCDM); (iv) a CDM model with a very low Hubble constant, $h=0.3$ (LOWH); (v) a model with mixed CDM and HDM (CHDM); (vi) a flat low-density CDM model with $\Omega_0=0.2$ and a non-zero cosmological $\Lambda$ term ($\Lambda$CDM). We analyse these models using a variety of statistical tests based on the analysis of: (i) the Euler-Poincar\'{e} characteristic; (ii) percolation properties; (iii) the Minimal Spanning Tree construction. Taking all these tests together we find that the best fitting model is $\Lambda$CDM and, indeed, the others do not appear to be consistent with the data. Our results demonstrate that despite their biased and extremely sparse sampling of the cosmological density field, it is possible to use clusters to probe subtle statistical diagnostics of models which go far beyond the low-order correlation functions usually applied to study superclustering.

Using an ensemble of high resolution 2D numerical simulations, we explore the scaling properties of cosmological density fluctuations in the non-linear regime. We study the scaling behaviour of the usual $N$--point volume-averaged correlations, and also examine the scaling of the entire probability density function (pdf) of the fluctuations. We focus on two important issues: (i) whether the scaling behaviour of 2D clustering is consistent with what one infer from radial collapse arguments; and (ii) whether there is any evidence from these high-resolution simulations that a regime of stable clustering is ever entered. We find that the answers are (i) yes and (ii) no. We further find that the behaviour of the highly non-linear regime in these simulations suggests the existence of a regime where the correlation function is independent of the initial power spectrum.

We discuss how the redshift dependence of the observed two-point correlation function of various classes of objects can be related to theoretical predictions. This relation involves first a calculation of the redshift evolution of the underlying matter correlations. The next step is to relate fluctuations in mass to those of any particular class of cosmic objects; in general terms, this means a model for the bias and how it evolves with cosmic epoch. Only after these two effects have been quantified can one perform an appropriate convolution of the non-linearly evolved two-point correlation function of the objects with their redshift distribution to obtain the `observed' correlation function for a given sample. This convolution in itself tends to mask the effect of evolution by mixing amplitudes at different redshifts. We develop a formalism which incorporates these requirements and, in particular, a set of plausible models for the evolution of the bias factor. We apply this formalism to the spatial, angular and projected correlation functions from different samples of high-redshift objects, assuming a simple phenomenological model for the initial power-spectrum and an Einstein-de Sitter cosmological model. We find that our model is roughly consistent with data on the evolution of QSO and galaxy clustering, but only if the effective degree of biasing is small. We discuss the differences between our analysis and other theoretical studies of clustering evolution and argue that the dominant barrier to making definitive predictions is uncertainty about the appropriate form of the bias and its evolution with cosmic epoch.

We investigate the properties of large--scale structure predicted in a class of mixed dark matter models in which the volatile component (made of particles with high rms velocity) derives from the decay of a heavier particle. Such models based on cold+volatile dark matter (CVDM) differ from the standard mixture of CDM and massive neutrinos, usually known as CHDM, in that they involve a component which has a non--thermal phase space distribution function. As a consequence, and differently from CHDM models, the value of the redshift at which volatile particles become non relativistic, $z_{nr}$, can be varied almost independently of the volatile fraction, $\Omega_X$. We compute transfer functions for a selection of such models, having $0.1\le \Omega_X\le 0.5$ and different values of $z_{nr}$. Using linear theory and assuming a scale--free primordial spectrum, we compare such models with observational constraints on large--scale galaxy clustering and bulk flows, as well as on the abundance of galaxy clusters and high--redshift damped Ly$\alpha$ systems. We find that these constraints enable us to discriminate between different $\Omega_X$ and $z_{nr}$; within the range of the models inspected, those which can be most easily accommodated by the data correspond to the parameter choice $\Omega_X\simeq 0.2$ and $z_{nr} \simeq 2\times 10^4\Omega_X$.

We propose and investigate a new algorithm for quantifying the topological properties of cosmological density fluctuations. We first motivate this algorithm by drawing a formal distinction between two definitions of relevant topological characteristics, based on concepts, on the one hand, from differential topology and, on the other, from integral geometry. The former approach leads one to concentrate on properties of the contour surfaces which, in turn, leads to the algorithms CONTOUR2D and CONTOUR3D familiar to cosmologists. The other approach, which we adopt here, actually leads to much simpler algorithms in both two and three dimensions. (The 2D algorithm has already been introduced to the astronomical literature.) We discuss the 3D case in some detail and compare results obtained with it to analogous results using the CONTOUR3D algorithm.

We study the large-scale velocity fields traced by galaxy clusters in numerical simulations of a box of side 960 $h^{-1}$ Mpc, and compare them with available data on real clusters. In order to test the reliability of the simulations, which are based on an optimized version of the Zel'dovich approximation, we compare their cluster velocities with those of "exact" N-body simulations, and find a remarkable agreement between the two according to a variety of statistical tests. We analyse Cold Dark Matter models with density parameter in the range $0.2\le \Omega_0\le 1$, both with and without the cosmological constant term to provide a flat geometry. We also simulate a Cold+Hot Dark Matter model, with 30% provided by the hot component. Comparison with real data is performed by applying tests based on the cumulative velocity frequency distribution (CVFD) and bulk flow statistics. For the CVFD, we use observational velocity data from different authors. By merging all available data in a combined sample, the CVFD test is able to exclude only open models with $\Omega_0\le 0.4$ and flat models with $\Omega_0=0.2$. However, the analysis of individual observational samples gives contradictory results; in particular the recent Giovanelli data, which imply much lower velocities (with significantly smaller uncertainties) than the other data, are actually only consistent with the open $\Omega_0=0.4$ and the flat $\Omega_0=0.2$ models, i.e. the models which are excluded by the other data. Furthermore, CVFD and bulk flow analyses of the Branchini et al. reconstructed velocity data disfavour precisely those models accepted on the grounds of Giovanelli's sample. Finally, we confirm that the Lauer & Postman bulk flow determination is an extremely rare event in the cosmological models we have analysed.

We use numerical simulations to investigate the behaviour of the dipole moment of the spatial distribution of different kinds of mass tracers. We select density peaks of the simulated matter distribution with mean separations of 38 and 30 $h^{-1}$ Mpc to represent two samples of rich clusters of galaxies. We extract, from the same simulations, samples selected to mimic the full 3D galaxy distribution of IR galaxies, and the flux--limited IRAS and QDOT galaxy samples. We compare the dipole moments of these ``galaxy'' and ``cluster'' samples in order to assess the effects of sampling uncertainties and shot--noise on the relationship between the ``true'' underlying galaxy dipole and the dipoles obtained for clusters and for the flux--limited galaxy samples. The results of this analysis demonstrate that the dipoles of both the IRAS and QDOT--like catalogues should trace the full 3D dipole shape fairly accurately, with the loss however of about 15--20$\%$ of the total 3D dipole amplitude. Furthermore, using a simple argument based on linear perturbation theory, on the linear biasing assumption and on the amplitude of the cluster dipole relative to that of galaxies, we can estimate their relative biasing factors quite accurately and in agreement with results obtained by other methods.

The problem of estimating cosmological parameters such as $\Omega$ from noisy or incomplete data is an example of an inverse problem and, as such, generally requires a probablistic approach. We adopt the Bayesian interpretation of probability for such problems and stress the connection between probability and information which this approach makes explicit. This connection is important even when information is ``minimal'' or, in other words, when we need to argue from a state of maximum ignorance. We use the transformation group method of Jaynes to assign minimally--informative prior probability measure for cosmological parameters in the simple example of a dust Friedman model, showing that the usual statements of the cosmological flatness problem are based on an inappropriate choice of prior. We further demonstrate that, in the framework of a classical cosmological model, there is no flatness problem.

We study the dipole for a redshift sample of Abell/ACO clusters. To elucidate the constraints it places on dark matter models, we use numerical simulations based on the Zel'dovich approximation. We run 20 realizations of each of six different dark matter models: four of these have a density parameter $\Omega_0=1$, while the other two have $\Omega_0=0.2$, one with and one without a cosmological constant term. For the Abell/ACO sample, we evaluate the parameter $\beta=\Omega_0^{0.6}/b_{ cl}$, which reaches its asymptotic value at $R=160 Mpc/h$. We find $\beta=0.15\pm 0.04$ and $0.25\pm 0.06$ in LG and CMB frames respectively. After identifying in the simulations LG-like observers, we construct mock cluster samples. We find that an alignment between the cluster dipole and observer velocity, such as that observed (about 20 degrees) should not be expected necessarily in the simulations. This, together with the large observer-to-observer variance estimates of $\beta$, makes it difficult to place any firm constraints on cosmological models. Our results demonstrate that the large amplitude and convergence depth of the cluster dipole cannot be taken as strong evidence either for or against a low--density Universe.

We present simulations of the cluster distribution in several dark matter models, using an optimized version of the truncated Zel'dovich approximation (TZA). We compare them with N-body cluster simulations and find that the TZA provides a very accurate description of the cluster distribution as long as fluctuations on the cluster mass scale are in the mildly non-linear regime. The simulated dark matter models are: Standard CDM (SCDM), Tilted CDM (TCDM) with n=0.7, Cold+Hot DM (CHDM) with 30% of hot component, low Hubble constant (h=0.3) CDM (LOWH) and a spatially flat low-density CDM model with \Omega_0=0.2. We compare the simulations with a redshift sample of Abell/ACO clusters, using the integral of the 2-point correlation function and the probability density function. We find that the best models at reproducing the data are CHDM and LCDM. All the other models are ruled out. The reduced skewness S_3 is fairly constant with S_3=1.9, independent of the DM model and consistent with observational data. The abundances of clusters predicted using the Press--Schechter theory provide strong constraints: only the CHDM, LOWH and LCDM models appear to produce the correct number-density of clusters.

We discuss various analytical approximation methods for following the evolution of cosmological density perturbations into the strong (i.e. nonlinear) clustering regime. These methods can be classified into five types: (i) simple extrapolations from linear theory, such as the high--peak model and the lognormal model; (ii) {\em dynamical} approximations, including the Zel'dovich approximation and its extensions; (iii) non--linear models based on purely geometric considerations, of which the main example is the Voronoi model; (iv) statistical solutions involving scaling arguments, such as the hierarchical closure {\em ansatz} for BBGKY, fractal models and the thermodynamic model of Saslaw; (v) numerical techniques based on particles and/or hydrodynamics. We compare the results of full dynamical evolution using particle codes and the various other approximation schemes. To put the models we discuss into perspective, we give a brief review of the observed properties of galaxy clustering and the statistical methods used to quantify it, such as correlation functions, power spectra, topology and spanning trees.

We estimate the variance and the skewness of the cluster distribution in several dark matter (DM) models. The cluster simulations are based on the Zel'dovich approximation, the low computational cost of which allows us to run 50 random realizations of each model. We compare our results with those coming from a similar analysis of a redshift sample of Abell/ACO clusters. Within the list of the considered models, we find that only the model based on Cold+Hot DM (with $\Omega_{\rm hot}=0.3$) provides a good fit to the data. The standard CDM model and the low-density ($\Omega_{\circ}=0.2$) CDM models, both with and without a cosmological constant term ($\Omega_\Lambda =0.8$) are ruled out. The tilted CDM model with primordial spectral index $n=0.7$ and a low Hubble constant ($h=0.3$) CDM model are only marginally consistent with the data.

We present extended simulations of the distribution of galaxy clusters in different dark matter models, using an optimized version of the Zel'dovich approximation. Six different dark matter models are studied: Standard CDM, Open CDM, Tilted CDM, Cold + Hot DM, low-density CDM with cosmological constant, and low Hubble constant ($h=0.3$) CDM. We compare simulations with an Abell/ACO redshift sample. We find that the models that best reproduce the clustering of the real data sets are the Cold + Hot DM model and the CDM model with a cosmological constant. The probability density function of all models and data is always well approximated by a lognormal distribution. We also find that the linear biasing parameter for the simulated clusters is nearly constant over a large range of scales, but its value depends on the model. We also note that the abundances of clusters predicted by the Press-Schechter theory provide strong constraints on these models: only the Cold + Hot DM model and the low-H CDM model appear to produce the correct number-density of clusters. Taking this constraint together with the cluster clustering statistics leads one to conclude that the best of our models is the Cold + Hot DM scenario.

We show how to simulate the clustering of rich clusters of galaxies using a technique based on the Zel'dovich approximation. This method well reproduces the spatial distribution of clusters obtainable from full N-body simulations at a fraction of the computational cost. We use an ensemble of large--scale simulations to assess the level and statistical significance of cluster clustering in open, tilted and flat versions of the Cold Dark Matter (CDM) model, as well as a model comprising a mixture of Cold and Hot Dark Matter (CHDM). We find the open and flat CDM models are excluded by the data. The tilted CDM model with a slight tilt is in marginal agreement, while larger tilt produces the right amount of clustering; CHDM is the best of all our models at reproducing the observations of cluster clustering. We find that {\em all} our models display a systematically weaker relationship between clustering length and mean cluster separation than seems to be implied by observations. We also note that the cluster bias factor, is not constant in any of the models, showing that one needs to be very careful when relating cluster clustering statistics to primordial density fluctuations.

We discuss the influence of gravitational waves (GWs) upon the polarisation of the Cosmic Microwave Background Radiation (CMBR). We show how to compute the {\em rms} temperature anisotropy and polarisation of the CMBR induced by GWs of arbitrary wavelength. We find that the ratio of polarisation, $\Pi$, to anisotropy, $A$, can be as large as $\sim 40$\%, but is sensitively dependent upon the GW spectrum and the cosmological ionisation history. We argue that CMBR polarisation measurements can provide useful constraints on cosmological models.

We consider a weighted biasing scheme for galaxy clustering. This differs from previous treatments in the fact that the biased density field coincides with the background mass--density whenever the latter exceeds a given threshold value. There is some physical motivation for this scheme and it is in better accord with intuitive ideas than models based on the Kaiser (1984) analysis of the clustering of rich clusters. We explain how different classes of object could be biased in different ways with respect to the underlying density distribution but still have $b=1$. We also show that if one applies our scheme consistently a weak dependence of $b$ upon density can be implied. This could also be the reason why the correlation function of galaxies in groups does not differ substantially from the correlation function of all galaxies.

We investigate the evolution of the skewness of the distribution of density fluctuations in CDM models with both Gaussian and non--Gaussian initial fluctuations. We show that the method proposed by Coles \& Frenk (1991), which uses the skewness of galaxy counts to test the hypothesis of Gaussian primordial density fluctuations, is a potentially powerful probe of initial conditions. As expected, the mass distribution in models with initially non--Gaussian fluctuations shows systematic departures from the Gaussian behaviour on intermediate to large scales. We investigate the effect of peculiar velocity distortions and normalisation upon the relationship between skewness and variance. These effects are generally small for the models we consider. Comparing our results to the QDOT measurements of the skewness, we find that our initially positive--skew models are clearly excluded by this analysis, but the available data do not rule out the negative--skew models.

We perform a detailed investigation of the statistical properties of the projected distribution of galaxy clusters obtained in Cold Dark Matter (CDM) models with both Gaussian and skewed primordial density fluctuations. We use N-body simulations to construct a set artificial Lick maps. An objective cluster--finding algorithm is used to identify clusters of different richness. For Gaussian models, the overall number of clusters is too small in the standard CDM case, but a model with higher normalisation fares much better; non--Gaussian models with negative skewness also fit faily well. We apply several statistical tests to compare real and simulated cluster samples, such as the 2-point correlation function, the minimal spanning tree construction, the multifractal analysis and the skewness of cell counts. The emerging picture is that Gaussian models, even with a higher normalization, are in trouble. Skew-positive models are also ruled out, while skew-negative models can reproduce the observed clustering of galaxy clusters in the CDM framework.

We generate artificial Lick maps using $N$--body simulations and compare the angular correlation function, $w(\vartheta)$, measured from the simulations with the APM correlation. For the Gaussian CDM model, neither the standard biassed model nor a more evolved model (as suggested by the COBE data), reproduce the correlations on large angular scales. We come to a similar conclusion about CDM models with positively skewed initial fluctuation distributions. In contrast, models with initially negatively skewed fluctuations produce a $w(\vartheta)$ that declines much more gently on large scales. Such models are therefore in principle capable of reconciling the lack of large--scale power of the CDM spectrum with the observed clustering of APM galaxies.