The Square Kilometre Array (SKA) is a planned large radio interferometer designed to operate over a wide range of frequencies, and with an order of magnitude greater sensitivity and survey speed than any current radio telescope. The SKA will address many important topics in astronomy, ranging from planet formation to distant galaxies. However, in this work, we consider the perspective of the SKA as a facility for studying physics. We review four areas in which the SKA is expected to make major contributions to our understanding of fundamental physics: cosmic dawn and reionisation; gravity and gravitational radiation; cosmology and dark energy; and dark matter and astroparticle physics. These discussions demonstrate that the SKA will be a spectacular physics machine, which will provide many new breakthroughs and novel insights on matter, energy and spacetime.

The future of precision cosmology could benefit from cross-correlations between intensity maps of unresolved neutral hydrogen (HI) and more conventional optical galaxy surveys. A major challenge that needs to be overcome is removing the 21cm foreground emission that contaminates the cosmological HI signal. Using N-body simulations we simulate HI intensity maps and optical catalogues which share the same underlying cosmology. Adding simulated foreground contamination and using state-of-the-art reconstruction techniques we investigate the impacts that 21cm foregrounds and other systematics have on these cross-correlations. We find that the impact a FASTICA 21cm foreground clean has on the cross-correlations with spectroscopic optical surveys with well-constrained redshifts is minimal. However, problems arise when photometric surveys are considered: we find that a redshift uncertainty {\sigma}_z {\geq} 0.04 causes significant degradation in the cross power spectrum signal. We diagnose the main root of these problems, which relates to arbitrary amplitude changes along the line-of-sight in the intensity maps caused by the foreground clean and suggest solutions which should be applicable to real data. These solutions involve a reconstruction of the line-of-sight temperature means using the available overlapping optical data along with an artificial extension to the HI data through redshift to address edge effects. We then put these solutions through a further test in a mock experiment that uses a clustering-based redshift estimation technique to constrain the photometric redshifts of the optical sample. We find that with our suggested reconstruction, cross-correlations can be utilized to make an accurate prediction of the optical redshift distribution.

We present a detailed overview of the cosmological surveys that will be carried out with Phase 1 of the Square Kilometre Array (SKA1), and the science that they will enable. We highlight three main surveys: a medium-deep continuum weak lensing and low-redshift spectroscopic HI galaxy survey over 5,000 sqdeg; a wide and deep continuum galaxy and HI intensity mapping survey over 20,000 sqdeg from z = 0.35 - 3; and a deep, high-redshift HI intensity mapping survey over 100 sqdeg from z = 3 - 6. Taken together, these surveys will achieve an array of important scientific goals: measuring the equation of state of dark energy out to z ~ 3 with percent-level precision measurements of the cosmic expansion rate; constraining possible deviations from General Relativity on cosmological scales by measuring the growth rate of structure through multiple independent methods; mapping the structure of the Universe on the largest accessible scales, thus constraining fundamental properties such as isotropy, homogeneity, and non-Gaussianity; and measuring the HI density and bias out to z = 6. These surveys will also provide highly complementary clustering and weak lensing measurements that have independent systematic uncertainties to those of optical surveys like LSST and Euclid, leading to a multitude of synergies that can improve constraints significantly beyond what optical or radio surveys can achieve on their own. This document, the 2018 Red Book, provides reference technical specifications, cosmological parameter forecasts, and an overview of relevant systematic effects for the three key surveys, and will be regularly updated by the Cosmology Science Working Group in the run up to start of operations and the Key Science Programme of SKA1.

HI intensity mapping data traces the large-scale structure matter distribution using the integrated emission of neutral hydrogen gas (HI). The cross-correlation of the intensity maps with optical galaxy surveys can mitigate foreground and systematic effects, but has been shown to significantly depend on galaxy evolution parameters of the HI and the optical sample. Previously, we have shown that the shot noise of the cross-correlation scales with the HI content of the optical samples, such that the shot noise estimation infers the average HI masses of these samples. In this article, we present an adaptive framework for the cross-correlation of HI intensity maps with galaxy samples using our implementation of the halo model formalism (Murray et al 2018, in prep) which utilises the halo occupation distribution of galaxies to predict their power spectra. We compare two HI population models, tracing the spatial halo and the galaxy distribution respectively, and present their auto- and cross-power spectra with an associated galaxy sample. We find that the choice of the HI model and the distribution of the HI within the galaxy sample have minor significance for the shape of the auto- and cross-correlations, but highly impact the measured shot noise amplitude of the estimators, a finding we confirm with simulations. We demonstrate parameter estimation of the HI halo occupation models and advocate this framework for the interpretation of future experimental data, with the prospect of determining the HI masses of optical galaxy samples via the cross-correlation shot noise.

We report results from 21-cm intensity maps acquired from the Parkes radio telescope and cross-correlated with galaxy maps from the 2dF galaxy survey. The data span the redshift range $0.057<z<0.098$ and cover approximately 1,300 square degrees over two long fields. Cross correlation is detected at a significance of $5.18\sigma$. The amplitude of the cross-power spectrum is low relative to the expected dark matter power spectrum, assuming a neutral hydrogen (HI) bias and mass density equal to measurements from the ALFALFA survey. The decrement is pronounced and statistically significant at small scales. At $k\sim1.5$ $ h \mathrm{Mpc^{-1}}$, the cross power spectrum is more than a factor of 6 lower than expected, with a significance of $14.8\,\sigma$. This decrement indicates either a lack of clustering of neutral hydrogen (HI), a small correlation coefficient between optical galaxies and HI, or some combination of the two. Separating 2dF into red and blue galaxies, we find that red galaxies are much more weakly correlated with HI on $k\sim1.5$ $h \mathrm{Mpc^{-1}}$ scales, suggesting that HI is more associated with blue star-forming galaxies and tends to avoid red galaxies.

Following the first two annual intensity mapping workshops at Stanford in March 2016 and Johns Hopkins in June 2017, we report on the recent advances in theory, instrumentation and observation that were presented in these meetings and some of the opportunities and challenges that were identified looking forward. With preliminary detections of CO, [CII], Lya and low-redshift 21cm, and a host of experiments set to go online in the next few years, the field is rapidly progressing on all fronts, with great anticipation for a flood of new exciting results. This current snapshot provides an efficient reference for experts in related fields and a useful resource for nonspecialists. We begin by introducing the concept of line-intensity mapping and then discuss the broad array of science goals that will be enabled, ranging from the history of star formation, reionization and galaxy evolution to measuring baryon acoustic oscillations at high redshift and constraining theories of dark matter, modified gravity and dark energy. After reviewing the first detections reported to date, we survey the experimental landscape, presenting the parameters and capabilities of relevant instruments such as COMAP, mmIMe, AIM-CO, CCAT-p, TIME, CONCERTO, CHIME, HIRAX, HERA, STARFIRE, MeerKAT/SKA and SPHEREx. Finally, we describe recent theoretical advances: different approaches to modeling line luminosity functions, several techniques to separate the desired signal from foregrounds, statistical methods to analyze the data, and frameworks to generate realistic intensity map simulations.

We discuss the ground-breaking science that will be possible with a wide area survey, using the MeerKAT telescope, known as MeerKLASS (MeerKAT Large Area Synoptic Survey). The current specifications of MeerKAT make it a great fit for science applications that require large survey speeds but not necessarily high angular resolutions. In particular, for cosmology, a large survey over $\sim 4,000 \, {\rm deg}^2$ for $\sim 4,000$ hours will potentially provide the first ever measurements of the baryon acoustic oscillations using the 21cm intensity mapping technique, with enough accuracy to impose constraints on the nature of dark energy. The combination with multi-wavelength data will give unique additional information, such as exquisite constraints on primordial non-Gaussianity using the multi-tracer technique, as well as a better handle on foregrounds and systematics. Such a wide survey with MeerKAT is also a great match for HI galaxy studies, providing unrivalled statistics in the pre-SKA era for galaxies resolved in the HI emission line beyond local structures at z > 0.01. It will also produce a large continuum galaxy sample down to a depth of about 5\,$\mu$Jy in L-band, which is quite unique over such large areas and will allow studies of the large-scale structure of the Universe out to high redshifts, complementing the galaxy HI survey to form a transformational multi-wavelength approach to study galaxy dynamics and evolution. Finally, the same survey will supply unique information for a range of other science applications, including a large statistical investigation of galaxy clusters as well as produce a rotation measure map across a huge swathe of the sky. The MeerKLASS survey will be a crucial step on the road to using SKA1-MID for cosmological applications and other commensal surveys, as described in the top priority SKA key science projects (abridged).

Modern radio telescopes, such as the Square Kilometre Array (SKA), will probe the radio sky over large fields-of-view, which results in large w-modulations of the sky image. This effect complicates the relationship between the measured visibilities and the image under scrutiny. In algorithmic terms, it gives rise to massive memory and computational time requirements. Yet, it can be a blessing in terms of reconstruction quality of the sky image. In recent years, several works have shown that large w-modulations promote the spread spectrum effect. Within the compressive sensing framework, this effect increases the incoherence between the sensing basis and the sparsity basis of the signal to be recovered, leading to better estimation of the sky image. In this article, we revisit the w-projection approach using convex optimisation in realistic settings, where the measurement operator couples the w-terms in Fourier and the de-gridding kernels. We provide sparse, thus fast, models of the Fourier part of the measurement operator through adaptive sparsification procedures. Consequently, memory requirements and computational cost are significantly alleviated, at the expense of introducing errors on the radio-interferometric data model. We present a first investigation of the impact of the sparse variants of the measurement operator on the image reconstruction quality. We finally analyse the interesting super-resolution potential associated with the spread spectrum effect of the w-modulation, and showcase it through simulations. Our C++ code is available online on GitHub.

We propose an innovative method for measuring the neutral hydrogen (HI) content of an optically-selected spectroscopic sample of galaxies through cross-correlation with HI intensity mapping measurements. We show that the HI-galaxy cross-power spectrum contains an additive shot noise term which scales with the average HI brightness temperature of the optically-selected galaxies, allowing constraints to be placed on the average HI mass per galaxy. This approach can estimate the HI content of populations too faint to directly observe through their 21cm emission over a wide range of redshifts. This cross-correlation, as a function of optical luminosity or colour, can be used to derive HI-scaling relations. We demonstrate that this signal will be detectable by cross-correlating upcoming Australian SKA Pathfinder (ASKAP) observations with existing optically-selected samples. We also use semi-analytic simulations to verify that the HI mass can be successfully recovered by our technique in the range M_HI > 10^8 M_solar, in a manner independent of the underlying power spectrum shape. We conclude that this method is a powerful tool to study galaxy evolution, which only requires a single intensity mapping dataset to infer complementary HI gas information from existing optical and infra-red observations.

We present the first application of a new foreground removal pipeline to the current leading HI intensity mapping dataset, obtained by the Green Bank Telescope (GBT). We study the 15hr and 1hr field data of the GBT observations previously presented in Masui et al (2013) and Switzer et al (2013), covering about 41 square degrees at 0.6<z<1.0, for which cross-correlations may be measured with the galaxy distribution of the WiggleZ Dark Energy Survey. In the presented pipeline, we subtract the Galactic foreground continuum and the point source contamination using an independent component analysis technique (fastica), and develop a Fourier-based optimal estimator to compute the temperature power spectrum of the intensity maps and cross-correlation with the galaxy survey data. We show that fastica is a reliable tool to subtract diffuse and point-source emission through the non-Gaussian nature of their probability distributions. The temperature power spectra of the intensity maps is dominated by instrumental noise on small scales which fastica, as a conservative subtraction technique of non-Gaussian signals, can not mitigate. However, we determine similar GBT-WiggleZ cross-correlation measurements to those obtained by the Singular Value Decomposition (SVD) method, and confirm that foreground subtraction with fastica is robust against 21cm signal loss, as seen by the converged amplitude of these cross-correlation measurements. We conclude that SVD and fastica are complementary methods to investigate the foregrounds and noise systematics present in intensity mapping datasets.

Intensity mapping of the neutral hydrogen (HI) is a new observational tool that can be used to efficiently map the large-scale structure of the Universe over wide redshift ranges. The power spectrum of the intensity maps contains cosmological information on the matter distribution and probes galaxy evolution by tracing the HI content of galaxies at different redshifts and the scale-dependence of HI clustering. The cross-correlation of intensity maps with galaxy surveys is a robust measure of the power spectrum which diminishes systematics caused by instrumental effects and foreground removal. We examine the cross-correlation signature at redshift z=0.9 using a variant of the semi-analytical galaxy formation model SAGE (Croton et al. 2016) applied to the Millennium simulation in order to model the HI gas of galaxies as well as their optical magnitudes based on their star-formation history. We determine the clustering of the cross-correlation power for different types of galaxies determined by their colours, acting as a proxy for their star-formation activity. We find that the cross-correlation coefficient for red quiescent galaxies falls off more quickly on smaller scales k>0.2h/Mpc than for blue star-forming galaxies. Additionally, we create a mock catalogue of highly star-forming galaxies using a selection function to mimic the WiggleZ survey, and use this to predict existing and future cross-correlation measurements of the GBT and Parkes telescope. We find that the cross-power of highly star-forming galaxies shows a higher clustering on small scales than any other galaxy type and that this significantly alters the power spectrum shape on scales k>0.2h/Mpc. We show that the cross-correlation coefficient is not negligible when interpreting the cosmological cross-power spectrum. On the other hand, it contains information about the HI content of the optically selected galaxies.

We address the problem of separating stars from galaxies in future large photometric surveys. We focus our analysis on simulations of the Dark Energy Survey (DES). In the first part of the paper, we derive the science requirements on star/galaxy separation, for measurement of the cosmological parameters with the Gravitational Weak Lensing and Large Scale Structure probes. These requirements are dictated by the need to control both the statistical and systematic errors on the cosmological parameters, and by Point Spread Function calibration. We formulate the requirements in terms of the completeness and purity provided by a given star/galaxy classifier. In order to achieve these requirements at faint magnitudes, we propose a new method for star/galaxy separation in the second part of the paper. We first use Principal Component Analysis to outline the correlations between the objects parameters and extract from it the most relevant information. We then use the reduced set of parameters as input to an Artificial Neural Network. This multi-parameter approach improves upon purely morphometric classifiers (such as the classifier implemented in SExtractor), especially at faint magnitudes: it increases the purity by up to 20% for stars and by up to 12% for galaxies, at i-magnitude fainter than 23.

HI intensity mapping (IM) is a novel technique capable of mapping the large-scale structure of the Universe in three dimensions and delivering exquisite constraints on cosmology, by using HI as a biased tracer of the dark matter density field. This is achieved by measuring the intensity of the redshifted 21cm line over the sky in a range of redshifts without the requirement to resolve individual galaxies. In this chapter, we investigate the potential of SKA1 to deliver HI intensity maps over a broad range of frequencies and a substantial fraction of the sky. By pinning down the baryon acoustic oscillation and redshift space distortion features in the matter power spectrum -- thus determining the expansion and growth history of the Universe -- these surveys can provide powerful tests of dark energy models and modifications to General Relativity. They can also be used to probe physics on extremely large scales, where precise measurements of spatial curvature and primordial non-Gaussianity can be used to test inflation; on small scales, by measuring the sum of neutrino masses; and at high redshifts where non-standard evolution models can be probed. We discuss the impact of foregrounds as well as various instrumental and survey design parameters on the achievable constraints. In particular we analyse the feasibility of using the SKA1 autocorrelations to probe the large-scale signal.

21cm intensity mapping experiments aim to observe the diffuse neutral hydrogen (HI) distribution on large scales which traces the Cosmic structure. The Square Kilometre Array (SKA) will have the capacity to measure the 21cm signal over a large fraction of the sky. However, the redshifted 21cm signal in the respective frequencies is faint compared to the Galactic foregrounds produced by synchrotron and free-free electron emission. In this article, we review selected foreground subtraction methods suggested to effectively separate the 21cm signal from the foregrounds with intensity mapping simulations or data. We simulate an intensity mapping experiment feasible with SKA phase 1 including extragalactic and Galactic foregrounds. We give an example of the residuals of the foreground subtraction with a independent component analysis and show that the angular power spectrum is recovered within the statistical errors on most scales. Additionally, the scale of the Baryon Acoustic Oscillations is shown to be unaffected by foreground subtraction.

Next-generation radio interferometric telescopes will exhibit non-coplanar baseline configurations and wide field-of-views, inducing a w-modulation of the sky image, which in turn induces the spread spectrum effect. We revisit the impact of this effect on imaging quality and study a new algorithmic strategy to deal with the associated operator in the image reconstruction process. In previous studies it has been shown that image recovery in the framework of compressed sensing is improved due to the spread spectrum effect, where the w-modulation can act to increase the incoherence between measurement and sparsifying signal representations. For the purpose of computational efficiency, idealised experiments were performed, where only a constant baseline component w in the pointing direction of the telescope was considered. We extend this analysis to the more realistic setting where the w-component varies for each visibility measurement. Firstly, incorporating varying w-components into imaging algorithms is a computational demanding task. We propose a variant of the w-projection algorithm for this purpose, which is based on an adaptive sparsification procedure, and incorporate it in compressed sensing imaging methods. This sparse matrix variant of the w-projection algorithm is generic and adapts to the support of each kernel. Consequently, it is applicable for all types of direction-dependent effects. Secondly, we show that for w-modulation with varying w-components, reconstruction quality is significantly improved compared to the setting where there is no w-modulation (i.e. w=0), reaching levels comparable to the quality of a constant, maximal w-component. This finding confirms that one may seek to optimise future telescope configurations to promote large w-components, thus enhancing the spread spectrum effect and consequently the fidelity of image reconstruction.

We model a 21 cm intensity mapping survey in the redshift range 0.01<z<1.5 designed to simulate the skies as seen by future radio telescopes such as the Square Kilometre Array (SKA), including instrumental noise and Galactic foregrounds. In our pipeline, we remove the introduced Galactic foregrounds with a fast independent component analysis (fastica) technique. We present the power spectrum of the large-scale matter distribution, C(l), before and after the application of this foreground removal method and calculate the resulting systematic errors. We attempt to reduce systematics in the foreground subtraction by optimally masking the maps to remove high foregrounds in the Galactic plane. Our simulations show a certain level of bias remains in the power spectrum at all scales l<400. At large-scales l<30 this bias is particularly significant. We measure the impact of these systematic effects in two different ways: firstly we fit cosmological parameters to the broadband shape of the power spectrum and secondly we extract the position of the Baryon Acoustic Oscillations (BAO). In the first analysis, we find that the systematics introduce an significant shift in the best fit cosmological parameters at the 2 to 3 sigma level which depends on the masking and noise levels. However, cosmic distances can be recovered in an unbiased way after foreground removal at all simulated redshifts by fitting the BAOs in the power spectrum. We conclude that further advances in foreground removal are needed in order to recover unbiased information from the broadband shape of the power spectrum, however, intensity mapping experiments will be a powerful tool for mapping cosmic distances across a wide redshift range.

We study the impact of the spread spectrum effect in radio interferometry on the quality of image reconstruction. This spread spectrum effect will be induced by the wide field-of-view of forthcoming radio interferometric telescopes. The resulting chirp modulation improves the quality of reconstructed interferometric images by increasing the incoherence of the measurement and sparsity dictionaries. We extend previous studies of this effect to consider the more realistic setting where the chirp modulation varies for each visibility measurement made by the telescope. In these first preliminary results, we show that for this setting the quality of reconstruction improves significantly over the case without chirp modulation and achieves almost the reconstruction quality of the case of maximal, constant chirp modulation.

We present a comparison of Fisher matrix forecasts for cosmological probes with Monte Carlo Markov Chain (MCMC) posterior likelihood estimation methods. We analyse the performance of future Dark Energy Task Force (DETF) stage-III and stage- IV dark-energy surveys using supernovae, baryon acoustic oscillations and weak lensing as probes. We concentrate in particular on the dark-energy equation of state parameters w0 and wa. For purely geometrical probes, and especially when marginalising over wa, we find considerable disagreement between the two methods, since in this case the Fisher matrix can not reproduce the highly non-elliptical shape of the likelihood function. More quantitatively, the Fisher method underestimates the marginalized errors for purely geometrical probes between 30%-70%. For cases including structure formation such as weak lensing, we find that the posterior probability contours from the Fisher matrix estimation are in good agreement with the MCMC contours and the forecasted errors only changing on the 5% level. We then explore non-linear transformations resulting in physically-motivated parameters and investigate whether these parameterisations exhibit a Gaussian behaviour. We conclude that for the purely geometrical probes and, more generally, in cases where it is not known whether the likelihood is close to Gaussian, the Fisher matrix is not the appropriate tool to produce reliable forecasts.