Future Square Kilometre Array (SKA) surveys are expected to generate huge datasets of 21cm maps on cosmological scales from the Epoch of Reionization (EoR). We assess the viability of exploiting machine learning techniques, namely, convolutional neural networks (CNN), to simultaneously estimate the astrophysical and cosmological parameters from 21cm maps from semi-numerical simulations. We further convert the simulated 21cm maps into SKA-like mock maps using the detailed SKA antennae distribution, thermal noise and a recipe for foreground cleaning. We successfully design two CNN architectures (VGGNet-like and ResNet-like) that are both efficiently able to extract simultaneously three astrophysical parameters, namely the photon escape fraction (f$_{\rm esc}$), the ionizing emissivity power dependence on halo mass ($C_{\rm ion}$) and the ionizing emissivity redshift evolution index ($D_{\rm ion}$), and three cosmological parameters, namely the matter density parameter ($\Omega_{m}$), the dimensionless Hubble constant ($h$), and the matter fluctuation amplitude ($\sigma_{8}$), from 21cm maps at several redshifts. With the presence of noise from SKA, our designed CNNs are still able to recover these astrophysical and cosmological parameters with great accuracy ($R^{2} > 92\%$), improving to $R^{2} > 99\%$ towards low redshift and low neutral fraction values. Our results show that future 21cm observations can play a key role to break degeneracy between models and tightly constrain the astrophysical and cosmological parameters, using only few frequency channels.

The Square Kilometre Array (SKA) is a planned large radio interferometer designed to operate over a wide range of frequencies, and with an order of magnitude greater sensitivity and survey speed than any current radio telescope. The SKA will address many important topics in astronomy, ranging from planet formation to distant galaxies. However, in this work, we consider the perspective of the SKA as a facility for studying physics. We review four areas in which the SKA is expected to make major contributions to our understanding of fundamental physics: cosmic dawn and reionisation; gravity and gravitational radiation; cosmology and dark energy; and dark matter and astroparticle physics. These discussions demonstrate that the SKA will be a spectacular physics machine, which will provide many new breakthroughs and novel insights on matter, energy and spacetime.

The apparent sizes and brightnesses of galaxies are correlated in a dipolar pattern around matter overdensities in redshift space, appearing larger on their near side and smaller on their far side. The opposite effect occurs for galaxies around an underdense region. These patterns of apparent magnification induce dipole and higher multipole terms in the cross-correlation of galaxy number density fluctuations with galaxy size/brightness (which is sensitive to the convergence field). This provides a means of directly measuring peculiar velocity statistics at low and intermediate redshift, with several advantages for performing cosmological tests of GR. In particular, it does not depend on empirically-calibrated scaling relations like the Tully-Fisher and Fundamental Plane methods. We show that the next generation of spectroscopic galaxy redshift surveys will be able to measure the Doppler magnification effect with sufficient signal-to-noise to test GR on large scales. We illustrate this with forecasts for the constraints that can be achieved on parametrised deviations from GR for forthcoming low-redshift galaxy surveys with DESI and SKA2. Although the cross-correlation statistic considered has a lower signal to noise than RSD, it will be a useful probe of GR since it is sensitive to different systematics.

We use machine learning to classify galaxies according to their HI content, based on both their optical photometry and environmental properties. The data used for our analyses are the outputs in the range $z = 0-1$ from MUFASA cosmological hydrodynamic simulation. In our previous paper, where we predicted the galaxy HI content using the same input features, HI rich galaxies were only selected for the training. In order for the predictions on real observation data to be more accurate, the classifiers built in this study will first establish if a galaxy is HI rich ($\rm{log(M_{HI}/M_{*})} > -2 $) before estimating its neutral hydrogen content using the regressors developed in the first paper. We resort to various machine learning algorithms and assess their performance with various metrics such as accuracy for instance. The performance of the classifiers gets better with increasing redshift and reaches their peak performance around $z = 1$. Random Forest method, the most robust among the classifiers when considering only the mock data for both training and test in this study, reaches an accuracy above $98.6 \%$ at $z = 0$ and above $99.0 \%$ at $z = 1$. We test our algorithms, trained with simulation data, on classification of the galaxies in RESOLVE, ALFALFA and GASS surveys. Interestingly, SVM algorithm, the best classifier for the tests, achieves a precision, the relevant metric for the tests, above $87.60\%$ and a specificity above $71.4\%$ with all the tests, indicating that the classifier is capable of learning from the simulated data to classify HI rich/HI poor galaxies from the real observation data. With the advent of large HI 21 cm surveys such as the SKA, this set of classifiers, together with the regressors developed in the first paper, will be part of a pipeline, a very useful tool, which is aimed at predicting HI content of galaxies.

We present a detailed overview of the cosmological surveys that will be carried out with Phase 1 of the Square Kilometre Array (SKA1), and the science that they will enable. We highlight three main surveys: a medium-deep continuum weak lensing and low-redshift spectroscopic HI galaxy survey over 5,000 sqdeg; a wide and deep continuum galaxy and HI intensity mapping survey over 20,000 sqdeg from z = 0.35 - 3; and a deep, high-redshift HI intensity mapping survey over 100 sqdeg from z = 3 - 6. Taken together, these surveys will achieve an array of important scientific goals: measuring the equation of state of dark energy out to z ~ 3 with percent-level precision measurements of the cosmic expansion rate; constraining possible deviations from General Relativity on cosmological scales by measuring the growth rate of structure through multiple independent methods; mapping the structure of the Universe on the largest accessible scales, thus constraining fundamental properties such as isotropy, homogeneity, and non-Gaussianity; and measuring the HI density and bias out to z = 6. These surveys will also provide highly complementary clustering and weak lensing measurements that have independent systematic uncertainties to those of optical surveys like LSST and Euclid, leading to a multitude of synergies that can improve constraints significantly beyond what optical or radio surveys can achieve on their own. This document, the 2018 Red Book, provides reference technical specifications, cosmological parameter forecasts, and an overview of relevant systematic effects for the three key surveys, and will be regularly updated by the Cosmology Science Working Group in the run up to start of operations and the Key Science Programme of SKA1.

Relativistic contributions to the dynamics of structure formation come in a variety of forms, and can potentially give corrections to the standard picture on typical scales of 100 Mpc. These corrections cannot be obtained by Newtonian numerical simulations, so it is important to accurately estimate the magnitude of these relativistic effects. Density fluctuations couple to produce a background of gravitational waves, which is larger than any primordial background. A similar interaction produces a much larger spectrum of vector modes which represent the frame-dragging rotation of spacetime. These can change the metric at the percent level in the concordance model at scales below the equality scale. Vector modes modify the lensing of background galaxies by large-scale structure. This gives in principle the exciting possibility of measuring relativistic frame dragging effects on cosmological scales. The effects of the non-linear tensor and vector modes on the cosmic convergence are computed and compared to first-order lensing contributions from density fluctuations, Doppler lensing, and smaller Sachs-Wolfe effects. The lensing from gravitational waves is negligible so we concentrate on the vector modes. We show the relative importance of this for future surveys such as Euclid and SKA. We find that these non-linear effects only marginally affect the overall weak lensing signal so they can safely be neglected in most analyses, though are still much larger than the linear Sachs-Wolfe terms. The second-order vector contribution can dominate the first-order Doppler lensing term at moderate redshifts and are actually more important for survey geometries like the SKA.

We develop a machine learning-based framework to predict the HI content of galaxies using more straightforwardly observable quantities such as optical photometry and environmental parameters. We train the algorithm on z=0-2 outputs from the Mufasa cosmological hydrodynamic simulation, which includes star formation, feedback, and a heuristic model to quench massive galaxies that yields a reasonable match to a range of survey data including HI. We employ a variety of machine learning methods (regressors), and quantify their performance using the root mean square error ({\sc rmse}) and the Pearson correlation coefficient (r). Considering SDSS photometry, 3$^{rd}$ nearest neighbor environment and line of sight peculiar velocities as features, we obtain r $> 0.8$ accuracy of the HI-richness prediction, corresponding to {\sc rmse}$<0.3$. Adding near-IR photometry to the features yields some improvement to the prediction. Compared to all the regressors, random forest shows the best performance, with r $>0.9$ at $z=0$, followed by a Deep Neural Network with r $>0.85$. All regressors exhibit a declining performance with increasing redshift, which limits the utility of this approach to $z\la 1$, and they tend to somewhat over-predict the HI content of low-HI galaxies which might be due to Eddington bias in the training sample. We test our approach on the RESOLVE survey data. Training on a subset of RESOLVE data, we find that our machine learning method can reasonably well predict the HI-richness of the remaining RESOLVE data, with {\sc rmse}$\sim0.28$. When we train on mock data from Mufasa and test on RESOLVE, this increases to {\sc rmse}$\sim0.45$. Our method will be useful for making galaxy-by-galaxy survey predictions and incompleteness corrections for upcoming HI 21cm surveys such as the LADUMA and MIGHTEE surveys on MeerKAT, over regions where photometry is already available.

Objects falling into an overdensity appear larger on its near side and smaller on its far side than other objects at the same redshift. This produces a dipolar pattern of magnification, primarily as a consequence of the Doppler effect. At low redshift this Doppler magnification completely dominates the usual integrated gravitational lensing contribution to the lensing magnification. We show that one can optimally observe this pattern by extracting the dipole in the cross-correlation of number counts and galaxy sizes. This dipole allows us to almost completely remove the contribution from gravitational lensing up to redshift 0.5, and even at high redshift z~1 the dipole picks up the Doppler magnification predominantly. Doppler magnification should be easily detectable in current and upcoming optical and radio surveys; by forecasting for telescopes such as the SKA, we show that this technique is competitive with using peculiar velocities via redshift-space distortions to constrain dark energy. It produces similar yet complementary constraints on the cosmological model to those found using measurements of the cosmic shear.

Doppler lensing is the apparent change in object size and magnitude due to peculiar velocities. Objects falling into an overdensity appear larger on its near side, and smaller on its far side, than typical objects at the same redshifts. This effect dominates over the usual gravitational lensing magnification at low redshift. Doppler lensing is a promising new probe of cosmology, and we explore in detail how to utilize the effect with forthcoming surveys. We present cosmological simulations of the Doppler and gravitational lensing effects based on the Millennium simulation. We show that Doppler lensing can be detected around stacked voids or unvirialised over-densities. New power spectra and correlation functions are proposed which are designed to be sensitive to Doppler lensing. We consider the impact of gravitational lensing and intrinsic size correlations on these quantities. We compute the correlation functions and forecast the errors for realistic forthcoming surveys, providing predictions for constraints on cosmological parameters. Finally, we demonstrate how we can make 3-D potential maps of large volumes of the Universe using Doppler lensing.

We use the Galaxies-Intergalactic Medium Interaction Calculation (GIMIC) cosmological hydrodynamic simulation at z=0 to study the distribution and environmental dependence of neutral hydrogen (HI) gas in the outskirts of simulated galaxies. This gas can currently be probed directly in, for example, Ly$\alpha$ absorption via the observation of background quasars. Radio facilities, such as the Square Kilometre Array, will provide a complementary probe of the diffuse HI in emission and will constrain the physics underpinning the complex interplay between accretion and feedback mechanisms which affect the intergalactic medium. We extract a sample of 488 galaxies from a re-simulation of the average cosmic density GIMIC region. We estimate the neutral hydrogen content of these galaxies and the surrounding intergalactic medium within which they reside. We investigate the average HI radial profiles by stacking the individual profiles according to both mass and environment. We find high HI column densities at large impact parameters in group environments and markedly lower HI densities for non-group galaxies. We suggest that these results likely arise from the combined effects of ram pressure stripping and tidal interactions present in group environments.