We explore a new Bayesian method of detecting galaxies from radio interferometric data of the faint sky. Working in the Fourier domain, we fit a single, parameterised galaxy model to simulated visibility data of star-forming galaxies. The resulting multimodal posterior distribution is then sampled using a multimodal nested sampling algorithm such as MultiNest. For each galaxy, we construct parameter estimates for the position, flux, scale-length and ellipticities from the posterior samples. We first test our approach on simulated SKA1-MID visibility data of up to 100 galaxies in the field of view, considering a typical weak lensing survey regime (SNR $\ge 10$) where 98% of the input galaxies are detected with no spurious source detections. We then explore the low SNR regime, finding our approach reliable in galaxy detection and providing in particular high accuracy in positional estimates down to SNR $\sim 5$. The presented method does not require transformation of visibilities to the image domain, and requires no prior knowledge of the number of galaxies in the field of view, thus could become a useful tool for constructing accurate radio galaxy catalogs in the future.

We present a detailed overview of the cosmological surveys that will be carried out with Phase 1 of the Square Kilometre Array (SKA1), and the science that they will enable. We highlight three main surveys: a medium-deep continuum weak lensing and low-redshift spectroscopic HI galaxy survey over 5,000 sqdeg; a wide and deep continuum galaxy and HI intensity mapping survey over 20,000 sqdeg from z = 0.35 - 3; and a deep, high-redshift HI intensity mapping survey over 100 sqdeg from z = 3 - 6. Taken together, these surveys will achieve an array of important scientific goals: measuring the equation of state of dark energy out to z ~ 3 with percent-level precision measurements of the cosmic expansion rate; constraining possible deviations from General Relativity on cosmological scales by measuring the growth rate of structure through multiple independent methods; mapping the structure of the Universe on the largest accessible scales, thus constraining fundamental properties such as isotropy, homogeneity, and non-Gaussianity; and measuring the HI density and bias out to z = 6. These surveys will also provide highly complementary clustering and weak lensing measurements that have independent systematic uncertainties to those of optical surveys like LSST and Euclid, leading to a multitude of synergies that can improve constraints significantly beyond what optical or radio surveys can achieve on their own. This document, the 2018 Red Book, provides reference technical specifications, cosmological parameter forecasts, and an overview of relevant systematic effects for the three key surveys, and will be regularly updated by the Cosmology Science Working Group in the run up to start of operations and the Key Science Programme of SKA1.

Radio weak lensing, while a highly promising complementary probe to optical weak lensing, will require incredible precision in the measurement of galaxy shape parameters. In this paper, we extend the Bayesian Inference for Radio Observations model fitting approach to measure galaxy shapes directly from visibility data of radio continuum surveys, instead of from image data. We apply a Hamiltonian Monte Carlo (HMC) technique for sampling the posterior, which is more efficient than the standard Monte Carlo Markov Chain method when dealing with a large dimensional parameter space. Adopting the exponential profile for galaxy model fitting allows us to analytically calculate the likelihood gradient required by HMC, allowing a faster and more accurate sampling. The method is tested on SKA1-MID simulated observations at 1.4 GHz of a field containing up to 1000 star-forming galaxies. It is also applied to a simulated observation of the weak lensing precursor survey SuperCLASS. In both cases we obtain reliable measurements of the galaxies' ellipticity and size for all sources with SNR $\ge 10$, and we also find relationships between the convergence properties of the HMC technique and some source parameters. Direct shape measurement in the visibility domain achieves high accuracy at the expected source number densities of the current and next SKA precursor continuum surveys. The proposed method can be easily extended for the fitting of other galaxy and scientific parameters, as well as simultaneously marginalising over systematic and instrumental effects.

This paper extends the method introduced in Rivi et al. (2016b) to measure galaxy ellipticities in the visibility domain for radio weak lensing surveys. In that paper we focused on the development and testing of the method for the simple case of individual galaxies located at the phase centre, and proposed to extend it to the realistic case of many sources in the field of view by isolating visibilities of each source with a faceting technique. In this second paper we present a detailed algorithm for source extraction in the visibility domain and show its effectiveness as a function of the source number density by running simulations of SKA1-MID observations in the band 950-1150 MHz and comparing original and measured values of galaxies' ellipticities. Shear measurements from a realistic population of 10^4 galaxies randomly located in a field of view of 1 deg^2 (i.e. the source density expected for the current radio weak lensing survey proposal with SKA1) are also performed. At SNR >= 10, the multiplicative bias is only a factor 1.5 worse than what found when analysing individual sources, and is still comparable to the bias values reported for similar measurement methods at optical wavelengths. The additive bias is unchanged from the case of individual sources, but is significantly larger than typically found in optical surveys. This bias depends on the shape of the uv coverage and we suggest that a uv-plane weighting scheme to produce a more isotropic shape could reduce and control additive bias.

The high sensitivity of the new generation of radio telescopes such as the Square Kilometre Array (SKA) will allow cosmological weak lensing measurements at radio wavelengths that are competitive with optical surveys. We present an adaptation to radio data of lensfit, a method for galaxy shape measurement originally developed and used for optical weak lensing surveys. This likelihood method uses an analytical galaxy model and makes a Bayesian marginalisation of the likelihood over uninteresting parameters. It has the feature of working directly in the visibility domain, which is the natural approach to adopt with radio interferometer data, avoiding systematics introduced by the imaging process. As a proof of concept, we provide results for visibility simulations of individual galaxies with flux density S >= 10 muJy at the phase centre of the proposed SKA1-MID baseline configuration, adopting 12 frequency channels in the band 950 - 1190 MHz. Weak lensing shear measurements from a population of galaxies with realistic flux and scalelength distributions are obtained after natural gridding of the raw visibilities. Shear measurements are expected to be affected by "noise bias": we estimate the bias in the method as a function of signal-to-noise ratio (SNR). We obtain additive and multiplicative bias values that are comparable to SKA1 requirements for SNR > 18 and SNR > 30, respectively. The multiplicative bias for SNR > 10 is comparable to that found in ground-based optical surveys such as CFHTLenS, and we anticipate that similar shear measurement calibration strategies to those used for optical surveys may be used to good effect in the analysis of SKA radio interferometer data.

With the increasing size and complexity of data produced by large scale numerical simulations, it is of primary importance for scientists to be able to exploit all available hardware in heterogenous High Performance Computing environments for increased throughput and efficiency. We focus on the porting and optimization of Splotch, a scalable visualization algorithm, to utilize the Xeon Phi, Intel's coprocessor based upon the new Many Integrated Core architecture. We discuss steps taken to offload data to the coprocessor and algorithmic modifications to aid faster processing on the many-core architecture and make use of the uniquely wide vector capabilities of the device, with accompanying performance results using multiple Xeon Phi. Finally performance is compared against results achieved with the GPU implementation of Splotch.

Observationally, weak lensing has been served so far by optical surveys due to the much larger number densities of background galaxies achieved, which is typically by two to three orders of magnitude compared to radio. However, the high sensitivity of the new generation of radio telescopes such as the Square Kilometre Array (SKA) will provide a density of detected galaxies that is comparable to that found at optical wavelengths, and with significant source shape measurements to make large area radio surveys competitive for weak lensing studies. This will lead weak lensing to become one of the primary science drivers in radio surveys too, with the advantage that they will access the largest scales in the Universe going beyond optical surveys, like LSST and Euclid, in terms of redshifts that are probed. RadioLensfit is an adaptation to radio data of "lensfit", a model-fitting approach for galaxy shear measurement, originally developed for optical weak lensing surveys. Its key advantage is working directly in the visibility domain, which is the natural approach to adopt with radio data, avoiding systematics due to the imaging process. We present results on galaxy shear measurements, including investigation of sensitivity to instrumental parameters such as the visibilities gridding size, based on simulations of individual galaxy visibilities performed by using SKA1-MID baseline configuration. We get an amplitude of the shear bias in the method comparable with SKA1 requirements for a population of galaxies with realistic flux and scalelength distributions estimated from the VLA SWIRE catalog.

Splotch is a rendering algorithm for exploration and visual discovery in particle-based datasets coming from astronomical observations or numerical simulations. The strengths of the approach are production of high quality imagery and support for very large-scale datasets through an effective mix of the OpenMP and MPI parallel programming paradigms. This article reports our experiences in re-designing Splotch for exploiting emerging HPC architectures nowadays increasingly populated with GPUs. A performance model is introduced for data transfers, computations and memory access, to guide our re-factoring of Splotch. A number of parallelization issues are discussed, in particular relating to race conditions and workload balancing, towards achieving optimal performances. Our implementation was accomplished by using the CUDA programming paradigm. Our strategy is founded on novel schemes achieving optimized data organisation and classification of particles. We deploy a reference simulation to present performance results on acceleration gains and scalability. We finally outline our vision for future work developments including possibilities for further optimisations and exploitation of emerging technologies.

The scientific community is presently witnessing an unprecedented growth in the quality and quantity of data sets coming from simulations and real-world experiments. To access effectively and extract the scientific content of such large-scale data sets (often sizes are measured in hundreds or even millions of Gigabytes) appropriate tools are needed. Visual data exploration and discovery is a robust approach for rapidly and intuitively inspecting large-scale data sets, e.g. for identifying new features and patterns or isolating small regions of interest within which to apply time-consuming algorithms. This paper presents a high performance parallelized implementation of Splotch, our previously developed visual data exploration and discovery algorithm for large-scale astrophysical data sets coming from particle-based simulations. Splotch has been improved in order to exploit modern massively parallel architectures, e.g. multicore CPUs and CUDA-enabled GPUs. We present performance and scalability benchmarks on a number of test cases, demonstrating the ability of our high performance parallelized Splotch to handle efficiently large-scale data sets, such as the outputs of the Millennium II simulation, the largest cosmological simulation ever performed.