One of the most promising ways to observe the Universe is by detecting the 21cm emission from cosmic neutral hydrogen (HI) through radio-telescopes. Those observations can shed light on fundamental astrophysical questions only if accurate theoretical predictions are available. In order to maximize the scientific return of these surveys, those predictions need to include different observables and be precise on non-linear scales. Currently, one of the best ways to achieve this is via cosmological hydrodynamic simulations; however, the computational cost of these simulations is high -- tens of millions of CPU hours. In this work, we use Wasserstein Generative Adversarial Networks (WGANs) to generate new high-resolution ($35~h^{-1}{\rm kpc}$) 3D realizations of cosmic HI at $z=5$. We do so by sampling from a 100-dimension manifold, learned by the generator, that characterizes the fully non-linear abundance and clustering of cosmic HI from the state-of-the-art simulation IllustrisTNG. We show that different statistical properties of the produced samples -- 1D PDF, power spectrum, bispectrum, and void size function -- match very well those of IllustrisTNG, and outperform state-of-the-art models such as Halo Occupation Distributions (HODs). Our WGAN samples reproduce the abundance of HI across 9 orders of magnitude, from the Ly$\alpha$ forest to Damped Lyman Absorbers. WGAN can produce new samples orders of magnitude faster than hydrodynamic simulations.

The DESI Legacy Imaging Surveys are a combination of three public projects (the Dark Energy Camera Legacy Survey, the Beijing-Arizona Sky Survey, and the Mayall z-band Legacy Survey) that will jointly image approximately 14,000 deg^2 of the extragalactic sky visible from the northern hemisphere in three optical bands (g, r, and z) using telescopes at the Kitt Peak National Observatory and the Cerro Tololo Inter-American Observatory. The combined survey footprint is split into two contiguous areas by the Galactic plane. The optical imaging is conducted using a unique strategy of dynamically adjusting the exposure times and pointing selection during observing that results in a survey of nearly uniform depth. In addition to calibrated images, the project is delivering a catalog, constructed by using a probabilistic inference-based approach to estimate source shapes and brightnesses. The catalog includes photometry from the grz optical bands and from four mid-infrared bands (at 3.4, 4.6, 12 and 22 micorons) observed by the Wide-field Infrared Survey Explorer (WISE) satellite during its full operational lifetime. The project plans two public data releases each year. All the software used to generate the catalogs is also released with the data. This paper provides an overview of the Legacy Surveys project.

We present a machine learning method for the reconstruction of the undistorted images of background sources in strongly lensed systems. This method treats the source as a pixelated image and utilizes the Recurrent Inference Machine (RIM) to iteratively reconstruct the background source given a lens model. Our architecture learns to minimize the likelihood of the model parameters (source pixels) given the data using the physical forward model (ray tracing simulations) while implicitly learning the prior of the source structure from the training data. This results in better performance compared to linear inversion methods, where the prior information is limited to the 2-point covariance of the source pixels approximated with a Gaussian form, and often specified in a relatively arbitrary manner. We combine our source reconstruction network with a convolutional neural network that predicts the parameters of the mass distribution in the lensing galaxies directly from telescope images, allowing a fully automated reconstruction of the background source images and the foreground mass distribution.

We use convolutional neural networks (CNNs) and recurrent neural networks (RNNs) to estimate the parameters of strong gravitational lenses from interferometric observations. We explore multiple strategies and find that the best results are obtained when the effects of the dirty beam are first removed from the images with a deconvolution performed with an RNN-based structure before estimating the parameters. For this purpose, we use the recurrent inference machine (RIM) introduced in Putzky & Welling (2017). This provides a fast and automated alternative to the traditional CLEAN algorithm. We obtain the uncertainties of the estimated parameters using variational inference with Bernoulli distributions. We test the performance of the networks with a simulated test dataset as well as with five ALMA observations of strong lenses. For the observed ALMA data we compare our estimates with values obtained from a maximum-likelihood lens modeling method which operates in the visibility space and find consistent results. We show that we can estimate the lensing parameters with high accuracy using a combination of an RNN structure performing image deconvolution and a CNN performing lensing analysis, with uncertainties less than a factor of two higher than those achieved with maximum-likelihood methods. Including the deconvolution procedure performed by RIM, a single evaluation can be done in about a second on a single GPU, providing a more than six orders of magnitude increase in analysis speed while using about eight orders of magnitude less computational resources compared to maximum-likelihood lens modeling in the uv-plane. We conclude that this is a promising method for the analysis of mm and cm interferometric data from current facilities (e.g., ALMA, JVLA) and future large interferometric observatories (e.g., SKA), where an analysis in the uv-plane could be difficult or unfeasible.

In Hezaveh et al. 2017 we showed that deep learning can be used for model parameter estimation and trained convolutional neural networks to determine the parameters of strong gravitational lensing systems. Here we demonstrate a method for obtaining the uncertainties of these parameters. We review the framework of variational inference to obtain approximate posteriors of Bayesian neural networks and apply it to a network trained to estimate the parameters of the Singular Isothermal Ellipsoid plus external shear and total flux magnification. We show that the method can capture the uncertainties due to different levels of noise in the input data, as well as training and architecture-related errors made by the network. To evaluate the accuracy of the resulting uncertainties, we calculate the coverage probabilities of marginalized distributions for each lensing parameter. By tuning a single hyperparameter, the dropout rate, we obtain coverage probabilities approximately equal to the confidence levels for which they were calculated, resulting in accurate and precise uncertainty estimates. Our results suggest that neural networks can be a fast alternative to Monte Carlo Markov Chains for parameter uncertainty estimation in many practical applications, allowing more than seven orders of magnitude improvement in speed.

Quantifying image distortions caused by strong gravitational lensing and estimating the corresponding matter distribution in lensing galaxies has been primarily performed by maximum likelihood modeling of observations. This is typically a time and resource-consuming procedure, requiring sophisticated lensing codes, several data preparation steps, and finding the maximum likelihood model parameters in a computationally expensive process with downhill optimizers. Accurate analysis of a single lens can take up to a few weeks and requires the attention of dedicated experts. Tens of thousands of new lenses are expected to be discovered with the upcoming generation of ground and space surveys, the analysis of which can be a challenging task. Here we report the use of deep convolutional neural networks to accurately estimate lensing parameters in an extremely fast and automated way, circumventing the difficulties faced by maximum likelihood methods. We also show that lens removal can be made fast and automated using Independent Component Analysis of multi-filter imaging data. Our networks can recover the parameters of the Singular Isothermal Ellipsoid density profile, commonly used to model strong lensing systems, with an accuracy comparable to the uncertainties of sophisticated models, but about ten million times faster: 100 systems in approximately 1s on a single graphics processing unit. These networks can provide a way for non-experts to obtain lensing parameter estimates for large samples of data. Our results suggest that neural networks can be a powerful and fast alternative to maximum likelihood procedures commonly used in astrophysics, radically transforming the traditional methods of data reduction and analysis.

We study the abundance of substructure in the matter density near galaxies using ALMA Science Verification observations of the strong lensing system SDP.81. We present a method to measure the abundance of subhalos around galaxies using interferometric observations of gravitational lenses. Using simulated ALMA observations, we explore the effects of various systematics, including antenna phase errors and source priors, and show how such errors may be measured or marginalized. We apply our formalism to ALMA observations of SDP.81. We find evidence for the presence of a $M=10^{8.96\pm 0.12} M_{\odot}$ subhalo near one of the images, with a significance of $6.9\sigma$ in a joint fit to data from bands 6 and 7; the effect of the subhalo is also detected in both bands individually. We also derive constraints on the abundance of dark matter subhalos down to $M\sim 2\times 10^7 M_{\odot}$, pushing down to the mass regime of the smallest detected satellites in the Local Group, where there are significant discrepancies between the observed population of luminous galaxies and predicted dark matter subhalos. We find hints of additional substructure, warranting further study using the full SDP.81 dataset (including, for example, the spectroscopic imaging of the lensed carbon monoxide emission). We compare the results of this search to the predictions of $\Lambda$CDM halos, and find that given current uncertainties in the host halo properties of SDP.81, our measurements of substructure are consistent with theoretical expectations. Observations of larger samples of gravitational lenses with ALMA should be able to improve the constraints on the abundance of galactic substructure.

The formalism of stochastic inflation is a powerful tool for analyzing the backreaction of cosmological perturbations, and making precise predictions for inflationary observables. We demonstrate this with the simple $m^2\phi^2$ model of inflation, wherein we obtain an effective field theory for IR modes of the inflaton, which remains coupled to UV modes through a classical noise. We compute slow-roll corrections to the evolution of UV modes (i.e. quantum fluctuations), and track this effect from the UV theory to the IR theory, where it manifests as a correction to the classical noise. We compute the stochastic correction to the spectral index of primordial perturbations, finding a small effect, and discuss models in which this effect can become large. We extend our analysis to tensor modes, and demonstrate that the stochastic approach allows us to recover the standard tensor tilt $n_T$, plus corrections.

In recent years, it has become possible to detect individual dark matter subhalos near images of strongly lensed extended background galaxies. Typically, only the most massive subhalos in the strong lensing region may be detected this way. In this work, we show that strong lenses may also be used to constrain the much more numerous population of lower mass subhalos that are too small to be detected individually. In particular, we show that the power spectrum of projected density fluctuations in galaxy halos can be measured using strong gravitational lensing. We develop the mathematical framework of power spectrum estimation, and test our method on mock observations. We use our results to determine the types of observations required to measure the substructure power spectrum with high significance. We predict that deep observations ($\sim10$ hours on a single target) with current facilities can measure this power spectrum at the $3\sigma$ level, with no apparent degeneracy with unknown clumpiness in the background source structure or fluctuations from detector noise. Upcoming ALMA measurements of strong lenses are capable of placing strong constraints on the abundance of dark matter subhalos and the underlying particle nature of dark matter.

Hybrid Inflation is a two-field model where inflation ends by a tachyonic instability, the duration of which is determined by stochastic effects and has important observational implications. Making use of the recursive approach to the stochastic formalism presented in Ref. [1], these effects are consistently computed. Through an analysis of back-reaction, this method is shown to converge in the valley but points toward an (expected) instability in the waterfall. It is further shown that quasi-stationarity of the auxiliary field distribution breaks down in the case of a short-lived waterfall. It is found that the typical dispersion of the waterfall field at the critical point is then diminished, thus increasing the duration of the waterfall phase and jeopardizing the possibility of a short transition. Finally, it is found that stochastic effects worsen the blue tilt of the curvature perturbations by an order one factor when compared with the usual slow-roll contribution.

We study the transition from an Emergent Galileon condensate phase of the early universe to a later expanding radiation phase. This "defrosting" or "preheating" transition is a consequence of the excitation of matter fluctuations by the coherent Galileon condensate, in analogy to how preheating in inflationary cosmology occurs via the excitation of matter fluctuations through coupling of matter with the coherent inflaton condensate. We show that the "minimal" coupling of matter (modeled as a massless scalar field) to the Galileon field introduced by Creminelli, Nicolis and Trincherini in order to generate a scale-invariant spectrum of matter fluctuations is sufficient to lead to efficient defrosting, provided that the effects of the non-vanishing expansion rate of the universe are taken into account. If we neglect the effects of expansion, an additional coupling of matter to the Galileon condensate is required. We study the efficiency of the defrosting mechanism in both cases.

Assuming the existence of a scalar field which undergoes "ghost condensation" and which has a suitably chosen potential, it is possible to obtain a non-singular bouncing cosmology in the presence of regular matter and radiation. The potential for the ghost condensate field can be chosen such that the cosmological bounce is stable against the presence of anisotropic stress. Cosmological fluctuations on long wavelengths relevant to current cosmological observations pass through the bounce unaffected by the new physics which yields the bounce. Thus, this model allows for the realization of the "matter bounce" scenario, an alternative to inflationary cosmology for the generation of the observed primordial fluctuations in which the inhomogeneities originate as quantum vacuum perturbations which exit the Hubble radius in the matter-dominated phase of contraction.

We provide an analytical study of the coupling of short and long wavelength fluctuation modes during the initial phase of reheating in two field models like hybrid inflation. In these models, there is - at linear order in perturbation theory - an instability in the entropy modes of cosmological perturbations which, if not cut off, could lead to curvature fluctuations which exceed the current observational values. Here, we demonstrate that the back-reaction of short wavelength fluctuations is too weak to lead to a truncation of the instability for the long wavelength modes on time scales comparable to the typical instability time scale of the long wavelength entropy modes. Hence, unless there are other mechanisms which truncate the instability, then in models such as hybrid inflation the curvature perturbations produced during reheating on scales of current observational interest may be very important.