We present SPECULATOR - a fast, accurate, and flexible framework for emulating stellar population synthesis (SPS) models for predicting galaxy spectra and photometry. For emulating spectra, we use principal component analysis to construct a set of basis functions, and neural networks to learn the basis coefficients as a function of the SPS model parameters. For photometry, we parameterize the magnitudes (for the filters of interest) as a function of SPS parameters by a neural network. The resulting emulators are able to predict spectra and photometry under both simple and complicated SPS model parameterizations to percent-level accuracy, giving a factor of $10^3$-$10^4$ speed up over direct SPS computation. They have readily-computable derivatives, making them amenable to gradient-based inference and optimization methods. The emulators are also straightforward to call from a GPU, giving an additional order-of-magnitude speed-up. Rapid SPS computations delivered by emulation offers a massive reduction in the computational resources required to infer the physical properties of galaxies from observed spectra or photometry and simulate galaxy populations under SPS models, whilst maintaining the accuracy required for a range of applications.

Density-estimation likelihood-free inference (DELFI) has recently been proposed as an efficient method for simulation-based cosmological parameter inference. Compared to the standard likelihood-based Markov Chain Monte Carlo (MCMC) approach, DELFI has several advantages: it is highly parallelizable, there is no need to assume a possibly incorrect functional form for the likelihood and complicated effects (e.g the mask and detector systematics) are easier to handle with forward models. In light of this, we present two DELFI pipelines to perform weak lensing parameter inference with lognormal realizations of the tomographic shear field -- using the C_l summary statistic. The first pipeline accounts for the non-Gaussianities of the shear field, intrinsic alignments and photometric-redshift error. We validate that it is accurate enough for Stage III experiments and estimate that O(1000) simulations are needed to perform inference on Stage IV data. By comparing the second DELFI pipeline, which makes no assumption about the functional form of the likelihood, with the standard MCMC approach, which assumes a Gaussian likelihood, we test the impact of the Gaussian likelihood approximation in the MCMC analysis. We find it has a negligible impact on Stage IV parameter constraints. Our pipeline is a step towards seamlessly propagating all data-processing, instrumental, theoretical and astrophysical systematics through to the final parameter constraints.

In this paper we show how nuisance parameter marginalized posteriors can be inferred directly from simulations in a likelihood-free setting, without having to jointly infer the higher-dimensional interesting and nuisance parameter posterior first and marginalize a posteriori. The result is that for an inference task with a given number of interesting parameters, the number of simulations required to perform likelihood-free inference can be kept (roughly) the same irrespective of the number of additional nuisances to be marginalized over. To achieve this we introduce two extensions to the standard likelihood-free inference set-up. Firstly we show how nuisance parameters can be re-cast as latent variables and hence automatically marginalized over in the likelihood-free framework. Secondly, we derive an asymptotically optimal compression from $N$ data down to $n$ summaries -- one per interesting parameter -- such that the Fisher information is (asymptotically) preserved, but the summaries are insensitive (to leading order) to the nuisance parameters. This means that the nuisance marginalized inference task involves learning $n$ interesting parameters from $n$ "nuisance hardened" data summaries, regardless of the presence or number of additional nuisance parameters to be marginalized over. We validate our approach on two examples from cosmology: supernovae and weak lensing data analyses with nuisance parameterized systematics. For the supernova problem, high-fidelity posterior inference of $\Omega_m$ and $w_0$ (marginalized over systematics) can be obtained from just a few hundred data simulations. For the weak lensing problem, six cosmological parameters can be inferred from $\mathcal{O}(10^3)$ simulations, irrespective of whether ten additional nuisance parameters are included in the problem or not.

Likelihood-free inference provides a framework for performing rigorous Bayesian inference using only forward simulations, properly accounting for all physical and observational effects that can be successfully included in the simulations. The key challenge for likelihood-free applications in cosmology, where simulation is typically expensive, is developing methods that can achieve high-fidelity posterior inference with as few simulations as possible. Density-estimation likelihood-free inference (DELFI) methods turn inference into a density estimation task on a set of simulated data-parameter pairs, and give orders of magnitude improvements over traditional Approximate Bayesian Computation approaches to likelihood-free inference. In this paper we use neural density estimators (NDEs) to learn the likelihood function from a set of simulated datasets, with active learning to adaptively acquire simulations in the most relevant regions of parameter space on-the-fly. We demonstrate the approach on a number of cosmological case studies, showing that for typical problems high-fidelity posterior inference can be achieved with just $\mathcal{O}(10^3)$ simulations or fewer. In addition to enabling efficient simulation-based inference, for simple problems where the form of the likelihood is known, DELFI offers a fast alternative to MCMC sampling, giving orders of magnitude speed-up in some cases. Finally, we introduce \textsc{pydelfi} -- a flexible public implementation of DELFI with NDEs and active learning -- available at \url{https://github.com/justinalsing/pydelfi}.

The Hubble constant ($H_0$) estimated from the local Cepheid-supernova (SN) distance ladder is in 3-$\sigma$ tension with the value extrapolated from cosmic microwave background (CMB) data assuming the standard cosmological model. Whether this tension represents new physics or systematic effects is the subject of intense debate. Here, we investigate how new, independent $H_0$ estimates can arbitrate this tension, assessing whether the measurements are consistent with being derived from the same model using the posterior predictive distribution (PPD). We show that, with existing data, the inverse distance ladder formed from BOSS baryon acoustic oscillation measurements and the Pantheon SN sample yields an $H_0$ posterior near-identical to the Planck CMB measurement. The observed local distance ladder value is a very unlikely draw from the resulting PPD. Turning to the future, we find that a sample of $\sim50$ binary neutron star "standard sirens" (detectable within the next decade) will be able to adjudicate between the local and CMB estimates.

We infer the mass distribution of neutron stars in binary systems using a flexible Gaussian mixture model and use Bayesian model selection to explore evidence for multi-modality and a sharp cut-off in the mass distribution. We find overwhelming evidence for a bimodal distribution, in agreement with previous literature, and report for the first time positive evidence for a sharp cut-off at a maximum neutron star mass. We measure the maximum mass to be $2.0M_\odot < m_\mathrm{max} < 2.2M_\odot$ (68\%), $2.0M_\odot < m_\mathrm{max}< 2.6M_\odot$ (90\%), and evidence for a cut-off is robust against the choice of model for the mass distribution and to removing the most extreme (highest mass) neutron stars from the dataset. If this sharp cut-off is interpreted as the maximum stable neutron star mass allowed by the equation of state of dense matter, our measurement puts constraints on the equation of state. For a set of realistic equations of state that support $>2M_\odot$ neutron stars, our inference of $m_\mathrm{max}$ is able to distinguish between models at odds ratios of up to $12:1$, whilst under a flexible piecewise polytropic equation of state model our maximum mass measurement improves constraints on the pressure at $3-7\times$ the nuclear saturation density by $\sim 30-50\%$ compared to simply requiring $m_\mathrm{max}> 2M_\odot$. We obtain a lower bound on the maximum sound speed attained inside the neutron star of $c_s^\mathrm{max} > 0.63c$ (99.8\%), ruling out $c_s^\mathrm{max} < c/\sqrt{3}$ at high significance. Our constraints on the maximum neutron star mass strengthen the case for neutron star-neutron star mergers as the primary source of short gamma-ray bursts.

Data compression has become one of the cornerstones of modern astronomical data analysis, with the vast majority of analyses compressing large raw datasets down to a manageable number of informative summaries. In this paper we provide a general procedure for optimally compressing $N$ data down to $n$ summary statistics, where $n$ is equal to the number of parameters of interest. We show that compression to the score function -- the gradient of the log-likelihood with respect to the parameters -- yields $n$ compressed statistics that are optimal in the sense that they preserve the Fisher information content of the data. Our method generalizes earlier work on linear Karhunen-Lo\'{e}ve compression for Gaussian data whilst recovering both lossless linear compression and quadratic estimation as special cases when they are optimal. We give a unified treatment that also includes the general non-Gaussian case as long as mild regularity conditions are satisfied, producing optimal non-linear summary statistics when appropriate. As a worked example, we derive explicitly the $n$ optimal compressed statistics for Gaussian data in the general case where both the mean and covariance depend on the parameters.

Many statistical models in cosmology can be simulated forwards but have intractable likelihood functions. Likelihood-free inference methods allow us to perform Bayesian inference from these models using only forward simulations, free from any likelihood assumptions or approximations. Likelihood-free inference generically involves simulating mock data and comparing to the observed data; this comparison in data-space suffers from the curse of dimensionality and requires compression of the data to a small number of summary statistics to be tractable. In this paper we use massive asymptotically-optimal data compression to reduce the dimensionality of the data-space to just one number per parameter, providing a natural and optimal framework for summary statistic choice for likelihood-free inference. Secondly, we present the first cosmological application of Density Estimation Likelihood-Free Inference (\textsc{delfi}), which learns a parameterized model for joint distribution of data and parameters, yielding both the parameter posterior and the model evidence. This approach is conceptually simple, requires less tuning than traditional Approximate Bayesian Computation approaches to likelihood-free inference and can give high-fidelity posteriors from orders of magnitude fewer forward simulations. As an additional bonus, it enables parameter inference and Bayesian model comparison simultaneously. We demonstrate Density Estimation Likelihood-Free Inference with massive data compression on an analysis of the joint light-curve analysis supernova data, as a simple validation case study. We show that high-fidelity posterior inference is possible for full-scale cosmological data analyses with as few as $\sim 10^4$ simulations, with substantial scope for further improvement, demonstrating the scalability of likelihood-free inference to large and complex cosmological datasets.

We apply two Bayesian hierarchical inference schemes to infer shear power spectra, shear maps and cosmological parameters from the CFHTLenS weak lensing survey - the first application of this method to data. In the first approach, we sample the joint posterior distribution of the shear maps and power spectra by Gibbs sampling, with minimal model assumptions. In the second approach, we sample the joint posterior of the shear maps and cosmological parameters, providing a new, accurate and principled approach to cosmological parameter inference from cosmic shear data. As a first demonstration on data we perform a 2-bin tomographic analysis to constrain cosmological parameters and investigate the possibility of photometric redshift bias in the CFHTLenS data. Under the baseline $\Lambda$CDM model we constrain $S_8 = \sigma_8(\Omega_\mathrm{m}/0.3)^{0.5} = 0.67 ^{\scriptscriptstyle+ 0.03 }_{\scriptscriptstyle- 0.03 }$ $(68\%)$, consistent with previous CFHTLenS analysis but in tension with Planck. Adding neutrino mass as a free parameter we are able to constrain $\sum m_\nu < 4.6\mathrm{eV}$ (95%) using CFHTLenS data alone. Including a linear redshift dependent photo-$z$ bias $\Delta z = p_2(z - p_1)$, we find $p_1=-0.25 ^{\scriptscriptstyle+ 0.53 }_{\scriptscriptstyle- 0.60 }$ and $p_2 = -0.15 ^{\scriptscriptstyle+ 0.17 }_{\scriptscriptstyle- 0.15 }$, and tension with Planck is only alleviated under very conservative prior assumptions. Neither the non-minimal neutrino mass or photo-$z$ bias models are significantly preferred by the CFHTLenS (2-bin tomography) data.

In this paper we discuss the commonly-used limiting cases, or approximations, for two-point cosmic shear statistics. We discuss the most prominent assumptions in this statistic: the flat-sky (small angle limit), the Limber (Bessel-to-delta function limit) and the Hankel transform (large l-mode limit) approximations; that the vast majority of cosmic shear results to date have used simultaneously. We find that the combined effect of these approximations can suppress power by >1% on scales of l<40. A fully non-approximated cosmic shear study should use a spherical-sky, non-Limber-approximated power spectrum analysis; and a transform involving Wigner small-d matrices in place of the Hankel transform. These effects, unaccounted for, would constitute at least 11% of the total budget for systematic effects for a power spectrum analysis of a Euclid-like experiment; but they are unnecessary.

To accomplish correct Bayesian inference from weak lensing shear data requires a complete statistical description of the data. The natural framework to do this is a Bayesian Hierarchical Model, which divides the chain of reasoning into component steps. Starting with a catalogue of shear estimates in tomographic bins, we build a model that allows us to sample simultaneously from the the underlying tomographic shear fields and the relevant power spectra (E-mode, B-mode, and E-B, for auto- and cross-power spectra). The procedure deals easily with masked data and intrinsic alignments. Using Gibbs sampling and messenger fields, we show with simulated data that the large (over 67000-)dimensional parameter space can be efficiently sampled and the full joint posterior probability density function for the parameters can feasibly be obtained. The method correctly recovers the underlying shear fields and all of the power spectra, including at levels well below the shot noise.

We develop a Bayesian hierarchical modelling approach for cosmic shear power spectrum inference, jointly sampling from the posterior distribution of the cosmic shear field and its (tomographic) power spectra. Inference of the shear power spectrum is a powerful intermediate product for a cosmic shear analysis, since it requires very few model assumptions and can be used to perform inference on a wide range of cosmological models \emph{a posteriori} without loss of information. We show that joint posterior for the shear map and power spectrum can be sampled effectively by Gibbs sampling, iteratively drawing samples from the map and power spectrum, each conditional on the other. This approach neatly circumvents difficulties associated with complicated survey geometry and masks that plague frequentist power spectrum estimators, since the power spectrum inference provides prior information about the field in masked regions at every sampling step. We demonstrate this approach for inference of tomographic shear $E$-mode, $B$-mode and $EB$-cross power spectra from a simulated galaxy shear catalogue with a number of important features; galaxies distributed on the sky and in redshift with photometric redshift uncertainties, realistic random ellipticity noise for every galaxy and a complicated survey mask. The obtained posterior distributions for the tomographic power spectrum coefficients recover the underlying simulated power spectra for both $E$- and $B$-modes.

One century after its formulation, Einstein's general relativity has made remarkable predictions and turned out to be compatible with all experimental tests. Most of these tests probe the theory in the weak-field regime, and there are theoretical and experimental reasons to believe that general relativity should be modified when gravitational fields are strong and spacetime curvature is large. The best astrophysical laboratories to probe strong-field gravity are black holes and neutron stars, whether isolated or in binary systems. We review the motivations to consider extensions of general relativity. We present a (necessarily incomplete) catalog of modified theories of gravity for which strong-field predictions have been computed and contrasted to Einstein's theory, and we summarize our current understanding of the structure and dynamics of compact objects in these theories. We discuss current bounds on modified gravity from binary pulsar and cosmological observations, and we highlight the potential of future gravitational wave measurements to inform us on the behavior of gravity in the strong-field regime.

Weak lensing can be observed through a number of effects on the images of distant galaxies; their shapes are sheared, their sizes and fluxes (magnitudes) are magnified and their positions on the sky are modified by the lensing field. Galaxy shapes probe the shear field whilst size, magnitude and number density probe the convergence field. Both contain cosmological information. In this paper we are concerned with the magnification of the size and magnitude of individual galaxies as a probe of cosmic convergence. We develop a Bayesian approach for inferring the convergence field from a measured size, magnitude and redshift and demonstrate that the inference on convergence requires detailed knowledge of the joint distribution of intrinsic sizes and magnitudes. We build a simple parameterised model for the size-magnitude distribution and estimate this distribution for CFHTLenS galaxies. In light of the measured distribution, we show that the typical dispersion on convergence estimation is ~0.8, compared to ~0.38 for shear. We discuss the possibility of physical systematics for magnification (similar to intrinsic alignments for shear) and compute the expected gains in the Dark Energy Figure-of-Merit (FoM) from combining magnification with shear for different scenarios regarding systematics: when accounting for intrinsic alignments but no systematics on the magnification signal, including magnification could improve the FoM by upto a factor of ~2.5, whilst when accounting for physical systematics in both shear and magnification we anticipate a gain between ~25% and ~65%. In addition to the statistical gains, the fact that cosmic shear and magnification are subject to different systematics makes magnification an attractive complement to any cosmic shear analysis.

This paper presents the first application of 3D cosmic shear to a wide-field weak lensing survey. 3D cosmic shear is a technique that analyses weak lensing in three dimensions using a spherical harmonic approach, and does not bin data in the redshift direction. This is applied to CFHTLenS, a 154 square degree imaging survey with a median redshift of 0.7 and an effective number density of 11 galaxies per square arcminute usable for weak lensing. To account for survey masks we apply a 3D pseudo-Cl approach on weak lensing data, and to avoid uncertainties in the highly non-linear regime, we separately analyse radial wave numbers k<=1.5h/Mpc and k<=5.0h/Mpc, and angular wavenumbers l~400-5000. We show how one can recover 2D and tomographic power spectra from the full 3D cosmic shear power spectra and present a measurement of the 2D cosmic shear power spectrum, and measurements of a set of 2-bin and 6-bin cosmic shear tomographic power spectra; in doing so we find that using the 3D power in the calculation of such 2D and tomographic power spectra from data naturally accounts for a minimum scale in the matter power spectrum. We use 3D cosmic shear to constrain cosmologies with parameters OmegaM, OmegaB, sigma8, h, ns, w0, wa. For a non-evolving dark energy equation of state, and assuming a flat cosmology, lensing combined with WMAP7 results in h=0.78+/-0.12, OmegaM=0.252+/-0.079, sigma8=0.88+/-0.23 and w=-1.16+/-0.38 using only scales k<=1.5h/Mpc. We also present results of lensing combined with first year Planck results, where we find no tension with the results from this analysis, but we also find no significant improvement over the Planck results alone. We find evidence of a suppression of power compared to LCDM on small scales 1.5 < k < 5.0 h/Mpc in the lensing data, which is consistent with predictions of the effect of baryonic feedback on the matter power spectrum.

Weak lensing alters the size of images with a similar magnitude to the distortion due to shear. Galaxy size probes the convergence field, and shape the shear field, both of which contain cosmological information. We show the gains expected in the Dark Energy Figure of Merit if galaxy size information is used in combination with galaxy shape. In any normal analysis of cosmic shear, galaxy sizes are also studied, so this is extra statistical information comes for free and is currently unused. There are two main results in this letter: firstly, we show that size measurement can be made uncorrelated with ellipticity measurement, thus allowing the full statistical gain from the combination, provided that $\sqrt{Area}$ is used as a size indicator; secondly, as a proof of concept, we show that when the relevant modes are noise-dominated, as is the norm for lensing surveys, the gains are substantial, with improvements of about 68% in the Figure of Merit expected when systematic errors are ignored. An approximate treatment of such systematics such as intrinsic alignments and size-magnitude correlations respectively suggests that a much better improvement in the Dark Energy Figure of Merit of even a factor of ~4 may be achieved.

Scalar-tensor theories are among the simplest extensions of general relativity. In theories with light scalars, deviations from Einstein's theory of gravity are determined by the scalar mass m_s and by a Brans-Dicke-like coupling parameter \omega_{BD}. We show that gravitational-wave observations of nonspinning neutron star-black hole binary inspirals can be used to set lower bounds on \omega_{BD} and upper bounds on the combination m_s/\sqrt{\omega_{BD}}$. We estimate via a Fisher matrix analysis that individual observations with signal-to-noise ratio \rho would yield (m_s/\sqrt{\omega_{BD}})(\rho/10)<10^{-15}, 10^{-16} and 10^{-19} eV for Advanced LIGO, ET and eLISA, respectively. A statistical combination of multiple observations may further improve these bounds.

We derive the equations of motion, the periastron shift, and the gravitational radiation damping for quasicircular compact binaries in a massive variant of the Brans-Dicke theory of gravity. We also study the Shapiro time delay and the Nordtvedt effect in this theory. By comparing with recent observational data, we put bounds on the two parameters of the theory: the Brans-Dicke coupling parameter \omega_{BD} and the scalar mass m_s. We find that the most stringent bounds come from Cassini measurements of the Shapiro time delay in the Solar System, that yield a lower bound \omega_{BD}>40000 for scalar masses m_s<2.5x10^{-20} eV, to 95% confidence. In comparison, observations of the Nordtvedt effect using Lunar Laser Ranging (LLR) experiments yield \omega_{BD}>1000 for m_s<2.5x10^{-20} eV. Observations of the orbital period derivative of the quasicircular white dwarf-neutron star binary PSR J1012+5307 yield \omega_{BD}>1250 for m_s<10^{-20} eV. A first estimate suggests that bounds comparable to the Shapiro time delay may come from observations of radiation damping in the eccentric white dwarf-neutron star binary PSR J1141-6545, but a quantitative prediction requires the extension of our work to eccentric orbits.