This work uses hierarchical logistic Gaussian processes to infer true redshift distributions of samples of galaxies, through their cross-correlations with spatially overlapping spectroscopic samples. We demonstrate that this method can accurately estimate these redshift distributions in a fully Bayesian manner jointly with galaxy-dark matter bias models. We forecast how systematic biases in the redshift-dependent galaxy-dark matter bias model affect redshift inference. Using published galaxy-dark matter bias measurements from the Illustris simulation, we compare these systematic biases with the statistical error budget from a forecasted weak gravitational lensing measurement. If the redshift-dependent galaxy-dark matter bias model is mis-specified, redshift inference can be biased. This can propagate into relative biases in the weak lensing convergence power spectrum on the 10% - 30% level. We, therefore, showcase a methodology to detect these sources of error using Bayesian model selection techniques. Furthermore, we discuss the improvements that can be gained from incorporating prior information from Bayesian template fitting into the model, both in redshift prediction accuracy and in the detection of systematic modeling biases.

We study methods for reconstructing Bayesian uncertainties on dynamical mass estimates of galaxy clusters using Convolutional Neural Networks (CNNs). We discuss the statistical background of Bayesian Neural Networks and demonstrate how variational inference techniques can be used to perform computationally tractable posterior estimation for a variety of deep neural architectures. We explore how various model designs and statistical assumptions impact prediction accuracy and uncertainty reconstruction in the context of cluster mass estimation. We measure the quality of our model posterior recovery using a mock cluster observation catalog derived from the MultiDark simulation and UniverseMachine catalog. We show that Bayesian CNNs produce highly accurate dynamical cluster mass posteriors. These model posteriors are log-normal in cluster mass and recover $68\%$ and $90\%$ confidence intervals to within $1\%$ of their measured value. We note how this rigorous modelling of dynamical mass posteriors is necessary for using cluster abundance measurements to constrain cosmological parameters.

We explore the relation between diffuse intracluster light (central galaxy included) and the galaxy cluster (baryonic and dark) matter distribution using a sample of 528 clusters at $0.2\leq z \leq 0.35$ found in the Dark Energy Survey (DES) Year 1 data. The surface brightness of the diffuse light shows an increasing dependence on cluster total mass at larger radius, and appears to be self-similar with a universal radial dependence after scaling by cluster radius.We also compare the diffuse light radial profiles to the cluster (baryonic and dark) matter distribution measured through weak lensing and find them to be comparable. The IllustrisTNG galaxy formation simulation offers further insight into the connection between diffuse stellar mass and cluster matter distributions -- the simulation radial profile of the diffuse stellar component does not have a similar slope with the total cluster matter content, although that of the cluster satellite galaxies does. Regardless of the radial trends, the amount of diffuse stellar mass has a low-scatter scaling relation with cluster's total mass in the simulation, out-performing the total stellar mass of cluster satellite galaxies. We conclude that there is no consistent evidence on whether or not diffuse light is a faithful radial tracer of the cluster matter distribution. Nevertheless, both observational and simulation results reveal that diffuse light is an excellent indicator of the cluster's total mass.

Obtaining accurate distributions of galaxy redshifts is a critical aspect of weak lensing cosmology experiments. One of the methods used to estimate and validate redshift distributions is apply weights to a spectroscopic sample so that their weighted photometry distribution matches the target sample. In this work we estimate the \textit{selection bias} in redshift that is introduced in this procedure. We do so by simulating the process of assembling a spectroscopic sample (including observer-assigned confidence flags) and highlight the impacts of spectroscopic target selection and redshift failures. We use the first year (Y1) weak lensing analysis in DES as an example data set but the implications generalise to all similar weak lensing surveys. We find that using colour cuts that are not available to the weak lensing galaxies can introduce biases of $\Delta~z\sim0.015$ in the weighted mean redshift of different redshift intervals. To assess the impact of incompleteness in spectroscopic samples, we select only objects with high observer-defined confidence flags and compare the weighted mean redshift with the true mean. We find that the mean redshift of the DES Y1 weak lensing sample is typically biased at the $\Delta~z=0.005-0.05$ level after the weighting is applied. The bias we uncover can have either sign, depending on the samples and redshift interval considered. For the highest redshift bin, the bias is larger than the uncertainties in the other DES Y1 redshift calibration methods, justifying the decision of not using this method for the redshift estimations. We discuss several methods to mitigate this bias.

We perform a joint analysis of the counts and weak lensing signal of redMaPPer clusters selected from the Dark Energy Survey (DES) Year 1 dataset. Our analysis uses the same shear and source photometric redshifts estimates as were used in the DES combined probes analysis. Our analysis results in surprisingly low values for $S_8 =\sigma_8(\Omega_{\rm m}/0.3)^{0.5}= 0.65\pm 0.04$, driven by a low matter density parameter, $\Omega_{\rm m}=0.179^{+0.031}_{-0.038}$, with $\sigma_8-\Omega_{\rm m}$ posteriors in $2.4\sigma$ tension with the DES Y1 3x2pt results, and in $5.6\sigma$ with the Planck CMB analysis. These results include the impact of post-unblinding changes to the analysis, which did not improve the level of consistency with other data sets compared to the results obtained at the unblinding. The fact that multiple cosmological probes (supernovae, baryon acoustic oscillations, cosmic shear, galaxy clustering and CMB anisotropies), and other galaxy cluster analyses all favor significantly higher matter densities suggests the presence of systematic errors in the data or an incomplete modeling of the relevant physics. Cross checks with X-ray and microwave data, as well as independent constraints on the observable--mass relation from SZ selected clusters, suggest that the discrepancy resides in our modeling of the weak lensing signal rather than the cluster abundance. Repeating our analysis using a higher richness threshold ($\lambda \ge 30$) significantly reduces the tension with other probes, and points to one or more richness-dependent effects not captured by our model.

What are the mass and galaxy profiles of cosmic voids? In this paper we use two methods to extract voids in the Dark Energy Survey (DES) Year 1 redMaGiC galaxy sample to address this question. We use either 2D slices in projection, or the 3D distribution of galaxies based on photometric redshifts to identify voids. For the mass profile, we measure the tangential shear profiles of background galaxies to infer the excess surface mass density. The signal-to-noise ratio for our lensing measurement ranges between 10.7 and 14.0 for the two void samples. We infer their 3D density profiles by fitting models based on N-body simulations and find good agreement for void radii in the range 15-85 Mpc. Comparison with their galaxy profiles then allows us to test the relation between mass and light at the 10%-level, the most stringent test to date. We find very similar shapes for the two profiles, consistent with a linear relationship between mass and light both within and outside the void radius. We validate our analysis with the help of simulated mock catalogues and estimate the impact of photometric redshift uncertainties on the measurement. Our methodology can be used for cosmological applications, including tests of gravity with voids. This is especially promising when the lensing profiles are combined with spectroscopic measurements of void dynamics via redshift-space distortions.

We present a new method to estimate redshift distributions and galaxy-dark matter bias parameters using correlation functions in a fully data driven and self-consistent manner. Unlike other machine learning, template, or correlation redshift methods, this approach does not require a reference sample with known redshifts. By measuring the projected cross- and auto- correlations of different galaxy sub-samples, e.g., as chosen by simple cells in color-magnitude space, we are able to estimate the galaxy-dark matter bias model parameters, and the shape of the redshift distributions of each sub-sample. This method fully marginalises over a flexible parameterisation of the redshift distribution and galaxy-dark matter bias parameters of sub-samples of galaxies, and thus provides a general Bayesian framework to incorporate redshift uncertainty into the cosmological analysis in a data-driven, consistent, and reproducible manner. This result is improved by an order of magnitude by including cross-correlations with the CMB and with galaxy-galaxy lensing. We showcase how this method could be applied to real galaxies. By using idealised data vectors, in which all galaxy-dark matter model parameters and redshift distributions are known, this method is demonstrated to recover unbiased estimates on important quantities, such as the offset $\Delta_z$ between the mean of the true and estimated redshift distribution and the 68\% and 95\% and 99.5\% widths of the redshift distribution to an accuracy required by current and future surveys.

Correlations between tracers of the matter density field and gravitational lensing are sensitive to the evolution of the matter power spectrum and the expansion rate across cosmic time. Appropriately defined ratios of such correlation functions, on the other hand, depend only on the angular diameter distances to the tracer objects and to the gravitational lensing source planes. Because of their simple cosmological dependence, such ratios can exploit available signal-to-noise down to small angular scales, even where directly modeling the correlation functions is difficult. We present a measurement of lensing ratios using galaxy position and lensing data from the Dark Energy Survey, and CMB lensing data from the South Pole Telescope and Planck, obtaining the highest precision lensing ratio measurements to date. Relative to the concordance $\Lambda$CDM model, we find a best fit lensing ratio amplitude of $A = 1.1 \pm 0.1$. We use the ratio measurements to generate cosmological constraints, focusing on the curvature parameter. We demonstrate that photometrically selected galaxies can be used to measure lensing ratios, and argue that future lensing ratio measurements with data from a combination of LSST and Stage-4 CMB experiments can be used to place interesting cosmological constraints, even after considering the systematic uncertainties associated with photometric redshift and galaxy shear estimation.

High-multiplex and deep spectroscopic follow-up of upcoming panoramic deep-imaging surveys like LSST, Euclid, and WFIRST is a widely recognized and increasingly urgent necessity. No current or planned facility at a U.S. observatory meets the sensitivity, multiplex, and rapid-response time needed to exploit these future datasets. FOBOS, the Fiber-Optic Broadband Optical Spectrograph, is a near-term fiber-based facility that addresses these spectroscopic needs by optimizing depth over area and exploiting the aperture advantage of the existing 10m Keck II Telescope. The result is an instrument with a uniquely blue-sensitive wavelength range (0.31-1.0 um) at R~3500, high-multiplex (1800 fibers), and a factor 1.7 greater survey speed and order-of-magnitude greater sampling density than Subaru's Prime Focus Spectrograph (PFS). In the era of panoramic deep imaging, FOBOS will excel at building the deep, spectroscopic reference data sets needed to interpret vast imaging data. At the same time, its flexible focal plane, including a mode with 25 deployable integral-field units (IFUs) across a 20 arcmin diameter field, enables an expansive range of scientific investigations. Its key programmatic areas include (1) nested stellar-parameter training sets that enable studies of the Milky Way and M31 halo sub-structure, as well as local group dwarf galaxies, (2) a comprehensive picture of galaxy formation thanks to detailed mapping of the baryonic environment at z~2 and statistical linking of evolving populations to the present day, and (3) dramatic enhancements in cosmological constraints via precise photometric redshifts and determined redshift distributions. In combination with Keck I instrumentation, FOBOS also provides instant access to medium-resolution spectroscopy for transient sources with full coverage from the UV to the K-band.

Variable stars with well-calibrated period-luminosity relationships provide accurate distance measurements to nearby galaxies and are therefore a vital tool for cosmology and astrophysics. While these measurements typically rely on samples of Cepheid and RR-Lyrae stars, abundant populations of luminous variable stars with longer periods of $10 - 1000$ days remain largely unused. We apply machine learning to derive a mapping between lightcurve features of these variable stars and their magnitude to extend the traditional period-luminosity (PL) relation commonly used for Cepheid samples. Using photometric data for long period variable stars in the Large Magellanic cloud (LMC), we demonstrate that our predictions produce residual errors comparable to those obtained on the corresponding Cepheid population. We show that our model generalizes well to other samples by performing a blind test on photometric data from the Small Magellanic Cloud (SMC). Our predictions on the SMC again show small residual errors and biases, comparable to results that employ PL relations fitted on Cepheid samples. The residual biases are complementary between the long period variable and Cepheid fits, which provides exciting prospects to better control sources of systematic error in cosmological distance measurements. We finally show that the proposed methodology can be used to optimize samples of variable stars as standard candles independent of any prior variable star classification.

We present cosmological results from a combined analysis of galaxy clustering and weak gravitational lensing, using 1321 deg$^2$ of $griz$ imaging data from the first year of the Dark Energy Survey (DES Y1). We combine three two-point functions: (i) the cosmic shear correlation function of 26 million source galaxies in four redshift bins, (ii) the galaxy angular autocorrelation function of 650,000 luminous red galaxies in five redshift bins, and (iii) the galaxy-shear cross-correlation of luminous red galaxy positions and source galaxy shears. To demonstrate the robustness of these results, we use independent pairs of galaxy shape, photometric redshift estimation and validation, and likelihood analysis pipelines. To prevent confirmation bias, the bulk of the analysis was carried out while blind to the true results; we describe an extensive suite of systematics checks performed and passed during this blinded phase. The data are modeled in flat $\Lambda$CDM and $w$CDM cosmologies, marginalizing over 20 nuisance parameters, varying 6 (for $\Lambda$CDM) or 7 (for $w$CDM) cosmological parameters including the neutrino mass density and including the 457 $\times$ 457 element analytic covariance matrix. We find consistent cosmological results from these three two-point functions, and from their combination obtain $S_8 \equiv \sigma_8 (\Omega_m/0.3)^{0.5} = 0.783^{+0.021}_{-0.025}$ and $\Omega_m = 0.264^{+0.032}_{-0.019}$ for $\Lambda$CDM for $w$CDM, we find $S_8 = 0.794^{+0.029}_{-0.027}$, $\Omega_m = 0.279^{+0.043}_{-0.022}$, and $w=-0.80^{+0.20}_{-0.22}$ at 68% CL. The precision of these DES Y1 results rivals that from the Planck cosmic microwave background measurements, allowing a comparison of structure in the very early and late Universe on equal terms. Although the DES Y1 best-fit values for $S_8$ and $\Omega_m$ are lower than the central values from Planck ...

In recent years, machine learning (ML) methods have remarkably improved how cosmologists can interpret data. The next decade will bring new opportunities for data-driven cosmological discovery, but will also present new challenges for adopting ML methodologies and understanding the results. ML could transform our field, but this transformation will require the astronomy community to both foster and promote interdisciplinary research endeavors.

We demonstrate the ability of Convolutional Neural Networks (CNNs) to mitigate systematics in the virial scaling relation and produce dynamical mass estimates of galaxy clusters with remarkably low bias and scatter. We present two models, CNN$_\text{1D}$ and CNN$_\text{2D}$, which leverage this deep learning tool to infer cluster masses from distributions of member galaxy dynamics. Our first model, CNN$_\text{1D}$, infers cluster mass directly from the distribution of member galaxy line-of-sight velocities. Our second model, CNN$_\text{2D}$, extends the input space of CNN$_\text{1D}$ to learn on the joint distribution of galaxy line-of-sight velocities and projected radial distances. We train each model as a regression over cluster mass using a labeled catalog of realistic mock cluster observations generated from the MultiDark simulation and UniverseMachine catalog. We then evaluate the performance of each model on an independent set of mock observations selected from the same simulated catalog. The CNN models produce cluster mass predictions with log-normal residuals of scatter as low as $0.127$ dex, a factor of three improvement over the classical M-$\sigma$ power law estimator. Furthermore, the CNN model reduces prediction scatter relative to similar machine learning approaches by up to $20\%$ while executing in drastically shorter training and evaluation times (by a factor of 30) and producing considerably more robust mass predictions (improving prediction stability under variations in galaxy sampling rate by $53\%$).

High energy radiation from a planet host star can have strong influence on the final habitability of a system through several mechanisms. In this context we have constructed a catalogue containing the X-ray luminosities, as well as basic stellar and planetary properties of all known stars hosting giant planets (> 0.1 Mjup) that have been observed by the Chandra X-ray Observatory, XMM-Newton and/or ROSAT. Specifically in this paper we present a first application of this catalogue to search for a possible imprint of X-ray photoevaporation of planet-forming discs on the present-day orbital distribution of the observed giant planets. We found a suggestive void in the semi-major axis, a, versus X-ray luminosity, Lx, plane, roughly located between a ~ 0.05-1 au and Lx ~10^27-10^29 erg/s, which would be expected if photoevaporation played a dominant role in the migration history of these systems. However, due to the small observational sample size, the statistical significance of this feature cannot be proven at this point.

We cross-correlate galaxy weak lensing measurements from the Dark Energy Survey (DES) year-one (Y1) data with a cosmic microwave background (CMB) weak lensing map derived from South Pole Telescope (SPT) and Planck data, with an effective overlapping area of 1289 deg$^{2}$. With the combined measurements from four source galaxy redshift bins, we reject the hypothesis of no lensing with a significance of $10.8\sigma$. When employing angular scale cuts, this significance is reduced to $6.8\sigma$, which remains the highest signal-to-noise measurement of its kind to date. We fit the amplitude of the correlation functions while fixing the cosmological parameters to a fiducial $\Lambda$CDM model, finding $A = 0.99 \pm 0.17$. We additionally use the correlation function measurements to constrain shear calibration bias, obtaining constraints that are consistent with previous DES analyses. Finally, when performing a cosmological analysis under the $\Lambda$CDM model, we obtain the marginalized constraints of $\Omega_{\rm m}=0.261^{+0.070}_{-0.051}$ and $S_{8}\equiv \sigma_{8}\sqrt{\Omega_{\rm m}/0.3} = 0.660^{+0.085}_{-0.100}$. These measurements are used in a companion work that presents cosmological constraints from the joint analysis of two-point functions among galaxies, galaxy shears, and CMB lensing using DES, SPT and Planck data.

We perform a joint analysis of the auto and cross-correlations between three cosmic fields: the galaxy density field, the galaxy weak lensing shear field, and the cosmic microwave background (CMB) weak lensing convergence field. These three fields are measured using roughly 1300 sq. deg. of overlapping optical imaging data from first year observations of the Dark Energy Survey and millimeter-wave observations of the CMB from both the South Pole Telescope Sunyaev-Zel'dovich survey and Planck. We present cosmological constraints from the joint analysis of the two-point correlation functions between galaxy density and galaxy shear with CMB lensing. We test for consistency between these measurements and the DES-only two-point function measurements, finding no evidence for inconsistency in the context of flat $\Lambda$CDM cosmological models. Performing a joint analysis of five of the possible correlation functions between these fields (excluding only the CMB lensing autospectrum) yields $S_{8}\equiv \sigma_8\sqrt{\Omega_{\rm m}/0.3} = 0.782^{+0.019}_{-0.025}$ and $\Omega_{\rm m}=0.260^{+0.029}_{-0.019}$. We test for consistency between these five correlation function measurements and the Planck-only measurement of the CMB lensing autospectrum, again finding no evidence for inconsistency in the context of flat $\Lambda$CDM models. Combining constraints from all six two-point functions yields $S_{8}=0.776^{+0.014}_{-0.021}$ and $\Omega_{\rm m}= 0.271^{+0.022}_{-0.016}$. These results provide a powerful test and confirmation of the results from the first year DES joint-probes analysis.

We present calibrations of the redshift distributions of redMaGiC galaxies in the Dark Energy Survey Year 1 (DES Y1) and Sloan Digital Sky Survey (SDSS) DR8 data. These results determine the priors of the redshift distribution of redMaGiC galaxies, which were used for galaxy clustering measurements and as lenses for galaxy-galaxy lensing measurements in DES Y1 cosmological analyses. We empirically determine the bias in redMaGiC photometric redshift estimates using angular cross-correlations with Baryon Oscillation Spectroscopic Survey (BOSS) galaxies. For DES, we calibrate a single parameter redshift bias in three photometric redshift bins: $z \in[0.15,0.3]$, [0.3,0.45], and [0.45,0.6]. Our best fit results in each bin give photometric redshift biases of $|\Delta z|<0.01$. To further test the redMaGiC algorithm, we apply our calibration procedure to SDSS redMaGiC galaxies, where the statistical precision of the cross-correlation measurement is much higher due to a greater overlap with BOSS galaxies. For SDSS, we also find best fit results of $|\Delta z|<0.01$. We compare our results to other analyses of redMaGiC photometric redshifts.

We constrain the mass--richness scaling relation of redMaPPer galaxy clusters identified in the Dark Energy Survey Year 1 data using weak gravitational lensing. We split clusters into $4\times3$ bins of richness $\lambda$ and redshift $z$ for $\lambda\geq20$ and $0.2 \leq z \leq 0.65$ and measure the mean masses of these bins using their stacked weak lensing signal. By modeling the scaling relation as $\langle M_{\rm 200m}|\lambda,z\rangle = M_0 (\lambda/40)^F ((1+z)/1.35)^G$, we constrain the normalization of the scaling relation at the 5.0 per cent level as $M_0 = [3.081 \pm 0.075 ({\rm stat}) \pm 0.133 ({\rm sys})] \cdot 10^{14}\ {\rm M}_\odot$ at $\lambda=40$ and $z=0.35$. The richness scaling index is constrained to be $F=1.356 \pm 0.051\ ({\rm stat})\pm 0.008\ ({\rm sys})$ and the redshift scaling index $G=-0.30\pm 0.30\ ({\rm stat})\pm 0.06\ ({\rm sys})$. These are the tightest measurements of the normalization and richness scaling index made to date. We use a semi-analytic covariance matrix to characterize the statistical errors in the recovered weak lensing profiles. Our analysis accounts for the following sources of systematic error: shear and photometric redshift errors, cluster miscentering, cluster member dilution of the source sample, systematic uncertainties in the modeling of the halo--mass correlation function, halo triaxiality, and projection effects. We discuss prospects for reducing this systematic error budget, which dominates the uncertainty on $M_0$. Our result is in excellent agreement with, but has significantly smaller uncertainties than, previous measurements in the literature, and augurs well for the power of the DES cluster survey as a tool for precision cosmology and upcoming galaxy surveys such as LSST, Euclid and WFIRST.

We present galaxy-galaxy lensing measurements from 1321 sq. deg. of the Dark Energy Survey (DES) Year 1 (Y1) data. The lens sample consists of a selection of 660,000 red galaxies with high-precision photometric redshifts, known as redMaGiC, split into five tomographic bins in the redshift range $0.15 < z < 0.9$. We use two different source samples, obtained from the Metacalibration (26 million galaxies) and Im3shape (18 million galaxies) shear estimation codes, which are split into four photometric redshift bins in the range $0.2 < z < 1.3$. We perform extensive testing of potential systematic effects that can bias the galaxy-galaxy lensing signal, including those from shear estimation, photometric redshifts, and observational properties. Covariances are obtained from jackknife subsamples of the data and validated with a suite of log-normal simulations. We use the shear-ratio geometric test to obtain independent constraints on the mean of the source redshift distributions, providing validation of those obtained from other photo-$z$ studies with the same data. We find consistency between the galaxy bias estimates obtained from our galaxy-galaxy lensing measurements and from galaxy clustering, therefore showing the galaxy-matter cross-correlation coefficient $r$ to be consistent with one, measured over the scales used for the cosmological analysis. The results in this work present one of the three two-point correlation functions, along with galaxy clustering and cosmic shear, used in the DES cosmological analysis of Y1 data, and hence the methodology and the systematics tests presented here provide a critical input for that study as well as for future cosmological analyses in DES and other photometric galaxy surveys.

We study the reionization parameter space consistent with the current measurement of the Thomson optical depth using a new parametrization of the reionization history. The mass-weighted ionization fraction is specified in terms of the redshift midpoint, duration, and asymmetry shape parameters. We perform an MCMC analysis using conservative flat priors and physical constraints. Our analysis yields a redshift midpoint of $z_{50}=7.66\substack{+0.57-0.61}\text{(68%)}\substack{+1.26-1.02}\text{(95%)}$, and upper limits on the duration $\Delta_\text{z} < 7.5$ and asymmetry $A_\text{z}<5.3$ for $\tau = 0.054 \pm 0.007$. The reconstructed mass-weighted ionization fraction $x_\text{i}(z)$ is asymmetric, but early contributions to reionization are minor.

We describe the derivation and validation of redshift distribution estimates and their uncertainties for the galaxies used as weak lensing sources in the Dark Energy Survey (DES) Year 1 cosmological analyses. The Bayesian Photometric Redshift (BPZ) code is used to assign galaxies to four redshift bins between z=0.2 and 1.3, and to produce initial estimates of the lensing-weighted redshift distributions $n^i_{PZ}(z)$ for bin i. Accurate determination of cosmological parameters depends critically on knowledge of $n^i$ but is insensitive to bin assignments or redshift errors for individual galaxies. The cosmological analyses allow for shifts $n^i(z)=n^i_{PZ}(z-\Delta z^i)$ to correct the mean redshift of $n^i(z)$ for biases in $n^i_{\rm PZ}$. The $\Delta z^i$ are constrained by comparison of independently estimated 30-band photometric redshifts of galaxies in the COSMOS field to BPZ estimates made from the DES griz fluxes, for a sample matched in fluxes, pre-seeing size, and lensing weight to the DES weak-lensing sources. In companion papers, the $\Delta z^i$ are further constrained by the angular clustering of the source galaxies around red galaxies with secure photometric redshifts at 0.15<z<0.9. This paper details the BPZ and COSMOS procedures, and demonstrates that the cosmological inference is insensitive to details of the $n^i(z)$ beyond the choice of $\Delta z^i$. The clustering and COSMOS validation methods produce consistent estimates of $\Delta z^i$, with combined uncertainties of $\sigma_{\Delta z^i}=$0.015, 0.013, 0.011, and 0.022 in the four bins. We marginalize over these in all analyses to follow, which does not diminish the constraining power significantly. Repeating the photo-z procedure using the Directional Neighborhood Fitting (DNF) algorithm instead of BPZ, or using the $n^i(z)$ directly estimated from COSMOS, yields no discernible difference in cosmological inferences.

We describe the creation, content, and validation of the Dark Energy Survey (DES) internal year-one cosmology data set, Y1A1 GOLD, in support of upcoming cosmological analyses. The Y1A1 GOLD data set is assembled from multiple epochs of DES imaging and consists of calibrated photometric zeropoints, object catalogs, and ancillary data products - e.g., maps of survey depth and observing conditions, star-galaxy classification, and photometric redshift estimates - that are necessary for accurate cosmological analyses. The Y1A1 GOLD wide-area object catalog consists of ~137 million objects detected in coadded images covering ~1800 deg$^2$ in the DES grizY filters. The 10{\sigma} limiting magnitude for galaxies is g = 23.4, r = 23.2, i = 22.5, z = 21.8, and Y = 20.1. Photometric calibration of Y1A1 GOLD was performed by combining nightly zeropoint solutions with stellar-locus regression, and the absolute calibration accuracy is better than 2% over the survey area. DES Y1A1 GOLD is the largest photometric data set at the achieved depth to date, enabling precise measurements of cosmic acceleration at z $\lesssim$ 1.

We use 26 million galaxies from the Dark Energy Survey (DES) Year 1 shape catalogs over 1321 deg$^2$ of the sky to produce the most significant measurement of cosmic shear in a galaxy survey to date. We constrain cosmological parameters in both the flat $\Lambda$CDM and $w$CDM models, while also varying the neutrino mass density. These results are shown to be robust using two independent shape catalogs, two independent \photoz\ calibration methods, and two independent analysis pipelines in a blind analysis. We find a 3.5\% fractional uncertainty on $\sigma_8(\Omega_m/0.3)^{0.5} = 0.782^{+0.027}_{-0.027}$ at 68\% CL, which is a factor of 2.5 improvement over the fractional constraining power of our DES Science Verification results. In $w$CDM, we find a 4.8\% fractional uncertainty on $\sigma_8(\Omega_m/0.3)^{0.5} = 0.777^{+0.036}_{-0.038}$ and a dark energy equation-of-state $w=-0.95^{+0.33}_{-0.39}$. We find results that are consistent with previous cosmic shear constraints in $\sigma_8$ -- $\Omega_m$, and see no evidence for disagreement of our weak lensing data with data from the CMB. Finally, we find no evidence preferring a $w$CDM model allowing $w\ne -1$. We expect further significant improvements with subsequent years of DES data, which will more than triple the sky coverage of our shape catalogs and double the effective integrated exposure time per galaxy.

We construct the largest curved-sky galaxy weak lensing mass map to date from the DES first-year (DES Y1) data. The map, about 10 times larger than previous work, is constructed over a contiguous $\approx1,500 $deg$^2$, covering a comoving volume of $\approx10 $Gpc$^3$. The effects of masking, sampling, and noise are tested using simulations. We generate weak lensing maps from two DES Y1 shear catalogs, Metacalibration and Im3shape, with sources at redshift $0.2<z<1.3,$ and in each of four bins in this range. In the highest signal-to-noise map, the ratio between the mean signal-to-noise in the E-mode and the B-mode map is $\sim$1.5 ($\sim$2) when smoothed with a Gaussian filter of $\sigma_{G}=30$ (80) arcminutes. The second and third moments of the convergence $\kappa$ in the maps are in agreement with simulations. We also find no significant correlation of $\kappa$ with maps of potential systematic contaminants. Finally, we demonstrate two applications of the mass maps: (1) cross-correlation with different foreground tracers of mass and (2) exploration of the largest peaks and voids in the maps.

We present the calibration of the Dark Energy Survey Year 1 (DES Y1) weak lensing source galaxy redshift distributions from clustering measurements. By cross-correlating the positions of source galaxies with luminous red galaxies selected by the redMaGiC algorithm we measure the redshift distributions of the source galaxies as placed into different tomographic bins. These measurements constrain any such shifts to an accuracy of $\sim0.02$ and can be computed even when the clustering measurements do not span the full redshift range. The highest-redshift source bin is not constrained by the clustering measurements because of the minimal redshift overlap with the redMaGiC galaxies. We compare our constraints with those obtained from $\texttt{COSMOS}$ 30-band photometry and find that our two very different methods produce consistent constraints.

We use numerical simulations to characterize the performance of a clustering-based method to calibrate photometric redshift biases. In particular, we cross-correlate the weak lensing (WL) source galaxies from the Dark Energy Survey Year 1 (DES Y1) sample with redMaGiC galaxies (luminous red galaxies with secure photometric redshifts) to estimate the redshift distribution of the former sample. The recovered redshift distributions are used to calibrate the photometric redshift bias of standard photo-$z$ methods applied to the same source galaxy sample. We apply the method to three photo-$z$ codes run in our simulated data: Bayesian Photometric Redshift (BPZ), Directional Neighborhood Fitting (DNF), and Random Forest-based photo-$z$ (RF). We characterize the systematic uncertainties of our calibration procedure, and find that these systematic uncertainties dominate our error budget. The dominant systematics are due to our assumption of unevolving bias and clustering across each redshift bin, and to differences between the shapes of the redshift distributions derived by clustering vs photo-$z$'s. The systematic uncertainty in the mean redshift bias of the source galaxy sample is $\Delta z \lesssim 0.02$, though the precise value depends on the redshift bin under consideration. We discuss possible ways to mitigate the impact of our dominant systematics in future analyses.

Photometric redshift uncertainties are a major source of systematic error for ongoing and future photometric surveys. We study different sources of redshift error caused by choosing a suboptimal redshift histogram bin width and propose methods to resolve them. The selection of a too large bin width is shown to oversmooth small scale structure of the radial distribution of galaxies. This systematic error can significantly shift cosmological parameter constraints by up to $6 \, \sigma$ for the dark energy equation of state parameter $w$. Careful selection of bin width can reduce this systematic by a factor of up to 6 as compared with commonly used current binning approaches. We further discuss a generalised resampling method that can correct systematic and statistical errors in cosmological parameter constraints caused by uncertainties in the redshift distribution. This can be achieved without any prior assumptions about the shape of the distribution or the form of the redshift error. Our methodology allows photometric surveys to obtain unbiased cosmological parameter constraints using a minimum number of spectroscopic calibration data. For a DES-like galaxy clustering forecast we obtain unbiased results with respect to errors caused by suboptimal histogram bin width selection, using only 5k representative spectroscopic calibration objects per tomographic redshift bin.

We present an analysis of a general machine learning technique called 'stacking' for the estimation of photometric redshifts. Stacking techniques can feed the photometric redshift estimate, as output by a base algorithm, back into the same algorithm as an additional input feature in a subsequent learning round. We shown how all tested base algorithms benefit from at least one additional stacking round (or layer). To demonstrate the benefit of stacking, we apply the method to both unsupervised machine learning techniques based on self-organising maps (SOMs), and supervised machine learning methods based on decision trees. We explore a range of stacking architectures, such as the number of layers and the number of base learners per layer. Finally we explore the effectiveness of stacking even when using a successful algorithm such as AdaBoost. We observe a significant improvement of between 1.9% and 21% on all computed metrics when stacking is applied to weak learners (such as SOMs and decision trees). When applied to strong learning algorithms (such as AdaBoost) the ratio of improvement shrinks, but still remains positive and is between 0.4% and 2.5% for the explored metrics and comes at almost no additional computational cost.

We showcase machine learning (ML) inspired target selection algorithms to determine which of all potential targets should be selected first for spectroscopic follow up. Efficient target selection can improve the ML redshift uncertainties as calculated on an independent sample, while requiring less targets to be observed. We compare the ML targeting algorithms with the Sloan Digital Sky Survey (SDSS) target order, and with a random targeting algorithm. The ML inspired algorithms are constructed iteratively by estimating which of the remaining target galaxies will be most difficult for the machine learning methods to accurately estimate redshifts using the previously observed data. This is performed by predicting the expected redshift error and redshift offset (or bias) of all of the remaining target galaxies. We find that the predicted values of bias and error are accurate to better than 10-30% of the true values, even with only limited training sample sizes. We construct a hypothetical follow-up survey and find that some of the ML targeting algorithms are able to obtain the same redshift predictive power with 2-3 times less observing time, as compared to that of the SDSS, or random, target selection algorithms. The reduction in the required follow up resources could allow for a change to the follow-up strategy, for example by obtaining deeper spectroscopy, which could improve ML redshift estimates for deeper test data.

We present an analysis of anomaly detection for machine learning redshift estimation. Anomaly detection allows the removal of poor training examples, which can adversely influence redshift estimates. Anomalous training examples may be photometric galaxies with incorrect spectroscopic redshifts, or galaxies with one or more poorly measured photometric quantity. We select 2.5 million 'clean' SDSS DR12 galaxies with reliable spectroscopic redshifts, and 6730 'anomalous' galaxies with spectroscopic redshift measurements which are flagged as unreliable. We contaminate the clean base galaxy sample with galaxies with unreliable redshifts and attempt to recover the contaminating galaxies using the Elliptical Envelope technique. We then train four machine learning architectures for redshift analysis on both the contaminated sample and on the preprocessed 'anomaly-removed' sample and measure redshift statistics on a clean validation sample generated without any preprocessing. We find an improvement on all measured statistics of up to 80% when training on the anomaly removed sample as compared with training on the contaminated sample for each of the machine learning routines explored. We further describe a method to estimate the contamination fraction of a base data sample.

We introduce an ordinal classification algorithm for photometric redshift estimation, which significantly improves the reconstruction of photometric redshift probability density functions (PDFs) for individual galaxies and galaxy samples. As a use case we apply our method to CFHTLS galaxies. The ordinal classification algorithm treats distinct redshift bins as ordered values, which improves the quality of photometric redshift PDFs, compared with non-ordinal classification architectures. We also propose a new single value point estimate of the galaxy redshift, that can be used to estimate the full redshift PDF of a galaxy sample. This method is competitive in terms of accuracy with contemporary algorithms, which stack the full redshift PDFs of all galaxies in the sample, but requires orders of magnitudes less storage space. The methods described in this paper greatly improve the log-likelihood of individual object redshift PDFs, when compared with a popular Neural Network code (ANNz). In our use case, this improvement reaches 50\% for high redshift objects ($z \geq 0.75$). We show that using these more accurate photometric redshift PDFs will lead to a reduction in the systematic biases by up to a factor of four, when compared with less accurate PDFs obtained from commonly used methods. The cosmological analyses we examine and find improvement upon are the following: gravitational lensing cluster mass estimates, modelling of angular correlation functions, and modelling of cosmic shear correlation functions.

We present analyses of data augmentation for machine learning redshift estimation. Data augmentation makes a training sample more closely resemble a test sample, if the two base samples differ, in order to improve measured statistics of the test sample. We perform two sets of analyses by selecting 800k (1.7M) SDSS DR8 (DR10) galaxies with spectroscopic redshifts. We construct a base training set by imposing an artificial r band apparent magnitude cut to select only bright galaxies and then augment this base training set by using simulations and by applying the K-correct package to artificially place training set galaxies at a higher redshift. We obtain redshift estimates for the remaining faint galaxy sample, which are not used during training. We find that data augmentation reduces the error on the recovered redshifts by 40% in both sets of analyses, when compared to the difference in error between the ideal case and the non augmented case. The outlier fraction is also reduced by at least 10% and up to 80% using data augmentation. We finally quantify how the recovered redshifts degrade as one probes to deeper magnitudes past the artificial magnitude limit of the bright training sample. We find that at all apparent magnitudes explored, the use of data augmentation with tree based methods provide a estimate of the galaxy redshift with a negligible bias, although the error on the recovered values increases as we probe to deeper magnitudes. These results have applications for surveys which have a spectroscopic training set which forms a biased sample of all photometric galaxies, for example if the spectroscopic detection magnitude limit is shallower than the photometric limit.

We present an analysis of importance feature selection applied to photometric redshift estimation using the machine learning architecture Decision Trees with the ensemble learning routine Adaboost (hereafter RDF). We select a list of 85 easily measured (or derived) photometric quantities (or `features') and spectroscopic redshifts for almost two million galaxies from the Sloan Digital Sky Survey Data Release 10. After identifying which features have the most predictive power, we use standard artificial Neural Networks (aNN) to show that the addition of these features, in combination with the standard magnitudes and colours, improves the machine learning redshift estimate by 18% and decreases the catastrophic outlier rate by 32%. We further compare the redshift estimate using RDF with those from two different aNNs, and with photometric redshifts available from the SDSS. We find that the RDF requires orders of magnitude less computation time than the aNNs to obtain a machine learning redshift while reducing both the catastrophic outlier rate by up to 43%, and the redshift error by up to 25%. When compared to the SDSS photometric redshifts, the RDF machine learning redshifts both decreases the standard deviation of residuals scaled by 1/(1+z) by 36% from 0.066 to 0.041, and decreases the fraction of catastrophic outliers by 57% from 2.32% to 0.99%.

We present results from a study of the photometric redshift performance of the Dark Energy Survey (DES), using the early data from a Science Verification (SV) period of observations in late 2012 and early 2013 that provided science-quality images for almost 200 sq.~deg.~at the nominal depth of the survey. We assess the photometric redshift performance using about 15000 galaxies with spectroscopic redshifts available from other surveys. These galaxies are used, in different configurations, as a calibration sample, and photo-$z$'s are obtained and studied using most of the existing photo-$z$ codes. A weighting method in a multi-dimensional color-magnitude space is applied to the spectroscopic sample in order to evaluate the photo-$z$ performance with sets that mimic the full DES photometric sample, which is on average significantly deeper than the calibration sample due to the limited depth of spectroscopic surveys. Empirical photo-$z$ methods using, for instance, Artificial Neural Networks or Random Forests, yield the best performance in the tests, achieving core photo-$z$ resolutions $\sigma_{68} \sim 0.08$. Moreover, the results from most of the codes, including template fitting methods, comfortably meet the DES requirements on photo-$z$ performance, therefore, providing an excellent precedent for future DES data sets.