Data Challenge 1 (DC1) is the first synthetic dataset produced by the Rubin Observatory Legacy Survey of Space and Time (LSST) Dark Energy Science Collaboration (DESC). DC1 is designed to develop and validate data reduction and analysis and to study the impact of systematic effects that will affect the LSST dataset. DC1 is comprised of $r$-band observations of 40 deg$^{2}$ to 10-year LSST depth. We present each stage of the simulation and analysis process: a) generation, by synthesizing sources from cosmological N-body simulations in individual sensor-visit images with different observing conditions; b) reduction using a development version of the LSST Science Pipelines; and c) matching to the input cosmological catalog for validation and testing. We verify that testable LSST requirements pass within the fidelity of DC1. We establish a selection procedure that produces a sufficiently clean extragalactic sample for clustering analyses and we discuss residual sample contamination, including contributions from inefficiency in star-galaxy separation and imperfect deblending. We compute the galaxy power spectrum on the simulated field and conclude that: i) survey properties have an impact of 50\% of the statistical uncertainty for the scales and models used in DC1 ii) a selection to eliminate artifacts in the catalogs is necessary to avoid biases in the measured clustering; iii) the presence of bright objects has a significant impact (2- to 6-$\sigma$) in the estimated power spectra at small scales ($\ell > 1200$), highlighting the impact of blending in studies at small angular scales in LSST;

This paper presents the second data release of the Hyper Suprime-Cam Subaru Strategic Program, a wide-field optical imaging survey on the 8.2 meter Subaru Telescope. The release includes data from 174 nights of observation through January 2018. The Wide layer data cover about 300 deg^2 in all five broadband filters (grizy) to the nominal survey exposure (10min in gr and 20min in izy). Partially observed areas are also included in the release; about 1100 deg^2 is observed in at least one filter and one exposure. The median seeing in the i-band is 0.6 arcsec, demonstrating the superb image quality of the survey. The Deep (26 deg^2) and UltraDeep (4 deg^2) data are jointly processed and the UltraDeep-COSMOS field reaches an unprecedented depth of i~28 at 5 sigma for point sources. In addition to the broad-bands, narrow-band data are also available in the Deep and UltraDeep fields. This release includes a major update to the processing pipeline, including improved sky subtraction, PSF modeling, object detection, and artifact rejection. The overall data quality has been improved, but this release is not without problems; there is a persistent deblender problem as well as new issues with masks around bright stars. The user is encouraged to review the issue list before utilizing the data for scientific explorations. All the image products as well as catalog products are available for download. The catalogs are also loaded to a database, which provides an easy interface for users to retrieve data for objects of interest. In addition to these main data products, detailed galaxy shape measurements withheld from the Public Data Release 1 (PDR1) are now available to the community. The shape catalog is drawn from the S16A internal release, which has a larger area than PDR1 (160 deg^2). All products are available at the data release site, https://hsc-release.mtk.nao.ac.jp/.

The Large Synoptic Survey Telescope (LSST) is an ambitious astronomical survey with a similarly ambitious Data Management component. Data Management for LSST includes processing on both nightly and yearly cadences to generate transient alerts, deep catalogs of the static sky, and forced photometry light-curves for billions of objects at hundreds of epochs, spanning at least a decade. The algorithms running in these pipelines are individually sophisticated and interact in subtle ways. This paper provides an overview of those pipelines, focusing more on those interactions than the details of any individual algorithm.

We present reverberation mapping results from the first year of combined spectroscopic and photometric observations of the Sloan Digital Sky Survey Reverberation Mapping Project. We successfully recover reverberation time delays between the $g+i$-band emission and the broad H$\beta$ emission line for a total of 44 quasars, and for the broad H$\alpha$ emission line in 18 quasars. Time delays are computed using the JAVELIN and CREAM software and the traditional interpolated cross-correlation function (ICCF): Using well defined criteria, we report measurements of 32 H$\beta$ and 13 H$\alpha$ lags with JAVELIN, 42 H$\beta$ and 17 H$\alpha$ lags with CREAM, and 16 H$\beta$ and 8 H$\alpha$ lags with the ICCF. Lag values are generally consistent among the three methods, though we typically measure smaller uncertainties with JAVELIN and CREAM than with the ICCF, given the more physically motivated light curve interpolation and more robust statistical modeling of the former two methods. The median redshift of our H$\beta$-detected sample of quasars is 0.53, significantly higher than that of the previous reverberation-mapping sample. We find that in most objects, the time delay of the H$\alpha$ emission is consistent with or slightly longer than that of H$\beta$. We measure black hole masses using our measured time delays and line widths for these quasars. These black hole mass measurements are mostly consistent with expectations based on the local M-sigma relationship, and are also consistent with single-epoch black hole mass measurements. This work increases the current sample size of reverberation-mapped active galaxies by about two-thirds and represents the first large sample of reverberation mapping observations beyond the local universe (z < 0.3).

(Abridged) We describe here the most ambitious survey currently planned in the optical, the Large Synoptic Survey Telescope (LSST). A vast array of science will be enabled by a single wide-deep-fast sky survey, and LSST will have unique survey capability in the faint time domain. The LSST design is driven by four main science themes: probing dark energy and dark matter, taking an inventory of the Solar System, exploring the transient optical sky, and mapping the Milky Way. LSST will be a wide-field ground-based system sited at Cerro Pach\'{o}n in northern Chile. The telescope will have an 8.4 m (6.5 m effective) primary mirror, a 9.6 deg$^2$ field of view, and a 3.2 Gigapixel camera. The standard observing sequence will consist of pairs of 15-second exposures in a given field, with two such visits in each pointing in a given night. With these repeats, the LSST system is capable of imaging about 10,000 square degrees of sky in a single filter in three nights. The typical 5$\sigma$ point-source depth in a single visit in $r$ will be $\sim 24.5$ (AB). The project is in the construction phase and will begin regular survey operations by 2022. The survey area will be contained within 30,000 deg$^2$ with $\delta<+34.5^\circ$, and will be imaged multiple times in six bands, $ugrizy$, covering the wavelength range 320--1050 nm. About 90\% of the observing time will be devoted to a deep-wide-fast survey mode which will uniformly observe a 18,000 deg$^2$ region about 800 times (summed over all six bands) during the anticipated 10 years of operations, and yield a coadded map to $r\sim27.5$. The remaining 10\% of the observing time will be allocated to projects such as a Very Deep and Fast time domain survey. The goal is to make LSST data products, including a relational database of about 32 trillion observations of 40 billion objects, available to the public and scientists around the world.

In this paper, we describe the optical imaging data processing pipeline developed for the Subaru Telescope's Hyper Suprime-Cam (HSC) instrument. The HSC Pipeline builds on the prototype pipeline being developed by the Large Synoptic Survey Telescope's Data Management system, adding customizations for HSC, large-scale processing capabilities, and novel algorithms that have since been reincorporated into the LSST codebase. While designed primarily to reduce HSC Subaru Strategic Program (SSP) data, it is also the recommended pipeline for reducing general-observer HSC data. The HSC pipeline includes high level processing steps that generate coadded images and science-ready catalogs as well as low-level detrending and image characterizations.

The Large Synoptic Survey Telescope (LSST) is a large-aperture, wide-field, ground-based survey system that will image the sky in six optical bands from 320 to 1050 nm, uniformly covering approximately $18,000$deg$^2$ of the sky over 800 times. The LSST is currently under construction on Cerro Pach\'on in Chile, and expected to enter operations in 2022. Once operational, the LSST will explore a wide range of astrophysical questions, from discovering "killer" asteroids to examining the nature of Dark Energy. The LSST will generate on average 15 TB of data per night, and will require a comprehensive Data Management system to reduce the raw data to scientifically useful catalogs and images with minimum human intervention. These reductions will result in a real-time alert stream, and eleven data releases over the 10-year duration of LSST operations. To enable this processing, the LSST project is developing a new, general-purpose, high-performance, scalable, well documented, open source data processing software stack for O/IR surveys. Prototypes of this stack are already capable of processing data from existing cameras (e.g., SDSS, DECam, MegaCam), and form the basis of the Hyper-Suprime Cam (HSC) Survey data reduction pipeline.

Luminous distant quasars are unique probes of the high redshift intergalactic medium (IGM) and of the growth of massive galaxies and black holes in the early universe. Absorption due to neutral Hydrogen in the IGM makes quasars beyond a redshift of z~6.5 very faint in the optical $z$-band, thus locating quasars at higher redshifts require large surveys that are sensitive above 1 micron. We report the discovery of three new z>6.5 quasars, corresponding to an age of the universe of <850 Myr, selected as z-band dropouts in the Pan-STARRS1 survey. This increases the number of known z>6.5 quasars from 4 to 7. The quasars have redshifts of z=6.50, 6.52, and 6.66, and include the brightest z-dropout quasar reported to date, PSO J036.5078+03.0498 with M_1450=-27.4. We obtained near-infrared spectroscopy for the quasars and from the MgII line we estimate that the central black holes have masses between 5x10^8 and 4x10^9 M_sun, and are accreting close to the Eddington limit (L_Bol/L_Edd=0.13-1.2). We investigate the ionized regions around the quasars and find near zone radii of R_NZ=1.5-5.2 proper Mpc, confirming the trend of decreasing near zone sizes with increasing redshift found for quasars at 5.7<z<6.4. By combining R_NZ of the PS1 quasars with those of 5.7<z<7.1 quasars in the literature, we derive a luminosity corrected redshift evolution of R_NZ,corrected=(7.2+/-0.2)-(6.1+/-0.7)x(z-6) Mpc. However, the large spread in R_NZ in the new quasars implies a wide range in quasar ages and/or a large variation in the neutral Hydrogen fraction along different lines of sight.

We present the fiducial main sequence stellar locus traced by 10 photometric colors observed by SDSS, 2MASS, and WISE. Median colors are determined using 1,052,793 stars with r-band extinction less than 0.125. We use this locus to measure the dust extinction curve relative to the r-band, which is consistent with previous measurements in the SDSS and 2MASS bands. The WISE band extinction coefficients are larger than predicted by standard extinction models. Using 13 lines of sight, we find variations in the extinction curve in H, Ks, and WISE bandpasses. Relative extinction decreases towards Galactic anti-center, in agreement with prior studies. Relative extinction increases with Galactic latitude, in contrast to previous observations. This indicates a universal mid-IR extinction law does not exist due to variations in dust grain size and chemistry with Galactocentric position. A preliminary search for outliers due to warm circumstellar dust is also presented, using stars with high signal-to-noise in the W3-band. We find 199 such outliers, identified by excess emission in Ks-W3. Inspection of SDSS images for these outliers reveals a large number of contaminants due to nearby galaxies. Six sources appear to be genuine dust candidates, yielding a fraction of systems with infrared excess of 0.12$\pm$0.05%.

The statistics of peak counts in reconstructed shear maps contain information beyond the power spectrum, and can improve cosmological constraints from measurements of the power spectrum alone if systematic errors can be controlled. We study the effect of galaxy shape measurement errors on predicted cosmological constraints from the statistics of shear peak counts with the Large Synoptic Survey Telescope (LSST). We use the LSST image simulator in combination with cosmological N-body simulations to model realistic shear maps for different cosmological models. We include both galaxy shape noise and, for the first time, measurement errors on galaxy shapes. We find that the measurement errors considered have relatively little impact on the constraining power of shear peak counts for LSST.

A main science goal for the Large Synoptic Survey Telescope (LSST) is to measure the cosmic shear signal from weak lensing to extreme accuracy. One difficulty, however, is that with the short exposure time ($\simeq$15 seconds) proposed, the spatial variation of the Point Spread Function (PSF) shapes may be dominated by the atmosphere, in addition to optics errors. While optics errors mainly cause the PSF to vary on angular scales similar or larger than a single CCD sensor, the atmosphere generates stochastic structures on a wide range of angular scales. It thus becomes a challenge to infer the multi-scale, complex atmospheric PSF patterns by interpolating the sparsely sampled stars in the field. In this paper we present a new method, PSFent, for interpolating the PSF shape parameters, based on reconstructing underlying shape parameter maps with a multi-scale maximum entropy algorithm. We demonstrate, using images from the LSST Photon Simulator, the performance of our approach relative to a 5th-order polynomial fit (representing the current standard) and a simple boxcar smoothing technique. Quantitatively, PSFent predicts more accurate PSF models in all scenarios and the residual PSF errors are spatially less correlated. This improvement in PSF interpolation leads to a factor of 3.5 lower systematic errors in the shear power spectrum on scales smaller than $\sim13'$, compared to polynomial fitting. We estimate that with PSFent and for stellar densities greater than $\simeq1/{\rm arcmin}^{2}$, the spurious shear correlation from PSF interpolation, after combining a complete 10-year dataset from LSST, is lower than the corresponding statistical uncertainties on the cosmic shear power spectrum, even under a conservative scenario.

The complete 10-year survey from the Large Synoptic Survey Telescope (LSST) will image $\sim$ 20,000 square degrees of sky in six filter bands every few nights, bringing the final survey depth to $r\sim27.5$, with over 4 billion well measured galaxies. To take full advantage of this unprecedented statistical power, the systematic errors associated with weak lensing measurements need to be controlled to a level similar to the statistical errors. This work is the first attempt to quantitatively estimate the absolute level and statistical properties of the systematic errors on weak lensing shear measurements due to the most important physical effects in the LSST system via high fidelity ray-tracing simulations. We identify and isolate the different sources of algorithm-independent, \textit{additive} systematic errors on shear measurements for LSST and predict their impact on the final cosmic shear measurements using conventional weak lensing analysis techniques. We find that the main source of the errors comes from an inability to adequately characterise the atmospheric point spread function (PSF) due to its high frequency spatial variation on angular scales smaller than $\sim10'$ in the single short exposures, which propagates into a spurious shear correlation function at the $10^{-4}$--$10^{-3}$ level on these scales. With the large multi-epoch dataset that will be acquired by LSST, the stochastic errors average out, bringing the final spurious shear correlation function to a level very close to the statistical errors. Our results imply that the cosmological constraints from LSST will not be severely limited by these algorithm-independent, additive systematic effects.

By selecting astrometric and photometric data from the Sloan Digital Sky Survey (SDSS), the L{\'e}pine & Shara Proper Motion North Catalog (LSPM-North), the Two Micron All Sky Survey (2MASS), and the USNO-B1.0 catalog, we use a succession of methods to isolate white dwarf candidates for follow-up spectroscopy. Our methods include: reduced proper motion diagram cuts, color cuts, and atmospheric model adherence. We present spectroscopy of 26 white dwarfs obtained from the CTIO 4m and APO 3.5m telescopes. Additionally, we confirm 28 white dwarfs with spectra available in the SDSS DR7 database but unpublished elsewhere, presenting a total of 54 WDs. We label one of these as a recovered WD while the remaining 53 are new discoveries. We determine physical parameters and estimate distances based on atmospheric model analyses. Three new white dwarfs are modeled to lie within 25 pc. Two additional white dwarfs are confirmed to be metal-polluted (DAZ). Follow-up time series photometry confirms another object to be a pulsating ZZ Ceti white dwarf.

We analyze the cross-correlation of 2,705 unambiguously intervening Mg II (2796,2803A) quasar absorption line systems with 1,495,604 luminous red galaxies (LRGs) from the Fifth Data Release of the Sloan Digital Sky Survey within the redshift range 0.36<=z<=0.8. We confirm with high precision a previously reported weak anti-correlation of equivalent width and dark matter halo mass, measuring the average masses to be log M_h(M_[solar]h^-1)=11.29 [+0.36,-0.62] and log M_h(M_[solar]h^-1)=12.70 [+0.53,-1.16] for systems with W[2796A]>=1.4A and 0.8A<=W[2796A]<1.4A, respectively. Additionally, we investigate the significance of a number of potential sources of bias inherent in absorber-LRG cross-correlation measurements, including absorber velocity distributions and the weak lensing of background quasars, which we determine is capable of producing a 20-30% bias in angular cross-correlation measurements on scales less than 2'. We measure the Mg II - LRG cross-correlation for 719 absorption systems with v<60,000 km s^-1 in the quasar rest frame and find that these associated absorbers typically reside in dark matter haloes that are ~10-100 times more massive than those hosting unambiguously intervening Mg II absorbers. Furthermore, we find evidence for evolution of the redshift number density, dN/dz, with 2-sigma significance for the strongest (W>2.0A) absorbers in the DR5 sample. This width-dependent dN/dz evolution does not significantly affect the recovered equivalent width-halo mass anti-correlation and adds to existing evidence that the strongest Mg II absorption systems are correlated with an evolving population of field galaxies at z<0.8, while the non-evolving dN/dz of the weakest absorbers more closely resembles that of the LRG population.

We have studied a sample of 415 associated (z_ab z_em; relative velocity with respect to QSO <3000km/s) Mg II absorption systems with 1.0<=z_ab<=1.86, in the spectra of SDSS DR3 QSOs, to determine the dust content and ionization state in the absorbers. We studied the dependence of these properties on the properties of the QSOs and also, compared the properties with those of a similarly selected sample of 809 intervening systems (apparent relative velocity with respect to the QSO of >3000km/s), so as to understand their origin. From the analysis of the composite spectra, as well as from the comparison of measured equivalent widths in individual spectra, we conclude that the associated Mg II absorbers have higher apparent ionization, measured by the strength of the C IV absorption lines compared to the Mg II absorption lines, than the intervening absorbers. The ionization so measured appears to be related to apparent ejection velocity, being lower as the apparent ejection velocity is more and more positive. There is clear evidence, from the composite spectra, for SMC like dust attenuation in these systems; the 2175AA absorption feature is not present. The extinction is almost twice that observed in the similarly selected sample of intervening systems. We reconfirm that QSOs with non-zero FIRST radio flux are intrinsically redder than the QSOs with no detection in the FIRST survey. The incidence of associated Mg II systems in QSOs with non-zero FIRST radio flux is 1.7 times that in the QSOs with no detection in the FIRST survey. The associated absorbers in radio-detected QSOs which comprise about 12% of our sample, cause 3 times more reddening than the associated absorbers in radio-undetected QSOs. This excess reddening possibly suggests an intrinsic nature for the associated absorbers in radio-detected QSOs.

We have studied a sample of 809 Mg II absorption systems with 1.0 < z_abs < 1.86 in the spectra of SDSS QSOs, with the aim of understanding the nature and abundance of the dust and the chemical abundances in the intervening absorbers. Normalized, composite spectra were derived, for abundance measurements, for the full sample and several sub-samples, chosen on the basis of the line strengths and other absorber and QSO properties. Average extinction curves were obtained for the sub-samples by comparing their geometric mean spectra with those of matching samples of QSOs without absorbers in their spectra. There is clear evidence for the presence of dust in the intervening absorbers. The 2175 A feature is not present in the extinction curves, for any of the sub-samples. The extinction curves are similar to the SMC extinction curve with a rising UV extinction below 2200 A. The absorber rest frame colour excess, E(B-V), derived from the extinction curves, depends on the absorber properties and ranges from < 0.001 to 0.085 for various sub-samples. The column densities of several ions do not show such a correspondingly large variation. The depletion pattern is similar to halo clouds in the Galaxy. Assuming an SMC gas-to-dust ratio we find a trend of increasing abundance with decreasing extinction; systems with N_H I \~ 10^{20} cm^{-2} show solar abundance of Zn. The large velocity spread of strong Mg II systems seems to be mimicked by weak lines of other elements. The ionization of the absorbers, in general appears to be low. QSOs with absorbers are, in general, at least three times as likely to have highly reddened spectra as compared to QSOs without any absorption systems in their spectra.

We find evidence for dust in the intervening QSO absorbers from the spectra of QSOs in the Sloan Digital Sky Survey Data Release 1. No evidence is found for the 2175 A feature which is present in the Milky Way dust extinction curve. The extinction curve resembles the SMC extinction curve. The observed Delta(g-i) excess for QSOs with strong absorption systems appears to be a result of the reddening due to dust in the intervening absorbers.