High resolution galaxy spectra contain much information about galactic physics, but the high dimensionality of these spectra makes it difficult to fully utilize the information they contain. We apply variational autoencoders (VAEs), a non-linear dimensionality reduction technique, to a sample of spectra from the Sloan Digital Sky Survey. In contrast to Principal Component Analysis (PCA), a widely used technique, VAEs can capture non-linear relationships between latent parameters and the data. We find that a VAE can reconstruct the SDSS spectra well with only six latent parameters, outperforming PCA with the same number of components. Different galaxy classes are naturally separated in this latent space, without class labels having been given to the VAE. The VAE latent space is interpretable because the VAE can be used to make synthetic spectra at any point in latent space. For example, making synthetic spectra along tracks in latent space yields sequences of realistic spectra that interpolate between two different types of galaxies. Using the latent space to find outliers may yield interesting spectra: in our small sample, we immediately find unusual data artifacts and stars misclassified as galaxies. In this exploratory work, we show that VAEs create compact, interpretable latent spaces that capture non-linear features of the data. While a VAE takes substantial time to train (~1 day for 48000 spectra), once trained, VAEs can enable the fast exploration of large astronomical data sets.

We report studies on mitigation of optical effects of bright Low-Earth-Orbit (LEO) satellites on Vera C. Rubin Observatory and its Legacy Survey of Space and Time (LSST). These include options for pointing the telescope to avoid satellites, laboratory investigations of bright trails on the Rubin Observatory LSST Camera sensors, algorithms for correcting image artifacts caused by bright trails, experiments on darkening SpaceX Starlink satellites, and ground-based follow-up observations. Starlink satellites with no brightness mitigation are presently g ~ 5.1 mag, and an initial experiment "DarkSat" is g ~ 6.1 mag. Future Starlink darkening plans may reach g ~ 7 mag, a brightness level that enables non-linear image artifact correction to the same level as background noise. However, the satellite trails will still exist at S/N ~ 100, generating systematics that may impact data analysis and limiting some science. LEO satellite trails are wider than a point-spread function because satellites are slightly out of focus due to their finite distance; for Rubin Observatory's 8.4-m mirror and a satellite at 550 km, this widening effect is about 3 arcsec, which helps avoid saturation by decreasing the trail's peak surface brightness.

Westerlund 1 (Wd1) is potentially the largest star cluster in the Galaxy. That designation critically depends upon the distance to the cluster, yet the cluster is highly obscured, making luminosity-based distance estimates difficult. Using {\it Gaia} Data Release 2 (DR2) parallaxes and Bayesian inference, we infer a parallax of $0.35^{+0.07}_{-0.06}$ mas corresponding to a distance of $2.6^{+0.6}_{-0.4}$ kpc. To leverage the combined statistics of all stars in the direction of Wd1, we derive the Bayesian model for a cluster of stars hidden among Galactic field stars; this model includes the parallax zero-point. Previous estimates for the distance to Wd1 ranged from 1.0 to 5.5 kpc, although values around 5 kpc have usually been adopted. The {\it Gaia} DR2 parallaxes reduce the uncertainty from a factor of 3 to 18\% and rules out the most often quoted value of 5 kpc with 99\% confidence. This new distance allows for more accurate mass and age determinations for the stars in Wd1. For example, the previously inferred initial mass at the main-sequence turn-off was around 40 M$_{\odot}$; the new {\it Gaia} DR2 distance shifts this down to about 22 M$_{\odot}$. This has important implications for our understanding of the late stages of stellar evolution, including the initial mass of the magnetar and the LBV in Wd1. Similarly, the new distance suggests that the total cluster mass is about four times lower than previously calculated.

The Zwicky Transient Facility is a large optical survey in multiple filters producing hundreds of thousands of transient alerts per night. We describe here various machine learning (ML) implementations and plans to make the maximal use of the large data set by taking advantage of the temporal nature of the data, and further combining it with other data sets. We start with the initial steps of separating bogus candidates from real ones, separating stars and galaxies, and go on to the classification of real objects into various classes. Besides the usual methods (e.g., based on features extracted from light curves) we also describe early plans for alternate methods including the use of domain adaptation, and deep learning. In a similar fashion we describe efforts to detect fast moving asteroids. We also describe the use of the Zooniverse platform for helping with classifications through the creation of training samples, and active learning. Finally we mention the synergistic aspects of ZTF and LSST from the ML perspective.

The Large Synoptic Survey Telescope (LSST) is an ambitious astronomical survey with a similarly ambitious Data Management component. Data Management for LSST includes processing on both nightly and yearly cadences to generate transient alerts, deep catalogs of the static sky, and forced photometry light-curves for billions of objects at hundreds of epochs, spanning at least a decade. The algorithms running in these pipelines are individually sophisticated and interact in subtle ways. This paper provides an overview of those pipelines, focusing more on those interactions than the details of any individual algorithm.

A large population of ultra-diffuse galaxies (UDGs) was recently discovered in the Coma cluster. Here we present optical spectra of three such UDGs, DF7, DF44 and DF17, which have central surface brightnesses of $\mu_g \approx 24.4-25.1$ mag arcsec$^{-2}$. The spectra were acquired as part of an ancillary program within the SDSS-IV MaNGA Survey. We stacked 19 fibers in the central regions from larger integral field units (IFUs) per source. With over 13.5 hours of on-source integration we achieved a mean signal-to-noise ratio (S/N) in the optical of $9.5$\AA$^{-1}$, $7.9$\AA$^{-1}$ and $5.0$\AA$^{-1}$, respectively, for DF7, DF44 and DF17. Stellar population models applied to these spectra enable measurements of recession velocities, ages and metallicities. The recession velocities of DF7, DF44 and DF17 are $6599^{+40}_{-25}$km/s, $6402^{+41}_{-39}$km/s and $8315^{+43}_{-43}$km/s, spectroscopically confirming that all of them reside in the Coma cluster. The stellar populations of these three galaxies are old and metal-poor, with ages of $7.9^{+3.6}_{-2.5}$Gyr, $8.9^{+4.3}_{-3.3}$Gyr and $9.1^{+3.9}_{-5.5}$Gyr, and iron abundances of $\mathrm{[Fe/H]}$ $-1.0^{+0.3}_{-0.4}$, $-1.3^{+0.4}_{-0.4}$ and $-0.8^{+0.5}_{-0.5}$, respectively. Their stellar masses are $3$-$6\times10^8 M_\odot$. The UDGs in our sample are as old or older than galaxies at similar stellar mass or velocity dispersion (only DF44 has an independently measured dispersion). They all follow the well-established stellar mass$-$stellar metallicity relation, while DF44 lies below the velocity dispersion-metallicity relation. These results, combined with the fact that UDGs are unusually large for their stellar mass, suggest that stellar mass plays a more important role in setting stellar population properties for these galaxies than either size or surface brightness.

(Abridged) We describe here the most ambitious survey currently planned in the optical, the Large Synoptic Survey Telescope (LSST). A vast array of science will be enabled by a single wide-deep-fast sky survey, and LSST will have unique survey capability in the faint time domain. The LSST design is driven by four main science themes: probing dark energy and dark matter, taking an inventory of the Solar System, exploring the transient optical sky, and mapping the Milky Way. LSST will be a wide-field ground-based system sited at Cerro Pach\'{o}n in northern Chile. The telescope will have an 8.4 m (6.5 m effective) primary mirror, a 9.6 deg$^2$ field of view, and a 3.2 Gigapixel camera. The standard observing sequence will consist of pairs of 15-second exposures in a given field, with two such visits in each pointing in a given night. With these repeats, the LSST system is capable of imaging about 10,000 square degrees of sky in a single filter in three nights. The typical 5$\sigma$ point-source depth in a single visit in $r$ will be $\sim 24.5$ (AB). The project is in the construction phase and will begin regular survey operations by 2022. The survey area will be contained within 30,000 deg$^2$ with $\delta<+34.5^\circ$, and will be imaged multiple times in six bands, $ugrizy$, covering the wavelength range 320--1050 nm. About 90\% of the observing time will be devoted to a deep-wide-fast survey mode which will uniformly observe a 18,000 deg$^2$ region about 800 times (summed over all six bands) during the anticipated 10 years of operations, and yield a coadded map to $r\sim27.5$. The remaining 10\% of the observing time will be allocated to projects such as a Very Deep and Fast time domain survey. The goal is to make LSST data products, including a relational database of about 32 trillion observations of 40 billion objects, available to the public and scientists around the world.

The Astropy project supports and fosters the development of open-source and openly-developed Python packages that provide commonly-needed functionality to the astronomical community. A key element of the Astropy project is the core package Astropy, which serves as the foundation for more specialized projects and packages. In this article, we provide an overview of the organization of the Astropy project and summarize key features in the core package as of the recent major release, version 2.0. We then describe the project infrastructure designed to facilitate and support development for a broader ecosystem of inter-operable packages. We conclude with a future outlook of planned new features and directions for the broader Astropy project.

The fourth generation of the Sloan Digital Sky Survey (SDSS-IV) began observations in July 2014. It pursues three core programs: APOGEE-2, MaNGA, and eBOSS. In addition, eBOSS contains two major subprograms: TDSS and SPIDERS. This paper describes the first data release from SDSS-IV, Data Release 13 (DR13), which contains new data, reanalysis of existing data sets and, like all SDSS data releases, is inclusive of previously released data. DR13 makes publicly available 1390 spatially resolved integral field unit observations of nearby galaxies from MaNGA, the first data released from this survey. It includes new observations from eBOSS, completing SEQUELS. In addition to targeting galaxies and quasars, SEQUELS also targeted variability-selected objects from TDSS and X-ray selected objects from SPIDERS. DR13 includes new reductions of the SDSS-III BOSS data, improving the spectrophotometric calibration and redshift classification. DR13 releases new reductions of the APOGEE-1 data from SDSS-III, with abundances of elements not previously included and improved stellar parameters for dwarf stars and cooler stars. For the SDSS imaging data, DR13 provides new, more robust and precise photometric calibrations. Several value-added catalogs are being released in tandem with DR13, in particular target catalogs relevant for eBOSS, TDSS, and SPIDERS, and an updated red-clump catalog for APOGEE. This paper describes the location and format of the data now publicly available, as well as providing references to the important technical papers that describe the targeting, observing, and data reduction. The SDSS website, http://www.sdss.org, provides links to the data, tutorials and examples of data access, and extensive documentation of the reduction and analysis procedures. DR13 is the first of a scheduled set that will contain new data and analyses from the planned ~6-year operations of SDSS-IV.

We present the first stable release of Halotools (v0.2), a community-driven Python package designed to build and test models of the galaxy-halo connection. Halotools provides a modular platform for creating mock universes of galaxies starting from a catalog of dark matter halos obtained from a cosmological simulation. The package supports many of the common forms used to describe galaxy-halo models: the halo occupation distribution (HOD), the conditional luminosity function (CLF), abundance matching, and alternatives to these models that include effects such as environmental quenching or variable galaxy assembly bias. Satellite galaxies can be modeled to live in subhalos, or to follow custom number density profiles within their halos, including spatial and/or velocity bias with respect to the dark matter profile. The package has an optimized toolkit to make mock observations on a synthetic galaxy population, including galaxy clustering, galaxy-galaxy lensing, galaxy group identification, RSD multipoles, void statistics, pairwise velocities and others, allowing direct comparison to observations. Halotools is object-oriented, enabling complex models to be built from a set of simple, interchangeable components, including those of your own creation. Halotools has an automated testing suite and is exhaustively documented on http://halotools.readthedocs.io, which includes quickstart guides, source code notes and a large collection of tutorials. The documentation is effectively an online textbook on how to build and study empirical models of galaxy formation with Python.

We present a direct measurement of the mean halo occupation distribution (HOD) of galaxies taken from the eleventh data release (DR11) of the Sloan Digital Sky Survey-III Baryon Oscillation Spectroscopic Survey (BOSS). The HOD of BOSS low-redshift (LOWZ: $0.2 < z < 0.4$) and Constant-Mass (CMASS: $0.43 <z <0.7$) galaxies is inferred via their association with the dark-matter halos of 174 X-ray-selected galaxy clusters drawn from the XMM Cluster Survey (XCS). Halo masses are determined for each galaxy cluster based on X-ray temperature measurements, and range between ${\rm log_{10}} (M_{180}/M_{\odot}) = 13-15$. Our directly measured HODs are consistent with the HOD-model fits inferred via the galaxy-clustering analyses of Parejko et al. for the BOSS LOWZ sample and White et al. for the BOSS CMASS sample. Under the simplifying assumption that the other parameters that describe the HOD hold the values measured by these authors, we have determined a best-fit alpha-index of 0.91$\pm$0.08 and $1.27^{+0.03}_{-0.04}$ for the CMASS and LOWZ HOD, respectively. These alpha-index values are consistent with those measured by White et al. and Parejko et al. In summary, our study provides independent support for the HOD models assumed during the development of the BOSS mock-galaxy catalogues that have subsequently been used to derive BOSS cosmological constraints.

The Astropy Project (http://astropy.org) is, in its own words, "a community effort to develop a single core package for Astronomy in Python and foster interoperability between Python astronomy packages." For five years this project has been managed, written, and operated as a grassroots, self-organized, almost entirely volunteer effort while the software is used by the majority of the astronomical community. Despite this, the project has always been and remains to this day effectively unfunded. Further, contributors receive little or no formal recognition for creating and supporting what is now critical software. This paper explores the problem in detail, outlines possible solutions to correct this, and presents a few suggestions on how to address the sustainability of general purpose astronomical software.

The MaNGA Survey (Mapping Nearby Galaxies at Apache Point Observatory) is one of three core programs in the Sloan Digital Sky Survey IV. It is obtaining integral field spectroscopy (IFS) for 10K nearby galaxies at a spectral resolution of R~2000 from 3,622-10,354A. The design of the survey is driven by a set of science requirements on the precision of estimates of the following properties: star formation rate surface density, gas metallicity, stellar population age, metallicity, and abundance ratio, and their gradients; stellar and gas kinematics; and enclosed gravitational mass as a function of radius. We describe how these science requirements set the depth of the observations and dictate sample selection. The majority of targeted galaxies are selected to ensure uniform spatial coverage in units of effective radius (Re) while maximizing spatial resolution. About 2/3 of the sample is covered out to 1.5Re (Primary sample), and 1/3 of the sample is covered to 2.5Re (Secondary sample). We describe the survey execution with details that would be useful in the design of similar future surveys. We also present statistics on the achieved data quality, specifically, the point spread function, sampling uniformity, spectral resolution, sky subtraction, and flux calibration. For our Primary sample, the median r-band signal-to-noise ratio is ~73 per 1.4A pixel for spectra stacked between 1-1.5 Re. Measurements of various galaxy properties from the first year data show that we are meeting or exceeding the defined requirements for the majority of our science goals.

Mapping Nearby Galaxies at Apache Point Observatory (MaNGA) is an optical fiber-bundle integral-field unit (IFU) spectroscopic survey that is one of three core programs in the fourth-generation Sloan Digital Sky Survey (SDSS-IV). With a spectral coverage of 3622 - 10,354 Angstroms and an average footprint of ~ 500 arcsec^2 per IFU the scientific data products derived from MaNGA will permit exploration of the internal structure of a statistically large sample of 10,000 low redshift galaxies in unprecedented detail. Comprising 174 individually pluggable science and calibration IFUs with a near-constant data stream, MaNGA is expected to obtain ~ 100 million raw-frame spectra and ~ 10 million reduced galaxy spectra over the six-year lifetime of the survey. In this contribution, we describe the MaNGA Data Reduction Pipeline (DRP) algorithms and centralized metadata framework that produces sky-subtracted, spectrophotometrically calibrated spectra and rectified 3-D data cubes that combine individual dithered observations. For the 1390 galaxy data cubes released in Summer 2016 as part of SDSS-IV Data Release 13 (DR13), we demonstrate that the MaNGA data have nearly Poisson-limited sky subtraction shortward of ~ 8500 Angstroms and reach a typical 10-sigma limiting continuum surface brightness mu = 23.5 AB/arcsec^2 in a five arcsec diameter aperture in the g band. The wavelength calibration of the MaNGA data is accurate to 5 km/s rms, with a median spatial resolution of 2.54 arcsec FWHM (1.8 kpc at the median redshift of 0.037) and a median spectral resolution of sigma = 72 km/s.

The Extended Baryon Oscillation Spectroscopic Survey (eBOSS) will conduct novel cosmological observations using the BOSS spectrograph at Apache Point Observatory. Observations will be simultaneous with the Time Domain Spectroscopic Survey (TDSS) designed for variability studies and the Spectroscopic Identification of eROSITA Sources (SPIDERS) program designed for studies of X-ray sources. eBOSS will use four different tracers to measure the distance-redshift relation with baryon acoustic oscillations (BAO). Using more than 250,000 new, spectroscopically confirmed luminous red galaxies at a median redshift z=0.72, we project that eBOSS will yield measurements of $d_A(z)$ to an accuracy of 1.2% and measurements of H(z) to 2.1% when combined with the z>0.6 sample of BOSS galaxies. With ~195,000 new emission line galaxy redshifts, we expect BAO measurements of $d_A(z)$ to an accuracy of 3.1% and H(z) to 4.7% at an effective redshift of z= 0.87. A sample of more than 500,000 spectroscopically-confirmed quasars will provide the first BAO distance measurements over the redshift range 0.9<z<2.2, with expected precision of 2.8% and 4.2% on $d_A(z)$ and H(z), respectively. Finally, with 60,000 new quasars and re-observation of 60,000 quasars known from BOSS, we will obtain new Lyman-alpha forest measurements at redshifts z>2.1; these new data will enhance the precision of $d_A(z)$ and H(z) by a factor of 1.44 relative to BOSS. Furthermore, eBOSS will provide improved tests of General Relativity on cosmological scales through redshift-space distortion measurements, improved tests for non-Gaussianity in the primordial density field, and new constraints on the summed mass of all neutrino species. Here, we provide an overview of the cosmological goals, spectroscopic target sample, demonstration of spectral quality from early data, and projected cosmological constraints from eBOSS.

The Large Synoptic Survey Telescope (LSST) is a large-aperture, wide-field, ground-based survey system that will image the sky in six optical bands from 320 to 1050 nm, uniformly covering approximately $18,000$deg$^2$ of the sky over 800 times. The LSST is currently under construction on Cerro Pach\'on in Chile, and expected to enter operations in 2022. Once operational, the LSST will explore a wide range of astrophysical questions, from discovering "killer" asteroids to examining the nature of Dark Energy. The LSST will generate on average 15 TB of data per night, and will require a comprehensive Data Management system to reduce the raw data to scientifically useful catalogs and images with minimum human intervention. These reductions will result in a real-time alert stream, and eleven data releases over the 10-year duration of LSST operations. To enable this processing, the LSST project is developing a new, general-purpose, high-performance, scalable, well documented, open source data processing software stack for O/IR surveys. Prototypes of this stack are already capable of processing data from existing cameras (e.g., SDSS, DECam, MegaCam), and form the basis of the Hyper-Suprime Cam (HSC) Survey data reduction pipeline.

The Baryon Oscillation Spectroscopic Survey (BOSS), part of the Sloan Digital Sky Survey (SDSS) III project, has provided the largest survey of galaxy redshifts available to date, in terms of both the number of galaxy redshifts measured by a single survey, and the effective cosmological volume covered. Key to analysing the clustering of these data to provide cosmological measurements is understanding the detailed properties of this sample. Potential issues include variations in the target catalogue caused by changes either in the targeting algorithm or properties of the data used, the pattern of spectroscopic observations, the spatial distribution of targets for which redshifts were not obtained, and variations in the target sky density due to observational systematics. We document here the target selection algorithms used to create the galaxy samples that comprise BOSS. We also present the algorithms used to create large scale structure catalogues for the final Data Release (DR12) samples and the associated random catalogues that quantify the survey mask. The algorithms are an evolution of those used by the BOSS team to construct catalogues from earlier data, and have been designed to accurately quantify the galaxy sample. The code used, designated MKSAMPLE, is released with this paper.

The third generation of the Sloan Digital Sky Survey (SDSS-III) took data from 2008 to 2014 using the original SDSS wide-field imager, the original and an upgraded multi-object fiber-fed optical spectrograph, a new near-infrared high-resolution spectrograph, and a novel optical interferometer. All the data from SDSS-III are now made public. In particular, this paper describes Data Release 11 (DR11) including all data acquired through 2013 July, and Data Release 12 (DR12) adding data acquired through 2014 July (including all data included in previous data releases), marking the end of SDSS-III observing. Relative to our previous public release (DR10), DR12 adds one million new spectra of galaxies and quasars from the Baryon Oscillation Spectroscopic Survey (BOSS) over an additional 3000 sq. deg of sky, more than triples the number of H-band spectra of stars as part of the Apache Point Observatory (APO) Galactic Evolution Experiment (APOGEE), and includes repeated accurate radial velocity measurements of 5500 stars from the Multi-Object APO Radial Velocity Exoplanet Large-area Survey (MARVELS). The APOGEE outputs now include measured abundances of 15 different elements for each star. In total, SDSS-III added 2350 sq. deg of ugriz imaging; 155,520 spectra of 138,099 stars as part of the Sloan Exploration of Galactic Understanding and Evolution 2 (SEGUE-2) survey; 2,497,484 BOSS spectra of 1,372,737 galaxies, 294,512 quasars, and 247,216 stars over 9376 sq. deg; 618,080 APOGEE spectra of 156,593 stars; and 197,040 MARVELS spectra of 5,513 stars. Since its first light in 1998, SDSS has imaged over 1/3 of the Celestial sphere in five bands and obtained over five million astronomical spectra.

MaNGA (Mapping Nearby Galaxies at Apache Point Observatory) is a SDSS-IV survey that will obtain spatially resolved spectroscopy from 3600 \AA\ to 10300 \AA\ for a representative sample of over 10000 nearby galaxies. In this paper we present the analysis of nebular emission line properties in 14 galaxies obtained with P-MaNGA, a prototype of the MaNGA instrument. Using spatially resolved diagnostic diagrams we find extended star formation in galaxies that are centrally dominated by Seyfert/LINER-like emission, which illustrates that galaxy characterisations based on single fibre spectra are necessarily incomplete. We observe extended LINER-like emission (up to $\rm 1 R_{e}$) in three galaxies. We make use of the $\rm EW(H \alpha)$ to argue that the observed emission is consistent with ionisation from hot evolved stars. We derive stellar population indices and demonstrate a clear correlation between $\rm D_n(4000)$ and $\rm EW(H \delta_A)$ and the position in the ionisation diagnostic diagram: resolved galactic regions which are ionised by a Seyfert/LINER-like radiation field are also devoid of recent star formation and host older and/or more metal rich stellar populations. We also detect extraplanar LINER-like emission in two highly inclined galaxies, and identify it with diffuse ionised gas. We investigate spatially resolved metallicities and find a positive correlation between metallicity and star formation rate (SFR) surface density. We study the relation between N/O vs O/H on resolved scales. We find that, at given N/O, regions within individual galaxies are spread towards lower metallicities, deviating from the sequence defined by galactic central regions as traced by Sloan $3''$ fibre spectra. We suggest that the observed dispersion can be a tracer for gas flows in galaxies: infalls of pristine gas and/or the effect of a galactic fountain.

We present an overview of a new integral field spectroscopic survey called MaNGA (Mapping Nearby Galaxies at Apache Point Observatory), one of three core programs in the fourth-generation Sloan Digital Sky Survey (SDSS-IV) that began on 2014 July 1. MaNGA will investigate the internal kinematic structure and composition of gas and stars in an unprecedented sample of 10,000 nearby galaxies. We summarize essential characteristics of the instrument and survey design in the context of MaNGA's key science goals and present prototype observations to demonstrate MaNGA's scientific potential. MaNGA employs dithered observations with 17 fiber-bundle integral field units that vary in diameter from 12" (19 fibers) to 32" (127 fibers). Two dual-channel spectrographs provide simultaneous wavelength coverage over 3600-10300 A at R~2000. With a typical integration time of 3 hr, MaNGA reaches a target r-band signal-to-noise ratio of 4-8 (per A, per 2" fiber) at 23 AB mag per sq. arcsec, which is typical for the outskirts of MaNGA galaxies. Targets are selected with stellar mass greater than 1e9 Msun using SDSS-I redshifts and i-band luminosity to achieve uniform radial coverage in terms of the effective radius, an approximately flat distribution in stellar mass, and a sample spanning a wide range of environments. Analysis of our prototype observations demonstrates MaNGA's ability to probe gas ionization, shed light on recent star formation and quenching, enable dynamical modeling, decompose constituent components, and map the composition of stellar populations. MaNGA's spatially resolved spectra will enable an unprecedented study of the astrophysics of nearby galaxies in the coming 6 yr.

We present a one per cent measurement of the cosmic distance scale from the detections of the baryon acoustic oscillations in the clustering of galaxies from the Baryon Oscillation Spectroscopic Survey (BOSS), which is part of the Sloan Digital Sky Survey III (SDSS-III). Our results come from the Data Release 11 (DR11) sample, containing nearly one million galaxies and covering approximately $8\,500$ square degrees and the redshift range $0.2<z<0.7$. We also compare these results with those from the publicly released DR9 and DR10 samples. Assuming a concordance $\Lambda$CDM cosmological model, the DR11 sample covers a volume of 13\,Gpc${}^3$ and is the largest region of the Universe ever surveyed at this density. We measure the correlation function and power spectrum, including density-field reconstruction of the baryon acoustic oscillation (BAO) feature. The acoustic features are detected at a significance of over $7\,\sigma$ in both the correlation function and power spectrum. Fitting for the position of the acoustic features measures the distance relative to the sound horizon at the drag epoch, $r_d$, which has a value of $r_{d,{\rm fid}}=149.28\,$Mpc in our fiducial cosmology. We find $D_V=(1264\pm25\,{\rm Mpc})(r_d/r_{d,{\rm fid}})$ at $z=0.32$ and $D_V=(2056\pm20\,{\rm Mpc})(r_d/r_{d,{\rm fid}})$ at $z=0.57$. At 1.0 per cent, this latter measure is the most precise distance constraint ever obtained from a galaxy survey. Separating the clustering along and transverse to the line-of-sight yields measurements at $z=0.57$ of $D_A=(1421\pm20\,{\rm Mpc})(r_d/r_{d,{\rm fid}})$ and $H=(96.8\pm3.4\,{\rm km/s/Mpc})(r_{d,{\rm fid}}/r_d)$. Our measurements of the distance scale are in good agreement with previous BAO measurements and with the predictions from cosmic microwave background data for a spatially flat cold dark matter model with a cosmological constant.

The Sloan Digital Sky Survey (SDSS) has been in operation since 2000 April. This paper presents the tenth public data release (DR10) from its current incarnation, SDSS-III. This data release includes the first spectroscopic data from the Apache Point Observatory Galaxy Evolution Experiment (APOGEE), along with spectroscopic data from the Baryon Oscillation Spectroscopic Survey (BOSS) taken through 2012 July. The APOGEE instrument is a near-infrared R~22,500 300-fiber spectrograph covering 1.514--1.696 microns. The APOGEE survey is studying the chemical abundances and radial velocities of roughly 100,000 red giant star candidates in the bulge, bar, disk, and halo of the Milky Way. DR10 includes 178,397 spectra of 57,454 stars, each typically observed three or more times, from APOGEE. Derived quantities from these spectra (radial velocities, effective temperatures, surface gravities, and metallicities) are also included.DR10 also roughly doubles the number of BOSS spectra over those included in the ninth data release. DR10 includes a total of 1,507,954 BOSS spectra, comprising 927,844 galaxy spectra; 182,009 quasar spectra; and 159,327 stellar spectra, selected over 6373.2 square degrees.

We present the distance measurement to z = 0.32 using the 11th data release of the Sloan Digital Sky Survey-III Baryon Acoustic Oscillation Survey (BOSS). We use 313,780 galaxies of the low-redshift (LOWZ) sample over 7,341 square-degrees to compute $D_V = (1264 \pm 25)(r_d/r_{d,fid})$ - a sub 2% measurement - using the baryon acoustic feature measured in the galaxy two-point correlation function and power-spectrum. We compare our results to those obtained in DR10. We study observational systematics in the LOWZ sample and quantify potential effects due to photometric offsets between the northern and southern Galactic caps. We find the sample to be robust to all systematic effects found to impact on the targeting of higher-redshift BOSS galaxies, and that the observed north-south tensions can be explained by either limitations in photometric calibration or by sample variance, and have no impact on our final result. Our measurement, combined with the baryonic acoustic scale at z = 0.57, is used in Anderson et al. (2013a) to constrain cosmological parameters.

We measure the luminosity and color dependence and the redshift evolution of galaxy clustering in the Sloan Digital Sky Survey-III Baryon Oscillation Spectroscopic Survey Ninth Data Release. We focus on the projected two-point correlation function (2PCF) of subsets of its CMASS sample, which includes about 260,000 galaxies over ~3,300 sq. deg in the redshift range 0.43<z<0.7. To minimize the selection effect on galaxy clustering, we construct well-defined luminosity and color subsamples by carefully accounting for the CMASS galaxy selection cuts. The 2PCF of the whole CMASS sample, if approximated by a power-law, has a correlation length of r_0=7.93\pm0.06Mpc/h and an index of \gamma=1.85\pm0.01. Clear dependences on galaxy luminosity and color are found for the projected 2PCF in all redshift bins, with more luminous and redder galaxies generally exhibiting stronger clustering and steeper 2PCF. The color dependence is also clearly seen for galaxies within the red sequence, consistent with the behavior of SDSS-II main sample galaxies at lower redshifts. At a given luminosity (k+e corrected), no significant evolution of the projected 2PCFs with redshift is detected for red sequence galaxies. We also construct galaxy samples of fixed number density at different redshifts, using redshift-dependent magnitude thresholds. The clustering of these galaxies in the CMASS redshift range is found to be consistent with that predicted by passive evolution. Our measurements of the luminosity and color dependence and redshift evolution of galaxy clustering will allow for detailed modeling of the relation between galaxies and dark matter halos and new constraints on galaxy formation and evolution.

We perform a spectroscopic analysis of 492,450 galaxy spectra from the first two years of observations of the Sloan Digital Sky Survey-III/Baryonic Oscillation Spectroscopic Survey (BOSS) collaboration. This data set has been released in the ninth SDSS data release, the first public data release of BOSS spectra. We show that the typical signal-to-noise ratio of BOSS spectra is sufficient to measure stellar velocity dispersion and emission line fluxes for individual objects. The typical velocity dispersion of a BOSS galaxy is 240 km/s, with an accuracy of better than 30 per cent for 93 per cent of BOSS galaxies. The distribution in velocity dispersion is redshift independent between redshifts 0.15 and 0.7, which reflects the survey design targeting massive galaxies with an approximately uniform mass distribution in this redshift interval. The majority of BOSS galaxies lack detectable emission lines. We analyse the emission line properties and present diagnostic diagrams using the emission lines [OII], Hbeta, [OIII], Halpha, and [NII] (detected in about 4 per cent of the galaxies). We show that the emission line properties are strongly redshift dependent and that there is a clear correlation between observed frame colours and emission line properties. Within in the low-z sample around 0.15<z<0.3, half of the emission-line galaxies have LINER-like emission line ratios, followed by Seyfert-AGN dominated spectra, and only a small fraction of a few per cent are purely star forming galaxies. AGN and LINER-like objects, instead, are less prevalent in the high-z sample around 0.4<z<0.7, where more than half of the emission line objects are star forming. This is a pure selection effect caused by the non-detection of weak Hbeta emission lines in the BOSS spectra. Finally, we show that star forming, AGN and emission line free galaxies are well separated in the g-r vs r-i target selection diagram.

We present the measurement of the two-point cross-correlation function (CCF) of 8,198 Sloan Digital Sky Survey (SDSS) Data Release 7 (DR7) quasars and 349,608 DR10 CMASS galaxies from the Baryonic Oscillation Spectroscopic Survey (BOSS) at redshift <z>~0.5 (0.3<z<0.9). The cross-correlation function can be reasonably well fit by a power-law model xi_QG(r)=(r/r_0)^(-gamma) on projected scales of r_p=2-25 Mpc/h with r_0=6.61+-0.25 Mpc/h and gamma=1.69+-0.07. We estimate a quasar linear bias of b_Q=1.38+-0.10 at <z>=0.53 from the CCF measurements. This linear bias corresponds to a characteristic host halo mass of ~4x10^12 M_sun/h, compared to ~10^13 M_sun/h characteristic host halo mass for CMASS galaxies. We divide the quasar sample in luminosity and constrain the luminosity dependence of quasar bias to be db_Q/dlogL=0.20+-0.34 or 0.11+-0.32 (depending on different luminosity divisions) for quasar luminosities -23.5>M_i(z=2)>-25.5, implying a weak luminosity dependence of quasar clustering for the bright end of the quasar population at <z>~0.5. We compare our measurements with theoretical predictions, Halo Occupation Distribution (HOD) models and mock catalogs. These comparisons suggest quasars reside in a broad range of host halos, and the host halo mass distributions significantly overlap with each other for quasars at different luminosities, implying a poor correlation between halo mass and instantaneous quasar luminosity. We also find that the quasar HOD parameterization is largely degenerate such that different HODs can reproduce the CCF equally well, but with different outcomes such as the satellite fraction and host halo mass distribution. These results highlight the limitations and ambiguities in modeling the distribution of quasars with the standard HOD approach and the need for additional information in populating quasars in dark matter halos with HOD. [Abridged]

We report on the small scale (0.5<r<40h^-1 Mpc) clustering of 78895 massive (M*~10^11.3M_sun) galaxies at 0.2<z<0.4 from the first two years of data from the Baryon Oscillation Spectroscopic Survey (BOSS), to be released as part of SDSS Data Release 9 (DR9). We describe the sample selection, basic properties of the galaxies, and caveats for working with the data. We calculate the real- and redshift-space two-point correlation functions of these galaxies, fit these measurements using Halo Occupation Distribution (HOD) modeling within dark matter cosmological simulations, and estimate the errors using mock catalogs. These galaxies lie in massive halos, with a mean halo mass of 5.2x10^13 h^-1 M_sun, a large scale bias of ~2.0, and a satellite fraction of 12+/-2%. Thus, these galaxies occupy halos with average masses in between those of the higher redshift BOSS CMASS sample and the original SDSS I/II LRG sample.

The Baryon Oscillation Spectroscopic Survey (BOSS) is designed to measure the scale of baryon acoustic oscillations (BAO) in the clustering of matter over a larger volume than the combined efforts of all previous spectroscopic surveys of large scale structure. BOSS uses 1.5 million luminous galaxies as faint as i=19.9 over 10,000 square degrees to measure BAO to redshifts z<0.7. Observations of neutral hydrogen in the Lyman alpha forest in more than 150,000 quasar spectra (g<22) will constrain BAO over the redshift range 2.15<z<3.5. Early results from BOSS include the first detection of the large-scale three-dimensional clustering of the Lyman alpha forest and a strong detection from the Data Release 9 data set of the BAO in the clustering of massive galaxies at an effective redshift z = 0.57. We project that BOSS will yield measurements of the angular diameter distance D_A to an accuracy of 1.0% at redshifts z=0.3 and z=0.57 and measurements of H(z) to 1.8% and 1.7% at the same redshifts. Forecasts for Lyman alpha forest constraints predict a measurement of an overall dilation factor that scales the highly degenerate D_A(z) and H^{-1}(z) parameters to an accuracy of 1.9% at z~2.5 when the survey is complete. Here, we provide an overview of the selection of spectroscopic targets, planning of observations, and analysis of data and data quality of BOSS.

The Sloan Digital Sky Survey III (SDSS-III) presents the first spectroscopic data from the Baryon Oscillation Spectroscopic Survey (BOSS). This ninth data release (DR9) of the SDSS project includes 535,995 new galaxy spectra (median z=0.52), 102,100 new quasar spectra (median z=2.32), and 90,897 new stellar spectra, along with the data presented in previous data releases. These spectra were obtained with the new BOSS spectrograph and were taken between 2009 December and 2011 July. In addition, the stellar parameters pipeline, which determines radial velocities, surface temperatures, surface gravities, and metallicities of stars, has been updated and refined with improvements in temperature estimates for stars with T_eff<5000 K and in metallicity estimates for stars with [Fe/H]>-0.5. DR9 includes new stellar parameters for all stars presented in DR8, including stars from SDSS-I and II, as well as those observed as part of the SDSS-III Sloan Extension for Galactic Understanding and Exploration-2 (SEGUE-2). The astrometry error introduced in the DR8 imaging catalogs has been corrected in the DR9 data products. The next data release for SDSS-III will be in Summer 2013, which will present the first data from the Apache Point Observatory Galactic Evolution Experiment (APOGEE) along with another year of data from BOSS, followed by the final SDSS-III data release in December 2014.

We analyze the density field of galaxies observed by the Sloan Digital Sky Survey (SDSS)-III Baryon Oscillation Spectroscopic Survey (BOSS) included in the SDSS Data Release Nine (DR9). DR9 includes spectroscopic redshifts for over 400,000 galaxies spread over a footprint of 3,275 deg^2. We identify, characterize, and mitigate the impact of sources of systematic uncertainty on large-scale clustering measurements, both for angular moments of the redshift-space correlation function and the spherically averaged power spectrum, P(k), in order to ensure that robust cosmological constraints will be obtained from these data. A correlation between the projected density of stars and the higher redshift (0.43 < z < 0.7) galaxy sample (the `CMASS' sample) due to imaging systematics imparts a systematic error that is larger than the statistical error of the clustering measurements at scales s > 120h^-1Mpc or k < 0.01hMpc^-1. We find that these errors can be ameliorated by weighting galaxies based on their surface brightness and the local stellar density. We use mock galaxy catalogs that simulate the CMASS selection function to determine that randomly selecting galaxy redshifts in order to simulate the radial selection function of a random sample imparts the least systematic error on correlation function measurements and that this systematic error is negligible for the spherically averaged correlation function. The methods we recommend for the calculation of clustering measurements using the CMASS sample are adopted in companion papers that locate the position of the baryon acoustic oscillation feature (Anderson et al. 2012), constrain cosmological models using the full shape of the correlation function (Sanchez et al. 2012), and measure the rate of structure growth (Reid et al. 2012). (abridged)

We present measurements of galaxy clustering from the Baryon Oscillation Spectroscopic Survey (BOSS), which is part of the Sloan Digital Sky Survey III (SDSS-III). These use the Data Release 9 (DR9) CMASS sample, which contains 264,283 massive galaxies covering 3275 square degrees with an effective redshift z=0.57 and redshift range 0.43 < z < 0.7. Assuming a concordance Lambda-CDM cosmological model, this sample covers an effective volume of 2.2 Gpc^3, and represents the largest sample of the Universe ever surveyed at this density, n = 3 x 10^-4 h^-3 Mpc^3. We measure the angle-averaged galaxy correlation function and power spectrum, including density-field reconstruction of the baryon acoustic oscillation (BAO) feature. The acoustic features are detected at a significance of 5\sigma in both the correlation function and power spectrum. Combining with the SDSS-II Luminous Red Galaxy Sample, the detection significance increases to 6.7\sigma. Fitting for the position of the acoustic features measures the distance to z=0.57 relative to the sound horizon DV /rs = 13.67 +/- 0.22 at z=0.57. Assuming a fiducial sound horizon of 153.19 Mpc, which matches cosmic microwave background constraints, this corresponds to a distance DV(z=0.57) = 2094 +/- 34 Mpc. At 1.7 per cent, this is the most precise distance constraint ever obtained from a galaxy survey. We place this result alongside previous BAO measurements in a cosmological distance ladder and find excellent agreement with the current supernova measurements. We use these distance measurements to constrain various cosmological models, finding continuing support for a flat Universe with a cosmological constant.

Building on the legacy of the Sloan Digital Sky Survey (SDSS-I and II), SDSS-III is a program of four spectroscopic surveys on three scientific themes: dark energy and cosmological parameters, the history and structure of the Milky Way, and the population of giant planets around other stars. In keeping with SDSS tradition, SDSS-III will provide regular public releases of all its data, beginning with SDSS DR8 (which occurred in Jan 2011). This paper presents an overview of the four SDSS-III surveys. BOSS will measure redshifts of 1.5 million massive galaxies and Lya forest spectra of 150,000 quasars, using the BAO feature of large scale structure to obtain percent-level determinations of the distance scale and Hubble expansion rate at z<0.7 and at z~2.5. SEGUE-2, which is now completed, measured medium-resolution (R=1800) optical spectra of 118,000 stars in a variety of target categories, probing chemical evolution, stellar kinematics and substructure, and the mass profile of the dark matter halo from the solar neighborhood to distances of 100 kpc. APOGEE will obtain high-resolution (R~30,000), high signal-to-noise (S/N>100 per resolution element), H-band (1.51-1.70 micron) spectra of 10^5 evolved, late-type stars, measuring separate abundances for ~15 elements per star and creating the first high-precision spectroscopic survey of all Galactic stellar populations (bulge, bar, disks, halo) with a uniform set of stellar tracers and spectral diagnostics. MARVELS will monitor radial velocities of more than 8000 FGK stars with the sensitivity and cadence (10-40 m/s, ~24 visits per star) needed to detect giant planets with periods up to two years, providing an unprecedented data set for understanding the formation and dynamical evolution of giant planet systems. (Abridged)

We calculate the real- and redshift-space clustering of massive galaxies at z~0.5 using the first semester of data by the Baryon Oscillation Spectroscopic Survey (BOSS). We study the correlation functions of a sample of 44,000 massive galaxies in the redshift range 0.4<z<0.7. We present a halo-occupation distribution modeling of the clustering results and discuss the implications for the manner in which massive galaxies at z~0.5 occupy dark matter halos. The majority of our galaxies are central galaxies living in halos of mass 10^{13}Msun/h, but 10% are satellites living in halos 10 times more massive. These results are broadly in agreement with earlier investigations of massive galaxies at z~0.5. The inferred large-scale bias (b~2) and relatively high number density (nbar=3e-4 h^3 Mpc^{-3}) imply that BOSS galaxies are excellent tracers of large-scale structure, suggesting BOSS will enable a wide range of investigations on the distance scale, the growth of large-scale structure, massive galaxy evolution and other topics.

We investigate a class of rapidly growing emission line galaxies, known as "Green Peas", first noted by volunteers in the Galaxy Zoo project because of their peculiar bright green colour and small size, unresolved in SDSS imaging. Their appearance is due to very strong optical emission lines, namely [O III] 5007 A, with an unusually large equivalent width of up to ~1000 A. We discuss a well-defined sample of 251 colour-selected objects, most of which are strongly star forming, although there are some AGN interlopers including 8 newly discovered narrow Line Seyfert 1 galaxies. The star-forming Peas are low mass galaxies (M~10^8.5 - 10^10 M_sun) with high star formation rates (~10 M_sun/yr), low metallicities (log[O/H] + 12 ~ 8.7) and low reddening (E(B-V) < 0.25) and they reside in low density environments. They have some of the highest specific star formation rates (up to ~10^{-8} yr^{-1}) seen in the local Universe, yielding doubling times for their stellar mass of hundreds of Myrs. The few star-forming Peas with HST imaging appear to have several clumps of bright star-forming regions and low surface density features that may indicate recent or ongoing mergers. The Peas are similar in size, mass, luminosity and metallicity to Luminous Blue Compact Galaxies. They are also similar to high redshift UV-luminous galaxies, e.g., Lyman-break galaxies and Lyman-alpha emitters, and therefore provide a local laboratory with which to study the extreme star formation processes that occur in high-redshift galaxies. Studying starbursting galaxies as a function of redshift is essential to understanding the build up of stellar mass in the Universe.

While both society and astronomy have evolved greatly over the past fifty years, the academic institutions and incentives that shape our field have remained largely stagnant. As a result, the astronomical community is faced with several major challenges, including: (1) the training that we provide does not align with the skills that future astronomers will need, (2) the postdoctoral phase is becoming increasingly demanding and demoralizing, and (3) our jobs are increasingly unfriendly to families with children. Solving these problems will require conscious engineering of our profession. Fortunately, this Decadal Review offers the opportunity to revise outmoded practices to be more effective and equitable. The highest priority of the Subcommittee on the State of the Profession should be to recommend specific, funded activities that will ensure the field meets the challenges we describe.

We explore the multidimensional, multiwavelength selection of quasars from mid-IR (MIR) plus optical data, specifically from Spitzer-IRAC and the Sloan Digital Sky Survey (SDSS). We apply modern statistical techniques to combined Spitzer MIR and SDSS optical data, allowing up to 8-D color selection of quasars. Using a Bayesian selection method, we catalog 5546 quasar candidates to an 8.0 um depth of 56 uJy over an area of ~24 sq. deg; ~70% of these candidates are not identified by applying the same Bayesian algorithm to 4-color SDSS optical data alone. Our selection recovers 97.7% of known type 1 quasars in this area and greatly improves the effectiveness of identifying 3.5<z<5 quasars. Even using only the two shortest wavelength IRAC bandpasses, it is possible to use our Bayesian techniques to select quasars with 97% completeness and as little as 10% contamination. This sample has a photometric redshift accuracy of 93.6% (Delta Z +/-0.3), remaining roughly constant when the two reddest MIR bands are excluded. While our methods are designed to find type 1 (unobscured) quasars, as many as 1200 of the objects are type 2 (obscured) quasar candidates. Coupling deep optical imaging data with deep mid-IR data could enable selection of quasars in significant numbers past the peak of the quasar luminosity function (QLF) to at least z~4. Such a sample would constrain the shape of the QLF and enable quasar clustering studies over the largest range of redshift and luminosity to date, yielding significant gains in our understanding of quasars and the evolution of galaxies.

The current view of galaxy formation holds that all massive galaxies harbor a massive black hole at their center, but that these black holes are not always in an actively accreting phase. X-ray emission is often used to identify accreting sources, but for galaxies that are not harboring quasars (low-luminosity active galaxies), the X-ray flux may be weak, or obscured by dust. To aid in the understanding of weakly accreting black holes in the local universe, a large sample of galaxies with X-ray detections is needed. We cross-match the ROSAT All Sky Survey (RASS) with galaxies from the Sloan Digital Sky Survey Data Release 4 (SDSS DR4) to create such a sample. Because of the high SDSS source density and large RASS positional errors, the cross-matched catalog is highly contaminated by random associations. We investigate the overlap of these surveys and provide a statistical test of the validity of RASS-SDSS galaxy cross-matches. SDSS quasars provide a test of our cross-match validation scheme, as they have a very high fraction of true RASS matches. We find that the number of true matches between the SDSS main galaxy sample and the RASS is highly dependent on the optical spectral classification of the galaxy; essentially no star-forming galaxies are detected, while more than 0.6% of narrow-line Seyferts are detected in the RASS. Also, galaxies with ambiguous optical classification have a surprisingly high RASS detection fraction. This allows us to further constrain the SEDs of low-luminosity active galaxies. Our technique is quite general, and can be applied to any cross-matching between surveys with well-understood positional errors.