This paper documents the sixteenth data release (DR16) from the Sloan Digital Sky Surveys; the fourth and penultimate from the fourth phase (SDSS-IV). This is the first release of data from the southern hemisphere survey of the Apache Point Observatory Galactic Evolution Experiment 2 (APOGEE-2); new data from APOGEE-2 North are also included. DR16 is also notable as the final data release for the main cosmological program of the Extended Baryon Oscillation Spectroscopic Survey (eBOSS), and all raw and reduced spectra from that project are released here. DR16 also includes all the data from the Time Domain Spectroscopic Survey (TDSS) and new data from the SPectroscopic IDentification of ERosita Survey (SPIDERS) programs, both of which were co-observed on eBOSS plates. DR16 has no new data from the Mapping Nearby Galaxies at Apache Point Observatory (MaNGA) survey (or the MaNGA Stellar Library "MaStar"). We also preview future SDSS-V operations (due to start in 2020), and summarize plans for the final SDSS-IV data release (DR17).

We present SciServer, a science platform built and supported by the Institute for Data Intensive Engineering and Science at the Johns Hopkins University. SciServer builds upon and extends the SkyServer system of server-side tools that introduced the astronomical community to SQL (Structured Query Language) and has been serving the Sloan Digital Sky Survey catalog data to the public. SciServer uses a Docker/VM based architecture to provide interactive and batch mode server-side analysis with scripting languages like Python and R in various environments including Jupyter (notebooks), RStudio and command-line in addition to traditional SQL-based data analysis. Users have access to private file storage as well as personal SQL database space. A flexible resource access control system allows users to share their resources with collaborators, a feature that has also been very useful in classroom environments. All these services, wrapped in a layer of REST APIs, constitute a scalable collaborative data-driven science platform that is attractive to science disciplines beyond astronomy.

We write in response to the call from the 2020 Decadal Survey to submit white papers illustrating the most pressing scientific questions in astrophysics for the coming decade. We propose exploration as the central question for the Decadal Committee's discussions.The history of astronomy shows that paradigm changing discoveries are not driven by well formulated scientific questions, based on the knowledge of the time. They were instead the result of the increase in discovery space fostered by new telescopes and instruments. An additional tool for increasing the discovery space is provided by the analysis and mining of the increasingly larger amount of archival data available to astronomers. Revolutionary observing facilities, and the state of the art astronomy archives needed to support these facilities, will open up the universe to new discovery. Here we focus on exploration for compact objects and multi messenger science. This white paper includes science examples of the power of the discovery approach, encompassing all the areas of astrophysics covered by the 2020 Decadal Survey.

This paper describes the organization of the database and the catalog data products from the Pan-STARRS1 $3\pi$ Steradian Survey. The catalog data products are available in the form of an SQL-based relational database from MAST, the Mikulski Archive for Space Telescopes at STScI. The database is described in detail, including the construction of the database, the provenance of the data, the schema, and how the database tables are related. Examples of queries for a range of science goals are included. The catalog data products are available in the form of an SQL-based relational database from MAST, the Mikulski Archive for Space Telescopes at STScI.

Pan-STARRS1 has carried out a set of distinct synoptic imaging sky surveys including the $3\pi$ Steradian Survey and the Medium Deep Survey in 5 bands ($grizy_{P1}$). The mean 5$\sigma$ point source limiting sensitivities in the stacked 3$\pi$ Steradian Survey in $grizy_{P1}$ are (23.3, 23.2, 23.1, 22.3, 21.4) respectively. The upper bound on the systematic uncertainty in the photometric calibration across the sky is 7-12 millimag depending on the bandpass. The systematic uncertainty of the astrometric calibration using the Gaia frame comes from a comparison of the results with Gaia: the standard deviation of the mean and median residuals ($ \Delta ra, \Delta dec $) are (2.3, 1.7) milliarcsec, and (3.1, 4.8) milliarcsec respectively. The Pan-STARRS system and the design of the PS1 surveys are described and an overview of the resulting image and catalog data products and their basic characteristics are described together with a summary of important results. The images, reduced data products, and derived data products from the Pan-STARRS1 surveys are available to the community from the Mikulski Archive for Space Telescopes (MAST) at STScI.

Twenty years have passed since first light for the Sloan Digital Sky Survey (SDSS). Here, we release data taken by the fourth phase of SDSS (SDSS-IV) across its first three years of operation (July 2014-July 2017). This is the third data release for SDSS-IV, and the fifteenth from SDSS (Data Release Fifteen; DR15). New data come from MaNGA - we release 4824 datacubes, as well as the first stellar spectra in the MaNGA Stellar Library (MaStar), the first set of survey-supported analysis products (e.g. stellar and gas kinematics, emission line, and other maps) from the MaNGA Data Analysis Pipeline (DAP), and a new data visualisation and access tool we call "Marvin". The next data release, DR16, will include new data from both APOGEE-2 and eBOSS; those surveys release no new data here, but we document updates and corrections to their data processing pipelines. The release is cumulative; it also includes the most recent reductions and calibrations of all data taken by SDSS since first light. In this paper we describe the location and format of the data and tools and cite technical references describing how it was obtained and processed. The SDSS website (www.sdss.org) has also been updated, providing links to data downloads, tutorials and examples of data use. While SDSS-IV will continue to collect astronomical data until 2020, and will be followed by SDSS-V (2020-2025), we end this paper by describing plans to ensure the sustainability of the SDSS data archive for many years beyond the collection of data.

SDSS-V will be an all-sky, multi-epoch spectroscopic survey of over six million objects. It is designed to decode the history of the Milky Way, trace the emergence of the chemical elements, reveal the inner workings of stars, and investigate the origin of planets. It will also create an integral-field spectroscopic map of the gas in the Galaxy and the Local Group that is 1,000x larger than the current state of the art and at high enough spatial resolution to reveal the self-regulation mechanisms of galactic ecosystems. SDSS-V will pioneer systematic, spectroscopic monitoring across the whole sky, revealing changes on timescales from 20 minutes to 20 years. The survey will thus track the flickers, flares, and radical transformations of the most luminous persistent objects in the universe: massive black holes growing at the centers of galaxies. The scope and flexibility of SDSS-V will be unique among extant and future spectroscopic surveys: it is all-sky, with matched survey infrastructures in both hemispheres; it provides near-IR and optical multi-object fiber spectroscopy that is rapidly reconfigurable to serve high target densities, targets of opportunity, and time-domain monitoring; and it provides optical, ultra-wide-field integral field spectroscopy. SDSS-V, with its programs anticipated to start in 2020, will be well-timed to multiply the scientific output from major space missions (e.g., TESS, Gaia, eROSITA) and ground-based projects. SDSS-V builds on the 25-year heritage of SDSS's advances in data analysis, collaboration infrastructure, and product deliverables. The project is now refining its science scope, optimizing the survey strategies, and developing new hardware that builds on the SDSS-IV infrastructure. We present here an overview of the current state of these developments as we seek to build our worldwide consortium of institutional and individual members.

We describe the Sloan Digital Sky Survey IV (SDSS-IV), a project encompassing three major spectroscopic programs. The Apache Point Observatory Galactic Evolution Experiment 2 (APOGEE-2) is observing hundreds of thousands of Milky Way stars at high resolution and high signal-to-noise ratio in the near-infrared. The Mapping Nearby Galaxies at Apache Point Observatory (MaNGA) survey is obtaining spatially-resolved spectroscopy for thousands of nearby galaxies (median redshift of z = 0.03). The extended Baryon Oscillation Spectroscopic Survey (eBOSS) is mapping the galaxy, quasar, and neutral gas distributions between redshifts z = 0.6 and 3.5 to constrain cosmology using baryon acoustic oscillations, redshift space distortions, and the shape of the power spectrum. Within eBOSS, we are conducting two major subprograms: the SPectroscopic IDentification of eROSITA Sources (SPIDERS), investigating X-ray AGN and galaxies in X-ray clusters, and the Time Domain Spectroscopic Survey (TDSS), obtaining spectra of variable sources. All programs use the 2.5-meter Sloan Foundation Telescope at Apache Point Observatory; observations there began in Summer 2014. APOGEE-2 also operates a second near-infrared spectrograph at the 2.5-meter du Pont Telescope at Las Campanas Observatory, with observations beginning in early 2017. Observations at both facilities are scheduled to continue through 2020. In keeping with previous SDSS policy, SDSS-IV provides regularly scheduled public data releases; the first one, Data Release 13, was made available in July 2016.

The Sloan Digitial Sky Surveys (SDSS) have been collecting imaging and spectoscopic data since 1998. These data as well as their derived data products are made publicly available through regular data releases, of which the 13th took place summer 2016. Although public data releases can be challenging to manage, they signficantly increase the impact of a survey, both scientifically and educationally.

The third generation of the Sloan Digital Sky Survey (SDSS-III) took data from 2008 to 2014 using the original SDSS wide-field imager, the original and an upgraded multi-object fiber-fed optical spectrograph, a new near-infrared high-resolution spectrograph, and a novel optical interferometer. All the data from SDSS-III are now made public. In particular, this paper describes Data Release 11 (DR11) including all data acquired through 2013 July, and Data Release 12 (DR12) adding data acquired through 2014 July (including all data included in previous data releases), marking the end of SDSS-III observing. Relative to our previous public release (DR10), DR12 adds one million new spectra of galaxies and quasars from the Baryon Oscillation Spectroscopic Survey (BOSS) over an additional 3000 sq. deg of sky, more than triples the number of H-band spectra of stars as part of the Apache Point Observatory (APO) Galactic Evolution Experiment (APOGEE), and includes repeated accurate radial velocity measurements of 5500 stars from the Multi-Object APO Radial Velocity Exoplanet Large-area Survey (MARVELS). The APOGEE outputs now include measured abundances of 15 different elements for each star. In total, SDSS-III added 2350 sq. deg of ugriz imaging; 155,520 spectra of 138,099 stars as part of the Sloan Exploration of Galactic Understanding and Evolution 2 (SEGUE-2) survey; 2,497,484 BOSS spectra of 1,372,737 galaxies, 294,512 quasars, and 247,216 stars over 9376 sq. deg; 618,080 APOGEE spectra of 156,593 stars; and 197,040 MARVELS spectra of 5,513 stars. Since its first light in 1998, SDSS has imaged over 1/3 of the Celestial sphere in five bands and obtained over five million astronomical spectra.

The Sloan Digital Sky Survey (SDSS) has been in operation since 2000 April. This paper presents the tenth public data release (DR10) from its current incarnation, SDSS-III. This data release includes the first spectroscopic data from the Apache Point Observatory Galaxy Evolution Experiment (APOGEE), along with spectroscopic data from the Baryon Oscillation Spectroscopic Survey (BOSS) taken through 2012 July. The APOGEE instrument is a near-infrared R~22,500 300-fiber spectrograph covering 1.514--1.696 microns. The APOGEE survey is studying the chemical abundances and radial velocities of roughly 100,000 red giant star candidates in the bulge, bar, disk, and halo of the Milky Way. DR10 includes 178,397 spectra of 57,454 stars, each typically observed three or more times, from APOGEE. Derived quantities from these spectra (radial velocities, effective temperatures, surface gravities, and metallicities) are also included.DR10 also roughly doubles the number of BOSS spectra over those included in the ninth data release. DR10 includes a total of 1,507,954 BOSS spectra, comprising 927,844 galaxy spectra; 182,009 quasar spectra; and 159,327 stellar spectra, selected over 6373.2 square degrees.

The Sloan Digital Sky Survey III (SDSS-III) presents the first spectroscopic data from the Baryon Oscillation Spectroscopic Survey (BOSS). This ninth data release (DR9) of the SDSS project includes 535,995 new galaxy spectra (median z=0.52), 102,100 new quasar spectra (median z=2.32), and 90,897 new stellar spectra, along with the data presented in previous data releases. These spectra were obtained with the new BOSS spectrograph and were taken between 2009 December and 2011 July. In addition, the stellar parameters pipeline, which determines radial velocities, surface temperatures, surface gravities, and metallicities of stars, has been updated and refined with improvements in temperature estimates for stars with T_eff<5000 K and in metallicity estimates for stars with [Fe/H]>-0.5. DR9 includes new stellar parameters for all stars presented in DR8, including stars from SDSS-I and II, as well as those observed as part of the SDSS-III Sloan Extension for Galactic Understanding and Exploration-2 (SEGUE-2). The astrometry error introduced in the DR8 imaging catalogs has been corrected in the DR9 data products. The next data release for SDSS-III will be in Summer 2013, which will present the first data from the Apache Point Observatory Galactic Evolution Experiment (APOGEE) along with another year of data from BOSS, followed by the final SDSS-III data release in December 2014.

Operation of the US Virtual Astronomical Observatory shares some issues with modern physical observatories, e.g., intimidating data volumes and rapid technological change, and must also address unique concerns like the lack of direct control of the underlying and scattered data resources, and the distributed nature of the observatory itself. In this paper we discuss how the VAO has addressed these challenges to provide the astronomical community with a coherent set of science-enabling tools and services. The distributed nature of our virtual observatory-with data and personnel spanning geographic, institutional and regime boundaries-is simultaneously a major operational headache and the primary science motivation for the VAO. Most astronomy today uses data from many resources. Facilitation of matching heterogeneous datasets is a fundamental reason for the virtual observatory. Key aspects of our approach include continuous monitoring and validation of VAO and VO services and the datasets provided by the community, monitoring of user requests to optimize access, caching for large datasets, and providing distributed storage services that allow user to collect results near large data repositories. Some elements are now fully implemented, while others are planned for subsequent years. The distributed nature of the VAO requires careful attention to what can be a straightforward operation at a conventional observatory, e.g., the organization of the web site or the collection and combined analysis of logs. Many of these strategies use and extend protocols developed by the international virtual observatory community.

Building on the legacy of the Sloan Digital Sky Survey (SDSS-I and II), SDSS-III is a program of four spectroscopic surveys on three scientific themes: dark energy and cosmological parameters, the history and structure of the Milky Way, and the population of giant planets around other stars. In keeping with SDSS tradition, SDSS-III will provide regular public releases of all its data, beginning with SDSS DR8 (which occurred in Jan 2011). This paper presents an overview of the four SDSS-III surveys. BOSS will measure redshifts of 1.5 million massive galaxies and Lya forest spectra of 150,000 quasars, using the BAO feature of large scale structure to obtain percent-level determinations of the distance scale and Hubble expansion rate at z<0.7 and at z~2.5. SEGUE-2, which is now completed, measured medium-resolution (R=1800) optical spectra of 118,000 stars in a variety of target categories, probing chemical evolution, stellar kinematics and substructure, and the mass profile of the dark matter halo from the solar neighborhood to distances of 100 kpc. APOGEE will obtain high-resolution (R~30,000), high signal-to-noise (S/N>100 per resolution element), H-band (1.51-1.70 micron) spectra of 10^5 evolved, late-type stars, measuring separate abundances for ~15 elements per star and creating the first high-precision spectroscopic survey of all Galactic stellar populations (bulge, bar, disks, halo) with a uniform set of stellar tracers and spectral diagnostics. MARVELS will monitor radial velocities of more than 8000 FGK stars with the sensitivity and cadence (10-40 m/s, ~24 visits per star) needed to detect giant planets with periods up to two years, providing an unprecedented data set for understanding the formation and dynamical evolution of giant planet systems. (Abridged)

The Sloan Digital Sky Survey (SDSS) started a new phase in August 2008, with new instrumentation and new surveys focused on Galactic structure and chemical evolution, measurements of the baryon oscillation feature in the clustering of galaxies and the quasar Ly alpha forest, and a radial velocity search for planets around ~8000 stars. This paper describes the first data release of SDSS-III (and the eighth counting from the beginning of the SDSS). The release includes five-band imaging of roughly 5200 deg^2 in the Southern Galactic Cap, bringing the total footprint of the SDSS imaging to 14,555 deg^2, or over a third of the Celestial Sphere. All the imaging data have been reprocessed with an improved sky-subtraction algorithm and a final, self-consistent photometric recalibration and flat-field determination. This release also includes all data from the second phase of the Sloan Extension for Galactic Understanding and Evolution (SEGUE-2), consisting of spectroscopy of approximately 118,000 stars at both high and low Galactic latitudes. All the more than half a million stellar spectra obtained with the SDSS spectrograph have been reprocessed through an improved stellar parameters pipeline, which has better determination of metallicity for high metallicity stars.

We present the fifth edition of the Sloan Digital Sky Survey (SDSS) Quasar Catalog, which is based upon the SDSS Seventh Data Release. The catalog, which contains 105,783 spectroscopically confirmed quasars, represents the conclusion of the SDSS-I and SDSS-II quasar survey. The catalog consists of the SDSS objects that have luminosities larger than M_i = -22.0 (in a cosmology with H_0 = 70 km/s/Mpc Omega_M = 0.3, and Omega_Lambda = 0.7) have at least one emission line with FWHM larger than 1000 km/s or have interesting/complex absorption features, are fainter than i > 15.0 and have highly reliable redshifts. The catalog covers an area of 9380 deg^2. The quasar redshifts range from 0.065 to 5.46, with a median value of 1.49; the catalog includes 1248 quasars at redshifts greater than four, of which 56 are at redshifts greater than five. The catalog contains 9210 quasars with i < 18; slightly over half of the entries have i< 19. For each object the catalog presents positions accurate to better than 0.1" rms per coordinate, five-band (ugriz) CCD-based photometry with typical accuracy of 0.03 mag, and information on the morphology and selection method. The catalog also contains radio, near-infrared, and X-ray emission properties of the quasars, when available, from other large-area surveys. The calibrated digital spectra cover the wavelength region 3800-9200 Ang. at a spectral resolution R = 2000 the spectra can be retrieved from the SDSS public database using the information provided in the catalog. Over 96% of the objects in the catalog were discovered by the SDSS. We also include a supplemental list of an additional 207 quasars with SDSS spectra whose archive photometric information is incomplete.

We present the fourth edition of the Sloan Digital Sky Survey (SDSS) Quasar Catalog. The catalog contains 77,429 objects; this is an increase of over 30,000 entries since the previous edition. The catalog consists of the objects in the SDSS Fifth Data Release that have luminosities larger than M_i = -22.0 (in a cosmology with H_0 = 70 km/s/Mpc, Omega_M = 0.3, and Omega_Lambda = 0.7) have at least one emission line with FWHM larger than 1000 km/s, or have interesting/complex absorption features, are fainter than i=15.0, and have highly reliable redshifts. The area covered by the catalog is 5740 sq. deg. The quasar redshifts range from 0.08 to 5.41, with a median value of 1.48; the catalog includes 891 quasars at redshifts greater than four, of which 36 are at redshifts greater than five. Approximately half of the catalog quasars have i < 19; nearly all have i < 21. For each object the catalog presents positions accurate to better than 0.2 arcsec. rms per coordinate, five-band (ugriz) CCD-based photometry with typical accuracy of 0.03 mag, and information on the morphology and selection method. The catalog also contains basic radio, near-infrared, and X-ray emission properties of the quasars, when available, from other large-area surveys. The calibrated digital spectra cover the wavelength region 3800--9200A at a spectral resolution of ~2000. The spectra can be retrieved from the public database using the information provided in the catalog. The average SDSS colors of quasars as a function of redshift, derived from the catalog entries, are presented in tabular form. Approximately 96% of the objects in the catalog were discovered by the SDSS.

(Abridged) We study the two-point correlation function of a uniformly selected sample of 4,426 luminous optical quasars with redshift $2.9 \le z\le 5.4$ selected over 4041 deg$^2$ from the Fifth Data Release of the Sloan Digital Sky Survey. For a real-space correlation function of the form $\xi(r)=(r/r_0)^{-\gamma}$, the fitted parameters in comoving coordinates are $r_0 = 15.2 \pm 2.7 h^{-1}$ Mpc and $\gamma = 2.0 \pm 0.3$, over a scale range $4\le r_p\le 150 h^{-1}$ Mpc. Thus high-redshift quasars are appreciably more strongly clustered than their $z \approx 1.5$ counterparts, which have a comoving clustering length $r_0 \approx 6.5 h^{-1}$ Mpc. Dividing our sample into two redshift bins: $2.9\le z\le 3.5$ and $z\ge 3.5$, and assuming a power-law index $\gamma=2.0$, we find a correlation length of $r_0 = 16.9 \pm 1.7 h^{-1}$ Mpc for the former, and $r_0 = 24.3 \pm 2.4 h^{-1}$ Mpc for the latter. Following Martini & Weinberg, we relate the clustering strength and quasar number density to the quasar lifetimes and duty cycle. Using the Sheth & Tormen halo mass function, the quasar lifetime is estimated to lie in the range $4\sim 50$ Myr for quasars with $2.9\le z\le 3.5$; and $30\sim 600$ Myr for quasars with $z\ge 3.5$. The corresponding duty cycles are $0.004\sim 0.05$ for the lower redshift bin and $0.03\sim 0.6$ for the higher redshift bin. The minimum mass of halos in which these quasars reside is $2-3\times 10^{12}\ h^{-1}M_\odot$ for quasars with $2.9\le z\le 3.5$ and $4-6\times 10^{12}\ h^{-1}M_\odot$ for quasars with $z\ge 3.5$.

We use the Galaxy Evolution Explorer (GALEX) Medium and All-Sky-Imaging Survey (MIS & AIS) data from the first public data release (GR1), matched to the Sloan Digital Sky Survey (SDSS) DR3 catalog, to perform source classification. The GALEX surveys provide photometry in far- and near-UV bands and the SDSS in five optical bands (u,g,r,i,z). The GR1/DR3 overlapping areas are 363[83]deg^2 for the GALEX AIS[MIS], for sources within the 0.5deg central area of the GALEX fields. Our sample covers mostly |b|>30deg galactic latitudes. We present statistical properties of the GALEX/SDSS matched sources catalog, containing >2x10^6 objects detected in at least one UV band. We classify the matched sources by comparing the seven-band photometry to model colors constructed for different classes of astrophysical objects. For sources with photometric errors <0.3 mag, the corresponding typical AB-magnitude limits are m_FUV~21.5, m_NUV~22.5 for AIS, and m_FUV~24, m_NUV~24.5 for MIS. At AIS depth, the number of Galactic and extragalactic objects are comparable, but the latter predominate in the MIS. Based on our stellar models, we estimate the GALEX surveys detect hot White Dwarfs throughout the Milky Way halo (down to a radius of 0.04 R_sun at MIS depth), providing an unprecedented improvement in the Galactic WD census. Their observed surface density is consistent with Milky Way model predictions. We also select low-redshift QSO candidates, extending the known QSO samples to lower magnitudes, and providing candidates for detailed z~1 follow-up investigations. SDSS optical spectra available for a large subsample confirm the classification for the photometrically selected candidates with 97% purity for single hot stars, ~45%(AIS)/31%(MIS) for binaries containing a hot star and a cooler companion, and about 85% for QSOs.

We use the Sloan Digital Sky Survey (SDSS) spectroscopic sample to constrain the projected radial distribution of satellites around isolated ~ L* galaxies. We employ mock galaxy catalogs derived from high-resolution cosmological simulations to investigate the effects of interloper contamination and show that interlopers significantly bias the estimated slope of the projected radial distribution of satellites. We also show that the distribution of interlopers around galaxies is expected to be non-uniform in velocity space because galaxies are clustered and reside in crowded environments. Successful methods of interloper contamination correction should therefore take into account environments of the host galaxies. Two such new methods are presented and the most reliable of them is used to correct for interloper contamination in analyses of the SDSS galaxy sample. The best fit power-law slope of the interloper-corrected surface density distribution of satellites, Sigma(R) ~ R^alpha, in the volume-limited SDSS sample is alpha ~ -1.7 +/- 0.1, independent of the galaxy and satellite luminosities. Comparison with Lambda-CDM simulations shows that the radial distribution of the SDSS satellites is more concentrated than that of subhalos around galaxy-sized halos, especially at R < 100 kpc/h. The predicted dark matter radial distribution is somewhat more concentrated than the profile of the SDSS satellites, but the difference is not statistically significant for our sample.

We determine the number counts and z=0-5 luminosity function for a well-defined, homogeneous sample of quasars from the Sloan Digital Sky Survey (SDSS). We conservatively define the most uniform statistical sample possible, consisting of 15,343 quasars within an effective area of 1622 deg^2 that was derived from a parent sample of 46,420 spectroscopically confirmed broad-line quasars in the 5282 deg^2 of imaging data from SDSS Data Release Three. The sample extends from i=15 to i=19.1 at z<3 and to i=20.2 for z>3. The number counts and luminosity function agree well with the results of the 2dF QSO Survey, but the SDSS data probe to much higher redshifts than does the 2dF sample. The number density of luminous quasars peaks between redshifts 2 and 3, although uncertainties in the selection function in this range do not allow us to determine the peak redshift more precisely. Our best fit model has a flatter bright end slope at high redshift than at low redshift. For z<2.4 the data are best fit by a redshift-independent slope of beta = -3.1 (Phi(L) propto L^beta). Above z=2.4 the slope flattens with redshift to beta=-2.37 at z=5. This slope change, which is significant at a >5-sigma level, must be accounted for in models of the evolution of accretion onto supermassive black holes.

We present an 8 sigma detection of cosmic magnification measured by the variation of quasar density due to gravitational lensing by foreground large scale structure. To make this measurement we used 3800 square degrees of photometric observations from the Sloan Digital Sky Survey (SDSS) containing \~200,000 quasars and 13 million galaxies. Our measurement of the galaxy-quasar cross-correlation function exhibits the amplitude, angular dependence and change in sign as a function of the slope of the observed quasar number counts that is expected from magnification bias due to weak gravitational lensing. We show that observational uncertainties (stellar contamination, Galactic dust extinction, seeing variations and errors in the photometric redshifts) are well controlled and do not significantly affect the lensing signal. By weighting the quasars with the number count slope, we combine the cross-correlation of quasars for our full magnitude range and detect the lensing signal at >4 sigma in all five SDSS filters. Our measurements of cosmic magnification probe scales ranging from 60 kpc/h to 10 Mpc/h and are in good agreement with theoretical predictions based on the WMAP concordance cosmology. As with galaxy-galaxy lensing, future measurements of cosmic magnification will provide useful constraints on the galaxy-mass power spectrum.

We present the third edition of the Sloan Digital Sky Survey (SDSS) Quasar Catalog. The catalog consists of the 46,420 objects in the SDSS Third Data Release that have luminosities larger than M_i = -22 (in a cosmology with H_0 = 70 km/s/Mpc, Omega_M = 0.3, and Omega_Lambda = 0.7), have at least one emission line with FWHM larger than 1000 km/s or are unambiguously broad absorption line quasars, are fainter than i = 15.0, and have highly reliable redshifts. The area covered by the catalog is 4188 sq. deg. The quasar redshifts range from 0.08 to 5.41, with a median value of 1.47; the high-redshift sample includes 520 quasars at redshifts greater than four, of which 17 are at redshifts greater than five. For each object the catalog presents positions accurate to better than 0.2 arcsec. rms per coordinate, five-band (ugriz) CCD-based photometry with typical accuracy of 0.03 mag, and information on the morphology and selection method. The catalog also contains radio, near-infrared, and X-ray emission properties of the quasars, when available, from other large-area surveys. The calibrated digital spectra cover the wavelength region 3800--9200A at a spectral resolution about 2000; the spectra can be retrieved from the public database using the information provided in the catalog. A total of 44,221 objects in the catalog were discovered by the SDSS; 28,400 of the SDSS discoveries are reported here for the first time.

We summarize the Sloan Digital Sky Survey data acquisition and processing steps, and describe runQA, a pipeline designed for automated data quality assessment. In particular, we show how the position of the stellar locus in color-color diagrams can be used to estimate the accuracy of photometric zeropoint calibration to better than 0.01 mag in 0.03 deg2 patches. Using this method, we estimate that typical photometric zeropoint calibration errors for SDSS imaging data are not larger than ~0.01 mag in the g, r, and i bands, 0.02 mag in the z band, and 0.03 mag in the u band (root-mean-scatter for zeropoint offsets).

We perform an objective classification of 170,000 galaxy spectra in the Sloan Digital Sky Survey (SDSS) using the Karhunen-Lo\`eve (KL) transform. With about one-sixth of the total set of galaxy spectra which will be obtained by the survey, we are able to carry out the most extensive analysis of its kind to date. The formalism proposed by Connolly and Szalay is adopted to correct for gappy regions in the spectra, and to derive eigenspectra and eigencoefficients. From this analysis, we show that this gap-correction formalism leads to a converging set of eigenspectra and KL-repaired spectra. Furthermore, KL eigenspectra of galaxies are found to be convergent not only as a function of iteration, but also as a function of the number of randomly selected galaxy spectra used in the analysis. From these data a set of ten eigenspectra of galaxy spectra are constructed, with rest-wavelength coverage 3450-8350 angstrom. The eigencoefficients describing these galaxies naturally place the spectra into several classes defined by the plane formed by the first three eigencoefficients of each spectrum. Spectral types, corresponding to different Hubble-types and galaxies with extreme emission lines, are identified for the 170,000 spectra and are shown to be complementary to existing spectral classifications. From a non-parametric classification technique, we find that the population of galaxies can be divided into three classes which correspond to early late- through to intermediate late-types galaxies. (Abridged)

Understanding the clustering of galaxies has long been a goal of modern observational cosmology. Utilizing our photometric redshift technique a volume limited sample containing more than 2 million galaxies is constructed from the SDSS galaxy catalog. In the largest such analysis to date, we study the angular clustering as a function of luminosity and spectral type. Using Limber's equation we calculate the clustering length for the full data set as r0=5.77+/-0.10 Mpc/h. We find that r0 increases with luminosity by a factor of 1.6 over the sampled luminosity range, in agreement with previous redshift surveys. We also find that both the clustering length and the slope of the correlation function depend on the galaxy type. In particular, by splitting the galaxies in four groups by their rest-frame type we find a bimodal behavior in their clustering properties. Galaxies with spectral types similar to elliptical galaxies have a correlation length of 6.59 +/- 0.17 Mpc/h and a slope of the angular correlation function of 0.96 +/- 0.05 while blue galaxies have a clustering length of 4.51 +/- 0.19 Mpc/h and a slope of 0.68 +/- 0.09. The two intermediate color groups behave like their more extreme 'siblings', rather than showing a gradual transition in slope. We discuss these correlations in the context of current cosmological models for structure formation.

We develop a new method to constrain the star formation histories, dust attenuation and stellar masses of galaxies. It is based on two stellar absorption line indices, the 4000 Angstrom break strength and the Balmer absorption line index Hdelta_A. Together, these indices allow us to constrain the mean stellar ages of galaxies and the fractional stellar mass formed in bursts over the past few Gyr. A comparison with broad band photometry then yields estimates of dust attenuation and of stellar mass. We generate a large library of Monte Carlo realizations of different star formation histories, including starbursts of varying strength and a range of metallicities. We use this library to generate median likelihood estimates of burst mass fractions, dust attenuation strengths, stellar masses and stellar mass-to-light ratios for a sample of 122,208 galaxies drawn from the Sloan Digital Sky Survey. The typical 95% confidence range in our estimated stellar masses is +-40%. We study how the stellar mass-to-light ratios of galaxies vary as a function of absolute magnitude, concentration index and photometric pass-band and how dust attenuation varies as a function of absolute magnitude and 4000 Angstrom break strength. We also calculate how the total stellar mass of the present Universe is distributed over galaxies as a function of their mass, size, concentration, colour, burst mass fraction and surface mass density. We find that most of the stellar mass in the local Universe resides in galaxies that have stellar masses \~5\times 10^10 M_sol, half light radii ~3 kpc, and half- light surface mass densities ~10^9 M_sol/kpc^2. The distribution of D(4000) is strongly bimodal, showing a clear division between galaxies dominated by old stellar populations and galaxies with more recent star formation.

Using a sample of 3814 quasars from the Sloan Digital Sky Survey, we confirm that high-ionization, broad, emission lines such as CIV are significantly blueshifted with respect to low-ionization, broad, emission lines such as MgII. CIV emission line peaks have a range of shifts from a redshift of 500 km/s to blueshifts well in excess of 2000 km/s as compared to MgII. We confirm previous results that suggest an anti-correlation between the shift of the CIV emission line peak and the rest equivalent width of the CIV emission line. Furthermore, using composite spectra, we are able to show that the apparent shift of the CIV emission line peak is not a shift so much as it is a lack of flux in the red wing for the composite with the largest apparent shift. This observation should strongly constrain models for the broad emission line region in quasars. The emission line blueshift and equivalent width of CIV are also discussed in light of the Baldwin Effect and as a function of other quasar properties such as spectral index, radio and X-ray detection. We find a possible correlation with both the radio and broad absorption line properties of the quasars that is suggestive of orientation as the cause of the CIV velocity shifts.

A sample of nearly 9000 early-type galaxies, in the redshift range 0.01<z<0.3, was selected from the Sloan Digital Sky Survey using morphological and spectral criteria. The sample was used to study how early-type galaxy observables, including luminosity L, effective radius R, surface brightness I, color, and velocity dispersion V, are correlated with one another. Measurement biases are understood with mock catalogs which reproduce all of the observed scaling relations. At any given redshift, the intrinsic distribution of luminosities, sizes and velocity dispersions in our sample are all approximately Gaussian. In the r* band L ~ V^3.91, L ~ R^1.58, R ~ I^(-0.75), and the Fundamental Plane relation is R ~ V^(1.49) I^(-0.75). These relations are approximately the same in the g*, i* and z* bands. At fixed luminosity, the mass-to-light ratio scales as M/L ~ L^0.14. The g*-r* color scales as V^0.25. Color also correlates with magnitude and size, but these correlations are entirely due to the L-V and R-V relations. Chemical evolution and star formation histories are investigated using co-added spectra of similar objects in our sample. Chemical abundances correlate primarily with velocity dispersion. At fixed V, the higher redshift population is bluer, is weaker in Mg2, and is stronger in Hbeta than the population nearby. In addition, the population at higher redshifts is slightly more luminous. These differences are consistent with that of a passively evolving population which formed the bulk of its stars about 9 Gyrs ago. The Fundamental Plane suggests that galaxies in dense regions are slightly different from those in less dense regions, but the co-added spectra and color--magnitude relations show no statistically significant dependence on environment.

We present moderate resolution Keck spectroscopy of quasars at z=5.82, 5.99 and 6.28, discovered by the Sloan Digital Sky Survey (SDSS). We find that the Ly Alpha absorption in the spectra of these quasars evolves strongly with redshift. To z~5.7, the Ly Alpha absorption evolves as expected from an extrapolation from lower redshifts. However, in the highest redshift object, SDSSp J103027.10+052455.0 (z=6.28), the average transmitted flux is 0.0038+-0.0026 times that of the continuum level over 8450 A < lambda < 8710 A (5.95<z(abs)<6.16), consistent with zero flux. Thus the flux level drops by a factor of >150, and is consistent with zero flux in the Ly Alpha forest region immediately blueward of the Ly Alpha emission line, compared with a drop by a factor of ~10 at z(abs)~5.3. A similar break is seen at Ly Beta; because of the decreased oscillator strength of this transition, this allows us to put a considerably stronger limit, tau(eff) > 20, on the optical depth to Ly Alpha absorption at z=6. This is a clear detection of a complete Gunn-Peterson trough, caused by neutral hydrogen in the intergalactic medium. Even a small neutral hydrogen fraction in the intergalactic medium would result in an undetectable flux in the Ly Alpha forest region. Therefore, the existence of the Gunn-Peterson trough by itself does not indicate that the quasar is observed prior to the reionization epoch. However, the fast evolution of the mean absorption in these high-redshift quasars suggests that the mean ionizing background along the line of sight to this quasar has declined significantly from z~5 to 6, and the universe is approaching the reionization epoch at z~6.

Early data taken during commissioning of the SDSS have resulted in the discovery of a very cool white dwarf. It appears to have stronger collision induced absorption from molecular hydrogen than any other known white dwarf, suggesting it has a cooler temperature than any other. While its distance is presently unknown, it has a surprisingly small proper motion, making it unlikely to be a halo star. An analysis of white dwarf cooling times suggests that this object may be a low-mass star with a helium core. The SDSS imaging and spectroscopy also recovered LHS 3250, the coolest previously known white dwarf, indicating that the SDSS will be an effective tool for identifying these extreme objects.

We report the discovery of five quasars with redshifts of 4.67 - 5.27 and z'-band magnitudes of 19.5-20.7 M_B ~ -27. All were originally selected as distant quasar candidates in optical/near-infrared photometry from the Sloan Digital Sky Survey (SDSS), and most were confirmed as probable high-redshift quasars by supplementing the SDSS data with J and K measurements. The quasars possess strong, broad Lyman-alpha emission lines, with the characteristic sharp cutoff on the blue side produced by Lyman-alpha forest absorption. Three quasars contain strong, broad absorption features, and one of them exhibits very strong N V emission. The amount of absorption produced by the Lyman-alpha forest increases toward higher redshift, and that in the z=5.27 object (D_A ~ 0.7) is consistent with a smooth extrapolation of the absorption seen in lower redshift quasars. The high luminosity of these objects relative to most other known objects at z >~ 5 makes them potentially valuable as probes of early quasar properties and of the intervening intergalactic medium.

The next-generation astronomy archives will cover most of the universe at fine resolution in many wavelengths. One of the first of these projects, the Sloan Digital Sky Survey (SDSS) will create a 5-wavelength catalog over 10,000 square degrees of the sky. The 200 million objects in the multi-terabyte database will have mostly numerical attributes, defining a space of 100+ dimensions. Points in this space have highly correlated distributions. The archive will enable astronomers to explore the data interactively. Data access will be aided by multidimensional spatial indices. The data will be partitioned in many ways. Small tag objects consisting of the most popular attributes speed up frequent searches. Splitting the data among multiple servers enables parallel, scalable I/O. Hashing techniques allow efficient clustering and pairwise comparison algorithms. Randomly sampled subsets allow debugging otherwise large queries at the desktop. Central servers will operate a data pump that supports sweeping searches that touch most of the data.

We present the results of Smoothed Particle Hydrodynamics (SPH) simulations of the formation of a massive counterrotating disk in a spiral galaxy. The current study revisits and extends (with SPH) previous work carried out with sticky particle gas dynamics, in which adiabatic gas infall and a retrograde gas-rich dwarf merger were tested as the two most likely processes for producing such a counterrotating disk. We report on experiments with a cold primary similar to our Galaxy, as well as a hot, compact primary modeled after NGC 4138. We have also conducted numerical experiments with varying amounts of prograde gas in the primary disk, and an alternative infall model (a spherical shell with retrograde angular momentum). The structure of the resulting counterrotating disks is dramatically different with SPH. The disks we produce are considerably thinner than the primary disks and those produced with sticky particles. The time-scales for counterrotating disk formation are shorter with SPH because the gas loses kinetic energy and angular momentum more rapidly. Spiral structure is evident in most of the disks, but an exponential radial profile is not a natural byproduct of these processes. The infalling gas shells that we tested produce counterrotating bulges and rings rather than disks. The presence of a considerable amount of preexisting prograde gas in the primary causes, at least in the absence of star formation, a rapid inflow of gas to the center and a subsequent hole in the counterrotating disk. In general, our SPH experiments yield stronger evidence to suggest that the accretion of massive counterrotating disks drives the evolution of the host galaxies towards earlier (S0/Sa) Hubble types.

The Sa(r) galaxy NGC 4138 has been recently found to contain an extensive counterrotating disk which appears to be still forming. Up to a third of the stars in the disk system may be on retrograde orbits. A counterrotating ring of H II regions, along with extended counterrotating H I gas, suggests that the retrograde material has been recently acquired in the gas phase and is still trickling in. Using numerical simulations, we have attempted to model the process by which the counterrotating mass has been accreted by this galaxy. We investigate two possibilities: continuous retrograde infall of gas, and a retrograde merger with a gas-rich dwarf galaxy. Both processes are successful in producing a counterrotating disk of the observed mass and dimensions without heating up the primary significantly. Contrary to our experience with a fiducial cold, thin primary disk, the gas-rich merger works well for the massive, compact primary disk of NGC 4138 even though the mass of the dwarf galaxy is a significant fraction of the mass of the primary disk. Although we have restricted ourselves mainly to coplanar infall and mergers, we report on one inclined infall simulation as well. We also explore the possibility that the H-alpha ring seen in the inner half of the disk is a consequence of counterrotating gas clouds colliding with corotating gas already present in the disk and forming stars in the process.

We present results of numerical simulations of the formation of a massive counterrotating gas disk in a spiral galaxy. Using a hierarchical tree gravity solver combined with a sticky-particle gas dissipation scheme for our simulations, we have investigated three mechanisms: episodic and continuous gas infall, and a merger with a gas-rich dwarf galaxy. We find that both episodic and continuous gas infall work reasonably well and are able to produce a substantial gas counterrotating disk without upsetting the stability of the existing disk drastically, but it is very important for the gas to be well-dispersed in phase-space and not form concentrated clumps prior to its absorption by the disk galaxy. The initial angular momentum of the gas also plays a crucial role in determining the scale length of the counterrotating disk formed and the time it takes to form. The rate of infall, i.e. the mass of gas falling in per unit time, has to be small enough to preclude excessive heating of the preexisting disk. It is much easier in general to produce a smaller counterrotating disk than it is to produce an extensive disk whose scale length is similar to that of the original prograde disk. A gas-rich dwarf merger does not appear to be a viable mechanism to produce a massive counterrotating disk, because only a very small dwarf galaxy can produce a counterrotating disk without increasing the thickness of the existing disk by an order of magnitude, and the time-scale for this process is prohibitively long because it makes it very unlikely that several such mergers can accumulate a massive counterrotating disk over a Hubble time.