$Gaia$ DR2 has provided an unprecedented wealth of information about the positions and motions of stars in our Galaxy, and has highlighted the degree of disequilibria in the disc. As we collect data over a wider area of the disc it becomes increasingly appealing to start analysing stellar actions and angles, which specifically label orbit space, instead of their current phase space location. Conceptually, while $\bar{x}$ and $\bar{v}$ tell us about the potential and local interactions, grouping in action puts together stars that have similar frequencies and hence similar responses to dynamical effects occurring over several orbits. Grouping in actions and angles refines this further to isolate stars which are travelling together through space and hence have shared histories. Mixing these coordinate systems can confuse the interpretation. For example, it has been suggested that by moving stars to their guiding radius, the Milky Way spiral structure is visible as ridge-like overdensities in the $Gaia$ data \citep{Khoperskov+19b}. However, in this work, we show that these features are in fact the known kinematic moving groups, both in the $L_z-\phi$ and the $v_{\mathrm{R}}-v_{\phi}$ planes. Using simulations we show how this distinction will become even more important as we move to a global view of the Milky Way. As an example, we show that the radial velocity wave seen in the Galactic disc in $Gaia$ and APOGEE should become stronger in the action-angle frame, and that it can be reproduced by transient spiral structure.

A product of two Gaussians (or normal distributions) is another Gaussian. That's a valuable and useful fact! Here we use it to derive a refactoring of a common product of multivariate Gaussians: The product of a Gaussian likelihood times a Gaussian prior, where some or all of those parameters enter the likelihood only in the mean and only linearly. That is, a linear, Gaussian, Bayesian model. This product of a likelihood times a prior pdf can be refactored into a product of a marginalized likelihood (or a Bayesian evidence) times a posterior pdf, where (in this case) both of these are also Gaussian. The means and variance tensors of the refactored Gaussians are straightforward to obtain as closed-form expressions; here we deliver these expressions, with discussion. The closed-form expressions can be used to speed up and improve the precision of inferences that contain linear parameters with Gaussian priors. We connect these methods to inferences that arise frequently in physics and astronomy. If all you want is the answer, the question is posed and answered at the beginning of Section 3. We show two toy examples, in the form of worked exercises, in Section 4. The solutions, discussion, and exercises in this Note are aimed at someone who is already familiar with the basic ideas of Bayesian inference and probability.

This paper documents the sixteenth data release (DR16) from the Sloan Digital Sky Surveys; the fourth and penultimate from the fourth phase (SDSS-IV). This is the first release of data from the southern hemisphere survey of the Apache Point Observatory Galactic Evolution Experiment 2 (APOGEE-2); new data from APOGEE-2 North are also included. DR16 is also notable as the final data release for the main cosmological program of the Extended Baryon Oscillation Spectroscopic Survey (eBOSS), and all raw and reduced spectra from that project are released here. DR16 also includes all the data from the Time Domain Spectroscopic Survey (TDSS) and new data from the SPectroscopic IDentification of ERosita Survey (SPIDERS) programs, both of which were co-observed on eBOSS plates. DR16 has no new data from the Mapping Nearby Galaxies at Apache Point Observatory (MaNGA) survey (or the MaNGA Stellar Library "MaStar"). We also preview future SDSS-V operations (due to start in 2020), and summarize plans for the final SDSS-IV data release (DR17).

M dwarfs have enormous potential for our understanding of structure and formation on both Galactic and exoplanetary scales through their properties and compositions. However, current atmosphere models have limited ability to reproduce spectral features in stars at the coolest temperatures ($T_{\rm eff} < 4200\,$K) and to fully exploit the information content of current and upcoming large-scale spectroscopic surveys. Here we present a catalog of spectroscopic temperatures, metallicities, and spectral types for 5875 M dwarfs in the Apache Point Observatory Galactic Evolution Experiment (APOGEE) and Gaia DR2 surveys using The Cannon: a flexible, data-driven spectral-modeling and parameter-inference framework demonstrated to estimate stellar-parameter labels ($T_{\rm eff}$, log$g$, [Fe/H], and detailed abundances) to high precision. Using a training sample of 87 M dwarfs with optically derived labels spanning $2860 < T_{\rm eff} < 4130\,$K calibrated with bolometric temperatures, and $-0.5 < $[Fe/H]$ < 0.5\,$dex calibrated with FGK binary metallicities, we train a two-parameter model with predictive accuracy (in cross-validation) to $77\,$K and $0.09\,$dex respectively. We also train a one-dimensional spectral classification model using 51 M dwarfs with Sloan Digital Sky Survey optical spectral types ranging from M0 to M6, to predictive accuracy of 0.7 types. We find Cannon temperatures to be in agreement to within $60\,$K compared to a subsample of 1702 sources with color-derived temperatures, and Cannon metallicities to be in agreement to within $0.08\,$dex metallicity compared to a subsample of 15 FGK+M or M+M binaries. Finally, our comparison between Cannon and APOGEE pipeline (ASPCAP DR14) labels finds that ASPCAP is systematically biased toward reporting higher temperatures and lower metallicities for M dwarfs.

Mutual gravitation between a pulsating star and an orbital companion leads to a time-dependent variation in path length for starlight traveling to Earth. These variations can be used for coherently pulsating stars, such as the {\delta} Scuti variables, to constrain the masses and orbits of their companions. Observing these variations for {\delta} Scuti stars has previously relied on subdividing the light curve and measuring the average pulsation phase in equally sized subdivisions, which leads to under-sampling near periapsis. We introduce a new approach that simultaneously forward-models each sample in the light curve and show that this method improves upon current sensitivity limits - especially in the case of highly eccentric and short-period binaries. We find that this approach is sensitive enough to observe Jupiter mass planets around {\delta} Scuti stars under ideal conditions, and use gravity-mode pulsations in the subdwarf B star KIC 7668647 to detect its companion without radial velocity data. We further provide robust detection limits as a function of the SNR of the pulsation mode and determine that the minimum detectable light travel time amplitude for a typical Kepler {\delta} Scuti is around 2 s. This new method significantly enhances the application of light travel time variations to detecting short period binaries with pulsating components, and pulsating A-type exoplanet host stars, especially as a tool for eliminating false positives.

The mean Galactocentric radial velocities $\langle v_{R}\rangle(R,\phi)$ of luminous red giant stars within the mid-plane of the Milky Way reveal a spiral signature, which could plausibly reflect the response to a non-axisymmetric perturbation of the gravitational potential in the Galactic disk. We apply a simple steady-state toy model of a logarithmic spiral to interpret these observations, and find a good qualitative and quantitative match. Presuming that the amplitude of the gravitational potential perturbation is proportionate to that in the disk's surface mass density, we estimate the surface mass density amplitude to be $\Sigma_{\rm max} (R_{\odot})= 14\pm5\,\rm M_{\odot}\,pc^{-2}$ at the solar radius. Combined with the local disk density, this implies a surface mass density contrast between the arm and inter-arm regions of approximately $\pm 20\%$ at the solar radius, with an increase towards larger Galactocentric radii. Our model constrains the pitch angle of the {\it dynamical} spiral arms to be $12.7^{\circ}\pm1.2^{\circ}$.

Many problems in contemporary astrophysics---from understanding the formation of black holes to untangling the chemical evolution of galaxies---rely on knowledge about binary stars. This, in turn, depends on discovery and characterization of binary companions for large numbers of different kinds of stars in different chemical and dynamical environments. Current stellar spectroscopic surveys observe hundreds of thousands to millions of stars with (typically) few observational epochs, which allows binary discovery but makes orbital characterization challenging. We use a custom Monte Carlo sampler (The Joker) to perform discovery and characterization of binary systems through radial-velocities, in the regime of sparse, noisy, and poorly sampled multi-epoch data. We use it to generate posterior samplings in Keplerian parameters for 232,531 sources released in APOGEE Data Release 16. Our final catalog contains 19,635 high-confidence close-binary (P < few years, a < few AU) systems that show interesting relationships between binary occurrence rate and location in the color-magnitude diagram. We find notable faint companions at high masses (black-hole candidates), at low masses (substellar candidates), and at very close separations (mass-transfer candidates). We also use the posterior samplings in a (toy) hierarchical inference to measure the long-period binary-star eccentricity distribution. We release the full set of posterior samplings for the entire parent sample of 232,531 stars. This set of samplings involves no heuristic "discovery" threshold and therefore can be used for myriad statistical purposes, including hierarchical inferences about binary-star populations and sub-threshold searches.

The $100^\circ$-long thin stellar stream in the Milky Way halo, GD-1, has an ensemble of features that may be due to dynamical interactions. Using high-resolution MMT/Hectochelle spectroscopy we show that a spur of GD-1-like stars outside of the main stream are kinematically and chemically consistent with the main stream. In the spur, as in the main stream, GD-1 has a low intrinsic radial velocity dispersion, $\sigma_{V_r}\lesssim1\,\rm km\,s^{-1}$, is metal-poor, $\rm [Fe/H]\approx-2.3$, with little $\rm [Fe/H]$ spread and some variation in $\rm [\alpha/Fe]$ abundances, which point to a common globular cluster progenitor. At a fixed location along the stream, the median radial velocity offset between the spur and the main stream is smaller than $0.5\,\rm km\,s^{-1}$, comparable to the measurement uncertainty. A flyby of a massive, compact object can change orbits of stars in a stellar stream and produce features like the spur observed in GD-1. In this scenario, the radial velocity of the GD-1 spur relative to the stream constrains the orbit of the perturber and its current on-sky position to $\approx5,000\,\rm deg^2$. The family of acceptable perturber orbits overlaps the stellar and dark-matter debris of the Sagittarius dwarf galaxy in present-day position and velocity. This suggests that GD-1 may have been perturbed by a globular cluster or an extremely compact dark-matter subhalo formerly associated with Sagittarius.

emcee is a Python library implementing a class of affine-invariant ensemble samplers for Markov chain Monte Carlo (MCMC). This package has been widely applied to probabilistic modeling problems in astrophysics where it was originally published, with some applications in other fields. When it was first released in 2012, the interface implemented in emcee was fundamentally different from the MCMC libraries that were popular at the time, such as PyMC, because it was specifically designed to work with "black box" models instead of structured graphical models. This has been a popular interface for applications in astrophysics because it is often non-trivial to implement realistic physics within the modeling frameworks required by other libraries. Since emcee's release, other libraries have been developed with similar interfaces, such as dynesty (Speagle 2019). The version 3.0 release of emcee is the first major release of the library in about 6 years and it includes a full re-write of the computational backend, several commonly requested features, and a set of new "move" implementations.

In recent years, dedicated extreme-precision radial velocity (EPRV) spectrographs have produced vast quantities of high-resolution, high-signal-to-noise time-series spectra for bright stars. These data contain valuable information for the dual purposes of planet detection via the measured RVs and stellar characterization via the co-added spectra. However, considerable data analysis challenges exist in extracting these data products from the observed spectra at the highest possible precision, including the issue of poorly-characterized telluric absorption features and the common use of an assumed stellar spectral template. In both of these examples, precision-limiting reliance on external information can be sidestepped using the data directly. Here we propose a data-driven method to simultaneously extract precise RVs and infer the underlying stellar and telluric spectra using a linear model (in the log of flux). The model employs a convex objective and convex regularization to keep the optimization of the spectral components fast. We implement this method in wobble, an open-source python package which uses TensorFlow in one of its first non-neural-network applications to astronomical data. In this work, we demonstrate the performance of wobble on archival HARPS spectra. We recover the canonical exoplanet 51 Pegasi b, detect the secular RV evolution of the M dwarf Barnard's Star, and retrieve the Rossiter-McLaughlin effect for the Hot Jupiter HD 189733b. The method additionally produces extremely high-S/N composite stellar spectra and detailed time-variable telluric spectra, which we also present here.

While the Kepler Mission was designed to look at tens of thousands of faint stars (V > 12), brighter stars that saturated the detector are important because they can be and have been observed very accurately by other instruments. By analyzing the unsaturated scattered-light `halo' around these stars, we have retrieved precise light curves of most of the brightest stars in K2 fields from Campaign~4 onwards. The halo method does not depend on the detailed cause and form of systematics, and we show that it is effective at extracting light curves from both normal and saturated stars. The key methodology is to optimize the weights of a linear combination of pixel time series with respect to an objective function. We test a range of such objective functions, finding that lagged Total Variation, a generalization of Total Variation, performs well on both saturated and unsaturated K2 targets. Applying this to the bright stars across the K2 Campaigns reveals stellar variability ubiquitously, including effects of stellar pulsation, rotation, and binarity. We describe our pipeline and present a catalogue of the 161 bright stars, with classifications of their variability, asteroseismic parameters for red giants with well-measured solar-like oscillations, and remarks on interesting objects. These light curves are publicly available as a High Level Science Product from the Mikulski Archive for Space Telescopes (MAST).

Orbital properties of stars, computed from their six-dimensional phase space measurements and an assumed Galactic potential, are used to understand the structure and evolution of the Galaxy. Stellar actions, computed from orbits, have the attractive quality of being invariant under certain assumptions and are therefore used as quantitative labels of a star's orbit. We report a subtle but important systematic error that is induced in the actions as a consequence of local midplane variations expected for the Milky Way. This error is difficult to model because it is non-Gaussian and bimodal, with neither mode peaking on the null value. An offset in the vertical position of the Galactic midplane of $\sim15\,\text{pc}$ for a thin disk-like orbit or $\sim 120\,\text{pc}$ for a thick disk-like orbit induces a $25\%$ systematic error in the vertical action $J_z$. In FIRE simulations of Milky Way-mass galaxies, these variations are on the order of $\sim100\,\text{pc}$ at the solar circle. From observations of the mean vertical velocity variation of $\sim5\text{--}10\,\text{km}\,\text{s}^{-1}$ with radius, we estimate that the Milky Way midplane variations are $\sim60\text{--}170\,\text{pc}$, consistent with three-dimensional dust maps. Action calculations and orbit integrations, which assume the global and local midplanes are identical, are likely to include this induced error, depending on the volume considered. Variation in the local standard of rest or distance to the Galactic center causes similar issues. The variation of the midplane must be taken into account when performing dynamical analysis across the large regions of the disk accessible to Gaia and future missions.

We present a new age-dating technique that combines gyrochronology with isochrone fitting to infer ages for FGKM main-sequence and subgiant field stars. Gyrochronology and isochrone fitting are each capable of providing relatively precise ages for field stars in certain areas of the Hertzsprung-Russell diagram: gyrochronology works optimally for cool main-sequence stars, and isochrone fitting can provide precise ages for stars near the main-sequence turnoff. Combined, these two age-dating techniques can provide precise and accurate ages for a broader range of stellar masses and evolutionary stages than either method used in isolation. We demonstrate that the position of a star on the Hertzsprung- Russell or color-magnitude diagram can be combined with its rotation period to infer a precise age via both isochrone fitting and gyrochronology simultaneously. We show that incorporating rotation periods with 5% uncertainties into stellar evolution models improves age precision for FGK stars on the main sequence, and can, on average, provide age estimates up to three times more precise than isochrone fitting alone. In addition, we provide a new gyrochronology relation, calibrated to the Praesepe cluster and the Sun, that includes a variance model to capture the rotational behavior of stars whose rotation periods do not lengthen with the square-root of time, and parts of the Hertzsprung-Russell diagram where gyrochronology has not been calibrated. This publication is accompanied by an open source Python package, stardate, for inferring the ages of main-sequence and subgiant FGKM stars from rotation periods, spectroscopic parameters and/or apparent magnitudes and parallaxes.

We report the results from a new, highly sensitive ($\Delta T_{mb} \sim 3 $mK) survey for thermal OH emission at 1665 and 1667 MHz over a dense, 9 x 9-pixel grid covering a $1\deg$ x $1\deg$ patch of sky in the direction of $l = 105\deg, b = +2.50\deg$ towards the Perseus spiral arm of our Galaxy. We compare our Green Bank Telescope (GBT) 1667 MHz OH results with archival CO J=1-0 observations from the Five College Radio Astronomy Observatory (FCRAO) Outer Galaxy Survey within the velocity range of the Perseus Arm at these galactic coordinates. Out of the 81 statistically-independent pointings in our survey area, 86% show detectable OH emission at 1667 MHz, and 19% of them show detectable CO emission. We explore the possible physical conditions of the observed features using a set of diffuse molecular cloud models. In the context of these models, both OH and CO disappear at current sensitivity limits below an A$_{\rm v}$ of 0.2, but the CO emission does not appear until the volume density exceeds 100-200 cm$^{-3}$. These results demonstrate that a combination of low column density A$_{\rm v}$ and low volume density $n_{H}$ can explain the lack of CO emission along sight lines exhibiting OH emission. The 18-cm OH main lines, with their low critical density of $n^{*}$ $ \sim 1 $ cm$^{-3}$, are collisionally excited over a large fraction of the quiescent galactic environment and, for observations of sufficient sensitivity, provide an optically-thin radio tracer for diffuse H$_2$.

The importance of the Decadal Survey in astrophysics is great; it deserves attention and revision. We make recommendations to increase the Survey's transparency and political legitimacy. The Astro2020 charge asks the Survey to "generate consensus recommendations". It is healthy to re-evaluate how to achieve consensus as the community and context evolve. Our recommendations are the following: (R1) Appoint the Decadal panel chairs and panel members through a transparent process, or even a democratic process. (R2) Don't make panel members sign any kinds of non-disclosure agreements, or strictly limit these. (R3) Educate the community about the Decadal's decision-making and consensus-building. (R4) Provide written documentation about how white papers will be read and used. (R5) Give the community an opportunity to comment on and vote to approve the final reports. (R6) Ask the AAAC to help the agencies make these changes.

The Milky Way is filled with the tidally-disrupted remnants of globular clusters and dwarf galaxies. Determining the properties of these objects -- in particular, initial masses and density profiles -- is relevant to both astronomy and dark matter physics. However, most direct measures of mass cannot be applied to tidal debris, as the systems of interest are no longer in equilibrium. Since phase-space density is conserved during adiabatic phase mixing, Liouville's theorem provides a connection between stellar kinematics as measured by observatories such as Gaia and the original mass of the disrupted system. Accurately recovering the phase-space density is complicated by uncertainties resulting from measurement errors and orbital integration, which both effectively inject entropy into the system, preferentially decreasing the measured density. In this paper, we demonstrate that these two issues can be overcome. First, we measure the phase-space density of the globular cluster M4 in Gaia data, and use Liouville's theorem to derive its mass. We then show that, for tidally disrupted systems, the orbital parameters and thus phase-space density can be inferred by minimizing the phase-space entropy of cold stellar streams. This work is therefore a proof of principle that true phase-space density can be measured and the original properties of the star cluster reconstructed in systems of astrophysical interest.

We present a model for the interaction of the GD-1 stellar stream with a massive perturber that naturally explains many of the observed stream features, including a gap and an off-stream spur of stars. The model involves an impulse by a fast encounter, after which the stream grows a loop of stars at different orbital energies. At specific viewing angles, this loop appears offset from the stream track. A quantitative comparison of the spur and gap features prefers models where the perturber is in the mass range of $10^6\,\rm M_\odot$ to $10^8\,\rm M_\odot$. Orbit integrations back in time show that the stream encounter could not have been caused by any known globular cluster or dwarf galaxy with a determined orbit, and mass, size and impact-parameter arguments show that it could not have been caused by a molecular cloud in the Milky Way disk. The most plausible explanation for the gap-and-spur structure is an encounter with a dark-matter substructure, like those predicted to populate galactic halos in LCDM cosmology. However, the expected densities of LCDM subhalos in this mass range and in this part of the Milky Way are $2-3\,\sigma$ lower than the inferred density of the GD-1 perturber. This observation opens up the possibility that detailed observations of streams could measure the mass spectrum of dark-matter substructures and even identify individual substructures and their orbits in the Galactic halo.

In simple models of the Milky Way, tidally disrupting satellites produce long and thin---nearly one-dimensional---stellar streams. Using astrometric data from the Gaia second data release and photometry from the Dark Energy Survey, we demonstrate that the Jhelum stream, a stellar stream in the inner halo, is a two-dimensional structure. The spatial distribution of highly probable Jhelum members reveals a dense thin component and an associated diffuse, spatially offset component. These two spatial components have indistinguishable proper motions (at $\sigma\sim1\,\rm mas\,yr^{-1}$ level) and a similar ratio of blue straggler to blue horizontal branch stars, which indicates a common origin for the two components. The best-fit orbit to the narrow component (pericenter $8\,\rm kpc$, apocenter $24\,\rm kpc$), however, does not explain the wide component of the Jhelum stream. On the other hand, an older orbital wrap of Jhelum's orbit traces the Indus stream, indicating a possible connection between these two structures and additional complexity in Jhelum's formation. Substructure in the Jhelum progenitor or precession of its tidal debris in the Milky Way potential may explain the observed structure of Jhelum. Future spectroscopic data will enable discrimination between these "nature" and "nurture" formation scenarios. Jhelum adds to the growing list of cold stellar streams that display complex morphologies and promise to reveal the dynamical history of the Milky Way.

Simpson's paradox, or Yule-Simpson effect, arises when a trend appears in different subsets of data but disappears or reverses when these subsets are combined. We describe here seven cases of this phenomenon for chemo-kinematical relations believed to constrain the Milky Way disk formation and evolution. We show that interpreting trends in relations, such as the radial and vertical chemical abundance gradients, the age-metallicity relation, and the metallicity-rotational velocity relation (MVR), can lead to conflicting conclusions about the Galaxy past if analyses marginalize over stellar age and/or birth radius. It is demonstrated that the MVR in RAVE giants is consistent with being always strongly negative, when narrow bins of [Mg/Fe] are considered. This is directly related to the negative radial metallicity gradients of stars grouped by common age (mono-age populations) due to the inside out disk formation. The effect of the asymmetric drift can then give rise to a positive MVR trend in high-[alpha/Fe] stars, with a slope dependent on a given survey's selection function and observational uncertainties. We also study the variation of lithium abundance, A(Li), with [Fe/H] of AMBRE:HARPS dwarfs. A strong reversal in the positive A(Li)-[Fe/H] trend of the total sample is found for mono-age populations, flattening for younger groups of stars. Dissecting by birth radius shows strengthening in the positive A(Li)-[Fe/H] trend, shifting to higher [Fe/H] with decreasing birth radius; these observational results suggest new constraints on chemical evolution models. This work highlights the necessity for precise age estimates for large stellar samples covering wide spatial regions.

Our uncertainties about binary star systems (and triples and so on) limit our capabilities in literally every single one of the Thematic Areas identified for Astro2020. We need to understand the population statistics of stellar multiplicity and their variations with stellar type, chemistry, and dynamical environment: Correct interpretation of any exoplanet experiment depends on proper treatment of resolved and unresolved binaries; stellar multiplicity is a direct outcome of star and companion formation; the most precise constraints on stellar structure come from well-characterized binary systems; stellar populations heavily rely on stellar and binary evolution modeling; high-redshift galaxy radiation and reionization is controlled by binary-dependent stellar physics; compact objects are the outcomes of binary evolution; the interpretation of multi-messenger astronomy from gravitational waves, light, and neutrinos relies on understanding the products of binary star evolution; near-Universe constraints on the Hubble constant with Type Ia supernovae and gravitational-wave mergers are subject to systematics related to their binary star progenitors; local measures of dark-matter substructure masses are distorted by binary populations. In order to realize the scientific goals in each of these themes over the next decade, we therefore need to understand how binary stars and stellar multiplets are formed and distributed in the space of masses, composition, age, and orbital properties, and how the distribution evolves with time. This white paper emphasizes the interdisciplinary importance of binary-star science and advocates that coordinated investment from all astrophysical communities will benefit almost all branches of astrophysics.

Twenty years have passed since first light for the Sloan Digital Sky Survey (SDSS). Here, we release data taken by the fourth phase of SDSS (SDSS-IV) across its first three years of operation (July 2014-July 2017). This is the third data release for SDSS-IV, and the fifteenth from SDSS (Data Release Fifteen; DR15). New data come from MaNGA - we release 4824 datacubes, as well as the first stellar spectra in the MaNGA Stellar Library (MaStar), the first set of survey-supported analysis products (e.g. stellar and gas kinematics, emission line, and other maps) from the MaNGA Data Analysis Pipeline (DAP), and a new data visualisation and access tool we call "Marvin". The next data release, DR16, will include new data from both APOGEE-2 and eBOSS; those surveys release no new data here, but we document updates and corrections to their data processing pipelines. The release is cumulative; it also includes the most recent reductions and calibrations of all data taken by SDSS since first light. In this paper we describe the location and format of the data and tools and cite technical references describing how it was obtained and processed. The SDSS website (www.sdss.org) has also been updated, providing links to data downloads, tutorials and examples of data use. While SDSS-IV will continue to collect astronomical data until 2020, and will be followed by SDSS-V (2020-2025), we end this paper by describing plans to ensure the sustainability of the SDSS data archive for many years beyond the collection of data.

We measure the circular velocity curve $v_{\rm c}(R)$ of the Milky Way with the highest precision to date across Galactocentric distances of $5\leq R \leq 25$ kpc. Our analysis draws on the $6$-dimensional phase-space coordinates of $\gtrsim 23,000$ luminous red-giant stars, for which we previously determined precise parallaxes using a data-driven model that combines spectral data from APOGEE with photometric information from WISE, 2MASS, and Gaia. We derive the circular velocity curve with the Jeans equation assuming an axisymmetric gravitational potential. At the location of the Sun we determine the circular velocity with its formal uncertainty to be $v_{\rm c}(R_{\odot}) = (229.0\pm0.2)\rm\,km\,s^{-1}$ with systematic uncertainties at the $\sim 2-5\%$ level. We find that the velocity curve is gently but significantly declining at $(-1.7\pm0.1)\rm\,km\,s^{-1}\,kpc^{-1}$, with a systematic uncertainty of $0.46\rm\,km\,s^{-1}\,kpc^{-1}$, beyond the inner $5$ kpc. We exclude the inner $5$ kpc from our analysis due to the presence of the Galactic bar, which strongly influences the kinematic structure and requires modeling in a non-axisymmetric potential. Combining our results with external measurements of the mass distribution for the baryonic components of the Milky Way from other studies, we estimate the Galaxy's dark halo mass within the virial radius to be $M_{\rm vir} = (7.25\pm0.26)\cdot 10^{11}M_{\odot}$ and a local dark matter density of $\rho_{\rm dm}(R_{\odot}) = 0.30\pm0.03\,\rm GeV\,cm^{-3}$.

With contemporary infrared spectroscopic surveys like APOGEE, red-giant stars can be observed to distances and extinctions at which Gaia parallaxes are not highly informative. Yet the combination of effective temperature, surface gravity, composition, and age - all accessible through spectroscopy - determines a giant's luminosity. Therefore spectroscopy plus photometry should enable precise spectrophotometric distance estimates. Here we use the APOGEE-Gaia-2MASS-WISE overlap to train a data-driven model to predict parallaxes for red-giant branch stars with $0<\log g\leq2.2$ (more luminous than the red clump). We employ (the exponentiation of) a linear function of APOGEE spectral pixel intensities and multi-band photometry to predict parallax spectrophotometrically. The model training involves no logarithms or inverses of the Gaia parallaxes, and needs no cut on the Gaia parallax signal-to-noise ratio. It includes an L1 regularization to zero out the contributions of uninformative pixels. The training is performed with leave-out subsamples such that no star's astrometry is used even indirectly in its spectrophotometric parallax estimate. The model implicitly performs a reddening and extinction correction in its parallax prediction, without any explicit dust model. We assign to each star in the sample a new spectrophotometric parallax estimate; these parallaxes have uncertainties of a few to 15 percent, depending on data quality, which is more precise than the Gaia parallax for the vast majority of targets, and certainly any stars more than a few kpc distance. We obtain 10-percent distance estimates out to heliocentric distances of $20\,$kpc, and make global maps of the Milky Way's disk.

Large stellar surveys are sensitive to interstellar dust through the effects of reddening. Using extinctions measured from photometry and spectroscopy, together with three-dimensional (3D) positions of individual stars, it is possible to construct a three-dimensional dust map. We present the first continuous map of the dust distribution in the Galactic disk out to 7 kpc within 100 pc of the Galactic midplane, using red clump and giant stars from SDSS APOGEE DR14. We use a non-parametric method based on Gaussian Processes to map the dust density, which is the local property of the ISM rather than an integrated quantity. This method models the dust correlation between points in 3D space and can capture arbitrary variations, unconstrained by a pre-specified functional form. This produces a continuous map without line-of-sight artefacts. Our resulting map traces some features of the local Galactic spiral arms, even though the model contains no prior suggestion of spiral arms, nor any underlying model for the Galactic structure. This is the first time that such evident arm structures have been captured by a dust density map in the Milky Way. Our resulting map also traces some of the known giant molecular clouds in the Galaxy and puts some constraints on their distances, some of which were hitherto relatively uncertain.

The past year has witnessed discovery of the first identified counterparts to a gravitational wave transient (GW 170817A) and a very high-energy neutrino (IceCube-170922A). These source identifications, and ensuing detailed studies, have realized longstanding dreams of astronomers and physicists to routinely carry out observations of cosmic sources by other than electromagnetic means, and inaugurated the era of "multi-messenger" astronomy. While this new era promises extraordinary physical insights into the universe, it brings with it new challenges, including: highly heterogeneous, high-volume, high-velocity datasets; globe-spanning cross-disciplinary teams of researchers, regularly brought together into transient collaborations; an extraordinary breadth and depth of domain-specific knowledge and computing resources required to anticipate, model, and interpret observations; and the routine need for adaptive, distributed, rapid-response observing campaigns to fully exploit the scientific potential of each source. We argue, therefore, that the time is ripe for the community to conceive and propose an Institute for Multi-Messenger Astrophysics that would coordinate its resources in a sustained and strategic fashion to efficiently address these challenges, while simultaneously serving as a center for education and key supporting activities. In this fashion, we can prepare now to realize the bright future that we see, beyond, through these newly opened windows onto the universe.

The cosmological exploitation of modern photometric galaxy surveys requires both accurate (unbiased) and precise (narrow) redshift probability distributions derived from broadband photometry. Existing methodologies do not meet those requirements. Standard template fitting delivers interpretable models and errors, but lacks flexibility to learn inaccuracies in the observed photometry or the spectral templates. Machine learning addresses those issues, but requires representative training data, and the resulting models and uncertainties cannot be interpreted in the context of a physical model or outside of the training data. We present a hierarchical modeling approach simultaneously addressing the issues of flexibility, interpretability, and generalization. It combines template fitting with flexible (machine learning-like) models to correct the spectral templates, model their redshift distributions, and recalibrate the photometric observations. By optimizing the full posterior distribution of the model and solving for its (thousands of) parameters, one can perform a global statistical calibration of the data and the SED model. We apply this approach to the public Dark Energy Survey Science Verification data, and show that it provides more accurate and compact redshift posterior distributions than existing methods, as well as insights into residual photometric and SED systematics. The model is causal, makes predictions for future data (e.g., additional photometric bandpasses), and its internal parameters and components are interpretable. This approach does not formally require the training data to be complete or representative; in principle it can even work in regimes in which few or no spectroscopic redshifts are available.

SPHEREx is a proposed NASA MIDEX mission selected for Phase A study. SPHEREx would carry out the first all-sky spectral survey in the near infrared. At the end of its two-year mission, SPHEREx would obtain 0.75-to-5$\mu$m spectra of every 6.2 arcsec pixel on the sky, with spectral resolution R>35 and a 5-$\sigma$ sensitivity AB$>$19 per spectral/spatial resolution element. More details concerning SPHEREx are available at http://spherex.caltech.edu. The SPHEREx team has proposed three specific science investigations to be carried out with this unique data set: cosmic inflation, interstellar and circumstellar ices, and the extra-galactic background light. Though these three themes are undoubtedly compelling, they are far from exhausting the scientific output of SPHEREx. Indeed, SPHEREx would create a unique all-sky spectral database including spectra of very large numbers of astronomical and solar system targets, including both extended and diffuse sources. These spectra would enable a wide variety of investigations, and the SPHEREx team is dedicated to making the data available to the community to enable these investigations, which we refer to as Legacy Science. To that end, we have sponsored two workshops for the general scientific community to identify the most interesting Legacy Science themes and to ensure that the SPHEREx data products are responsive to their needs. In February of 2016, some 50 scientists from all fields met in Pasadena to develop these themes and to understand their implications for the SPHEREx mission. The 2016 workshop highlighted many synergies between SPHEREx and other contemporaneous astronomical missions, facilities, and databases. Consequently, in January 2018 we convened a second workshop at the Center for Astrophysics in Cambridge to focus specifically on these synergies. This white paper reports on the results of the 2018 SPHEREx workshop.

We develop and apply a model to quantify the global efficiency of radial orbit migration among stars in the Milky Way disk. This model parameterizes the possible star formation and enrichment histories, radial birth profiles, and combines them with a migration model that relates present-day orbital radii to birth radii through a Gaussian probability, broadening with age $\tau$ as $\sigma_\mathrm{RM8}~\sqrt{\tau/8{~\mathrm{Gyr}}}$. Guided by observations, we assume that stars are born with an initially tight age--metallicity relation at given radius, which becomes subsequently scrambled by radial orbit migration, thereby providing a direct observational constraint on radial orbit migration strength $\sigma_\mathrm{RM8}$. We fit this model with MCMC to the observed age--metallicity distribution of low-$\alpha$ red clump stars with Galactocentric radii between 5 and 14 kpc from APOGEE DR12, sidestepping the complex spatial selection function and accounting for the considerable age uncertainties. This simple model reproduces well the observed data, and we find a global (in radius and time) radial orbit migration efficiency in the Milky Way of $\sigma_\mathrm{RM8}=3.6\pm 0.1$ kpc when marginalizing over all other model aspects. This shows that radial orbit migration in the Milky Way's main disk is indeed rather strong, in line with theoretical expectations: stars migrate by about a half-mass radius over the age of the disk. The model finds the Sun's birth radius at $\sim 5.2$ kpc. If such strong radial orbit migration is typical, this mechanism plays indeed an important role in setting the structural regularity of disk galaxies.

It has been demonstrated that the time variability of a star's brightness at different frequencies can be used to infer its surface gravity, radius, mass, and age. With large samples of light curves now available from Kepler and K2, and upcoming surveys like TESS, we wish to quantify the overall information content of this data and identify where the information resides. As a first look into this question we ask which stellar parameters we can predict from the brightness variations in red-giant stars data and to what precision, using a data-driven model. We demonstrate that the long-cadence (30-minute) Kepler light curves for 2000 red-giant stars can be used to predict their $T_{\rm eff}$ and $\log g$. Our inference makes use of a data-driven model of a part of the autocorrelation function (ACF) of the light curve, where we posit a polynomial relationship between stellar parameters and the ACF pixel values. We find that this model, trained using 1000 stars, can be used to recover the temperature $T_{\rm eff}$ to $<$100 K, the surface gravity to $<$ 0.1 dex, and the asteroseismic power-spectrum parameters $\rm \nu_{max}$ and $\rm \Delta{\nu}$ to $<11$ $\mu$Hz and $<0.9$ $\mu$Hz ($\lesssim$ 15\%). We recover $T_{\rm eff}$ from range of time-lags 0.045 $<$ $T_{\rm lag}$ $<$ 370 days and the $\log g$, $\rm \nu_{max}$ and $\rm \Delta{\nu}$ from the range 0.045 $<$ $T_{\rm lag}$ $<$ 35 days. We do not discover any information about stellar metallicity. The information content of the data about each parameter is empirically quantified using this method, enabling comparisons to theoretical expectations about convective granulation.

Although core helium-burning red clump (RC) stars are faint at ultraviolet wavelengths, their ultraviolet-optical color is a unique and accessible probe of their physical properties. Using data from the GALEX All Sky Imaging Survey, Gaia Data Release 2 and the SDSS APOGEE DR14 survey, we find that spectroscopic metallicity is strongly correlated with the location of an RC star in the UV-optical color magnitude diagram. The RC has a wide spread in (NUV - G)$_0$ color, over 4 magnitudes, compared to a 0.7-magnitude range in (G$_{BP}$ - G$_{RP}$)$_0$. We propose a photometric, dust-corrected, ultraviolet-optical (NUV - G)$_0$ color-metallicity [Fe/H] relation using a sample of 5,175 RC stars from APOGEE. We show that this relation has a scatter of 0.28 dex and is easier to obtain for large, wide-field samples than spectroscopic metallicities. Importantly, the effect may be comparable to the spread in RC color attributed to extinction in other studies.

The fourth generation of the Sloan Digital Sky Survey (SDSS-IV) has been in operation since July 2014. This paper describes the second data release from this phase, and the fourteenth from SDSS overall (making this, Data Release Fourteen or DR14). This release makes public data taken by SDSS-IV in its first two years of operation (July 2014-2016). Like all previous SDSS releases, DR14 is cumulative, including the most recent reductions and calibrations of all data taken by SDSS since the first phase began operations in 2000. New in DR14 is the first public release of data from the extended Baryon Oscillation Spectroscopic Survey (eBOSS); the first data from the second phase of the Apache Point Observatory (APO) Galactic Evolution Experiment (APOGEE-2), including stellar parameter estimates from an innovative data driven machine learning algorithm known as "The Cannon"; and almost twice as many data cubes from the Mapping Nearby Galaxies at APO (MaNGA) survey as were in the previous release (N = 2812 in total). This paper describes the location and format of the publicly available data from SDSS-IV surveys. We provide references to the important technical papers describing how these data have been taken (both targeting and observation details) and processed for scientific use. The SDSS website (www.sdss.org) has been updated for this release, and provides links to data downloads, as well as tutorials and examples of data use. SDSS-IV is planning to continue to collect astronomical data until 2020, and will be followed by SDSS-V.

When we perform probabilistic inferences with the Gaia Mission data, we technically require a likelihood function, or a probability of the (raw-ish) data as a function of stellar (astrometric and photometric) properties. Unfortunately, we aren't (at present) given access to the Gaia data directly; we are only given a Catalog of derived astrometric properties for the stars. How do we perform probabilistic inferences in this context? The answer - implicit in many publications - is that we should look at the Gaia Catalog as containing the parameters of a likelihood function, or a probability of the Gaia data, conditioned on stellar properties, evaluated at the location of the data. Concretely, my recommendation is to assume (for, say, the parallax) that the Catalog-reported value and uncertainty are the mean and root-variance of a Gaussian function that can stand in for the true likelihood function. This is the implicit assumption in most Gaia literature to date; my only goal here is to make the assumption explicit. Certain technical choices by the Mission team slightly invalidate this assumption for DR1 (TGAS), but not seriously. Generalizing beyond Gaia, it is important to downstream users of any Catalog products that they deliver likelihood information about the fundamental data; this is a challenge for the probabilistic catalogs of the future.

Cold stellar streams---produced by tidal disruptions of clusters---are long-lived, coherent dynamical features in the halo of the Milky Way. Due to their different ages and different positions in phase space, different streams tell us different things about the Galaxy. Here we employ a Cramer--Rao (CRLB) or Fisher-matrix approach to understand the quantitative information content in eleven known streams (ATLAS, GD-1, Hermus, Kwando, Orinoco, PS1A, PS1C, PS1D, PS1E, Sangarius and Triangulum). This approach depends on a generative model, which we have developed previously, and which permits calculation of derivatives of predicted stream properties with respect to Galaxy and stream parameters. We find that in simple analytic models of the Milky Way, streams on eccentric orbits contain the most information about the halo shape. For each stream, there are near-degeneracies between dark-matter-halo properties and parameters of the bulge, the disk, and the stream progenitor, but simultaneous fitting of multiple streams will constrain all parameters at the percent level. At this precision, simulated dark matter halos deviate from simple analytic parametrizations, so we add an expansion of basis functions to give the gravitational potential more freedom. As freedom increases, the information about the halo reduces overall, and it becomes more localized to the current position of the stream. In the limit of high model freedom, a stellar stream appears to measure the local acceleration at its current position; this motivates thinking about future non-parametric approaches. The CRLB formalism also permits us to assess the value of future measurements of stellar velocities, distances, and proper motions. We show that kinematic measurements of stream stars are essential for producing competitive constraints on the distribution of dark matter, which bodes well for stream studies in the age of Gaia.

Multi-epoch radial velocity measurements of stars can be used to identify stellar, sub-stellar, and planetary-mass companions. Even a small number of observation epochs can be informative about companions, though there can be multiple qualitatively different orbital solutions that fit the data. We have custom-built a Monte Carlo sampler (The Joker) that delivers reliable (and often highly multi-modal) posterior samplings for companion orbital parameters given sparse radial-velocity data. Here we use The Joker to perform a search for companions to 96,231 red-giant stars observed in the APOGEE survey (DR14) with $\geq 3$ spectroscopic epochs. We select stars with probable companions by making a cut on our posterior belief about the amplitude of the stellar radial-velocity variation induced by the orbit. We provide (1) a catalog of 320 companions for which the stellar companion properties can be confidently determined, (2) a catalog of 4,898 stars that likely have companions, but would require more observations to uniquely determine the orbital properties, and (3) posterior samplings for the full orbital parameters for all stars in the parent sample. We show the characteristics of systems with confidently determined companion properties and highlight interesting systems with candidate compact object companions.

Multiple stellar systems are ubiquitous in the Milky Way, but are often unresolved and seen as single objects in spectroscopic, photometric, and astrometric surveys. Yet, modeling them is essential for developing a full understanding of large surveys such as Gaia, and connecting them to stellar and Galactic models. In this paper we address this problem by jointly fitting the Gaia and 2MASS photometric and astrometric data using a data-driven Bayesian hierarchical model that includes populations of binary and trinary systems. This allows us to classify observations into singles, binaries, and trinaries, in a robust and efficient manner, without resorting to external models. We are able to identify multiple systems and, in some cases, make strong predictions for the properties of its unresolved stars. We will be able to compare such predictions with Gaia Data Release 4, which will contain astrometric identification and analysis of binary systems.

Standard present day large-scale structure (LSS) analyses make a major assumption in their Bayesian parameter inference --- that the likelihood has a Gaussian form. For summary statistics currently used in LSS, this assumption, even if the underlying density field is Gaussian, cannot be correct in detail. We investigate the impact of this assumption on two recent LSS analyses: the Beutler et al. (2017) power spectrum multipole ($P_\ell$) analysis and the Sinha et al. (2017) group multiplicity function ($\zeta$) analysis. Using non-parametric divergence estimators on mock catalogs originally constructed for covariance matrix estimation, we identify significant non-Gaussianity in both the $P_\ell$ and $\zeta$ likelihoods. We then use Gaussian mixture density estimation and Independent Component Analysis on the same mocks to construct likelihood estimates that approximate the true likelihood better than the Gaussian $pseudo$-likelihood. Using these likelihood estimates, we accurately estimate the true posterior probability distribution of the Beutler et al. (2017) and Sinha et al. (2017) parameters. Likelihood non-Gaussianity shifts the $f\sigma_8$ constraint by $-0.44\sigma$, but otherwise, does not significantly impact the overall parameter constraints of Beutler et al. (2017). For the $\zeta$ analysis, using the pseudo-likelihood significantly underestimates the uncertainties and biases the constraints of Sinha et al. (2017) halo occupation parameters. For $\log M_1$ and $\alpha$, the posteriors are shifted by $+0.43\sigma$ and $-0.51\sigma$ and broadened by $42\%$ and $66\%$, respectively. The divergence and likelihood estimation methods we present provide a straightforward framework for quantifying the impact of likelihood non-Gaussianity and deriving more accurate parameter constraints.

Observational tests of stellar and Galactic chemical evolution call for the joint knowledge of a star's physical parameters, detailed element abundances, and precise age. For cool main-sequence (MS) stars the abundances of many elements can be measured from spectroscopy, but ages are very hard to determine. The situation is different if the MS star has a white dwarf (WD) companion and a known distance, as the age of such a binary system can then be determined precisely from the photometric properties of the cooling WD. As a pilot study for obtaining precise age determinations of field MS stars, we identify nearly one hundred candidates for such wide binary systems: a faint WD whose GPS1 proper motion matches that of a brighter MS star in Gaia/TGAS with a good parallax ($\sigma_\varpi/\varpi\le 0.05$). We model the WD's multi-band photometry with the BASE-9 code using this precise distance (assumed to be common for the pair) and infer ages for each binary system. The resulting age estimates are precise to $\le 10\%$ ($\le 20\%$) for $42$ ($67$) MS-WD systems. Our analysis more than doubles the number of MS-WD systems with precise distances known to date, and it boosts the number of such systems with precise age determination by an order of magnitude. With the advent of the Gaia DR2 data, this approach will be applicable to a far larger sample, providing ages for many MS stars (that can yield detailed abundances for over 20 elements), especially in the age range 2 to 8\,\Gyr, where there are only few known star clusters.

We develop a data-driven spectral model for identifying and characterizing spatially unresolved multiple-star systems and apply it to APOGEE DR13 spectra of main-sequence stars. Binaries and triples are identified as targets whose spectra can be significantly better fit by a superposition of two or three model spectra, drawn from the same isochrone, than any single-star model. From an initial sample of $\sim$20,000 main-sequence targets, we identify $\sim$2,500 binaries in which both the primary and secondary star contribute detectably to the spectrum, simultaneously fitting for the velocities and stellar parameters of both components. We additionally identify and fit $\sim$200 triple systems, as well as $\sim$700 velocity-variable systems in which the secondary does not contribute detectably to the spectrum. Our model simplifies the process of simultaneously fitting single- or multi-epoch spectra with composite models and does not depend on a velocity offset between the two components of a binary, making it sensitive to traditionally undetectable systems with periods of hundreds or thousands of years. In agreement with conventional expectations, almost all the spectrally-identified binaries with measured parallaxes fall above the main sequence in the color-magnitude diagram. We find excellent agreement between spectrally and dynamically inferred mass ratios for the $\sim$600 binaries in which a dynamical mass ratio can be measured from multi-epoch radial velocities. We obtain full orbital solutions for 64 systems, including 14 close binaries within hierarchical triples. We make available catalogs of stellar parameters, abundances, mass ratios, and orbital parameters.

Across almost all scientific disciplines, the instruments that record our experimental data and the methods required for storage and data analysis are rapidly increasing in complexity. This gives rise to the need for scientific communities to adapt on shorter time scales than traditional university curricula allow for, and therefore requires new modes of knowledge transfer. The universal applicability of data science tools to a broad range of problems has generated new opportunities to foster exchange of ideas and computational workflows across disciplines. In recent years, hack weeks have emerged as an effective tool for fostering these exchanges by providing training in modern data analysis workflows. While there are variations in hack week implementation, all events consist of a common core of three components: tutorials in state-of-the-art methodology, peer-learning and project work in a collaborative environment. In this paper, we present the concept of a hack week in the larger context of scientific meetings and point out similarities and differences to traditional conferences. We motivate the need for such an event and present in detail its strengths and challenges. We find that hack weeks are successful at cultivating collaboration and the exchange of knowledge. Participants self-report that these events help them both in their day-to-day research as well as their careers. Based on our results, we conclude that hack weeks present an effective, easy-to-implement, fairly low-cost tool to positively impact data analysis literacy in academic disciplines, foster collaboration and cultivate best practices.

The target of many astronomical studies is the recovery of tiny astrophysical signals living in a sea of uninteresting (but usually dominant) noise. In many contexts (i.e., stellar time-series, or high-contrast imaging, or stellar spectroscopy), there are structured components in this noise caused by systematic effects in the astronomical source, the atmosphere, the telescope, or the detector. More often than not, evaluation of the true physical model for these nuisances is computationally intractable and dependent on too many (unknown) parameters to allow rigorous probabilistic inference. Sometimes, housekeeping data---and often the science data themselves---can be used as predictors of the systematic noise. Linear combinations of simple functions of these predictors are often used as computationally tractable models that can capture the nuisances. These models can be used to fit and subtract systematics prior to investigation of the signals of interest, or they can be used in a simultaneous fit of the systematics and the signals. In this Note, we show that if a Gaussian prior is placed on the weights of the linear components, the weights can be marginalized out with an operation in pure linear algebra, which can (often) be made fast. We illustrate this model by demonstrating the applicability of a linear model for the non-linear systematics in K2 time-series data, where the dominant noise source for many stars is spacecraft motion and variability.

Markov Chain Monte Carlo (MCMC) methods for sampling probability density functions (combined with abundant computational resources) have transformed the sciences, especially in performing probabilistic inferences, or fitting models to data. In this primarily pedagogical contribution, we give a brief overview of the most basic MCMC method and some practical advice for the use of MCMC in real inference problems. We give advice on method choice, tuning for performance, methods for initialization, tests of convergence, troubleshooting, and use of the chain output to produce or report parameter estimates with associated uncertainties. We argue that autocorrelation time is the most important test for convergence, as it directly connects to the uncertainty on the sampling estimate of any quantity of interest. We emphasize that sampling is a method for doing integrals; this guides our thinking about how MCMC output is best used.

Difference imaging or image subtraction is a method that measures differential photometry by matching the pointing and point-spread function (PSF) between image frames. It is used for the detection of time-variable phenomena. Here we present a new category of method---CPM Difference Imaging, in which differences are not measured between matched images but instead between image frames and a data-driven predictive model that has been designed only to predict the pointing, PSF, and detector effects but not astronomical variability. In CPM Difference Imaging each pixel is modelled by the Causal Pixel Model (CPM) originally built for modeling Kepler data, in which pixel values are predicted by a linear combination of other pixels at the same epoch but far enough away such that these pixels are causally disconnected, astrophysically. It does not require that the user have any explicit model or description of the pointing or point-spread function of any of the images. Its principal drawback is that---in its current form---it requires an imaging campaign with many epochs and fairly stable telescope pointing. The method is applied to simulated data and also the K2 Campaign 9 microlensing data. We show that CPM Difference Imaging can detect variable objects and produce precise differentiate photometry in a crowded field. CPM Difference Imaging is capable of producing image differences at nearly photon-noise precision.

The fourth generation of the Sloan Digital Sky Survey (SDSS-IV) began observations in July 2014. It pursues three core programs: APOGEE-2, MaNGA, and eBOSS. In addition, eBOSS contains two major subprograms: TDSS and SPIDERS. This paper describes the first data release from SDSS-IV, Data Release 13 (DR13), which contains new data, reanalysis of existing data sets and, like all SDSS data releases, is inclusive of previously released data. DR13 makes publicly available 1390 spatially resolved integral field unit observations of nearby galaxies from MaNGA, the first data released from this survey. It includes new observations from eBOSS, completing SEQUELS. In addition to targeting galaxies and quasars, SEQUELS also targeted variability-selected objects from TDSS and X-ray selected objects from SPIDERS. DR13 includes new reductions of the SDSS-III BOSS data, improving the spectrophotometric calibration and redshift classification. DR13 releases new reductions of the APOGEE-1 data from SDSS-III, with abundances of elements not previously included and improved stellar parameters for dwarf stars and cooler stars. For the SDSS imaging data, DR13 provides new, more robust and precise photometric calibrations. Several value-added catalogs are being released in tandem with DR13, in particular target catalogs relevant for eBOSS, TDSS, and SPIDERS, and an updated red-clump catalog for APOGEE. This paper describes the location and format of the data now publicly available, as well as providing references to the important technical papers that describe the targeting, observing, and data reduction. The SDSS website, http://www.sdss.org, provides links to the data, tutorials and examples of data access, and extensive documentation of the reduction and analysis procedures. DR13 is the first of a scheduled set that will contain new data and analyses from the planned ~6-year operations of SDSS-IV.

We report and discuss the discovery of a comoving pair of bright solar-type stars, HD 240430 and HD 240429, with a significant difference in their chemical abundances. The two stars have an estimated 3D separation of $\approx 0.6$ pc ($\approx 0.01$ pc projected) at a distance of $r\approx 100$ pc with nearly identical three-dimensional velocities, as inferred from Gaia TGAS parallaxes and proper motions, and high-precision radial velocity measurements. Stellar parameters determined from high-resolution Keck HIRES spectra indicate that both stars are $\sim 4$ Gyr old. The more metal-rich of the two, HD 240430, shows an enhancement of refractory ($T_C>1200$ K) elements by $\approx 0.2$ dex and a marginal enhancement of (moderately) volatile elements ($T_C<1200$ K, C, N, O, Na, and Mn). This is the largest metallicity difference found in a wide binary pair yet. Additionally, HD 240430 shows an anomalously high surface lithium abundance ($A(\mathrm{Li})=2.75$), higher than its companion by $0.5$ dex. The proximity in phase-space and ages between the two stars suggests that they formed together with the same composition, at odds with the observed differences in metallicity and abundance patterns. We therefore suggest that the star HD~240430, "Kronos", accreted 15 $M_\oplus$ of rocky material after birth, selectively enhancing the refractory elements as well as lithium in its surface and convective envelope.

We present the first catalog and data release of the Swift-BAT AGN Spectroscopic Survey (BASS). We analyze optical spectra of the majority of AGN (77%, 641/836) detected based on their 14-195 keV emission in the 70-month Swift BAT all-sky catalog. This includes redshift determination, absorption and emission line measurements, and black hole mass and accretion rate estimates for the majority of obscured and un-obscured AGN (74%, 473/641) with 340 measured for the first time. With ~90% of sources at z<0.2, the survey represents a significant census of hard-X-ray selected AGN in the local universe. In this first catalog paper, we describe the spectroscopic observations and datasets, and our initial spectral analysis. The FWHM of the emission lines show broad agreement with the X-ray obscuration (~94%), such that Sy 1-1.8 have NH<10^21.9 cm^-2, and Seyfert 2, have NH>10^21.9 cm^-2. Seyfert 1.9 show a range of column densities. Compared to narrow line AGN in the SDSS, the X-ray selected AGN have a larger fraction of dusty host galaxies suggesting these types of AGN are missed in optical surveys. Using the most sensitive [OIII]/Hbeta and [NII]/Halpha emission line diagnostic, about half of the sources are classified as Seyferts, ~15% reside in dusty galaxies that lack an Hbeta detection, but for which the line upper limits imply either a Seyfert or LINER, ~15% are in galaxies with weak or no emission lines despite high quality spectra, and a few percent each are LINERS, composite galaxies, HII regions, or in known beamed AGN.

Distances to individual stars in our own Galaxy are critical in order to piece together the nature of its velocity and spatial structure. Core helium burning red clump (RC) stars have similar luminosities, are abundant throughout the Galaxy, and thus constitute good standard candles. We build a hierarchical probabilistic model to quantify the quality of RC stars as standard candles using parallax measurements from the first Gaia data release. A unique aspect of our methodology is to fully account for (and marginalize over) parallax, photometry, and dust corrections uncertainties, which leads to more robust results than standard approaches. We determine the absolute magnitude and intrinsic dispersion of the RC in 2MASS bands J, H, Ks, Gaia G band, and WISE bands W1, W2, W3, and W4. We find that the absolute magnitude of the RC is $-1.61 \pm$ 0.01 (in Ks), $+0.44 \pm$ 0.01 (in G) , $-0.93 \pm$ 0.01 (in J), $-1.46 \pm$ 0.01 (in H), $-1.68 \pm$ 0.02 (in W1), $-1.69\pm$ 0.02 (in W2), $-1.67 \pm$ 0.02 (in W3), $1.76 \pm$ 0.01 mag (in W4). The mean intrinsic dispersion is $\sim 0.17 \pm$ 0.03 mag across all bands (yielding a typical distance precision of $\sim$ 8%). Thus RC stars are reliable and precise standard candles. In addition, we have also re-calibrated the zero point of the absolute magnitude of the RC in each band, which provide a benchmark for future studies to estimate distances to RC stars. Finally, the parallax error shrinkage in the hierarchical model outlined in this work can be used to obtain more precise parallaxes than Gaia for the most distant RC stars across the Galaxy.

We describe the Sloan Digital Sky Survey IV (SDSS-IV), a project encompassing three major spectroscopic programs. The Apache Point Observatory Galactic Evolution Experiment 2 (APOGEE-2) is observing hundreds of thousands of Milky Way stars at high resolution and high signal-to-noise ratio in the near-infrared. The Mapping Nearby Galaxies at Apache Point Observatory (MaNGA) survey is obtaining spatially-resolved spectroscopy for thousands of nearby galaxies (median redshift of z = 0.03). The extended Baryon Oscillation Spectroscopic Survey (eBOSS) is mapping the galaxy, quasar, and neutral gas distributions between redshifts z = 0.6 and 3.5 to constrain cosmology using baryon acoustic oscillations, redshift space distortions, and the shape of the power spectrum. Within eBOSS, we are conducting two major subprograms: the SPectroscopic IDentification of eROSITA Sources (SPIDERS), investigating X-ray AGN and galaxies in X-ray clusters, and the Time Domain Spectroscopic Survey (TDSS), obtaining spectra of variable sources. All programs use the 2.5-meter Sloan Foundation Telescope at Apache Point Observatory; observations there began in Summer 2014. APOGEE-2 also operates a second near-infrared spectrograph at the 2.5-meter du Pont Telescope at Las Campanas Observatory, with observations beginning in early 2017. Observations at both facilities are scheduled to continue through 2020. In keeping with previous SDSS policy, SDSS-IV provides regularly scheduled public data releases; the first one, Data Release 13, was made available in July 2016.

Converting a noisy parallax measurement into a posterior belief over distance requires inference with a prior. Usually this prior represents beliefs about the stellar density distribution of the Milky Way. However, multi-band photometry exists for a large fraction of the \textsl{\small{Gaia}} \textsl{\small{TGAS}} Catalog and is incredibly informative about stellar distances. Here we use \textsl{\small{2MASS}} colors for 1.4 million \textsl{\small{TGAS}} stars to build a noise-deconvolved empirical prior distribution for stars in color--magnitude space. This model contains no knowledge of stellar astrophysics or the Milky Way, but is precise because it accurately generates a large number of noisy parallax measurements under an assumption of stationarity; that is, it is capable of combining the information from many stars. We use the Extreme Deconvolution (\textsl{\small{XD}}) algorithm---an Empirical Bayes approximation to a full hierarchical model of the true parallax and photometry of every star---to construct this prior. The prior is combined with a \textsl{\small{TGAS}} likelihood to infer a precise photometric parallax estimate and uncertainty (and full posterior) for every star. Our parallax estimates are more precise than the \textsl{\small{TGAS}} catalog entries by a median factor of 1.2 (14% are more precise by a factor >2) and are more precise than previous Bayesian distance estimates that use spatial priors. We validate our parallax inferences using members of the Milky Way star cluster M67, which is not visible as a cluster in the \textsl{\small{TGAS}} parallax estimates, but appears as a cluster in our posterior parallax estimates. Our results, including a parallax posterior pdf for each of 1.4 million \textsl{\small{TGAS}} stars, are available in companion electronic tables.

We measure carbon and nitrogen abundances to $\lesssim$ 0.1 dex for 450,000 giant stars from their low-resolution (R$\sim$1800) LAMOST DR2 survey spectra. We use these [C/M] and [N/M] measurements, together with empirical relations based on the APOKASC sample, to infer stellar masses and implied ages for 230,000 of these objects to 0.08 dex and 0.2 dex respectively. We use The Cannon, a data-driven approach to spectral modeling, to construct a predictive model for LAMOST spectra. Our reference set comprises 8125 stars observed in common between the APOGEE and LAMOST surveys, taking seven APOGEE DR12 labels (parameters) as ground truth: Teff, logg, [M/H], [$\alpha$/M], [C/M], [N/M], and Ak. We add seven colors to the Cannon model, based on the g, r, i, J, H, K, W1, and W2 magnitudes from APASS, 2MASS & WISE, which improves our constraints on Teff and logg by up to 20% and on Ak by up to 70%. Cross-validation of the model demonstrates that, for high-SNR objects, our inferred labels agree with the APOGEE values to within 50 K in temperature, 0.04 magnitudes in Ak, and < 0.1 dex in logg, [M/H], [C/M], [N/M], and [$\alpha$/M]. We apply the model to 450,000 giants in LAMOST DR2 that have not been observed by APOGEE. This demonstrates that precise individual abundances can be measured from low-resolution spectra, and represents the largest catalog of [C/M], [N/M], masses and ages to date. As as result, we greatly increase the number and sky coverage of stars with mass and age estimates.

The primary sample of the {\it Gaia} Data Release 1 is the Tycho-Gaia Astrometric Solution (TGAS): $\approx$ 2 million Tycho-2 sources with improved parallaxes and proper motions relative to the initial catalog. This increased astrometric precision presents an opportunity to find new binary stars and moving groups. We search for high-confidence comoving pairs of stars in TGAS by identifying pairs of stars consistent with having the same 3D velocity using a marginalized likelihood ratio test to discriminate candidate comoving pairs from the field population. Although we perform some visualizations using (bias- corrected) inverse parallax as a point estimate of distance, the likelihood ratio is computed with a probabilistic model that includes the covariances of parallax and proper motions and marginalizes the (unknown) true distances and 3D velocities of the stars. We find 13,085 comoving star pairs among 10,606 unique stars with separations as large as 10 pc (our search limit). Some of these pairs form larger groups through mutual comoving neighbors: many of these pair networks correspond to known open clusters and OB associations, but we also report the discovery of several new comoving groups. Most surprisingly, we find a large number of very wide ($>1$ pc) separation comoving star pairs, the number of which increases with increasing separation and cannot be explained purely by false-positive contamination. Our key result is a catalog of high-confidence comoving pairs of stars in TGAS. We discuss the utility of this catalog for making dynamical inferences about the Galaxy, testing stellar atmosphere models, and validating chemical abundance measurements.

In this study, we probe the transition to cosmic homogeneity in the Large Scale Structure (LSS) of the Universe using the CMASS galaxy sample of BOSS spectroscopic survey which covers the largest effective volume to date, $3\ h^{-3}\ \mathrm{Gpc}^3$ at $0.43 \leq z \leq 0.7$. We study the scaled counts-in-spheres, $\mathcal{N}(<r)$, and the fractal correlation dimension, $\mathcal{D}_2(r)$, to assess the homogeneity scale of the universe using a $Landy\ \&\ Szalay$ inspired estimator. Defining the scale of transition to homogeneity as the scale at which $\mathcal{D}_2(r)$ reaches 3 within $1\%$, i.e. $\mathcal{D}_2(r)>2.97$ for $r>\mathcal{R}_H$, we find $\mathcal{R}_H = (63.3\pm0.7) \ h^{-1}\ \mathrm{Mpc}$, in agreement at the percentage level with the predictions of the $\Lambda$CDM model $\mathcal{R}_H=62.0\ h^{-1}\ \mathrm{Mpc}$. Thanks to the large cosmic depth of the survey, we investigate the redshift evolution of the transition to homogeneity scale and find agreement with the $\Lambda$CDM prediction. Finally, we find that $\mathcal{D}_2$ is compatible with $3$ at scales larger than $300\ h^{-1}\ $Mpc in all redshift bins. These results consolidate the Cosmological Principle and represent a precise consistency test of the $\Lambda CDM$ model.

Standard approaches to Bayesian parameter inference in large scale structure assume a Gaussian functional form (chi-squared form) for the likelihood. This assumption, in detail, cannot be correct. Likelihood free inferences such as Approximate Bayesian Computation (ABC) relax these restrictions and make inference possible without making any assumptions on the likelihood. Instead ABC relies on a forward generative model of the data and a metric for measuring the distance between the model and data. In this work, we demonstrate that ABC is feasible for LSS parameter inference by using it to constrain parameters of the halo occupation distribution (HOD) model for populating dark matter halos with galaxies. Using specific implementation of ABC supplemented with Population Monte Carlo importance sampling, a generative forward model using HOD, and a distance metric based on galaxy number density, two-point correlation function, and galaxy group multiplicity function, we constrain the HOD parameters of mock observation generated from selected "true" HOD parameters. The parameter constraints we obtain from ABC are consistent with the "true" HOD parameters, demonstrating that ABC can be reliably used for parameter inference in LSS. Furthermore, we compare our ABC constraints to constraints we obtain using a pseudo-likelihood function of Gaussian form with MCMC and find consistent HOD parameter constraints. Ultimately our results suggest that ABC can and should be applied in parameter inference for LSS analyses.

Given sparse or low-quality radial-velocity measurements of a star, there are often many qualitatively different stellar or exoplanet companion orbit models that are consistent with the data. The consequent multimodality of the likelihood function leads to extremely challenging search, optimization, and MCMC posterior sampling over the orbital parameters. Here we create a custom Monte Carlo sampler for sparse or noisy radial-velocity measurements of two-body systems that can produce posterior samples for orbital parameters even when the likelihood function is poorly behaved. The six standard orbital parameters for a binary system can be split into four non-linear parameters (period, eccentricity, argument of pericenter, phase) and two linear parameters (velocity amplitude, barycenter velocity). We capitalize on this by building a sampling method in which we densely sample the prior pdf in the non-linear parameters and perform rejection sampling using a likelihood function marginalized over the linear parameters. With sparse or uninformative data, the sampling obtained by this rejection sampling is generally multimodal and dense. With informative data, the sampling becomes effectively unimodal but too sparse: in these cases we follow the rejection sampling with standard MCMC. The method produces correct samplings in orbital parameters for data that include as few as three epochs. The Joker can therefore be used to produce proper samplings of multimodal pdfs, which are still informative and can be used in hierarchical (population) modeling. We give some examples that show how the posterior pdf depends sensitively on the number and time coverage of the observations and their uncertainties.

We present a hierarchical probabilistic model for improving geometric stellar distance estimates using color--magnitude information. This is achieved with a data driven model of the color--magnitude diagram, not relying on stellar models but instead on the relative abundances of stars in color--magnitude cells, which are inferred from very noisy magnitudes and parallaxes. While the resulting noise-deconvolved color--magnitude diagram can be useful for a range of applications, we focus on deriving improved stellar distance estimates relying on both parallax and photometric information. We demonstrate the efficiency of this approach on the 1.4 million stars of the Gaia TGAS sample that also have APASS magnitudes. Our hierarchical model has 4~million parameters in total, most of which are marginalized out numerically or analytically. We find that distance estimates are significantly improved for the noisiest parallaxes and densest regions of the color--magnitude diagram. In particular, the average distance signal-to-noise ratio and uncertainty improve by 19~percent and 36~percent, respectively, with 8~percent of the objects improving in SNR by a factor greater than 2. This computationally efficient approach fully accounts for both parallax and photometric noise, and is a first step towards a full hierarchical probabilistic model of the Gaia data.

Among the population of known galactic black hole X-ray binaries, GRS 1915+105 stands out in multiple ways. It has been in continuous outburst since 1992, and has shown a wide range of different states that can be distinguished by their timing and spectral properties. These states, also observed in IGR J17091-3624, have in the past been linked to accretion dynamics. Here, we present the first comprehensive study into the long-term evolution of GRS 1915+105, using the entire data set observed with RXTE over its sixteen-year lifetime. We develop a set of descriptive features allowing for automatic separation of states, and show that supervised machine learning in the form of logistic regression and random forests can be used to efficiently classify the entire data set. For the first time, we explore the duty cycle and time evolution of states over the entire sixteen-year time span, and find that the temporal distribution of states has significantly changed over the span of the observations. We connect the machine classification with physical interpretations of the phenomenology in terms of chaotic and stochastic processes.

We explore to which extent stars within Galactic disk open clusters resemble each other in the high-dimensional space of their photospheric element abundances, and contrast this with pairs of field stars. Our analysis is based on abundances for 20 elements, homogeneously derived from APOGEE spectra (with carefully quantified uncertainties, with a median value of $\sim 0.03$ dex). We consider 90 red giant stars in seven open clusters and find that most stars within a cluster have abundances in most elements that are indistinguishable (in a $\chi^2$-sense) from those of the other members, as expected for stellar birth siblings. An analogous analysis among pairs of $>1000$ field stars shows that highly significant abundance differences in the 20-dimensional space can be established for the vast majority of these pairs, and that the APOGEE-based abundance measurements have high discriminating power. However, pairs of field stars whose abundances are indistinguishable even at 0.03~dex precision exist: $\sim 0.3$ percent of all field star pairs, and $\sim 1.0$ percent of field star pairs at the same (solar) metallicity [Fe/H] = $0 \pm 0.02$. Most of these pairs are presumably not birth siblings from the same cluster, but rather doppelganger. Our analysis implies that 'chemical tagging' in the strict sense, identifying birth siblings for typical disk stars through their abundance similarity alone, will not work with such data. However, our approach shows that abundances have extremely valuable information for probabilistic chemo-orbital modeling and combined with velocities, we have identified new cluster members from the field.

In this era of large-scale stellar spectroscopic surveys, measurements of stellar attributes ("labels," i.e. parameters and abundances) must be made precise and consistent across surveys. Here, we demonstrate that this can be achieved by a data-driven approach to spectral modeling. With The Cannon, we transfer information from the APOGEE survey to determine precise Teff, log g, [Fe/H], and [$\alpha$/M] from the spectra of 450,000 LAMOST giants. The Cannon fits a predictive model for LAMOST spectra using 9952 stars observed in common between the two surveys, taking five labels from APOGEE DR12 as ground truth: Teff, log g, [Fe/H], [\alpha/M], and K-band extinction $A_k$. The model is then used to infer Teff, log g, [Fe/H], and [$\alpha$/M] for 454,180 giants, 20% of the LAMOST DR2 stellar sample. These are the first [$\alpha$/M] values for the full set of LAMOST giants, and the largest catalog of [$\alpha$/M] for giant stars to date. Furthermore, these labels are by construction on the APOGEE label scale; for spectra with S/N > 50, cross-validation of the model yields typical uncertainties of 70K in Teff, 0.1 in log g, 0.1 in [Fe/H], and 0.04 in [$\alpha$/M], values comparable to the broadly stated, conservative APOGEE DR12 uncertainties. Thus, by using "label transfer" to tie low-resolution (LAMOST R $\sim$ 1800) spectra to the label scale of a much higher-resolution (APOGEE R $\sim$ 22,500) survey, we substantially reduce the inconsistencies between labels measured by the individual survey pipelines. This demonstrates that label transfer with The Cannon can successfully bring different surveys onto the same physical scale.

We present a new method for inferring photometric redshifts in deep galaxy and quasar surveys, based on a data driven model of latent spectral energy distributions (SEDs) and a physical model of photometric fluxes as a function of redshift. This conceptually novel approach combines the advantages of both machine-learning and template-fitting methods by building template SEDs directly from the training data. This is made computationally tractable with Gaussian Processes operating in flux--redshift space, encoding the physics of redshift and the projection of galaxy SEDs onto photometric band passes. This method alleviates the need of acquiring representative training data or constructing detailed galaxy SED models; it requires only that the photometric band passes and calibrations be known or have parameterized unknowns. The training data can consist of a combination of spectroscopic and deep many-band photometric data, which do not need to entirely spatially overlap with the target survey of interest or even involve the same photometric bands. We showcase the method on the $i$-magnitude-selected, spectroscopically-confirmed galaxies in the COSMOS field. The model is trained on the deepest bands (from SUBARU and HST) and photometric redshifts are derived using the shallower SDSS optical bands only. We demonstrate that we obtain accurate redshift point estimates and probability distributions despite the training and target sets having very different redshift distributions, noise properties, and even photometric bands. Our model can also be used to predict missing photometric fluxes, or to simulate populations of galaxies with realistic fluxes and redshifts, for example. This method opens a new era in which photometric redshifts for large photometric surveys are derived using a flexible yet physical model of the data trained on all available surveys (spectroscopic and photometric).

The BOSS quasar sample is used to study cosmic homogeneity with a 3D survey in the redshift range $2.2<z<2.8$. We measure the count-in-sphere, $N(<\! r)$, i.e. the average number of objects around a given object, and its logarithmic derivative, the fractal correlation dimension, $D_2(r)$. For a homogeneous distribution $N(<\! r) \propto r^3$ and $D_2(r)=3$. Due to the uncertainty on tracer density evolution, 3D surveys can only probe homogeneity up to a redshift dependence, i.e. they probe so-called "spatial isotropy". Our data demonstrate spatial isotropy of the quasar distribution in the redshift range $2.2<z<2.8$ in a model-independent way, independent of any FLRW fiducial cosmology, resulting in $3-\langle D_2 \rangle < 1.7 \times 10^{-3}$ (2 $\sigma$) over the range $250<r<1200 \, h^{-1}$Mpc for the quasar distribution. If we assume that quasars do not have a bias much less than unity, this implies spatial isotropy of the matter distribution on large scales. Then, combining with the Copernican principle, we finally get homogeneity of the matter distribution on large scales. Alternatively, using a flat $\Lambda$CDM fiducial cosmology with CMB-derived parameters, and measuring the quasar bias relative to this $\Lambda$CDM model, our data provide a consistency check of the model, in terms of how homogeneous the Universe is on different scales. $D_2(r)$ is found to be compatible with our $\Lambda$CDM model on the whole $10<r<1200 \, h^{-1}$Mpc range. For the matter distribution we obtain $3-\langle D_2 \rangle < 5 \times 10^{-5}$ (2 $\sigma$) over the range $250<r<1200 \, h^{-1}$Mpc, consistent with homogeneity on large scales.

Using a sample of nearly half million galaxies, intersected by over 7 million lines of sight from the Sloan Digital Sky Survey Data Release 12, we trace H$\alpha$ + [N{\small II}] emission from a galactocentric projected radius, $r_p$, of 5 kpc to more than 100 kpc. The emission flux surface brightness is $\propto r_p^{-1.9 \pm 0.4}$. We obtain consistent results using only the H$\alpha$ or [N{\small II}] flux. We measure a stronger signal for the bluer half of the target sample than for the redder half on small scales, $r_p <$ 20 kpc. We obtain a $3\sigma$ detection of H$\alpha$ + [N{\small II}] emission in the 50 to 100 kpc $r_p$ bin. The mean emission flux within this bin is $(1.10 \pm 0.35) \times 10^{-20}$ erg cm$^{-2}$ s$^{-1}$ \AA$^{-1}$, which corresponds to $1.87 \times 10^{-20}$ erg cm$^{-2}$ s$^{-1}$ arcsec$^{-2}$ or 0.0033 Rayleigh. This detection is 34 times fainter than a previous strict limit obtained using deep narrow-band imaging. The faintness of the signal demonstrates why it has been so difficult to trace recombination radiation out to large radii around galaxies. This signal, combined with published estimates of n$_{\rm H}$, lead us to estimate the temperature of the gas to be 12,000 K, consistent with independent empirical estimates based on metal ion absorption lines and expectations from numerical simulations.

One of the most demanding tasks in astronomical image processing---in terms of precision---is the centroiding of stars. Upcoming large surveys are going to take images of billions of point sources, including many faint stars, with short exposure times. Real-time estimation of the centroids of stars is crucial for real-time PSF estimation, and maximal precision is required for measurements of proper motion. The fundamental Cram\'{e}r-Rao lower bound sets a limit on the root-mean-squared-error achievable by optimal estimators. In this work, we aim to compare the performance of various centroiding methods, in terms of saturating the bound, when they are applied to relatively low signal-to-noise ratio unsaturated stars assuming zero-mean constant Gaussian noise. In order to make this comparison, we present the ratio of the root-mean-squared-errors of these estimators to their corresponding Cram\'{e}r-Rao bound as a function of the signal-to-noise ratio and the full-width at half-maximum of faint stars. We discuss two general circumstances in centroiding of faint stars: (i) when we have a good estimate of the PSF, (ii) when we do not know the PSF. In the case that we know the PSF, we show that a fast polynomial centroiding after smoothing the image by the PSF can be as efficient as the maximum-likelihood estimator at saturating the bound. In the case that we do not know the PSF, we demonstrate that although polynomial centroiding is not as optimal as PSF profile fitting, it comes very close to saturating the Cram\'{e}r-Rao lower bound in a wide range of conditions. We also show that the moment-based method of center-of-light never comes close to saturating the bound, and thus it does not deliver reliable estimates of centroids.

The Kepler Mission has discovered thousands of exoplanets and revolutionized our understanding of their population. This large, homogeneous catalog of discoveries has enabled rigorous studies of the occurrence rate of exoplanets and planetary systems as a function of their physical properties. However, transit surveys like Kepler are most sensitive to planets with orbital periods much shorter than the orbital periods of Jupiter and Saturn, the most massive planets in our Solar System. To address this deficiency, we perform a fully automated search for long-period exoplanets with only one or two transits in the archival Kepler light curves. When applied to the $\sim 40,000$ brightest Sun-like target stars, this search produces 16 long-period exoplanet candidates. Of these candidates, 6 are novel discoveries and 5 are in systems with inner short-period transiting planets. Since our method involves no human intervention, we empirically characterize the detection efficiency of our search. Based on these results, we measure the average occurrence rate of exoplanets smaller than Jupiter with orbital periods in the range 2-25 years to be $2.0\pm0.7$ planets per Sun-like star.

The orbits, atmospheric parameters, chemical abundances, and ages of individual stars in the Milky Way provide the most comprehensive illustration of galaxy formation available. The Tycho-Gaia Astrometric Solution (TGAS) will deliver astrometric parameters for the largest ever sample of Milky Way stars, though its full potential cannot be realized without the addition of complementary spectroscopy. Among existing spectroscopic surveys, the RAdial Velocity Experiment (RAVE) has the largest overlap with TGAS ($\gtrsim$200,000 stars). We present a data-driven re-analysis of 520,781 RAVE spectra using The Cannon. For red giants, we build our model using high-fidelity APOGEE stellar parameters and abundances for stars that overlap with RAVE. For main-sequence and sub-giant stars, our model uses stellar parameters from the K2/EPIC. We derive and validate effective temperature $T_{\rm eff}$, surface gravity $\log{g}$, and chemical abundances of up to seven elements (O, Mg, Al, Si, Ca, Fe, Ni). We report a total of 1,685,851 elemental abundances with a typical precision of 0.07 dex, a substantial improvement over previous RAVE data releases. The synthesis of RAVE-on and TGAS is the most powerful data set for chemo-dynamic analyses of the Milky Way ever produced.

Chemical tagging promises to use detailed abundance measurements to identify spatially separated stars that were in fact born together (in the same molecular cloud), long ago. This idea has not yielded much practical success, presumably because of the noise and incompleteness in chemical-abundance measurements. We have succeeded in substantially improving spectroscopic measurements with The Cannon, which has now delivered 15 individual abundances for ~100,000 stars observed as part of the APOGEE spectroscopic survey, with precisions around 0.04 dex. We test the chemical-tagging hypothesis by looking at clusters in abundance space and confirming that they are clustered in phase space. We identify (by the k-means algorithm) overdensities of stars in the 15-dimensional chemical-abundance space delivered by The Cannon, and plot the associated stars in phase space. We use only abundance-space information (no positional information) to identify stellar groups. We find that clusters in abundance space are indeed clusters in phase space. We recover some known phase-space clusters and find other interesting structures. This is the first-ever project to identify phase-space structures at survey-scale by blind search purely in abundance space; it verifies the precision of the abundance measurements delivered by The Cannon; the prospects for future data sets appear very good.

We present the Bayesian Extinction And Stellar Tool (BEAST), a probabilistic approach to modeling the dust extinguished photometric spectral energy distribution of an individual star while accounting for observational uncertainties common to large resolved star surveys. Given a set of photometric measurements and an observational uncertainty model, the BEAST infers the physical properties of the stellar source using stellar evolution and atmosphere models and constrains the line of sight extinction using a newly developed mixture model that encompasses the full range of dust extinction curves seen in the Local Group. The BEAST is specifically formulated for use with large multi-band surveys of resolved stellar populations. Our approach accounts for measurement uncertainties and any covariance between them due to stellar crowding (both systematic biases and uncertainties in the bias) and absolute flux calibration, thereby incorporating the full information content of the measurement. We illustrate the accuracy and precision possible with the BEAST using data from the Panchromatic Hubble Andromeda Treasury. While the BEAST has been developed for this survey, it can be easily applied to similar existing and planned resolved star surveys.

We present AGNfitter, a publicly available open-source algorithm implementing a fully Bayesian Markov Chain Monte Carlo method to fit the spectral energy distributions (SEDs) of active galactic nuclei (AGN) from the sub-mm to the UV, allowing one to robustly disentangle the physical processes responsible for their emission. AGNfitter makes use of a large library of theoretical, empirical, and semi-empirical models to characterize both the nuclear and host galaxy emission simultaneously. The model consists of four physical emission components: an accretion disk, a torus of AGN heated dust, stellar populations, and cold dust in star forming regions. AGNfitter determines the posterior distributions of numerous parameters that govern the physics of AGN with a fully Bayesian treatment of errors and parameter degeneracies, allowing one to infer integrated luminosities, dust attenuation parameters, stellar masses, and star formation rates. We tested AGNfitter's performace on real data by fitting the SEDs of a sample of 714 X-ray selected AGN from the XMM-COSMOS survey, spectroscopically classified as Type1 (unobscured) and Type2 (obscured) AGN by their optical-UV emission lines. We find that two independent model parameters, namely the reddening of the accretion disk and the column density of the dusty torus, are good proxies for AGN obscuration, allowing us to develop a strategy for classifying AGN as Type1 or Type2, based solely on an SED-fitting analysis. Our classification scheme is in excellent agreement with the spectroscopic classification, giving a completeness fraction of $\sim 86\%$ and $\sim 70\%$, and an efficiency of $\sim 80\%$ and $\sim 77\%$, for Type1 and Type2 AGNs, respectively.

Stellar spectra depend on the stellar parameters and on dozens of photospheric elemental abundances. Simultaneous fitting of these $\mathcal{N}\sim 10-40$ model labels to observed spectra has been deemed unfeasible, because the number of ab initio spectral model grid calculations scales exponentially with $\mathcal{N}$. We suggest instead the construction of a polynomial spectral model (PSM) of order $\mathcal{O}$ for the model flux at each wavelength. Building this approximation requires a minimum of only ${\mathcal{N}+\mathcal{O}\choose\mathcal{O}}$ calculations: e.g. a quadratic spectral model ($\mathcal{O}=2$) to fit $\mathcal{N}=20$ labels simultaneously, can be constructed from as few as $231$ ab initio spectral model calculations; in practice, a somewhat larger number ($\sim 300-1000$) of randomly chosen models lead to a better performing PSM. Such a PSM can be a good approximation only over a portion of label space, which will vary case by case. Yet, taking the APOGEE survey as an example, a single quadratic PSM provides a remarkably good approximation to the exact ab initio spectral models across much of this survey: for random labels within that survey the PSM approximates the flux to within $10^{-3}$, and recovers the abundances to within $\sim 0.02$ dex rms of the exact models. This enormous speed-up enables the simultaneous many-label fitting of spectra with computationally expensive ab initio models for stellar spectra, such as non-LTE models. A PSM also enables the simultaneous fitting of observational parameters, such as the spectrum's continuum or line-spread function.

Astronomical observations are affected by several kinds of noise, each with its own causal source; there is photon noise, stochastic source variability, and residuals coming from imperfect calibration of the detector or telescope. The precision of NASA Kepler photometry for exoplanet science---the most precise photometric measurements of stars ever made---appears to be limited by unknown or untracked variations in spacecraft pointing and temperature, and unmodeled stellar variability. Here we present the Causal Pixel Model (CPM) for Kepler data, a data-driven model intended to capture variability but preserve transit signals. The CPM works at the pixel level so that it can capture very fine-grained information about the variation of the spacecraft. The CPM predicts each target pixel value from a large number of pixels of other stars sharing the instrument variabilities while not containing any information on possible transits in the target star. In addition, we use the target star's future and past (auto-regression). By appropriately separating, for each data point, the data into training and test sets, we ensure that information about any transit will be perfectly isolated from the model. The method has four hyper-parameters (the number of predictor stars, the auto-regressive window size, and two L2-regularization amplitudes for model components), which we set by cross-validation. We determine a generic set of hyper-parameters that works well for most of the stars and apply the method to a corresponding set of target stars. We find that we can consistently outperform (for the purposes of exoplanet detection) the Kepler Pre-search Data Conditioning (PDC) method for exoplanet discovery.

Several long, dynamically cold stellar streams have been observed around the Milky Way Galaxy, presumably formed from the tidal disruption of globular clusters. In integrable potentials---where all orbits are regular---tidal debris phase-mixes close to the orbit of the progenitor system. However, the Milky Way's dark matter halo is expected not to be fully integrable; an appreciable fraction of orbits will be chaotic. This paper examines the influence of chaos on the phase-space morphology of cold tidal streams. Streams even in weakly chaotic regions look very different from those in regular regions. We find that streams can be sensitive to chaos on a much shorter time-scale than any standard prediction (from the Lyapunov or frequency-diffusion times). For example, on a weakly chaotic orbit with a chaotic timescale predicted to be $>$1000 orbital periods ($>$1000 Gyr), the resulting stellar stream is, after just a few 10's of orbits, substantially more diffuse than any formed on a nearby but regular orbit. We find that the enhanced diffusion of the stream stars can be understood by looking at the variance in orbital frequencies of orbit ensembles centered around the parent (progenitor) orbit. Our results suggest that long, cold streams around our Galaxy must exist only on regular (or very nearly regular) orbits; they potentially provide a map of the regular regions of the Milky Way potential. This suggests a promising new direction for the use of tidal streams to constrain the distribution of dark matter around our Galaxy.

We have shown that data-driven models are effective for inferring physical attributes of stars (labels; Teff, logg, [M/H]) from spectra, even when the signal-to-noise ratio is low. Here we explore whether this is possible when the dimensionality of the label space is large (Teff, logg, and 15 abundances: C, N, O, Na, Mg, Al, Si, S, K, Ca, Ti, V, Mn, Fe, Ni) and the model is non-linear in its response to abundance and parameter changes. We adopt ideas from compressed sensing to limit overall model complexity while retaining model freedom. The model is trained with a set of 12,681 red-giant stars with high signal-to-noise spectroscopic observations and stellar parameters and abundances taken from the APOGEE Survey. We find that we can successfully train and use a model with 17 stellar labels. Validation shows that the model does a good job of inferring all 17 labels (typical abundance precision is 0.04 dex), even when we degrade the signal-to-noise by discarding ~50% of the observing time. The model dependencies make sense: the spectral derivatives with respect to abundances correlate with known atomic lines, and we identify elements belonging to atomic lines that were previously unknown. We recover (anti-)correlations in abundance labels for globular cluster stars, consistent with the literature. However we find the intrinsic spread in globular cluster abundances is 3--4 times smaller than previously reported. We deliver 17 labels with associated errors for 87,563 red giant stars, as well as open-source code to extend this work to other spectroscopic surveys.

$K2$'s Campaign 9 ($K2$C9) will conduct a $\sim$3.7 deg$^{2}$ survey toward the Galactic bulge from 7/April through 1/July of 2016 that will leverage the spatial separation between $K2$ and the Earth to facilitate measurement of the microlens parallax $\pi_{\rm E}$ for $\gtrsim$127 microlensing events. These will include several that are planetary in nature as well as many short-timescale microlensing events, which are potentially indicative of free-floating planets (FFPs). These satellite parallax measurements will in turn allow for the direct measurement of the masses of and distances to the lensing systems. In this white paper we provide an overview of the $K2$C9 space- and ground-based microlensing survey. Specifically, we detail the demographic questions that can be addressed by this program, including the frequency of FFPs and the Galactic distribution of exoplanets, the observational parameters of $K2$C9, and the array of resources dedicated to concurrent observations. Finally, we outline the avenues through which the larger community can become involved, and generally encourage participation in $K2$C9, which constitutes an important pathfinding mission and community exercise in anticipation of $WFIRST$.

The Second Workshop on Extreme Precision Radial Velocities defined circa 2015 the state of the art Doppler precision and identified the critical path challenges for reaching 10 cm/s measurement precision. The presentations and discussion of key issues for instrumentation and data analysis and the workshop recommendations for achieving this precision are summarized here. Beginning with the HARPS spectrograph, technological advances for precision radial velocity measurements have focused on building extremely stable instruments. To reach still higher precision, future spectrometers will need to produce even higher fidelity spectra. This should be possible with improved environmental control, greater stability in the illumination of the spectrometer optics, better detectors, more precise wavelength calibration, and broader bandwidth spectra. Key data analysis challenges for the precision radial velocity community include distinguishing center of mass Keplerian motion from photospheric velocities, and the proper treatment of telluric contamination. Success here is coupled to the instrument design, but also requires the implementation of robust statistical and modeling techniques. Center of mass velocities produce Doppler shifts that affect every line identically, while photospheric velocities produce line profile asymmetries with wavelength and temporal dependencies that are different from Keplerian signals. Exoplanets are an important subfield of astronomy and there has been an impressive rate of discovery over the past two decades. Higher precision radial velocity measurements are required to serve as a discovery technique for potentially habitable worlds and to characterize detections from transit missions. The future of exoplanet science has very different trajectories depending on the precision that can ultimately be achieved with Doppler measurements.

We present an algorithm capable of detecting diffuse, dim sources of any size in an astronomical image. These sources often defeat traditional methods for source finding, which expand regions around points of high intensity. Extended sources often have no bright points and are only detectable when viewed as a whole, so a more sophisticated approach is required. Our algorithm operates at all scales simultaneously by considering a tree of nested candidate bounding boxes, and inverts a hierarchical Bayesian generative model to obtain the probability of sources existing at given locations and sizes. This model naturally accommodates the detection of nested sources, and no prior knowledge of the distribution of a source, or even the background, is required. The algorithm scales nearly linear with the number of pixels making it feasible to run on large images, and requires minimal parameter tweaking to be effective. We demonstrate the algorithm on several types of astronomical and artificial images.

The mass of a star is arguably its most fundamental parameter. For red giant stars, tracers luminous enough to be observed across the Galaxy, mass implies a stellar evolution age. It has proven to be extremely difficult to infer ages and masses directly from red giant spectra using existing methods. From the KEPLER and APOGEE surveys, samples of several thousand stars exist with high-quality spectra and asteroseismic masses. Here we show that from these data we can build a data-driven spectral model using The Cannon, which can determine stellar masses to $\sim$ 0.07 dex from APOGEE DR12 spectra of red giants; these imply age estimates accurate to $\sim$ 0.2 dex (40 percent). We show that The Cannon constrains these ages foremost from spectral regions with CN absorption lines, elements whose surface abundances reflect mass-dependent dredge-up. We deliver an unprecedented catalog of 80,000 giants (including 20,000 red-clump stars) with mass and age estimates, spanning the entire disk (from the Galactic center to R $\sim$ 20 kpc). We show that the age information in the spectra is not simply a corollary of the birth-material abundances [Fe/H] and [$\alpha$/Fe], and that even within a mono-abundance population of stars, there are age variations that vary sensibly with Galactic position. Such stellar age constraints across the Milky Way open up new avenues in Galactic archeology.

In area and depth, the Pan-STARRS1 (PS1) 3$\pi$ survey is unique among many-epoch, multi-band surveys and has enormous potential for all-sky identification of variable sources. PS1 has observed the sky typically seven times in each of its five bands ($grizy$) over 3.5 years, but unlike SDSS not simultaneously across the bands. Here we develop a new approach for quantifying statistical properties of non-simultaneous, sparse, multi-color lightcurves through light-curve structure functions, effectively turning PS1 into a $\sim 35$-epoch survey. We use this approach to estimate variability amplitudes and timescales $(\omega_r, \tau)$ for all point-sources brighter than $r_{\mathrm{P1}}=21.5$ mag in the survey. With PS1 data on SDSS Stripe 82 as ``ground truth", we use a Random Forest Classifier to identify QSOs and RR Lyrae based on their variability and their mean PS1 and WISE colors. We find that, aside from the Galactic plane, QSO and RR Lyrae samples of purity $\sim$75\% and completeness $\sim$92\% can be selected. On this basis we have identified a sample of $\sim 1,000,000$ QSO candidates, as well as an unprecedentedly large and deep sample of $\sim$150,000 RR Lyrae candidates with distances from $\sim$10 kpc to $\sim$120 kpc. Within the Draco dwarf spheroidal, we demonstrate a distance precision of 6\% for RR Lyrae candidates. We provide a catalog of all likely variable point sources and likely QSOs in PS1, a total of $25.8\times 10^6$ sources.

Mapping Nearby Galaxies at Apache Point Observatory (MaNGA), one of three core programs in the Sloan Digital Sky Survey-IV (SDSS-IV), is an integral-field spectroscopic (IFS) survey of roughly 10,000 nearby galaxies. It employs dithered observations using 17 hexagonal bundles of 2 arcsec fibers to obtain resolved spectroscopy over a wide wavelength range of 3,600-10,300A. To map the internal variations within each galaxy, we need to perform accurate {\it spectral surface photometry}, which is to calibrate the specific intensity at every spatial location sampled by each individual aperture element of the integral field unit. The calibration must correct only for the flux loss due to atmospheric throughput and the instrument response, but not for losses due to the finite geometry of the fiber aperture. This requires the use of standard star measurements to strictly separate these two flux loss factors (throughput versus geometry), a difficult challenge with standard single-fiber spectroscopy techniques due to various practical limitations. Therefore, we developed a technique for spectral surface photometry using multiple small fiber-bundles targeting standard stars simultaneously with galaxy observations. We discuss the principles of our approach and how they compare to previous efforts, and we demonstrate the precision and accuracy achieved. MaNGA's relative calibration between the wavelengths of H$\alpha$ and H$\beta$ has a root-mean-square (RMS) of 1.7%, while that between [NII] $\lambda$6583A and [OII] $\lambda$3727A has an RMS of 4.7%. Using extinction-corrected star formation rates and gas-phase metallicities as an illustration, this level of precision guarantees that flux calibration errors will be sub-dominant when estimating these quantities. The absolute calibration is better than 5% for more than 89% of MaNGA's wavelength range.

Tidal streams of globular clusters are ideal tracers of the Galactic gravitational potential. Compared to the few known, complex and diffuse dwarf-galaxy streams, they are kinematically cold, have thin morphologies and are abundant in the halo of the Milky Way. Their coldness and thinness in combination with potential epicyclic substructure in the vicinity of the stream progenitor turns them into high-precision scales. With the example of Palomar 5, we demonstrate how modeling of a globular cluster stream allows us to simultaneously measure the properties of the disrupting globular cluster, its orbital motion, and the gravitational potential of the Milky Way.

We map the distribution of dust in M31 at 25pc resolution, using stellar photometry from the Panchromatic Hubble Andromeda Treasury. We develop a new mapping technique that models the NIR color-magnitude diagram (CMD) of red giant branch (RGB) stars. The model CMDs combine an unreddened foreground of RGB stars with a reddened background population viewed through a log-normal column density distribution of dust. Fits to the model constrain the median extinction, the width of the extinction distribution, and the fraction of reddened stars. The resulting extinction map has >4 times better resolution than maps of dust emission, while providing a more direct measurement of the dust column. There is superb morphological agreement between the new map and maps of the extinction inferred from dust emission by Draine et al. 2014. However, the widely-used Draine & Li (2007) dust models overpredict the observed extinction by a factor of ~2.5, suggesting that M31's true dust mass is lower and that dust grains are significantly more emissive than assumed in Draine et al. (2014). The discrepancy we identify is consistent with similar findings in the Milky Way by the Planck Collaboration (2015), but has a more complex dependence on parameters from the Draine & Li (2007) dust models. We also show that the discrepancy with the Draine et al. (2014) map is lowest where the interstellar radiation field has a harder spectrum than average. We discuss possible improvements to the CMD dust mapping technique, and explore further applications.

We present a modular, extensible likelihood framework for spectroscopic inference based on synthetic model spectra. The subtraction of an imperfect model from a continuously sampled spectrum introduces covariance between adjacent datapoints (pixels) into the residual spectrum. For the high signal-to-noise data with large spectral range that is commonly employed in stellar astrophysics, that covariant structure can lead to dramatically underestimated parameter uncertainties (and, in some cases, biases). We construct a likelihood function that accounts for the structure of the covariance matrix, utilizing the machinery of Gaussian process kernels. This framework specifically address the common problem of mismatches in model spectral line strengths (with respect to data) due to intrinsic model imperfections (e.g., in the atomic/molecular databases or opacity prescriptions) by developing a novel local covariance kernel formalism that identifies and self-consistently downweights pathological spectral line "outliers." By fitting many spectra in a hierarchical manner, these local kernels provide a mechanism to learn about and build data-driven corrections to synthetic spectral libraries. An open-source software implementation of this approach is available at http://iancze.github.io/Starfish, including a sophisticated probabilistic scheme for spectral interpolation when using model libraries that are sparsely sampled in the stellar parameters. We demonstrate some salient features of the framework by fitting the high resolution $V$-band spectrum of WASP-14, an F5 dwarf with a transiting exoplanet, and the moderate resolution $K$-band spectrum of Gliese 51, an M5 field dwarf.

The extended Kepler mission, K2, is now providing photometry of new fields every three months in a search for transiting planets. In a recent study, Foreman-Mackey and collaborators presented a list of 36 planet candidates orbiting 31 stars in K2 Campaign 1. In this contribution, we present stellar and planetary properties for all systems. We combine ground-based seeing-limited survey data and adaptive optics imaging with an automated transit analysis scheme to validate 21 candidates as planets, 17 for the first time, and identify 6 candidates as likely false positives. Of particular interest is K2-18 (EPIC 201912552), a bright (K=8.9) M2.8 dwarf hosting a 2.23 \pm 0.25 R_Earth planet with T_eq = 272 \pm 15 K and an orbital period of 33 days. We also present two new open-source software packages which enable this analysis. The first, isochrones, is a flexible tool for fitting theoretical stellar models to observational data to determine stellar properties using a nested sampling scheme to capture the multimodal nature of the posterior distributions of the physical parameters of stars that may plausibly be evolved. The second is vespa, a new general-purpose procedure to calculate false positive probabilities and statistically validate transiting exoplanets.

New spectroscopic surveys offer the promise of consistent stellar parameters and abundances ('stellar labels') for hundreds of thousands of stars in the Milky Way: this poses a formidable spectral modeling challenge. In many cases, there is a sub-set of reference objects for which the stellar labels are known with high(er) fidelity. We take advantage of this with The Cannon, a new data-driven approach for determining stellar labels from spectroscopic data. The Cannon learns from the 'known' labels of reference stars how the continuum-normalized spectra depend on these labels by fitting a flexible model at each wavelength; then, The Cannon uses this model to derive labels for the remaining survey stars. We illustrate The Cannon by training the model on only 542 stars in 19 clusters as reference objects, with Teff, log g and [Fe/H] as the labels, and then applying it to the spectra of 56,000 stars from APOGEE DR10. The Cannon is very accurate. Its stellar labels compare well to the stars for which APOGEE pipeline (ASPCAP) labels are provided in DR10, with rms differences that are basically identical to the stated ASPCAP uncertainties. Beyond the reference labels, The Cannon makes no use of stellar models nor any line-list, but needs a set of reference objects that span label-space. The Cannon performs well at lower signal-to-noise, as it delivers comparably good labels even at one ninth the APOGEE observing time. We discuss the limitations of The Cannon and its future potential, particularly, to bring different spectroscopic surveys onto a consistent scale of stellar labels.

Neutron stars are a prime laboratory for testing physical processes under conditions of strong gravity, high density, and extreme magnetic fields. Among the zoo of neutron star phenomena, magnetars stand out for their bursting behaviour, ranging from extremely bright, rare giant flares to numerous, less energetic recurrent bursts. The exact trigger and emission mechanisms for these bursts are not known; favoured models involve either a crust fracture and subsequent energy release into the magnetosphere, or explosive reconnection of magnetic field lines. In the absence of a predictive model, understanding the physical processes responsible for magnetar burst variability is difficult. Here, we develop an empirical model that decomposes magnetar bursts into a superposition of small spike-like features with a simple functional form, where the number of model components is itself part of the inference problem. The cascades of spikes that we model might be formed by avalanches of reconnection, or crust rupture aftershocks. Using Markov Chain Monte Carlo (MCMC) sampling augmented with reversible jumps between models with different numbers of parameters, we characterise the posterior distributions of the model parameters and the number of components per burst. We relate these model parameters to physical quantities in the system, and show for the first time that the variability within a burst does not conform to predictions from ideas of self-organised criticality. We also examine how well the properties of the spikes fit the predictions of simplified cascade models for the different trigger mechanisms.

Photometry of stars from the K2 extension of NASA's Kepler mission is afflicted by systematic effects caused by small (few-pixel) drifts in the telescope pointing and other spacecraft issues. We present a method for searching K2 light curves for evidence of exoplanets by simultaneously fitting for these systematics and the transit signals of interest. This method is more computationally expensive than standard search algorithms but we demonstrate that it can be efficiently implemented and used to discover transit signals. We apply this method to the full Campaign 1 dataset and report a list of 36 planet candidates transiting 31 stars, along with an analysis of the pipeline performance and detection efficiency based on artificial signal injections and recoveries. For all planet candidates, we present posterior distributions on the properties of each system based strictly on the transit observables.

The third generation of the Sloan Digital Sky Survey (SDSS-III) took data from 2008 to 2014 using the original SDSS wide-field imager, the original and an upgraded multi-object fiber-fed optical spectrograph, a new near-infrared high-resolution spectrograph, and a novel optical interferometer. All the data from SDSS-III are now made public. In particular, this paper describes Data Release 11 (DR11) including all data acquired through 2013 July, and Data Release 12 (DR12) adding data acquired through 2014 July (including all data included in previous data releases), marking the end of SDSS-III observing. Relative to our previous public release (DR10), DR12 adds one million new spectra of galaxies and quasars from the Baryon Oscillation Spectroscopic Survey (BOSS) over an additional 3000 sq. deg of sky, more than triples the number of H-band spectra of stars as part of the Apache Point Observatory (APO) Galactic Evolution Experiment (APOGEE), and includes repeated accurate radial velocity measurements of 5500 stars from the Multi-Object APO Radial Velocity Exoplanet Large-area Survey (MARVELS). The APOGEE outputs now include measured abundances of 15 different elements for each star. In total, SDSS-III added 2350 sq. deg of ugriz imaging; 155,520 spectra of 138,099 stars as part of the Sloan Exploration of Galactic Understanding and Evolution 2 (SEGUE-2) survey; 2,497,484 BOSS spectra of 1,372,737 galaxies, 294,512 quasars, and 247,216 stars over 9376 sq. deg; 618,080 APOGEE spectra of 156,593 stars; and 197,040 MARVELS spectra of 5,513 stars. Since its first light in 1998, SDSS has imaged over 1/3 of the Celestial sphere in five bands and obtained over five million astronomical spectra.

We describe a method for removing the effect of confounders in order to reconstruct a latent quantity of interest. The method, referred to as half-sibling regression, is inspired by recent work in causal inference using additive noise models. We provide a theoretical justification and illustrate the potential of the method in a challenging astronomy application.

A number of problems in probability and statistics can be addressed using the multivariate normal (Gaussian) distribution. In the one-dimensional case, computing the probability for a given mean and variance simply requires the evaluation of the corresponding Gaussian density. In the $n$-dimensional setting, however, it requires the inversion of an $n \times n$ covariance matrix, $C$, as well as the evaluation of its determinant, $\det(C)$. In many cases, such as regression using Gaussian processes, the covariance matrix is of the form $C = \sigma^2 I + K$, where $K$ is computed using a specified covariance kernel which depends on the data and additional parameters (hyperparameters). The matrix $C$ is typically dense, causing standard direct methods for inversion and determinant evaluation to require $\mathcal O(n^3)$ work. This cost is prohibitive for large-scale modeling. Here, we show that for the most commonly used covariance functions, the matrix $C$ can be hierarchically factored into a product of block low-rank updates of the identity matrix, yielding an $\mathcal O (n\log^2 n) $ algorithm for inversion. More importantly, we show that this factorization enables the evaluation of the determinant $\det(C)$, permitting the direct calculation of probabilities in high dimensions under fairly broad assumptions on the kernel defining $K$. Our fast algorithm brings many problems in marginalization and the adaptation of hyperparameters within practical reach using a single CPU core. The combination of nearly optimal scaling in terms of problem size with high-performance computing resources will permit the modeling of previously intractable problems. We illustrate the performance of the scheme on standard covariance kernels.

We present first results from the third GRavitational lEnsing Accuracy Testing (GREAT3) challenge, the third in a sequence of challenges for testing methods of inferring weak gravitational lensing shear distortions from simulated galaxy images. GREAT3 was divided into experiments to test three specific questions, and included simulated space- and ground-based data with constant or cosmologically-varying shear fields. The simplest (control) experiment included parametric galaxies with a realistic distribution of signal-to-noise, size, and ellipticity, and a complex point spread function (PSF). The other experiments tested the additional impact of realistic galaxy morphology, multiple exposure imaging, and the uncertainty about a spatially-varying PSF; the last two questions will be explored in Paper II. The 24 participating teams competed to estimate lensing shears to within systematic error tolerances for upcoming Stage-IV dark energy surveys, making 1525 submissions overall. GREAT3 saw considerable variety and innovation in the types of methods applied. Several teams now meet or exceed the targets in many of the tests conducted (to within the statistical errors). We conclude that the presence of realistic galaxy morphology in simulations changes shear calibration biases by $\sim 1$ per cent for a wide range of methods. Other effects such as truncation biases due to finite galaxy postage stamps, and the impact of galaxy type as measured by the S\'{e}rsic index, are quantified for the first time. Our results generalize previous studies regarding sensitivities to galaxy size and signal-to-noise, and to PSF properties such as seeing and defocus. Almost all methods' results support the simple model in which additive shear biases depend linearly on PSF ellipticity.

We have undertaken the largest systematic study of the high-mass stellar initial mass function (IMF) to date using the optical color-magnitude diagrams (CMDs) of 85 resolved, young (4 Myr < t < 25 Myr), intermediate mass star clusters (10^3-10^4 Msun), observed as part of the Panchromatic Hubble Andromeda Treasury (PHAT) program. We fit each cluster's CMD to measure its mass function (MF) slope for stars >2 Msun. For the ensemble of clusters, the distribution of stellar MF slopes is best described by $\Gamma=+1.45^{+0.03}_{-0.06}$ with a very small intrinsic scatter. The data also imply no significant dependencies of the MF slope on cluster age, mass, and size, providing direct observational evidence that the measured MF represents the IMF. This analysis implies that the high-mass IMF slope in M31 clusters is universal with a slope ($\Gamma=+1.45^{+0.03}_{-0.06}$) that is steeper than the canonical Kroupa (+1.30) and Salpeter (+1.35) values. Using our inference model on select Milky Way (MW) and LMC high-mass IMF studies from the literature, we find $\Gamma_{\rm MW} \sim+1.15\pm0.1$ and $\Gamma_{\rm LMC} \sim+1.3\pm0.1$, both with intrinsic scatter of ~0.3-0.4 dex. Thus, while the high-mass IMF in the Local Group may be universal, systematics in literature IMF studies preclude any definitive conclusions; homogenous investigations of the high-mass IMF in the local universe are needed to overcome this limitation. Consequently, the present study represents the most robust measurement of the high-mass IMF slope to date. We have grafted the M31 high-mass IMF slope onto widely used sub-solar mass Kroupa and Chabrier IMFs and show that commonly used UV- and Halpha-based star formation rates should be increased by a factor of ~1.3-1.5 and the number of stars with masses >8 Msun are ~25% fewer than expected for a Salpeter/Kroupa IMF. [abridged]

Using the example of the tidal stream of the Milky Way globular cluster Palomar 5 (Pal 5), we demonstrate how observational data on streams can be efficiently reduced in dimensionality and modeled in a Bayesian framework. Our approach combines detection of stream overdensities by a Difference-of-Gaussians process with fast streakline models, a continuous likelihood function built from these models, and inference with MCMC. By generating $\approx10^7$ model streams, we show that the geometry of the Pal 5 debris yields powerful constraints on the solar position and motion, the Milky Way and Pal 5 itself. All 10 model parameters were allowed to vary over large ranges without additional prior information. Using only SDSS data and a few radial velocities from the literature, we find that the distance of the Sun from the Galactic Center is $8.30\pm0.25$ kpc, and the transverse velocity is $253\pm16$ km/s. Both estimates are in excellent agreement with independent measurements of these quantities. Assuming a standard disk and bulge model, we determine the Galactic mass within Pal 5's apogalactic radius of 19 kpc to be $(2.1\pm0.4)\times10^{11}$ M$_\odot$. Moreover, we find the potential of the dark halo with a flattening of $q_z = 0.95^{+0.16}_{-0.12}$ to be essentially spherical within the radial range that is effectively probed by Pal 5. We also determine Pal 5's mass, distance and proper motion independently from other methods, which enables us to perform vital cross-checks. We conclude that with more observational data and by using additional prior information, the precision of this method can be significantly increased.

We report the first results from a survey for 1665, 1667, and 1720 MHz OH emission over a small region of the Outer Galaxy centered at $l \approx 105.0\deg , b \approx +1.0\deg$ . This sparse, high-sensitivity survey ($\Delta Ta \approx \Delta Tmb \approx 3.0 - 3.5$ mK rms in 0.55 km/s channels), was carried out as a pilot project with the Green Bank Telescope (GBT, FWHM $\approx 7.6'$) on a 3 X 9 grid at $0.5\deg$ spacing. The pointings chosen correspond with those of the existing $^{12}$CO(1-0) CfA survey of the Galaxy (FWHM $\approx 8.4'$). With 2-hr integrations, 1667 MHz OH emission was detected with the GBT at $\gtrsim 21$ of the 27 survey positions ($\geq 78\%$ ), confirming the ubiquity of molecular gas in the ISM as traced by this spectral line. With few exceptions, the main OH lines at 1665 and 1667 MHz appear in the ratio of 5:9 characteristic of LTE at our sensitivity levels. No OH absorption features are recorded in the area of the present survey, in agreement with the low levels of continuum background emission in this direction. At each pointing the OH emission appears in several components extending over a range of radial velocity and coinciding with well-known features of Galactic structure such as the Local Arm and the Perseus Arm. In contrast, little CO emission is seen in the survey area; less than half of the $\gtrsim 50$ identified OH components show detectable CO at the CfA sensitivity levels, and these are generally faint. There are no CO profiles without OH emission. With few exceptions, peaks in the OH profiles coincide with peaks in the GBT HI spectra (obtained concurrently, FWHM $8.9'$), although the converse is not true. We conclude that main-line OH emission is a promising tracer for the "dark molecular gas" in the Galaxy discovered earlier in Far-IR and gamma-ray emission. Further work is needed to establish the quantitative details of this connection.

We present a new method for constraining the Milky Way halo gravitational potential by simultaneously fitting multiple tidal streams. This method requires full three-dimensional positions and velocities for all stars to be fit, but does not require identification of any specific stream or determination of stream membership for any star. We exploit the principle that the action distribution of stream stars is most clustered when the potential used to calculate the actions is closest to the true potential. Clustering is quantified with the Kullback-Leibler Divergence (KLD), which also provides conditional uncertainties for our parameter estimates. We show, for toy Gaia-like data in a spherical isochrone potential, that maximizing the KLD of the action distribution relative to a smoother distribution recovers the true values of the potential parameters. The precision depends on the observational errors and the number of streams in the sample; using KIII giants as tracers, we measure the enclosed mass at the average radius of the sample stars accurate to 3% and precise to 20-40%. Recovery of the scale radius is precise to 25%, and is biased 50% high by the small galactocentric distance range of stars in our mock sample (1-25 kpc, or about three scale radii, with mean 6.5 kpc). About 15 streams, with at least 100 stars per stream, are needed to obtain upper and lower bounds on the enclosed mass and scale radius when observational errors are taken into account; 20-25 streams are required to stabilize the size of the confidence interval. If radial velocities are provided for stars out to 100 kpc (10 scale radii), all parameters can be determined with 10% accuracy and 20% precision (1.3% accuracy in the case of the enclosed mass), underlining the need for ground-based spectroscopic follow-up to complete the radial velocity catalog for faint halo stars observed by Gaia.

The Ly$\alpha$ forest transmission probability distribution function (PDF) is an established probe of the intergalactic medium (IGM) astrophysics, especially the temperature-density relationship of the IGM. We measure the transmission PDF from 3393 Baryon Oscillations Spectroscopic Survey (BOSS) quasars from SDSS Data Release 9, and compare with mock spectra that include careful modeling of the noise, continuum, and astrophysical uncertainties. The BOSS transmission PDFs, measured at $\langle z \rangle = [2.3,2.6,3.0]$, are compared with PDFs created from mock spectra drawn from a suite of hydrodynamical simulations that sample the IGM temperature-density relationship, $\gamma$, and temperature at mean-density, $T_0$, where $T(\Delta) = T_0 \Delta^{\gamma-1}$. We find that a significant population of partial Lyman-limit systems with a column-density distribution slope of $\beta_\mathrm{pLLS} \sim -2$ are required to explain the data at the low-transmission end of transmission PDF, while uncertainties in the mean Ly$\alpha$ forest transmission affect the high-transmission end. After modelling the LLSs and marginalizing over mean-transmission uncertainties, we find that $\gamma=1.6$ best describes the data over our entire redshift range, although constraints on $T_0$ are affected by systematic uncertainties. Within our model framework, isothermal or inverted temperature-density relationships ($\gamma \leq 1$) are disfavored at a significance of over 4$\sigma$, although this could be somewhat weakened by cosmological and astrophysical uncertainties that we did not model.

Point estimators for the shearing of galaxy images induced by gravitational lensing involve a complex inverse problem in the presence of noise, pixelization, and model uncertainties. We present a probabilistic forward modeling approach to gravitational lensing inference that has the potential to mitigate the biased inferences in most common point estimators and is practical for upcoming lensing surveys. The first part of our statistical framework requires specification of a likelihood function for the pixel data in an imaging survey given parameterized models for the galaxies in the images. We derive the lensing shear posterior by marginalizing over all intrinsic galaxy properties that contribute to the pixel data (i.e., not limited to galaxy ellipticities) and learn the distributions for the intrinsic galaxy properties via hierarchical inference with a suitably flexible conditional probabilitiy distribution specification. We use importance sampling to separate the modeling of small imaging areas from the global shear inference, thereby rendering our algorithm computationally tractable for large surveys. With simple numerical examples we demonstrate the improvements in accuracy from our importance sampling approach, as well as the significance of the conditional distribution specification for the intrinsic galaxy properties when the data are generated from an unknown number of distinct galaxy populations with different morphological characteristics.

We present photometry of images from the Wide-Field Infrared Survey Explorer (WISE; Wright et al. 2010) of over 400 million sources detected by the Sloan Digital Sky Survey (SDSS; York et al. 2000). We use a "forced photometry" technique, using measured SDSS source positions, star-galaxy separation and galaxy profiles to define the sources whose fluxes are to be measured in the WISE images. We perform photometry with The Tractor image modeling code, working on our "unWISE" coaddds and taking account of the WISE point-spread function and a noise model. The result is a measurement of the flux of each SDSS source in each WISE band. Many sources have little flux in the WISE bands, so often the measurements we report are consistent with zero. However, for many sources we get three- or four-sigma measurements; these sources would not be reported by the WISE pipeline and will not appear in the WISE catalog, yet they can be highly informative for some scientific questions. In addition, these small-signal measurements can be used in stacking analyses at catalog level. The forced photometry approach has the advantage that we measure a consistent set of sources between SDSS and WISE, taking advantage of the resolution and depth of the SDSS images to interpret the WISE images; objects that are resolved in SDSS but blended together in WISE still have accurate measurements in our photometry. Our results, and the code used to produce them, are publicly available at http://unwise.me.

No true extrasolar Earth analog is known. Hundreds of planets have been found around Sun-like stars that are either Earth-sized but on shorter periods, or else on year-long orbits but somewhat larger. Under strong assumptions, exoplanet catalogs have been used to make an extrapolated estimate of the rate at which Sun-like stars host Earth analogs. These studies are complicated by the fact that every catalog is censored by non-trivial selection effects and detection efficiencies, and every property (period, radius, etc.) is measured noisily. Here we present a general hierarchical probabilistic framework for making justified inferences about the population of exoplanets, taking into account survey completeness and, for the first time, observational uncertainties. We are able to make fewer assumptions about the distribution than previous studies; we only require that the occurrence rate density be a smooth function of period and radius (employing a Gaussian process). By applying our method to synthetic catalogs, we demonstrate that it produces more accurate estimates of the whole population than standard procedures based on weighting by inverse detection efficiency. We apply the method to an existing catalog of small planet candidates around G dwarf stars (Petigura et al. 2013). We confirm a previous result that the radius distribution changes slope near Earth's radius. We find that the rate density of Earth analogs is about 0.02 (per star per natural logarithmic bin in period and radius) with large uncertainty. This number is much smaller than previous estimates made with the same data but stronger assumptions.

High dynamic-range imagers aim to block out or null light from a very bright primary star to make it possible to detect and measure far fainter companions; in real systems a small fraction of the primary light is scattered, diffracted, and unocculted. We introduce S4, a flexible data-driven model for the unocculted (and highly speckled) light in the P1640 spectroscopic coronograph. The model uses Principal Components Analysis (PCA) to capture the spatial structure and wavelength dependence of the speckles but not the signal produced by any companion. Consequently, the residual typically includes the companion signal. The companion can thus be found by filtering this error signal with a fixed companion model. The approach is sensitive to companions that are of order a percent of the brightness of the speckles, or up to $10^{-7}$ times the brightness of the primary star. This outperforms existing methods by a factor of 2-3 and is close to the shot-noise physical limit.

We present a new method for determining the Galactic gravitational potential based on forward modeling of tidal stellar streams. We use this method to test the performance of smooth and static analytic potentials in representing realistic dark matter halos, which have substructure and are continually evolving by accretion. Our FAST-FORWARD method uses a Markov Chain Monte Carlo algorithm to compare, in 6D phase space, an "observed" stream to models created in trial analytic potentials. We analyze a large sample of streams evolved in the Via Lactea II (VL2) simulation, which represents a realistic Galactic halo potential. The recovered potential parameters are in agreement with the best fit to the global, present-day VL2 potential. However, merely assuming an analytic potential limits the dark matter halo mass measurement to an accuracy of 5 to 20%, depending on the choice of analytic parametrization. Collectively, mass estimates using streams from our sample reach this fundamental limit, but individually they can be highly biased. Individual streams can both under- and overestimate the mass, and the bias is progressively worse for those with smaller perigalacticons, motivating the search for tidal streams at galactocentric distances larger than 70 kpc. We estimate that the assumption of a static and smooth dark matter potential in modeling of the GD-1 and Pal5-like streams introduces an error of up to 50% in the Milky Way mass estimates.

We describe a system that builds a high dynamic-range and wide-angle image of the night sky by combining a large set of input images. The method makes use of pixel-rank information in the individual input images to improve a "consensus" pixel rank in the combined image. Because it only makes use of ranks and the complexity of the algorithm is linear in the number of images, the method is useful for large sets of uncalibrated images that might have undergone unknown non-linear tone mapping transformations for visualization or aesthetic reasons. We apply the method to images of the night sky (of unknown provenance) discovered on the Web. The method permits discovery of astronomical objects or features that are not visible in any of the input images taken individually. More importantly, however, it permits scientific exploitation of a huge source of astronomical images that would not be available to astronomical research without our automatic system.

The dark matter halo of the Milky Way is expected to be triaxial and filled with substructure. It is hoped that streams or shells of stars produced by tidal disruption of stellar systems will provide precise measures of the gravitational potential to test these predictions. We develop a method for inferring the Galactic potential with tidal streams based on the idea that the stream stars were once close in phase space. Our method can flexibly adapt to any form for the Galactic potential: it works in phase-space rather than action-space and hence relies neither on our ability to derive actions nor on the integrability of the potential. Our model is probabilistic, with a likelihood function and priors on the parameters. The method can properly account for finite observational uncertainties and missing data dimensions. We test our method on synthetic datasets generated from N-body simulations of satellite disruption in a static, multi-component Milky Way including a triaxial dark matter halo with observational uncertainties chosen to mimic current and near-future surveys of various stars. We find that with just four well-measured stream stars, we can infer properties of a triaxial potential with precisions of order 5-7 percent. Without proper motions we obtain 15 percent constraints on potential parameters and precisions around 25 percent for recovering missing phase-space coordinates. These results are encouraging for the eventual goal of using flexible, time-dependent potential models combined with larger data sets to unravel the detailed shape of the dark matter distribution around the Milky Way.

Recoiling supermassive black holes (SMBHs) are considered one plausible physical mechanism to explain high velocity shifts between narrow and broad emission lines sometimes observed in quasar spectra. If the sphere of influence of the recoiling SMBH is such that only the accretion disc is bound, the dusty torus would be left behind, hence the SED should then present distinctive features (i.e. a mid-infrared deficit). Here we present results from fitting the Spectral Energy Distributions (SEDs) of 32 Type-1 AGN with high velocity shifts between broad and narrow lines. The aim is to find peculiar properties in the multi-wavelength SEDs of such objects by comparing their physical parameters (torus and disc luminosity, intrinsic reddening, and size of the 12$\mu$m emitter) with those estimated from a control sample of $\sim1000$ \emph{typical} quasars selected from the Sloan Digital Sky Survey in the same redshift range. We find that all sources, with the possible exception of J1154+0134, analysed here present a significant amount of 12~$\mu$m emission. This is in contrast with a scenario of a SMBH displaced from the center of the galaxy, as expected for an undergoing recoil event.

The fully marginalized likelihood, or Bayesian evidence, is of great importance in probabilistic data analysis, because it is involved in calculating the posterior probability of a model or re-weighting a mixture of models conditioned on data. It is, however, extremely challenging to compute. This paper presents a geometric-path Monte Carlo method, inspired by multi-canonical Monte Carlo to evaluate the fully marginalized likelihood. We show that the algorithm is very fast and easy to implement and produces a justified uncertainty estimate on the fully marginalized likelihood. The algorithm performs efficiently on a trial problem and multi-companion model fitting for radial velocity data. For the trial problem, the algorithm returns the correct fully marginalized likelihood, and the estimated uncertainty is also consistent with the standard deviation of results from multiple runs. We apply the algorithm to the problem of fitting radial velocity data from HIP 88048 ($\nu$ Oph) and Gliese 581. We evaluate the fully marginalized likelihood of 1, 2, 3, and 4-companion models given data from HIP 88048 and various choices of prior distributions. We consider prior distributions with three different minimum radial velocity amplitude $K_{\mathrm{min}}$. Under all three priors, the 2-companion model has the largest marginalized likelihood, but the detailed values depend strongly on $K_{\mathrm{min}}$. We also evaluate the fully marginalized likelihood of 3, 4, 5, and 6-planet model given data from Gliese 581 and find that the fully marginalized likelihood of the 5-planet model is too close to that of the 6-planet model for us to confidently decide between them.

We present AGNfitter: a Markov Chain Monte Carlo algorithm developed to fit the spectral energy distributions (SEDs) of active galactic nuclei (AGN) with different physical models of AGN components. This code is well suited to determine in a robust way multiple parameters and their uncertainties, which quantify the physical processes responsible for the panchromatic nature of active galaxies and quasars. We describe the technicalities of the code and test its capabilities in the context of X-ray selected obscured AGN using multiwavelength data from the XMM-COSMOS survey.

The Sloan Digital Sky Survey (SDSS) has been in operation since 2000 April. This paper presents the tenth public data release (DR10) from its current incarnation, SDSS-III. This data release includes the first spectroscopic data from the Apache Point Observatory Galaxy Evolution Experiment (APOGEE), along with spectroscopic data from the Baryon Oscillation Spectroscopic Survey (BOSS) taken through 2012 July. The APOGEE instrument is a near-infrared R~22,500 300-fiber spectrograph covering 1.514--1.696 microns. The APOGEE survey is studying the chemical abundances and radial velocities of roughly 100,000 red giant star candidates in the bulge, bar, disk, and halo of the Milky Way. DR10 includes 178,397 spectra of 57,454 stars, each typically observed three or more times, from APOGEE. Derived quantities from these spectra (radial velocities, effective temperatures, surface gravities, and metallicities) are also included.DR10 also roughly doubles the number of BOSS spectra over those included in the ninth data release. DR10 includes a total of 1,507,954 BOSS spectra, comprising 927,844 galaxy spectra; 182,009 quasar spectra; and 159,327 stellar spectra, selected over 6373.2 square degrees.

This article offers a short guide to the steps scientists can take to ensure that their data and associated analyses continue to be of value and to be recognized. In just the past few years, hundreds of scholarly papers and reports have been written on questions of data sharing, data provenance, research reproducibility, licensing, attribution, privacy, and more, but our goal here is not to review that literature. Instead, we present a short guide intended for researchers who want to know why it is important to "care for and feed" data, with some practical advice on how to do that.

We introduce a stable, well tested Python implementation of the affine-invariant ensemble sampler for Markov chain Monte Carlo (MCMC) proposed by Goodman & Weare (2010). The code is open source and has already been used in several published projects in the astrophysics literature. The algorithm behind emcee has several advantages over traditional MCMC sampling methods and it has excellent performance as measured by the autocorrelation time (or function calls per independent sample). One major advantage of the algorithm is that it requires hand-tuning of only 1 or 2 parameters compared to $\sim N^2$ for a traditional algorithm in an N-dimensional parameter space. In this document, we describe the algorithm and the details of our implementation and API. Exploiting the parallelism of the ensemble method, emcee permits any user to take advantage of multiple CPU cores without extra effort. The code is available online at http://dan.iel.fm/emcee under the MIT License.

In today's mailing, Hogg et al. propose image modeling techniques to maintain 10-ppm-level precision photometry in Kepler data with only two working reaction wheels. While these results are relevant to many scientific goals for the repurposed mission, all modeling efforts so far have used a toy model of the Kepler telescope. Because the two-wheel performance of Kepler remains to be determined, we advocate for the consideration of an alternate strategy for a >1 year program that maximizes the science return from the "low-torque" fields across the ecliptic plane. Assuming we can reach the precision of the original Kepler mission, we expect to detect 800 new planet candidates in the first year of such a mission. Our proposed strategy has benefits for transit timing variation and transit duration variation studies, especially when considered in concert with the future TESS mission. We also expect to help address the first key science goal of Kepler: the frequency of planets in the habitable zone as a function of spectral type.

Kepler's immense photometric precision to date was maintained through satellite stability and precise pointing. In this white paper, we argue that image modeling--fitting the Kepler-downlinked raw pixel data--can vastly improve the precision of Kepler in pointing-degraded two-wheel mode. We argue that a non-trivial modeling effort may permit continuance of photometry at 10-ppm-level precision. We demonstrate some baby steps towards precise models in both data-driven (flexible) and physics-driven (interpretably parameterized) modes. We demonstrate that the expected drift or jitter in positions in the two-weel era will help with constraining calibration parameters. In particular, we show that we can infer the device flat-field at higher than pixel resolution; that is, we can infer pixel-to-pixel variations in intra-pixel sensitivity. These results are relevant to almost any scientific goal for the repurposed mission; image modeling ought to be a part of any two-wheel repurpose for the satellite. We make other recommendations for Kepler operations, but fundamentally advocate that the project stick with its core mission of finding and characterizing Earth analogs. [abridged]

Theoretically, bound binaries of massive black holes are expected as the natural outcome of mergers of massive galaxies. From the observational side, however, massive black hole binaries remain elusive. Velocity shifts between narrow and broad emission lines in quasar spectra are considered a promising observational tool to search for spatially unresolved, dynamically bound binaries. In this series of papers we investigate the nature of such candidates through analyses of their spectra, images and multi-wavelength spectral energy distributions. Here we investigate the properties of the optical spectra, including the evolution of the broad line profiles, of all the sources identified in our previous study. We find a diverse phenomenology of broad and narrow line luminosities, widths, shapes, ionization conditions and time variability, which we can broadly ascribe to 4 classes based on the shape of the broad line profiles: 1) Objects with bell-shaped broad lines with big velocity shifts (>1000 km/s) compared to their narrow lines show a variety of broad line widths and luminosities, modest flux variations over a few years, and no significant change in the broad line peak wavelength. 2) Objects with double-peaked broad emission lines tend to show very luminous and broadened lines, and little time variability. 3) Objects with asymmetric broad emission lines show a broad range of broad line luminosities and significant variability of the line profiles. 4) The remaining sources tend to show moderate to low broad line luminosities, and can be ascribed to diverse phenomena. We discuss the implications of our findings in the context of massive black hole binary searches.

We present and implement a probabilistic (Bayesian) method for producing catalogs from images of stellar fields. The method is capable of inferring the number of sources N in the image and can also handle the challenges introduced by noise, overlapping sources, and an unknown point spread function (PSF). The luminosity function of the stars can also be inferred even when the precise luminosity of each star is uncertain, via the use of a hierarchical Bayesian model. The computational feasibility of the method is demonstrated on two simulated images with different numbers of stars. We find that our method successfully recovers the input parameter values along with principled uncertainties even when the field is crowded. We also compare our results with those obtained from the SExtractor software. While the two approaches largely agree about the fluxes of the bright stars, the Bayesian approach provides more accurate inferences about the faint stars and the number of stars, particularly in the crowded case.

The best gravitational lenses for detecting distant galaxies are those with the largest mass concentrations and the most advantageous configurations of that mass along the line of sight. Our new method for finding such gravitational telescopes uses optical data to identify projected concentrations of luminous red galaxies (LRGs). LRGs are biased tracers of the underlying mass distribution, so lines of sight with the highest total luminosity in LRGs are likely to contain the largest total mass. We apply this selection technique to the Sloan Digital Sky Survey and identify the 200 fields with the highest total LRG luminosities projected within a 3.5' radius over the redshift range 0.1 < z < 0.7. The redshift and angular distributions of LRGs in these fields trace the concentrations of non-LRG galaxies. These fields are diverse; 22.5% contain one known galaxy cluster and 56.0% contain multiple known clusters previously identified in the literature. Thus, our results confirm that these LRGs trace massive structures and that our selection technique identifies fields with large total masses. These fields contain 2-3 times higher total LRG luminosities than most known strong-lensing clusters and will be among the best gravitational lensing fields for the purpose of detecting the highest redshift galaxies.

We performed an image search for "Comet Holmes," using the Yahoo Web search engine, on 2010 April 1. Thousands of images were returned. We astrometrically calibrated---and therefore vetted---the images using the Astrometry.net system. The calibrated image pointings form a set of data points to which we can fit a test-particle orbit in the Solar System, marginalizing over image dates and detecting outliers. The approach is Bayesian and the model is, in essence, a model of how comet astrophotographers point their instruments. In this work, we do not measure the position of the comet within each image, but rather use the celestial position of the whole image to infer the orbit. We find very strong probabilistic constraints on the orbit, although slightly off the JPL ephemeris, probably due to limitations of our model. Hyperparameters of the model constrain the reliability of date meta-data and where in the image astrophotographers place the comet; we find that ~70 percent of the meta-data are correct and that the comet typically appears in the central third of the image footprint. This project demonstrates that discoveries and measurements can be made using data of extreme heterogeneity and unknown provenance. As the size and diversity of astronomical data sets continues to grow, approaches like ours will become more essential. This project also demonstrates that the Web is an enormous repository of astronomical information; and that if an object has been given a name and photographed thousands of times by observers who post their images on the Web, we can (re-)discover it and infer its dynamical properties.

The PRIsm MUti-object Survey (PRIMUS) is a spectroscopic galaxy redshift survey to z~1 completed with a low-dispersion prism and slitmasks allowing for simultaneous observations of ~2,500 objects over 0.18 square degrees. The final PRIMUS catalog includes ~130,000 robust redshifts over 9.1 sq. deg. In this paper, we summarize the PRIMUS observational strategy and present the data reduction details used to measure redshifts, redshift precision, and survey completeness. The survey motivation, observational techniques, fields, target selection, slitmask design, and observations are presented in Coil et al 2010. Comparisons to existing higher-resolution spectroscopic measurements show a typical precision of sigma_z/(1+z)=0.005. PRIMUS, both in area and number of redshifts, is the largest faint galaxy redshift survey completed to date and is allowing for precise measurements of the relationship between AGNs and their hosts, the effects of environment on galaxy evolution, and the build up of galactic systems over the latter half of cosmic history.

We obtained spectra, in the wavelength range \lambda = 995 - 1769 nm, of all four known planets orbiting the star HR 8799. Using the suite of instrumentation known as Project 1640 on the Palomar 5-m Hale Telescope, we acquired data at two epochs. This allowed for multiple imaging detections of the companions and multiple extractions of low-resolution (R ~ 35) spectra. Data reduction employed two different methods of speckle suppression and spectrum extraction, both yielding results that agree. The spectra do not directly correspond to those of any known objects, although similarities with L and T-dwarfs are present, as well as some characteristics similar to planets such as Saturn. We tentatively identify the presence of CH_4 along with NH_3 and/or C_2H_2, and possibly CO_2 or HCN in varying amounts in each component of the system. Other studies suggested red colors for these faint companions, and our data confirm those observations. Cloudy models, based on previous photometric observations, may provide the best explanation for the new data presented here. Notable in our data is that these presumably co-eval objects of similar luminosity have significantly different spectra; the diversity of planets may be greater than previously thought. The techniques and methods employed in this paper represent a new capability to observe and rapidly characterize exoplanetary systems in a routine manner over a broad range of planet masses and separations. These are the first simultaneous spectroscopic observations of multiple planets in a planetary system other than our own.

We report a detection of the baryon acoustic oscillation (BAO) feature in the three-dimensional correlation function of the transmitted flux fraction in the \Lya forest of high-redshift quasars. The study uses 48,640 quasars in the redshift range $2.1\le z \le 3.5$ from the Baryon Oscillation Spectroscopic Survey (BOSS) of the third generation of the Sloan Digital Sky Survey (SDSS-III). At a mean redshift $z=2.3$, we measure the monopole and quadrupole components of the correlation function for separations in the range $20\hMpc<r<200\hMpc$. A peak in the correlation function is seen at a separation equal to $(1.01\pm0.03)$ times the distance expected for the BAO peak within a concordance $\Lambda$CDM cosmology. This first detection of the BAO peak at high redshift, when the universe was strongly matter dominated, results in constraints on the angular diameter distance $\da$ and the expansion rate $H$ at $z=2.3$ that, combined with priors on $H_0$ and the baryon density, require the existence of dark energy. Combined with constraints derived from Cosmic Microwave Background (CMB) observations, this result implies $H(z=2.3)=(224\pm8){\rm km\,s^{-1}Mpc^{-1}}$, indicating that the time derivative of the cosmological scale parameter $\dot{a}=H(z=2.3)/(1+z)$ is significantly greater than that measured with BAO at $z\sim0.5$. This demonstrates that the expansion was decelerating in the range $0.7<z<2.3$, as expected from the matter domination during this epoch. Combined with measurements of $H_0$, one sees the pattern of deceleration followed by acceleration characteristic of a dark-energy dominated universe.

Obtaining reliable, matched photometry for galaxies imaged by different observatories represents a key challenge in the era of wide-field surveys spanning more than several hundred square degrees. Methods such as flux fitting, profile fitting, and PSF homogenization followed by matched-aperture photometry are all computationally expensive. We present an alternative solution called "synthetic aperture photometry" that exploits galaxy profile fits in one band to efficiently model the observed, PSF-convolved light profile in other bands and predict the flux in arbitrarily sized apertures. Because aperture magnitudes are the most widely tabulated flux measurements in survey catalogs, producing synthetic aperture magnitudes (SYNMAGs) enables very fast matched photometry at the catalog level, without reprocessing imaging data. We make our code public and apply it to obtain matched photometry between SDSS ugriz and UKIDSS YJHK imaging, recovering red-sequence colors and photometric redshifts with a scatter and accuracy as good as if not better than FWHM-homogenized photometry from the GAMA Survey. Finally, we list some specific measurements that upcoming surveys could make available to facilitate and ease the use of SYNMAGs.

We present a probabilistic approach for inferring the parameters of the present day power-law stellar mass function (MF) of a resolved young star cluster. This technique (a) fully exploits the information content of a given dataset; (b) accounts for observational uncertainties in a straightforward way; (c) assigns meaningful uncertainties to the inferred parameters; (d) avoids the pitfalls associated with binning data; and (e) is applicable to virtually any resolved young cluster, laying the groundwork for a systematic study of the high mass stellar MF (M > 1 Msun). Using simulated clusters and Markov chain Monte Carlo sampling of the probability distribution functions, we show that estimates of the MF slope, {\alpha}, are unbiased and that the uncertainty, {\Delta}{\alpha}, depends primarily on the number of observed stars and stellar mass range they span, assuming that the uncertainties on individual masses and the completeness are well-characterized. Using idealized mock data, we compute the lower limit precision on {\alpha} and provide an analytic approximation for {\Delta}{\alpha} as a function of the observed number of stars and mass range. We find that ~ 3/4 of quoted literature uncertainties are smaller than the theoretical lower limit. By correcting these uncertainties to the theoretical lower limits, we find the literature studies yield <{\alpha}>=2.46 with a 1-{\sigma} dispersion of 0.35 dex. We verify that it is impossible for a power-law MF to obtain meaningful constraints on the upper mass limit of the IMF. We show that avoiding substantial biases in the MF slope requires: (1) including the MF as a prior when deriving individual stellar mass estimates; (2) modeling the uncertainties in the individual stellar masses; and (3) fully characterizing and then explicitly modeling the completeness for stars of a given mass. (abridged)

The Baryon Oscillation Spectroscopic Survey (BOSS) is designed to measure the scale of baryon acoustic oscillations (BAO) in the clustering of matter over a larger volume than the combined efforts of all previous spectroscopic surveys of large scale structure. BOSS uses 1.5 million luminous galaxies as faint as i=19.9 over 10,000 square degrees to measure BAO to redshifts z<0.7. Observations of neutral hydrogen in the Lyman alpha forest in more than 150,000 quasar spectra (g<22) will constrain BAO over the redshift range 2.15<z<3.5. Early results from BOSS include the first detection of the large-scale three-dimensional clustering of the Lyman alpha forest and a strong detection from the Data Release 9 data set of the BAO in the clustering of massive galaxies at an effective redshift z = 0.57. We project that BOSS will yield measurements of the angular diameter distance D_A to an accuracy of 1.0% at redshifts z=0.3 and z=0.57 and measurements of H(z) to 1.8% and 1.7% at the same redshifts. Forecasts for Lyman alpha forest constraints predict a measurement of an overall dilation factor that scales the highly degenerate D_A(z) and H^{-1}(z) parameters to an accuracy of 1.9% at z~2.5 when the survey is complete. Here, we provide an overview of the selection of spectroscopic targets, planning of observations, and analysis of data and data quality of BOSS.

Exponential, de Vaucouleurs, and S\'ersic profiles are simple and successful models for fitting two-dimensional images of galaxies. One numerical issue encountered in this kind of fitting is the pixel rendering and convolution (or correlation) of the models with the telescope point-spread function (PSF); these operations are slow, and easy to get slightly wrong at small radii. Here we exploit the realization that these models can be approximated to arbitrary accuracy with a mixture (linear superposition) of two-dimensional Gaussians (MoGs). MoGs are fast to render and fast to affine-transform. Most importantly, if you have a MoG model for the pixel-convolved PSF, the PSF-convolved, affine-transformed galaxy models are themselves MoGs and therefore very fast to compute, integrate, and render precisely. We present worked examples that can be directly used in image fitting; we are using them ourselves. The MoG profiles we provide can be swapped in to replace the standard models in any image-fitting code; they sped up model fitting in our projects by an order of magnitude; they ought to make any code faster at essentially no cost in precision.

Ground-based optical surveys such as PanSTARRS, DES, and LSST, will produce large catalogs to limiting magnitudes of r > 24. Star-galaxy separation poses a major challenge to such surveys because galaxies---even very compact galaxies---outnumber halo stars at these depths. We investigate photometric classification techniques on stars and galaxies with intrinsic FWHM < 0.2 arcsec. We consider unsupervised spectral energy distribution template fitting and supervised, data-driven Support Vector Machines (SVM). For template fitting, we use a Maximum Likelihood (ML) method and a new Hierarchical Bayesian (HB) method, which learns the prior distribution of template probabilities from the data. SVM requires training data to classify unknown sources; ML and HB don't. We consider i.) a best-case scenario (SVM_best) where the training data is (unrealistically) a random sampling of the data in both signal-to-noise and demographics, and ii.) a more realistic scenario where training is done on higher signal-to-noise data (SVM_real) at brighter apparent magnitudes. Testing with COSMOS ugriz data we find that HB outperforms ML, delivering ~80% completeness, with purity of ~60-90% for both stars and galaxies, respectively. We find no algorithm delivers perfect performance, and that studies of metal-poor main-sequence turnoff stars may be challenged by poor star-galaxy separation. Using the Receiver Operating Characteristic curve, we find a best-to-worst ranking of SVM_best, HB, ML, and SVM_real. We conclude, therefore, that a well trained SVM will outperform template-fitting methods. However, a normally trained SVM performs worse. Thus, Hierarchical Bayesian template fitting may prove to be the optimal classification method in future surveys.

We present the Data Release 9 Quasar (DR9Q) catalog from the Baryon Oscillation Spectroscopic Survey (BOSS) of the Sloan Digital Sky Survey III. The catalog includes all BOSS objects that were targeted as quasar candidates during the survey, are spectrocopically confirmed as quasars via visual inspection, have luminosities Mi[z=2]<-20.5 (in a $\Lambda$CDM cosmology with H0 = 70 km/s/Mpc, $\Omega_{\rm M}$ = 0.3, and $\Omega_{\Lambda}$ = 0.7) and either display at least one emission line with full width at half maximum (FWHM) larger than 500 km/s or, if not, have interesting/complex absorption features. It includes as well, known quasars (mostly from SDSS-I and II) that were reobserved by BOSS. This catalog contains 87,822 quasars (78,086 are new discoveries) detected over 3,275 deg$^{2}$ with robust identification and redshift measured by a combination of principal component eigenspectra newly derived from a training set of 8,632 spectra from SDSS-DR7. The number of quasars with $z>2.15$ (61,931) is ~2.8 times larger than the number of z>2.15 quasars previously known. Redshifts and FWHMs are provided for the strongest emission lines (CIV, CIII], MgII). The catalog identifies 7,533 broad absorption line quasars and gives their characteristics. For each object the catalog presents five-band (u,g,r,i,z) CCD-based photometry with typical accuracy of 0.03 mag, and information on the morphology and selection method. The catalog also contains X-ray, ultraviolet, near-infrared, and radio emission properties of the quasars, when available, from other large-area surveys.

In this paper, we investigate the impact of survey strategy on the performance of self-calibration when the goal is to produce accurate photometric catalogs from wide-field imaging surveys. This self-calibration technique utilizes multiple measurements of sources at different focal-plane positions to constrain instruments' large-scale response (flat-field) from survey science data alone. We create an artificial sky of sources and synthetically observe it under four basic survey strategies, creating an end-to-end simulation of an imaging survey for each. These catalog-level simulations include realistic measurement uncertainties and a complex focal-plane dependence of the instrument response. In the self-calibration step, we simultaneously fit for all the star fluxes and the parameters of a position-dependent flat-field. For realism, we deliberately fit with a wrong noise model and a flat-field functional basis that does not include the model that generated the synthetic data. We demonstrate that with a favorable survey strategy, a complex instrument response can be precisely self-calibrated. We show that returning the same sources to very different focal-plane positions is the key property of any survey strategy designed for accurate retrospective calibration of this type. The results of this work suggest the following advice for those considering the design of large-scale imaging surveys: Do not use a regular, repeated tiling of the sky; instead return the same sources to very different focal-plane positions.

We measure the mass growth rate by merging for a wide range of galaxy types. We present the small-scale (0.014 < r < 11 h70^{-1} Mpc) projected cross-correlation functions w(rp) of galaxy subsamples from the spectroscopic sample of the NYU VAGC (5 \times 10^5 galaxies of redshifts 0.03 < z < 0.15) with galaxy subsamples from the SDSS imaging (4 \times 10^7 galaxies). We use smooth fits to de-project the two-dimensional functions w(rp) to obtain smooth three-dimensional real-space cross-correlation functions \xi(r) for each of several spectroscopic subsamples with each of several imaging subsamples. Because close pairs are expected to merge, the three-space functions and dynamical evolution time estimates provide galaxy accretion rates. We find that the accretion onto massive blue galaxies and onto red galaxies is dominated by red companions, and that onto small-mass blue galaxies, red and blue galaxies make comparable contributions. We integrate over all types of companions and find that at fixed stellar mass, the total fractional accretion rates onto red galaxies (\sim 1.5 h70 percent per Gyr) is greater than that onto blue galaxies (\sim 0.5 h70 percent per Gyr). Although these rates are very low, they are almost certainly over-estimates because we have assumed that all close pairs merge as quickly as dynamical friction permits.

We measure the Milky Way's rotation curve over the Galactocentric range 4 kpc <~ R <~ 14 kpc from the first year of data from the Apache Point Observatory Galactic Evolution Experiment (APOGEE). We model the line-of-sight velocities of 3,365 stars in fourteen fields with b = 0 deg between 30 deg < l < 210 deg out to distances of 10 kpc using an axisymmetric kinematical model that includes a correction for the asymmetric drift of the warm tracer population (\sigma_R ~ 35 km/s). We determine the local value of the circular velocity to be V_c(R_0) = 218 +/- 6 km/s and find that the rotation curve is approximately flat with a local derivative between -3.0 km/s/kpc and 0.4 km/s/kpc. We also measure the Sun's position and velocity in the Galactocentric rest frame, finding the distance to the Galactic center to be 8 kpc < R_0 < 9 kpc, radial velocity V_{R,sun} = -10 +/- 1 km/s, and rotational velocity V_{\phi,sun} = 242^{+10}_{-3} km/s, in good agreement with local measurements of the Sun's radial velocity and with the observed proper motion of Sgr A*. We investigate various systematic uncertainties and find that these are limited to offsets at the percent level, ~2 km/s in V_c. Marginalizing over all the systematics that we consider, we find that V_c(R_0) < 235 km/s at >99% confidence. We find an offset between the Sun's rotational velocity and the local circular velocity of 26 +/- 3 km/s, which is larger than the locally-measured solar motion of 12 km/s. This larger offset reconciles our value for V_c with recent claims that V_c >~ 240 km/s. Combining our results with other data, we find that the Milky Way's dark-halo mass within the virial radius is ~8x10^{11} M_sun.

We present the vertical kinematics of stars in the Milky Way's stellar disk inferred from SDSS/SEGUE G-dwarf data, deriving the vertical velocity dispersion, \sigma_z, as a function of vertical height |z| and Galactocentric radius R for a set of 'mono-abundance' sub-populations of stars with very similar elemental abundances [\alpha/Fe] and [Fe/H]. We find that all components exhibit nearly isothermal kinematics in |z|, and a slow outward decrease of the vertical velocity dispersion: \sigma_z (z,R|[\alpha/Fe],[Fe/H]) ~ \sigma_z ([\alpha/Fe],[Fe/H]) x \exp (-(R-R_0)/7 kpc}). The characteristic velocity dispersions of these components vary from ~ 15 km/s for chemically young, metal-rich stars, to >~ 50 km/s for metal poor stars. The mean \sigma_z gradient away from the mid plane is only 0.3 +/- 0.2 km/s/kpc. We find a continuum of vertical kinetic temperatures (~\sigma^2_z) as function of ([\alpha/Fe],[Fe/H]), which contribute to the stellar surface mass density as \Sigma_{R_0}(\sigma^2_z) ~ \exp(-\sigma^2_z). The existence of isothermal mono-abundance populations with intermediate dispersions reject the notion of a thin-thick disk dichotomy. This continuum of disks argues against models where the thicker disk portions arise from massive satellite infall or heating; scenarios where either the oldest disk portion was born hot, or where internal evolution plays a major role, seem the most viable. The wide range of \sigma_z ([\alpha/Fe],[Fe/H]) combined with a constant \sigma_z(z) for each abundance bin provides an independent check on the precision of the SEGUE abundances: \delta_[\alpha/Fe] ~ 0.07 dex and \delta_[Fe/H] ~ 0.15 dex. The radial decline of the vertical dispersion presumably reflects the decrease in disk surface-mass density. This measurement constitutes a first step toward a purely dynamical estimate of the mass profile the disk in our Galaxy. [abridged]

The Sloan Digital Sky Survey III (SDSS-III) presents the first spectroscopic data from the Baryon Oscillation Spectroscopic Survey (BOSS). This ninth data release (DR9) of the SDSS project includes 535,995 new galaxy spectra (median z=0.52), 102,100 new quasar spectra (median z=2.32), and 90,897 new stellar spectra, along with the data presented in previous data releases. These spectra were obtained with the new BOSS spectrograph and were taken between 2009 December and 2011 July. In addition, the stellar parameters pipeline, which determines radial velocities, surface temperatures, surface gravities, and metallicities of stars, has been updated and refined with improvements in temperature estimates for stars with T_eff<5000 K and in metallicity estimates for stars with [Fe/H]>-0.5. DR9 includes new stellar parameters for all stars presented in DR8, including stars from SDSS-I and II, as well as those observed as part of the SDSS-III Sloan Extension for Galactic Understanding and Exploration-2 (SEGUE-2). The astrometry error introduced in the DR8 imaging catalogs has been corrected in the DR9 data products. The next data release for SDSS-III will be in Summer 2013, which will present the first data from the Apache Point Observatory Galactic Evolution Experiment (APOGEE) along with another year of data from BOSS, followed by the final SDSS-III data release in December 2014.

In this pedagogical text aimed at those wanting to start thinking about or brush up on probabilistic inference, I review the rules by which probability distribution functions can (and cannot) be combined. I connect these rules to the operations performed in probabilistic data analysis. Dimensional analysis is emphasized as a valuable tool for helping to construct non-wrong probabilistic statements. The applications of probability calculus in constructing likelihoods, marginalized likelihoods, posterior probabilities, and posterior predictions are all discussed.

The spatial, kinematic, and elemental-abundance structure of the Milky Way's stellar disk is complex, and has been difficult to dissect with local spectroscopic or global photometric data. Here, we develop and apply a rigorous density modeling approach for Galactic spectroscopic surveys that enables investigation of the global spatial structure of stellar sub-populations in narrow bins of [\alpha/Fe] and [Fe/H], using 23,767 G-type dwarfs from SDSS/SEGUE. We fit models for the number density of each such mono-abundance component, properly accounting for the complex spectroscopic SEGUE sampling of the underlying stellar population. We find that each mono-abundance sub-population has a simple spatial structure that can be described by a single exponential in both the vertical and radial direction, with continuously increasing scale heights (~200 pc to 1 kpc) and decreasing scale lengths (>4.5 kpc to 2 kpc) for increasingly older sub-populations, as indicated by their lower metallicities and [\alpha/Fe] enhancements. That the abundance-selected sub-components with the largest scale heights have the shortest scale lengths is in sharp contrast with purely geometric `thick--thin disk' decompositions. To the extent that [\alpha/Fe] is an adequate proxy for age, our results directly show that older disk sub-populations are more centrally concentrated, which implies inside-out formation of galactic disks. The fact that the largest scale-height sub-components are most centrally concentrated in the Milky Way is an almost inevitable consequence of explaining the vertical structure of the disk through internal evolution. Whether the simple spatial structure of the mono-abundance sub-components, and the striking correlations between age, scale length, and scale height can be plausibly explained by satellite accretion or other external heating remains to be seen.

We present a data-driven method - heteroscedastic matrix factorization, a kind of probabilistic factor analysis - for modeling or performing dimensionality reduction on observed spectra or other high-dimensional data with known but non-uniform observational uncertainties. The method uses an iterative inverse-variance-weighted least-squares minimization procedure to generate a best set of basis functions. The method is similar to principal components analysis, but with the substantial advantage that it uses measurement uncertainties in a responsible way and accounts naturally for poorly measured and missing data; it models the variance in the noise-deconvolved data space. A regularization can be applied, in the form of a smoothness prior (inspired by Gaussian processes) or a non-negative constraint, without making the method prohibitively slow. Because the method optimizes a justified scalar (related to the likelihood), the basis provides a better fit to the data in a probabilistic sense than any PCA basis. We test the method on SDSS spectra, concentrating on spectra known to contain two redshift components: These are spectra of gravitational lens candidates and massive black-hole binaries. We apply a hypothesis test to compare one-redshift and two-redshift models for these spectra, utilizing the data-driven model trained on a random subset of all SDSS spectra. This test confirms 129 of the 131 lens candidates in our sample and all of the known binary candidates, and turns up very few false positives.

We present a new method to determine the age spread of resolved stellar populations in a starburst cluster. The method relies on a two-step process. In the first step, kinematic members of the cluster are identified based on multi-epoch astrometric monitoring. In the second step, a Bayesian analysis is carried out, comparing the observed photometric sequence of cluster members with sets of theoretical isochrones. When applying this methodology to optical and near-infrared high angular resolution Hubble Space Telescope (HST) and adaptive optics observations of the ~5 Myr old starburst cluster Westerlund 1 and ~2 Myr old starburst cluster NGC 3603 YC, we derive upper limits for the age spreads of 0.4 and 0.1 Myr, respectively. The results strongly suggest that star formation in these starburst clusters happened almost instantaneously.

Different stellar sub-populations of the Milky Way's stellar disk are known to have different vertical scale heights, their thickness increasing with age. Using SEGUE spectroscopic survey data, we have recently shown that mono-abundance sub-populations, defined in the [\alpha/Fe]-[Fe/H] space, are well described by single exponential spatial-density profiles in both the radial and the vertical direction; therefore any star of a given abundance is clearly associated with a sub-population of scale height h_z. Here, we work out how to determine the stellar surface-mass density contributions at the solar radius R_0 of each such sub-population, accounting for the survey selection function, and for the fraction of the stellar population mass that is reflected in the spectroscopic target stars given populations of different abundances and their presumed age distributions. Taken together, this enables us to derive \Sigma_{R_0}(h_z), the surface-mass contributions of stellar populations with scale height h_z. Surprisingly, we find no hint of a thin-thick disk bi-modality in this mass-weighted scale-height distribution, but a smoothly decreasing function, approximately \Sigma_{R_0}(h_z)\propto \exp(-h_z), from h_z ~ 200 pc to h_z ~ 1 kpc. As h_z is ultimately the structurally defining property of a thin or thick disk, this shows clearly that the Milky Way has a continuous and monotonic distribution of disk thicknesses: there is no 'thick disk' sensibly characterized as a distinct component. We discuss how our result is consistent with evidence for seeming bi-modality in purely geometric disk decompositions, or chemical abundances analyses. We constrain the total visible stellar surface-mass density at the Solar radius to be \Sigma^*_{R_0} = 30 +/- 1 M_\odot pc^{-2}.

We describe a technique for simultaneously classifying and estimating the redshift of quasars. It can separate quasars from stars in arbitrary redshift ranges, estimate full posterior distribution functions for the redshift, and naturally incorporate flux uncertainties, missing data, and multi-wavelength photometry. We build models of quasars in flux-redshift space by applying the extreme deconvolution technique to estimate the underlying density. By integrating this density over redshift one can obtain quasar flux-densities in different redshift ranges. This approach allows for efficient, consistent, and fast classification and photometric redshift estimation. This is achieved by combining the speed obtained by choosing simple analytical forms as the basis of our density model with the flexibility of non-parametric models through the use of many simple components with many parameters. We show that this technique is competitive with the best photometric quasar classification techniques---which are limited to fixed, broad redshift ranges and high signal-to-noise ratio data---and with the best photometric redshift techniques when applied to broadband optical data. We demonstrate that the inclusion of UV and NIR data significantly improves photometric quasar--star separation and essentially resolves all of the redshift degeneracies for quasars inherent to the ugriz filter system, even when included data have a low signal-to-noise ratio. For quasars spectroscopically confirmed by the SDSS 84 and 97 percent of the objects with GALEX UV and UKIDSS NIR data have photometric redshifts within 0.1 and 0.3, respectively, of the spectroscopic redshift; this amounts to about a factor of three improvement over ugriz-only photometric redshifts. Our code to calculate quasar probabilities and redshift probability distributions is publicly available.

We investigate the radial distribution of galaxies within their host dark matter halos by modeling their small-scale clustering, as measured in the Sloan Digital Sky Survey. Specifically, we model the Jiang et al. (2011) measurements of the galaxy two-point correlation function down to very small projected separations (10 < r < 400 kpc/h), in a wide range of luminosity threshold samples (absolute r-band magnitudes of -18 up to -23). We use a halo occupation distribution (HOD) framework with free parameters that specify both the number and spatial distribution of galaxies within their host dark matter halos. We assume that the first galaxy in each halo lives at the halo center and that additional satellite galaxies follow a radial density profile similar to the dark matter Navarro-Frenk-White (NFW) profile, except that the concentration and inner slope are allowed to vary. We find that in low luminosity samples, satellite galaxies have radial profiles that are consistent with NFW. M_r < -20 and brighter satellite galaxies have radial profiles with significantly steeper inner slopes than NFW (we find inner logarithmic slopes ranging from -1.6 to -2.1, as opposed to -1 for NFW). We define a useful metric of concentration, M_(1/10), which is the fraction of satellite galaxies (or mass) that are enclosed within one tenth of the virial radius of a halo. We find that M_(1/10) for low luminosity satellite galaxies agrees with NFW, whereas for luminous galaxies it is 2.5-4 times higher, demonstrating that these galaxies are substantially more centrally concentrated within their dark matter halos than the dark matter itself. Our results therefore suggest that the processes that govern the spatial distribution of galaxies, once they have merged into larger halos, must be luminosity dependent, such that luminous galaxies become poor tracers of the underlying dark matter.

Markov Chain Monte Carlo (MCMC) proves to be powerful for Bayesian inference and in particular for exoplanet radial velocity fitting because MCMC provides more statistical information and makes better use of data than common approaches like chi-square fitting. However, the non-linear density functions encountered in these problems can make MCMC time-consuming. In this paper, we apply an ensemble sampler respecting affine invariance to orbital parameter extraction from radial velocity data. This new sampler has only one free parameter, and it does not require much tuning for good performance, which is important for automatization. The autocorrelation time of this sampler is approximately the same for all parameters and far smaller than Metropolis-Hastings, which means it requires many fewer function calls to produce the same number of independent samples. The affine-invariant sampler speeds up MCMC by hundreds of times compared with Metropolis-Hastings in the same computing situation. This novel sampler would be ideal for projects involving large datasets such as statistical investigations of planet distribution. The biggest obstacle to ensemble samplers is the existence of multiple local optima; we present a clustering technique to deal with local optima by clustering based on the likelihood of the walkers in the ensemble. We demonstrate the effectiveness of the sampler on real radial velocity data.

We quantify quasar color-variability using an unprecedented variability database - ugriz photometry of 9093 quasars from SDSS Stripe 82, observed over 8 years at ~60 epochs each. We confirm previous reports that quasars become bluer when brightening. We find a redshift dependence of this blueing in a given set of bands (e.g. g and r), but show that it is the result of the flux contribution from less-variable or delayed emission lines in the different SDSS bands at different redshifts. After correcting for this effect, quasar color-variability is remarkably uniform, and independent not only of redshift, but also of quasar luminosity and black hole mass. The color variations of individual quasars, as they vary in brightness on year timescales, are much more pronounced than the ranges in color seen in samples of quasars across many orders of magnitude in luminosity. This indicates distinct physical mechanisms behind quasar variability and the observed range of quasar luminosities at a given black hole mass - quasar variations cannot be explained by changes in the mean accretion rate. We do find some dependence of the color variability on the characteristics of the flux variations themselves, with fast, low-amplitude, brightness variations producing more color variability. The observed behavior could arise if quasar variability results from flares or ephemeral hot spots in an accretion disc.

An analytic relation between the statistics of photons in pixels and the number counts of multi-photon point sources is used to constrain the distribution of gamma-ray point sources below the Fermi detection limit at energies above 1 GeV and at latitudes below and above 30 degrees. The derived source-count distribution is consistent with the distribution found by the Fermi collaboration based on the first Fermi point source catalogue. In particular, we find that the contribution of resolved and unresolved active galactic nuclei (AGN) to the total gamma-ray flux is below 20% - 25%. In the best fit model, the AGN-like point source fraction is 17% +- 2%. Using the fact that the Galactic emission varies across the sky while the extra-galactic diffuse emission is isotropic, we put a lower limit of 51% on Galactic diffuse emission and an upper limit of 32% on the contribution from extra-galactic weak sources, such as star-forming galaxies. Possible systematic uncertainties are discussed.

Building on the legacy of the Sloan Digital Sky Survey (SDSS-I and II), SDSS-III is a program of four spectroscopic surveys on three scientific themes: dark energy and cosmological parameters, the history and structure of the Milky Way, and the population of giant planets around other stars. In keeping with SDSS tradition, SDSS-III will provide regular public releases of all its data, beginning with SDSS DR8 (which occurred in Jan 2011). This paper presents an overview of the four SDSS-III surveys. BOSS will measure redshifts of 1.5 million massive galaxies and Lya forest spectra of 150,000 quasars, using the BAO feature of large scale structure to obtain percent-level determinations of the distance scale and Hubble expansion rate at z<0.7 and at z~2.5. SEGUE-2, which is now completed, measured medium-resolution (R=1800) optical spectra of 118,000 stars in a variety of target categories, probing chemical evolution, stellar kinematics and substructure, and the mass profile of the dark matter halo from the solar neighborhood to distances of 100 kpc. APOGEE will obtain high-resolution (R~30,000), high signal-to-noise (S/N>100 per resolution element), H-band (1.51-1.70 micron) spectra of 10^5 evolved, late-type stars, measuring separate abundances for ~15 elements per star and creating the first high-precision spectroscopic survey of all Galactic stellar populations (bulge, bar, disks, halo) with a uniform set of stellar tracers and spectral diagnostics. MARVELS will monitor radial velocities of more than 8000 FGK stars with the sensitivity and cadence (10-40 m/s, ~24 visits per star) needed to detect giant planets with periods up to two years, providing an unprecedented data set for understanding the formation and dynamical evolution of giant planet systems. (Abridged)

We present the PRIsm MUlti-object Survey (PRIMUS), a spectroscopic faint galaxy redshift survey to z~1. PRIMUS uses a low-dispersion prism and slitmasks to observe ~2,500 objects at once in a 0.18 deg^2 field of view, using the IMACS camera on the Magellan I Baade 6.5m telescope at Las Campanas Observatory. PRIMUS covers a total of 9.1 deg^2 of sky to a depth of i_AB~23.5 in seven different deep, multi-wavelength fields that have coverage from GALEX, Spitzer and either XMM or Chandra, as well as multiple-band optical and near-IR coverage. PRIMUS includes ~130,000 robust redshifts of unique objects with a redshift precision of dz/(1+z)~0.005. The redshift distribution peaks at z=0.6 and extends to z=1.2 for galaxies and z=5 for broad-line AGN. The motivation, observational techniques, fields, target selection, slitmask design, and observations are presented here, with a brief summary of the redshift precision; a companion paper presents the data reduction, redshift fitting, redshift confidence, and survey completeness. PRIMUS is the largest faint galaxy survey undertaken to date. The high targeting fraction (~80%) and large survey size will allow for precise measures of galaxy properties and large-scale structure to z~1.

We generalize the well-known mixtures of Gaussians approach to density estimation and the accompanying Expectation--Maximization technique for finding the maximum likelihood parameters of the mixture to the case where each data point carries an individual $d$-dimensional uncertainty covariance and has unique missing data properties. This algorithm reconstructs the error-deconvolved or "underlying" distribution function common to all samples, even when the individual data points are samples from different distributions, obtained by convolving the underlying distribution with the heteroskedastic uncertainty distribution of the data point and projecting out the missing data directions. We show how this basic algorithm can be extended with conjugate priors on all of the model parameters and a "split-and-merge" procedure designed to avoid local maxima of the likelihood. We demonstrate the full method by applying it to the problem of inferring the three-dimensional velocity distribution of stars near the Sun from noisy two-dimensional, transverse velocity measurements from the Hipparcos satellite.

We present the results of a systematic search for massive black hole binaries in the Sloan Digital Sky Survey spectroscopic database. We focus on bound binaries, under the assumption that one of the black holes is active. In this framework, the broad lines associated to the accreting black hole are expected to show systematic velocity shifts with respect to the narrow lines, which trace the rest-frame of the galaxy. For a sample of 54586 quasars and 3929 galaxies at redshifts 0.1<z<1.5 we brute-force model each spectrum as a mixture of two quasars at two different redshifts. The spectral model is a data-driven dimensionality reduction of the SDSS quasar spectra based on a matrix factorization. We identified 32 objects with peculiar spectra. Nine of them can be interpreted as black hole binaries. This doubles the number of known black hole binary candidates. We also report on the discovery of a new class of extreme double-peaked emitters with exceptionally broad and faint Balmer lines. For all the interesting sources, we present detailed analysis of the spectra, and discuss possible interpretations.

The SDSS-III Baryon Oscillation Spectroscopic Survey (BOSS), a five-year spectroscopic survey of 10,000 deg^2, achieved first light in late 2009. One of the key goals of BOSS is to measure the signature of baryon acoustic oscillations in the distribution of Ly-alpha absorption from the spectra of a sample of ~150,000 z>2.2 quasars. Along with measuring the angular diameter distance at z\approx2.5, BOSS will provide the first direct measurement of the expansion rate of the Universe at z > 2. One of the biggest challenges in achieving this goal is an efficient target selection algorithm for quasars over 2.2 < z < 3.5, where their colors overlap those of stars. During the first year of the BOSS survey, quasar target selection methods were developed and tested to meet the requirement of delivering at least 15 quasars deg^-2 in this redshift range, out of 40 targets deg^-2. To achieve these surface densities, the magnitude limit of the quasar targets was set at g <= 22.0 or r<=21.85. While detection of the BAO signature in the Ly-alpha absorption in quasar spectra does not require a uniform target selection, many other astrophysical studies do. We therefore defined a uniformly-selected subsample of 20 targets deg^-2, for which the selection efficiency is just over 50%. This "CORE" subsample will be fixed for Years Two through Five of the survey. In this paper we describe the evolution and implementation of the BOSS quasar target selection algorithms during the first two years of BOSS operations. We analyze the spectra obtained during the first year. 11,263 new z>2.2 quasars were spectroscopically confirmed by BOSS. Our current algorithms select an average of 15 z > 2.2 quasars deg^-2 from 40 targets deg^-2 using single-epoch SDSS imaging. Multi-epoch optical data and data at other wavelengths can further improve the efficiency and completeness of BOSS quasar target selection. [Abridged]

Dynamically cold stellar streams are ideal probes of the gravitational field of the Milky Way. This paper re-examines the question of how such streams might be used to test for the presence of "missing satellites" -the many thousands of dark-matter subhalos with masses 10^5-10^7Msolar which are seen to orbit within Galactic-scale dark-matter halos in simulations of structure formation in LCDM cosmologies. Analytical estimates of the frequency and energy scales of stream encounters indicate that these missing satellites should have a negligible effect on hot debris structures, such as the tails from the Sagittarius dwarf galaxy. However, long cold streams, such as the structure known as GD-1 or those from the globular cluster Palomar 5 (Pal 5) are expected to suffer many tens of direct impacts from missing satellites during their lifetimes. Numerical experiments confirm that these impacts create gaps in the debris' orbital energy distribution, which will evolve into degree- and sub-degree- scale fluctuations in surface density over the age of the debris. Maps of Pal 5's own stream contain surface density fluctuations on these scales. The presence and frequency of these inhomogeneities suggests the existence of a population of missing satellites in numbers predicted in the standard LCDM cosmologies.

We present the SDSS-XDQSO quasar targeting catalog for efficient flux-based quasar target selection down to the faint limit of the Sloan Digital Sky Survey (SDSS) catalog, even at medium redshifts (2.5 <~ z <~ 3) where the stellar contamination is significant. We build models of the distributions of stars and quasars in flux space down to the flux limit by applying the extreme-deconvolution method to estimate the underlying density. We convolve this density with the flux uncertainties when evaluating the probability that an object is a quasar. This approach results in a targeting algorithm that is more principled, more efficient, and faster than other similar methods. We apply the algorithm to derive low-redshift (z < 2.2), medium-redshift (2.2 <= z <= 3.5), and high-redshift (z > 3.5) quasar probabilities for all 160,904,060 point sources with dereddened i-band magnitude between 17.75 and 22.45 mag in the 14,555 deg^2 of imaging from SDSS Data Release 8. The catalog can be used to define a uniformly selected and efficient low- or medium-redshift quasar survey, such as that needed for the SDSS-III's Baryon Oscillation Spectroscopic Survey project. We show that the XDQSO technique performs as well as the current best photometric quasar-selection technique at low redshift, and outperforms all other flux-based methods for selecting the medium-redshift quasars of our primary interest. We make code to reproduce the XDQSO quasar target selection publicly available.

The Sloan Digital Sky Survey (SDSS) started a new phase in August 2008, with new instrumentation and new surveys focused on Galactic structure and chemical evolution, measurements of the baryon oscillation feature in the clustering of galaxies and the quasar Ly alpha forest, and a radial velocity search for planets around ~8000 stars. This paper describes the first data release of SDSS-III (and the eighth counting from the beginning of the SDSS). The release includes five-band imaging of roughly 5200 deg^2 in the Southern Galactic Cap, bringing the total footprint of the SDSS imaging to 14,555 deg^2, or over a third of the Celestial Sphere. All the imaging data have been reprocessed with an improved sky-subtraction algorithm and a final, self-consistent photometric recalibration and flat-field determination. This release also includes all data from the second phase of the Sloan Extension for Galactic Understanding and Evolution (SEGUE-2), consisting of spectroscopy of approximately 118,000 stars at both high and low Galactic latitudes. All the more than half a million stellar spectra obtained with the SDSS spectrograph have been reprocessed through an improved stellar parameters pipeline, which has better determination of metallicity for high metallicity stars.

We develop a technique to investigate the possibility that some of the recently discovered ultra-faint dwarf satellites of the Milky Way might be cusp caustics rather than gravitationally self-bound systems. Such cusps can form when a stream of stars folds, creating a region where the projected 2-D surface density is enhanced. In this work, we construct a Poisson maximum likelihood test to compare the cusp and exponential models of any substructure on an equal footing. We apply the test to the Hercules dwarf (d ~ 113 kpc, M_V ~ -6.2, e ~ 0.67). The flattened exponential model is strongly favored over the cusp model in the case of Hercules, ruling out at high confidence that Hercules is a cusp catastrophe. This test can be applied to any of the Milky Way dwarfs, and more generally to the entire stellar halo population, to search for the cusp catastrophes that might be expected in an accreted stellar halo.

If the stellar halos of disk galaxies are built up from the disruption of dwarf galaxies, models predict highly structured variations in the stellar populations within these halos. We test this prediction by studying the ratio of blue horizontal branch stars (BHB stars; more abundant in old, metal-poor populations) to main-sequence turn-off stars (MSTO stars; a feature of all populations) in the stellar halo of the Milky Way using data from the Sloan Digital Sky Survey. We develop and apply an improved technique to select BHB stars using ugr color information alone, yielding a sample of ~9000 g<18 candidates where ~70% of them are BHB stars. We map the BHB/MSTO ratio across ~1/4 of the sky at the distance resolution permitted by the absolute magnitude distribution of MSTO stars. We find large variations of BHB/MSTO star ratio in the stellar halo. Previously identified, stream-like halo structures have distinctive BHB/MSTO ratios, indicating different ages/metallicities. Some halo features, e.g., the low-latitude structure, appear to be almost completely devoid of BHB stars, whereas other structures appear to be rich in BHB stars. The Sagittarius tidal stream shows an apparent variation in BHB/MSTO ratio along its extent, which we interpret in terms of population gradients within the progenitor dwarf galaxy. Our detection of coherent stellar population variations between different stellar halo substructures provides yet more support to cosmologically motivated models for stellar halo growth.

Standard maximum-likelihood estimators for binary-star and exoplanet eccentricities are biased high, in the sense that the estimated eccentricity tends to be larger than the true eccentricity. As with most non-trivial observables, a simple histogram of estimated eccentricities is not a good estimate of the true eccentricity distribution. Here we develop and test a hierarchical probabilistic method for performing the relevant meta-analysis, that is, inferring the true eccentricity distribution, taking as input the likelihood functions for the individual-star eccentricities, or samplings of the posterior probability distributions for the eccentricities (under a given, uninformative prior). The method is a simple implementation of a hierarchical Bayesian model; it can also be seen as a kind of heteroscedastic deconvolution. It can be applied to any quantity measured with finite precision--other orbital parameters, or indeed any astronomical measurements of any kind, including magnitudes, parallaxes, or photometric redshifts--so long as the measurements have been communicated as a likelihood function or a posterior sampling.

We go through the many considerations involved in fitting a model to data, using as an example the fit of a straight line to a set of points in a two-dimensional plane. Standard weighted least-squares fitting is only appropriate when there is a dimension along which the data points have negligible uncertainties, and another along which all the uncertainties can be described by Gaussians of known variance; these conditions are rarely met in practice. We consider cases of general, heterogeneous, and arbitrarily covariant two-dimensional uncertainties, and situations in which there are bad data (large outliers), unknown uncertainties, and unknown but expected intrinsic scatter in the linear relationship being fit. Above all we emphasize the importance of having a "generative model" for the data, even an approximate one. Once there is a generative model, the subsequent fitting is non-arbitrary because the model permits direct computation of the likelihood of the parameters or the posterior probability distribution. Construction of a posterior probability distribution is indispensible if there are "nuisance parameters" to marginalize away.

Astronomical instruments make intensity measurements; any precise astronomical experiment ought to involve modeling those measurements. People make catalogues, but because a catalogue requires hard decisions about calibration and detection, no catalogue can contain all of the information in the raw pixels relevant to most scientific investigations. Here we advocate making catalogue-like data outputs that permit investigators to test hypotheses with almost the power of the original image pixels. The key is to provide users with approximations to likelihood tests against the raw image pixels. We advocate three options, in order of increasing difficulty: The first is to define catalogue entries and associated uncertainties such that the catalogue contains the parameters of an approximate description of the image-level likelihood function. The second is to produce a K-catalogue sampling in "catalogue space" that samples a posterior probability distribution of catalogues given the data. The third is to expose a web service or equivalent that can re-compute on demand the full image-level likelihood for any user-supplied catalogue.

Fully cosmological, high resolution N-Body + SPH simulations are used to investigate the chemical abundance trends of stars in simulated stellar halos as a function of their origin. These simulations employ a physically motivated supernova feedback recipe, as well as metal enrichment, metal cooling and metal diffusion. As presented in an earlier paper, the simulated galaxies in this study are surrounded by stellar halos whose inner regions contain both stars accreted from satellite galaxies and stars formed in situ in the central regions of the main galaxies and later displaced by mergers into their inner halos. The abundance patterns ([Fe/H] and [O/Fe]) of halo stars located within 10 kpc of a solar-like observer are analyzed. We find that for galaxies which have not experienced a recent major merger, in situ stars at the high [Fe/H] end of the metallicity distribution function are more [alpha/Fe]-rich than accreted stars at similar [Fe/H]. This dichotomy in the [O/Fe] of halo stars at a given [Fe/H] results from the different potential wells within which in situ and accreted halo stars form. These results qualitatively match recent observations of local Milky Way halo stars. It may thus be possible for observers to uncover the relative contribution of different physical processes to the formation of stellar halos by observing such trends in the halo populations of the Milky Way, and other local L* galaxies.

The velocity distribution of nearby stars contains many "moving groups" that are inconsistent with the standard assumption of an axisymmetric, time-independent, and steady-state Galaxy. We study the age and metallicity properties of the low-velocity moving groups based on the reconstruction of the local velocity distribution in Paper I of this series. We perform stringent, conservative hypothesis testing to establish for each of these moving groups whether it could conceivably consist of a coeval population of stars. We conclude that they do not: the moving groups are not trivially associated with their eponymous open clusters nor with any other inhomogeneous star formation event. Concerning a possible dynamical origin of the moving groups, we test whether any of the moving groups has a higher or lower metallicity than the background population of thin disk stars, as would generically be the case if the moving groups are associated with resonances of the bar or spiral structure. We find clear evidence that the Hyades moving group has higher than average metallicity and weak evidence that the Sirius moving group has lower than average metallicity, which could indicate that these two groups are related to the inner Lindblad resonance of the spiral structure. Further we find weak evidence that the Hercules moving group has higher than average metallicity, as would be the case if it is associated with the bar's outer Lindblad resonance. The Pleiades moving group shows no clear metallicity anomaly, arguing against a common dynamical origin for the Hyades and Pleiades groups. Overall, however, the moving groups are barely distinguishable from the background population of stars, raising the likelihood that the moving groups are associated with transient perturbations. [abridged]

If a dynamical system is long-lived and non-resonant (that is, if there is a set of tracers that have evolved independently through many orbital times), and if the system is observed at any non-special time, it is possible to infer the dynamical properties of the system (such as the gravitational force or acceleration law) from a snapshot of the positions and velocities of the tracer population at a single moment in time. In this paper we describe a general inference technique that solves this problem while allowing (1) the unknown distribution function of the tracer population to be simultaneously inferred and marginalized over, and (2) prior information about the gravitational field and distribution function to be taken into account. As an example, we consider the simplest problem of this kind: We infer the force law in the Solar System using only an instantaneous kinematic snapshot (valid at 2009 April 1.0) for the eight major planets. We consider purely radial acceleration laws of the form a_r = -A [r/r_0]^{-\alpha}, where r is the distance from the Sun. Using a probabilistic inference technique, we infer 1.989 < \alpha < 2.052 (95 percent interval), largely independent of any assumptions about the distribution of energies and eccentricities in the system beyond the assumption that the system is phase-mixed. Generalizations of the methods used here will permit, among other things, inference of Milky Way dynamics from Gaia-like observations.

The narrow GD-1 stream of stars, spanning 60 deg on the sky at a distance of ~10 kpc from the Sun and ~15 kpc from the Galactic center, is presumed to be debris from a tidally disrupted star cluster that traces out a test-particle orbit in the Milky Way halo. We combine SDSS photometry, USNO-B astrometry, and SDSS and Calar Alto spectroscopy to construct a complete, empirical 6-dimensional phase-space map of the stream. We find that an eccentric orbit in a flattened isothermal potential describes this phase-space map well. Even after marginalizing over the stream orbital parameters and the distance from the Sun to the Galactic center, the orbital fit to GD-1 places strong constraints on the circular velocity at the Sun's radius V_c=224 \pm 13 km/s and total potential flattening q_\Phi=0.87^{+0.07}_{-0.04}. When we drop any informative priors on V_c the GD-1 constraint becomes V_c=221 \pm 18 km/s. Our 6-D map of GD-1 therefore yields the best current constraint on V_c and the only strong constraint on q_\Phi at Galactocentric radii near R~15 kpc. Much, if not all, of the total potential flattening may be attributed to the mass in the stellar disk, so the GD-1 constraints on the flattening of the halo itself are weak: q_{\Phi,halo}>0.89 at 90% confidence. The greatest uncertainty in the 6-D map and the orbital analysis stems from the photometric distances, which will be obviated by Gaia.

Computer representations of real numbers are necessarily discrete, with some finite resolution, discreteness, quantization, or minimum representable difference. We perform astrometric and photometric measurements on stars and co-add multiple observations of faint sources to demonstrate that essentially all of the scientific information in an optical astronomical image can be preserved or transmitted when the minimum representable difference is a factor of two finer than the root-variance of the per-pixel noise. Adopting a representation this coarse reduces bandwidth for data acquisition, transmission, or storage, or permits better use of the system dynamic range, without sacrificing any information for down-stream data analysis, including information on sources fainter than the minimum representable difference itself.

I review the basis and limitations of plausible inference in cosmology, in particular the limitation that it can only provide fundamentally true inferences when the hypotheses under consideration form a set that is exhaustive. They never do; this recommends abandoning realism. Despite this, we can adopt a scientifically correct pragmatism and understand aspects of the cosmological model with enormous confidence. I illustrate these points with discussion of one certainty--expansion--and two current controversies--the existence of large extra dimensions and the possibility that the matter distribution forms a fractal on large scales. I argue that the existence of large extra dimensions is certainly plausible, but a fractal universe is untenable.

We have built a reliable and robust system that takes as input an astronomical image, and returns as output the pointing, scale, and orientation of that image (the astrometric calibration or WCS information). The system requires no first guess, and works with the information in the image pixels alone; that is, the problem is a generalization of the "lost in space" problem in which nothing--not even the image scale--is known. After robust source detection is performed in the input image, asterisms (sets of four or five stars) are geometrically hashed and compared to pre-indexed hashes to generate hypotheses about the astrometric calibration. A hypothesis is only accepted as true if it passes a Bayesian decision theory test against a background hypothesis. With indices built from the USNO-B Catalog and designed for uniformity of coverage and redundancy, the success rate is 99.9% for contemporary near-ultraviolet and visual imaging survey data, with no false positives. The failure rate is consistent with the incompleteness of the USNO-B Catalog; augmentation with indices built from the 2MASS Catalog brings the completeness to 100% with no false positives. We are using this system to generate consistent and standards-compliant meta-data for digital and digitized imaging from plate repositories, automated observatories, individual scientific investigators, and hobbyists. This is the first step in a program of making it possible to trust calibration meta-data for astronomical data of arbitrary provenance.

Masers found in massive star-forming regions can be located precisely in six-dimensional phase space and therefore serve as a tool for studying Milky Way dynamics. The non-random orbital phases at which the masers are found and the sparseness of current samples require modeling. Here we model the phase-space distribution function of 18 precisely measured Galactic masers, permitting a mean velocity offset and a general velocity dispersion tensor relative to their local standards of rest, and accounting for different pieces of prior information. With priors only on the Sun's distance from the Galactic Center and on its motion with respect to the local standard of rest, the maser data provide a weak constraint on the circular velocity at the Sun of V_c = 246 +/- 30 km/s. Including prior information on the proper motion of Sgr A* leads to V_c = 244 +/- 13 km/s. We do not confirm the value of V_c \approx 254 km/s found in more restrictive models. This analysis shows that there is no conflict between recent determinations of V_c from Galactic Center analyses, orbital fitting of the GD-1 stellar stream, and the kinematics of Galactic masers; a combined estimate is V_c = 236 +/- 11 km/s. Apart from the dynamical parameters, we find that masers tend to occur at post-apocenter, circular-velocity-lagging phases of their orbits.

We present a three-dimensional reconstruction of the velocity distribution of nearby stars (<~ 100 pc) using a maximum likelihood density estimation technique applied to the two-dimensional tangential velocities of stars. The underlying distribution is modeled as a mixture of Gaussian components. The algorithm reconstructs the error-deconvolved distribution function, even when the individual stars have unique error and missing-data properties. We apply this technique to the tangential velocity measurements from a kinematically unbiased sample of 11,865 main sequence stars observed by the Hipparcos satellite. We explore various methods for validating the complexity of the resulting velocity distribution function, including criteria based on Bayesian model selection and how accurately our reconstruction predicts the radial velocities of a sample of stars from the Geneva-Copenhagen survey (GCS). Using this very conservative external validation test based on the GCS, we find that there is little evidence for structure in the distribution function beyond the moving groups established prior to the Hipparcos mission. This is in sharp contrast with internal tests performed here and in previous analyses, which point consistently to maximal structure in the velocity distribution. We quantify the information content of the radial velocity measurements and find that the mean amount of new information gained from a radial velocity measurement of a single star is significant. This argues for complementary radial velocity surveys to upcoming astrometric surveys.

We investigate the formation of the stellar halos of four simulated disk galaxies using high resolution, cosmological SPH + N-Body simulations. These simulations include a self-consistent treatment of all the major physical processes involved in galaxy formation. The simulated galaxies presented here each have a total mass of ~10^12 M_sun, but span a range of merger histories. These simulations allow us to study the competing importance of in-situ star formation (stars formed in the primary galaxy) and accretion of stars from subhalos in the building of stellar halos in a LambdaCDM universe. All four simulated galaxies are surrounded by a stellar halo, whose inner regions (r < 20 kpc) contain both accreted stars, and an in-situ stellar population. The outer regions of the galaxies' halos were assembled through pure accretion and disruption of satellites. Most of the in-situ halo stars formed at high redshift out of smoothly accreted cold gas in the inner 1 kpc of the galaxies' potential wells, possibly as part of their primordial disks. These stars were displaced from their central locations into the halos through a succession of major mergers. We find that the two galaxies with recently quiescent merger histories have a higher fraction of in-situ stars (~20-50%) in their inner halos than the two galaxies with many recent mergers (~5-10% in-situ fraction). Observational studies concentrating on stellar populations in the inner halo of the Milky Way will be the most affected by the presence of in-situ stars with halo kinematics, as we find that their existence in the inner few tens of kpc is a generic feature of galaxy formation.

We present optical and mid-infrared photometry of a statistically complete sample of 29 very faint dwarf galaxies (M_r > -15 mag) selected from the SDSS spectroscopic sample and observed in the mid-infrared with Spitzer IRAC. This sample contains nearby (redshift z<0.005) galaxies three magnitudes fainter than previously studied samples. We compare our sample with other star-forming galaxies that have been observed with both IRAC and SDSS. We examine the relationship of the infrared color, sensitive to PAH abundance, with star-formation rates, gas-phase metallicities and radiation hardness, all estimated from optical emission lines. Consistent with studies of more luminous dwarfs, we find that the very faint dwarf galaxies show much weaker PAH emission than more luminous galaxies with similar specific star-formation rates. Unlike more luminous galaxies, we find that the very faint dwarf galaxies show no significant dependence at all of PAH emission on star-formation rate, metallicity, or radiation hardness, despite the fact that the sample spans a significant range in all of these quantities. When the very faint dwarfs in our sample are compared with more luminous (M_r ~ -18 mag) dwarfs, we find that PAH emission depends on metallicity and radiation hardness. These two parameters are correlated; we look at the PAH-metallicity relation at fixed radiation hardness and the PAH-hardness relation at fixed metallicity. This test shows that the PAH emission in dwarf galaxies depends most directly on metallicity.

Conservation of the phase-space density of photons plus Lorentz invariance requires that the cosmological luminosity distance be larger than the angular diameter distance by a factor of $(1+z)^2$, where $z$ is the redshift. Because this is a fundamental symmetry, this prediction--known sometimes as the "Etherington relation" or the "Tolman test"--is independent of world model, or even the assumptions of homogeneity and isotropy. It depends, however, on Lorentz invariance and transparency. Transparency can be affected by intergalactic dust or interactions between photons and the dark sector. Baryon acoustic feature and type Ia supernovae measures of the expansion history are differently sensitive to the angular diameter and luminosity distances and can therefore be used in conjunction to limit cosmic transparency. At the present day, the comparison only limits the change $\Delta\tau$ in the optical depth from redshift 0.20 to 0.35 at visible wavelengths to $\Delta\tau < 0.13$ at 95% confidence. In a model with a constant comoving number density $n$ of scatterers of constant proper cross-section $\sigma$, this limit implies $n \sigma< 2\times10^{-4} h \Mpc^{-1}$. These limits depend weakly on the cosmological world model. Within the next few years, the limits could extend to redshifts $z\approx2.5$ and improve to $n \sigma<1.1 \times10^{-5} h \Mpc^{-1}$. Cosmic variance will eventually limit the sensitivity of any test using the BAF at the $n \sigma\sim 4\times10^{-7} h \Mpc^{-1}$ level. Comparison with other measures of the transparency is provided; no other measure in the visible is as free of astrophysical assumptions.

A common belief about big-bang cosmology is that the cosmological redshift cannot be properly viewed as a Doppler shift (that is, as evidence for a recession velocity), but must be viewed in terms of the stretching of space. We argue that, contrary to this view, the most natural interpretation of the redshift is as a Doppler shift, or rather as the accumulation of many infinitesimal Doppler shifts. The stretching-of-space interpretation obscures a central idea of relativity, namely that it is always valid to choose a coordinate system that is locally Minkowskian. We show that an observed frequency shift in any spacetime can be interpreted either as a kinematic (Doppler) shift or a gravitational shift by imagining a suitable family of observers along the photon's path. In the context of the expanding universe the kinematic interpretation corresponds to a family of comoving observers and hence is more natural.

The near future of astrophysics involves many large solid-angle, multi-epoch, multi-band imaging surveys. These surveys will, at their faint limits, have data on large numbers of sources that are too faint to be detected at any individual epoch. Here we show that it is possible to measure in multi-epoch data not only the fluxes and positions, but also the parallaxes and proper motions of sources that are too faint to be detected at any individual epoch. The method involves fitting a model of a moving point source simultaneously to all imaging, taking account of the noise and point-spread function in each image. By this method it is possible to measure the proper motion of a point source with an uncertainty close to the minimum possible uncertainty given the information in the data, which is limited by the point-spread function, the distribution of observation times (epochs), and the total signal-to-noise in the combined data. We demonstrate our technique on multi-epoch Sloan Digital Sky Survey imaging of the SDSS Southern Stripe. We show that we can distinguish very red brown dwarfs by their proper motions from very high-redshift quasars more than $1.6\mag$ fainter than with traditional technique on these SDSS data, and with better better fidelity than by multi-band imaging alone. We re-discover all 10 known brown dwarfs in our sample and present 9 new candidate brown dwarfs, identified on the basis of high proper motion.

Astronomical software is now a fact of daily life for all hands-on members of our community. Purpose-built software for data reduction and modeling tasks becomes ever more critical as we handle larger amounts of data and simulations. However, the writing of astronomical software is unglamorous, the rewards are not always clear, and there are structural disincentives to releasing software publicly and to embedding it in the scientific literature, which can lead to significant duplication of effort and an incomplete scientific record. We identify some of these structural disincentives and suggest a variety of approaches to address them, with the goals of raising the quality of astronomical software, improving the lot of scientist-authors, and providing benefits to the entire community, analogous to the benefits provided by open access to large survey and simulation datasets. Our aim is to open a conversation on how to move forward. We advocate that: (1) the astronomical community consider software as an integral and fundable part of facility construction and science programs; (2) that software release be considered as integral to the open and reproducible scientific process as are publication and data release; (3) that we adopt technologies and repositories for releasing and collaboration on software that have worked for open-source software; (4) that we seek structural incentives to make the release of software and related publications easier for scientist-authors; (5) that we consider new ways of funding the development of grass-roots software; (6) and that we rethink our values to acknowledge that astronomical software development is not just a technical endeavor, but a fundamental part of our scientific practice.

We are developing automated systems to provide homogeneous calibration meta-data for heterogeneous imaging data, using the pixel content of the image alone where necessary. Standardized and complete calibration meta-data permit generative modeling: A good model of the sky through wavelength and time--that is, a model of the positions, motions, spectra, and variability of all stellar sources, plus an intensity map of all cosmological sources--could synthesize or generate any astronomical image ever taken at any time with any equipment in any configuration. We argue that the best-fit or highest likelihood model of the data is also the best possible astronomical catalog constructed from those data. A generative model or catalog of this form is the best possible platform for automated discovery, because it is capable of identifying informative failures of the model in new data at the pixel level, or as statistical anomalies in the joint distribution of residuals from many images. It is also, in some sense, an astronomer's "theory of everything".

Data points are placed in bins when a histogram is created, but there is always a decision to be made about the number or width of the bins. This decision is often made arbitrarily or subjectively, but it need not be. A jackknife or leave-one-out cross-validation likelihood is defined and employed as a scalar objective function for optimization of the locations and widths of the bins. The objective is justified as being related to the histogram's usefulness for predicting future data. The method works for data or histograms of any dimensionality.

If galaxy clusters contain intracluster dust, the spectra of galaxies lying behind clusters should show attenuation by dust absorption. We compare the optical (3500 - 7200 \AA) spectra of 60,267 luminous, early-type galaxies selected from the Sloan Digital Sky Survey to search for the signatures of intracluster dust in z ~ 0.05 clusters. We select massive, quiescent (i.e., non-star-forming) galaxies using an EW(Halpha) <= 2 \AA cut and consider galaxies in three bins of velocity dispersion, ranging from 150 to 300 km s^{-1}. The uniformity of early-type galaxy spectra in the optical allows us to construct inverse-variance-weighted composite spectra with high signal-to-noise ratio (ranging from 10^2-10^3). We compare the composite spectra of galaxies that lie behind and adjacent to galaxy clusters and find no convincing evidence of dust attenuation on scales ~ 0.15-2 Mpc; we derive a generic limit of E(B-V) < 3 x 10^{-3} mag on scales ~ 1-2 Mpc at the 99% confidence level, using conservative jackknife error bars, corresponding to a dust mass <~ 10^8 $M_{\odot}$. On scales smaller than 1 Mpc this limit is slightly weaker, E(B-V) < 8 x 10^{-3} mag.

Lens modeling is the key to successful and meaningful automated strong galaxy-scale gravitational lens detection. We have implemented a lens-modeling "robot" that treats every bright red galaxy (BRG) in a large imaging survey as a potential gravitational lens system. Using a simple model optimized for "typical" galaxy-scale lenses, we generate four assessments of model quality that are used in an automated classification. The robot infers the lens classification parameter H that a human would have assigned; the inference is performed using a probability distribution generated from a human-classified training set, including realistic simulated lenses and known false positives drawn from the HST/EGS survey. We compute the expected purity, completeness and rejection rate, and find that these can be optimized for a particular application by changing the prior probability distribution for H, equivalent to defining the robot's "character." Adopting a realistic prior based on the known abundance of lenses, we find that a lens sample may be generated that is ~100% pure, but only ~20% complete. This shortfall is due primarily to the over-simplicity of the lens model. With a more optimistic robot, ~90% completeness can be achieved while rejecting ~90% of the candidate objects. The remaining candidates must be classified by human inspectors. We are able to classify lens candidates by eye at a rate of a few seconds per system, suggesting that a future 1000 square degree imaging survey containing 10^7 BRGs, and some 10^4 lenses, could be successfully, and reproducibly, searched in a modest amount of time. [Abridged]

Astrometric calibration is based on patterns of cataloged stars and therefore effectively assumes a particular epoch, which can be substantially incorrect for historical images. With the known proper motions of stars we can "run back the clock" to an approximation of the night sky in any given year, and in principle the year that best fits stellar patterns in any given image is an estimate of the year in which that image was taken. In this paper we use 47 scanned photographic images of M44 spanning years 1910-1975 to demonstrate this technique. We use only the pixel information in the images; we use no prior information or meta-data about image pointing, scale, orientation, or date. Blind Date returns date meta-data for the input images. It also improves the astrometric calibration of the image because the final astrometric calibration is performed at the appropriate epoch. The accuracy and reliability of Blind Date are functions of image size, pointing, angular resolution, and depth; performance is related to the sum of proper-motion signal-to-noise ratios for catalog stars measured in the input image. All of the science-quality images and 85 percent of the low-quality images in our sample of photographic plate images of M44 have their dates reliably determined to within a decade, many to within months.

We have used data from the Sloan Digital Sky Survey (SDSS) Data Release 5 to explore the overall structure and substructure of the stellar halo of the Milky Way using about 4 million color-selected main sequence turn-off stars. We fit oblate and triaxial broken power-law models to the data, and found a `best-fit' oblateness of the stellar halo 0.5<c/a<0.8, and halo stellar masses between Galactocentric radii of 1 and 40kpc of (3.7+/-1.2)x10^8 M_sun. The density profile of the stellar halo is approximately r^{-3}; it is possible that the power law slope is shallower inside 20kpc and steeper outside that radius. Yet, we found that all smooth and symmetric models were very poor fits to the distribution of stellar halo stars because the data exhibit a great deal of spatial substructure. We quantified deviations from a smooth oblate/triaxial model using the RMS of the data around the model profile on scales >~100pc, after accounting for the (known) contribution of Poisson uncertainties. The fractional RMS deviation of the actual stellar distribution from any smooth, parameterized halo model is >~40%: hence, the stellar halo is highly structured. We compared the observations with simulations of galactic stellar halos formed entirely from the accretion of satellites in a cosmological context by analysing the simulations in the same way as the data. While the masses, overall profiles, and degree of substructure in the simulated stellar halos show considerable scatter, the properties and degree of substructure in the Milky Way's halo match well the properties of a `typical' stellar halo built exclusively out of the debris from disrupted satellite galaxies. Our results therefore point towards a picture in which an important fraction of the Milky Way's stellar halo has been accreted from satellite galaxies.

Galaxies are seen from different viewing angles and their observed properties change as a function of viewing angle. In many circumstances we would rather know the intrinsic properties of galaxies - those properties that do not depend on viewing angle. For a large sample of galaxies it is possible to recover the intrinsic properties of galaxies, statistically, by looking for correlations with galaxy inclination, and then applying a correction to remove those dependencies. Studying the intrinsic properties of galaxies can give a different impression of the galaxy population and help avoid the mistake of connecting observed properties to quantities that don't depend on inclination like halo mass.

The observed properties of galaxies vary with inclination; for most applications we would rather have properties that are independent of inclination, intrinsic properties. One way to determine inclination corrections is to consider a large sample of galaxies, study how the observed properties of these galaxies depend on inclination and then remove this dependence to recover the intrinsic properties. We perform such an analysis for galaxies selected from the Sloan Digital Sky Survey which have been matched to galaxies from the Two-Micron All Sky Survey. We determine inclination corrections for these galaxies as a function of galaxy luminosity and Sersic index. In the g-band these corrections reach as as high as 1.2 mag and have a median value of 0.3 mag for all galaxies in our sample. We find that the corrections show little dependence on galaxy luminosity, except in the $u$ band, but are strongly dependent on galaxy Sersic index. We find that the ratio of red-to-blue galaxies changes from 1:1 to 1:2 when going from observed to intrinsic colors for galaxies in the range -22.75 < M_K < -17.75. We also discuss how survey completeness and photometric redshifts should be determined when taking into account that observed and intrinsic properties differ. Finally, we examine whether previous determinations of stellar mass give an intrinsic quantity or one that depends on galaxy inclination.

The USNO-B Catalog contains spurious entries that are caused by diffraction spikes and circular reflection halos around bright stars in the original imaging data. These spurious entries appear in the Catalog as if they were real stars; they are confusing for some scientific tasks. The spurious entries can be identified by simple computer vision techniques because they produce repeatable patterns on the sky. Some techniques employed here are variants of the Hough transform, one of which is sensitive to (two-dimensional) overdensities of faint stars in thin right-angle cross patterns centered on bright ($<13 \mag$) stars, and one of which is sensitive to thin annular overdensities centered on very bright ($<7 \mag$) stars. After enforcing conservative statistical requirements on spurious-entry identifications, we find that of the 1,042,618,261 entries in the USNO-B Catalog, 24,148,382 of them ($2.3 \percent$) are identified as spurious by diffraction-spike criteria and 196,133 ($0.02 \percent$) are identified as spurious by reflection-halo criteria. The spurious entries are often detected in more than 2 bands and are not overwhelmingly outliers in any photometric properties; they therefore cannot be rejected easily on other grounds, i.e., without the use of computer vision techniques. We demonstrate our method, and return to the community in electronic form a table of spurious entries in the Catalog.

We use numerical simulations to model the migration of massive planets at small radii and compare the results with the known properties of 'hot Jupiters' (extrasolar planets with semi-major axes a < 0.1 AU). For planet masses Mp sin i > 0.5 MJup, the evidence for any `pile-up' at small radii is weak (statistically insignificant), and although the mass function of hot Jupiters is deficient in high mass planets as compared to a reference sample located further out, the small sample size precludes definitive conclusions. We suggest that these properties are consistent with disc migration followed by entry into a magnetospheric cavity close to the star. Entry into the cavity results in a slowing of migration, accompanied by a growth in orbital eccentricity. For planet masses in excess of 1 Jupiter mass we find eccentricity growth timescales of a few x 10^5 years, suggesting that these planets may often be rapidly destroyed. Eccentricity growth appears to be faster for more massive planets which may explain changes in the planetary mass function at small radii and may also predict a pile-up of lower mass planets, the sample of which is still incomplete.

We present an algorithm to photometrically calibrate wide field optical imaging surveys, that simultaneously solves for the calibration parameters and relative stellar fluxes using overlapping observations. The algorithm decouples the problem of "relative" calibrations, from that of "absolute" calibrations; the absolute calibration is reduced to determining a few numbers for the entire survey. We pay special attention to the spatial structure of the calibration errors, allowing one to isolate particular error modes in downstream analyses. Applying this to the Sloan Digital Sky Survey imaging data, we achieve ~1% relative calibration errors across 8500 sq.deg. in griz; the errors are ~2% for the u band. These errors are dominated by unmodelled atmospheric variations at Apache Point Observatory. These calibrations, dubbed "ubercalibration", are now public with SDSS Data Release 6, and will be a part of subsequent SDSS data releases.

We study the role of major and minor mergers in the mass growth of luminous red galaxies. We present small-scale ($0.01<r<8\,\hMpc$) projected cross-correlation functions of $23043$ luminous early-type galaxies from the Sloan Digital Sky Survey (SDSS) Luminous Red Galaxy (LRG) sample ($0.16<z<0.30$, $\MMi\approx -22.75\,\mag$) with all their companions in the SDSS imaging sample, split into color and luminosity subsamples with $\MMi<-18\,\mag$. We de-project the two-dimensional functions to obtain three-dimensional real-space LRG--galaxy cross-correlation functions for each companion subsample. We find that the cross-correlation functions are not purely power-law and that there is a clear ``one-halo'' to ``two-halo'' transition near $1\,\hMpc$. We convert these results into close pair statistics and estimate the LRG accretion rate from each companion galaxy subsample using timescales from dynamical friction arguments for each subsample of the companions. We find that the accretion onto LRGs is dominated by dry mergers of galaxies more luminous than $\Lstar$. We integrate the luminosity accretion rate from mergers over all companion galaxy subsamples and find that LRGs are growing by $[1.7\pm 0.1]$ percent per $\Gyr$, on average, from merger activity at redshift $z\sim 0.25$. This rate is almost certainly an over-estimate because we have assumed that all close pairs are merging as quickly as dynamical friction allows; nonetheless it is on the low side of the panoply of measurements in the literature, and lower than any rate predicted from theory.

In order to investigate the contribution of diffuse components to their total HI emission, we have obtained high precision HI line flux densities with the 100m Green Bank Telescope for a sample of 100 isolated spiral and irregular galaxies which we have previously observed with the 43m telescope. A comparison of the observed HI line fluxes obtained with the two different telescopes, characterized by half-power beam widths of 9 arcmin and 21 arcmin respectively, exploits a ``beam matching'' technique to yield a statistical determination of the occurrence of diffuse HI components in their disks. A simple model of the HI distribution within a galaxy well describes ~75 % of the sample and accounts for all of the HI line flux density. The remaining galaxies are approximately evenly divided into two categories: ones which appear to possess a significantly more extensive HI distribution than the model predicts, and ones for which the HI distribution is more centrally concentrated than predicted. Examples of both extremes can be found in the literature but little attention has been paid to the centrally concentrated HI systems. Our sample has demonstrated that galaxies do not commonly possess extended regions of low surface brightness HI gas which is not accounted for by our current understanding of the structure of HI disks. Eight HI-rich companions to the target objects are identified, and a set of extragalactic HI line flux density calibrators is presented.

We present the fourth edition of the Sloan Digital Sky Survey (SDSS) Quasar Catalog. The catalog contains 77,429 objects; this is an increase of over 30,000 entries since the previous edition. The catalog consists of the objects in the SDSS Fifth Data Release that have luminosities larger than M_i = -22.0 (in a cosmology with H_0 = 70 km/s/Mpc, Omega_M = 0.3, and Omega_Lambda = 0.7) have at least one emission line with FWHM larger than 1000 km/s, or have interesting/complex absorption features, are fainter than i=15.0, and have highly reliable redshifts. The area covered by the catalog is 5740 sq. deg. The quasar redshifts range from 0.08 to 5.41, with a median value of 1.48; the catalog includes 891 quasars at redshifts greater than four, of which 36 are at redshifts greater than five. Approximately half of the catalog quasars have i < 19; nearly all have i < 21. For each object the catalog presents positions accurate to better than 0.2 arcsec. rms per coordinate, five-band (ugriz) CCD-based photometry with typical accuracy of 0.03 mag, and information on the morphology and selection method. The catalog also contains basic radio, near-infrared, and X-ray emission properties of the quasars, when available, from other large-area surveys. The calibrated digital spectra cover the wavelength region 3800--9200A at a spectral resolution of ~2000. The spectra can be retrieved from the public database using the information provided in the catalog. The average SDSS colors of quasars as a function of redshift, derived from the catalog entries, are presented in tabular form. Approximately 96% of the objects in the catalog were discovered by the SDSS.

We investigate the dependences of galaxy star-formation history and galaxy morphology on environment, using color and H-alpha equivalent width as star-formation history indicators, using concentration and central surface brightness as morphological indicators, and using clustocentric distance as an environment indicator. Clustocentric distance has the virtue that it can be measured with very high precision over a large dynamic range. We find the following asymmetry between morphological and star-formation history parameters: star-formation history parameters relate directly to the clustocentric distance while morphological parameters relate to the clustocentric distance only indirectly through their relationships with star-formation history. This asymmetry has important implications for the role that environment plays in shaping galaxy properties and it places strong constraints on theoretical models of galaxy formation. Current semi-analytic models do not reproduce this effect.

We measure the large-scale real-space power spectrum P(k) using luminous red galaxies (LRGs) in the Sloan Digital Sky Survey (SDSS) and use this measurement to sharpen constraints on cosmological parameters from the Wilkinson Microwave Anisotropy Probe (WMAP). We employ a matrix-based power spectrum estimation method using Pseudo-Karhunen-Loeve eigenmodes, producing uncorrelated minimum-variance measurements in 20 k-bands of both the clustering power and its anisotropy due to redshift-space distortions, with narrow and well-behaved window functions in the range 0.01h/Mpc < k < 0.2h/Mpc. Results from the LRG and main galaxy samples are consistent, with the former providing higher signal-to-noise. Our results are robust to omitting angular and radial density fluctuations and are consistent between different parts of the sky. They provide a striking confirmation of the predicted large-scale LCDM power spectrum. Combining only SDSS LRG and WMAP data places robust constraints on many cosmological parameters that complement prior analyses of multiple data sets. The LRGs provide independent cross-checks on Om and the baryon fraction in good agreement with WMAP. Within the context of flat LCDM models, our LRG measurements complement WMAP by sharpening the constraints on the matter density, the neutrino density and the tensor amplitude by about a factor of two, giving Omega_m=0.24+-0.02 (1 sigma), sum m_nu < 0.9 eV (95%) and r<0.3 (95%). Baryon oscillations are clearly detected and provide a robust measurement of the comoving distance to the median survey redshift z=0.35 independent of curvature and dark energy properties. Within the LCDM framework, our power spectrum measurement improves the evidence for spatial flatness, sharpening the curvature constraint Omega_tot=1.05+-0.05 from WMAP alone to Omega_tot=1.003+-0.010. Assuming Omega_tot=1, the equation of state parameter is constrained to w=-0.94+-0.09, indicating the potential for more ambitious future LRG measurements to provide precision tests of the nature of dark energy. All these constraints are essentially independent of scales k>0.1h/Mpc and associated nonlinear complications, yet agree well with more aggressive published analyses where nonlinear modeling is crucial.

We investigate the clustering of galaxy groups and clusters in the SDSS using the Berlind et al. (2006) group sample, which is designed to identify galaxy systems that each occupy a single dark matter halo. We estimate group masses from their abundances, and measure their relative large-scale bias as a function of mass. Our measurements are in agreement with the theoretical halo bias function, given a standard LCDM cosmological model, and they tend to favor a low value of the power spectrum amplitude sigma_8. We search for a residual dependence of clustering on other group properties at fixed mass, and find the strongest signal for central galaxy color in high mass groups. Massive groups with less red central galaxies are more biased on large scales than similar mass groups with redder central galaxies. We show that this effect is unlikely to be caused by errors in our mass estimates, and is most likely observational evidence of recent theoretical findings that halo bias depends on a ``second parameter'' other than mass, such as age or concentration. To compare with the data, we study the bias of massive halos in N-body simulations and quantify the strength of the relation between halo bias and concentration at fixed mass. In addition to confirming a non-trivial prediction of the LCDM cosmological model, these results have important implications for the role that environment plays in shaping galaxy properties.

The photometric calibration of the Sloan Digital Sky Survey (SDSS) is a multi-step process which involves data from three different telescopes: the 1.0-m telescope at the US Naval Observatory (USNO), Flagstaff Station, Arizona (which was used to establish the SDSS standard star network); the SDSS 0.5-m Photometric Telescope (PT) at the Apache Point Observatory (APO), New Mexico (which calculates nightly extinctions and calibrates secondary patch transfer fields); and the SDSS 2.5-m telescope at APO (which obtains the imaging data for the SDSS proper). In this paper, we describe the Monitor Telescope Pipeline, MTPIPE, the software pipeline used in processing the data from the single-CCD telescopes used in the photometric calibration of the SDSS (i.e., the USNO 1.0-m and the PT). We also describe transformation equations that convert photometry on the USNO-1.0m u'g'r'i'z' system to photometry the SDSS 2.5m ugriz system and the results of various validation tests of the MTPIPE software. Further, we discuss the semi-automated PT factory, which runs MTPIPE in the day-to-day standard SDSS operations at Fermilab. Finally, we discuss the use of MTPIPE in current SDSS-related projects, including the Southern u'g'r'i'z' Standard Star project, the u'g'r'i'z' Open Star Clusters project, and the SDSS extension (SDSS-II).

We determine what aspects of the density field surrounding galaxies most affect their properties. For Sloan Digital Sky Survey galaxies, we measure the group environment, meaning the host group luminosity and the distance from the group center (hereafter, ``groupocentric distance''). For comparison, we measure the surrounding density field on scales ranging from 100 kpc/h to 10 Mpc/h. We use the relationship between color and group environment to test the null hypothesis that only the group environment matters, searching for a residual dependence of properties on the surrounding density. Generally, red galaxies are slightly more clustered on small scales (about 100--300 kpc/h) than the null hypothesis predicts, possibly indicating that substructure within groups has some importance. At large scales (> 1 Mpc/h), the actual projected correlation functions of galaxies are biased at less than the 5% level with respect to the null hypothesis predictions. We exclude strongly the converse null hypothesis, that only the surrounding density (on any scale) matters. These results generally encourage the use of the halo model description of galaxy bias, which models the galaxy distribution as a function of host halo mass alone. We compare these results to proposed galaxy formation scenarios within the Cold Dark Matter cosmological model.

We identify galaxy groups and clusters in volume-limited samples of the SDSS redshift survey, using a redshift-space friends-of-friends algorithm. We optimize the friends-of-friends linking lengths to recover galaxy systems that occupy the same dark matter halos, using a set of mock catalogs created by populating halos of N-body simulations with galaxies. Extensive tests with these mock catalogs show that no combination of perpendicular and line-of-sight linking lengths is able to yield groups and clusters that simultaneously recover the true halo multiplicity function, projected size distribution, and velocity dispersion. We adopt a linking length combination that yields, for galaxy groups with ten or more members: a group multiplicity function that is unbiased with respect to the true halo multiplicity function; an unbiased median relation between the multiplicities of groups and their associated halos; a spurious group fraction of less than ~1%; a halo completeness of more than ~97%; the correct projected size distribution as a function of multiplicity; and a velocity dispersion distribution that is ~20% too low at all multiplicities. These results hold over a range of mock catalogs that use different input recipes of populating halos with galaxies. We apply our group-finding algorithm to the SDSS data and obtain three group and cluster catalogs for three volume-limited samples that cover 3495.1 square degrees on the sky. We correct for incompleteness caused by fiber collisions and survey edges, and obtain measurements of the group multiplicity function, with errors calculated from realistic mock catalogs. These multiplicity function measurements provide a key constraint on the relation between galaxy populations and dark matter halos.

(abridged) There are good observational reasons to believe that the progenitors of red galaxies have undergone starbursts, followed by a post-starburst phase. We investigate the environments of post-starburst galaxies by measuring \textsl{(1)} number densities in $8 h^{-1} \mathrm{Mpc}$ radius comoving spheres, \textsl{(2)} transverse distances to nearest Virgo-like galaxy clusters, and \textsl{(3)} transverse distances to nearest luminous-galaxy neighbors. We compare the post-starburst galaxies to currently star-forming galaxies identified solely by A-star excess or $\Halpha$ emission. We find that post-starburst galaxies are in the same kinds of environments as star-forming galaxies; this is our ``null hypothesis''. More importantly, we find that at each value of the A-star excess, the star-forming and post-starburst galaxies lie in very similar distributions of environment. The only deviations from our null hypothesis are barely significant: a slight deficit of post-starburst galaxies (relative to the star-forming population) in very low-density regions, a small excess inside the virial radii of clusters, and a slight excess with nearby neighbors. None of these effects is strong enough to make the post-starburst galaxies a high-density phenomenon, or to argue that the starburst events are primarily triggered by external tidal impulses (e.g., from close passages of massive galaxies). The small excess inside cluster virial radii suggests that some post-starbursts are triggered by interactions with the intracluster medium, but this represents a very small fraction of all post-starburst galaxies.

We present the 3D real space clustering power spectrum of a sample of \~600,000 luminous red galaxies (LRGs) measured by the Sloan Digital Sky Survey (SDSS), using photometric redshifts. This sample of galaxies ranges from redshift z=0.2 to 0.6 over 3,528 deg^2 of the sky, probing a volume of 1.5 (Gpc/h)^3, making it the largest volume ever used for galaxy clustering measurements. We measure the angular clustering power spectrum in eight redshift slices and combine these into a high precision 3D real space power spectrum from k=0.005 (h/Mpc) to k=1 (h/Mpc). We detect power on gigaparsec scales, beyond the turnover in the matter power spectrum, on scales significantly larger than those accessible to current spectroscopic redshift surveys. We also find evidence for baryonic oscillations, both in the power spectrum, as well as in fits to the baryon density, at a 2.5 sigma confidence level. The statistical power of these data to constrain cosmology is ~1.7 times better than previous clustering analyses. Varying the matter density and baryon fraction, we find \Omega_M = 0.30 \pm 0.03, and \Omega_b/\Omega_M = 0.18 \pm 0.04, The detection of baryonic oscillations also allows us to measure the comoving distance to z=0.5; we find a best fit distance of 1.73 \pm 0.12 Gpc, corresponding to a 6.5% error on the distance. These results demonstrate the ability to make precise clustering measurements with photometric surveys (abridged).

SDSSJ1049+5103, commonly known as Willman 1, is an extremely low-luminosity Milky Way companion whose properties are intermediate between those of globular clusters and dwarf spheroidals. In this paper, we use deep photometry to show that this object is old and moderately metal-poor, has a distance of 38 +/- 7 kpc, has an M_V of -2.5 mag, and has a half-light radius of 21 +/- 7 pc, consistent with previous estimates. The spatial distribution of Willman 1's main sequence stars shows 1) its total spatial extent exceeds its tidal radius for a range of assumptions about its total mass and its orbit and 2) the presence of prominent multi-directional stellar tails. The tidal interactions causing these tail features may explain the large physical size of Willman 1 relative to low-luminosity globular clusters. It is the most distant Galactic object yet known to display prominent tails, and is the only distant satellite to display multi-directional tails. Although we cannot at present determine the cause of this unusual morphology, preliminary comparisons between the morphology of Willman 1 and published simulations suggest that it may be near the apocenter of its orbit, or that it may have interacted with another halo object. We find a significant difference between the luminosity functions of stars in the center and in the tails of Willman 1, strongly suggesting mass segregation much like that seen in Palomar 5. Although Willman 1 has more pronounced tidal tails than most confirmed Milky Way dwarf galaxies, because of its very low stellar mass we cannot at present rule out the possibility that it has a dark matter halo. (Abridged)

We investigate the extent to which galaxies' star-formation histories and morphologies are determined by their clustocentric distance and their nearest cluster's richness. We look at three tracers of star-formation history (i-band absolute magnitude M_i, [g-r] color, and Halpha emission line equivalent width) and two indicators of galaxy morphology (surface brightness and radial concentration) for 52,569 galaxies in the redshift range of 0.015<z<0.068. We find that our morphology indicators relate to the clustocentric distance only indirectly through their relationships with stellar population and starformation rate. Galaxies that are near the cluster center tend to be more luminous, redder and have lower Halpha EW (ie, lower star-formation rates) than those that lie near or outside the virial radius of the cluster. The detailed relationships between these galaxy properties and clustocentric distance depend on cluster richness. For richer clusters, we find that (i) the transition in color and Halpha EW from cluster center to field values is more abrupt and occurs closer to the cluster virial radius, and (ii) the color and Halpha EW distributions are overall narrower than in less rich clusters. We also find that the radial gradient seen in the luminosity distribution is strongest around the smaller clusters and decreases as cluster richness increases. We find there is a `characteristic distance' at around one virial radius (the infall region) where the change with radius of galaxy property distributions is most dramatic, but we find no evidence for infall-triggered star bursts. These results suggest that galaxies `know' the distance to, and the size of, their nearest cluster and they express this information in their star-formation histories.

In this paper, we present Sloan Digital Sky Survey (SDSS) photometry and spectroscopy in the fields of 24 gamma-ray bursts (GRBs) observed by Swift, including bursts localized by Swift, HETE-2, and INTEGRAL, after December 2004. After this bulk release, we plan to provide individual releases of similar data shortly after the localization of future bursts falling in the SDSS survey area. These data provide a solid basis for the astrometric and photometric calibration of follow-up afterglow searches and monitoring. Furthermore, the images provided with this release will allow observers to find transient objects up to a magnitude fainter than possible with Digitized Sky Survey image comparisons.

We present the small-scale (0.01<r<8 h^{-1} Mpc) projected correlation function w_p(r_p) and real space correlation function xi(r) of 24520 luminous early-type galaxies from the Sloan Digital Sky Survey Luminous Red Galaxy (LRG) sample (0.16<z<0.36). ``Fiber collision'' incompleteness of the SDSS spectroscopic sample at scales smaller than 55 arcseconds prevents measurements of the correlation function for LRGs on scales smaller than ~0.3 Mpc by the usual methods. In this work, we cross-correlate the spectroscopic sample with the imaging sample, with a weighting scheme to account for the collisions, extensively tested against mock catalogs. We correct for photometric biases in the SDSS imaging of close galaxy pairs. We find that the correlation function xi(r) is surprisingly close to a r^{-2} power law over more than 4 orders of magnitude in separation r. This result is too steep at small scales to be explained in current versions of the halo model for galaxy clustering. We infer an LRG-LRG merger rate of less than or similar to 0.6 Gyr^{-1} Gpc^{-3} for this sample. This result suggests that the LRG-LRG mergers are not the main mode of mass growth for LRGs at z<0.36.

After a polemical introduction about the proper activity of an astrophysicist facing a dominant theoretical model and many Tb of highly informative data, I review a few recent results on the properties of galaxies in the nearby (redshift one-tenth) Universe that directly bear on physical cosmology. In one example, I show that there are a number of ways of measuring, or strongly constraining, massive galaxy-galaxy major merger rates, which are predicted with limited uncertainties in the current generation of models. In another, I show that we can go beyond "correlations" between individual galaxy properties and "environment". Our results show that it is galaxy star-formation histories--not their morphologies--that are sensitive to environmental density. I look forward to a future, perhaps not that far away, in which these results guide a fundamental modification to our theoretical assumptions, though I fear that the dominant paradigm may not require subversion.

We investigate the origin of a nearly pointlike cluster of 5 ultrahigh energy cosmic rays at RA ~169.2deg and dec ~56.8deg, using Sloan Digital Sky Survey and other data. No particular source candidates are found near the estimated source direction, but the direction is exceptional in having a likely merging pair of galaxy clusters at 140/h Mpc, with an unusually low foreground density. Large scale shocks or another product of the merging galaxy clusters may accelerate the UHECRs, or the merging galaxy clusters may be coincidental and the UHECRs may be accelerated in a rare event of an unexceptional progenitor. Low magnetic deflections in the foreground void may explain why this is the only identified pointlike cluster of so many UHECRs.

In this Letter, we report the discovery of a new dwarf satellite to the Milky Way, located at ($\alpha_{2000}, \delta_{2000}$) $=$ (158.72,51.92) in the constellation of Ursa Major. This object was detected as an overdensity of red, resolved stars in Sloan Digital Sky Survey data. The color-magnitude diagram of the Ursa Major dwarf looks remarkably similar to that of Sextans, the lowest surface brightness Milky Way companion known, but with approximately an order of magnitude fewer stars. Deeper follow-up imaging confirms this object has an old and metal-poor stellar population and is $\sim$ 100 kpc away. We roughly estimate M$_V =$ -6.75 and $r_{1/2} =$ 250 pc for this dwarf. Its luminosity is several times fainter than the faintest known Milky Way dwarf. However, its physical size is typical for dSphs. Even though its absolute magnitude and size are presently quite uncertain, Ursa Major is likely the lowest luminosity and lowest surface brightness galaxy yet known.

[abridged] A "missing data" algorithm is developed to model (ie, reconstruct) the three-dimensional velocity distribution function of a sample of stars using data (velocity measurements) every one of which has one dimension unmeasured (the radial direction). It also accounts for covariant measurement uncertainties on the tangential velocity components. The algorithm is applied to tangential velocities measured in a kinematically unbiased sample of 11,865 stars taken from the Hipparcos catalog. The local stellar velocity distribution function of each of a set of 20 color-selected subsamples is modeled as a mixture of two three-dimensional Gaussian ellipsoids of arbitrary relative responsibility. In the fitting, one Gaussian (the "halo") is fixed at the known mean velocity and velocity variance tensor of the Galaxy halo, and the other (the "disk") is allowed to take arbitrary mean and arbitrary variance tensor. The mean and variance tensor (commonly the "velocity ellipsoid") of the disk velocity distribution are both found to be strong functions of stellar color, with long-lived populations showing larger velocity dispersion, slower mean rotation velocity, and smaller vertex deviation than short-lived populations. The local standard of rest (LSR) is inferred in the usual way and the Sun's motion relative to the LSR is found to be (U,V,W)_{\odot}=(10.1,4.0,6.7)+/-(0.5,0.8,0.2) km/s. Artificial data sets are made and analyzed, with the same error properties as the Hipparcos data, to demonstrate that the analysis is unbiased. The results are shown to be insensitive to the assumption that the velocity distributions are Gaussian.

We report the discovery of SDSSJ1049+5103, an overdensity of resolved blue stars at (\alpha_{2000}, \delta_{2000}) = (162.343, 51.051). This object appears to be an old, metal-poor stellar system at a distance of 45 +/- 10 kpc, with a half-light radius of 23$\pm 10$ pc and an absolute magnitude of M_V = -3.0^{+2.0}_{-0.7}. One star that is likely associated with this companion has an SDSS spectrum confirming it as a blue horizontal branch star at 48 kpc. The color-magnitude diagram of SDSSJ1049+5103 contains few, if any, horizontal or red giant branch stars, similar to the anomalously faint globular cluster AM 4. The size and luminosity of SDSSJ1049+5103 places it at the intersection of the size-luminosity relationships followed by known globular clusters and by Milky Way dwarf spheroidals. If SDSSJ1049+5103 is a globular cluster, then its properties are consistent with the established trend that the largest radius Galactic globular clusters are all in the outer halo. However, the five known globular clusters with similarly faint absolute magnitudes all have half-mass radii that are smaller than SDSSJ1049+5103 by a factor of $\gtrsim$ 5. If it is a dwarf spheroidal, then it is the faintest yet known by two orders of magnitude, and is the first example of the ultra-faint dwarfs predicted by some theories. The uncertain nature of this new system underscores the sometimes ambiguous distinction between globular clusters and dwarf spheroidals. A simple friends-of-friends search for similar blue, small scalesize star clusters detected all known globulars and dwarfs closer than 50 kpc in the SDSS area, but yielded no other candidates as robust as SDSSJ1049+5103.

Here we present the New York University Value-Added Galaxy Catalog (NYU-VAGC), a catalog of local galaxies (mostly below a redshift of about 0.3) based on a set of publicly-released surveys (including the 2dFGRS, 2MASS, PSCz, FIRST, and RC3) matched to the Sloan Digital Sky Survey (SDSS) Data Release 2. Excluding areas masked by bright stars, the photometric sample covers 3514 square degrees and the spectroscopic sample covers 2627 square degrees (with about 85% completeness). Earlier, proprietary versions of this catalog have formed the basis of many SDSS investigations of the power spectrum, correlation function, and luminosity function of galaxies. We calculate and compile derived quantities (for example, K-corrections and structural parameters for galaxies). The SDSS catalog presented here is photometrically recalibrated, reducing systematic calibration errors across the sky from about 2% to about 1%. We include an explicit description of the geometry of the catalog, including all imaging and targeting information as a function of sky position. Finally, we have performed eyeball quality checks on a large number of objects in the catalog in order to flag deblending and other errors. This catalog is complementary to the SDSS Archive Servers, in that NYU-VAGC's calibration, geometrical description, and conveniently small size are specifically designed for studying galaxy properties and large-scale structure statistics using the SDSS spectroscopic catalog.

We present the large-scale correlation function measured from a spectroscopic sample of 46,748 luminous red galaxies from the Sloan Digital Sky Survey. The survey region covers 0.72 h^{-3} Gpc^3 over 3816 square degrees and 0.16<z<0.47, making it the best sample yet for the study of large-scale structure. We find a well-detected peak in the correlation function at 100h^{-1} Mpc separation that is an excellent match to the predicted shape and location of the imprint of the recombination-epoch acoustic oscillations on the low-redshift clustering of matter. This detection demonstrates the linear growth of structure by gravitational instability between z=1000 and the present and confirms a firm prediction of the standard cosmological theory. The acoustic peak provides a standard ruler by which we can measure the ratio of the distances to z=0.35 and z=1089 to 4% fractional accuracy and the absolute distance to z=0.35 to 5% accuracy. From the overall shape of the correlation function, we measure the matter density Omega_mh^2 to 8% and find agreement with the value from cosmic microwave background (CMB) anisotropies. Independent of the constraints provided by the CMB acoustic scale, we find Omega_m = 0.273 +- 0.025 + 0.123 (1+w_0) + 0.137 Omega_K. Including the CMB acoustic scale, we find that the spatial curvature is Omega_K=-0.010+-0.009 if the dark energy is a cosmological constant. More generally, our results provide a measurement of cosmological distance, and hence an argument for dark energy, based on a geometric method with the same simple physics as the microwave background anisotropies. The standard cosmological model convincingly passes these new and robust tests of its fundamental properties.

We report the intermediate-scale (0.3 to 40 Mpc/h) clustering of 35,000 luminous early-type galaxies at redshifts 0.16 to 0.44 from the Sloan Digital Sky Survey. We present the redshift-space two-point correlation function \xi(s), the projected correlation function w_p(r_p), and the deprojected real-space correlation function \xi(r), for approximately volume-limited samples. As expected, the galaxies are highly clustered, with the correlation length varying from 9.8 +/- 0.2 Mpc/h to 11.2 +/- 0.2 Mpc/h, dependent on the specific luminosity range. For the -23.2 < Mg < -21.2 sample, the inferred bias relative to that of L* galaxies is 1.84 +/- 0.11 for 1 Mpc/h < r_p < 10 Mpc/h, with yet stronger clustering on smaller scales. We detect luminosity-dependent bias within the sample but see no evidence for redshift evolution between z=0.2 and z=0.4. We find a clear indication for deviations from a power-law in the real-space correlation function, with a dip at ~ 2 Mpc/h scales and an upturn on smaller scales. The precision measurements of these clustering trends offer new avenues for the study of the formation and evolution of these massive galaxies.

We test the homogeneity of the Universe at $z\sim 0.3$ with the Luminous Red Galaxy (LRG) spectroscopic sample of the Sloan Digital Sky Survey. First, the mean number $N(R)$ of LRGs within completely surveyed LRG-centered spheres of comoving radius $R$ is shown to be proportional to $R^3$ at radii greater than $R\sim 70 h^{-1} \mathrm{Mpc}$. The test has the virtue that it does not rely on the assumption that the LRG sample has a finite mean density; its results show, however, that there \emph{is} such a mean density. Secondly, the survey sky area is divided into 10 disjoint solid angular regions and the fractional rms density variations of the LRG sample in the redshift range $0.2<z<0.35$ among these ($\sim 2\times10^7 h^{-3} \mathrm{Mpc^3}$) regions is found to be 7 percent of the mean density. This variance is consistent with typical biased \lcdm models and puts very strong constraints on the quality of SDSS photometric calibration.

We investigate the relationship between the colors, luminosities, and environments of galaxies in the Sloan Digital Sky Survey spectroscopic sample, using environmental measurements on scales ranging from 0.2 to 6 Mpc/h. We find: (1) that the relationship between color and environment persists even to the lowest luminosities we probe (absolute magnitude in the r band of about -14 for h=1); (2) at luminosities and colors for which the galaxy correlation function has a large amplitude, it also has a steep slope; and (3) in regions of a given overdensity on small scales (1 Mpc/h), the overdensity on large scales (6 Mpc/h) does not appear to relate to the recent star formation history of the galaxies. Of these results, the last has the most immediate application to galaxy formation theory. In particular, it lends support to the notion that a galaxy's properties are related only to the mass of its host dark matter halo, and not to the larger scale environment.

The Spitzer Space Telescope First Look Survey Infrared Array Camera (IRAC) near and mid-infrared imaging data partially overlaps the Sloan Digital Sky Survey (SDSS), with 313 visually selected (r<17.6 mag) SDSS Main Sample galaxies in the overlap region. The 3.5 and 7.8 um properties of the galaxies are investigated in the context of their visual properties, where the IRAC [3.5] magnitude primarily measures starlight, and the [7.8] magnitude primarily measures PAH emission from the interstellar medium. As expected, we find a strong inverse correlation between [3.5]-[7.8] and visual color; galaxies red in visual colors (`red galaxies') tend to show very little dust and molecular emission (low `PAH-to-star' ratios), and galaxies blue in visual colors (`blue galaxies,' ie, star-forming galaxies) tend to show large PAH-to-star ratios. Red galaxies with high PAH-to-star ratios tend to be edge-on disks reddened by dust lanes. Simple, visually inferred attenuation corrections bring the visual colors of these galaxies in line with those of face-on disks; ie, PAH emission is closely related to attenuation-corrected, optically inferred star-formation rates. Blue galaxies with anomalously low PAH-to-star ratios are all low-luminosity star-forming galaxies. There is some weak evidence in this sample that the deficiency in PAH emission for these low-luminosity galaxies may be related to emission-line metallicity.

We study the relationship between galaxy luminosity, color, and environment in a cosmological simulation of galaxy formation. We compare the predicted relationship with that found for SDSS galaxies and find that the model successfully predicts most of the qualitative features seen in the data, but also shows some interesting differences. Specifically, the simulation predicts that the local density around bright red galaxies is a strong increasing function of luminosity, but does not depend much on color at fixed luminosity. Moreover, we show that this is due to central galaxies in dark matter halos whose baryonic masses correlate strongly with halo mass. The simulation also predicts that the local density around blue galaxies is a strong increasing function of color, but does not depend much on luminosity at fixed color. We show that this is due to satellite galaxies in halos whose stellar ages correlate with halo mass. Finally, the simulation fails to predict the luminosity dependence of environment observed around low luminosity red galaxies. However, we show that this is most likely due to the simulation's limited resolution. A study of a higher resolution, smaller volume simulation suggests that this dependence is caused by the fact that all low luminosity red galaxies are satellites in massive halos, whereas intermediate luminosity red galaxies are a mixture of satellites in massive halos and central galaxies in less massive halos.

The Hubble Space Telescope has obtained some of its well-deserved impact by producing stunning three-color (RGB) pictures from three-band imaging data. Here we produce a new RGB representation of the $I$, $V$, and $B$ bandpass images of the HST Ultra Deep Field (HUDF). Our representation is based on principles set forth elsewhere (Lupton et al 2004, PASP, 116, 133--137). The principal difference between our RGB representation of the data and the more traditional representation provided by the Space Telescope Science Institute is that the (necessarily) nonlinear transformation between data values and RGB values is done in a color-preserving (i.e., hue- and saturation-preserving) way. For example, if one of the image pixel values saturates the dynamic range of the RGB representation, all three of the R, G, and B values in the representation are truncated such that the hue and saturation of the pixel is the same as it would have been if the pixel had had lower flux but the same astronomical color. This, in effect, makes the bright parts of the representation an informative color map, not "whited out" as they are in traditional representations. For the HUDF, this difference is seen best in the centers of bright galaxies, which show significant detail not visible in the more traditional representation.

We present a new, and we believe arguably correct, algorithm for producing Red-Green-Blue (RBG) composites from 3-band astronomical images. Our method ensures that an object with a specified astronomical color (e.g. g-r and r-i) has a unique color in the RGB image, as opposed to the burnt-out white stars to which we are accustomed. A natural consequence of this is that we can use the same colors to code color-magnitude diagrams, providing a natural `index' to our images. We also introduce the use of an asinh stretch, which allows us to show faint objects while simultaneously preserving the structure of brighter objects in the field, such as the spiral arms of large galaxies. We believe that, in addition to their aesthetic value, our images convey far more information than do the traditional ones, and provide examples from Sloan Digital Sky Survey (SDSS) imaging, the Hubble Deep Field (HDF), and Chandra to support our claims. More examples are available at http://www.astro.princeton.edu/~rhl/PrettyPictures

We examine the relationship between environment and the luminosities, surface brightnesses, colors, and profile shapes of luminous galaxies in the Sloan Digital Sky Survey (SDSS). For the SDSS sample, galaxy color is the galaxy property most predictive of the local environment. Galaxy color and luminosity jointly comprise the most predictive pair of properties. At fixed luminosity and color, density is not closely related to surface brightness or to Sersic index -- the parameter in this study that astronomers most often associate with morphology. In the text, we discuss what measureable residual relationships exist, generally finding that at red colors and fixed luminosity, the mean density decreases at the highest surface brightnesses and Sersic indices. In general, these results suggest that the morphological properties of galaxies are less closely related to galaxy environment than are their masses and star-formation histories.

The distribution in color and absolute magnitude is presented for 55,158 galaxies taken from the Sloan Digital Sky Survey in the redshift range $0.08<z<0.12$, as a function of galaxy number overdensity in a line-of-sight cylinder of transverse radius $1 h^{-1} \mathrm{Mpc}$. In all environments, bulge-dominated galaxies (defined to be those with radial profiles best fit with large S\'ersic indices) form a narrow, well defined color--magnitude relation. Although the most luminous galaxies reside preferentially in the highest density regions, there is only a barely detectable variation in the color (zero-point) or slope of the color--magnitude relation ($<0.02 \mathrm{mag}$ in $^{0.1}[g-r]$ or $[B-V]$). These results constrain variations with environmental density in the ages or metallicities of typical bulge-dominated galaxies to be under 20 percent.

The distribution of early-type galaxy velocity dispersions, phi(sigma), is measured using a sample drawn from the SDSS database. Its shape differs significantly from that which one obtains by simply using the mean correlation between luminosity, L, and velocity dispersion, sigma, to transform the luminosity function into a velocity function: ignoring the scatter around the mean sigma-L relation is a bad approximation. An estimate of the contribution from late-type galaxies is also made, which suggests that phi(sigma) is dominated by early-type galaxies at velocities larger than ~ 200 km/s.

Two different simple measurements of galaxy star formation rate with different timescales are compared empirically on $156,395$ fiber spectra of galaxies with $r<17.77$ mag taken from the Sloan Digital Sky Survey in the redshift range $0.05<z<0.20$: a ratio $\Aamp / \Kamp$ found by fitting a linear sum of an average old stellar poplulation spectrum (\Kamp) and average A-star spectrum (\Aamp) to the galaxy spectrum, and the equivalent width (EW) of the $\Halpha$ emission line. The two measures are strongly correlated, but there is a small clearly separated population of outliers from the median correlation that display excess $\Aamp /\Kamp$ relative to \Halpha EW. These ``K+A'' (or ``E+A'') galaxies must have dramatically decreased their star-formation rates over the last $\sim 1$ Gyr. The K+A luminosity distribution is very similar to that of the total galaxy population. The K+A population appears to be bulge-dominated, but bluer and higher surface-brightness than normal bulge-dominated galaxies; it appears that K+A galaxies will fade with time into normal bulge-dominated galaxies. The inferred rate density for K+A galaxy formation is $\sim 10^{-4} h^3 Mpc^{-3} Gyr^{-1}$ at redshift $z\sim 0.1$. These events are taking place in the field; K+A galaxies don't primarily lie in the high-density environments or clusters typical of bulge-dominated populations.

A magnitude limited sample of nearly 9000 early-type galaxies, in the redshift range 0.01 < z < 0.3, was selected from the Sloan Digital Sky Survey using morphological and spectral criteria. The sample was used to study how early-type galaxy observables, including luminosity L, effective radius R_o, surface brightness I_o, color, and velocity dispersion sigma, are correlated with one another. Measurement biases are understood with mock catalogs which reproduce all of the observed scaling relations and their dependences on fitting technique. At any given redshift, the intrinsic distribution of luminosities, sizes and velocity dispersions in our sample are all approximately Gaussian. A maximum likelihood analysis shows that sigma ~ L^{0.25\pm 0.012}, R_o ~ L^{0.63\pm 0.025}, and R_o ~ I^{-0.75\pm 0.02} in the r* band. In addition, the mass-to-light ratio within the effective radius scales as M_o/L ~ L^{0.14\pm 0.02} or M_o/L ~ M_o^{0.22\pm 0.05}, and galaxies with larger effective masses have smaller effective densities: Delta_o ~ M_o^{-0.52\pm 0.03}. These relations are approximately the same in the g*, i* and z* bands. Relative to the population at the median redshift in the sample, galaxies at lower and higher redshifts have evolved only little, with more evolution in the bluer bands. The luminosity function is consistent with weak passive luminosity evolution and a formation time of about 9 Gyrs ago.

A sample of nearly 9000 early-type galaxies, in the redshift range 0.01 < z < 0.3, was selected from the Sloan Digital Sky Survey using morphological and spectral criteria. This paper describes how the sample was selected, presents examples of images and seeing corrected fits to the observed surface brightness profiles, describes our method for estimating K-corrections, and shows that the SDSS spectra are of sufficiently high quality to measure velocity dispersions accurately. It also provides catalogs of the measured photometric and spectroscopic parameters. In related papers, these data are used to study how early-type galaxy observables, including luminosity, effective radius, surface brightness, color, and velocity dispersion, are correlated with one another.

A magnitude limited sample of nearly 9000 early-type galaxies, in the redshift range 0.01 < z < 0.3, was selected from the Sloan Digital Sky Survey using morphological and spectral criteria. The Fundamental Plane relation in this sample is R_o ~ sigma^{1.49\pm 0.05} I_o^{-0.75\pm 0.01} in the r* band. It is approximately the same in the g*, i* and z* bands. Relative to the population at the median redshift in the sample, galaxies at lower and higher redshifts have evolved only little. If the Fundamental Plane is used to quantify this evolution then the apparent magnitude limit can masquerade as evolution; once this selection effect has been accounted for, the evolution is consistent with that of a passively evolving population which formed the bulk of its stars about 9 Gyrs ago. One of the principal advangtages of the SDSS sample over previous samples is that the galaxies in it lie in environments ranging from isolation in the field to the dense cores of clusters. The Fundamental Plane shows that galaxies in dense regions are slightly different from galaxies in less dense regions.

We combine Sloan Digital Sky Survey spectra of 22,000 luminous, red, bulge-dominated galaxies to get high S/N average spectra in the rest-frame optical and ultraviolet (2600A to 7000A). The average spectra of these massive, quiescent galaxies are early-type with weak emission lines and with absorption lines indicating an apparent excess of alpha elements over solar abundance ratios. We make average spectra of subsamples selected by luminosity, environment and redshift. The average spectra are remarkable in their similarity. What variations do exist in the average spectra as a function of luminosity and environment are found to form a nearly one-parameter family in spectrum space. We present a high signal-to-noise ratio spectrum of the variation. We measure the properties of the variation with a modified version of the Lick index system and compare to model spectra from stellar population syntheses. The variation may be a combination of age and chemical abundance differences, but the conservative conclusion is that the quality of the data considerably exceeds the current state of the models.

We study the mean environments of galaxies in the Sloan Digital Sky Survey as a function of rest-frame luminosity and color. Overdensities in galaxy number are estimated in $8 h^{-1} \mathrm{Mpc}$ and $1 h^{-1} \mathrm{Mpc}$ spheres centered on $125,000$ galaxies taken from the SDSS spectroscopic sample. We find that, at constant color, overdensity is independent of luminosity for galaxies with the blue colors of spirals. This suggests that, at fixed star-formation history, spiral-galaxy mass is a very weak function of environment. Overdensity does depend on luminosity for galaxies with the red colors of early types; both low-luminosity and high-luminosity red galaxies are found to be in highly overdense regions.

The K correction "corrects" for the fact that sources observed at different redshifts are, in general, compared with standards or each other at different rest-frame wavelengths. It is part of the relation between the emitted- or rest-frame absolute magnitude of a source in one broad photometric bandpass to the observed-frame apparent magnitude of the same source in another broad bandpass. This short pedagogical paper provides definitions of and equations for the K correction.

Using a catalog of 147,986 galaxy redshifts and fluxes from the Sloan Digital Sky Survey (SDSS) we measure the galaxy luminosity density at z=0.1 in five optical bandpasses corresponding to the SDSS bandpasses shifted to match their restframe shape at z=0.1. We denote the bands {0.1}{u}, {0.1}{g}, {0.1}{r}, {0.1}{i}, {0.1}{z}, with \lambda_{eff} = [3216, 4240, 5595, 6792, 8111] Angstroms respectively. We use a maximum likelihood method which allows for a general form for the shape of the luminosity function, simple luminosity and number evolution, incorporates flux uncertainties, and accounts for the flux limits of the survey. We find luminosity densities at z=0.1 in absolute AB magnitudes in a Mpc^3 of [-14.10 \pm 0.15, -15.18 \pm 0.03, -15.90 \pm 0.03, -16.24 \pm 0.03, -16.56 \pm 0.02] in [{0.1}{u}, {0.1}{g}, {0.1}{r}, {0.1}{i}, {0.1}{z}], respectively, using \Omega_0 =0.3, \Omega_\Lambda=0.7, and h=1, and using Petrosian magnitudes. Similar results are obtained using Sersic model magnitudes, suggesting that flux from outside the Petrosian apertures is not a major correction. In the {0.1}{r} band, the best fit Schechter function to our results has \phi_\ast = (1.49 \pm 0.04) \times 10^{-2} h^3 Mpc^{-3}, M_\ast - 5\log_{10} h = -20.44 \pm 0.01, and \alpha = -1.05\pm 0.01. In solar luminosities, the luminosity density in {0.1}{r} is (1.84 \pm 0.04) h 10^8 L_{{0.1}{r},\odot} Mpc^{-3}. Our results are consistent with other estimates of the luminosity density, from the Two-degree Field Galaxy Redshift Survey and the Millenium Galaxy Catalog. They represent a substantial change (\sim 0.5 mag) from earlier SDSS luminosity density results based on commissioning data, almost entirely because of the inclusion of evolution in the luminosity function model.

Broad-band measurements of flux for galaxies at different redshifts measure different regions of the rest-frame galaxy spectrum. Certain astronomical questions, such as the evolution of the luminosity function of galaxies, require transforming these magnitudes into redshift-independent quantities. To prepare to address these astronomical questions, investigated in detail in subsequent papers, we fit spectral energy distributions (SEDs) to broad band photometric observations, in the context of the optical observations of the Sloan Digital Sky Survey (SDSS). Linear combinations of four spectral templates can reproduce the five SDSS magnitudes of all galaxies to the precision of the photometry. Expressed in the appropriate coordinate system, the locus of the coefficients multiplying the templates is planar, and in fact nearly linear. The resulting reconstructed SEDs can be used to recover fixed frame magnitudes over a range of redshifts. This process yields consistent results, in the sense that within each sample the intrinsic colors of similar type galaxies are nearly constant with redshift. We compare our results to simpler interpolation methods and galaxy spectrophotometry from the SDSS. The software that generates these results is publicly available and easily adapted to handle a wide range of galaxy observations.

Using photometry and spectroscopy of 144,609 galaxies from the Sloan Digital Sky Survey, we present bivariate distributions of pairs of seven galaxy properties: four optical colors, surface brightness, radial profile shape as measured by the Sersic index, and absolute magnitude. In addition, we present the dependence of local galaxy density (smoothed on 8 h^{-1} Mpc scales) on all of these properties. Several classic, well-known relations among galaxy properties are evident at extremely high signal-to-noise ratio: the color-color relations of galaxies, the color-magnitude relations, the magnitude-surface brightness relation, and the dependence of density on color and absolute magnitude. We show that most of the i-band luminosity density in the universe is in the absolute magnitude and surface brightness ranges used. Some of the relationships between parameters, in particular the color--magnitude relations, show stronger correlations for exponential galaxies and concentrated galaxies taken separately than for all galaxies taken together. We provide a simple set of fits of the dependence of galaxy properties on luminosity for these two sets of galaxies.

A meta-analysis is performed of the literature on evolution in cosmic star-formation rate density from redshift unity to the present day. The measurements are extremely diverse, including radio, infrared, and ultraviolet broad-band photometric indicators, and visible and near-ultraviolet line-emission indicators. Although there is large scatter among indicators at any given redshift, virtually all studies find a significant decrease from redshift unity to the present day. This is the most heterogeneously confirmed result in the study of galaxy evolution. When comoving star-formation rate density is treated as being proportional to $(1+z)^{\beta}$, the meta-analysis gives a best-fit exponent and conservative confidence interval of $\beta= 2.7\pm 0.7$ in a world model with $(\Omega_M,\Omega_{\Lambda})=(0.3,0.7)$ and $\beta= 3.3\pm 0.8$ in $(\Omega_M,\Omega_{\Lambda})=(1.0,0.0)$. In either case these evolutionary trends are strong enough that the bulk of the stellar mass at the present day ought to be in old ($>6 \mathrm{Gyr}$) populations.

A complete sample of $7.7\times 10^4$ galaxies with five-band imaging and spectroscopic redshifts from the Sloan Digital Sky Survey is used to determine the fraction of the optical luminosity density of the Local Universe (redshifts $0.02<z<0.22$) emitted by red galaxies. The distribution in the space of rest-frame color, central surface brightness, and concentration is shown to be highly clustered and bimodal; galaxies fall primarily into one of two distinct classes. One class is red, concentrated and high in surface brightness; the other is bluer, less concentrated, and lower in central surface brightness. Elliptical and bulge-dominated galaxies preferentially belong to the red class. Even with a very restrictive definition of the red class that includes limits on color, surface brightness and concentration, the class comprises roughly one fifth of the number density of galaxies more luminous than $0.05 \Lstar$ and produces two fifths of the total cosmic galaxy luminosity density at $0.7 \mathrm{\mu m}$. The natural interpretation is that a large fraction of the stellar mass density of the Local Universe is in very old stellar populations.

A sample of nearly 9000 early-type galaxies, in the redshift range 0.01<z<0.3, was selected from the Sloan Digital Sky Survey using morphological and spectral criteria. The sample was used to study how early-type galaxy observables, including luminosity L, effective radius R, surface brightness I, color, and velocity dispersion V, are correlated with one another. Measurement biases are understood with mock catalogs which reproduce all of the observed scaling relations. At any given redshift, the intrinsic distribution of luminosities, sizes and velocity dispersions in our sample are all approximately Gaussian. In the r* band L ~ V^3.91, L ~ R^1.58, R ~ I^(-0.75), and the Fundamental Plane relation is R ~ V^(1.49) I^(-0.75). These relations are approximately the same in the g*, i* and z* bands. At fixed luminosity, the mass-to-light ratio scales as M/L ~ L^0.14. The g*-r* color scales as V^0.25. Color also correlates with magnitude and size, but these correlations are entirely due to the L-V and R-V relations. Chemical evolution and star formation histories are investigated using co-added spectra of similar objects in our sample. Chemical abundances correlate primarily with velocity dispersion. At fixed V, the higher redshift population is bluer, is weaker in Mg2, and is stronger in Hbeta than the population nearby. In addition, the population at higher redshifts is slightly more luminous. These differences are consistent with that of a passively evolving population which formed the bulk of its stars about 9 Gyrs ago. The Fundamental Plane suggests that galaxies in dense regions are slightly different from those in less dense regions, but the co-added spectra and color--magnitude relations show no statistically significant dependence on environment.

We describe the target selection and resulting properties of a spectroscopic sample of luminous, red galaxies (LRG) from the imaging data of the Sloan Digital Sky Survey (SDSS). These galaxies are selected on the basis of color and magnitude to yield a sample of luminous, intrinsically red galaxies that extends fainter and further than the main flux-limited portion of the SDSS galaxy spectroscopic sample. The sample is designed to impose a passively-evolving luminosity and rest-frame color cut to a redshift of 0.38. Additional, yet more luminous, red galaxies are included to a redshift of 0.5. Approximately 12 of these galaxies per square degree are targeted for spectroscopy, so the sample will number over 100,000 with the full survey. SDSS commissioning data indicate that the algorithm efficiently selects luminous (M_g=-21.4), red galaxies, that the spectroscopic success rate is very high, and that the resulting set of galaxies is approximately volume-limited out to z=0.38. When the SDSS is complete, the LRG spectroscopic sample will fill over 1h^-3 Gpc^3 with an approximately homogeneous population of galaxies and will therefore be well suited to studies of large-scale structure and clusters out to z=0.5.

An unsupervised software ``robot'' that automatically and robustly reduces and analyzes CCD observations of photometric standard stars is described. The robot measures extinction coefficients and other photometric parameters in real time and, more carefully, on the next day. It also reduces and analyzes data from an all-sky $10 \mu m$ camera to detect clouds; photometric data taken during cloudy periods are automatically rejected. The robot reports its findings back to observers and data analysts via the World-Wide Web. It can be used to assess photometricity, and to build data on site conditions. The robot's automated and uniform site monitoring represents a minimum standard for any observing site with queue scheduling, a public data archive, or likely participation in any future National Virtual Observatory.

We present bright galaxy number counts in five broad bands ($u', g', r', i', z'$) from imaging data taken during the commissioning phase of the Sloan Digital Sky Survey (SDSS). The counts are derived from two independent stripes of imaging scans along the Celestial Equator, one each toward the North and the South Galactic cap, covering about 230 and 210 square degrees, respectively. A careful study is made to verify the reliability of the photometric catalog. For galaxies brighter than $r^* = 16$, the catalog produced by automated software is examined against eye inspection of all objects. Statistically meaningful results on the galaxy counts are obtained in the magnitude range $12 \le r^* \le 21$, using a sample of 900,000 galaxies. The counts from the two stripes differ by about 30% at magnitudes brighter than $r^*= 15.5$, consistent with a local $2\sigma$ fluctuation due to large scale structure in the galaxy distribution. The shape of the number counts-magnitude relation brighter than $r^* = 16$ is well characterized by $N \propto 10^{0.6m}$, the relation expected for a homogeneous galaxy distribution in a ``Euclidean'' universe. In the magnitude range $ 16 < r^* < 21$, the galaxy counts from both stripes agree very well, and follow the prediction of the no-evolution model, although the data do not exclude a small amount of evolution. We use empirically determined color transformations to derive the galaxy number counts in the $B$ and $I_{814}$ bands. We compute the luminosity density of the universe at zero redshift in the five SDSS bands and in the $B$ band. We find ${\cal L}_{B} = 2.4 \pm 0.4 \times 10^8L_\odot h $Mpc$^{-3}$, for a reasonably wide range of parameters of the Schechter luminosity function in the $B$ band.

We present HST/STIS observations of the optical counterpart (OT) of the gamma-ray burster GRB 000301C obtained on 2000 March 6, five days after the burst. CCD clear aperture imaging reveals a R ~ 21.50+/-0.15 source with no apparent host galaxy. An 8000 s, 1150 < lambda/A < 3300 NUV-MAMA prism spectrum shows a relatively flat continuum (in f_lambda) between 2800 and 3300 A, with a mean flux 8.7 (+0.8,-1.6)+/- 2.6 10^(-18) ergs/s/cm^2/A, and a sharp break centered at 2797+/-25 A. We interpret it as HI Lyman break at z = 2.067+/-0.025 indicating the presence of a cloud with a HI column density log(HI) > 18 on the line-of-sight to the OT. This value is conservatively a lower limit to the GRB redshift. However, the facts that large N(HI) system are usually considered as progenitors of present day galaxies and that other OTs are found associated with star forming galaxies strongly suggest that it is the GRB redshift. In any case, this represents the largest direct redshift determination of a gamma-ray burster to date. Our data are compatible with an OT spectrum represented by a power-law with an intrinsic index \alpha = 1.2((f_nu \propto nu^-alpha) and no extinction in the host galaxy or with alpha = 0.5 and extinction by a SMC-like dust in the OT rest-frame with A_V = 0.15. The large N(HI) and the lack of detected host is similar to the situation for damped Ly-alpha absorbers at z > 2.

Formulae for the line-of-sight and transverse comoving distances, proper motion distance, angular diameter distance, luminosity distance, k-correction, distance modulus, comoving volume, lookback time, age, and object intersection probability are all given, some with justifications. Some attempt is made to rationalize disparate terminologies, or at least abuse bad usage.

In very crowded fields, the modulation of the background by the sea of unresolved faint sources induces centroid shifts. The errors increase with the number of sources per beam. Even the most optimistic simulations of imaging data show that position errors can become severe (on the order of the beam size) at flux levels at which images contain 1/50 to 1/15 sources per beam, depending on the slope of the number-flux relation $d\log N/d\log S$. These problems are expected to be significant for recent observations of faint submillimeter sources and may be the reason that some sources appear to lack optical counterparts.

A clustering analysis is performed on two samples of $\sim 600$ faint galaxies each, in two widely separated regions of the sky, including the Hubble Deep Field. One of the survey regions is configured so that some galaxy pairs span angular separations of up to 1 deg. The median redshift is $z_{med}\approx 0.55$. Strong clustering is obvious, with every pencil-beam field containing a handful of narrow redshift-space features, corresponding to galaxy structures with sizes of 5 to 20 Mpc. The structures are not obviously organized on planes, though one prominent, colinear triplet of structures is observed, spanning $\sim 20$ Mpc. This may be evidence of a filament. A galaxy--galaxy correlation function calculation is performed. No significant evolution of clustering (relative to stable clustering) is found in the redshift range 0.3<z<1.0. This is not surprising, since uncertainties in the correlation amplitude estimated from surveys like these are large; field-to-field variations and covariances between data points are both shown to be significant. Consistent with other studies in this redshift range, the galaxy--galaxy correlation length is found to be somewhat smaller than that predicted from local measurements and an assumption of no evolution. Galaxies with absorption-line-dominated spectra show much stronger clustering at distances of <2 Mpc than typical field galaxies. There is some evidence for weaker clustering at intermediate redshift than at low redshift, when the results presented here are compared with surveys of the local Universe. In subsets of the data, the measured pairwise velocity dispersion of galaxies ranges from 200 to $600 km s^{-1}$, depending on the properties of the dominant redshift structures in each subset.

Morphological classifications are reported for Hubble Space Telescope (HST) images of 241 galaxies in the Hubble Deep Field (HDF) and its Flanking Fields (FF) with measured redshifts in the interval 0.25 < z < 1.2, drawn from a magnitude-limited redshift survey to R = 24.0. The galaxies are divided into three groups with redshifts in the intervals [0.25,0.6], [0.6,0.8], [0.8,1.2]. R606 images from the first group and I814 images from the second and third groups are compared with B-band images of nearby galaxies. All classifications were therefore made at approximately the same rest wavelength. Selection biases are discussed. We corroborate and extend the results of earlier investigations by observing that: Most intermediate and late-type galaxies with $z\gtrsim0.5$ have morphologies that are dramatically different from those of local galaxies and cannot be shoehorned into the Hubble ``tuning fork'' classification scheme. Grand-design spirals appear to be rare or absent for $z\gtrsim0.3$. Many Sa and Sb spirals with $z\gtrsim0.6$ do not exhibit well-defined spiral arms. The arms of distant Sc galaxies appear more chaotic than those of their nearby counterparts. (abridged) On the basis of these and similar observations, it is inferred that the development of pronounced spiral structure was delayed until \~5 Gyr and that most bulges are probably not formed by disintegrating bars. Major morphological changes were still taking place only ~5 Gyr ago even though changes in the integrated light of most galaxies were then much slower than they were ~10 Gyr ago.

A redshift survey has been carried out in the region of the Hubble Deep Field North using the Low Resolution Imaging Spectrograph at the Keck Observatory. The resulting redshift catalog, which contains 671 entries, is a compendium of our own data together with published LRIS/Keck data. It is more than 92% complete for objects, irrespective of morphology, to $R = 24$ mag in the HDF itself and to $R = 23$ mag in the Flanking Fields within a diameter of 8 arcmin centered on the HDF, an unusually high completion for a magnitude limited survey performed with a large telescope. A median redshift $z = 1.0$ is reached at $R \sim 23.8$. Strong peaks in the redshift distribution, which arise when a group or poor cluster of galaxies intersect the area surveyed, can be identified to $z \sim 1.2$ in this dataset. More than 68% of the galaxies are members of these redshift peaks. In a few cases, closely spaced peaks in $z$ can be resolved into separate groups of galaxies that can be distinguished in both velocity and location on the sky. The radial separation of these peaks in the pencil-beam survey is consistent with a characteristic length scale for the their separation of $\approx$70 Mpc in our adopted cosmology ($h = 0.6, \Omega_M = 0.3$, $\Lambda = 0$). Strong galaxy clustering is in evidence at all epochs back to $z \le 1.1$. (abstract abridged)

The good match of the type Ia supernova (SNIa) Hubble Diagram to the prediction of a not-unreasonable cosmological world model shows that measurements of standard stars and their comparison with point sources down to m=25 mag is good to better than +/-0.5 mag over an 11 mag range. It also shows that the true spectral energy distribution (SED) shapes of standard stars are known to better than +/-0.5 mag over an octave in wavelength. On the other hand, the SNIa argument for an accelerating Universe assumes that the magnitude system is good to much better than ~0.1 mag over the 11 mag range, and that SED shapes are known to much better than ~10 percent over an octave in wavelength. There is no independent empirical evidence for these plausible assumptions.

The rate of mass accumulation due to galaxy merging depends on the mass, density, and velocity distribution of galaxies in the near neighborhood of a host galaxy. The fractional luminosity in kinematic pairs combines all of these effects in a single estimator which is relatively insensitive to population evolution. Here we use a k-corrected and evolution compensated volume-limited sample drawing about 300 redshifts from CFGRS and 3000 from CNOC2 to measure the rate and redshift evolution of merging. We identify kinematic pairs with projected separations less than either 50 or 100 \hkpc and rest-frame velocity differences of less than 1000\kms. The fractional luminosity in pairs is modeled as f_L(Delta v,r_p,M_r^{ke})(1+z)^{m_L} where [f_L,m_L] are [0.14+/-0.07,0+/-1.4] and [0.37+/-0.7,0.1+/-0.5] for r_p<= 50 and 100\hkpc, respectively (Omega_M=0.2, Omega_Lambda=0.8). The value of m_L is about 0.6 larger if Lambda=0. To convert these redshift space statistics to a merger rate we use the data to derive a conversion factor to physical space pair density, a merger probability and a mean in-spiral time. The resulting mass accretion rate per galaxy (M_1,M_2>= 0.2 M*) is 0.02+/-0.01(1+z)^{0.1+/-0.5} M*~Gyr^{-1}. Present day high-luminosity galaxies therefore have accreted approximately 0.15M* of their mass over the approximately 7 Gyr to redshift one. (abridged)

The combination of deep exposures and high resolution offered by telescopes in space allows the detection of lensing over a wide range of source redshifts and lens masses. As an example, we model a lens candidate found in the southern Hubble Deep Field. The system consists of a source galaxy lensed into an arc, 0.9 arcseconds from an elliptical galaxy with an implied mass-to-light ratio of order 15 in solar units. This lens system may be a preview of the large number of lensed high-redshift galaxies that will be detected with the Next Generation Space Telescope (NGST). Popular models of structure formation imply that roughly 3% of observed sources at z>5 should be multiply imaged. Thus, NGST should detect several lensed objects in each field of view. In addition, NGST will be a valuable tool for weak lensing measurements if it can resolve the background galaxies. We estimate the angular size distribution of high redshift sources within hierarchical models of structure formation and find that most will be resolved. (abridged)

Images of the Hubble Deep Field at 3.2 um, taken with the 10-m Keck Telescope, are presented. The images cover a total area of ~2.5 arcmin^2. To a 5-sigma limit of [3.2](total)=17.5 mag (Vega-relative), 11 sources are detected, 9 of which are extragalactic. The integrated galaxy number counts are therefore ~1.3x10^4 deg^{-2} to this depth. The galaxies detected at 3.2 um have a median redshift of z=0.56. All 3.2 um sources have 1.6 um, 1.1 um and visual counterparts, all of fairly regular morphologies; several also have 6.7 um, 15 um, 850 um, 8.5 GHz, or 1.4 GHz counterparts. No sources are found which are either anomalously red or anomalously blue in their H-[3.2] color, and there are significant detections of most of the known near-infrared HDF sources for which detection in these 3.2 um data seemed likely.

Detection and photometry of sources in the U_n, G, R, and K_s bands in a 9x9 arcmin^2 region of the sky, centered on the Hubble Deep Field, are described. The data permit construction of complete photometric catalogs to roughly U_n=25, G=26, R=25.5 and K_s=20 mag, and significant photometric measurements somewhat fainter. The galaxy number density is 1.3x10^5 deg^{-2} to R=25.0 mag. Galaxy number counts have slopes dlog N/dm=0.42, 0.33, 0.27 and 0.31 in the U_n, G, R and K_s bands, consistent with previous studies and the trend that fainter galaxies are, on average, bluer. Galaxy catalogs selected in the R and K_s bands are presented, containing 3607 and 488 sources, in field areas of 74.8 and 59.4 arcmin^2, to R=25.5 and and K_s=20 mag.

We report on HST and Palomar optical images of the field of GRB 990123, obtained on 8 and 9 February 1999. We find that the optical transient (OT) associated with GRB 990123 is located on an irregular galaxy, with magnitude V=24.20 +/- 0.15. The strong metal absorption lines seen in the spectrum of the OT, along with the low probability of a chance superposition, lead us to conclude that this galaxy is the host of the GRB. The OT is projected within the ~1'' visible stellar field of the host, nearer the edge than the center. We cannot, on this basis, rule out the galactic nucleus as the site of the GRB, since the unusual morphology of the host may be the result of an ongoing galactic merger, but our demonstration that this host galaxy has extremely blue optical to infrared colors more strongly supports an association between GRBs and star formation. We find that the OT magnitude on 1999 Feb 9.05, V = 25.45 +/- 0.15, is about 1.5 mag fainter than expected from extrapolation of the decay rate found in earlier observations. A detailed analysis of the OT light curve suggests that its fading has gone through three distinct phases: an early rapid decline (f_{nu} \propto t^{-1.6} for t < 0.1 days), a slower intermediate decline power-law decay (f_{nu} \propto t^{-1.1} for 0.1 < t < 2 days), and then a more rapid decay (at least as steep as (f_{\nu} \propto t^{-1.8} for t > 2 days). The break to steeper slope at late times may provide evidence that the optical emission from this GRB was highly beamed.

The observed redshifts and magnitudes of the host galaxies of gamma-ray bursts (GRBs) are compared with the predictions of three basic GRB models, in which the comoving rate density of GRBs is (1) proportional to the cosmic star formation rate density, (2) proportional to the total integrated stellar density and (3) constant. All three models make the assumption that at every epoch the probability of a GRB occuring in a galaxy is proportional to that galaxy's broad-band luminosity. No assumption is made that GRBs are standard candles or even that their luminosity function is narrow. All three rate density models are consistent with the observed GRB host galaxies to date, although model (2) is slightly disfavored relative to the others. Models (1) and (3) make very similar predictions for host galaxy magnitude and redshift distributions; these models will be probably not be distinguished without measurements of host-galaxy star-formation rates. The fraction of host galaxies fainter than 28 mag may constrain the faint end of the galaxy luminosity function at high redshift, or, if the fraction is observed to be low, may suggest that the bursters are expelled from low-luminosity hosts. In all models, the probability of finding a z<0.008 GRB among a sample of 11 GRBs is less than 10^(-4), strongly suggesting that GRB 980425, if associated with supernova 1998bw, represents a distinct class of GRBs.

We model an apparent gravitational lens system HDFS 2232509-603243 in the Hubble Deep Field South. The system consists of a blue V=25 mag arc separated by 0.9 arcsec from a red V=22 mag elliptical galaxy. A mass distribution which follows the observed light distribution with a constant mass-to-light ratio can fit the arc component positions if external shear is added. A good fit is also obtained with simple parameterized models, and all the models predict a forth image fainter than the detection limit. The inferred mass-to-light ratio is roughly 15 in solar units if the lens is at redshift 0.6. The lens models predict a velocity dispersion of about 280 km/s which could be confirmed with spectroscopy.