As cosmic structures form, matter density fluctuations collapse gravitationally and baryonic matter is shock-heated and thermalized. We therefore expect a connection between the mean gravitational potential energy density of collapsed halos, $\Omega_{W}^{\rm halo}$, and the mean thermal energy density of baryons, $\Omega_{\rm th}$. These quantities can be obtained using two fundamentally different estimates: we compute $\Omega_{W}^{\rm halo}$ using the theoretical framework of the halo model which is driven by dark matter statistics, and measure $\Omega_{\rm th}$ using the Sunyaev-Zeldovich (SZ) effect which probes the mean thermal pressure of baryons. First, we derive that, at the present time, about 90% of $\Omega_{W}^{\rm halo}$ originates from massive halos with $M>10^{13}\,M_\odot$. Then, using our measurements of the SZ background, we find that $\Omega_{\rm th}$ accounts for about 80% of the kinetic energy of the baryons available for pressure in halos at $z\lesssim 0.5$. This constrains the amount of non-thermal pressure, e.g., due to bulk and turbulent gas motion sourced by mass accretion, to be about $\Omega_{\rm non-th}\simeq 0.4\times 10^{-8}$ at $z=0$.

The cosmic thermal history, quantified by the evolution of the mean thermal energy density in the universe, is driven by the growth of structures as baryons get shock-heated in collapsing dark matter halos. This process can be probed by redshift-dependent amplitudes of the thermal Sunyaev-Zeldovich (SZ) effect background. To do so, we cross-correlate eight sky intensity maps in the $\it{Planck}$ and Infrared Astronomical Satellite missions with two million spectroscopic-redshift references in the Sloan Digital Sky Surveys. This delivers snapshot spectra for the far-infrared to microwave background light as a function of redshift up to $z\sim3$. We decompose them into the SZ and thermal dust components. Our SZ measurements directly constrain $\langle bP_{\rm e} \rangle$, the halo bias-weighted mean electron pressure, up to $z\sim 1$. This is the highest redshift achieved to date, with uncorrelated redshift bins thanks to the spectroscopic references. We detect a threefold increase in the density-weighted mean electron temperature $\bar{T}_{\rm{e}}$ from $7\times 10^5~{\rm K}$ at $z=1$ to $2\times 10^6~{\rm K}$ today. Over $z=1$-$0$, we witness the build up of nearly $70\%$ of the present-day mean thermal energy density $\rho_{\rm{th}}$, with the corresponding density parameter $\Omega_{\rm th}$ reaching $1.5 \times10^{-8}$. We find the mass bias parameter of $\it{Planck}$'s universal pressure profile of $B=1.27$ (or $1-b=1/B=0.79$), consistent with the magnitude of non-thermal pressure in gas motion and turbulence from mass assembly. We estimate the redshift-integrated mean Compton parameter $y\sim1.2\times10^{-6}$, which will be tested by future spectral distortion experiments. More than half of which originates from large-scale structure at $z<1$, which we detect directly.

Scientists aim to extract simplicity from observations of the complex world. An important component of this process is the exploration of data in search of trends. In practice, however, this tends to be more of an art than a science. Among all trends existing in the natural world, one-dimensional trends, often called sequences, are of particular interest as they provide insights into simple phenomena. However, some are challenging to detect as they may be expressed in complex manners. We present the Sequencer, an algorithm designed to generically identify the main trend in a dataset. It does so by constructing graphs describing the similarities between pairs of observations, computed with a set of metrics and scales. Using the fact that continuous trends lead to more elongated graphs, the algorithm can identify which aspects of the data are relevant in establishing a global sequence. Such an approach can be used beyond the proposed algorithm and can optimize the parameters of any dimensionality reduction technique. We demonstrate the power of the Sequencer using real-world data from astronomy, geology as well as images from the natural world. We show that, in a number of cases, it outperforms the popular t-SNE and UMAP dimensionality reduction techniques. This approach to exploratory data analysis, which does not rely on training nor tuning of any parameter, has the potential to enable discoveries in a wide range of scientific domains. The source code is available on github and we provide an online interface at \url{http://sequencer.org}.

Parameter estimation with non-Gaussian stochastic fields is a common challenge in astrophysics and cosmology. In this paper we advocate performing this task using the scattering transform, a statistical tool rooted in the mathematical properties of convolutional neural nets. This estimator can characterize a complex field without explicitly computing higher-order statistics, thus avoiding the high variance and dimensionality problems. It generates a compact set of coefficients which can be used as robust summary statistics for non-Gaussian information. It is especially suited for fields presenting localized structures and hierarchical clustering, such as the cosmological density field. To demonstrate its power, we apply this estimator to the cosmological parameter inference problem in the context of weak lensing. Using simulated convergence maps with realistic noise, the scattering transform outperforms the power spectrum and peak counts, and is on par with the state-of-the-art CNN. It retains the advantages of traditional statistical descriptors (it does not require any training nor tuning), has provable stability properties, allows to check for systematics, and importantly, the scattering coefficients are interpretable. It is a powerful and attractive estimator for observational cosmology and, in general, the study of physically-motivated fields.

Double white dwarf (double-WD) binaries may merge within a Hubble time and produce high-mass WDs. Compared to other high-mass WDs, the double-WD merger products have higher velocity dispersion because they are older. With the power of Gaia data, we show strong evidence for double-WD merger products among high-mass WDs by analyzing the transverse-velocity distribution of more than a thousand high-mass WDs (0.8--1.3 $M_\odot$). We estimate that the fraction of double-WD merger products in our sample is about 20 %. We also obtain a precise double-WD merger rate and its mass dependence. Our merger rate estimates are close to binary population synthesis results and support the idea that double-WD mergers may contribute to a significant fraction of type Ia supernovae.

Recently, the power of Gaia data has revealed an enhancement of high-mass white dwarfs (WDs) on the Hertzsprung--Russell diagram, called the Q branch. This branch is located at the high-mass end of the recently identified crystallization branch. Investigating its properties, we find that the number density and velocity distribution on the Q branch cannot be explained by the cooling delay of crystallization alone, suggesting the existence of an extra cooling delay. To quantify this delay, we statistically compare two age indicators -- the dynamical age inferred from transverse velocity, and the photometric isochrone age -- for more than one thousand high-mass WDs (1.08--1.23 $M_\odot$) selected from Gaia Data Release 2. We show that about 6 % of the high-mass WDs must experience an 8 Gyr extra cooling delay on the Q branch, in addition to the crystallization and merger delays. This cooling anomaly is a challenge for WD cooling models. We point out that $^{22}$Ne settling in C/O-core WDs could account for this extra cooling delay.

Cosmic photons can be efficiently collected by broadband intensity mapping but information on their emission redshift and frequency is largely lost. We introduce a technique to statistically recover these otherwise collapsed dimensions by exploiting information in spatial fluctuations and apply it to the Galaxy Evolution Explorer (GALEX) All Sky and Medium Imaging Surveys. By spatially cross-correlating photons in the GALEX far-UV (1500A) and near-UV (2300A) bands with a million spectroscopic objects in the Sloan Digital Sky Survey as a function of redshift, we robustly detect the redshift-dependent intensity of the UV background (UVB) modulated by its clustering bias up to $z\sim2$. These measurements clearly reveal the imprints of UVB spectral features redshifting through the filters. Using a simple parameterization, we simultaneously fit a UVB emissivity and clustering bias factor to these observations and constrain the main spectral features of the UVB spectrum: (i) the Lyman break, (ii) the non-ionizing UV continuum, which agrees with the Haardt & Madau model but does not rely on any assumption regarding the nature of the sources, and (iii) the Ly$\alpha$ emission, whose luminosity density is consistent with estimates of the combined galaxy and AGN contributions at $z\sim1$. Because the technique probes the total background including low surface brightness emission, we place constraints on the amount of UV light originating from the diffuse intergalactic medium (IGM). Finally, the clustering bias of UV photons is found to be chromatic and evolving. Our frequency- and redshift-dependent UVB measurement delivers a summary statistic of the universe's net radiation output from stars, black holes, and the IGM combined.

The scaling relations between supermassive black holes and their host galaxy properties are of fundamental importance in the context black hole-host galaxy co-evolution throughout cosmic time. In this work, we use a novel algorithm that identifies smooth trends in complex datasets and apply it to a sample of 2,000 type I active galactic nuclei (AGN) spectra. We detect a sequence in emission line shapes and strengths which reveals a correlation between the narrow L([OIII])/L(H$\beta$) line ratio and the width of the broad H$\alpha$. This scaling relation ties the kinematics of the gas clouds in the broad line region to the ionisation state of the narrow line region, connecting the properties of gas clouds kiloparsecs away from the black hole to material gravitationally bound to it on sub-parsec scales. This relation can be used to estimate black hole masses from narrow emission lines only. It therefore enables black hole mass estimation for obscured type II AGN and allows us to explore the connection between black holes and host galaxy properties for thousands of objects, well beyond the local Universe. Using this technique, we present the $M_{\mathrm{BH}} - \sigma$ and $M_{\mathrm{BH}} - M_{*}$ scaling relations for a sample of about 10,000 type II AGN from SDSS. These relations are remarkably consistent with those observed for type I AGN, suggesting that this new method may perform as reliably as the classical estimate used in non-obscured type I AGN. These findings open a new window for studies of black hole-host galaxy co-evolution throughout cosmic time.

Extragalactic astronomy relies on the accurate estimation of source photometry corrected for Milky Way dust extinction. This has motivated the creation of a number of "Galactic" dust maps. We investigate whether these maps are contaminated by extragalactic signals using the clustering-redshift technique, i.e., by measuring a set of angular cross-correlations with spectroscopic objects as a function of redshift. Our tomographic analysis reveals imprints of extragalactic large-scale structure patterns in nine out of 10 Galactic dust maps, including all infrared-based maps as well as "stellar" reddening maps. When such maps are used for extinction corrections, this extragalactic contamination introduces redshift- and scale-dependent biases in photometric estimates at the millimagnitude level. It can affect both object-based analyses, such as the estimation of the Hubble diagram with supernovae, as well as spatial statistics. The bias can be appreciable when measuring angular correlation functions with low amplitudes, such as lensing-induced correlations or angular correlations for sources distributed over a broad redshift range. As expected, we do not detect any extragalactic contamination for the dust map inferred from 21cm HI observations. Such a map provides an alternative to widely used infrared-based maps but relies on the assumption of a constant dust-to-gas ratio. We note that, using the WISE 12 micron map sensitive to polycyclic aromatic hydrocarbons (PAH), an indirect dust tracer, we detect the diffuse extragalactic PAH background up to $z\sim2$. Finally, we provide a procedure to minimize the level of biased magnitude corrections in maps with extragalactic imprints.

Luminous red galaxies (LRGs) are the most massive galaxies at $z\sim 0.5$ and, by selection, have negligible star formation. These objects have halo masses between those of $L_{*}$ galaxies, whose circumgalactic media (CGM) are observed to have large masses of cold gas, and clusters of galaxies, which primarily contain hot gas. Here we report detections of strong and extended metal (CIII 977) and HI lines in the CGM of two LRGs. The CIII lines have equivalent widths of $\sim 1.8$ \r{A} and $\sim 1.2$ \r{A} , and velocity spreads of $\sim 796$ km s$^{-1}$ and $\sim 1245$ km s$^{-1}$, exceeding all such measurements from local $\sim L_{*}$ galaxies (maximal CIII equivalent widths $\sim 1$ \r{A}). The data demonstrate that a subset of halos hosting very massive, quenched galaxies contain significant complexes of cold gas. Possible scenarios to explain our observations include that the LRGs' CGM originate from past activity (e.g., star formation or active galactic nuclei driven outflows) or from the CGM of galaxies in overlapping subhalos. We favor the latter scenario, in which the properties of the CGM are more tightly linked to the underlying dark matter halo than properties of the targeted galaxies (e.g., star formation).

SPHEREx is a proposed NASA MIDEX mission selected for Phase A study. SPHEREx would carry out the first all-sky spectral survey in the near infrared. At the end of its two-year mission, SPHEREx would obtain 0.75-to-5$\mu$m spectra of every 6.2 arcsec pixel on the sky, with spectral resolution R>35 and a 5-$\sigma$ sensitivity AB$>$19 per spectral/spatial resolution element. More details concerning SPHEREx are available at http://spherex.caltech.edu. The SPHEREx team has proposed three specific science investigations to be carried out with this unique data set: cosmic inflation, interstellar and circumstellar ices, and the extra-galactic background light. Though these three themes are undoubtedly compelling, they are far from exhausting the scientific output of SPHEREx. Indeed, SPHEREx would create a unique all-sky spectral database including spectra of very large numbers of astronomical and solar system targets, including both extended and diffuse sources. These spectra would enable a wide variety of investigations, and the SPHEREx team is dedicated to making the data available to the community to enable these investigations, which we refer to as Legacy Science. To that end, we have sponsored two workshops for the general scientific community to identify the most interesting Legacy Science themes and to ensure that the SPHEREx data products are responsive to their needs. In February of 2016, some 50 scientists from all fields met in Pasadena to develop these themes and to understand their implications for the SPHEREx mission. The 2016 workshop highlighted many synergies between SPHEREx and other contemporaneous astronomical missions, facilities, and databases. Consequently, in January 2018 we convened a second workshop at the Center for Astrophysics in Cambridge to focus specifically on these synergies. This white paper reports on the results of the 2018 SPHEREx workshop.

We investigate the limitations of statistical absorption measurements with the SDSS optical spectroscopic surveys. We show that changes in the data reduction strategy throughout different data releases have led to a better accuracy at long wavelengths, in particular for sky line subtraction, but a degradation at short wavelengths with the emergence of systematic spectral features with an amplitude of about one percent. We show that these features originate from inaccuracy in the fitting of modeled F-star spectra used for flux calibration. The best-fit models for those stars are found to systematically over-estimate the strength of metal lines and under-estimate that of Lithium. We also identify the existence of artifacts due to masking and interpolation procedures at the wavelengths of the hydrogen Balmer series leading to the existence of artificial Balmer $\alpha$ absorption in all SDSS optical spectra. All these effects occur in the rest-frame of the standard stars and therefore present Galactic longitude variations due to the rotation of the Galaxy. We demonstrate that the detection of certain weak absorption lines reported in the literature are solely due to calibration effects. Finally, we discuss new strategies to mitigate these issues.

We present \textsl{Hubble Space Telescope} (\textsl{HST}) F606W-band imaging observations of 21 galaxy-Ly$\alpha$ emitter lens candidates in the Baryon Oscillation Spectroscopic Survey (BOSS) Emission-Line Lens Survey (BELLS) for GALaxy-Ly$\alpha$ EmitteR sYstems (BELLS GALLERY) survey. 17 systems are confirmed to be definite lenses with unambiguous evidence of multiple imaging. The lenses are primarily massive early-type galaxies (ETGs) at redshifts of approximately $0.55$, while the lensed sources are Ly$\alpha$ emitters (LAEs) at redshifts from 2 to 3. Although the \textsl{HST} imaging data are well fit by smooth lens models consisting of singular isothermal ellipsoids in an external shear field, a thorough exploration of dark substructures in the lens galaxies is required. The Einstein radii of the BELLS GALLERY lenses are on average $60\%$ larger than those of the BELLS lenses because of the much higher source redshifts which will allow a detailed investigation of the radius evolution of the mass profile in ETGs. With the aid of the average $\sim 13 \times$ lensing magnification, the LAEs are resolved to comprise individual star-forming knots of a wide range of properties with characteristic sizes from less than 100 pc to several kpc, rest-frame far UV apparent AB magnitudes from 29.6 to 24.2, and typical projected separations of 500 pc to 2 kpc.

Using a sample of nearly half million galaxies, intersected by over 7 million lines of sight from the Sloan Digital Sky Survey Data Release 12, we trace H$\alpha$ + [N{\small II}] emission from a galactocentric projected radius, $r_p$, of 5 kpc to more than 100 kpc. The emission flux surface brightness is $\propto r_p^{-1.9 \pm 0.4}$. We obtain consistent results using only the H$\alpha$ or [N{\small II}] flux. We measure a stronger signal for the bluer half of the target sample than for the redder half on small scales, $r_p <$ 20 kpc. We obtain a $3\sigma$ detection of H$\alpha$ + [N{\small II}] emission in the 50 to 100 kpc $r_p$ bin. The mean emission flux within this bin is $(1.10 \pm 0.35) \times 10^{-20}$ erg cm$^{-2}$ s$^{-1}$ \AA$^{-1}$, which corresponds to $1.87 \times 10^{-20}$ erg cm$^{-2}$ s$^{-1}$ arcsec$^{-2}$ or 0.0033 Rayleigh. This detection is 34 times fainter than a previous strict limit obtained using deep narrow-band imaging. The faintness of the signal demonstrates why it has been so difficult to trace recombination radiation out to large radii around galaxies. This signal, combined with published estimates of n$_{\rm H}$, lead us to estimate the temperature of the gas to be 12,000 K, consistent with independent empirical estimates based on metal ion absorption lines and expectations from numerical simulations.

We compare predictions of a number of empirical models and numerical simulations of galaxy formation to the conditional stellar mass functions (CSMF)of galaxies in groups of different masses obtained recently by Lan et al. to test how well different models accommodate the data. The observational data clearly prefer a model in which star formation in low-mass halos changes behavior at a characteristic redshift $z_c\sim 2$. There is also tentative evidence that this characteristic redshift depends on environment, becoming $z_c\sim 4$ in regions that eventually evolve into rich clusters of galaxies. The constrained model is used to understand how galaxies form and evolve in dark matter halos, and to make predictions for other statistical properties of the galaxy population, such as the stellar mass functions of galaxies at high $z$, the star formation and stellar mass assembly histories in dark matter halos. A comparison of our model predictions with those of other empirical models shows that different models can make vastly different predictions, even though all of them are tuned to match the observed stellar mass functions of galaxies.

We characterize the luminosity functions of galaxies residing in $z\sim0$ groups and clusters over the broadest ranges of luminosity and mass reachable by the Sloan Digital Sky Survey. Our measurements cover four orders of magnitude in luminosity, down to about $M_r=-12$ mag or $L=10^7\,L_\odot$, and three orders of magnitude in halo mass, from $10^{12}$ to $10^{15} \, {\rm M}_\odot$. We find a characteristic scale, $M_r\sim-18$ mag or $L\sim10^9\, L_\odot$, below which the slope of the luminosity function becomes systematically steeper. This trend is present for all halo masses and originates mostly from red satellites. This ubiquitous faint-end upturn suggests that it is formation, rather than halo-specific environmental effect, that plays a major role in regulating the stellar masses of faint satellites. We show that the satellite luminosity functions can be described in a simple manner by a double Schechter function with amplitudes scaling with halo mass over the entire range of observables. Combining these conditional luminosity functions with the dark matter halo mass function, we accurately recover the entire field luminosity function over 10 visual magnitudes and reveal that satellite galaxies dominate the field luminosity function at magnitudes fainter than $-17$. We find that the luminosity functions of blue and red satellite galaxies show distinct shapes and we present estimates of the stellar mass fraction as a function of halo mass and galaxy type. Finally, using a simple model, we demonstrate that the abundances and the faint-end slopes of blue and red satellite galaxies can be interpreted in terms of their formation history, with two distinct modes separated by some characteristic time.

We apply clustering-based redshift inference to all extended sources from the Sloan Digital Sky Survey photometric catalogue, down to magnitude r = 22. We map the relationships between colours and redshift, without assumption of the sources' spectral energy distributions (SED). We identify and locate star-forming, quiescent galaxies, and AGN, as well as colour changes due to spectral features, such as the 4000 \AA{} break, redshifting through specific filters. Our mapping is globally in good agreement with colour-redshift tracks computed with SED templates, but reveals informative differences, such as the need for a lower fraction of M-type stars in certain templates. We compare our clustering-redshift estimates to photometric redshifts and find these two independent estimators to be in good agreement at each limiting magnitude considered. Finally, we present the global clustering-redshift distribution of all Sloan extended sources, showing objects up to z ~ 0.8. While the overall shape agrees with that inferred from photometric redshifts, the clustering redshift technique results in a smoother distribution, with no indication of structure in redshift space suggested by the photometric redshift estimates (likely artifacts imprinted by their spectroscopic training set). We also infer a higher fraction of high redshift objects. The mapping between the four observed colours and redshift can be used to estimate the redshift probability distribution function of individual galaxies. This work is an initial step towards producing a general mapping between redshift and all available observables in the photometric space, including brightness, size, concentration, and ellipticity.

The Two-Micron All-Sky Survey (2MASS) has mapped out the low-redshift Universe down to $K_S\sim14$ mag. As its near-infrared photometry primarily probes the featureless Rayleigh-Jeans tail of galaxy spectral energy distributions, colour-based redshift estimation is rather uninformative. Until now, redshift estimates for this dataset have relied on optical follow-up suffering from selection biases. Here we use the newly-developed technique of clustering-based redshift estimation to infer the redshift distribution of the 2MASS sources regardless of their optical properties. We characterise redshift distributions of objects from the Extended Source Catalogue as a function of near-infrared colours and brightness and report some observed trends. We also apply the clustering redshift technique to dropout populations, sources with non-detections in one or more near-infrared bands, and present their redshift distributions. Combining all extended sources, we confirm with clustering redshifts that the distribution of this sample extends up to $z\sim0.35$. % We perform a similar analysis with the Point Source Catalogue and show that it can be separated into stellar and extragalactic contributions with galaxies reaching $z\sim0.7$. We estimate that the Point Source Catalogue contains 1.6 million extragalactic objects: as many as in the Extended Source Catalogue but probing a cosmic volume ten times larger.

We use star, galaxy and quasar spectra taken by the Sloan Digital Sky Survey to map out the distribution of diffuse interstellar bands (DIBs) induced by the Milky Way. We show that, after carefully removing the intrinsic spectral energy distribution of each source, it is possible to measure statistical flux fluctuations at the 1e-3 level, detect more than 20 DIBs and measure their strength as a function of position on the sky. We create a map of DIB absorption covering about 5000 square degrees and measure correlations with various tracers of the interstellar medium: atomic and molecular hydrogen, dust and polycyclic aromatic hydrocarbons (PAHs). After recovering known correlations, we show that each DIB has a different dependence on atomic and molecular hydrogen: while they are all positively correlated with N(HI), they exhibit a range of behaviours with N(H2) showing positive, negative or no correlation. We show that a simple parametrization involving only N(HI) and N(H2) applied to all the DIBs is sufficient to reproduce a large collection of observational results reported in the literature: it allows us to naturally describe the relations between DIB strength and dust reddening (including the so-called skin effect), the related scatter, DIB pair-wise correlations & families, the affinity for $\sigma/\zeta$-type environments and other correlations related to molecules. Our approach allows us to characterize DIB dependencies in a simple manner and provides us with a metric to characterize the similarity between different DIBs.

We map out calcium II & sodium I absorption (Fraunhofer H, K & D lines) induced by both the interstellar medium and the circumgalactic medium of the Milky Way. Our measurements cover more than $9000$ deg$^2$ and make use of about $300,000$ extragalactic spectra from the Sloan Digital Sky Survey. We present absorption maps for these two species and then compare their distributions to those of neutral hydrogen and dust. We show that the abundance of Na I with respect to neutral hydrogen stays roughly constant in different environments, while that of Ca II decreases with hydrogen column density. Studying how these tracers vary as a function of velocity, we show that, on average, the N(Na I)/N(Ca II) ratio decreases at higher velocity with respect to the local standard of rest, similar to the local Routly-Spitzer effect but seen on Galactic scale. We show that it is likely caused by higher gas/dust density at lower velocity. Finally, we show that Galactic Ca II and Na I absorption needs to be taken into account for precision photometry and, more importantly, for photometric redshift estimation with star forming galaxies. Our maps of Ca II and Na I absorption are publicly available.

The Prime Focus Spectrograph (PFS) is an optical/near-infrared multifiber spectrograph with 2394 science fibers distributed across a 1.3-deg diameter field of view at the Subaru 8.2-m telescope. The wide wavelength coverage from 0.38 {\mu}m to 1.26 {\mu}m, with a resolving power of 3000, simultaneously strengthens its ability to target three main survey programs: cosmology, galactic archaeology and galaxy/AGN evolution. A medium resolution mode with a resolving power of 5000 for 0.71 {\mu}m to 0.89 {\mu}m will also be available by simply exchanging dispersers. We highlight some of the technological aspects of the design. To transform the telescope focal ratio, a broad-band coated microlens is glued to each fiber tip. A higher transmission fiber is selected for the longest part of the cable system, optimizing overall throughput; a fiber with low focal ratio degradation is selected for the fiber-positioner and fiber-slit components, minimizing the effects of fiber movements and fiber bending. Fiber positioning will be performed by a positioner consisting of two stages of piezo-electric rotary motors. The positions of these motors are measured by taking an image of artificially back-illuminated fibers with the metrology camera located in the Cassegrain container; the fibers are placed in the proper location by iteratively measuring and then adjusting the positions of the motors. Target light reaches one of the four identical fast-Schmidt spectrograph modules, each with three arms. The PFS project has passed several project-wide design reviews and is now in the construction phase.

The third generation of the Sloan Digital Sky Survey (SDSS-III) took data from 2008 to 2014 using the original SDSS wide-field imager, the original and an upgraded multi-object fiber-fed optical spectrograph, a new near-infrared high-resolution spectrograph, and a novel optical interferometer. All the data from SDSS-III are now made public. In particular, this paper describes Data Release 11 (DR11) including all data acquired through 2013 July, and Data Release 12 (DR12) adding data acquired through 2014 July (including all data included in previous data releases), marking the end of SDSS-III observing. Relative to our previous public release (DR10), DR12 adds one million new spectra of galaxies and quasars from the Baryon Oscillation Spectroscopic Survey (BOSS) over an additional 3000 sq. deg of sky, more than triples the number of H-band spectra of stars as part of the Apache Point Observatory (APO) Galactic Evolution Experiment (APOGEE), and includes repeated accurate radial velocity measurements of 5500 stars from the Multi-Object APO Radial Velocity Exoplanet Large-area Survey (MARVELS). The APOGEE outputs now include measured abundances of 15 different elements for each star. In total, SDSS-III added 2350 sq. deg of ugriz imaging; 155,520 spectra of 138,099 stars as part of the Sloan Exploration of Galactic Understanding and Evolution 2 (SEGUE-2) survey; 2,497,484 BOSS spectra of 1,372,737 galaxies, 294,512 quasars, and 247,216 stars over 9376 sq. deg; 618,080 APOGEE spectra of 156,593 stars; and 197,040 MARVELS spectra of 5,513 stars. Since its first light in 1998, SDSS has imaged over 1/3 of the Celestial sphere in five bands and obtained over five million astronomical spectra.

We estimate the abundance of dust in damped Lyman-{\alpha} absorbers (DLAs) by statistically measuring the excess reddening they induce on their background quasars. We detect systematic reddening behind DLA consistent with the SMC type reddening curve, but it is inconsistent with the Milky Way type reddening. We find that the derived dust-to-gas ratio is, on average, inversely proportional to the column density of neutral hydrogen, implying that the amount of dust is constant, irrespective of the column density of hydrogen. It means that the average metallicity is inversely proportional to the column density of hydrogen, unless the average dust-to-metal ratio varies with the hydrogen column density. This indicates that the prime origin of metals seen in DLAs is not by in situ star formation, with which Z ~ N_{HI}^{0.4} is expected from the empirical star formation law, contrary to our observation. We interpret the metals observed in absorbers being deposited dominantly from nearby galaxies by galactic winds ubiquitous in intergalactic space. When extrapolating the relation between dust-to-gas ratio and HI column density to lower column density, we find a value which is consistent with what is observed for Mg II absorbers.

Cross-correlating the Planck High Frequency Instrument (HFI) maps against quasars from the Sloan Digital Sky Survey (SDSS) DR7, we estimate the intensity distribution of the Cosmic Infrared Background (CIB) over the redshift range 0 < z < 5.We detect redshift-dependent spatial cross-correlations between the two datasets using the 857, 545 and 353 GHz channels and we obtain upper limits at 217 GHz consistent with expectations. At all frequencies with detectable signal we infer a redshift distribution peaking around z ~ 1.2 and find the recovered spectrum to be consistent with emission arising from star forming galaxies. By assuming simple modified blackbody and Kennicutt relations, we estimate dust and star formation rate density as a function of redshift, finding results consistent with earlier multiwavelength measurements over a large portion of cosmic history. However, we note that, lacking mid-infrared coverage, we are not able to make an accurate determination of the mean temperature for the dust responsible for the CIB. Our results demonstrate that clustering-based redshift inference is a valuable tool for measuring the entire evolution history of the cosmic star formation rate from a single and homogeneous dataset.

Using spectroscopically selected galaxies from the Sloan Digital Sky Survey we present a detection of reddening due to dust in the circumgalactic medium of galaxies. We detect the mean change in the colors of "standard crayons" correlated with the presence of foreground galaxies at z ~0.05 as a function of angular separation. Following Peek & Graves (2010), we create standard crayons using passively evolving galaxies corrected for Milky Way reddening and color-redshift trends, leading to a sample with as little as 2% scatter in color. We devise methods to ameliorate possible systematic effects related to the estimation of colors, and we find an excess reddening induced by foreground galaxies at a level ranging from 10 to 0.5 millimagnitudes on scales ranging from 30 kpc to 1 Mpc. We attribute this effect to a large-scale distribution of dust around galaxies similar to the findings of Menard et al. 2010. We find that circumgalactic reddening is a weak function of stellar mass over the range $6 \times 10^9 M_\odot$ -- $6 \times 10^{10} M_\odot$ and note that this behavior appears to be consistent with recent results on the distribution of metals in the gas phase.

We explore the distribution of cool (~$10^4$K) gas around galaxies and its dependence on galaxy properties. By cross-correlating about 50,000 MgII absorbers with millions of sources from the SDSS (optical), WISE (IR), and GALEX (UV) surveys we effectively extract about 2,000 galaxy-absorber pairs at z~0.5 and probe relations between absorption strength and galaxy type, impact parameter and azimuthal angle. We find that cool gas traced by MgII absorbers exists around both star-forming and passive galaxies with a similar incidence rate on scales greater than 100 kpc but each galaxy type exhibits a different behavior on smaller scales: MgII equivalent width does not correlate with the presence of passive galaxies whereas stronger MgII absorbers tend to be found in the vicinity of star-forming galaxies. This effect is preferentially seen along the minor axis of these galaxies, suggesting that some of the gas is associated with outflowing material. In contrast, the distribution of cool gas around passive galaxies is consistent with being isotropic on the same scales. We quantify the average excess MgII equivalent width $<\delta W_{0}^{\rm MgII}>$ as a function of galaxy properties and find $<\delta W_0^{\rm MgII}>\propto SFR^{1.2}, sSFR^{0.5}$ and $M_\ast^{0.4}$ for star-forming galaxies. This work demonstrates that the dichotomy between star-forming and passive galaxies is reflected in the CGM traced by low-ionized gas. We also measure the covering fraction of MgII absorption and find it to be about 2-10 times higher for star-forming galaxies than passive ones within 50 kpc. We estimate the amount of neutral gas in the halo of $<\log M_\ast/{\rm M_\odot}>$~10.8 galaxies to be a few x$10^9 \rm M_\odot$ for both types of galaxies. Finally, we find that correlations between absorbers and sources detected in the UV and IR lead to physical trends consistent with those measured in the optical.

The Prime Focus Spectrograph (PFS) is an optical/near-infrared multi-fiber spectrograph with 2394 science fibers, which are distributed in 1.3 degree diameter field of view at Subaru 8.2-meter telescope. The simultaneous wide wavelength coverage from 0.38 um to 1.26 um, with the resolving power of 3000, strengthens its ability to target three main survey programs: cosmology, Galactic archaeology, and galaxy/AGN evolution. A medium resolution mode with resolving power of 5000 for 0.71 um to 0.89 um also will be available by simply exchanging dispersers. PFS takes the role for the spectroscopic part of the Subaru Measurement of Images and Redshifts project, while Hyper Suprime-Cam works on the imaging part. To transform the telescope plus WFC focal ratio, a 3-mm thick broad-band coated glass-molded microlens is glued to each fiber tip. A higher transmission fiber is selected for the longest part of cable system, while one with a better FRD performance is selected for the fiber-positioner and fiber-slit components, given the more frequent fiber movements and tightly curved structure. Each Fiber positioner consists of two stages of piezo-electric rotary motors. Its engineering model has been produced and tested. Fiber positioning will be performed iteratively by taking an image of artificially back-illuminated fibers with the Metrology camera located in the Cassegrain container. The camera is carefully designed so that fiber position measurements are unaffected by small amounts of high special-frequency inaccuracies in WFC lens surface shapes. Target light carried through the fiber system reaches one of four identical fast-Schmidt spectrograph modules, each with three arms. Prototype VPH gratings have been optically tested. CCD production is complete, with standard fully-depleted CCDs for red arms and more-challenging thinner fully-depleted CCDs with blue-optimized coating for blue arms.

We present a data-driven method to infer the redshift distribution of an arbitrary dataset based on spatial cross-correlation with a reference population and we apply it to various datasets across the electromagnetic spectrum to show its potential and limitations. Our approach advocates the use of clustering measurements on all available scales, in contrast to previous works focusing only on linear scales. We also show how its accuracy can be enhanced by optimally sampling a dataset within its photometric space rather than applying the estimator globally. We show that the ultimate goal of this technique is to characterize the mapping between the space of photometric observables and redshift space as this characterization then allows us to infer the clustering-redshift p.d.f. of a single galaxy. We apply this technique to estimate the redshift distributions of luminous red galaxies and emission line galaxies from the SDSS, infrared sources from WISE and radio sources from FIRST. We show that consistent redshift distributions are found using both quasars and absorber systems as reference populations. This technique brings valuable information on the third dimension of astronomical datasets. It is widely applicable to a large range of extra-galactic surveys.

We investigate the potential and accuracy of clustering-based redshift estimation using the method proposed by M\'enard et al. (2013). This technique enables the inference of redshift distributions from measurements of the spatial clustering of arbitrary sources, using a set of reference objects for which redshifts are known. We apply it to a sample of spectroscopic galaxies from the Sloan Digital Sky Survey and show that, after carefully controlling the sampling efficiency over the sky, we can estimate redshift distributions with high accuracy. Probing the full colour space of the SDSS galaxies, we show that we can recover the corresponding mean redshifts with an accuracy ranging from $\delta$z=0.001 to 0.01. We indicate that this mapping can be used to infer the redshift probability distribution of a single galaxy. We show how the lack of information on the galaxy bias limits the accuracy of the inference and show comparisons between clustering redshifts and photometric redshifts for this dataset. This analysis demonstrates, using real data, that clustering-based redshift inference provides a powerful data-driven technique to explore the redshift distribution of arbitrary datasets, without any prior knowledge on the spectral energy distribution of the sources.

We have obtained spectra of 163 quasars at $z_\mathrm{em}>4.4$ with the Gemini Multi Object Spectrometers on the Gemini North and South telescopes, the largest publicly available sample of high-quality, low-resolution spectra at these redshifts. From this homogeneous data set, we generated stacked quasar spectra in three redshift intervals at $z\sim 5$. We have modelled the flux below the rest-frame Lyman limit ($\lambda_\mathrm{r}<912$\AA) to assess the mean free path $\lambda_\mathrm{mfp}^{912}$ of the intergalactic medium to HI-ionizing radiation. At mean redshifts $z_\mathrm{q}=4.56$, 4.86 and 5.16, we measure $\lambda_\mathrm{mfp}^{912}=(22.2\pm 2.3, 15.1\pm 1.8, 10.3\pm 1.6)h_{70}^{-1}$ proper Mpc with uncertainties dominated by sample variance. Combining our results with $\lambda_\mathrm{mfp}^{912}$ measurements from lower redshifts, the data are well modelled by a simple power-law $\lambda_\mathrm{mfp}^{912}=A[(1+z)/5]^\eta$ with $A=(37\pm 2)h_{70}^{-1}$ Mpc and $\eta = -5.4\pm 0.4$ between $z=2.3$ and $z=5.5$. This rapid evolution requires a physical mechanism -- beyond cosmological expansion -- which reduces the cosmic effective Lyman limit opacity. We speculate that the majority of HI Lyman limit opacity manifests in gas outside galactic dark matter haloes, tracing large-scale structures (e.g. filaments) whose average density (and consequently neutral fraction) decreases with cosmic time. Our measurements of the strongly redshift-dependent mean free path shortly after the completion of HI reionization serve as a valuable boundary condition for numerical models thereof. Having measured $\lambda_\mathrm{mfp}^{912}\approx 10$ Mpc at $z=5.2$, we confirm that the intergalactic medium is highly ionized by that epoch and that the redshift evolution of the mean free path does not show a break that would indicate a recent end to HI reionization.

The Sloan Digital Sky Survey (SDSS) has been in operation since 2000 April. This paper presents the tenth public data release (DR10) from its current incarnation, SDSS-III. This data release includes the first spectroscopic data from the Apache Point Observatory Galaxy Evolution Experiment (APOGEE), along with spectroscopic data from the Baryon Oscillation Spectroscopic Survey (BOSS) taken through 2012 July. The APOGEE instrument is a near-infrared R~22,500 300-fiber spectrograph covering 1.514--1.696 microns. The APOGEE survey is studying the chemical abundances and radial velocities of roughly 100,000 red giant star candidates in the bulge, bar, disk, and halo of the Milky Way. DR10 includes 178,397 spectra of 57,454 stars, each typically observed three or more times, from APOGEE. Derived quantities from these spectra (radial velocities, effective temperatures, surface gravities, and metallicities) are also included.DR10 also roughly doubles the number of BOSS spectra over those included in the ninth data release. DR10 includes a total of 1,507,954 BOSS spectra, comprising 927,844 galaxy spectra; 182,009 quasar spectra; and 159,327 stellar spectra, selected over 6373.2 square degrees.

We present a measurement of the correlation function between luminous red galaxies and cool gas traced by Mg II \lambda \lambda 2796, 2803 absorption, on scales ranging from about 30 kpc to 20 Mpc. The measurement is based on cross-correlating the positions of about one million red galaxies at z~0.5 and the flux decrements induced in the spectra of about 10^5 background quasars from the Sloan Digital Sky Survey. We find that: (i) This galaxy-gas correlation reveals a change of slope on scales of about 1 Mpc, consistent with the expected transition from a dark matter halo dominated environment to a regime where clustering is dominated by halo-halo correlations. Assuming that, on average, the distribution of Mg II gas follows that of dark matter up to a gas-to-mass ratio, we find the standard halo model to provide an accurate description of the gas distribution over three orders of magnitude in scale. Within this framework we estimate the average host halo mass of luminous red galaxies to be about 10^{13.5} M_solar, in agreement with other methods. We also find the Mg II gas-to-mass ratio around LRGs to be consistent with the cosmic value estimated on Mpc scales. Combining our galaxy-gas correlation and the galaxy-mass correlation function from galaxy-galaxy lensing analyses we can directly measure the Mg II gas-to-mass ratio as a function of scale and reach the same conclusion. (ii) From line-width estimates, we show that the velocity dispersion of the gas clouds also shows the expected 1- and 2-halo behaviors. On large scales the gas distribution follows the Hubble flow, whereas on small scales we observe the velocity dispersion of the Mg II gas clouds to be lower than that of collisionless dark matter particles within their host halo. This is in line with the fact that cool clouds are subject to the pressure of the virialized hot gas.

Large sets of objects with spectroscopic redshift measurements will be needed for imaging dark energy experiments to achieve their full potential, serving two goals:_training_, i.e., the use of objects with known redshift to develop and optimize photometric redshift algorithms; and_calibration_, i.e., the characterization of moments of redshift (or photo-z error) distributions. Better training makes cosmological constraints from a given experiment stronger, while highly-accurate calibration is needed for photo-z systematics not to dominate errors. In this white paper, we investigate the required scope of spectroscopic datasets which can serve both these purposes for ongoing and next-generation dark energy experiments, as well as the time required to obtain such data with instruments available in the next decade. Large time allocations on kilo-object spectrographs will be necessary, ideally augmented by infrared spectroscopy from space. Alternatively, precision calibrations could be obtained by measuring cross-correlation statistics using samples of bright objects from a large baryon acoustic oscillation experiment such as DESI. We also summarize the additional work on photometric redshift methods needed to prepare for ongoing and future dark energy experiments.

We present a measurement of the mean density profile of Ca II gas around galaxies out to ~ 200 kpc, traced by Fraunhofer's H & K absorption lines. The measurement is based on cross-correlating the positions of about one million foreground galaxies at z ~ 0.1 and the flux decrements induced in the spectra of about 10^5 background quasars from the Sloan Digital Sky Survey. This technique allows us to trace the total amount of Ca II absorption induced by the circumgalactic medium, including absorbers too weak to be detected in individual spectra. We can statistically measure Ca II rest equivalent widths down to several mA, corresponding to column densities of about 5x10^10 cm^{-2}. We find that the Ca II column density distribution follows N ~ rp^{-1.4} and the mean Ca II mass in the halo within 200 kpc is ~ 5x10^3 Msolar, averaged over the foreground galaxy sample with median mass ~ 10^10.3 Msolar. This is about an order-of-magnitude larger than the Ca II mass in the interstellar medium of the Milky Way, suggesting more than 90% of Ca II in the Universe is in the circum- and inter-galactic environments. Our measurements indicate that the amount of Ca II in halos is larger for galaxies with higher stellar mass and higher star formation rate. For edge-on galaxies we find Ca II to be more concentrated along the minor axis, i.e. in the polar direction. This suggests that bipolar outflows induced by star formation must have played a significant role in producing Ca II in galaxy halos.

Determining accurate redshift distributions for very large samples of objects has become increasingly important in cosmology. We investigate the impact of extending cross-correlation based redshift distribution recovery methods to include small scale clustering information. The major concern in such work is the ability to disentangle the amplitude of the underlying redshift distribution from the influence of evolving galaxy bias. Using multiple simulations covering a variety of galaxy bias evolution scenarios, we demonstrate reliable redshift recoveries using linear clustering assumptions well into the non-linear regime for redshift distributions of narrow redshift width. Including information from intermediate physical scales balances the increased information available from clustering and the residual bias incurred from relaxing of linear constraints. We discuss how breaking a broad sample into tomographic bins can improve estimates of the redshift distribution, and present a simple bias removal technique using clustering information from the spectroscopic sample alone.

In 2006, Prochter et al. reported a statistically significant enhancement of very strong Mg II absorption systems intervening the sightlines to gamma-ray bursts (GRBs) relative to the in- cidence of such absorption along quasar sightlines. This counterintuitive result, has inspired a diverse set of astrophysical explanations (e.g. dust, gravitational lensing) but none of these has obviously resolved the puzzle. Using the largest set of GRB afterglow spectra available, we reexamine the purported enhancement. In an independent sample of GRB spectra with a survey path 3 times larger than Prochter et al., we measure the incidence per unit redshift of $\geq 1$\AA rest-frame equivalent width Mg II absorbers at $z \approx 1$ to be l(z)= 0.18 $\pm$ 0.06. This is fully consistent with current estimates for the incidence of such absorbers along quasar sightlines. Therefore, we do not confirm the original enhancement and suggest those results suffered from a statistical fluke. Signatures of the original result do remain in our full sample (l(z) shows an $\approx 1.5$ enhancement over l(z)QSO), but the statistical significance now lies at $\approx 90%$ c.l. Restricting our analysis to the subset of high-resolution spectra of GRB afterglows (which overlaps substantially with Prochter et al.), we still reproduce a statistically significant enhancement of Mg II absorption. The reason for this excess, if real, is still unclear since there is no connection between the rapid afterglow follow-up process with echelle (or echellette) spectrographs and the detectability of strong Mg II doublets. Only a larger sample of such high-resolution data will shed some light on this matter.

We present a generic and fully-automatic method aimed at detecting absorption lines in the spectra of astronomical objects. The algorithm estimates the source continuum flux using a dimensionality reduction technique, nonnegative matrix factorization, and then detects and identifies metal absorption lines. We apply it to a sample of ~100,000 quasar spectra from the Sloan Digital Sky Survey and compile a sample of ~40,000 Mg II & Fe II absorber systems, spanning the redshift range 0.4< z < 2.3. The corresponding catalog is publicly available. We study the statistical properties of these absorber systems and find that the rest equivalent width distribution of strong Mg II absorbers follows an exponential distribution at all redshifts, confirming previous studies. Combining our results with recent near-infrared observations of Mg II absorbers we introduce a new parametrization that fully describes the incidence rate of these systems up to z~5. We find the redshift evolution of strong Mg II absorbers to be remarkably similar to the cosmic star formation history over 0.4<z<5.5 (the entire redshift range covered by observations), suggesting a physical link between these two quantities.

Using about 450,000 galaxies in the Deep Lens Survey, we present a detection of the gravitational magnification of z > 4 Lyman Break Galaxies by massive foreground galaxies with 0.4 < z < 1.0, grouped by redshift. The magnification signal is detected at S/N greater than 20, and rigorous checks confirm that it is not contaminated by any galaxy sample overlap in redshift. The inferred galaxy mass profiles are consistent with earlier lensing analyses at lower redshift. We then explore the tomographic lens magnification signal by splitting our foreground galaxy sample into 7 redshift bins. Combining galaxy-magnification cross-correlations and galaxy angular auto-correlations, we develop a bias-independent estimator of the tomographic signal. As a diagnostic of magnification tomography, the measurement of this estimator rejects a flat dark matter dominated Universe at > 7.5{\sigma} with a fixed \sigma_8 and is found to be consistent with the expected redshift-dependence of the WMAP7 {\Lambda}CDM cosmology.

The Sloan Digital Sky Survey III (SDSS-III) presents the first spectroscopic data from the Baryon Oscillation Spectroscopic Survey (BOSS). This ninth data release (DR9) of the SDSS project includes 535,995 new galaxy spectra (median z=0.52), 102,100 new quasar spectra (median z=2.32), and 90,897 new stellar spectra, along with the data presented in previous data releases. These spectra were obtained with the new BOSS spectrograph and were taken between 2009 December and 2011 July. In addition, the stellar parameters pipeline, which determines radial velocities, surface temperatures, surface gravities, and metallicities of stars, has been updated and refined with improvements in temperature estimates for stars with T_eff<5000 K and in metallicity estimates for stars with [Fe/H]>-0.5. DR9 includes new stellar parameters for all stars presented in DR8, including stars from SDSS-I and II, as well as those observed as part of the SDSS-III Sloan Extension for Galactic Understanding and Exploration-2 (SEGUE-2). The astrometry error introduced in the DR8 imaging catalogs has been corrected in the DR9 data products. The next data release for SDSS-III will be in Summer 2013, which will present the first data from the Apache Point Observatory Galactic Evolution Experiment (APOGEE) along with another year of data from BOSS, followed by the final SDSS-III data release in December 2014.

MgII absorbers induce reddening on background quasars. We measure this effect and infer the cosmic density of dust residing in these systems to be \Omega\ ~ 2e-6, in units of the critical density of the Universe, which is comparable to the amount of dust found in galactic disks or about half the amount inferred to exist outside galaxies. We also estimate the neutral hydrogen abundance in MgII clouds to be \Omega\ ~ 1.5e-4, which is approximately 5% of hydrogen in stars in galaxies. This implies a dust-to-gas mass ratio for MgII clouds of about 1/100, which is similar to the value for normal galaxies. This would support the hypothesis of the outflow origin of MgII clouds, which are intrinsically devoid of stars and hence have no sources of dust. Considerations of the dust abundance imply that the presence of MgII absorbers around galaxies lasts effectively for a few Gyr. High redshift absorbers allow us to measure the rest-frame extinction curve to 900 Angstroms at which the absorption by the Lyman edge dominates over scattering by dust in the extinction opacity.

A few percent of quasars show strong associated MgII absorption, with velocities (v_off) lying within a few thousand km/s from the quasar systemic redshift. These associated absorption line systems (AALs) are usually interpreted as absorbers that are either intrinsic to the quasar and its host, or arising from external galaxies clustering around the quasar. Using composite spectra of ~1,800 MgII AAL quasars selected from SDSS DR7 at 0.4<~ z<~2, we show that quasars with AALs with v_off<1500 km/s have a prominent excess in [OII]3727 emission (detected at >7sigma) at rest to the quasar host, compared to unabsorbed quasars. We interpret this [OII] excess as due to enhanced star formation in the quasar host. Our results suggest that a significant fraction of AALs with v_off<1500 km/s are physically associated with the quasar and its host, and are most likely large-scale flows with typical velocities of a few hundred km/s. AAL quasars also have dust reddening lying between normal quasars and the so-called dust-reddened quasars. We suggest that the unique properties of AAL quasars can be explained if they are the transitional population from heavily dust-reddened quasar to normal quasars in the formation process of quasars and their hosts. This scenario predicts a larger fraction of young bulges, disturbed morphologies and interactions of AAL quasar hosts compared to normal quasars. The intrinsic link between associated absorbers and quasar hosts opens a new window to probe massive galaxy formation and galactic-scale feedback processes, and provides a crucial test of the evolutionary picture of quasars.

The Sloan Digital Sky Survey (SDSS) started a new phase in August 2008, with new instrumentation and new surveys focused on Galactic structure and chemical evolution, measurements of the baryon oscillation feature in the clustering of galaxies and the quasar Ly alpha forest, and a radial velocity search for planets around ~8000 stars. This paper describes the first data release of SDSS-III (and the eighth counting from the beginning of the SDSS). The release includes five-band imaging of roughly 5200 deg^2 in the Southern Galactic Cap, bringing the total footprint of the SDSS imaging to 14,555 deg^2, or over a third of the Celestial Sphere. All the imaging data have been reprocessed with an improved sky-subtraction algorithm and a final, self-consistent photometric recalibration and flat-field determination. This release also includes all data from the second phase of the Sloan Extension for Galactic Understanding and Evolution (SEGUE-2), consisting of spectroscopy of approximately 118,000 stars at both high and low Galactic latitudes. All the more than half a million stellar spectra obtained with the SDSS spectrograph have been reprocessed through an improved stellar parameters pipeline, which has better determination of metallicity for high metallicity stars.

(Abridged) Star formation-driven outflows are a critical phenomenon in theoretical treatments of galaxy evolution, despite the limited ability of observations to trace them across cosmological timescales. If the strongest MgII absorption-line systems detected in the spectra of background quasars arise in such outflows, "ultra-strong" MgII (USMgII) absorbers would identify significant numbers of galactic winds over a huge baseline in cosmic time, in a manner independent of the luminous properties of the galaxy. To this end, we present the first detailed imaging and spectroscopic study of the fields of two USMgII absorber systems culled from a statistical absorber catalog, with the goal of understanding the physical processes leading to the large velocity spreads that define such systems. Each field contains two bright emission-line galaxies at similar redshift (dv < 300 km/s) to that of the absorption. Lower-limits on their instantaneous star formation rates (SFR) from the observed OII and Hb line fluxes, and stellar masses from spectral template fitting indicate specific SFRs among the highest for their masses at z~0.7. Additionally, their 4000A break and Balmer absorption strengths imply they have undergone recent (~0.01 - 1 Gyr) starbursts. The concomitant presence of two rare phenomena - starbursts and USMgII absorbers - strongly implies a causal connection. We consider these data and USMgII absorbers in general in the context of various popular models, and conclude that galactic outflows are generally necessary to account for the velocity extent of the absorption. We favour starburst driven outflows over tidally-stripped gas from a major interaction which triggered the starburst as the energy source for the majority of systems. Finally, we discuss the implications of these results and speculate on the overall contribution of such systems to the global SFR density at z~0.7.

We present a new technique to estimate the level of contamination between photometric redshift bins. If the true angular cross-correlation between redshift bins can be safely assumed to be zero, any measured cross-correlation is a result of contamination between the bins. We present the theory for an arbitrary number of redshift bins, and discuss in detail the case of two and three bins which can be easily solved analytically. We use mock catalogues constructed from the Millennium Simulation to test the method, showing that artificial contamination can be successfully recovered with our method. We find that degeneracies in the parameter space prohibit us from determining a unique solution for the contamination, though constraints are made which can be improved with larger data sets. We then apply the method to an observational galaxy survey: the deep component of the Canada-France-Hawaii Telescope Legacy Survey. We estimate the level of contamination between photometric redshift bins and demonstrate our ability to reconstruct both the true redshift distribution and the true average redshift of galaxies in each photometric bin.

In order to investigate the origin of the excess of strong MgII systems towards GRB afterglows as compared to QSO sightlines, we have measured the incidence of MgII absorbers towards a third class of objects: the Blazars. This class includes the BL Lac object population for which a tentative excess of MgII systems had already been reported. We observed with FORS1 at the ESO-VLT 42 Blazars with an emission redshift 0.8<z_em<1.9, to which we added the three high z northern objects belonging to the 1Jy BL Lac sample. We detect 32 MgII absorbers in the redshift range 0.35-1.45, leading to an excess in the incidence of MgII absorbers compared to that measured towards QSOs by a factor ~2, detected at 3 sigma. The amplitude of the effect is similar to that found along GRB sightlines. Our analysis provides a new piece of evidence that the observed incidence of MgII absorbers might depend on the type of background source. In front of Blazars, the excess is apparent for both 'strong' (w_ r(2796) > 1.0 A) and weaker (0.3 < w_r(2796) < 1.0 A) MgII systems. The dependence on velocity separation with respect to the background Blazars indicates, at the ~1.5 sigma level, a potential excess for beta = v/c ~0.1. We show that biases involving dust extinction or gravitational amplification are not likely to notably affect the incidence of MgII systems towards Blazars. Finally we discuss the physical conditions required for these absorbers to be gas entrained by the powerful Blazar jets. More realistic numerical modelling of jet-ambient gas interaction is required to reach any firm conclusions as well as repeat observations at high spectral resolution of strong MgII absorbers towards Blazars in both high and low states.

We study the kinematically narrow, low-ionization line emission from a bright, starburst galaxy at z = 0.69 using slit spectroscopy obtained with Keck/LRIS. The spectrum reveals strong absorption in MgII and FeII resonance transitions with Doppler shifts of -200 to -300 km/s, indicating a cool gas outflow. Emission in MgII near and redward of systemic velocity, in concert with the observed absorption, yields a P Cygni-like line profile similar to those observed in the Ly alpha transition in Lyman Break Galaxies. Further, the MgII emission is spatially resolved, and extends significantly beyond the emission from stars and HII regions within the galaxy. Assuming the emission has a simple, symmetric surface brightness profile, we find that the gas extends to distances > ~7 kpc. We also detect several narrow FeII* fine-structure lines in emission near the systemic velocity, arising from energy levels which are radiatively excited directly from the ground state. We suggest that the MgII and FeII* emission is generated by photon scattering in the observed outflow, and emphasize that this emission is a generic prediction of outflows. These observations provide the first direct constraints on the minimum spatial extent and morphology of the wind from a distant galaxy. Estimates of these parameters are crucial for understanding the impact of outflows in driving galaxy evolution.

Galactic outflows of low ionization, cool gas are ubiquitous in local starburst galaxies, and in the majority of galaxies at high redshift. How these cool outflows arise is still in question. Hot gas from supernovae has long been suspected as the primary driver, but this mechanism suffers from its tendency to destroy the cool gas as the latter is accelerated. We propose a modification of the supernova scenario that overcomes this difficulty. Star formation is observed to take place in clusters; in a given galaxy, the bulk of the star formation is found in the ~20 most massive clusters. We show that, for L* galaxies, the radiation pressure from clusters with M>10^6 M_sun is able to expel the surrounding gas at velocities in excess of the circular velocity of the disk galaxy. This cool gas can travel above the galactic disk in less than 2 Myr, well before any supernovae erupt in the driving cluster. Once above the disk, the cool outflowing gas is exposed to radiation, and supernovae induced hot gas outflows, from other clusters in the disk, which drive it to distances of several tens to hundreds of kpc. Because the radiatively driven clouds grow in size as they travel, and because the hot gas is more dilute at large distance, the clouds are less subject to destruction if they do eventually encounter hot gas. Therefore, unlike wind driven clouds, radiatively driven clouds can survive to distances ~50 kpc. We identify these cluster-driven winds with large-scale galactic outflows. Another implication of our model is that only starburst galaxies, where massive clusters reside, are able to drive winds cold outflows on galactic scales via this mechanism. We find that the critical star formation rates above which large scale cool outflows will be launched to be ~0.1 M_sun/yr/kpc^2, which is in good agreement with observations.

We present an empirical connection between cold gas in galactic halos and star formation. Using a sample of more than 8,500 MgII absorbers from SDSS quasar spectra, we report the detection of a 15 sigma correlation between the rest equivalent width W0 of MgII absorbers and the associated OII luminosity, an estimator of star formation rate. This correlation has interesting implications: using only observable quantities we show that MgII absorbers trace a substantial fraction of the global OII luminosity density and recover the overall star formation history of the Universe derived from classical emission estimators up to z~2. We then show that the distribution function of MgII rest equivalent widths, dN/dW0 inherits both its shape and amplitude from the OII luminosity function Phi(L). These distributions can be naturally connected, without any free parameter. Our results imply a high covering factor of cold gas around star forming galaxies: C>0.5, favoring outflows as the mechanism responsible for MgII absorption. We then argue that intervening MgII absorbers and blue-shifted MgII absorption seen in the spectra of star forming galaxies are essentially the same systems. These results not only shed light on the nature of MgII absorbers but also provide us with a new probe of star formation, in absorption, i.e. in a way which does not suffer from dust extinction and with a redshift-independent sensitivity. As shown in this analysis, such a tool can be applied in a noise-dominated regime, i.e. using a dataset for which emission lines are not detected in individual objects. This is of particular interest for high redshift studies.

Supernova measurements have become a key ingredient in current determinations of cosmological parameters. These sources can however be used as standard candles only after correcting their apparent brightness for a number of effects. In this paper we discuss some limitations imposed by the formalism currently used for such corrections and investigate the impact on cosmological constraints. We show that color corrections are, in general, expected to be biased. In addition, color excesses which do not add a significant scatter to the observed SN brightnesses affect the value of cosmological parameters but leave the slope of the color-luminosity relation unchanged. We quantify these biases in the context of the redshift-dependent dust extinction suggested by the recent detection of intergalactic dust by Menard et al. (2009). Using a range of models for the opacity of the Universe as a function of redshift, we find that color-magnitude-stretch scaling relations are virtually insensitive to the presence of cosmic dust while cosmological parameters such as Omega_M and w are biased at the level of a few percent, i.e. offsets comparable to the current statistical errors. Future surveys will be able to limit the impact of intergalactic extinction by observing at larger wavelengths. In addition such datasets will provide direct detections of intergalactic dust by cross-correlating SN colors and the density of foreground galaxies, which can be used as a consistency check on the cosmic dust extinction correction. Alternatively, such biases could be avoided by correcting the colors of supernovae on an object-by-object basis with accurate photometry.

We present a simultaneous detection of gravitational magnification and dust reddening effects due to galactic halos and large-scale structure. The measurement is based on correlating the brightness of ~85,000 quasars at z>1 with the position of 20 million galaxies at z~0.3 derived from the Sloan Digital Sky Survey and is used to constrain the galaxy-mass and galaxy-dust correlation functions up to cosmological scales. The presence of dust is detected from 20 kpc to several Mpc, and we find its projected density to follow: Sigma_dust ~ theta^-0.8, a distribution similar to mass. The amount of dust in galactic halos is found to be comparable to that in disks. On large scales its wavelength dependence is described by R_V=3.9+/-2.6, consistent with interstellar dust. We estimate the resulting opacity of the Universe as a function of redshift and find A_V~0.03 mag up to z=0.5. This, in turn, implies a cosmic dust density of Omega_dust ~ 5x10^-6, roughly half of which comes from dust in halos of ~L* galaxies. We present magnification measurements, corrected for dust extinction, from which the galaxy-mass correlation function is inferred. The mean mass profile around galaxies is found to be Sigma ~ 30 (theta/arcmin)^-0.8 h M_sun/pc^2 up to a radius of 10 Mpc, in agreement with gravitational shear estimates.

We estimate the mean dust-to-gas ratio of MgII absorbers as a function of rest equivalent width W_0 and redshift over the range 0.5<z<1.4. Using the expanded SDSS/HST sample of low-redshift Lyman-alpha absorbers we first show the existence of a 8-sigma correlation between the mean hydrogen column density <N_HI> and W_0, an indicator of gas velocity dispersion. By combining these results with recent dust-reddening measurements we show that the mean dust-to-gas ratio of MgII absorbers does not appreciably depend on rest equivalent width. Assuming that, on average, dust-to-gas ratio is proportional to metallicity, we find its redshift evolution to be consistent with that of L^star galaxies from z=0.5 to 1.4 and we show that our constraints disfavor dwarf galaxies as the origin of such absorbers. We discuss other scenarii and favor galactic outflows from ~L^star galaxies as the origin of the majority of strong MgII absorbers. Finally, we show that, once evolutionary effects are taken into account, the Bohlin et al. relation between A_V and N_H is also satisfied by strong MgII systems down to lower column densities than those probed in our Galaxy.

We present an exploration of weak lensing by large-scale structure in the linear regime, using the third-year (T0003) CFHTLS Wide data release. Our results place tight constraints on the scaling of the amplitude of the matter power spectrum sigma_8 with the matter density Omega_m. Spanning 57 square degrees to i'_AB = 24.5 over three independent fields, the unprecedented contiguous area of this survey permits high signal-to-noise measurements of two-point shear statistics from 1 arcmin to 4 degrees. Understanding systematic errors in our analysis is vital in interpreting the results. We therefore demonstrate the percent-level accuracy of our method using STEP simulations, an E/B-mode decomposition of the data, and the star-galaxy cross correlation function. We also present a thorough analysis of the galaxy redshift distribution using redshift data from the CFHTLS T0003 Deep fields that probe the same spatial regions as the Wide fields. We find sigma_8(Omega_m/0.25)^0.64 = 0.785+-0.043 using the aperture-mass statistic for the full range of angular scales for an assumed flat cosmology, in excellent agreement with WMAP3 constraints. The largest physical scale probed by our analysis is 85 Mpc, assuming a mean redshift of lenses of 0.5 and a LCDM cosmology. This allows for the first time to constrain cosmology using only cosmic shear measurements in the linear regime. Using only angular scales theta> 85 arcmin, we find sigma_8(Omega_m/0.25)_lin^0.53 = 0.837+-0.084, which agree with the results from our full analysis. Combining our results with data from WMAP3, we find Omega_m=0.248+-0.019 and sigma_8 = 0.771+-0.029.

We establish a simple model for the distribution of cold gas around L* galaxies using a large set of observational constraints on the properties of strong MgII absorber systems. Our analysis suggests that the halos of L* galaxies are filled with cool gaseous clouds having sizes of order 1kpc and densities of ~10^{-2} cm^{-3}. We then investigate the physical effects of cloud irradiation by a quasar and study the resulting spectral signatures. We show that quasar activity gives rise to (i) extended narrow-line emission on ~100kpc scales and (ii) an anisotropy in the properties of the absorbing gas arising from the geometry of the quasar radiation field. Provided that quasars reside in halos several times more massive than those of L* galaxies, our model predictions appear to be in agreement with observations of narrow emission-line nebulae around quasars and the recent detections of ~100kpc cold gaseous envelopes around those objects, suggesting a common origin for these phenomena. We discuss the implications of our results for understanding absorption systems, probing quasar environments at high redshifts, and testing the quasar unification scheme.

Using a sample of almost 7000 strong MgII absorbers with 0.4 < z < 2.2 detected in the SDSS DR4 dataset, we investigate the gravitational lensing and dust extinction effects they induce on background quasars. After carefully quantifying several selection biases, we isolate the reddening effects as a function of redshift and absorber rest equivalent width, W_0. We find the amount of dust to increase with cosmic time as (1+z)^(-1.1 +/- 0.4), following the evolution of cosmic star density or integrated star formation rate. We measure the reddening effects over a factor 30 in E(B-V) and we find the dust column density to be proportional to W_0^(1.9 +/- 0.2), which provides an important scaling for theoretical modeling of metal absorbers. We also measure the dust-to-metals ratio and find it similar to that of the Milky Way. In contrast to previous studies, we do not detect any gravitational magnification by MgII systems. We measure the upper limit \mu<1.10 and discuss the origin of the discrepancy. Finally, we estimate the fraction of absorbers missed due to extinction effects and show that it rises from 1 to 50% in the range 1<W_0<6 Angstrom. We parametrize this effect and provide a correction for recovering the intrinsic distribution of absorber rest equivalent widths.

Using a large sample of MgII absorbers with 0.4<z<2.2 detected by Nestor et al (2005) in the Early Data Release of the SDSS, we present new constraints on the physical properties of these systems based on two statistical analyses: (i) By computing the ratio between the composite spectra of quasars with and without absorbers, we measure the reddening effects induced by these intervening systems; and (ii) by stacking SDSS images centered on quasars with strong MgII absorption lines and isolating the excess light around the PSF, we measure the mean luminosity and colors of the absorbing galaxies. This statistical approach does not require any spectroscopic follow up and allows us to constrain the photometric properties of absorber systems.

We investigate the microlensing effects on a source star surrounded by a circumstellar disk, as a function of wavelength. The microlensing light curve of the system encodes the geometry and surface brightness profile of the disk. In the mid- and far-infrared, the emission of the system is dominated by the thermal emission from the cold dusty disk. For a system located at the Galactic center, we find typical magnifications to be of order 10-20% or higher, depending on the disk surface brightness profile, and the event lasts over one year. At around 20 microns, where the emission for the star and the disk are comparable, the difference in the emission areas results in a chromatic microlensing event. Finally, in the near-infrared and visible, where the emission of the star dominates, the fraction of star light directly reflected by the disk slightly modifies the light curve of the system which is no longer that of a point source. In each case, the corresponding light curve can be used to probe some of the disk properties. A fraction of 0.1% to 1% optical microlensing events are expected to be associated with circumstellar disk systems. We show that the lensing signal of the disk can be detected with sparse follow-up observations of the next generation space telescopes. While direct imaging studies of circumstellar disks are limited to the solar neighborhood, this microlensing technique can probe very distant disk systems living in various environments and has the potential to reveal a larger diversity of circumstellar disks.

We propose a method for detecting gravitational magnification of distant sources, like quasars, due to absorber systems detected in their spectra. We first motivate the use of metal absorption lines rather than Lyman-alpha lines, then we show how to relate the observed moments of the source magnitude distribution to the mass distribution of absorbers. In order to illustrate the feasibility of the method, we use a simple model to estimate the amplitude of the effect expected for MgII absorption lines, and show that their lensing signal might already be detectable in large surveys like the SDSS. Our model suggests that quasars behind strong MgII absorbers are in average brightened by -0.05 to -0.2 magnitude due to magnification. One must therefore revisit the claim that, in magnitude limited surveys, quasars with strong absorbers tend to be missed due to extinction effects. In addition to constraining the mass of absorber systems, applying our method will allow for the quantification of this bias.

We cross-correlate the sample of Type Ia supernovae from Riess et al. (2004) with the SDSS DR2 photometric galaxy catalogue. In contrast to recent work, we find no detectable correlation between supernova magnitude and galaxy overdensity on scales ranging between 1 and 10 arcminutes. Our results are in accord with theoretical expectations for gravitational lensing of supernovae by large-scale structure. Future supernova surveys like SNAP will be capable of detecting unambiguously the predicted lensing signal.

We use the first data release of the 2-degree Field Quasar survey to investigate the effect of gravitational magnification by foreground absorbing systems on background quasars. We select two populations of quasars from this sample: one with strong MgII/FeII absorbers and one without. The selection is done in such a way that the two populations have the same redshift distribution and the absorber detection procedure discards possible biases with quasar magnitude. We then compare their magnitude distributions and find a relative excess of bright quasars with absorbers. This effect is detected at the 2.4, 3.7 and 4.4 sigma levels in u-, b- and r-bands. Various explanations of the observed phenomenon are considered and several lines of evidence point towards gravitational lensing causing some of the differences observed in the magnitude distributions. We note that physical quasar-absorber associations may contribute to some extent to the observed correlations for low quasar-absorber velocity differences. We discuss the implications of these findings and propose future work which will allow us to strengthen and extend the results presented here.