Using a suite of hydrodynamical simulations with cold dark matter, baryons, and neutrinos, we present a detailed study of the effect of massive neutrinos on the 1-D and 3-D flux power spectra of the Lyman-$\alpha$ (Ly$\alpha$) forest. The presence of massive neutrinos in cosmology induces a scale- and time-dependent suppression of structure formation that is strongest on small scales. Measuring this suppression is a key method for inferring neutrino masses from cosmological data, and is one of the main goals of ongoing and future surveys like eBOSS, DES, LSST, Euclid or DESI. The clustering in the Ly$\alpha$ forest traces the quasi-linear power at late times and on small scales. In combination with observations of the cosmic microwave background, the forest therefore provides some of the tightest constraints on the sum of the neutrino masses. However there is a well-known degeneracy between $\Sigma m_{\nu}$ and the amplitude of perturbations in the linear matter power spectrum. We study the corresponding degeneracy in the 1-D flux power spectrum of the Ly$\alpha$ forest, and for the first time also study this degeneracy in the 3-D flux power spectrum. We show that the non-linear effects of massive neutrinos on the Ly$\alpha$ forest, beyond the effect of linear power amplitude suppression, are negligible, and this degeneracy persists in the Ly$\alpha$ forest observables to a high precision. We discuss the implications of this degeneracy for choosing parametrisations of the Ly$\alpha$ forest for cosmological analysis.

Context. EE Cep is one of few eclipsing binary systems with a dark, dusty disk around an invisible object similar to {\epsilon} Aur. The system is characterized by grey and asymmetric eclipses every 5.6 yr, with a significant variation in their photometric depth, ranging from ~ 0 m .5 to ~ 2 m .0. Aims. The main aim of the observational campaign of the EE Cep eclipse in 2014 was to test the model of disk precession (Galan et al. 2012). We expected that this eclipse would be one of the deepest with a depth of ~ 2 m .0. Methods. We collected multicolor observations from almost 30 instruments located in Europe and North America. This photometric data covers 243 nights during and around the eclipse. We also analyse the low- and high-resolution spectra from several instruments. Results. The eclipse was shallow with a depth of 0 m .71 in V-band. The multicolor photometry illustrates small color changes during the eclipse with a total amplitude of order ~ +0 m . 15 in B-I color index. The linear ephemeris for this system is updated by including new times of minima, measured from the three most recent eclipses at epochs E = 9, 10 and 11. New spectroscopic observations were acquired, covering orbital phases around the eclipse, which were not observed in the past and increased the data sample, filling some gaps and giving a better insight into the evolution of the H {\alpha} and NaI spectral line profiles during the primary eclipse. Conclusions. The eclipse of EE Cep in 2014 was shallower than expected 0 m .71 instead of ~ 2 m . 0. This means that our model of disk precession needs revision.

MegaMapper is a proposed ground-based experiment to measure Inflation parameters and Dark Energy from galaxy redshifts at 2<z<5. A 6.5-m Magellan telescope will be coupled with DESI spectrographs to achieve multiplexing of 20,000. MegaMapper would be located at Las Campanas Observatory to fully access LSST imaging for target selection.

Evaluation of likelihood functions for cosmological large scale structure data sets (including CMB, galaxy redshift surveys, etc.) naturally involves marginalization, i.e., integration, over an unknown underlying random signal field. Recently, I showed how a renormalization group method can be used to carry out this integration efficiently by first integrating out the smallest scale structure, i.e., localized structure on the scale of differences between nearby data cells, then combining adjacent cells in a coarse graining step, then repeating this process over and over until all scales have been integrated. Here I extend the formulation in several ways in order to reduce the prefactor on the method's linear scaling with data set size. The key improvement is showing how to integrate out the difference between specific adjacent cells before summing them in the coarse graining step, compared to the original formulation in which small-scale fluctuations were integrated more generally. I suggest some other improvements in details of the scheme, including showing how to perform the integration around a maximum likelihood estimate for the underlying random field. In the end, an accurate likelihood computation for a million-cell Gaussian test data set runs in two minutes on my laptop, with room for further optimization and straightforward parallelization.

The expansion of the Universe is understood to have accelerated during two epochs: in its very first moments during a period of Inflation and much more recently, at $z < 1$, when Dark Energy is hypothesized to drive cosmic acceleration. The undiscovered mechanisms behind these two epochs represent some of the most important open problems in fundamental physics. The large cosmological volume at $2 < z < 5$, together with the ability to efficiently target high-$z$ galaxies with known techniques, enables large gains in the study of Inflation and Dark Energy. A future spectroscopic survey can test the Gaussianity of the initial conditions up to a factor of ~50 better than our current bounds, crossing the crucial theoretical threshold of $\sigma(f_{NL}^{\rm local})$ of order unity that separates single field and multi-field models. Simultaneously, it can measure the fraction of Dark Energy at the percent level up to $z = 5$, thus serving as an unprecedented test of the standard model and opening up a tremendous discovery space.

In the upcoming decade cadenced wide-field imaging surveys will increase the number of identified $z<0.3$ Type~Ia supernovae (SNe~Ia) from the hundreds to the hundreds of thousands. The increase in the number density and solid-angle coverage of SNe~Ia, in parallel with improvements in the standardization of their absolute magnitudes, now make them competitive probes of the growth of structure and hence of gravity. The peculiar velocity power spectrum is sensitive to the growth index $\gamma$, which captures the effect of gravity on the linear growth of structure through the relation $f=\Omega_M^\gamma$. We present the first projections for the precision in $\gamma$ for a range of realistic SN peculiar-velocity survey scenarios. In the next decade the peculiar velocities of SNe~Ia in the local $z<0.3$ Universe will provide a measure of $\gamma$ to $\pm 0.01$ precision that can definitively distinguish between General Relativity and leading models of alternative gravity.

I show how a renormalization group (RG) method can be used to incrementally integrate the information in cosmological large-scale structure data sets (including CMB, galaxy redshift surveys, etc.). I show numerical tests for Gaussian fields, where the method allows arbitrarily close to exact computation of the likelihood function in order $\sim N$ time, even for problems with no symmetry, compared to $N^3$ for brute force linear algebra (where $N$ is the number of data points -- to be fair, methods already exist to solve the Gaussian problem in at worst $N \log N$ time, and this method will not necessarily be faster in practice). The method requires no sampling or other Monte Carlo (random) element. Non-linearity/non-Gaussianity can be accounted for to the extent that terms generated by integrating out small scale modes can be projected onto a sufficient basis, e.g., at least in the sufficiently perturbative regime. The formulas to evaluate are straightforward and require no understanding of quantum field theory, but this paper may also serve as a pedagogical introduction to Wilsonian RG for astronomers.

We suggest an approach to perturbative calculations of large-scale clustering in the Universe that includes from the start the stream crossing (multiple velocities for mass elements at a single position) that is lost in traditional calculations. Starting from a functional integral over displacement, the perturbative series expansion is in deviations from (truncated) Zel'dovich evolution, with terms that can be computed exactly even for stream-crossed displacements. We evaluate the one-loop formulas for displacement and density power spectra numerically in 1D, finding dramatic improvement in agreement with N-body simulations compared to the Zel'dovich power spectrum (which is exact in 1D up to stream crossing). Beyond 1D, our approach could represent an improvement over previous expansions even aside from the inclusion of stream crossing, but we have not investigated this numerically. In the process we show how to achieve effective-theory-like regulation of small-scale fluctuations without free parameters.

We derive and numerically implement an algorithm for estimating the 3D power spectrum of the Lyman-$\alpha$ (Ly-$\alpha$) forest flux fluctuations. The algorithm exploits the unique geometry of Ly-$\alpha$ forest data to efficiently measure the cross-spectrum between lines of sight as a function of parallel wavenumber, transverse separation and redshift. The key to fast evaluation is to approximate the global covariance matrix as block-diagonal, where only pixels from the same spectrum are correlated. We then compute the eigenvectors of the derivative of the signal covariance with respect to cross-spectrum parameters, and project the inverse-covariance-weighted spectra onto them. This acts much like a radial Fourier transform over redshift windows. The resulting cross-spectrum inference is then converted into our final product, an approximation of the likelihood for the 3D power spectrum expressed as second order Taylor expansion around a fiducial model. We demonstrate the accuracy and scalability of the algorithm and comment on possible extensions. Our algorithm will allow efficient analysis of the upcoming Dark Energy Spectroscopic Instrument dataset.

We introduce FastPM, a highly-scalable approximated particle mesh N-body solver, which implements the particle mesh (PM) scheme enforcing correct linear displacement (1LPT) evolution via modified kick and drift factors. Employing a 2-dimensional domain decomposing scheme, FastPM scales extremely well with a very large number of CPUs. In contrast to COmoving-LAgrangian (COLA) approach, we do not require to split the force or track separately the 2LPT solution, reducing the code complexity and memory requirements. We compare FastPM with different number of steps ($N_s$) and force resolution factor ($B$) against 3 benchmarks: halo mass function from Friends of Friends halo finder, halo and dark matter power spectrum, and cross correlation coefficient (or stochasticity), relative to a high resolution TreePM simulation. We show that the modified time stepping scheme reduces the halo stochasticity when compared to COLA with the same number of steps and force resolution. While increasing $N_s$ and $B$ improves the transfer function and cross correlation coefficient, for many applications FastPM achieves sufficient accuracy at low $N_s$ and $B$. For example, $N_s=10$ and $B=2$ simulation provides a substantial saving (a factor of 10) of computing time relative to $N_s=40$, $B=3$ simulation, yet the halo benchmarks are very similar at $z=0$. We find that for abundance matched halos the stochasticity remains low even for $N_s=5$. FastPM compares well against less expensive schemes, being only 7 (4) times more expensive than 2LPT initial condition generator for $N_s=10$ ($N_s=5$). Some of the applications where FastPM can be useful are generating a large number of mocks, producing non-linear statistics where one varies a large number of nuisance or cosmological parameters, or serving as part of an initial conditions solver.

Cosmic voids found in galaxy surveys are defined based on the galaxy distribution in redshift space. We show that the large scale distribution of voids in redshift space traces the fluctuations in the dark matter density field \delta(k) (in Fourier space with \mu being the line of sight projected k-vector): \delta_v^s(k) = (1 + \beta_v \mu^2) b^s_v \delta(k), with a beta factor that will be in general different than the one describing the distribution of galaxies. Only in case voids could be assumed to be quasi-local transformations of the linear (Gaussian) galaxy redshift space field, one gets equal beta factors \beta_v=\beta_g=f/b_g with f being the growth rate, and b_g, b^s_v being the galaxy and void bias on large scales defined in redshift space. Indeed, in our mock void catalogs we measure void beta factors being in good agreement with the galaxy one. Further work needs to be done to confirm the level of accuracy of the beta factor equality between voids and galaxies, but in general the void beta factor needs to be considered as a free parameter for RSD studies.

We present a Bayesian phase-space reconstruction of the cosmic large-scale matter density and velocity fields from the SDSS-III Baryon Oscillations Spectroscopic Survey Data Release 12 (BOSS DR12) CMASS galaxy clustering catalogue. We rely on a given $\Lambda$CDM cosmology, a mesh resolution in the range of 6-10 $h^{-1}$ Mpc, and a lognormal-Poisson model with a redshift dependent nonlinear bias. The bias parameters are derived from the data and a general renormalised perturbation theory approach. We use combined Gibbs and Hamiltonian sampling, implemented in the \textsc{argo} code, to iteratively reconstruct the dark matter density field and the coherent peculiar velocities of individual galaxies, correcting hereby for coherent redshift space distortions (RSD). Our tests relying on accurate $N$-body based mock galaxy catalogues, show unbiased real space power spectra of the nonlinear density field up to $k\sim0.2\, h$ Mpc$^{-1}$, and vanishing quadrupoles down to $r\sim20\,h^{-1}$ Mpc. We also demonstrate that the nonlinear cosmic web can be obtained from the tidal field tensor based on the Gaussian component of the reconstructed density field. We find that the reconstructed velocities have a statistical correlation coefficient compared to the true velocities of each individual lightcone mock galaxy of $r\sim0.68$ including about 10% of satellite galaxies with virial motions (about $r=0.75$ without satellites). The power spectra of the velocity divergence agree well with theoretical predictions up to $k\sim0.2\,h\,{\rm Mpc}^{-1}$. This work will be especially useful to improve, e.g. BAO reconstructions, kinematic Sunyaev-Zeldovich (kSZ), integrated Sachs-Wolfe (ISW) measurements, or environmental studies.

DESI (Dark Energy Spectropic Instrument) is a Stage IV ground-based dark energy experiment that will study baryon acoustic oscillations and the growth of structure through redshift-space distortions with a wide-area galaxy and quasar redshift survey. The DESI instrument is a robotically-actuated, fiber-fed spectrograph capable of taking up to 5,000 simultaneous spectra over a wavelength range from 360 nm to 980 nm. The fibers feed ten three-arm spectrographs with resolution $R= \lambda/\Delta\lambda$ between 2000 and 5500, depending on wavelength. The DESI instrument will be used to conduct a five-year survey designed to cover 14,000 deg$^2$. This powerful instrument will be installed at prime focus on the 4-m Mayall telescope in Kitt Peak, Arizona, along with a new optical corrector, which will provide a three-degree diameter field of view. The DESI collaboration will also deliver a spectroscopic pipeline and data management system to reduce and archive all data for eventual public use.

DESI (Dark Energy Spectroscopic Instrument) is a Stage IV ground-based dark energy experiment that will study baryon acoustic oscillations (BAO) and the growth of structure through redshift-space distortions with a wide-area galaxy and quasar redshift survey. To trace the underlying dark matter distribution, spectroscopic targets will be selected in four classes from imaging data. We will measure luminous red galaxies up to $z=1.0$. To probe the Universe out to even higher redshift, DESI will target bright [O II] emission line galaxies up to $z=1.7$. Quasars will be targeted both as direct tracers of the underlying dark matter distribution and, at higher redshifts ($ 2.1 < z < 3.5$), for the Ly-$\alpha$ forest absorption features in their spectra, which will be used to trace the distribution of neutral hydrogen. When moonlight prevents efficient observations of the faint targets of the baseline survey, DESI will conduct a magnitude-limited Bright Galaxy Survey comprising approximately 10 million galaxies with a median $z\approx 0.2$. In total, more than 30 million galaxy and quasar redshifts will be obtained to measure the BAO feature and determine the matter power spectrum, including redshift space distortions.

We analyse the Baryon Acoustic Oscillation (BAO) signal of the final Baryon Oscillation Spectroscopic Survey (BOSS) data release (DR12). Our analysis is performed in Fourier-space, using the power spectrum monopole and quadrupole. The dataset includes $1\,198\,006$ galaxies over the redshift range $0.2 < z < 0.75$. We divide this dataset into three (overlapping) redshift bins with the effective redshifts $\zeff = 0.38$, $0.51$ and $0.61$. We demonstrate the reliability of our analysis pipeline using N-body simulations as well as $\sim 1000$ MultiDark-Patchy mock catalogues, which mimic the BOSS-DR12 target selection. We apply density field reconstruction to enhance the BAO signal-to-noise ratio. By including the power spectrum quadrupole we can separate the line-of-sight and angular modes, which allows us to constrain the angular diameter distance $D_A(z)$ and the Hubble parameter $H(z)$ separately. We obtain two independent $1.6\%$ and $1.5\%$ constraints on $D_A(z)$ and $2.9\%$ and $2.3\%$ constraints on $H(z)$ for the low ($\zeff=0.38$) and high ($\zeff=0.61$) redshift bin, respectively. We obtain two independent $1\%$ and $0.9\%$ constraints on the angular averaged distance $D_V(z)$, when ignoring the Alcock-Paczynski effect. The detection significance of the BAO signal is of the order of $8\sigma$ (post-reconstruction) for each of the three redshift bins. Our results are in good agreement with the Planck prediction within $\Lambda$CDM. This paper is part of a set that analyses the final galaxy clustering dataset from BOSS. The measurements and likelihoods presented here are combined with others in~\citet{Alam2016} to produce the final cosmological constraints from BOSS.

The usual fluid equations describing the large-scale evolution of mass density in the universe can be written as local in the density, velocity divergence, and velocity potential fields. As a result, the perturbative expansion in small density fluctuations, usually written in terms of convolutions in Fourier space, can be written as a series of products of these fields evaluated at the same location in configuration space. Based on this, we establish a new method to numerically evaluate the 1-loop power spectrum (i.e., Fourier transform of the 2-point correlation function) with one-dimensional Fast Fourier Transforms. This is exact and a few orders of magnitude faster than previously used numerical approaches. Numerical results of the new method are in excellent agreement with the standard quadrature integration method. This fast model evaluation can in principle be extended to higher loop order where existing codes become painfully slow. Our approach follows by writing higher order corrections to the 2-point correlation function as, e.g., the correlation between two second-order fields or the correlation between a linear and a third-order field. These are then decomposed into products of correlations of linear fields and derivatives of linear fields. The method can also be viewed as evaluating three-dimensional Fourier space convolutions using products in configuration space, which may also be useful in other contexts where similar integrals appear.

We develop a general framework for generating estimators of a given quantity which are unbiased to a given order in the difference between the true value of the underlying quantity and the fiducial position in theory space around which we expand the likelihood. We apply this formalism to rederive the optimal quadratic estimator and show how the replacement of the second derivative matrix with the Fisher matrix is a generic way of creating an unbiased estimator (assuming choice of the fiducial model is independent of data). Next apply the approach to estimation of shear lensing, closely following the work of Bernstein and Armstrong (2014). Our first order estimator reduces to their estimator in the limit of zero shear, but it also naturally allows for the case of non-constant shear and the easy calculation of correlation functions or power spectra using standard methods. Both our first-order estimator and Bernstein and Armstrong's estimator exhibit a bias which is quadratic in true shear. Our third-order estimator is, at least in the realm of the toy problem of Bernstein and Armstrong, unbiased to 0.1% in relative shear errors $\Delta g/|g|$ for shears up to $|g|=0.2$.

Understanding the relation between underlying matter distribution and biased tracers such as galaxy or dark matter halo is essential to extract cosmological information from ongoing or future galaxy redshift surveys. At sufficiently large scales such as the BAO scale, a standard approach for the bias problem on the basis of the perturbation theory (PT) is to assume the `local bias' model in which the density field of biased tracers is deterministically expanded in terms of matter density field at the same position. The higher-order bias parameters are then determined by combining the power spectrum with higher-order statistics such as the bispectrum. As is pointed out by recent studies, however, nonlinear gravitational evolution naturally induces nonlocal bias terms even if initially starting only with purely local bias. As a matter of fact, previous works showed that the second-order nonlocal bias term, which corresponds to the gravitational tidal field, is important to explain the characteristic scale-dependence of the bispectrum. In this paper we extend the nonlocal bias term up to third order, and investigate whether the PT-based model including nonlocal bias terms can simultaneously explain the power spectrum and the bispectrum of simulated halos in $N$-body simulations. We show that the power spectrum, including density and momentum, and the bispectrum between halo and matter in $N$-body simulations can be simultaneously well explained by the model including up to third-order nonlocal bias terms up to k~0.1h/Mpc. Also, the results seem in a good agreement with theoretical predictions of a simple coevolution picture, although the agreement is not perfect. These demonstration clearly shows a failure of the local bias model even at such large scales, and we conclude that nonlocal bias terms should be consistently included in order to model statistics of halos. [abridged]

We present Fisher matrix projections for future cosmological parameter measurements, including neutrino masses, dark energy, curvature, modified gravity, the inflationary perturbation spectrum, non-Gaussianity, and dark radiation. We focus on DESI and generally redshift surveys (BOSS, HETDEX, eBOSS, Euclid, and WFIRST), but also include CMB (Planck) and weak gravitational lensing (DES and LSST) constraints. The goal is to present a consistent set of projections, for concrete experiments, which are otherwise scattered throughout many papers and proposals. We include neutrino mass as a free parameter in most projections, as it will inevitably be relevant -- DESI and other experiments can measure the sum of neutrino masses to ~0.02 eV or better, while the minimum possible sum is ~0.06 eV. We note that the BAO-only use of galaxy clustering is substantially degraded as a dark energy probe in the presence of neutrino mass uncertainty -- using broadband galaxy power is critical, especially pushing it to as small a scale as possible, and big gains are achieved by combining lensing survey constraints with redshift survey constraints. We do not try to be especially innovative, e.g., in careful treatments of potential systematic errors -- these projections are intended as a straightforward baseline for comparison to more detailed analyses.

McDonald (2007) presented an approach to improving perturbation theory (PT) calculations of the dark matter power spectrum, with a derivation based on the idea of renormalization group flow with time. In spite of a questionable approximation made in deriving it, subsequent comparisons by several groups between the predictions of the resulting equation and N-body simulations showed remarkable improvement relative to "standard" PT (SPT) at similar order. In this brief note I show that the same final equation can be derived cleanly from the point of view not of flowing with time but with non-linear coupling strength, i.e., gradually dialing the coupling from the trivial value zero to the physical one. This understanding makes it clear how to extend the approach to higher order and other statistics. While I do not necessarily think this approach is best among the many, it may be interesting in that it contains a unique way of suppressing UV sensitivity. In passing I remind the reader of references demonstrating that SPT works remarkably well without improvement (except near redshift zero, where, fortunately for SPT, there is very little volume in the Universe).

In this follow-up work to the High Energy Physics Community Summer Study 2013 (HEP CSS 2013, a.k.a. Snowmass), we explore the scientific capabilities of a future Stage-IV Cosmic Microwave Background polarization experiment (CMB-S4) under various assumptions on detector count, resolution, and sky coverage. We use the Fisher matrix technique to calculate the expected uncertainties in cosmological parameters in $\nu \Lambda$CDM that are especially relevant to the physics of fundamental interactions, including neutrino masses, effective number of relativistic species, dark-energy equation of state, dark-matter annihilation, and inflationary parameters. To further chart the landscape of future cosmology probes, we include forecasted results from the Baryon Acoustic Oscillation (BAO) signal as measured by DESI to constrain parameters that would benefit from low redshift information. We find the following best 1-sigma constraints: $\sigma$ constraints: $\sigma(M_{\nu})= 15$ meV, $\sigma(N_{\rm eff})= 0.0156$, Dark energy Figure of Merit = 303, $\sigma(p_{ann})= 0.00588\times3\times10^{-26}$ cm$^3$/s/GeV, $\sigma(\Omega_K)= 0.00074$, $\sigma(n_s)= 0.00110$, $\sigma(\alpha_s)= 0.00145$, and $\sigma(r)= 0.00009$. We also detail the dependences of the parameter constraints on detector count, resolution, and sky coverage.

The Lyman-$\beta$ forest refers to a region in the spectra of distant quasars that lies between the rest-frame Lyman-$\beta$ and Lyman-$\gamma$ emissions. The forest in this region is dominated by a combination of absorption due to resonant Ly$\alpha$ and Ly$\beta$ scattering. When considering the 1D Ly$\beta$ forest in addition to the 1D Ly$\alpha$ forest, the full statistical description of the data requires four 1D power spectra: Ly$\alpha$ and Ly$\beta$ auto-power spectra and the Ly$\alpha$-Ly$\beta$ real and imaginary cross-power spectra. We describe how these can be measured using an optimal quadratic estimator that naturally disentangles Ly$\alpha$ and Ly$\beta$ contributions. Using a sample of approximately 60,000 quasar sight-lines from the BOSS Data Release 9, we make the measurement of the one-dimensional power spectrum of fluctuations due to the Ly$\beta$ resonant scattering. While we have not corrected our measurements for resolution damping of the power and other systematic effects carefully enough to use them for cosmological constraints, we can robustly conclude the following: i) Ly$\beta$ power spectrum and Ly$\alpha$-Ly$\beta$ cross spectra are detected with high statistical significance; ii) the cross-correlation coefficient is $\approx 1$ on large scales; iii) the Ly$\beta$ measurements are contaminated by the associated OVI absorption, which is analogous to the SiIII contamination of the Ly$\alpha$ forest. Measurements of the Ly$\beta$ forest will allow extension of the usable path-length for the Ly$\alpha$ measurements while allowing a better understanding of the physics of intergalactic medium and thus more robust cosmological constraints.

The Dark Energy Spectroscopic Instrument (DESI) is a massively multiplexed fiber-fed spectrograph that will make the next major advance in dark energy in the timeframe 2018-2022. On the Mayall telescope, DESI will obtain spectra and redshifts for at least 18 million emission-line galaxies, 4 million luminous red galaxies and 3 million quasi-stellar objects, in order to: probe the effects of dark energy on the expansion history using baryon acoustic oscillations (BAO), measure the gravitational growth history through redshift-space distortions, measure the sum of neutrino masses, and investigate the signatures of primordial inflation. The resulting 3-D galaxy maps at z<2 and Lyman-alpha forest at z>2 will make 1%-level measurements of the distance scale in 35 redshift bins, thus providing unprecedented constraints on cosmological models.

We use the Baryon Oscillation Spectroscopic Survey (BOSS) Data Release 9 (DR9) to detect and measure the position of the Baryonic Acoustic Oscillation (BAO) feature in the three-dimensional correlation function in the Lyman-alpha forest flux fluctuations at a redshift z=2.4. The feature is clearly detected at significance between 3 and 5 sigma (depending on the broadband model and method of error covariance matrix estimation) and is consistent with predictions of the standard LCDM model. We assess the biases in our method, stability of the error covariance matrix and possible systematic effects. We fit the resulting correlation function with several models that decouple the broadband and acoustic scale information. For an isotropic dilation factor, we measure 100x(alpha_iso-1) = -1.6 ^{+2.0+4.3+7.4}_{-2.0-4.1-6.8} (stat.) +/- 1.0 (syst.) (multiple statistical errors denote 1,2 and 3 sigma confidence limits) with respect to the acoustic scale in the fiducial cosmological model (flat LCDM with Omega_m=0.27, h=0.7). When fitting separately for the radial and transversal dilation factors we find marginalised constraints 100x(alpha_par-1) = -1.3 ^{+3.5+7.6 +12.3}_{-3.3-6.7-10.2} (stat.) +/- 2.0 (syst.) and 100x(alpha_perp-1) = -2.2 ^{+7.4+17}_{-7.1-15} +/- 3.0 (syst.). The dilation factor measurements are significantly correlated with cross-correlation coefficient of ~ -0.55. Errors become significantly non-Gaussian for deviations over 3 standard deviations from best fit value. Because of the data cuts and analysis method, these measurements give tighter constraints than a previous BAO analysis of the BOSS DR9 Lyman-alpha forest sample, providing an important consistency test of the standard cosmological model in a new redshift regime.

This work describes a new instrument optimized for a detection of the neutral hydrogen 21cm power spectrum between redshifts of 0.5-1.5: the Baryon Acoustic Oscillation Broadband and Broad-beam (BAOBAB) Array. BAOBAB will build on the efforts of a first generation of 21cm experiments which are targeting a detection of the signal from the Epoch of Reionization at z ~ 10. At z ~ 1, the emission from neutral hydrogen in self-shielded overdense halos also presents an accessible signal, since the dominant, synchrotron foreground emission is considerably fainter than at redshift 10. The principle science driver for these observations are Baryon Acoustic Oscillations in the matter power spectrum which have the potential to act as a standard ruler and constrain the nature of dark energy. BAOBAB will fully correlate dual-polarization antenna tiles over the 600-900MHz band with a frequency resolution of 300 kHz and a system temperature of 50K. The number of antennas will grow in staged deployments, and reconfigurations of the array will allow for both traditional imaging and high power spectrum sensitivity operations. We present calculations of the power spectrum sensitivity for various array sizes, with a 35-element array measuring the cosmic neutral hydrogen fraction as a function of redshift, and a 132-element system detecting the BAO features in the power spectrum, yielding a 1.8% error on the z ~ 1 distance scale, and, in turn, significant improvements to constraints on the dark energy equation of state over an unprecedented range of redshifts from ~0.5-1.5.

We develop a perturbative approach to redshift space distortions (RSD) using the phase space distribution function approach and apply it to the dark matter redshift space power spectrum and its moments. RSD can be written as a sum over density weighted velocity moments correlators, with the lowest order being density, momentum density and stress energy density. We use standard and extended perturbation theory (PT) to determine their auto and cross correlators, comparing them to N-body simulations. We show which of the terms can be modeled well with the standard PT and which need additional terms that include higher order corrections which cannot be modeled in PT. Most of these additional terms are related to the small scale velocity dispersion effects, the so called finger of god (FoG) effects, which affect some, but not all, of the terms in this expansion, and which can be approximately modeled using a simple physically motivated ansatz such as the halo model. We point out that there are several velocity dispersions that enter into the detailed RSD analysis with very different amplitudes, which can be approximately predicted by the halo model. In contrast to previous models our approach systematically includes all of the terms at a given order in PT and provides a physical interpretation for the small scale dispersion values. We investigate RSD power spectrum as a function of \mu, the cosine of the angle between the Fourier mode and line of sight, focusing on the lowest order powers of \mu and multipole moments which dominate the observable RSD power spectrum. Overall we find considerable success in modeling many, but not all, of the terms in this expansion.

The Baryon Oscillation Spectroscopic Survey (BOSS) is designed to measure the scale of baryon acoustic oscillations (BAO) in the clustering of matter over a larger volume than the combined efforts of all previous spectroscopic surveys of large scale structure. BOSS uses 1.5 million luminous galaxies as faint as i=19.9 over 10,000 square degrees to measure BAO to redshifts z<0.7. Observations of neutral hydrogen in the Lyman alpha forest in more than 150,000 quasar spectra (g<22) will constrain BAO over the redshift range 2.15<z<3.5. Early results from BOSS include the first detection of the large-scale three-dimensional clustering of the Lyman alpha forest and a strong detection from the Data Release 9 data set of the BAO in the clustering of massive galaxies at an effective redshift z = 0.57. We project that BOSS will yield measurements of the angular diameter distance D_A to an accuracy of 1.0% at redshifts z=0.3 and z=0.57 and measurements of H(z) to 1.8% and 1.7% at the same redshifts. Forecasts for Lyman alpha forest constraints predict a measurement of an overall dilation factor that scales the highly degenerate D_A(z) and H^{-1}(z) parameters to an accuracy of 1.9% at z~2.5 when the survey is complete. Here, we provide an overview of the selection of spectroscopic targets, planning of observations, and analysis of data and data quality of BOSS.

In December 2010, NASA created a Science Definition Team (SDT) for WFIRST, the Wide Field Infra-Red Survey Telescope, recommended by the Astro 2010 Decadal Survey as the highest priority for a large space mission. The SDT was chartered to work with the WFIRST Project Office at GSFC and the Program Office at JPL to produce a Design Reference Mission (DRM) for WFIRST. Part of the original charge was to produce an interim design reference mission by mid-2011. That document was delivered to NASA and widely circulated within the astronomical community. In late 2011 the Astrophysics Division augmented its original charge, asking for two design reference missions. The first of these, DRM1, was to be a finalized version of the interim DRM, reducing overall mission costs where possible. The second of these, DRM2, was to identify and eliminate capabilities that overlapped with those of NASA's James Webb Space Telescope (henceforth JWST), ESA's Euclid mission, and the NSF's ground-based Large Synoptic Survey Telescope (henceforth LSST), and again to reduce overall mission cost, while staying faithful to NWNH. This report presents both DRM1 and DRM2.

Measurement of redshift-space distortions (RSD) offers an attractive method to directly probe the cosmic growth history of density perturbations. A distribution function approach where RSD can be written as a sum over density weighted velocity moment correlators has recently been developed. We use Nbody simulations to investigate the individual contributions and convergence of this expansion for dark matter. If the series is expanded as a function of powers of mu, cosine of the angle between the Fourier mode and line of sight, there are a finite number of terms contributing at each order. We present these terms and investigate their contribution to the total as a function of wavevector k. For mu^2 the correlation between density and momentum dominates on large scales. Higher order corrections, which act as a Finger-of-God (FoG) term, contribute 1% at k~0.015h/Mpc, 10% at k~0.05h/Mpc at z=0, while for k>0.15h/Mpc they dominate and make the total negative. These higher order terms are dominated by density-energy density correlations which contribute negatively to the power, while the contribution from vorticity part of momentum density auto-correlation is an order of magnitude lower. For mu^4 term the dominant term on large scales is the scalar part of momentum density auto-correlation, while higher order terms dominate for k>0.15h/Mpc. For mu^6 and mu^8 we find it has very little power for k<0.15h/Mpc. We also compare the expansion to the full 2D P^ss(k,mu) as well as to their multipoles. For these statistics an infinite number of terms contribute and we find that the expansion achieves percent level accuracy for kmu<0.15h/Mpc at 6th order, but breaks down on smaller scales because the series is no longer perturbative. We explore resummation of the terms into FoG kernels, which extend the convergence up to a factor of 2 in scale. We find that the FoG kernels are approximately Lorentzian.

The relation between the clustering properties of luminous matter in the form of galaxies and the underlying dark matter distribution is of fundamental importance for the interpretation of ongoing and upcoming galaxy surveys. The so called local bias model, where galaxy density is a function of local matter density, is frequently discussed as a means to infer the matter power spectrum or correlation function from the measured galaxy correlation. However, gravitational evolution generates a term quadratic in the tidal tensor and thus non-local in the density field, even if this term is absent in the initial conditions (Lagrangian space). Because the term is quadratic, it contributes as a loop correction to the power spectrum, so the standard linear bias picture still applies on large scales, however, it contributes at leading order to the bispectrum for which it is significant on all scales. Such a term could also be present in Lagrangian space if halo formation were influenced by the tidal field. We measure the corresponding coupling strengths from the matter-matter-halo bispectrum in numerical simulations and find a non-vanishing coefficient for the tidal tensor term. We find no scale dependence of the bias parameters up to k=0.1 h/Mpc and that the tidal effect is increasing with halo mass. While the Lagrangian bias picture is a better description of our results than the Eulerian bias picture, our results suggest that there might be a tidal tensor bias already in the initial conditions. We also find that the coefficients of the quadratic density term deviate quite strongly from the theoretical predictions based on the spherical collapse model and a universal mass function. Both quadratic density and tidal tensor bias terms must be included in the modeling of galaxy clustering of current and future surveys if one wants to achieve the high precision cosmology promise of these datasets.

We revisit the uncertainty in baryon acoustic oscillation (BAO) forecasts and data analyses. In particular, we study how much the uncertainties on both the measured mean dilation scale and the associated error bar are affected by the non-Gaussianity of the non-linear density field. We examine two possible impacts of non-Gaussian analysis: (1) we derive the distance estimators from Gaussian theory, but use 1000 N-Body simulations to measure the actual errors, and compare this to the Gaussian prediction, and (2) we compute new optimal estimators, which requires the inverse of the non-Gaussian covariance matrix of the matter power spectrum. Obtaining an accurate and precise inversion is challenging, and we opted for a noise reduction technique applied on the covariance matrices. By measuring the bootstrap error on the inverted matrix, this work quantifies for the first time the significance of the non-Gaussian error corrections on the BAO dilation scale. We find that the variance (error squared) on distance measurements can deviate by up to 12% between both estimators, an effect that requires a large number of simulations to be resolved. We next apply a reconstruction algorithm to recover some of the BAO signal that had been smeared by non-linear evolution, and we rerun the analysis. We find that after reconstruction, the rms error on the distance measurement improves by a factor of ~1.7 at low redshift (consistent with previous results), and the variance ({\sigma}^2) shows a change of up to 18% between optimal and sub-optimal cases (note, however, that these discrepancies may depend in detail on the procedure used to isolate the BAO signal). We finally discuss the impact of this work on current data analyses.

Massive spectroscopic surveys of high-redshift quasars yield large numbers of correlated Lyman {\alpha} absorption spectra that can be used to measure large-scale structure. Simulations of these surveys are required to accurately interpret the measurements of correlations and correct for systematic errors. An efficient method to generate mock realizations of Lyman {\alpha} forest surveys is presented which generates a field over the lines of sight to the survey sources only, instead of having to generate it over the entire three-dimensional volume of the survey. The method can be calibrated to reproduce the power spectrum and one-point distribution function of the transmitted flux fraction, as well as the redshift evolution of these quantities, and is easily used for modeling any survey systematic effects. We present an example of how these mock surveys are applied to predict the measurement errors in a survey with similar parameters as the BOSS quasar survey in SDSS-III.

We develop a phase space distribution function approach to redshift space distortions (RSD), in which the redshift space density can be written as a sum over velocity moments of the distribution function. These moments are density weighted and their lowest orders are density, momentum density, and stress energy density. The series expansion is convergent on large scales. We perform an expansion of these velocity moments into helicity modes, which are eigenmodes under rotation around the axis of Fourier mode direction, generalizing the scalar, vector, tensor decomposition of perturbations to an arbitrary order. We show that only equal helicity moments correlate and derive the angular dependence of the individual contributions to the redshift space power spectrum in terms of angle mu between wave vector and line of sight. We show that the dominant term of mu^2 dependence on large scales is the cross-correlation between the density and scalar part of momentum density, which can be related to the time derivative of the matter power spectrum. Additional terms contributing and dominating on small scales are the vector part of momentum density-momentum density correlations, the energy density-density correlations, and the scalar part of anisotropic stress density-density correlations. Similarly, we identify 7 terms contributing to mu^4 dependence. Some of the advantages of the distribution function approach are that the series expansion converges on large scales and remains valid in multi-stream situations. We finish with a brief discussion of implications for RSD in galaxies relative to dark matter, highlighting the issue of scale dependent bias of velocity moments correlators.

Building on the legacy of the Sloan Digital Sky Survey (SDSS-I and II), SDSS-III is a program of four spectroscopic surveys on three scientific themes: dark energy and cosmological parameters, the history and structure of the Milky Way, and the population of giant planets around other stars. In keeping with SDSS tradition, SDSS-III will provide regular public releases of all its data, beginning with SDSS DR8 (which occurred in Jan 2011). This paper presents an overview of the four SDSS-III surveys. BOSS will measure redshifts of 1.5 million massive galaxies and Lya forest spectra of 150,000 quasars, using the BAO feature of large scale structure to obtain percent-level determinations of the distance scale and Hubble expansion rate at z<0.7 and at z~2.5. SEGUE-2, which is now completed, measured medium-resolution (R=1800) optical spectra of 118,000 stars in a variety of target categories, probing chemical evolution, stellar kinematics and substructure, and the mass profile of the dark matter halo from the solar neighborhood to distances of 100 kpc. APOGEE will obtain high-resolution (R~30,000), high signal-to-noise (S/N>100 per resolution element), H-band (1.51-1.70 micron) spectra of 10^5 evolved, late-type stars, measuring separate abundances for ~15 elements per star and creating the first high-precision spectroscopic survey of all Galactic stellar populations (bulge, bar, disks, halo) with a uniform set of stellar tracers and spectral diagnostics. MARVELS will monitor radial velocities of more than 8000 FGK stars with the sensitivity and cadence (10-40 m/s, ~24 visits per star) needed to detect giant planets with periods up to two years, providing an unprecedented data set for understanding the formation and dynamical evolution of giant planet systems. (Abridged)

Using a sample of approximately 14,000 z>2.1 quasars observed in the first year of the Baryon Oscillation Spectroscopic Survey (BOSS), we measure the three-dimensional correlation function of absorption in the Lyman-alpha forest. The angle-averaged correlation function of transmitted flux (F = exp(-tau)) is securely detected out to comoving separations of 60 Mpc/h, the first detection of flux correlations across widely separated sightlines. A quadrupole distortion of the redshift-space correlation function by peculiar velocities, the signature of the gravitational instability origin of structure in the Lyman-alpha forest, is also detected at high significance. We obtain a good fit to the data assuming linear theory redshift-space distortion and linear bias of the transmitted flux, relative to the matter fluctuations of a standard LCDM cosmological model (inflationary cold dark matter with a cosmological constant). At 95% confidence, we find a linear bias parameter 0.16<b<0.24 and redshift-distortion parameter 0.44<beta<1.20, at central redshift z=2.25, with a well constrained combination b(1+\beta)=0.336 +/- 0.012. The errors on beta are asymmetric, with beta=0 excluded at over 5 sigma confidence level. The value of beta is somewhat low compared to theoretical predictions, and our tests on synthetic data suggest that it is depressed (relative to expectations for the Lyman-alpha forest alone) by the presence of high column density systems and metal line absorption. These results set the stage for cosmological parameter determinations from three-dimensional structure in the Lyman-alpha forest, including anticipated constraints on dark energy from baryon acoustic oscillations.

BigBOSS is a Stage IV ground-based dark energy experiment to study baryon acoustic oscillations (BAO) and the growth of structure with a wide-area galaxy and quasar redshift survey over 14,000 square degrees. It has been conditionally accepted by NOAO in response to a call for major new instrumentation and a high-impact science program for the 4-m Mayall telescope at Kitt Peak. The BigBOSS instrument is a robotically-actuated, fiber-fed spectrograph capable of taking 5000 simultaneous spectra over a wavelength range from 340 nm to 1060 nm, with a resolution R = 3000-4800. Using data from imaging surveys that are already underway, spectroscopic targets are selected that trace the underlying dark matter distribution. In particular, targets include luminous red galaxies (LRGs) up to z = 1.0, extending the BOSS LRG survey in both redshift and survey area. To probe the universe out to even higher redshift, BigBOSS will target bright [OII] emission line galaxies (ELGs) up to z = 1.7. In total, 20 million galaxy redshifts are obtained to measure the BAO feature, trace the matter power spectrum at smaller scales, and detect redshift space distortions. BigBOSS will provide additional constraints on early dark energy and on the curvature of the universe by measuring the Ly-alpha forest in the spectra of over 600,000 2.2 < z < 3.5 quasars. BigBOSS galaxy BAO measurements combined with an analysis of the broadband power, including the Ly-alpha forest in BigBOSS quasar spectra, achieves a FOM of 395 with Planck plus Stage III priors. This FOM is based on conservative assumptions for the analysis of broad band power (kmax = 0.15), and could grow to over 600 if current work allows us to push the analysis to higher wave numbers (kmax = 0.3). BigBOSS will also place constraints on theories of modified gravity and inflation, and will measure the sum of neutrino masses to 0.024 eV accuracy.

It is shown that 21 cm intensity mapping could be used in the near term to make cosmologically useful measurements. Large scale structure could be detected using existing radio telescopes, or using prototypes for dedicated redshift survey telescopes. This would provide a measure of the mean neutral hydrogen density, using redshift space distortions to break the degeneracy with the linear bias. We find that with only 200 hours of observing time on the Green Bank Telescope, the neutral hydrogen density could be measured to 25% precision at redshift 0.54<z<1.09. This compares favourably to current measurements, uses independent techniques, and would settle the controversy over an important parameter which impacts galaxy formation studies. In addition, a 4000 hour survey would allow for the detection of baryon acoustic oscillations, giving a cosmological distance measure at 3.5% precision. These observation time requirements could be greatly reduced with the construction of multiple pixel receivers. Similar results are possible using prototypes for dedicated cylindrical telescopes on month time scales, or SKA pathfinder aperture arrays on day time scales. Such measurements promise to improve our understanding of these quantities while beating a path for future generations of hydrogen surveys.

We present projected constraints on modified gravity models from the observational technique known as 21 cm intensity mapping, where cosmic structure is detected without resolving individual galaxies. The resulting map is sensitive to both BAO and weak lensing, two of the most powerful cosmological probes. It is found that a 200 m x 200 m cylindrical telescope, sensitive out to z=2.5, would be able to distinguish DGP from most dark energy models, and constrain the Hu & Sawicki f(R) model to |f_{R0}| < 9*10^(-6) at 95% confidence. The latter constraint makes extensive use of the lensing spectrum in the nonlinear regime. These results show that 21 cm intensity mapping is not only sensitive to modifications of the standard model's expansion history, but also to structure growth. This makes intensity mapping a powerful and economical technique, achievable on much shorter time scales than optical experiments that would probe the same era.

I show how to reintroduce velocity dispersion into perturbation theory (PT) calculations of structure in the Universe, i.e., how to go beyond the pressureless fluid approximation, starting from first principles. This addresses a possible deficiency in uses of PT to compute clustering on the weakly non-linear scales that will be critical for probing dark energy. Specifically, I show how to derive a non-negligible value for the (initially tiny) velocity dispersion of dark matter particles, <\delta v^2>, where \delta v is the deviation of particle velocities from the local bulk flow. The calculation is essentially a renormalization of the homogeneous (zero order) dispersion by fluctuations 1st order in the initial power spectrum. For power law power spectra with n>-3, the small-scale fluctuations diverge and significant dispersion can be generated from an arbitrarily small starting value -- the dispersion level is set by an equilibrium between fluctuations generating more dispersion and dispersion suppressing fluctuations. For an n=-1.4 power law normalized to match the present non-linear scale, the dispersion would be ~100 km/s. This n corresponds roughly to the slope on the non-linear scale in the real \LambdaCDM Universe, but \LambdaCDM contains much less initial small-scale power -- not enough to bootstrap the small starting dispersion up to a significant value within linear theory (viewed very broadly, structure formation has actually taken place rather suddenly and recently, in spite of the usual "hierarchical" description). The next order PT calculation, which I carry out only at an order of magnitude level, should drive the dispersion up into balance with the growing structure, accounting for small dispersion effects seen recently in simulations.

I extend the usual linear-theory formula for large-scale clustering in redshift-space to include gravitational redshift. The extra contribution to the standard galaxy power spectrum is suppressed by k_c^{-2}, where k_c=c k/a H (k is the wavevector, a the expansion factor, and H=\dot{a}/a), and is thus effectively limited to the few largest-scale modes and very difficult to detect; however, a correlation, \propto k_c^{-1}, is generated between the real and imaginary parts of the Fourier space density fields of two different types of galaxy, which would otherwise be zero, i.e., the cross-power spectrum has an imaginary part: P_{ab}(k,\mu)/P(k)=(b_a+f\mu^2)(b_b+f\mu^2) -i(3\Omega_m/2)(\mu/k_c)(b_a-b_b)+\mathcal{O}(k_c^{-2}), where P(k) is the real-space mass-density power spectrum, b_i are the galaxy biases, \mu is the cosine of the angle between the wavevector and line of sight, and f=dlnD/dlna (D is the linear growth factor). The total signal-to-noise of measurements of this effect is not dominated by the largest scales -- it converges at k~0.05 h/Mpc. This gravitational redshift result is pedagogically interesting, but naive in that it is gauge dependent and there are other effects of similar form and size, related to the transformation between observable and proper coordinates. I include these effects, which add other contributions to the coefficient of \mu/k_c, and add a \mu^3/k_c term, but don't qualitatively change the picture. The leading source of noise in the measurement is galaxy shot-noise, not sample variance, so developments that allow higher S/N surveys can make this measurement powerful, although it would otherwise be only marginally detectable in a JDEM-scale survey.

The inhomogeneous cosmological reionization process leaves tangible imprints in the intergalactic medium down to z=4-5. The Lyman-alpha forest flux power spectrum provides a potentially powerful probe of the epoch of reionization. With the existing SDSS I/II quasar sample we show that two cosmological reionization scenarios, one completing reionization at z=6 and the other at z=9, can be distinguished at ~7 sigma level by utilizing Lyman alpha forest absorption spectra at z=4.5+-0.5, in the absence of other physical processes that may also affect the Lyman alpha flux power spectrum. The redshift range z=4-5 may provide the best window, because there is still enough transmitted flux and quasars to measure precise statistics of the flux fluctuations, and the IGM still retains a significant amount of memory of reionization.

A new and powerful probe of the origin and evolution of structures in the Universe has emerged and been actively developed over the last decade. In the coming decade, non-Gaussianity, i.e., the study of non-Gaussian contributions to the correlations of cosmological fluctuations, will become an important probe of both the early and the late Universe. Specifically, it will play a leading role in furthering our understanding of two fundamental aspects of cosmology and astrophysics: (i) the physics of the very early universe that created the primordial seeds for large-scale structures, and (ii) the subsequent growth of structures via gravitational instability and gas physics at later times. To date, observations of fluctuations in the Cosmic Microwave Background (CMB) and the Large-Scale Structure of the Universe (LSS) have focused largely on the Gaussian contribution as measured by the two-point correlations (or the power spectrum) of density fluctuations. However, an even greater amount of information is contained in non-Gaussianity and a large discovery space therefore still remains to be explored. Many observational probes can be used to measure non-Gaussianity, including CMB, LSS, gravitational lensing, Lyman-alpha forest, 21-cm fluctuations, and the abundance of rare objects such as clusters of galaxies and high-redshift galaxies. Not only does the study of non-Gaussianity maximize the science return from a plethora of present and future cosmological experiments and observations, but it also carries great potential for important discoveries in the coming decade.

Long-term precise timing of Galactic millisecond pulsars holds great promise for measuring the long-period (months-to-years) astrophysical gravitational waves. Several gravitational-wave observational programs, called Pulsar Timing Arrays (PTA), are being pursued around the world. Here we develop a Bayesian algorithm for measuring the stochastic gravitational-wave background (GWB) from the PTA data. Our algorithm has several strengths: (1) It analyses the data without any loss of information, (2) It trivially removes systematic errors of known functional form, including quadratic pulsar spin-down, annual modulations and jumps due to a change of equipment, (3) It measures simultaneously both the amplitude and the slope of the GWB spectrum, (4) It can deal with unevenly sampled data and coloured pulsar noise spectra. We sample the likelihood function using Markov Chain Monte Carlo (MCMC) simulations. We extensively test our approach on mock PTA datasets, and find that the algorithm has significant benefits over currently proposed counterparts. We show the importance of characterising all red noise components in pulsar timing noise by demonstrating that the presence of a red component would significantly hinder a detection of the GWB. Lastly, we explore the dependence of the signal-to-noise ratio on the duration of the experiment, number of monitored pulsars, and the magnitude of the pulsar timing noise. These parameter studies will help formulate observing strategies for the PTA experiments.

On very large scales, density fluctuations in the Universe are small, suggesting a perturbative model for large-scale clustering of galaxies (or other dark matter tracers), in which the galaxy density is written as a Taylor series in the local mass density, delta, with the unknown coefficients in the series treated as free "bias" parameters. We extend this model to include dependence of the galaxy density on the local values of nabla_i nabla_j phi and nabla_i v_j, where phi is the potential and v is the peculiar velocity. We show that only two new free parameters are needed to model the power spectrum and bispectrum up to 4th order in the initial density perturbations, once symmetry considerations and equivalences between possible terms are accounted for. One of the new parameters is a bias multiplying s_ij s_ji, where s_ij=[nabla_i nabla_j \nabla^-2 - 1/3 delta^K_ij] delta. The other multiplies s_ij t_ji, where t_ij=[nabla_i nabla_j nabla^-2 - 1/3 delta^K_ij](theta-delta), with theta=-(a H dlnD/dlna)^-1 nabla_i v_i. (There are other, observationally equivalent, ways to write the two terms, e.g., using theta-delta instead of s_ij s_ji.) We show how short-range (non-gravitational) non-locality can be included through a controlled series of higher derivative terms, starting with R^2 nabla^2 delta, where R is the scale of non-locality (this term will be a small correction as long as k^2 R^2 is small, where k is the observed wavenumber). We suggest that there will be much more information in future huge redshift surveys in the range of scales where beyond-linear perturbation theory is both necessary and sufficient than in the fully linear regime.

I compute the effect on the power spectrum of tracers of the large-scale mass-density field (e.g., galaxies) of primordial non-Gaussianity of the form Phi=phi+fNL (phi-<phi^2>)+gNL phi^3+..., where Phi is proportional to the initial potential fluctuations and phi is a Gaussian field, using beyond-linear-order perturbation theory. I find that the need to eliminate large higher-order corrections necessitates the addition of a new term to the bias model, proportional to phi, i.e., delta_g=b_delta delta+b_phi fNL phi+..., with all the consequences this implies for clustering statistics, e.g., P_gg(k)=b_delta^2 P_deltadelta(k)+2 b_delta b_phi fNL P_phidelta(k)+b_phi^2 fNL^2 P_phiphi(k)+... . This result is consistent with calculations based on a model for dark matter halo clustering, showing that the form is quite general, not requiring assumptions about peaks, or the formation or existence of halos. The halo model plays the same role it does in the usual bias picture, giving a prediction for b_phi for galaxies known to sit in a certain type of halo. Previous projections for future constraints based on this effect have been very conservative -- there is enough volume at z<~2 to measure fNL to ~+-1, with much more volume at higher z. As a prelude to the bias calculation, I point out that the beyond-linear (in phi) corrections to the power spectrum of mass-density perturbations are naively infinite, so it is dangerous to assume they are negligible; however, the infinite part can be removed by a renormalization of the fluctuation amplitude, with the residual k-dependent corrections negligible for models allowed by current constraints.

We show how to use multiple tracers of large-scale density with different biases to measure the redshift-space distortion parameter beta=f/b=(dlnD/dlna)/b (where D is the growth rate and a the expansion factor), to a much better precision than one could achieve with a single tracer, to an arbitrary precision in the low noise limit. In combination with the power spectrum of the tracers this allows a much more precise measurement of the bias-free velocity divergence power spectrum, f^2 P_m - in fact, in the low noise limit f^2 P_m can be measured as well as would be possible if velocity divergence was observed directly, with rms improvement factor ~[5.2(beta^2+2 beta+2)/beta^2]^0.5 (e.g., ~10 times better than a single tracer for beta=0.4). This would allow a high precision determination of f D as a function of redshift with an error as low as 0.1%. We find up to two orders of magnitude improvement in Figure of Merit for the Dark Energy equation of state relative to Stage II, a factor of several better than other proposed Stage IV Dark Energy surveys. The ratio b_2/b_1 will be determined with an even greater precision than beta, producing, when measured as a function of scale, an exquisitely sensitive probe of the onset of non-linear bias. We also extend in more detail previous work on the use of the same technique to measure non-Gaussianity. Currently planned redshift surveys are typically designed with signal to noise of unity on scales of interest, and are not optimized for this technique. Our results suggest that this strategy may need to be revisited as there are large gains to be achieved from surveys with higher number densities of galaxies.

Observations of high-redshift Ly-alpha sources are a major tool for studying the high-redshift Universe. We discuss the effect of the reionizing intergalactic medium on the observability of Ly-alpha sources based on large simulations of early structure formation with radiative transfer. This takes into account self-consistently the reionization history, density, velocity and ionization structures and nonlinear source clustering. We find that all fields are highly anisotropic and as a consequence there are very large variations in opacity among the different lines-of-sight. The velocity effects, from both infall and source peculiar velocity are most important for the luminous sources, affecting the line profile and depressing the bright end of the luminosity function. The line profiles are generally asymmetric and the line centers of the luminous sources are always absorbed due to the high density of the local IGM. For both luminous and average sources the damping wing effects are of similar magnitude and remain significant until fairly late. The ionizing flux in the ionized patch surrounding a high density peak is generally strongly dominated, particularly at late times, by the cluster of faint sources, rather than the central massive galaxy. The IGM absorption does not change appreciably the correlation function of sources at high redshift. Our derived luminosity function assuming constant mass-to-light ratio provides an excellent match to the shape of the observed luminosity function at z=6.6 with faint-end slope of alpha=-1.5. The resulting mass-to-light ratio implies that the majority of sources responsible for reionization are too faint to be observed by the current surveys. (abridged)

The expansion of the universe appears to be accelerating, and the mysterious anti-gravity agent of this acceleration has been called ``dark energy''. To measure the dynamics of dark energy, Baryon Acoustic Oscillations (BAO) can be used. Previous discussions of the BAO dark energy test have focused on direct measurements of redshifts of as many as $10^9$ individual galaxies, by observing the 21cm line or by detecting optical emission. Here we show how the study of acoustic oscillation in the 21 cm brightness can be accomplished by economical three dimensional intensity mapping. If our estimates gain acceptance they may be the starting point for a new class of dark energy experiments dedicated to large angular scale mapping of the radio sky, shedding light on dark energy.

Recently the numerical simulations of the process of reionization of the universe at z>6 have made a qualitative leap forward, reaching sufficient sizes and dynamic range to determine the characteristic scales of this process. This allowed making the first realistic predictions for a variety of observational signatures. We discuss recent results from large-scale radiative transfer and structure formation simulations on the observability of high-redshift Ly-alpha sources. We also briefly discuss the dependence of the characteristic scales and topology of the ionized and neutral patches on the reionization parameters.

In recent years there has been considerable progress in our understanding of the nature and properties of the reionization process. In particular, the numerical simulations of this epoch have made a qualitative leap forward, reaching sufficiently large scales to derive the characteristic scales of the reionization process and thus allowing for realistic observational predictions. Our group has recently performed the first such large-scale radiative transfer simulations of reionization, run on top of state-of-the-art simulations of early structure formation. This allowed us to make the first realistic observational predictions about the Epoch of Reionization based on detailed radiative transfer and structure formation simulations. We discuss the basic features of reionization derived from our simulations and some recent results on the observational implications for the high-redshift Ly-alpha sources.

I compute a renormalization group (RG) improvement to the standard beyond-linear-order Eulerian perturbation theory (PT) calculation of the power spectrum of large-scale density fluctuations in the Universe. At z=0, for a power spectrum matching current observations, lowest order RGPT appears to be as accurate as one can test using existing numerical simulation-calibrated fitting formulas out to at least k~=0.3 h/Mpc; although inaccuracy is guaranteed at some level by approximations in the calculation (which can be improved in the future). In contrast, standard PT breaks down virtually as soon as beyond-linear corrections become non-negligible, on scales even larger than k=0.1 h/Mpc. This extension in range of validity could substantially enhance the usefulness of PT for interpreting baryonic acoustic oscillation surveys aimed at probing dark energy, for example. I show that the predicted power spectrum converges at high k to a power law with index given by the fixed-point solution of the RG equation. I discuss many possible future directions for this line of work. The basic calculation of this paper should be easily understandable without any prior knowledge of RG methods, while a rich background of mathematical physics literature exists for the interested reader.

A commonly used perturbative method for computing large-scale clustering of tracers of mass density, like galaxies, is to model the tracer density field as a Taylor series in the local smoothed mass density fluctuations, possibly adding a stochastic component. I suggest a set of parameter redefinitions, eliminating problematic perturbative correction terms, that should represent a modest improvement, at least, to this method. As presented here, my method can be used to compute the power spectrum and bispectrum to 4th order in initial density perturbations, and higher order extensions should be straightforward. While the model is technically unchanged at this order, just reparameterized, the renormalized model is more elegant, and should have better convergence behavior, for three reasons: First, in the usual approach the effects of beyond-linear-order bias parameters can be seen at asymptotically large scales, while after renormalization the linear model is preserved in the large-scale limit, i.e., the effects of higher order bias parameters are restricted to relatively high k. Second, while the standard approach includes smoothing to suppress large perturbative correction terms, resulting in dependence on the arbitrary cutoff scale, no cutoff-sensitive terms appear explicitly after my redefinitions (and, relatedly, my correction terms are less sensitive to high-k, non-linear, power). Third, the 3rd order bias parameter disappears entirely, so my model has one fewer free parameter than usual (this parameter was redundant at the order considered). This model predicts a small modification of the baryonic acoustic oscillation (BAO) signal, in real space, supporting the robustness of BAO as a probe of dark energy, and providing a complete perturbative description over the relevant range of scales.

We combine the Ly-alpha forest power spectrum (LYA) from the Sloan Digital Sky Survey (SDSS) and high resolution spectra with cosmic microwave background (CMB) including 3-year WMAP, and supernovae (SN) and galaxy clustering constraints to derive new constraints on cosmological parameters. The existing LYA power spectrum analysis is supplemented by constraints on the mean flux decrement derived using a principle component analysis for quasar continua, which improves the LYA constraints on the linear power. We find some tension between the WMAP3 and LYA power spectrum amplitudes, at the ~2 sigma level, which is partially alleviated by the inclusion of other observations: we find \sigma_8=0.85\pm 0.02 compared to sigma_8=0.80 \pm 0.03 without LYA. For the slope we find ns=0.965\pm0.012. We find no evidence for the running of the spectral index in the combined analysis, dn/dln k=-(1.5\pm 1.2) x 10^{-2}, in agreement with inflation. The limits on the sum of neutrino masses are significantly improved: $\sum m_{\nu}<0.17\eV$ at 95% (<0.32eV at 99.9%). This result, when combined with atmospheric and solar neutrino mixing constraints, requires that the neutrino masses cannot be degenerate, m_3/m_1>1.3 (95% c.l.). Assuming a thermalized fourth neutrino we find m_s<0.26\eV at 95% c.l. and such neutrino cannot be an explanation for the LSND results. In the limits of massless neutrinos we obtain the effective number of neutrinos N_\nu^{\rm eff}=5.3^{+0.4}_{-0.6}{}^{+2.1}_{-1.7}{}^{+3.8}_{-2.5} and N_\nu^{\rm eff}=3.04 is allowed only at 2.4-sigma. The constraint on the dark energy equation of state is w=-1.04\pm 0.06. The constraint on curvature is Omega_k=-0.003\pm 0.006. Cosmic strings limits are G\mu <2.3 x 10^{-7} at 95% c.l. and correlated isocurvature models are also tightly constrained.

We explore the requirements for a Lyman-alpha forest (LyaF) survey designed to measure the angular diameter distance and Hubble parameter at 2~<z~<4 using the standard ruler provided by baryonic acoustic oscillations (BAO). The goal would be to obtain a high enough density of sources to probe the three-dimensional density field on the scale of the BAO feature. A percent-level measurement in this redshift range can almost double the Dark Energy Task Force Figure of Merit, relative to the case with only a similar precision measurement at z~1, if the Universe is not assumed to be flat. This improvement is greater than the one obtained by doubling the size of the z~1 survey, with Planck and a weak SDSS-like z=0.3 BAO measurement assumed in each case. Galaxy BAO surveys at z~1 may be able to make an effective LyaF measurement simultaneously at minimal added cost, because the required number density of quasars is relatively small. We discuss the constraining power as a function of area, magnitude limit (density of quasars), resolution, and signal-to-noise of the spectra. For example, a survey covering 2000 sq. deg. and achieving S/N=1.8 per Ang. at g=23 (~40 quasars per sq. deg.) with an R~>250 spectrograph is sufficient to measure both the radial and transverse oscillation scales to 1.4% from the LyaF (or better, if fainter magnitudes and possibly Lyman-break galaxies can be used). At fixed integration time and in the sky-noise-dominated limit, a wider, noisier survey is generally more efficient; the only fundamental upper limit on noise being the need to identify a quasar and find a redshift. Because the LyaF is much closer to linear and generally better understood than galaxies, systematic errors are even less likely to be a problem.

We use the Ly-alpha forest power spectrum measured by the SDSS and high-resolution spectroscopy observations in combination with cosmic microwave background and galaxy clustering constraints to place limits on a sterile neutrino as a dark matter candidate in the warm dark matter (WDM) scenario. Such a neutrino would be created in the early universe through mixing with an active neutrino and would suppress structure on scales smaller than its free streaming scale. We ran a series of high-resolution hydrodynamic simulations with varying neutrino mass to describe the effect of a sterile neutrino on the Ly-alpha forest power spectrum. We find that the mass limit is m_s >14 keV at 95% c.l. (10keV at 99.9%), which is nearly an order of magnitude tighter constraint than previously published limits and is above the upper limit allowed by X-ray constraints, excluding this candidate as dark matter in this model. The corresponding limit for a neutrino that decoupled early while in thermal equilibrium is 2.5keV (95% c.l.).

We present N-body simulation calculations of the dependence of the power spectrum of non-linear cosmological mass density fluctuations on the equation of state of the dark energy, w=p/rho. At fixed linear theory power, increasing w leads to an increase in non-linear power, with the effect increasing with k. By k=10 h/Mpc, a model with w=-0.75 has ~12% more power than a standard cosmological constant model (w=-1), while a model with w=-0.5 has ~33% extra power (at z=0). The size of the effect increases with increasing dark energy fraction, and to a lesser extent increasing power spectrum normalization, but is insensitive to the power spectrum shape (the numbers above are for Omega_m=0.281 and sigma_8=0.897). A code quantifying the non-linear effect of varying w, as a function of k, z, and other cosmological parameters, which should be accurate to a few percent for k<10 h/Mpc for models that fit the current observations, is available at http://www.cita.utoronto.ca/~pmcdonal/code.html. This paper also serves as an example of a detailed exploration of the numerical convergence properties of ratios of power spectra for different models, which can be useful because some kinds of numerical error cancel in a ratio. When precision calculations based on numerical simulations are needed for many different models, efficiency may be gained by breaking the problem into a calculation of the absolute prediction at a central point, and calculations of the relative change in the prediction with model parameters.

We analyze the SDSS Ly-alpha forest P_F(k,z) measurement to determine the linear theory power spectrum. Our analysis is based on fully hydrodynamic simulations, extended using hydro-PM simulations. We account for the effect of absorbers with damping wings, which leads to an increase in the slope of the linear power spectrum. We break the degeneracy between the mean level of absorption and the linear power spectrum without significant use of external constraints. We infer linear theory power spectrum amplitude Delta^2_L(k_p=0.009s/km,z_p=3.0)=0.452_{-0.057-0.116}^{+0.069+0.141} and slope n_eff=-2.321_{-0.047-0.102}^{+0.055+0.131} (possible systematic errors are included through nuisance parameters in the fit - a factor >~5 smaller errors would be obtained on both parameters if we ignored modeling uncertainties). The errors are correlated and not perfectly Gaussian, so we provide a chi^2 table to accurately describe the results. The result corresponds to sigma_8=0.85, n=0.94, for a LCDM model with Omega_m=0.3, Omega_b=0.04, and h=0.7, but is most useful in a combined fit with the CMB. The inferred curvature of the linear power spectrum and the evolution of its amplitude and slope with redshift are consistent with expectations for LCDM models, with the evolution of the slope, in particular, being tightly constrained. We use this information to constrain systematic contamination, e.g., fluctuations in the UV background. This paper should serve as a starting point for more work to refine the analysis, including technical improvements such as increasing the size and number of the hydrodynamic simulations, and improvements in the treatment of the various forms of feedback from galaxies and quasars.

We combine the measurements of luminosity dependence of bias with the luminosity dependent weak lensing analysis of dark matter around galaxies to derive the galaxy bias and constrain nonlinear mass and cosmological parameters. We take advantage of theoretical and simulation predictions that predict that while halo bias is rapidly increasing with mass for high masses, it is nearly constant in low mass halos. We use a new weak lensing analysis around the same SDSS galaxies to determine their halo mass probability distribution. These halo mass probability distributions are used to predict the bias for each luminosity subsample and we find an excellent agreement with observed values. The required nonlinear mass suggests slightly lower matter density than usually assumed, Omegam=0.25+/- 0.03 for the simplest models. We combine the bias constraints with those from the WMAP and the SDSS power spectrum analysis to derive new constraints on bias and sigma_8. For the most general parameter space we find sigma_8=0.88+/- 0.06 and b_*=0.99+/- 0.07. In the context of spatially flat models we improve the limit on the neutrino mass for the case of 3 degenerate families from m_nu<0.6eV without bias to m_nu<0.18eV with bias (95% c.l.), which is weakened to m_nu<0.24eV if running is allowed. The corresponding limit for 3 massless + 1 massive neutrino is 1.37eV.

We explore several physical effects on the power spectrum of the Lyman-alpha forest transmitted flux. The effects we investigate here are usually not part of hydrodynamic simulations and so need to be estimated separately. The most important effect is that of high column density absorbers with damping wings, which add power on large scales. We compute their effect using the observational constraints on their abundance as a function of column density. Ignoring their effect leads to an underestimation of the slope of the linear theory power spectrum. The second effect we investigate is that of fluctuations in the ionizing radiation field. For this purpose we use a very large high resolution N-body simulation, which allows us to simulate both the fluctuations in the ionizing radiation and the small scale LyaF within the same simulation. We find an enhancement of power on large scales for quasars and a suppression for galaxies. The strength of the effect rapidly increases with increasing redshift, allowing it to be uniquely identified in cases where it is significant. We develop templates which can be used to search for this effect as a function of quasar lifetime, quasar luminosity function, and attenuation length. Finally, we explore the effects of galactic winds using hydrodynamic simulations. We find the wind effects on the LyaF power spectrum to be be degenerate with parameters related to the temperature of the gas that are already marginalized over in cosmological fits. While more work is needed to conclusively exclude all possible systematic errors, our results suggest that, in the context of data analysis procedures where parameters of the LyaF model are properly marginalized over, the flux power spectrum is a reliable tracer of cosmological information.

We combine the constraints from the recent Ly-alpha forest and bias analysis of the SDSS with previous constraints from SDSS galaxy clustering, the latest supernovae, and WMAP . Combining WMAP and the lya we find for the primordial slope n_s=0.98\pm 0.02. We see no evidence of running, dn/d\ln k=-0.003\pm 0.010, a factor of 3 improvement over previous constraints. We also find no evidence of tensors, r<0.36 (95% c.l.). A positive correlation between tensors and primordial slope disfavors chaotic inflation type models with steep slopes: V \propto \phi^4 is outside the 3-sigma contour. For the amplitude we find sigma_8=0.90\pm 0.03 from the lyaf and WMAP alone. We find no evidence of neutrino mass: for the case of 3 massive neutrino families with an inflationary prior, \sum m_{\nu}<0.42eV and the mass of lightest neutrino is m_1<0.13eV at 95% c.l. For the 3 massless + 1 massive neutrino case we find m_{\nu}<0.79eV for the massive neutrino, excluding at 95% c.l. all neutrino mass solutions compatible with the LSND results. We explore dark energy constraints in models with a fairly general time dependence of dark energy equation of state, finding Omega_lambda=0.72\pm 0.02, w(z=0.3)=-0.98^{+0.10}_{-0.12}, the latter changing to w(z=0.3)=-0.92^{+0.09}_{-0.10} if tensors are allowed. We find no evidence for variation of the equation of state with redshift, w(z=1)=-1.03^{+0.21}_{-0.28}. These results rely on the current understanding of the lyaf and other probes, which need to be explored further both observationally and theoretically, but extensive tests reveal no evidence of inconsistency among different data sets used here.

We measure the power spectrum, P_F(k,z), of the transmitted flux in the Ly-alpha forest using 3035 high redshift quasar spectra from the Sloan Digital Sky Survey. This sample is almost two orders of magnitude larger than any previously available data set, yielding statistical errors of ~0.6% and ~0.005 on, respectively, the overall amplitude and logarithmic slope of P_F(k,z). This unprecedented statistical power requires a correspondingly careful analysis of the data and of possible systematic contaminations in it. For this purpose we reanalyze the raw spectra to make use of information not preserved by the standard pipeline. We investigate the details of the noise in the data, resolution of the spectrograph, sky subtraction, quasar continuum, and metal absorption. We find that background sources such as metals contribute significantly to the total power and have to be subtracted properly. We also find clear evidence for SiIII correlations with the Ly-alpha forest and suggest a simple model to account for this contribution to the power. While it is likely that our newly developed analysis technique does not eliminate all systematic errors in the P_F(k,z) measurement below the level of the statistical errors, our tests indicate that any residual systematics in the analysis are unlikely to affect the inference of cosmological parameters from P_F(k,z). These results should provide an essential ingredient for all future attempts to constrain modeling of structure formation, cosmological parameters, and theories for the origin of primordial fluctuations.

The transverse proximity effect is the expected decrease in the strength of the Lya forest absorption in a QSO spectrum when another QSO lying close to the line of sight enhances the photoionization rate above that due to the average cosmic ionizing background. We select three QSOs from the Early Data Release of the Sloan Digital Sky Survey that have nearby foreground QSOs, with proper line of sight tangential separations of 0.50, 0.82, and 1.10 h^{-1} Mpc. We estimate that the ionizing flux from the foreground QSO should increase the photoionization rate by a factor (94, 13, 13) in these three cases, which would be clearly detectable in the first QSO and marginally so in the other two. We do not detect the transverse proximity effect. Three possible explanations are provided: an increase of the gas density in the vicinity of QSOs, time variability, and anisotropy of the QSO emission. We find that the increase of gas density near QSOs can be important if they are located in the most massive halos present at high redshift, but is not enough to fully explain the absence of the transverse proximity effect. Anisotropy requires an unrealistically small opening angle of the QSO emission. Variability demands that the luminosity of the QSO with the largest predicted effect was much lower 10^6 years ago, whereas the transverse proximity effect observed in the HeII Lya absorption in QSO 0302-003 by Jakobsen et al. (2003) implies a lifetime longer than 10^7 years. A combination of all three effects may better explain the lack of Lya absorption reduction. A larger sample of QSO pairs may be used to diagnose the environment, anisotropy and lifetime distribution of QSOs.

We use statistical inference theory to explore the constraints from future galaxy weak lensing (cosmic shear) surveys combined with the current CMB constraints on cosmological parameters, focusing particularly on the running of the spectral index of the primordial scalar power spectrum, $\alpha_s$. Recent papers have drawn attention to the possibility of measuring $\alpha_s$ by combining the CMB with galaxy clustering and/or the Lyman-$\alpha$ forest. Weak lensing combined with the CMB provides an alternative probe of the primordial power spectrum. We run a series of simulations with variable runnings and compare them to semi-analytic non-linear mappings to test their validity for our calculations. We find that a ``Reference'' cosmic shear survey with $f_{sky}=0.01$ and $6.6\times 10^8$ galaxies per steradian can reduce the uncertainty on $n_s$ and $\alpha_s$ by roughly a factor of 2 relative to the CMB alone. We investigate the effect of shear calibration biases on lensing by including the calibration factor as a parameter, and show that for our Reference Survey, the precision of cosmological parameter determination is only slightly degraded even if the amplitude calibration is uncertain by as much as 5%. We conclude that in the near future weak lensing surveys can supplement the CMB observations to constrain the primordial power spectrum.

We investigate the promise of the Ly-alpha forest for high precision cosmology in the era of the Sloan Digital Sky Survey using low order N-point statistics. We show that with the existing data one can determine the amplitude, slope and curvature of the slope of the matter power spectrum with a few percent precision. Higher order statistics such as the bispectrum provide independent information that can confirm and improve upon the statistical precision from the power spectrum alone. The achievable precision is comparable to that from the cosmic microwave background with upcoming satellites, and complements it by measuring the power spectrum amplitude and shape at smaller scales. Since the data cover the redshift range 2<z<4, one can also extract the evolution of the growth factor and Hubble parameter over this range, and provide useful constraints on the presence of dark energy at z>2.

The WMAP team has recently highlighted the usefulness of combining the Ly-alpha forest constraints with those from the cosmic microwave background (CMB). This combination is particularly powerful as a probe of the primordial shape of the power spectrum. Converting between the Ly-alpha forest observations and the linear mass power spectrum requires a careful treatment of nuisance parameters and modeling with cosmological simulations. We point out several issues which lead to an expansion of the errors, the two most important being the range of cosmological parameters explored in simulations and the treatment of the mean transmitted flux constraints. We employ a likelihood calculator for the current Ly-alpha data set based on an extensive 6-dimensional grid of simulations. We show that the current uncertainties in the mean transmission and the flux power spectrum define a degeneracy line in the amplitude-slope plane. The CMB degeneracy due to the primordial power spectrum shape follows a similar relation in this plane. This weakens the statistical significance of the primordial power spectrum shape constraints based on combined CMB+Ly-alpha forest analysis. Using the current data the simplest n=1 scale invariant model with dn/dln k=0 and no tensors has a Delta chi^2=4 compared to the best fitting model in which these 3 parameters are free. Current data therefore do not require relaxing these parameters to improve the fit.

We consider the possibility that massive primordial black holes are the dominant form of dark matter. Black hole formation generates entropy fluctuations that adds a Poisson noise to the matter power spectrum. We use Lyman-alpha forest observations to constrain this Poisson term in matter power spectrum, then we constrain the mass of black holes to be less than few times 10^4 solar mass. We also find that structures with less than ~ 10^3 primordial black holes evaporate by now.

Statistical properties of gas absorption in high redshift quasars such as power spectrum and bispectrum allow one to determine the evolution of structure over the redshift range 2<z<4. Sloan Digital Sky Survey (SDSS) will measure around 10,000 quasar spectra in this redshift range and will allow one to determine the growth factor with a few percent accuracy. This allows one to extend the studies of dark energy to higher redshift and determine the presence of dark energy if Omega_de>0.1-0.2 at z>2. In combination with low redshift studies one can place useful limits on the time evolution of the equation of state.

We present predictions of the correlation between the Lyman-alpha forest absorption in quasar spectra and the mass within \sim 5 Mpc/h (comoving) of the line of sight, using fully hydrodynamic and hydro-PM numerical simulations of the cold dark matter model supported by present observations. The observed correlation based on galaxies and the Lya forest can be directly compared to our theoretical results, assuming that galaxies are linearly biased on large scales. Specifically, we predict the average value of the mass fluctuation, <delta_m>, conditioned to a fixed value of the Lya forest transmitted flux delta_F, after they have been smoothed over a 10 Mpc/h cube and line of sight interval, respectively. We find that <delta_m>/sigma_m as a function of delta_F/sigma_F has a slope of 0.6 at this smoothing scale, where sigma_m and sigma_F are the rms dispersions (this slope should decrease with the smoothing scale). We show that this value is largely insensitive to the cosmological model and other Lya forest parameters. Comparison of our predictions to observations should provide a fundamental test of our ideas on the nature of the Lya forest and the distribution of galaxies, and can yield a measurement of the bias factor of any type of galaxies that are observed in the vicinity of Lya forest lines of sight.

The temporal evolution of the ionizing UV background radiation field at high redshift provides a probe of the evolution of the early star formation rate. By comparing the observed levels of absorption in the highest redshift quasar spectra to the predictions of a hydrodynamic simulation, we determine the evolution of the photoionization rate Gamma for neutral hydrogen in the intergalactic medium, over the redshift range 4.9 < z < 6.1. After accounting for sampling variance, we infer a sharp increase in Gamma from z~6.1 to z~5.8, probably implying reionization at this redshift. We find a decrease in Gamma from z~5.6 to 5.2, at 3sigma significance. This feature is a generic signature in the aftermath of reionization, entirely consistent with the cosmological reionization process being completed at z~6.1. This generic feature is a result of a significant change in the star formation rate subsequent to the cosmological reionization. There is an abrupt rise of the temperature of the intergalactic medium due to photo-heating, when it is reionized. This translates to a correspondingly sudden jump in the Jeans mass and a dramatic suppression of gas accretion onto the most abundant (sub-galactic) halos at the epochs of interest. The star formation rate suffers a temporary setback in the aftermath of reionization, resulting in a temporary decrease in the amplitude of the ionizing radiation field.

The correlation between Lyman-alpha absorption in the spectra of quasar pairs can be used to measure the transverse distance scale at z~2, which is sensitive to the cosmological constant (Omega_Lambda) or other forms of vacuum energy. Using Hydro-PM simulations, I compute the three-dimensional power spectrum of the Lyman-alpha forest flux, P_F(k,mu), from which the redshift-space anisotropy of the correlation can be obtained. I find that box size ~40 Mpc/h and resolution ~40 Kpc/h are necessary for convergence of the calculations to <5% on all relevant scales, although somewhat poorer resolution can be used for large scales. I compute directly the linear theory bias parameters of the Lyman-alpha forest, potentially allowing simulation results to be extended to arbitrarily large scales. I investigate the dependence of P_F(k,mu) on the primordial power spectrum, the temperature-density relation of the gas, and the mean flux decrement, finding that the redshift-space anisotropy is relatively insensitive to these parameters. A table of results is provided for different parameter variations. I investigate the constraint that can be obtained on Omega_Lambda using quasars from a large survey. Assuming 13 (theta/1')^2 pairs at separation <theta, and including separations <10', a measurement to <5% can be made if simulations can predict the redshift-space anisotropy with <5% accuracy, or to <10% if the anisotropy must be measured from the data. The Sloan Digital Sky Survey (SDSS) will obtain spectra for a factor ~5 fewer pairs than this, so followup observations of fainter pair candidates will be necessary. I discuss the requirements on spectral resolution and signal-to-noise ratio (SDSS-quality spectra are sufficient).

Energy injected into the Cosmic Microwave Background at redshifts z<10^6 will distort its spectrum permanently. In this paper we discuss the distortion caused by annihilations of relic particles. We use the observational bounds on deviations from a Planck spectrum to constrain a combination of annihilation cross section, mass, and abundance. For particles with (s-wave) annihilation cross section, <\sigma|v|>=\sigma_0, the bound is f[(\sigma_0/6e-27cm^3/s)(\Omega_{X\bar{X}}h^2)^2]/(m_X/MeV)<0.2, where m_X is the particle mass, \Omega_{X\bar{X}} is the fraction of the critical density the particle and its antiparticle contribute if they survive to the present time, h=H_0/(100km/s/Mpc), H_0 is the Hubble constant, and f is the fraction of the annihilation energy that interacts electromagnetically. We also compute the less stringent limits for p-wave annihilation. We update other bounds on residual annihilations and compare them to our CMB bound.

We use the redshift evolution of the lyman-alpha forest mean transmitted flux at z>2.5 to infer the evolution of the intensity of the ionizing background, using theoretical predictions for the density distribution of the intergalactic gas giving rise to the lyman-alpha forest. The proper background intensity declines gradually with redshift, decreasing by a factor \sim 3 between z=3 and z=5. The gravitational structure formation theory of the lyman-alpha forest implies that, given the observed mean transmitted flux of \bar{F}=0.1 in the highest redshift quasar (with a mean lyman-alpha forest redshift z=5.2), only about 3% of the lyman-alpha spectrum should have a flux higher than 50% of the continuum, and less than 0.5% of pixels should have flux above 75% of the continuum, assuming a uniform ionizing background intensity. We show that this is consistent with the spectrum shown in Fan et al.

The evolution of the temperature in the intergalactic medium is related to the reionization of hydrogen and helium, and has important consequences for our understanding of the Lya forest and of galaxy formation in gravitational models of large-scale structure. We measure the temperature-density relation of intergalactic gas from Lya forest observations of eight quasar spectra with high resolution and signal-to-noise ratio, using a new line fitting technique to obtain a lower cutoff of the distribution of line widths from which the temperature is derived. We carefully test the accuracy of this technique to recover the gas temperature with a hydrodynamic simulation. The temperature at redshift z=(3.9, 3.0, 2.4) is best determined at densities slightly above the mean: T_star=(20200\pm2700, 20200\pm1300, 22600\pm1900)K (statistical error bars) for gas density (in units of the mean density) Delta_star=(1.42\pm0.08, 1.37\pm0.11, 1.66\pm0.11). The power-law index of the temperature-density relation, defined by T=T_star(Delta/Delta_star)^{gamma-1}, is gamma-1= (0.43\pm0.45, 0.29\pm0.30, 0.52\pm0.14) for the same three redshifts. The temperature at the fixed over-density Delta=1.4 is T_1.4=(20100\pm2800, 20300\pm1400, 20700\pm1900)K. These temperatures are higher than expected for photoionized gas in ionization equilibrium with a cosmic background, and can be explained by a gradual additional heating due to on-going HeII reionization. The measurement of the temperature reduces one source of uncertainty in the lower limit to the baryon density implied by the observed mean flux decrement. We find that the temperature cannot be reliably measured for under-dense gas, because the velocities due to expansion always dominate the widths of the corresponding weak lines.

A sample of eight quasars observed at high resolution and signal-to-noise is used to determine the probability distribution function (PDF), the power spectrum, and the correlation function of the transmitted flux in the \lya forest, in three redshift bins centered at z=2.41, 3.00, and 3.89. All the results are presented in tabular form, with full error covariance matrices to allow for comparisons with any numerical simulations and with other data sets. The observations are compared with a numerical simulation of the \lya forest of a Lambda-CDM model with Omega=0.4, known to agree with other large-scale structure observational constraints. There is excellent agreement for the PDF, if the mean transmitted flux is adjusted to match the observations. A small difference between the observed and predicted PDF is found at high fluxes and low redshift, which may be due to the uncertain effects of fitting the spectral continuum. Using the numerical simulation, we show how the flux power spectrum can be used to recover the initial power spectrum of density fluctuations. From our sample of eight quasars, we measure the amplitude of the mass power spectrum to correspond to a linear variance per unit ln(k) of $\Delta^2_\rho(k)=0.72\pm0.09$ at k=0.04(km/s)^{-1} and z=3, and the slope of the power spectrum near the same k to be $n_p=-2.55\pm0.10$ (statistical error bars). The results are statistically consistent with Croft et. al. (1999), although our value for the rms fluctuation is lower by a factor 0.75. For the Lambda-CDM model we use, the implied primordial slope is $n=0.93\pm0.10$, and the normalization is $\sigma_8=0.68+1.16(0.95-n)\pm0.04$.

A model of damped lyman alpha systems is presented based on randomly moving clouds in spherical halos. We use the Press-Schechter model for the abundance of halos, and assume that each halo has a similar population of clouds, with total mass and spatial distribution constrained to fit observations of the column density distribution. We show that the kinematics of the multiple absorbing components revealed in absorption profiles of the low-ionization lines, presented by Prochaska & Wolfe, are consistent with our spherical halo model. The presence of multiple absorbing components with a large covering factor, combined with the small impact parameters of the systems predicted in our analytical model and in numerical simulations, implies a high rate of energy dissipation in cloud collisions. We calculate the rate of energy dissipation in our model, and show that it is far greater than the rate at which energy can be supplied by gravitational mergers of halos. This poses a problem for the model of merging protogalactic clumps of Haehnelt et al., based on numerical simulations. We also present new constraints on the amplitude of the power spectrum in hierarchical theories required to account for the observed velocity dispersion in the absorbers. We find that the linearly extrapolated rms fluctuation on spheres of radius HR = 100 km/s at z=4 must be greater than 0.75. Although this limit is obtained only for our specific model of the absorbing components, it should not be highly model-dependent because the velocity dispersion of the absorbers is essentially determined by the velocity dispersion of the halos where the gas is moving.

We discuss the feasibility of measuring the cosmological metric using the redshift space correlation function of the Lya forest in multiple lines of sight, as a function of angular and velocity separation. The geometric parameter that is measured is f(z) = H(z) D(z)/c, where H(z) is the Hubble constant and D(z) the angular diameter distance at redshift z. The correlation function is computed in linear theory. We describe a method to measure it from observations with the Gaussianization procedure of Croft et al (1998) to map the Lya forest transmitted flux to an approximation of the linear density field. The effect of peculiar velocities on the shape of the recovered power spectrum is pointed out. We estimate the error in recovering the f(z) factor from observations due to the variance in the Lya absorbers. We show that ~ 20 pairs of quasars (separations < 3') are needed to distinguish a flat \Omega_0=1 universe from a universe with \Omega_0=0.2, \Omega_\Lambda=0.8. A second parameter that is obtained from the correlation function of the Lya forest is \beta \simeq \Omega(z)^{0.6}/b (affecting the magnitude of the peculiar velocities), where b is a linear theory bias of the Lya forest. The statistical error of f(z) is reduced if b can be determined independently from numerical simulations, reducing the number of quasar pairs needed for constraining cosmology to approximately six. On small scales, where the correlation function is higher, f(z) should be measurable with fewer quasars, but non-linear effects must then be taken into account. The anisotropy of the non-linear redshift space correlation function as a function of scale should also provide a precise quantitative test of the gravitational instability theory of the Lya forest.