Allowing for enhanced Ly$\alpha$ photon line emission from Population III dominated stellar systems in the first forming galaxies, we show the 21-cm cosmic dawn signal at $10<z<30$ may substantially differ from standard scenarios. Energy transfer by Ly$\alpha$ photons emerging from galaxies may heat intergalactic gas if HII regions within galaxies are recombination bound, or cool the gas faster than by adiabatic expansion if reddened by winds internal to the haloes. In some cases, differential 21-cm antenna temperatures near $-500$ mK may be achieved at $15<z<25$, similar to the signature detected by the EDGES 21-cm cosmic dawn experiment.

We interpret observations of intergalactic low ionisation metal absorption systems at redshifts z $\gtrsim$5 in terms of pressure-confined clouds. We find clouds confined by the expected pressure of galactic haloes with masses $11<\log M_h/h^{-1}M_\odot<12$ provide a good description of the column density ratios between low ionisation metal absorbers. Some of the ratios, however, require extending conventional radiative transfer models of irradiated slabs to spherical (or cylindrical) clouds to allow for lines of sight passing outside the cores of the clouds. Moderate depletion of silicon onto dust grains is also indicated in some systems. The chemical abundances inferred span the range between solar and massive-star dominated stellar populations as may arise in starburst galaxies. The typical HI column densities matching the data correspond to Damped Lyman-$\alpha$ Absorbers (DLAs) or sub-DLAs, with sizes of 40 pc to 3 kpc, gas masses $3.5<\log M_c/M_\odot<8$ and metallicites $0.001-0.01Z_\odot$. Such systems continue to pose a challenge for galaxy-scale numerical simulations to reproduce.

The leading contenders for the seeds of the first quasars are direct collapse black holes (DCBHs) formed during catastrophic baryon collapse in atomically-cooled halos at $z \sim$ 20. The discovery of the Ly$\alpha$ emitter CR7 at $z =$ 6.6 was initially held to be the first detection of a DCBH, although this interpretation has since been challenged on the grounds of Spitzer IRAC and Very Large Telescope X-Shooter data. Here we determine if radio flux from a DCBH in CR7 could be detected and discriminated from competing sources of radio emission in the halo such as young supernovae and H II regions. We find that a DCBH would emit a flux of 10 - 200 nJy at 1.0 GHz, far greater than the sub-nJy signal expected for young supernovae but on par with continuum emission from star-forming regions. However, radio emission from a DCBH in CR7 could be distinguished from free-free emission from H II regions by its spectral evolution with frequency and could be detected by the Square Kilometer Array in the coming decade.

Under the assumption that galaxies and Quasi-Stellar Objects (QSOs) dominate the metagalactic ultra-violet (UV) background, it is shown that at high redshifts fluctuations in the UV background are dominated by QSO shot noise and have an auto-correlation length of a few to several comoving Mpcs, depending on the bright end of the QSO luminosity function. The correlations create long range spatial coherence in the neutral hydrogen fraction. Using a semi-analytic model, it is demonstrated that the coherence may account for the broad distribution in effective optical depths measured in the Ly$\alpha$ forest spectra of background QSOs, for line-of-sight segments of comoving length $50h^{-1}$ Mpc at redshifts $5<z<6$. Capturing the fluctuations in a numerical simulation requires a comoving box size of $\sim1h^{-1}$ Gpc, although a box half this size may be adequate if sufficient random realizations of the QSO population are performed.

Spatial fluctuations in ultraviolet backgrounds can subtly modulate the distribution of extragalactic sources, a potential signal and systematic for large-scale structure surveys. While this modulation has been shown to be significant for 3D Ly alpha forest surveys, its relevance for other large-scale structure probes has been hardly explored, despite being the only astrophysical process that likely can affect clustering measurements on the scales of >~Mpc. We estimate that the background fluctuations, modulating the amount of H I, have a fractional effect of (0.03-0.3) x (k/[10^-2 Mpc^-1])^-1 on the power spectrum of 21 cm intensity maps at z = 1-3. We find a smaller effect for H alpha and Ly alpha intensity mapping surveys of (0.001-0.1) x (k/[10^-2 Mpc^-1])-1 and even smaller effect for more traditional surveys that correlate the positions of individual H alpha or Ly alpha emitters. We also estimate the effect of backgrounds on low-redshift galaxy surveys in general based on a simple model in which background fluctuations modulate the rate halo gas cools, modulating star formation: We estimate a maximum fractional effect on the power of ~0.01 (k/[10-2 Mpc-1])-1 at z = 1. We compare sizes of these imprints to cosmological parameter benchmarks for the next generation of redshift surveys: We find that ionizing backgrounds could result in a bias on the squeezed triangle non-Gaussianity parameter fNL that can be larger than unity for power spectrum measurements with a SPHEREx-like galaxy survey, and typical values of intensity bias. Marginalizing over a shape of the form k-1PL, where PL is the linear matter power spectrum, removes much of this bias at the cost of ~ 40% larger statistical errors.

Increasing evidence suggests that He II proximity profiles in the quasar spectra at z ~ 3 - 4 are sensitive probes of quasar ages. But the development of their H I counterparts is difficult to trace and remains poorly constrained. We compare the UV spectra of 15 He II quasars with their high-resolution optical counterparts and find a significant correlation between the sizes of He II and H I proximity zones. The luminous quasar HE2347-4342 displays a null proximity zone in both He II and H I, suggesting that it is extremely young (age < 0.2 Myr). Three other quasars also display small proximity zones for He II and H I. There is no evidence that a H I ionization zone expands considerably faster than its He II counterpart. The results suggest that the expansion of quasar ionizing fronts may be noticeably slower than the speed of light, and raise the possibility of distinguishing young and old quasars from the sizes of their H I proximity zones.

We present a formalism for computing time-dependent fluctuations in the cosmological photoionizing radiation background, extending background fluctuations models beyond the steady-state approximation. We apply this formalism to estimate fluctuations in the HI LyA flux redshift space power spectrum and its spatial correlation function at redshifts 2<z<4, assuming the photoionization background is dominated by Quasi-stellar Objects (QSOs) and/or galaxies. We show the shot noise in the power spectrum due to discrete sources is strongly suppressed relative to the steady-state value at low wavenumbers by a factor proportional to the lifetime of the sources, and that this suppression may be used to constrain QSO lifetimes. The total HI LyA power spectrum including shot noise is affected at tens of percent on short scales, and by as much as an order of magnitude or more on scales exceeding the mean free path. The spatial correlation function is similarly found to be sensitive to the shot noise, although moderately insensitive to the effects of time-dependence on the non-shotnoise contribution. Photoionization rate fluctuations substantially modify the shape of the Baryonic Acoustic Oscillation peak in the correlation function, including a small increase in its position that must be accounted for to avoid biasing estimates of cosmological parameters based on the peak position. We briefly investigate solving the full frequency dependent equation, finding that it agrees with the frequency-independent to better than percent accuracy. Simple formulas are provided for the power spectrum of fluctuations in the photoionization rate that approximate the full computations.

The diffuse soft X-ray emissivity from galactic winds is computed during the Epoch of Reionization (EoR). We consider two analytic models, a pressure-driven wind and a superbubble model, and a 3D cosmological simulation including gas dynamics from the First Billion Years (FiBY) project. The analytic models are normalized to match the diffuse X-ray emissivity of star-forming galaxies in the nearby Universe. The cosmological simulation uses physically motivated star formation and wind prescriptions, and includes radiative transfer corrections. The models and the simulation all are found to produce sufficient heating of the Intergalactic Medium to be detectable by current and planned radio facilities through 21 cm measurements during the EoR. While the analytic models predict a 21 cm emission signal relative to the Cosmic Microwave Background sets in by $z_{\rm trans} \simeq 8 - 10$, the predicted signal in the FiBY simulation remains in absorption until reionization completes. The 21 cm absorption differential brightness temperature reaches a minimum of $\Delta T \simeq -130$ to $-200$ mK, depending on model. Allowing for additional heat from high mass X-ray binaries pushes the transition to emission to $z_{\rm trans} \simeq 10 - 12$, with shallower absorption signatures having a minimum of $\Delta T \simeq -110$ to $-140$ mK. The 21 cm signal may be a means of distinguishing between the wind models, with the superbubble model favouring earlier reheating. While an early transition to emission may indicate X-ray binaries dominate the reheating, a transition to emission as early as $z_{\rm trans} > 12$ would suggest the presence of additional heat sources.

Modern theories of galaxy formation predict that galaxies impact on their gaseous surroundings, playing the fundamental role of regulating the amount of gas converted into stars. While star-forming galaxies are believed to provide feedback through galactic winds, Quasi-Stellar Objects (QSOs) are believed instead to provide feedback through the heat generated by accretion onto a central supermassive black hole. A quantitative difference in the impact of feedback on the gaseous environments of star-forming galaxies and QSOs has not been established through direct observations. Using the Sherwood cosmological simulations, we demonstrate that measurements of neutral hydrogen in the vicinity of star-forming galaxies and QSOs during the era of peak galaxy formation show excess LyA absorption extending up to comoving radii of about 150 kpc for star-forming galaxies and 300 - 700 kpc for QSOs. Simulations including supernovae-driven winds with the wind velocity scaling like the escape velocity of the halo account for the absorption around star-forming galaxies but not QSOs.

We introduce a new set of large scale, high resolution hydrodynamical simulations of the intergalactic medium: the Sherwood simulation suite. These are performed in volumes 10^3-160^3 h^-3 comoving Mpc^{3}, span almost four orders of magnitude in mass resolution with up to 17.2 billion particles, and employ a variety of physics variations including warm dark matter and galactic outflows. We undertake a detailed comparison of the simulations to high resolution, high signal-to-noise observations of the Lyman-alpha forest over the redshift range 2 < z < 5. The simulations are in very good agreement with the observational data, lending further support to the paradigm that the Lyman-alpha forest is a natural consequence of the web-like distribution of matter arising in LCDM cosmological models. Only a small number of minor discrepancies remain with respect to the observational data. Saturated Lyman-alpha absorption lines with column densities N_HI > 10^14.5 cm^-2 at 2 < z < 2.5 are underpredicted in the models. An uncertain correction for continuum placement bias is required to match the distribution and power spectrum of the transmitted flux, particularly at z > 4. Finally, the temperature of intergalactic gas in the simulations may be slightly too low at z=2.7 and a flatter temperature-density relation is required at z=2.4, consistent with the expected effects of non-equilibrium ionisation during He-II reionisation.

We present a detailed analysis of the ionization and thermal structure of the intergalactic medium (IGM) around a high-redshift QSO using a large suite of cosmological, multi-frequency radiative transfer (RT) simulations, exploring the contribution from galaxies as well as the QSO, and the effect of X-rays and secondary ionization. We show that in high-z QSO environments both the central QSO and the surrounding galaxies concertedly control the reionization morphology of hydrogen and helium and have a non-linear impact on the thermal structure of the IGM. A QSO imprints a distinctive morphology on H II regions if its total ionizing photon budget exceeds that of the surrounding galaxies since the onset of hydrogen reionization; otherwise, the morphology shows little difference from that of H II regions produced only by galaxies. In addition, the spectral shape of the collective radiation field from galaxies and QSOs controls the thickness of the I-fronts. While a UV-obscured QSO can broaden the I-front, the contribution from other UV sources, either galaxies or unobscured QSO, is sufficient to maintain a sharp I-front. X-rays photons from the QSO are responsible for a prominent extended tail of partial ionization ahead of the I-front. QSOs leave a unique imprint on the morphology of He II / He III regions. We suggest that, while the physical state of the IGM is modified by QSOs, the most direct test to understand the role of galaxies and QSOs during reionization is to perform galaxy surveys in a region of sky imaged by 21 cm tomography.

Observational implications are derived for two standard models of supernovae-driven galactic winds: a freely expanding steady-state wind and a wind sourced by a self-similarly expanding superbubble including thermal heat conduction. It is shown that, for the steady-state wind, matching the measured correlation between the soft x-ray luminosity and star formation rate of starburst galaxies is equivalent to producing a scaled wind mass-loading factor relative to the star-formation rate of 0.5 - 3, in agreement with the amount inferred from metal absorption line measurements. The match requires the asymptotic wind velocity v_inf to scale with the star formation rate SFR (in solar masses per year) approximately as v_inf ~ (700 - 1000) km/s SFR^{1/6}. The corresponding mass injection rate is close to the amount naturally provided by thermal evaporation from the wall of a superbubble in a galactic disc, suggesting thermal evaporation may be a major source of mass-loading. The predicted mass-loading factors from thermal evaporation within the galactic disc alone, however, are somewhat smaller, 0.2 - 2, so that a further contribution from cloud ablation or evaporation may be required. Both models may account for the 1.4GHz luminosity of unresolved radio sources within starburst galaxies for plausible parameters describing the distribution of relativistic electrons. Further observational tests to distinguish the models are suggested.

We study the statistics of the Lyman-$\alpha$ forest in a flat LCDM cosmology with the N-body + Eulerian hydrodynamics code Nyx. We produce a suite of simulations, covering the observationally relevant redshift range $2 \leq z \leq 4$. We find that a grid resolution of 20 kpc/h is required to produce one percent convergence of Lyman-$\alpha$ flux statistics, up to k = 10 h/Mpc. In addition to establishing resolution requirements, we study the effects of missing modes in these simulations, and find that box sizes of L > 40 Mpc/h are needed to suppress numerical errors to a sub-percent level. Our optically-thin simulations with the ionizing background prescription of Haardt & Madau (2012) reproduce an IGM equation of state with $T_0 \approx 10^4 K$ and $\gamma \approx 1.55$ at z=2, with a mean transmitted flux close to the observed values. When using the ionizing background prescription of Faucher-Giguere et al. (2009), the mean flux is 10-15 per cent below observed values at z=2, and a factor of 2 too small at z = 4. We show the effects of the common practice of rescaling optical depths to the observed mean flux and how it affects convergence rates. We also investigate the common practice of `splicing' results from a number of different simulations to estimate the 1D flux power spectrum and show it is accurate at the 10 percent level. Finally, we find that collisional heating of the gas from dark matter particles is negligible in modern cosmological simulations.

We present the largest homogeneous survey of $z>4.4$ damped Lyman-$\alpha$ systems (DLAs) using the spectra of 163 QSOs that comprise the Giant Gemini GMOS (GGG) survey. With this survey we make the most precise high-redshift measurement of the cosmological mass density of neutral hydrogen, $\Omega_{\rm HI}$. At such high redshift important systematic uncertainties in the identification of DLAs are produced by strong intergalactic medium absorption and QSO continuum placement. These can cause spurious DLA detections, result in real DLAs being missed, or bias the inferred DLA column density distribution. We correct for these effects using a combination of mock and higher-resolution spectra, and show that for the GGG DLA sample the uncertainties introduced are smaller than the statistical errors on $\Omega_{\rm HI}$. We find $\Omega_{\rm HI}=0.98^{+0.20}_{-0.18}\times10^{-3}$ at $\langle z\rangle=4.9$, assuming a 20% contribution from lower column density systems below the DLA threshold. By comparing to literature measurements at lower redshifts, we show that $\Omega_{\rm HI}$ can be described by the functional form $\Omega_{\rm HI}(z)\propto(1+z)^{0.4}$. This gradual decrease from $z=5$ to $0$ is consistent with the bulk of HI gas being a transitory phase fuelling star formation, which is continually replenished by more highly-ionized gas from the intergalactic medium, and from recycled galactic winds.

We compare predictions of large-scale cosmological hydrodynamical simulations for neutral hydrogen absorption signatures in the vicinity of 1e11 - 1e12.5 MSun haloes with observational measurements. Two different hydrodynamical techniques and a variety of prescriptions for gas removal in high density regions are examined. Star formation and wind feedback play only secondary roles in the HI absorption signatures outside the virial radius, but play important roles within. Accordingly, we identify three distinct gaseous regions around a halo: the virialized region, the mesogalactic medium outside the virial radius arising from the extended haloes of galaxies out to about two turnaround radii, and the intergalactic medium beyond. Predictions for the amount of absorption from the mesogalactic and intergalactic media are robust across different methodologies, and the predictions agree with the amount of absorption observed around star-forming galaxies and QSO host galaxies. Recovering the measured amount of absorption within the virialized region, however, requires either a higher dynamic range in the simulations, additional physics, or both.

The proximity profile in the spectra of z~3 quasars, where fluxes extend blueward of the He II Lya wavelength 304 (1+z) A, is one of the most important spectral features in the study of the intergalactic medium. Based on the HST spectra of 24 He II quasars, we find that the majority of them display a proximity profile, corresponding to an ionization radius as large as 20 Mpc in the source's rest frame. In comparison with those in the H i spectra of the quasars at z~6, the He II proximity effect is more prominent and is observed over a considerably longer period of reionization. The He II proximity zone sizes decrease at higher redshifts, particularly at z > 3.3. This trend is similar to that for H I, signaling an onset of He II reionization at z~4. For quasar SDSS1253+6817 (z=3.48), the He II absorption trough displays a gradual decline and serves a good case for modeling the He II reionization. To model such a broad profile requires a quasar radiation field whose distribution between 4 and 1 Rydberg is considerably harder than normally assumed. The UV continuum of this quasar is indeed exceptionally steep, and the He II ionization level in the quasar vicinity is higher than the average level in the intergalactic medium. These results are evidence that a very hard EUV continuum from this quasar produces a large ionized zone around it. Distinct exceptions are the two brightest He II quasars at z~2.8, for which no significant proximity profile is present, possibly implying that they are young.

We perform cosmological simulations of the intergalactic medium (IGM) at redshift z ~ 3 using the numerical gravity-hydrodynamics codes GADGET-3 and Enzo for the purpose of modelling the gaseous environments of galaxies. We identify haloes in the simulations using three different algorithms. Different rank orderings of the haloes by mass result, introducing a limiting factor in identifying haloes with observed galaxies. We also compare the physical properties of the gas between the two codes, focussing primarily on the gas outside the virial radius, motivated by recent HI absorption measurements of the gas around z ~ 2 - 3 galaxies. The internal dispersion velocities of the gas in the haloes have converged for a box size of 30 comoving Mpc, but the centre-of-mass peculiar velocities of the haloes have not up to a box size of 60 comoving Mpc. The density and temperature of the gas within the instantaneous turn-around radii of the haloes are adequately captured for box sizes 30 Mpc on a side, but the results are highly sensitive to the treatment of unresolved, rapidly cooling gas, with the gas mass fraction within the virial radius severely depleted by star formation in the GADGET-3 simulations. Convergence of the gas peculiar velocity field on large scales requires a box size of at least 60 Mpc. Outside the turn-around radius, the physical state of the gas agrees to 30 percent or better both with box size and between simulation methods. We conclude that generic IGM simulations make accurate predictions for the intergalactic gas properties beyond the halo turn-around radii, but the gas properties on smaller scales are highly dependent on star formation and feedback implementations.

We have obtained spectra of 163 quasars at $z_\mathrm{em}>4.4$ with the Gemini Multi Object Spectrometers on the Gemini North and South telescopes, the largest publicly available sample of high-quality, low-resolution spectra at these redshifts. From this homogeneous data set, we generated stacked quasar spectra in three redshift intervals at $z\sim 5$. We have modelled the flux below the rest-frame Lyman limit ($\lambda_\mathrm{r}<912$\AA) to assess the mean free path $\lambda_\mathrm{mfp}^{912}$ of the intergalactic medium to HI-ionizing radiation. At mean redshifts $z_\mathrm{q}=4.56$, 4.86 and 5.16, we measure $\lambda_\mathrm{mfp}^{912}=(22.2\pm 2.3, 15.1\pm 1.8, 10.3\pm 1.6)h_{70}^{-1}$ proper Mpc with uncertainties dominated by sample variance. Combining our results with $\lambda_\mathrm{mfp}^{912}$ measurements from lower redshifts, the data are well modelled by a simple power-law $\lambda_\mathrm{mfp}^{912}=A[(1+z)/5]^\eta$ with $A=(37\pm 2)h_{70}^{-1}$ Mpc and $\eta = -5.4\pm 0.4$ between $z=2.3$ and $z=5.5$. This rapid evolution requires a physical mechanism -- beyond cosmological expansion -- which reduces the cosmic effective Lyman limit opacity. We speculate that the majority of HI Lyman limit opacity manifests in gas outside galactic dark matter haloes, tracing large-scale structures (e.g. filaments) whose average density (and consequently neutral fraction) decreases with cosmic time. Our measurements of the strongly redshift-dependent mean free path shortly after the completion of HI reionization serve as a valuable boundary condition for numerical models thereof. Having measured $\lambda_\mathrm{mfp}^{912}\approx 10$ Mpc at $z=5.2$, we confirm that the intergalactic medium is highly ionized by that epoch and that the redshift evolution of the mean free path does not show a break that would indicate a recent end to HI reionization.

The sources which reionized the Intergalactic Medium by redshift ~6 are still unknown. A severe constraint on the ionization process is the low emissivity required to maintain the ionization in the Lyman-{\alpha} forest. Simulation-calibrated observations suggest a production rate of at most only a few photons per baryon. In this work, we present a new solution to this "photon-starvation" problem using a weak background of cosmic magnetic fields, which may be present as a consequence of early-Universe physics and subsequent magneto-hydrodynamical amplification. If present, such magnetic fields can induce density perturbations which are dominant on scales comparable to those probed by measurements of hydrogen-absorption lines at redshifts z~2-5. We show that a sub-nanoGauss magnetic field, coherent on scale ~1 Mpc with an almost scale-invariant spectrum, is sufficient to produce significant impact on the effective optical depth, the appearance of the Lyman-{\alpha} forest on quasar spectra, the pixel-flux statistics and the power spectrum of transmitted flux. We also show that such magnetic-field signatures are effectively erased when the metagalactic photoionization rate is increased, hence relaxing the constraint on the cosmic photon budget available for reionization.

The first primitive galaxies formed from accretion and mergers by z ~ 15, and were primarily responsible for cosmological reionization and the chemical enrichment of the early cosmos. But a few of these galaxies may have formed in the presence of strong Lyman-Werner UV fluxes that sterilized them of H_2, preventing them from forming stars or expelling heavy elements into the IGM prior to assembly. At masses of 10^8 Ms and virial temperatures of 10^4 K, these halos began to rapidly cool by atomic lines, perhaps forming 10^4 - 10^6 Ms Pop III stars and, later, the seeds of supermassive black holes. We have modeled the explosion of a supermassive Pop III star in the dense core of a line-cooled protogalaxy with the ZEUS-MP code. We find that the supernova (SN) expands to a radius of ~ 1 kpc, briefly engulfing the entire galaxy, but then collapses back into the potential well of the dark matter. Fallback fully mixes the interior of the protogalaxy with metals, igniting a violent starburst and fueling the rapid growth of a massive black hole at its center. The starburst would populate the protogalaxy with stars in greater numbers and at higher metallicities than in more slowly-evolving, nearby halos. The SN remnant becomes a strong synchrotron source that can be observed with eVLA and eMERLIN and has a unique signature that easily distinguishes it from less energetic SN remnants. Such explosions, and their attendant starbursts, may well have marked the birthplaces of supermassive black holes on the sky.

The Square Kilometre Array (SKA) will have a low frequency component (SKA-low) which has as one of its main science goals the study of the redshifted 21cm line from the earliest phases of star and galaxy formation in the Universe. This 21cm signal provides a new and unique window on both the formation of the first stars and accreting black holes and the later period of substantial ionization of the intergalactic medium. The signal will teach us fundamental new things about the earliest phases of structure formation, cosmology and even has the potential to lead to the discovery of new physical phenomena. Here we present a white paper with an overview of the science questions that SKA-low can address, how we plan to tackle these questions and what this implies for the basic design of the telescope.

Primordial stars are key to primeval structure formation as the first stellar components of primeval galaxies, the sources of cosmic chemical enrichment and likely cosmic reionization, and they possibly gave rise to the supermassive black holes residing at the centres of galaxies today. While the direct detection of individual Pop III stars will likely remain beyond reach for decades to come, we show their supernova remnants may soon be detectable in the radio. We calculate radio synchrotron signatures between 0.5 - 35 GHz from hydrodynamical computations of the supernova remnants of Pop III stars in minihaloes. We find that hypernovae yield the brightest systems, with observed radio fluxes as high as 1 - 10 muJy. Less energetic Type II supernovae yield remnants about a factor of 30 dimmer and pair-instability supernova remnants are dimmer by a factor of more than 10,000. Because of the high gas densities of the progenitor environments, synchrotron losses severely limit the maximum emission frequencies, producing a distinctive peaked radio spectrum distinguishable from normal galactic supernova remnant spectra. Hypernovae radio remnants should be detectable by existing radio facilities like eVLA and eMERLIN while Type II supernova remnants will require the Square Kilometre Array. The number counts of hypernova remnants at z > 20 with fluxes above 1 muJy are expected to be one per hundred square degree field, increasing to a few per square degree if they form down to z = 10. The detection of a z > 20 Type II supernova remnant brighter than 1 nJy would require a 100 - 200 square degree field, although only a 1 - 2 square degree field for those forming down to z = 10. Hypernova and Type II supernova remnants are easily separated from one another by their light curves, which will enable future surveys to use them to constrain the initial mass function of Pop III stars.

Two methods are developed for solving the steady-state spherically symmetric radiative transfer equation for resonance line radiation emitted by a point source in the Intergalactic Medium. One method is based on solving the ray and moment equations using finite differences. The second uses a Monte Carlo approach incorporating methods that greatly improve the accuracy compared with previous approaches in this context. Several applications are presented serving as test problems for both a static medium and an expanding medium, including inhomogeneities in the density and velocity fields. Solutions are obtained in the coherent scattering limit and for Doppler RII redistribution with and without recoils. We find generally that the radiation intensity is linear in the cosine of the azimuthal angle with respect to radius to high accuracy over a broad frequency region across the line centre for both linear and perturbed velocity fields, yielding the Eddington factors f(nu) = 1/3 and g(nu) = 3/5. We show the radiation field produced by a point source divides into three spatial regimes for a uniformly expanding homogeneous medium: at radii r small compared with a characteristic radius r*, the mean intensity near line centre varies as 1/ r^(7/3), while at r > r* it approaches 1/ r^2; for r << r* it is modified by frequency redistribution. Before the reionization epoch, r* takes on the universal value 1.1 Mpc, independent of redshift. The mean intensity and scattering rate are found to be very sensitive to the gradient of the velocity field, growing exponentially with the amplitude of the perturbation as the limit of a vanishing velocity gradient is approached near the source. We expect the 21cm signal from the Epoch of Reionization to thus be a sensitive probe of both the density and the peculiar velocity fields.

The full reionization of intergalactic helium was a major event in the history of the IGM, and UV observations of the He II Gunn-Peterson trough allow us to characterize the end of this process at z~3. Due to intervening hydrogen absorption, quasars allowing such study are rare, with only 33 known in the literature, and most of those are very recent discoveries. We expand on our previous discovery work, and present 13 new He II quasars with redshifts 2.82 < z < 3.77, here selected with ~80% efficiency, and including several that are much brighter than the vast majority of those previously known. This is the largest sample of uniformly observed He II quasars covering such a broad redshift range, and they show evidence of IGM opacity increasing with redshift, as expected for the helium reionization epoch. No evidence of He II Ly{\alpha} quasar emission is seen in individual or averaged spectra, posing a problem for standard models of the broad line region. The current rapid advance in the study of He II quasars has been greatly facilitated by the Cosmic Origins Spectrograph on HST, and we discuss the instrumental and other subtleties that must be taken into account in IGM He II observations.

The first major star-forming galaxies and Active Galactic Nuclei will produce Balmer and higher order extended haloes during the Epoch of Reionization through the scattering of Lyman resonance line photons off the surrounding neutral intergalactic gas. The optical depth dependence of the scattering rates will produce a signal sensitive to both the density and velocity fluctuations of the gas, offering the possibility of probing the ionization region and flow field surrounding young star-forming galaxies. The requirements for detecting the haloes in the infra-red using a space-based telescope are discussed, along with an assessment of the possibility of detecting the haloes using the Tunable Filter Imager on the James Webb Space Telescope.

A unified description is provided for the 21cm signatures arising from minihaloes against a bright background radio source and against the Cosmic Microwave Background (CMB), within the context of a dynamical collapsing cosmological spherical halo model. The equivalent width distribution of the resulting 21cm forest is computed for LCDM cosmologies, along with the brightness temperature differential relative to the CMB. The effects of an ambient Ly-alpha radiation field and heating of the IGM on the signatures are included. It is shown that the dynamical effects of heating substantially suppress absorption features in the 21cm forest with observed equivalent widths exceeding 0.15 kHz. It is demonstrated how measurements of excess fluctuations beyond detector noise could make a statistical detection of the weaker absorption features against a bright background radio source. It is also shown that a Ly-alpha radiation field only a few percent the thermalisation rate is sufficient to render the minihalo signal against the CMB negligible compared with the signal from the diffuse IGM component. The 21cm signals are found to be very sensitive to the amount of small scale power in the primordial density fluctuation spectrum. The effects of gas cooling via radiative atomic and molecular processes and of star formation on setting the maximum mass of the minihaloes giving rise to a 21cm signal are included, with allowance made for the suppression of molecular hydrogen formation by an ambient UV radiation field.

We examine the impact of helium reionization on the structure of the intergalactic medium (IGM). We model the reionization using a radiative transfer (RT) code coupled to the combined gravity hydrodynamics code Enzo. Neutral hydrogen and helium are initially ionized by a starburst spectrum, which is allowed to gradually evolve into a power law spectrum over the redshift interval 3 < z < 4. The temperature-density relation of the gas is found to fan out and flatten following HeII reionization, with an inversion for overdensities above 5. Peculiar velocities of up to 10 km/s are induced by the increased pressure, with the gas density field distorted over large coherent regions by 10-20%, and the dark matter by levels of 1%. The photoionization-induced flows may thus distort the matter power spectrum at comoving wavenumbers k > 0.5 h/Mpc by a few percent by z = 2. Absorption spectra for HI and HeII are drawn from the simulations, and absorption lines are fit to the spectra. A median Doppler parameter of 35 km/s is obtained for the HI absorption systems at z = 3. Dividing into subsamples optically thick and optically thin at line centre reveals that the optically thick systems undergo only mild evolution while the optically thin systems evolve rapidly following HeII reionization. A comparison between HeII and HI absorption features shows a broad distribution in the HeII and HI column density ratio, peaking near the measured value and only slightly narrower than measured. A comparison with approximate simulation methods shows moderately good agreement in the absorption line properties, but not to the precision to which they may be measured.

Observations of He II Ly{\alpha} Gunn-Peterson troughs have proved to be a valuable probe of the epoch of helium reionization at z~3. Since this optical depth can become unmeasurably large even for modest He II fractions, various alternate techniques have been proposed to push to higher redshift, and among the more promising is looking at higher order Lyman-series troughs. We here report four new observations of the He II Ly{\beta} trough, including new data on the only sightline with a prior Ly{\beta} observation. However, the effective optical depth ratio {\tau}_eff,{\beta}/{\tau}_eff,{\alpha} is not simply predicted by (f_{\beta} {\lambda}_{\beta})/(f_{\alpha} {\lambda}_{\alpha})=0.16, and we analyze cosmological simulations to find that the correct ratio for helium at z~3 is ~0.35. In one case we infer {\tau}_eff,{\alpha} > 8.8, strong evidence that helium was not fully reionized at z=3.2--3.5, in agreement with previous measurements suggesting a later completion of reionization.

IGMtransmission is a Java graphical user interface that implements Monte Carlo simulations to compute the corrections to colours of high-redshift galaxies due to intergalactic attenuation based on current models of the Intergalactic Medium. The effects of absorption due to neutral hydrogen are considered, with particular attention to the stochastic effects of Lyman Limit Systems. Attenuation curves are produced, as well as colours for a wide range of filter responses and model galaxy spectra. Alternative filter response curves and spectra may be readily uploaded. The code is freely available from http://code.google.com/p/igmtransmission. It is licensed under the GNU General Public License v.3.

Quasars that allow the study of IGM He II are very rare, since they must be at high redshift along sightlines free of substantial hydrogen absorption, but recent work has dramatically expanded the number of such quasars known. We analyze two dozen higher-redshift (z=3.1-3.9) low-resolution He II quasar spectra from HST and find that their He II Gunn-Peterson troughs suggest exclusion of very early and very late reionization models, favoring a reionization redshift of z~3. Although the data quality is not sufficient to reveal details such as the expected redshift evolution of helium opacity, we obtain the first ensemble measure of helium opacity at high redshift averaged over many sightlines: tau=4.90 at z~3.3. We also find that it would be very difficult to observe the IGM red wing of absorption from the beginning of He II reionization, but depending on the redshift of reionization and the size of ionization zones, it might be possible to do so in some objects with the current generation of UV spectrographs.

We examine the temperature structure of the intergalactic medium IGM) surounding a hard radiation source, such as a Quasi-Stellar Object (QSO), as it responds to the onset of helium reionization by the source. We model the reionization using a radiative transfer (RT) code coupled to a particle-mesh (PM) N-body code. Neutral hydrogen and helium are initially ionized by a starburst spectrum, which is allowed to gradually evolve into a power law spectrum (fnu ~ nu^(-0.5)). Multiple simulations were performed with different times for the onset and dominance of the hard spectrum, with onset redshifts ranging from z = 3.5 to 5.5. The source is placed in a high-density region to mimic the expected local environment of a QSO. Simulations with the source placed in a low-density environment were also performed as control cases to explore the role of the environment on the properties of the surrounding IGM. We find in both cases that the IGM temperature within the HeIII region produced exceeds the IGM temperature before full helium reionization, resulting in a "thermal proximity effect", but that the temperature in the HeIII region increases systematically with distance from the source. With time the temperature relaxes with a reduced spread as a function of impact parameter along neighbouring lines of sight, although the trend continues to persist until z = 2. Such a trend could be detected using the widths of intervening metal absorption systems using high resolution, high signal-to-noise ratio spectra.

The spectroscopic Sloan Digital Sky Survey (SDSS) Data Release 7 (DR7) galaxy sample represents the final set of galaxies observed using the original SDSS target selection criteria. We analyse the clustering of galaxies within this sample, including both the Luminous Red Galaxy (LRG) and Main samples, and also include the 2-degree Field Galaxy Redshift Survey (2dFGRS) data. Baryon Acoustic Oscillations are observed in power spectra measured for different slices in redshift; this allows us to constrain the distance--redshift relation at multiple epochs. We achieve a distance measure at redshift z=0.275, of r_s(z_d)/D_V(0.275)=0.1390+/-0.0037 (2.7% accuracy), where r_s(z_d) is the comoving sound horizon at the baryon drag epoch, D_V(z)=[(1+z)^2D_A^2cz/H(z)]^(1/3), D_A(z) is the angular diameter distance and H(z) is the Hubble parameter. We find an almost independent constraint on the ratio of distances D_V(0.35)/D_V(0.2)=1.736+/-0.065, which is consistent at the 1.1sigma level with the best fit Lambda-CDM model obtained when combining our z=0.275 distance constraint with the WMAP 5-year data. The offset is similar to that found in previous analyses of the SDSS DR5 sample, but the discrepancy is now of lower significance, a change caused by a revised error analysis and a change in the methodology adopted, as well as the addition of more data. Using WMAP5 constraints on Omega_bh^2 and Omega_ch^2, and combining our BAO distance measurements with those from the Union Supernova sample, places a tight constraint on Omega_m=0.286+/-0.018 and H_0 = 68.2+/-2.2km/s/Mpc that is robust to allowing curvature and non-Lambda dark energy. This result is independent of the behaviour of dark energy at redshifts greater than those probed by the BAO and supernova measurements. (abridged)

Absorption along quasar sightlines remains among the most sensitive direct measures of HeII reionization in much of the intergalactic medium (IGM). Until recently, fewer than a half-dozen unobscured quasar sightlines suitable for the HeII Gunn-Peterson test were known; although these handful demonstrated great promise, the small sample size limited confidence in cosmological inferences. We have recently added nine more such clean HeII quasars, exploiting SDSS quasar samples, broadband UV imaging from GALEX, and high-yield UV spectroscopic confirmations from HST. Here we markedly expand this approach by cross-correlating SDSS DR7 and GALEX GR4+5 to catalog 428 SDSS and 165 other quasars with z>2.78 having likely (~70%) GALEX detections, suggesting they are bright into the far-UV. Reconnaissance HST Cycle 16 Supplemental prism data for 29 of these new quasar-GALEX matches spectroscopically confirm 17 as indeed far-UV bright. At least 10 of these confirmations have clean sightlines all the way down to HeII Lyman-alpha, substantially expanding the number of known clean HeII quasars, and reaffirming the order of magnitude enhanced efficiency of our selection technique. Combined confirmations from this and our past programs yield more than twenty HeII quasars, quintupling the sample. These provide substantial progress toward a sample of HeII quasar sightlines large enough, and spanning a sufficient redshift range, to enable statistical IGM studies that may avoid individual object peculiarity and sightline variance. Our expanded catalog of hundreds of high-likelihood far-UV-bright QSOs additionally will be useful for understanding the extreme-UV properties of the quasars themselves.

The role of higher order Lyman series photons on the 21cm absorption or emission signature of the IGM against the background CMB during the Epoch of Reionisation is examined. It is shown that, taking into account the diminishing resonance line scattering cross section with increasing Lyman order, a non-negligible net scattering rate of higher order Lyman photons is expected. The resulting radiative cascades will substantially enhance the number density of Lyman-alpha photons near a radiation source. It is also shown that the higher order Lyman series photons are able to collisionally heat the IGM by amounts of tens to hundreds of degrees kelvin. The possibility that the Wouthuysen-Field effect may be suppressed by the presence of dust near a galaxy is discussed, and it is shown that the higher order Lyman series photons would still induce the effect, but with a somewhat reduced 21cm radiation efficiency. It is also demonstrated that extended low surface brightness emission line halos will be produced from radiative cascades following the scattering of higher order Lyman series photons. These halos would provide a unique means of confirming that reionisation source candidates were surrounded by an IGM that was still largely neutral on large scales.

We present the power spectrum of the reconstructed halo density field derived from a sample of Luminous Red Galaxies (LRGs) from the Sloan Digital Sky Survey Seventh Data Release (DR7). The halo power spectrum has a direct connection to the underlying dark matter power for k <= 0.2 h/Mpc, well into the quasi-linear regime. This enables us to use a factor of ~8 more modes in the cosmological analysis than an analysis with kmax = 0.1 h/Mpc, as was adopted in the SDSS team analysis of the DR4 LRG sample (Tegmark et al. 2006). The observed halo power spectrum for 0.02 < k < 0.2 h/Mpc is well-fit by our model: chi^2 = 39.6 for 40 degrees of freedom for the best fit LCDM model. We find \Omega_m h^2 * (n_s/0.96)^0.13 = 0.141^{+0.009}_{-0.012} for a power law primordial power spectrum with spectral index n_s and \Omega_b h^2 = 0.02265 fixed, consistent with CMB measurements. The halo power spectrum also constrains the ratio of the comoving sound horizon at the baryon-drag epoch to an effective distance to z=0.35: r_s/D_V(0.35) = 0.1097^{+0.0039}_{-0.0042}. Combining the halo power spectrum measurement with the WMAP 5 year results, for the flat LCDM model we find \Omega_m = 0.289 +/- 0.019 and H_0 = 69.4 +/- 1.6 km/s/Mpc. Allowing for massive neutrinos in LCDM, we find \sum m_{\nu} < 0.62 eV at the 95% confidence level. If we instead consider the effective number of relativistic species Neff as a free parameter, we find Neff = 4.8^{+1.8}_{-1.7}. Combining also with the Kowalski et al. (2008) supernova sample, we find \Omega_{tot} = 1.011 +/- 0.009 and w = -0.99 +/- 0.11 for an open cosmology with constant dark energy equation of state w.

Intergalactic space is filled with a pervasive medium of ionized gas, the Intergalactic Medium (IGM). A residual neutral fraction is detected in the spectra of Quasi-Stellar Objects at both low and high redshifts, revealing a highly fluctuating medium with temperatures characteristic of photoionized gas. The statistics of the fluctuations are well-reproduced by numerical gravity-hydrodynamics simulations within the context of standard cosmological structure formation scenarios. As such, the study of the IGM offers an opportunity to probe the nature of the primordial density fluctuations on scales unavailable to other methods. The simulations also suggest the IGM is the dominant reservoir of baryons produced by the Big Bang, and so the principal source of the matter from which galaxies formed. The detection of metal systems within the IGM shows that it was enriched by evolved stars early in its history, demonstrating an intimate connection between galaxy formation and the IGM. The author presents a comprehensive review of the current understanding of the structure and physical properties of the IGM and its relation to galaxies, concluding with comments on prospects for furthering the study of the IGM using future ground-based facilities and space-based experiments.

We show that, due to the high optical depth of the intergalactic medium to Lyman-alpha photons before the Epoch of Reionization, the Lyman-alpha scattering rate responsible for the Wouthuysen-Field effect from an isolated source will be negligible unless (1) there is sufficient time for the scattering photons to establish a steady state, or (2) the scattering gas is undergoing internal expansion or has a peculiar motion of tens to hundreds of km/s away from the source. We present steady-state solutions in the radiative diffusion approximation for the radiation field trapped in a clump of gas and show that this may result in an enhancement, by a factor of up to 10^6, of the strength of the Wouthuysen-Field effect over that obtained from the free-streaming limit. Solutions to the time-dependent diffusion equation, however, suggest that the timescales required to reach such a steady state will generally exceed the source lifetimes. In the presence of internal expansion, a steady state may be established as photons are redshifted into the red wing, and significant enhancement in the scattering rate may again be produced. Alternatively, a substantial scattering rate may arise in systems with a peculiar motion away from the source that redshifts the received radiation into the resonance line centre. As a consequence, at epochs z<30, when collisional decoupling is small except in dense regions, and prior to the establishment of any large-scale diffuse radiation field of resonance line photons, the 21cm signature from the Intergalactic Medium produced by the Wouthuysen-Field effect will in general trace the peculiar velocity field of the gas in addition to its density structure.

Investigations of He II Ly-alpha (304 A rest) absorption toward a half-dozen quasars at z~3-4 have demonstrated the great potential of helium studies of the IGM, but the current critically small sample size of clean sightlines for the He II Gunn-Peterson test limits confidence in cosmological inferences, and a larger sample is required. Although the unobscured quasar sightlines to high redshift are extremely rare, SDSS DR6 provides thousands of z>2.8 quasars. We have cross-correlated these SDSS quasars with GALEX GR2/GR3 to establish a catalog of 200 higher-confidence (~70% secure) cases of quasars at z=2.8-5.1 potentially having surviving far-UV (restframe) flux. We also catalog another 112 likely far-UV-bright quasars from GALEX cross-correlation with other (non-SDSS) quasar compilations. Reconnaissance UV prism observations with HST of 24 of our SDSS/GALEX candidates confirm 12 as detected in the far-UV, with at least 9 having flux extending to very near the He II break; with refinements our success rate is even higher. Our SDSS/GALEX selection approach is thereby confirmed to be an order of magnitude more efficient than previous He II quasar searches, more than doubles the number of spectroscopically confirmed clean sightlines to high redshift, and provides a resource list of hundreds of high-confidence sightlines for upcoming He II and other far-UV studies from HST. Our reconnaissance HST prism spectra suggest some far-UV diversity, confirming the need to obtain a large sample of independent quasar sightlines across a broad redshift range to assess such issues as the epoch(s) of helium reionization, while averaging over individual-object pathology and/or cosmic variance.

We measure the evolution of the luminous red galaxy (LRG) luminosity function in the redshift range 0.1<z<0.9 using samples of galaxies from the Sloan Digital Sky Survey as well as new spectroscopy of high-redshift massive red galaxies. Our high-redshift sample of galaxies is largest spectroscopic sample of massive red galaxies at z~0.9 collected to date and covers 7 square deg, minimizing the impact of large scale structure on our results. We find that the LRG population has evolved little beyond the passive fading of its stellar populations since z~0.9. Based on our luminosity function measurements and assuming a non-evolving Salpeter stellar initial mass function, we find that the most massive (L>3L*) red galaxies have grown by less than 50% (at 99% confidence), since z=0.9, in stark contrast to the factor of 2-4 growth observed in the L* red galaxy population over the same epoch. We also investigate the evolution of the average LRG spectrum since z~0.9 and find the high-redshift composite to be well-described as a passively evolving example of the composite galaxy observed at low-redshift. From spectral fits to the composite spectra, we find at most 5% of the stellar mass in massive red galaxies may have formed within 1Gyr of z=0.9. While L* red galaxies are clearly assembled at z<1, 3L* galaxies appear to be largely in place and evolve little beyond the passive evolution of their stellar populations over the last half of cosmic history.

We have studied a sample of 415 associated (z_ab z_em; relative velocity with respect to QSO <3000km/s) Mg II absorption systems with 1.0<=z_ab<=1.86, in the spectra of SDSS DR3 QSOs, to determine the dust content and ionization state in the absorbers. We studied the dependence of these properties on the properties of the QSOs and also, compared the properties with those of a similarly selected sample of 809 intervening systems (apparent relative velocity with respect to the QSO of >3000km/s), so as to understand their origin. From the analysis of the composite spectra, as well as from the comparison of measured equivalent widths in individual spectra, we conclude that the associated Mg II absorbers have higher apparent ionization, measured by the strength of the C IV absorption lines compared to the Mg II absorption lines, than the intervening absorbers. The ionization so measured appears to be related to apparent ejection velocity, being lower as the apparent ejection velocity is more and more positive. There is clear evidence, from the composite spectra, for SMC like dust attenuation in these systems; the 2175AA absorption feature is not present. The extinction is almost twice that observed in the similarly selected sample of intervening systems. We reconfirm that QSOs with non-zero FIRST radio flux are intrinsically redder than the QSOs with no detection in the FIRST survey. The incidence of associated Mg II systems in QSOs with non-zero FIRST radio flux is 1.7 times that in the QSOs with no detection in the FIRST survey. The associated absorbers in radio-detected QSOs which comprise about 12% of our sample, cause 3 times more reddening than the associated absorbers in radio-undetected QSOs. This excess reddening possibly suggests an intrinsic nature for the associated absorbers in radio-detected QSOs.

We examine the temperature structure of the IGM due to the passage of individual ionisation fronts using a radiative transfer (RT) code coupled to a particle-mesh (PM) N-body code. Multiple simulations were performed with different spectra of ionising radiation: a power law (goes as nu^{-0.5}), miniquasar, starburst, and a time-varying spectrum that evolves from a starburst spectrum to a power law. The RT is sufficiently resolved in time and space to correctly model both the ionisation state and the temperature across the ionisation front. We find the post-ionisation temperature of the reionised intergalactic medium (IGM) is sensitive to the spectrum of the source of ionising radiation, which may be used to place strong constraints on the nature of the sources of reionisation. Radiative transfer effects also produce large fluctuations in the HeII to HI number density ratio eta. The spread in values is smaller than measured, except for the time-varying spectrum. For this case, the spread evolves as the spectral nature of the ionising background changes. Large values for eta are found in partially ionised HeII as the power-law spectrum begins to dominate the starburst, suggesting that the large eta values measured may be indicating the onset of the HeII reionisation epoch.

We measure the cosmological matter density by observing the positions of baryon acoustic oscillations in the clustering of galaxies in the Sloan Digital Sky Survey (SDSS). We jointly analyse the main galaxies and LRGs in the SDSS DR5 sample, using over half a million galaxies in total. The oscillations are detected with 99.74% confidence (3.0sigma assuming Gaussianity) compared to a smooth power spectrum. When combined with the observed scale of the peaks within the CMB, we find a best-fit value of Omega_m=0.256+0.029-0.024 (68% confidence interval), for a flat Lambda cosmology when marginalising over the Hubble parameter and the baryon density. This value of the matter density is derived from the locations of the baryon oscillations in the galaxy power spectrum and in the CMB, and does not include any information from the overall shape of the power spectra. This is an extremely clean cosmological measurement as the physics of the baryon acoustic oscillation production is well understood, and the positions of the oscillations are expected to be independent of systematics such as galaxy bias.

We perform population synthesis modelling of a magnitude-limited sample of 4391 Luminous Red Galaxies selected from the Sloan Digital Sky Survey Data Release 4 (SDSS DR4). We fit measured spectral indices using a large library of high resolution spectra, covering a wide range of metallicities and assuming an exponentially decaying star-formation rate punctuated by bursts, to obtain median-likelihood estimates for the light-weighted age, metallicity, stellar mass and extinction for the galaxies. The ages lie in the range 4-10 Gyr, peaking near 6 Gyr, with metallicities in the range -0.4<[Z/H]<0.4, peaking at [Z/H] ~ 0.2. Only a few per cent of the spectra are better fit allowing for a burst in addition to continuous star-formation. The total stellar masses of all the galaxies are confined to a very narrow range. Our results broadly agree with those of previous groups using an independent population synthesis code. We find, however, that our choice in priors results in ages 1-2 Gyr smaller, decreasing the peak star formation epoch from z=2.3 to z=1.3. We develop a metal evolution model incorporating stochastic star-formation quenching motivated by recent attempts to solve the `anti-hierarchical' formation problem of ellipticals. Two scenarios emerge, a closed box with an effective stellar yield of 0.26, and an accreting box with an effective stellar yield of 0.10. Both scenarios require an IMF weighted towards massive stars and characteristic star-formation quenching times of about 100 Myr, the expected lifetime of luminous QSOs. The models predict an anti-correlation between the age and mean metallicity similar to that observed.

We present a Fourier analysis of the clustering of galaxies in the combined Main galaxy and Luminous Red Galaxy (LRG) Sloan Digital Sky Survey (SDSS) Data Release 5 (DR5) sample. The aim of our analysis is to consider how well we can measure the cosmological matter density using the signature of the horizon at matter-radiation equality embedded in the large-scale power spectrum. The new data constrains the power spectrum on scales 100--600h^-1Mpc with significantly higher precision than previous analyses of just the SDSS Main galaxies, due to our larger sample and the inclusion of the LRGs. This improvement means that we can now reveal a discrepancy between the shape of the measured power and linear CDM models on scales 0.01<k<0.15hMpc^-1, with linear model fits favouring a lower matter density (Omega_m=0.22+/-0.04) on scales 0.01<k<0.06hMpc^-1 and a higher matter density (Omega_m=0.32+/-0.01) when smaller scales are included, assuming a flat LCDM model with h=0.73 and n_s=0.96. This discrepancy could be explained by scale-dependent bias and, by analysing subsamples of galaxies, we find that the ratio of small-scale to large-scale power increases with galaxy luminosity, so all of the SDSS galaxies cannot trace the same power spectrum shape over 0.01<k<0.2hMpc^-1. However, the data are insufficient to clearly show a luminosity-dependent change in the largest scale at which a significant increase in clustering is observed, although they do not rule out such an effect. Significant scale-dependent galaxy bias on large-scales, which changes with the r-band luminosity of the galaxies, could potentially explain differences in our Omega_m estimates and differences previously observed between 2dFGRS and SDSS power spectra and the resulting parameter constraints.

We present a spectroscopic survey of almost 15,000 candidate intermediate-redshift Luminous Red Galaxies (LRGs) brighter than i=19.8, observed with 2dF on the Anglo-Australian Telescope. The targets were selected photometrically from the Sloan Digital Sky Survey (SDSS) and lie along two narrow equatorial strips covering 180 sq deg. Reliable redshifts were obtained for 92% of the targets and the selection is very efficient: over 90% have redshifts between 0.45 and 0.8. More than 80% of the ~11,000 red galaxies have pure absorption-line spectra consistent with a passively-evolving old stellar population. The redshift, photometric and spatial distributions of the LRGs are described. The 2SLAQ data will be released publicly from mid-2006, providing a powerful resource for observational cosmology and the study of galaxy evolution.

A formal derivation is presented of the energy transfer rate between radiation and matter due to the scattering of an isotropic distribution of resonant photons. The derivation is developed in the context of the two-level atom in the absence of collisions and radiative transitions to and from the continuum, but includes the full angle-averaged redistribution function for photon scattering. The result is compared with previous derivations, all of which have been based on the Fokker-Planck approximation to the radiative transfer equation. A new Fokker-Planck approximation, including an extension to higher (post-diffusive) orders, is derived to solve the radiative transfer equation, and time-dependent numerical solutions are found. The relaxation of the colour temperature to the matter temperature is computed as the radiation field approaches statistical equilibrium through scattering. The results are discussed in the context of the Wouthuysen-Field mechanism for coupling the 21cm spin temperature of neutral hydrogen to the kinetic temperature of the gas through LyA scattering. The evolution of the heating rate is also computed, and shown to diminish as the gas approaches statistical equilibrium.

We determine the number counts and z=0-5 luminosity function for a well-defined, homogeneous sample of quasars from the Sloan Digital Sky Survey (SDSS). We conservatively define the most uniform statistical sample possible, consisting of 15,343 quasars within an effective area of 1622 deg^2 that was derived from a parent sample of 46,420 spectroscopically confirmed broad-line quasars in the 5282 deg^2 of imaging data from SDSS Data Release Three. The sample extends from i=15 to i=19.1 at z<3 and to i=20.2 for z>3. The number counts and luminosity function agree well with the results of the 2dF QSO Survey, but the SDSS data probe to much higher redshifts than does the 2dF sample. The number density of luminous quasars peaks between redshifts 2 and 3, although uncertainties in the selection function in this range do not allow us to determine the peak redshift more precisely. Our best fit model has a flatter bright end slope at high redshift than at low redshift. For z<2.4 the data are best fit by a redshift-independent slope of beta = -3.1 (Phi(L) propto L^beta). Above z=2.4 the slope flattens with redshift to beta=-2.37 at z=5. This slope change, which is significant at a >5-sigma level, must be accounted for in models of the evolution of accretion onto supermassive black holes.

The colours of high redshift Type II QSOs are synthesized from observations of moderate redshift systems. It is shown that Type II QSOs are comparable to starbursts in their success at matching the colours of z_850-dropouts and i_775-drops in the Hubble Ultra Deep Field, and more naturally account for the bluest objects detected. Type II QSOs may also account for some of the i_775-drops detected in the GOODS fields. It is shown that by combining imaging data from the Hubble Space Telescope and the James Webb Space Telescope, it will be possible to clearly separate Type II QSOs from Type I QSOs and starbursts based on their colours. Similarly, it is shown that the UKIDSS ZYJ filters may be used to discriminate high redshift Type II QSOs from other objects. If Type II QSOs are prevalent at high redshifts, then AGN may be major contributors to the re-ionization of the Intergalactic Medium.

Corrections to the magnitudes of high redshift objects due to intergalactic attenuation are computed using current estimates of the properties of the intergalactic medium. The results of numerical simulations are used to estimate the contributions to resonant scattering from the higher order Lyman transitions. Differences of 0.5-1 magnitude from the previous estimate of Madau (1995) are found. Intergalactic k_IGM-corrections and colours are provided for high redshift starburst galaxies and Type I and Type II QSOs for several filter systems used in current and planned deep optical and infra-red surveys.

We study the luminosity and color dependence of the galaxy 2-point correlation function in the Sloan Digital Sky Survey, starting from a sample of 200,000 galaxies over 2500 deg^2. We concentrate on the projected correlation function w(r_p), which is directly related to the real space \xi(r). The amplitude of w(r_p) grows continuously with luminosity, rising more steeply above the characteristic luminosity L_*. Redder galaxies exhibit a higher amplitude and steeper correlation function at all luminosities. The correlation amplitude of blue galaxies increases continuously with luminosity, but the luminosity dependence for red galaxies is less regular, with bright red galaxies more strongly clustered at large scales and faint red galaxies more strongly clustered at small scales. We interpret these results using halo occupation distribution (HOD) models assuming concordance cosmological parameters. For most samples, an HOD model with two adjustable parameters fits the w(r_p) data better than a power-law, explaining inflections at r_p ~ 1-3 Mpc/h as the transition between the 1-halo and 2-halo regimes of \xi(r). The implied minimum mass for a halo hosting a central galaxy above a luminosity threshold L grows as M_min ~ L at low luminosities and more steeply above L_*. The mass at which an average halo has one satellite galaxy brighter than L is M_1 ~ 23 M_min(L). These results imply a conditional luminosity function (at fixed halo mass) in which central galaxies lie far above a Schechter function extrapolation of the satellite population. HOD models nicely explain the joint luminosity-color dependence of w(r_p) in terms of the color fractions of central and satellite populations as a function of halo mass. The inferred HOD properties are in good qualitative agreement with theoretical predictions.

We have used the 2dF instrument on the AAT to obtain redshifts of a sample of z<3, 18.0<g<21.85 quasars selected from SDSS imaging. These data are part of a larger joint programme: the 2dF-SDSS LRG and QSO Survey (2SLAQ). We describe the quasar selection algorithm and present the resulting luminosity function of 5645 quasars in 105.7 deg^2. The bright end number counts and luminosity function agree well with determinations from the 2dF QSO Redshift Survey (2QZ) data to g\sim20.2. However, at the faint end the 2SLAQ number counts and luminosity function are steeper than the final 2QZ results from Croom et al. (2004), but are consistent with the preliminary 2QZ results from Boyle et al. (2000). Using the functional form adopted for the 2QZ analysis, we find a faint end slope of beta=-1.78+/-0.03 if we allow all of the parameters to vary and beta=-1.45+/-0.03 if we allow only the faint end slope and normalization to vary. Our maximum likelihood fit to the data yields 32% more quasars than the final 2QZ parameterization, but is not inconsistent with other g>21 deep surveys. The 2SLAQ data exhibit no well defined ``break'' but do clearly flatten with increasing magnitude. The shape of the quasar luminosity function derived from 2SLAQ is in good agreement with that derived from type I quasars found in hard X-ray surveys. [Abridged]

We present the large-scale correlation function measured from a spectroscopic sample of 46,748 luminous red galaxies from the Sloan Digital Sky Survey. The survey region covers 0.72 h^{-3} Gpc^3 over 3816 square degrees and 0.16<z<0.47, making it the best sample yet for the study of large-scale structure. We find a well-detected peak in the correlation function at 100h^{-1} Mpc separation that is an excellent match to the predicted shape and location of the imprint of the recombination-epoch acoustic oscillations on the low-redshift clustering of matter. This detection demonstrates the linear growth of structure by gravitational instability between z=1000 and the present and confirms a firm prediction of the standard cosmological theory. The acoustic peak provides a standard ruler by which we can measure the ratio of the distances to z=0.35 and z=1089 to 4% fractional accuracy and the absolute distance to z=0.35 to 5% accuracy. From the overall shape of the correlation function, we measure the matter density Omega_mh^2 to 8% and find agreement with the value from cosmic microwave background (CMB) anisotropies. Independent of the constraints provided by the CMB acoustic scale, we find Omega_m = 0.273 +- 0.025 + 0.123 (1+w_0) + 0.137 Omega_K. Including the CMB acoustic scale, we find that the spatial curvature is Omega_K=-0.010+-0.009 if the dark energy is a cosmological constant. More generally, our results provide a measurement of cosmological distance, and hence an argument for dark energy, based on a geometric method with the same simple physics as the microwave background anisotropies. The standard cosmological model convincingly passes these new and robust tests of its fundamental properties.

Spectra of nearly 20000 point-like objects to a Galactic reddening corrected magnitude of i=19.1 have been obtained to test the completeness of the SDSS quasar survey. The spatially-unresolved objects were selected from all regions of color space, sparsely sampled from within a 278 sq. deg. area of sky covered by this study. Only ten quasars were identified that were not targeted as candidates by the SDSS quasar survey (including both color and radio source selection). The inferred density of unresolved quasars on the sky that are missed by the SDSS algorithm is 0.44 per sq. deg, compared to 8.28 per sq. deg. for the selected quasar density, giving a completeness of 94.9(+2.6,-3.8) to the limiting magnitude. Omitting radio selection reduces the color-only selection completeness by about 1%. Of the ten newly identified quasars, three have detected broad absorption line systems, six are significantly redder than other quasars at the same redshift, and four have redshifts between 2.7 and 3.0 (the redshift range where the SDSS colors of quasars intersect the stellar locus). The fraction of quasars missed due to image defects and blends is approximately 4%, but this number varies by a few percent with magnitude. Quasars with extended images comprise about 6% of the SDSS sample, and the completeness of the selection algorithm for extended quasars is approximately 81%, based on the SDSS galaxy survey. The combined end-to-end completeness for the SDSS quasar survey is approximately 89%. The total corrected density of quasars on the sky to i=19.1 is estimated to be 10.2 per sq. deg.

We present the small-scale (0.2h^{-1} to 7h^{-1} Mpc) cross-correlations between 32,000 luminous early-type galaxies and a reference sample of 16 million normal galaxies from the Sloan Digital Sky Survey. Our method allows us to construct the spherically averaged, real-space cross-correlation function between the spectroscopic LRG sample and galaxies from the SDSS imaging. We report the cross-correlation as a function of scale, luminosity, and redshift. We find very strong luminosity dependences in the clustering amplitudes, up to a factor of 4 over a factor of 4 in luminosity, and measure this dependence with high signal-to-noise ratio. The luminosity dependence of bias is found to depend on scale, with more variation on smaller scales. The clustering as a function of scale is not a power law, but instead has a dip at 1h^{-1} Mpc and an excess on small scales. The fraction of red galaxies within the L* sample surrounding LRGs is a strong function of scale, as expected. However, the fraction of red galaxies evolves in redshift similarly on small and large scales, suggesting that cluster and field populations are changing in the same manner. The results highlight the advantage on small scales of using cross-correlation methods as a means of avoiding shot noise in samples of rare galaxies.

We report the intermediate-scale (0.3 to 40 Mpc/h) clustering of 35,000 luminous early-type galaxies at redshifts 0.16 to 0.44 from the Sloan Digital Sky Survey. We present the redshift-space two-point correlation function \xi(s), the projected correlation function w_p(r_p), and the deprojected real-space correlation function \xi(r), for approximately volume-limited samples. As expected, the galaxies are highly clustered, with the correlation length varying from 9.8 +/- 0.2 Mpc/h to 11.2 +/- 0.2 Mpc/h, dependent on the specific luminosity range. For the -23.2 < Mg < -21.2 sample, the inferred bias relative to that of L* galaxies is 1.84 +/- 0.11 for 1 Mpc/h < r_p < 10 Mpc/h, with yet stronger clustering on smaller scales. We detect luminosity-dependent bias within the sample but see no evidence for redshift evolution between z=0.2 and z=0.4. We find a clear indication for deviations from a power-law in the real-space correlation function, with a dip at ~ 2 Mpc/h scales and an upturn on smaller scales. The precision measurements of these clustering trends offer new avenues for the study of the formation and evolution of these massive galaxies.

Constraints on the ionization structure of the Intergalactic Medium are derived as directly imposed by observations in conjunction with the results of numerical simulations for structure formation. Under the assumption that the population of sources dominating the UV ionizing background at z<6 is the same population which reionized the IGM, it is shown that consistency with measurements of the mean LyA transmitted flux at high redshifts requires the epoch of hydrogen reionization of the IGM to have occurred at a redshift z < 11, independent of the space density of the sources. The upper limit on the reionization redshift depends only on the shape of the UV spectra of the sources. Consistency with constraints on the reionization epoch from WMAP requires the sources of photoionization to have had hard spectra, such as QSOs or Population III stars. The only way to escape these conclusions is either: 1.the sources which dominate the photoionization background at z<6 are the remnants of a population that was a much more prodigious source of ionizing photons at earlier times, or 2.the sources responsible for the photoionization of the IGM are an unknown population that contributes negligibly to the ionization of the IGM at z<6. The contribution of QSOs to the UV background is also estimated based on recent surveys.

We model how repeated supernova explosions in high-redshift dwarf starburst galaxies drive superbubbles and winds out of the galaxies. We compute the efficiencies of metal and mass ejection and energy transport from the galactic potentials, including the effect of cosmological infall of external gas. The starburst bubbles quickly blow out of small, high-redshift, galactic disks, but must compete with the ram pressure of the infalling gas to escape into intergalactic space. We show that the assumed efficiency of the star formation rate dominates the bubble evolution and the metal, mass, and energy feedback efficiencies. With star formation efficiency f*=0.01, the ram pressure of infall can confine the bubbles around high-redshift dwarf galaxies with circular velocities v_c>52 km/s. We can expect high metal and mass ejection efficiencies, and moderate energy transport efficiencies in halos with v_c~30-50 km/s and f*~0.01 as well as in halos with v_c~100 km/s and f*>>0.01. Such haloes collapse successively from 1-2 sigma peaks in LambdaCDM Gaussian density perturbations as time progresses. These dwarf galaxies can probably enrich low and high-density regions of intergalactic space with metals to 10^-3-10^-2 Zsun as they collapse at z~8 and z<5 respectively. They also may be able to provide adequate turbulent energy to prevent the collapse of other nearby halos, as well as to significantly broaden Lyman-alpha absorption lines to v_rms~20-40 km/s. We compute the timescales for the next starbursts if gas freely falls back after a starburst, and find that, for star formation efficiencies as low as f*<0.01, the next starburst should occur in less than half the Hubble time at the collapse redshift. This suggests that episodic star formation may be ubiquitous in dwarf galaxies.

We present a library of 6410 synthetic spectra with resolution Lambda/dLambda = 250,000 based on the revised Kurucz 1993 model atmospheres. The library covers the wavelength range 3000 - 10,000 AA with 54 values of effective temperature in the range 5250 - 50,000 K, 11 values of log surface gravity between 0.0 and 5.0 and 19 metallicities in the range -5.0 to 1.0. We find that, with a few caveats, the library compares well with both the original 20 AA Kurucz spectra and also with observed spectra. The library is intended for use in population synthesis and physical parameterisation of stellar spectra. We assess the suitability of the library for these tasks.

We present estimates of cosmological parameters from the application of the Karhunen-Loeve transform to the analysis of the 3D power spectrum of density fluctuations using Sloan Digital Sky Survey galaxy redshifts. We use Omega_m*h and f_b = Omega_b/Omega_m to describe the shape of the power spectrum, sigma8 for the (linearly extrapolated) normalization, and beta to parametrize linear theory redshift space distortions. On scales k < 0.16 h/Mpc, our maximum likelihood values are Omega_m*h = 0.264 +/-0.043, f_b = 0.286 +/- 0.065, sigma8 = 0.966 +/- 0.048, and beta = 0.45 +/- 0.12. When we take a prior on Omega_b from WMAP, we find Omega_m*h = 0.207 +/- 0.030, which is in excellent agreement with WMAP and 2dF. This indicates that we have reasonably measured the gross shape of the power spectrum but we have difficulty breaking the degeneracy between Omega_m*h and f_b because the baryon oscillations are not resolved in the current spectroscopic survey window function.

We use a probabilistic method to compute the propagation of an ionization front corresponding to the re-ionization of the intergalactic medium in a LCDM cosmology, including both hydrogen and helium. The effects of radiative transfer substantially boost the temperature of the ionized gas over the case of uniform re-ionization. The resulting temperature-density relation of the ionized gas is both non-monotonic and multiple-valued, reflecting the non-local character of radiative transfer and suggesting that a single polytropic relation between local gas density and temperatue is a poor description of the thermodynamic state of baryons in the post-reionization universe.

The distribution in color and absolute magnitude is presented for 55,158 galaxies taken from the Sloan Digital Sky Survey in the redshift range $0.08<z<0.12$, as a function of galaxy number overdensity in a line-of-sight cylinder of transverse radius $1 h^{-1} \mathrm{Mpc}$. In all environments, bulge-dominated galaxies (defined to be those with radial profiles best fit with large S\'ersic indices) form a narrow, well defined color--magnitude relation. Although the most luminous galaxies reside preferentially in the highest density regions, there is only a barely detectable variation in the color (zero-point) or slope of the color--magnitude relation ($<0.02 \mathrm{mag}$ in $^{0.1}[g-r]$ or $[B-V]$). These results constrain variations with environmental density in the ages or metallicities of typical bulge-dominated galaxies to be under 20 percent.

We examine the possible effects of UV background fluctuations on the pixel flux power spectrum and auto-correlation function of the LyA forest due to a finite number of sources in an attenuating medium. We consider scenarios in which QSO sources dominate the contribution to the UV background. To estimate their contribution, we use the QSO luminosity functions from the 2dF and Sloan QSO surveys. We estimate self-consistent values for the attenuation length at the Lyman edge through the Intergalactic Medium using Particle Mesh simulations of the LyA forest, normalised by the measured mean LyA flux. We examine the convergence properties of the flux power spectrum and auto-correlation function under differing assumptions regarding pressure-smoothing. Convergence to better than 10% in the flux power spectrum at proper wavenumbers k < 0.015s/km requires a comoving resolution of 30-60kpc/h in a comoving box of size 25Mpc/h at z = 5, with the requirements becoming more severe at lower redshifts. We find much better covergence properties for the relative effects of the UV background fluctuations on the flux power spectrum. The background fluctuations increase the large-scale power and suppress the power at intermediate scales. At z < 4, the effect is only at the few percent level. By z > 5, however, the large-scale power is boosted by more than 50%, suggesting the flux power spectrum may serve as a useful tool for distinguishing QSO-dominated UV background scenarios from those dominated by galaxies.

Numerical hydrodynamical simulations have proven a successful means of reproducing many of the statistical properties of the LyA forest as measured in high redshift (z > 4) quasar spectra. The source of ionization of the Intergalactic Medium (IGM), however, remains unknown. We investigate how the LyA forest may be used to probe the nature of the sources. We show that the attenuation of Lyman continuum photons by the IGM depends sensitively on the emissivity of the sources, permitting a strong constraint to be set on the required emissivity to match the measured values of the mean IGM LyA optical depth. We also investigate the effect of fluctuations in the UV background. We derive the distribution function of the background radiation field produced by discrete sources in an infinite universe, including the effects of attenuation by an intervening absorbing medium. We show that for z > 5, the fluctuations boost the mean LyA optical depth in a scenario in which QSO sources dominate the UV background. The fluctuations will also result in large spatial correlations in the ionization level of the IGM at high redshifts, providing a means of discriminating between scenarios in which stars and galaxies dominate the UV background vs a QSO-dominated background.

We present a determination of the `Cosmic Optical Spectrum' of the Universe, i.e. the ensemble emission from galaxies, as determined from the red-selected Sloan Digital Sky Survey main galaxy sample and compare with previous results of the blue-selected 2dF Galaxy Redshift Survey. Broadly we find good agreement in both the spectrum and the derived star-formation histories. If we use a power-law star-formation history model where star-formation rate $\propto (1+z)^\beta$ out to z=1, then we find that $\beta$ of 2 to 3 is still the most likely model and there is no evidence for current surveys missing large amounts of star formation at high redshift. In particular `Fossil Cosmology' of the local universe gives measures of star-formation history which are consistent with direct observations at high redshift. Using the photometry of SDSS we are able to derive the cosmic spectrum in absolute units (i.e.$ W \AA$^{-1}$ Mpc$^{-3}$) at 2--5\AA resolution and find good agreement with published broad-band luminosity densities. For a Salpeter IMF the best fit stellar mass/light ratio is 3.7--7.5 $\Msun/\Lsun$ in the r-band (corresponding to $\omstars h = 0.0025$--0.0055) and from both the stellar emission history and the H$\alpha$ luminosity density independently we find a cosmological star-formation rate of 0.03--0.04 h $\Msun$ yr$^{-1}$ Mpc$^{-3}$ today.

Using a catalog of 147,986 galaxy redshifts and fluxes from the Sloan Digital Sky Survey (SDSS) we measure the galaxy luminosity density at z=0.1 in five optical bandpasses corresponding to the SDSS bandpasses shifted to match their restframe shape at z=0.1. We denote the bands {0.1}{u}, {0.1}{g}, {0.1}{r}, {0.1}{i}, {0.1}{z}, with \lambda_{eff} = [3216, 4240, 5595, 6792, 8111] Angstroms respectively. We use a maximum likelihood method which allows for a general form for the shape of the luminosity function, simple luminosity and number evolution, incorporates flux uncertainties, and accounts for the flux limits of the survey. We find luminosity densities at z=0.1 in absolute AB magnitudes in a Mpc^3 of [-14.10 \pm 0.15, -15.18 \pm 0.03, -15.90 \pm 0.03, -16.24 \pm 0.03, -16.56 \pm 0.02] in [{0.1}{u}, {0.1}{g}, {0.1}{r}, {0.1}{i}, {0.1}{z}], respectively, using \Omega_0 =0.3, \Omega_\Lambda=0.7, and h=1, and using Petrosian magnitudes. Similar results are obtained using Sersic model magnitudes, suggesting that flux from outside the Petrosian apertures is not a major correction. In the {0.1}{r} band, the best fit Schechter function to our results has \phi_\ast = (1.49 \pm 0.04) \times 10^{-2} h^3 Mpc^{-3}, M_\ast - 5\log_{10} h = -20.44 \pm 0.01, and \alpha = -1.05\pm 0.01. In solar luminosities, the luminosity density in {0.1}{r} is (1.84 \pm 0.04) h 10^8 L_{{0.1}{r},\odot} Mpc^{-3}. Our results are consistent with other estimates of the luminosity density, from the Two-degree Field Galaxy Redshift Survey and the Millenium Galaxy Catalog. They represent a substantial change (\sim 0.5 mag) from earlier SDSS luminosity density results based on commissioning data, almost entirely because of the inclusion of evolution in the luminosity function model.

We present initial results for counts in cells statistics of the angular distribution of galaxies in early data from the Sloan Digital Sky Survey (SDSS). We analyze a rectangular stripe $2.5^\circ$ wide, covering approximately 160 sq. degrees, containing over $10^6$ galaxies in the apparent magnitude range $18 < r^\prime < 22$, with areas of bad seeing, contamination from bright stars, ghosts, and high galactic extinction masked out. This survey region, which forms part of the SDSS Early Data Release, is the same as that for which two-point angular clustering statistics have recently been computed. The third and fourth moments of the cell counts, $s_3$ (skewness) and $s_4$ (kurtosis), constitute the most accurate measurements to date of these quantities (for $r^\prime < 21$) over angular scales $0.015^\circ-0.3^\circ$. They display the approximate hierarchical scaling expected from non-linear structure formation models and are in reasonable agreement with the predictions of $\Lambda$-dominated cold dark matter models with galaxy biasing that suppresses higher order correlations at small scales. The results are in general consistent with previous measurements in the APM, EDSGC, and Deeprange surveys. These results suggest that the SDSS imaging data are free of systematics to a high degree and will therefore enable determination of the skewness and kurtosis to 1% and less then 10%, as predicted by Colombi, Szapudi, & Szalay (1998).

We present measurements of parameters of the 3-dimensional power spectrum of galaxy clustering from 222 square degrees of early imaging data in the Sloan Digital Sky Survey. The projected galaxy distribution on the sky is expanded over a set of Karhunen-Loeve eigenfunctions, which optimize the signal-to-noise ratio in our analysis. A maximum likelihood analysis is used to estimate parameters that set the shape and amplitude of the 3-dimensional power spectrum. Our best estimates are Gamma=0.188 +/- 0.04 and sigma_8L = 0.915 +/- 0.06 (statistical errors only), for a flat Universe with a cosmological constant. We demonstrate that our measurements contain signal from scales at or beyond the peak of the 3D power spectrum. We discuss how the results scale with systematic uncertainties, like the radial selection function. We find that the central values satisfy the analytically estimated scaling relation. We have also explored the effects of evolutionary corrections, various truncations of the KL basis, seeing, sample size and limiting magnitude. We find that the impact of most of these uncertainties stay within the 2-sigma uncertainties of our fiducial result.

Numerical hydrodynamical simulations are used to predict the expected absorption properties of the Lyman-Alpha forest for a variety of Cold Dark Matter dominated cosmological scenarios: CHDM, OCDM, LCDM, SCDM, and tCDM. Synthetic spectra are constructed duplicating the resolution, signal-to-noise ratio, and wavelength coverage of several published high resolution spectra, and their statistical properties compared on the basis of the flux distribution of the spectra, the distribution of coefficients in a wavelet decomposition of the spectra, and the distributions of absorption line profile parameters. Agreement between the measured and predicted cumulative distributions is found at the few to several percent level. The best-fitting models to the flux distribution correspond to normalizations on the scale of the cosmological Jeans length of 1.3 < sigma_J < 1.7 at z=3. No single model provides an acceptable match to all the distributions. Larger median Doppler parameters are found in the measured spectra than predicted by all but the lowest normalization models (CHDM and tCDM), which provide poor fits to the flux distributions. The discrepancy in Doppler parameters is particularly large for absorption systems optically thin at the Lyman-Alpha line-centre. This may indicate the need to introduce additional energy injection throughout the IGM, as may be provided by late HeII reionization (z_HeII~3.5) or supernovae-driven winds from young galaxies. The models require a hydrogen ionization rate at redshifts 1.7<z<3.5 within a factor of 2 of that predicted from QSOs alone as the sources of the UV photoionization background, although with a slower rate of decline with redshift at z>3.5 than predicted from current QSO counts.

Numerical hydrodynamical simulations have proven a successful means of reproducing many of the statistical properties of the Lyman-Alpha forest as measured in high redshift quasar spectra. Pseudo-hydrodynamical methods based only on simulating the dark matter component have been claimed to yield a comparable level of success. We investigate the degree to which two pseudo-methods, with and without allowing for a pseudo-gas pressure, are able to match the predictions of fully hydrodynamical plus dark matter simulations. We also address the requirements for convergence to the statistics of the spectra and the inferred properties of the Lyman-Alpha forest as a function of resolution and box size. Generally we find it is possible to reach agreement with full hydrodynamic simulations at the 10% level in the cumulative distributions of the flux and absorption line parameter statistics for readily achievable particle and grid numbers, but difficult to do much better.

It is shown how wavelets may be used to analyse the absorption properties of the Lya forest. The Discrete Wavelet Transform of a QSO spectrum is used to decompose the light fluctuations that comprise the forest into orthogonal wavelets. It is demonstrated that most of the signal is carried by the moderate to lower frequency wavelets in high resolution spectra, and that a statistically acceptable description of even high signal-to-noise spectra is provided by only a fraction (10-30%) of the wavelets. The distributions of the wavelet coefficients provide a statistical basis for discriminating between different models of the Lya forest. The method is illustrated using the measured spectrum of Q1937-1009. The procedure described is readily automated and may be used to process both measured spectra and the large number of spectra generated by numerical simulations, permitting a fair comparison between the two.

The emission of 21-cm radiation from a neutral intergalactic medium (IGM) at high redshift is discussed in connection with the thermal and ionization history of the universe. The physical mechanisms that make such radiation detectable against the cosmic microwave background include Ly_alpha coupling of the hydrogen spin temperature to the kinetic temperature of the gas and preheating of the IGM by the first generation of stars and quasars. Three different signatures are investigated in detail: (a) the fluctuations in the redshifted 21-cm emission induced by the gas density inhomogeneities that develop at early times in cold dark matter (CDM) dominated cosmologies; (b) the sharp absorption feature in the radio sky due to the rapid rise of the Ly_alpha continuum background that marks the birth of the first UV sources in the universe; and (c) the 21-cm emission and absorption shells that are generated on several Mpc scales around the first bright quasars. Future radio observations with projected facilities like the Giant Metrewave Radio Telescope and the Square Kilometer Array may shed light on the power spectrum of density fluctuations at z>5, and map the end of the "dark ages", i.e. the transition from the post-recombination universe to one populated with radiation sources.

We investigate the properties of the Lyman alpha forest as predicted by numerical simulations for a range of currently viable cosmological models. This is done in order to understand the dependencies of the forest on cosmological parameters. Focusing on the redshift range from two to four, we show that: (1) most of the evolution in the distributions of optical depth, flux and column density can be understood by simple scaling relations, (2) the shape of optical depth distribution is a sensitive probe of the amplitude of density fluctuations on scales of a few hundred kpc, (3) the mean of the b distribution (a measure of the width of the absorption lines) is also very sensitive to fluctuations on these scales, and decreases as they increase. We perform a preliminary comparison to observations, where available. A number of other properties are also examined, including the evolution in the number of lines, the two-point flux distribution and the HeII opacity.

We show how the investigation of the redshifted 21-cm radiation can give insight into the development of structures in the early universe (at redshifts z>5). In particular we investigate: the epoch of the first light; the fluctuations in the redshifted 21-cm emission induced by the density inhomogeneities in CDM dominated universes; the emission and absorption shells that are generated around the first bright quasars. Such features can be observed with the next generation radio facilities.

We find statistically significant correlations in the cosmological matter power spectrum over the full range of observable scales. While the correlations between individual modes are weak, the band-averaged power spectrum shows strong non-trivial correlations. The correlations are significant when the modes in either one or both bands are in the non-linear regime, and approach 100% for pairs of bands in which all the modes are non-linear. The correlations are weaker, but not absent, when computed in redshift space. Since estimates of the power spectrum from galaxy surveys require band-averaging, the correlations must be taken into account when comparing a measured power spectrum with theoretical models.

The comparison of quasar absorption spectra with numerically simulated spectra from hierarchical cosmological models of structure formation promises to be a valuable tool to discriminate among these models. We present simulation results for the column density, Doppler b parameter, and optical depth probability distributions for five popular cosmological models.

Prior to the epoch of full reionization, the intergalactic medium and gravitationally collapsed systems will be detectable in 21-cm radiation. Physical mechanisms that would produce a 21-cm signature are discussed. These include Lya coupling of the hydrogen spin temperature to the kinetic temperature of the gas resulting from the radiation by an early generation of stars, preheating by soft x-rays from collapsing dark matter halos, and preheating by ambient Lya photons. A patchwork of either 21-cm emission, or absorption against the Cosmic Microwave Background, will result. Large radio telescopes like the Giant Metre Wavelength Telescope (GMRT) or a Square Kilometre Array Radio Telescope (SKA) offer the prospect of measuring this signature, and so detecting the transitional epoch from a dark universe to one with light.

We investigate the consequences of a non-negligible baryon fraction for models of structure formation in Cold Dark Matter dominated cosmologies, emphasizing in particular the existence of oscillations in the present-day matter power spectrum. These oscillations are the remnants of acoustic oscillations in the photon-baryon fluid before last scattering. For acceptable values of the cosmological and baryon densities, the oscillations modulate the power by up to 10%, with a `period' in spatial wavenumber which is close to Delta k approximately 0.05/ Mpc. We study the effects of nonlinear evolution on these features, and show that they are erased for k > 0.2 h/ Mpc. At larger scales, the features evolve as expected from second-order perturbation theory: the visibility of the oscillations is affected only weakly by nonlinear evolution. No realistic CDM parameter combination is able to account for the claimed feature near k = 0.1 h/ Mpc in the APM power spectrum, or the excess power at 100 Mpc/h wavelengths quoted by several recent surveys. Thus baryonic oscillations are not predicted to dominate existing measurements of clustering. We examine several effects which may mask the features which are predicted, and conclude that future galaxy surveys may be able to detect the oscillatory features in the power spectrum provided baryons comprise more than 15% of the total density, but that it will be a technically challenging achievement.

In this paper we review the importance of the Lyman alpha forest as a probe of structure formation in the universe. We first discuss the statistics used to describe the Lyman alpha forest and the numerical techniques used to produce simulated spectra of the forest from a given cosmological model. We then discuss the physical picture of the absorbing structures that emerges from these numerical simulations. Finally, we comment on how two of the statistics, the slope of the column density distribution and the b parameter distribution, may be used to constrain competing cosmologies.

We discuss the origin and physical nature of the Lya forest absorption systems as found in hydrodynamical simulations of the Intergalactic Medium in a standard Cold Dark Matter cosmology (Omega=1, H0=50 km/s/Mpc, sigma_8=0.7). The structures of the systems that give rise to the Lya forest span a wide range in morphologies, depending on the density contrast. The absorption properties of the forest clouds correlate strongly with those of the underlying physical systems from which they arise. The highest column density systems (log N_HI > 15), correspond to highly overdense spheroidal structures, moderate column density systems (13 < log N_HI < 14), correspond to filaments, and the lowest density absorption systems originate from discrete fluctuations within underdense regions a few megaparsecs across, cosmic minivoids. Most of the intergalactic HeII opacity arises from these underdense regions. We are able to account for the distribution of optical depths in our synthesized spectra entirely by absorption due to discrete systems. We find that virtually all the baryons in the simulation fragment into structures that we can identify with discrete absorption lines, with at most 5% remaining in a smoothly distributed component (the Gunn-Peterson effect). We compare our results with the cloud ionization parameters inferred from Keck HIRES measurements of carbon and silicon in the Lya forest. Combining with constraints imposed by measurements of the mean intergalactic HI opacity, we find 0.03 < Omega_b < 0.08 and 0.3 < (Gamma_HI/ 10^-12 s^-1) < 1 at z=3-3.5.

We simulate the Lya forest in a standard CDM universe using a 2-level hierarchical grid code to evolve the dark and baryonic matter components self-consistently. We solve the time-dependent ionization equations for hydrogen and helium, adopting the Haardt & Madau (1996) estimate for the metagalactic UV radiation background. We compare our simulation results with the measured properties of the Lya forest by constructing synthetic spectra which we analyze in a manner similar to the method used by observers. The HI column density and Doppler parameter distributions we obtain agree closely with those measured by the Keck HIRES and earlier high spectral resolution observations over the column density range 10^{12} < NHI < 10^{16}. In particular, we find a power-law column density distribution persists to the lowest values reported from the HIRES measurements, in agreement with the incompleteness-corrected observations. We find evolution in the cloud number density and opacity comparable to the observed evolution. We also compare with measured values of the intergalactic HeII opacity. Our results require a HeII ionizing background lower than the Haardt & Madau estimate by a factor of 4, corresponding to a soft intrinsic QSO spectrum of alpha_Q = 1.8 - 2.

The Gunn-Peterson effect, absorption of Lya photons by a homogeneous component of the intergalactic medium (IGM), potentially provides a test of Big Bang Nucleosynthesis (BBN). With a lower limit on the UV radiation field estimated from the contribution due to QSOs, a measurement of the Lya opacity of the intergalactic medium would permit the derivation of a lower bound to the baryonic density of the universe. The effect, however, has continually eluded a convincing detection, both in HI and HeII, despite extensive searches. Recent cosmological hydrodynamical simulations of structure formation in the intergalactic medium suggest an explanation for its absence. In a Cold Dark Matter dominated cosmology, the fragmentation of the baryons is nearly complete, leaving a negligible remnant to comprise a smoothly distributed component. The fragmentation extends even into regions that are underdense, where it gives rise to most of the optically thin HI systems and nearly all of the HeII systems, both thin and saturated. The result is a Lya opacity from a smooth IGM that is suppressed by over two orders of magnitude from the BBN value.

We investigate the 21-cm signature that may arise from the intergalactic medium (IGM) prior to the epoch of full reionization (z>5). In scenarios in which the IGM is reionized by discrete sources of photoionizing radiation, the neutral gas which has not yet been engulfed by an H II region may easily be preheated to temperatures well above that of the cosmic background radiation (CBR), rendering the IGM invisible in absorption against the CBR. We identify three possible preheating mechanisms: (1) photoelectric heating by soft X-rays from QSOs, (2) photoelectric heating by soft X-rays from early galactic halos, and (3) resonant scattering of the continuum UV radiation from an early generation of stars. In the presence of a sufficiently strong ambient flux of Lyman-alpha photons, the hyperfine transition in the warmed H I will be excited. A beam differencing experiment would detect a patchwork of emission, both in frequency and in angle across the sky. This patchwork could serve as a valuable tool for understanding the epoch, nature, and sources of the reionization of the universe, and their implications for cosmology. We demonstrate that isolated QSOs will produce detectable signals at meter wavelengths within their ``spheres of influence'' over which they warm the IGM. As a result of the redshifted 21-cm radiation emitted by warm H I bubbles, the spectrum of the radio extragalactic background will display frequency structure with velocity widths up to 10,000 km/s. Broad beam observations would reveal corresponding angular fluctuations in the sky intensity with (delta T/T)=1E-3 on degree-scales. Radio measurements near 235 and 150 MHz, as will be possible in the near future using the Giant Metrewave Radio Telescope, may provide the first detection of a neutral IGM at 5<z<10.

Counts in cells are used to analyse the higher order properties of the statistics of the EDSGC survey. The probability distribution is obtained from an equal area projection source catalog with infinite oversampling over the range $0.015^\circ-2^\circ$. The factorial moments of the resulting distribution and the $s_N$'s characterizing the non-Gaussian nature of the distribution are extracted. These results are compared to previous results from the APM survey, and to theoretical results from perturbation theory. The deprojected 3D values corresponding to the $s_N$'s are also determined. We find that the 3D values match the scaling relation for strongly nonlinear clustering found in N-body simulations remarkably well, suggesting that the galaxies are reliable tracers of the underlying mass distribution.

Motivated by the observations of high Faraday rotation measures measured in cooling flow clusters we propose a model relevant to plasmas with comparable thermal and magnetic pressures. Magnetic field reconnection may play a major role in changing the topology of the magnetic field in the central cooling flow regions. The effect of the topology change is that cool flux loops can reconnect to hot flux loops that are connected to the overall thermal reservoir of the cluster. There can be a rapid recycling of mass between hot and cold phases on a time scale of 3 x 10^8-10^9 yr which may reduce the inferred inflow and mass condensation rates by at least an order of magnitude. A central multiphase medium is a direct consequence of such a model. Throughout the cooling flow the filling factor of the hot loops (T > 2 x 10^7 K) is of order unity. The filling factor of the cool loops (T < 2 x 10^7 K) is 0.1-1% with a corresponding mass fraction of cold phase of 1-10%. A crucial parameter is the coherence length of the field relative to the cooling radius and the distribution of field energy with scale. When the cooling radius is greater than the field coherence length then cooling flows proceed as usual. When the coherence length is greater than the central cooling radius, however, the thermal energy of the reservoir can be tapped and the mass condensation rates may be very significantly reduced. Three additional conditions must be satisfied: I. Cold loops must be able to fall at least as far as the mean distance between hot loops in a cooling time; II. Loops must enter an evaporative phase on reconnecting; and III. A sufficient number of hot loops penetrate the cold phase region to power the radiative losses.

Soon after the first QSO was identified, Gunn & Peterson searched for the expected characteristic absorption trough on the blueward side of Lya in the spectrum of the QSO due to an Intergalactic Medium (IGM). They failed to find it, placing a constraint on the density of neutral hydrogen in the IGM that was less than 1 part in 10^5 of that residing in galaxies, and concluded that the IGM must be highly ionized. Soon afterwards absorption by Lya was detected in the IGM; not by a diffuse component, but by a clumpy component of intergalactic gas clouds, the Lya forest. The goal then became to search for `excess' absorption beyond that expected from the forest. No clear absorption by a diffuse HI component, however, was ever detected. The results of recent numerical hydrodynamics computations of the formation of the Lya forest appear to indicate that the division between a clumpy component and a diffuse one may be inappropriate. We find that in a CDM-dominated cosmology, no substantial diffuse medium should be expected. Instead, the medium condenses into a network of complex structures that reveal themselves as discrete absorption systems in the spectra of QSOs. The lowest column density lines arise from the fine structure in minivoids -- small regions with densities below the cosmic mean. These results suggest that the long sought for diffuse HI Gunn-Peterson effect may not exist.

We present a novel technique for calculating \Lya forest correlations based on cell counts. It is applied to the line lists from 7 QSOs observed at high resolution ($\Delta v<25\kms$). Two spectra (Q0055$-$259 and Q0014$+$813) appear to be sufficiently free of biases to obtain meaningful estimates. We find for both positive correlations, with a maximum of $0.5-1$, on the scale of $0.5-3 h^{-1}$ Mpc (comoving), or $100-600\kms$, which is consistent with the primordial power spectrum inferred from optically-selected galaxy surveys. Strong evidence for anti-correlation on the scale of $3-6 h^{-1}$ Mpc is also found. If this first detection of anti-correlations is physical, additional factors to gravity may play a role in determining the clustering of the \Lya forest on comoving scales $> 3h^{-1}\Mpc$.}

We present a novel technique for calculating the two-point autocorrelation function of the Lyman-alpha forest based on the relation between the two-point correlation function and the Neighbor Probability Distribution Functions. The technique appears to reduce the scatter in estimates of the correlation function by a factor of about two from the traditional pair-counting method. We apply the technique to the Lyman-alpha forest line lists determined from the spectra of seven z > 2 QSOs observed at high resolution ( < 25 km/s ). Of these, only two spectra, those of Q0055-259 and Q0014+813, appear to be sufficiently free of systematics to obtain meaningful estimates of the correlation function. We find positive correlations, with a maximum amplitude of 0.5 - 1, on the scale of 0.5 - 3 h^{-1} Mpc (comoving), or 100 - 600 km/s, in the forests of both QSOs. The technique also finds strong evidence for anticorrelation on the scale of 3 - 6 h^{-1} Mpc. The strength of the positive correlations is comparable to that predicted from the primordial power spectrum inferred from optically-selected galaxy redshift surveys. If the anticorrelations are physical, it becomes unclear whether the detected clustering is consistent with current models of structure formation with a homogeneous photoionizing UV metagalactic background. Instead, the anti-clustering may require inhomogeneity in the UV background, and possibly in the process of reionization itself.

Results are presented for one-dimensional numerical hydrodynamics computations of the structure and evolution of Lya forest clouds gravitationally confined by dark matter minihalos. The clouds are developed from linear perturbations at high redshift and exposed to either a QSO- or galaxy-dominated metagalactic radiation field at moderate redshifts. While the emphasis is on spherical systems, slab symmetry is also considered. Three zones may be identified in a collapsed cloud: (1) a quasi-hydrostatic core in thermal equilibrium, (2) a nonhydrostatic intermediate zone out of thermal equilibrium, and (3) a cosmological accretion layer joining onto the Hubble expansion. Most of the measured Lya forest column densities arise in the intermediate zone. The development of the core would result in a flattening in the column density distribution near an HI column density of 10**15-10**16 cm**-2. The cloud diameters corresponding to an HI column density of 10**14 cm**-2 lie in the range 10-60 kpc, while systems with column densities exceeding 10**15 cm**-2 have diameters smaller than 10 kpc. Systems with circular velocities exceeding 50 km/s result in clouds which contract until they become Jeans unstable and collapse. The critical column density for collapse is 10**17-10**18 cm**-2. A mild correlation of Doppler parameter with neutral hydrogen column density is found in several models for systems with column densities less than 10**13.5 cm**-2, with Doppler parameters occurring as low as b > 20 km/s for 10**13 cm**-2 column density systems. No lines with b < 15 km/s are found.