We compare a sample of five high-resolution, high S/N Ly$\alpha$ forest spectra of bright $6<z \lesssim 6.5$ QSOs aimed at spectrally resolving the last remaining transmission spikes at $z>5$ with those obtained from mock absorption spectra from the Sherwood and Sherwood-Relics suites of hydrodynamical simulations of the intergalactic medium (IGM). We use a profile fitting procedure for the inverted transmitted flux, $1-F$, similar to the widely used Voigt profile fitting of the transmitted flux $F$ at lower redshifts, to characterise the transmission spikes that probe predominately underdense regions of the IGM. We are able to reproduce the width and height distributions of the transmission spikes, both with optically thin simulations of the post-reionization Universe using a homogeneous UV background and full radiative transfer simulations of a late reionization model. We find that the width of the fitted components of the simulated transmission spikes is very sensitive to the instantaneous temperature of the reionized IGM. The internal structures of the spikes are more prominant in low temeperature models of the IGM. The width distribution of the observed transmission spikes, which require high spectral resolution ($\leq $ 8 km/s) to be resolved, is reproduced for optically thin simulations with a temperature at mean density of $T_0= (11000 \pm 1600,10500\pm 2100,12000 \pm 2200)$ K at $z= (5.4,5.6,5.8)$. This is weakly dependent on the slope of the temperature-density relation, which is favoured to be moderately steeper than isothermal. In the inhomogeneous, late reionization, full radiative transfer simulations where islands of neutral hydrogen persist to $z\sim5.3$, the width distribution of the observed transmission spikes is consistent with the range of $T_0$ caused by spatial fluctuations in the temperature-density relation.

We use state of the art hydrodyamical simulations from the Sherwood, EAGLE and Illustris projects to examine the signature of $M_{\rm z=0}\simeq 10^{14}M_{\odot}$ protoclusters observed in Ly-$\alpha$ absorption at $z\simeq 2.4$. We find there is a weak correlation between the mass overdensity, $\delta_{\rm m}$, and the Ly-$\alpha$ effective optical depth relative to the mean, $\delta_{\tau_\textrm{eff}}$, averaged over $15~h^{-1}\rm\,cMpc$ scales, although scatter in the $\delta_{\rm m}$--$\delta_{\tau_\textrm{eff}}$ plane means it is not possible to uniquely identify large scale overdensities with strong Ly-$\alpha$ absorption. Although all protoclusters are associated with large scale mass overdensities, most sight lines through protoclusters in a $\sim 10^{6}$ $\rm cMpc^{3}$ volume probe the low column density Ly-$\alpha$ forest. A small subset of sight lines that pass through protoclusters exhibit coherent, strong Ly-$\alpha$ absorption on $15h^{-1}\rm\,cMpc$ scales, although these correspond to a wide range in mass overdensity. Assuming perfect removal of contamination by Ly-$\alpha$ absorbers with damping wings, more than half of the remaining sight lines with $\delta_{\tau_{\rm eff}}>3.5$ trace protoclusters. It is furthermore possible to identify a model dependent $\delta_{\tau_{\rm eff}}$ threshold that selects only protoclusters. However, such regions are rare: excluding absorption caused by damped systems, less than 0.1 per cent of sight lines that pass through a protocluster have $\delta_{\tau_{\rm eff}}>3.5$, meaning that any protocluster sample selected in this manner will also be highly incomplete. On the other hand, coherent regions of Ly-$\alpha$ absorption also provide a promising route for identifying and studying filamentary environments at high redshift.

We present a new investigation of the thermal history of the intergalactic medium (IGM) during and after reionization using the Lyman-$\alpha$ forest flux power spectrum at $4.0\lesssim z\lesssim5.2$. Using a sample of 15 high-resolution spectra, we measure the flux power down to the smallest scales ever probed at these redshifts ($-1\lesssim \log(k/$km$^{-1}$s)$\lesssim -0.7$). These scales are highly sensitive to both the instantaneous temperature of the IGM and the total energy injected per unit mass during and after reionization. We measure temperatures at the mean density of $T_{0}\sim7000$-8000 K, consistent with no significant temperature evolution for redshifts $4.2\lesssim z\lesssim5.0$. We also present the first observational constraints on the integrated IGM thermal history, finding that the total energy input per unit mass increases from $u_{0}\sim4.6$ ${\rm eV}$ $m_{\rm p}^{-1}$ to 7.3 eV $m_{\rm p}^{-1}$ from $z\sim 6$ to $4.2$ assuming a $\Lambda$-CDM cosmology. We show how these results can be used simultaneously to obtain information on the timing and the sources of the reionization process. Our first proof of concept using simplistic models of instantaneous reionization produces results comparable to and consistent with the recent Planck constraints, favoring models with $z_{\rm rei}\sim 8.5^{+1.1}_{-0.8}$.

We present new measurements of the free-streaming of warm dark matter (WDM) from Lyman-$\alpha$ flux-power spectra. We use data from the medium resolution, intermediate redshift XQ-100 sample observed with the X-shooter spectrograph ($z=3 - 4.2$) and the high-resolution, high-redshift sample used in Viel et al. (2013) obtained with the HIRES/MIKE spectrographs ($z=4.2 - 5.4$). Based on further improved modelling of the dependence of the Lyman-$\alpha$ flux-power spectrum on the free-streaming of dark matter, cosmological parameters, as well as the thermal history of the intergalactic medium (IGM) with hydrodynamical simulations, we obtain the following limits, expressed as the equivalent mass of thermal relic WDM particles. The XQ-100 flux power spectrum alone gives a lower limit of 1.4 keV, the re-analysis of the HIRES/MIKE sample gives 4.1 keV while the combined analysis gives our best and significantly strengthened lower limit of 5.3 keV (all 2$\sigma$ C.L.). The further improvement in the joint analysis is partly due to the fact that the two data sets have different degeneracies between astrophysical and cosmological parameters that are broken when the data sets are combined, and more importantly on chosen priors on the thermal evolution. These results all assume that the temperature evolution of the IGM can be modelled as a power law in redshift. Allowing for a non-smooth evolution of the temperature of the IGM with sudden temperature changes of up to 5000K reduces the lower limit for the combined analysis to 3.5 keV. A WDM with smaller thermal relic masses would require, however, a sudden temperature jump of $5000\,K$ or more in the narrow redshift interval $z=4.6-4.8$, in disagreement with observations of the thermal history based on high-resolution resolution Lyman-$\alpha$ forest data and expectations for photo-heating and cooling in the low density IGM at these redshifts.

We present two measurements of the temperature-density relationship (TDR) of the intergalactic medium (IGM) in the redshift range $2.55 < z < 2.95$ using a sample of 13 high-quality quasar spectra and high resolution numerical simulations of the IGM. Our approach is based on fitting the neutral hydrogen column density $N_{HI}$ and the Doppler parameter $b$ of the absorption lines in the \mlya\ forest. The first measurement is obtained using a novel Bayesian scheme which takes into account the statistical correlations between the parameters characterising the lower cut-off of the $b-N_{HI}$ distribution and the power-law parameters $T_0$ and $\gamma$ describing the TDR. This approach yields $T_0/ 10^3\, {\rm K}=15.6 \pm 4.4 $ and $\gamma=1.45 \pm 0.17$ independent of the assumed pressure smoothing of the small scale density field. In order to explore the information contained in the overall $b-N_{HI}$ distribution rather than only the lower cut-off, we obtain a second measurement based on a similar Bayesian analysis of the median Doppler parameter for separate column-density ranges of the absorbers. In this case we obtain $T_0/ 10^3\, {\rm K}=14.6 \pm 3.7$ and $\gamma=1.37 \pm 0.17$ in good agreement with the first measurement. Our Bayesian analysis reveals strong anti-correlations between the inferred $T_0$ and $\gamma$ for both methods as well as an anti-correlation of the inferred $T_0$ and the pressure smoothing length for the second method, suggesting that the measurement accuracy can in the latter case be substantially increased if independent constraints on the smoothing are obtained. Our results are in good agreement with other recent measurements of the thermal state of the IGM probing similar (over-)density ranges.

We present constraints on the masses of extremely light bosons dubbed fuzzy dark matter from Lyman-$\alpha$ forest data. Extremely light bosons with a De Broglie wavelength of $\sim 1$ kpc have been suggested as dark matter candidates that may resolve some of the current small scale problems of the cold dark matter model. For the first time we use hydrodynamical simulations to model the Lyman-$\alpha$ flux power spectrum in these models and compare with the observed flux power spectrum from two different data sets: the XQ-100 and HIRES/MIKE quasar spectra samples. After marginalization over nuisance and physical parameters and with conservative assumptions for the thermal history of the IGM that allow for jumps in the temperature of up to $5000\rm\,K$, XQ-100 provides a lower limit of 7.1$\times 10^{-22}$ eV, HIRES/MIKE returns a stronger limit of 14.3$\times 10^{-22}$ eV, while the combination of both data sets results in a limit of 20 $\times 10^{-22}$ eV (2$\sigma$ C.L.). The limits for the analysis of the combined data sets increases to 37.5$\times 10^{-22}$ eV (2$\sigma$ C.L.) when a smoother thermal history is assumed where the temperature of the IGM evolves as a power-law in redshift. Light boson masses in the range $1-10 \times10^{-22}$ eV are ruled out at high significance by our analysis, casting strong doubts that FDM helps solve the "small scale crisis" of the cold dark matter models.

We study the effect of different feedback prescriptions on the properties of the low redshift ($z\leq1.6$) Ly$\alpha$ forest using a selection of hydrodynamical simulations drawn from the Sherwood simulation suite. The simulations incorporate stellar feedback, AGN feedback and a simplified scheme for efficiently modelling the low column density Ly$\alpha$ forest. We confirm a discrepancy remains between Cosmic Origins Spectrograph (COS) observations of the Ly$\alpha$ forest column density distribution function (CDDF) at $z \simeq 0.1$ for high column density systems ($N_{\rm HI}>10^{14}\rm\,cm^{-2}$), as well as Ly$\alpha$ velocity widths that are too narrow compared to the COS data. Stellar or AGN feedback -- as currently implemented in our simulations -- have only a small effect on the CDDF and velocity width distribution. We conclude that resolving the discrepancy between the COS data and simulations requires an increase in the temperature of overdense gas with $\Delta=4$--$40$, either through additional He$\,\rm \scriptstyle II\ $ photo-heating at $z>2$ or fine-tuned feedback that ejects overdense gas into the IGM at just the right temperature for it to still contribute significantly to the Ly$\alpha$ forest. Alternatively a larger, currently unresolved turbulent component to the line width could resolve the discrepancy.

We compare the low redshift (z ~ 0.1) Lyman-alpha forest from hydrodynamical simulations with data from the Cosmic Origin Spectrograph (COS). We find tension between the observed number of lines with b-parameters in the range 25-45 km/s and the predictions from simulations that incorporate either vigorous feedback from active galactic nuclei or that exclude feedback altogether. The gas in these simulations is, respectively, either too hot to contribute to the Lyman-alpha absorption or too cold to produce the required line widths. Matching the observed b-parameter distribution therefore requires feedback processes that thermally or turbulently broaden the absorption features without collisionally (over-)ionising hydrogen. This suggests the Lyman-alpha forest b-parameter distribution is a valulable diagnostic of galactic feedback in the low redshift Universe. We furthermore confirm the low redshift Lyman-alpha forest column density distribution is better reproduced by an ultraviolet background with an HI photo-ionisation rate a factor 1.5-3 higher than predicted by Haardt & Madau (2012).

We present the Lyman-$\alpha$ flux power spectrum measurements of the XQ-100 sample of quasar spectra obtained in the context of the European Southern Observatory Large Programme "Quasars and their absorption lines: a legacy survey of the high redshift universe with VLT/XSHOOTER". Using $100$ quasar spectra with medium resolution and signal-to-noise ratio we measure the power spectrum over a range of redshifts $z = 3 - 4.2$ and over a range of scales $k = 0.003 - 0.06\,\mathrm{s\,km^{-1}}$. The results agree well with the measurements of the one-dimensional power spectrum found in the literature. The data analysis used in this paper is based on the Fourier transform and has been tested on synthetic data. Systematic and statistical uncertainties of our measurements are estimated, with a total error (statistical and systematic) comparable to the one of the BOSS data in the overlapping range of scales, and smaller by more than $50\%$ for higher redshift bins ($z>3.6$) and small scales ($k > 0.01\,\mathrm{s\,km^{-1}}$). The XQ-100 data set has the unique feature of having signal-to-noise ratios and resolution intermediate between the two data sets that are typically used to perform cosmological studies, i.e. BOSS and high-resolution spectra (e.g. UVES/VLT or HIRES). More importantly, the measured flux power spectra span the high redshift regime which is usually more constraining for structure formation models.

Modern theories of galaxy formation predict that galaxies impact on their gaseous surroundings, playing the fundamental role of regulating the amount of gas converted into stars. While star-forming galaxies are believed to provide feedback through galactic winds, Quasi-Stellar Objects (QSOs) are believed instead to provide feedback through the heat generated by accretion onto a central supermassive black hole. A quantitative difference in the impact of feedback on the gaseous environments of star-forming galaxies and QSOs has not been established through direct observations. Using the Sherwood cosmological simulations, we demonstrate that measurements of neutral hydrogen in the vicinity of star-forming galaxies and QSOs during the era of peak galaxy formation show excess LyA absorption extending up to comoving radii of about 150 kpc for star-forming galaxies and 300 - 700 kpc for QSOs. Simulations including supernovae-driven winds with the wind velocity scaling like the escape velocity of the halo account for the absorption around star-forming galaxies but not QSOs.

In these proceedings we describe the WEAVE-QSO survey, which will observe around 400,000 high redshift quasars starting in 2018. This survey is part of a broader WEAVE survey to be conducted at the 4.2m William Herschel Telescope. We will focus on chiefly on the science goals, but will also briefly summarise the target selection methods anticipated and the expected survey plan. Understanding the apparent acceleration in the expansion of the Universe is one of the key scientific challenges of our time. Many experiments have been proposed to study this expansion, using a variety of techniques. Here we describe a survey that can measure this acceleration and therefore help elucidate the nature of dark energy: a survey of the Lyman-alpha forest (and quasar absorption in general) in spectra towards z>2 quasars (QSOs). Further constraints on neutrino masses and warm dark matter are also anticipated. The same data will also shed light on galaxy formation via study of the properties of inflowing/outflowing gas associated with nearby galaxies and in a cosmic web context. Gas properties are sensitive to density, temperature, UV radiation, metallicity and abundance pattern, and so constraint galaxy formation in a variety of ways. WEAVE-QSO will study absorbers with a dynamic range spanning more than 8 orders of magnitude in column density, their thermal broadening, and a host of elements and ionization species. A core principal of the WEAVE-QSO survey is the targeting of QSOs with near 100% efficiency principally through use of the J-PAS (r < 23.2) and Gaia (r < 20) data.

At low densities the standard ionisation history of the intergalactic medium (IGM) predicts a decreasing temperature of the IGM with decreasing density once hydrogen (and helium) reionisation is complete. Heating the high-redshift, low-density IGM above the temperature expected from photo-heating is difficult, and previous claims of high/rising temperatures in low density regions of the Universe based on the probability density function (PDF) of the opacity in Lyman-$\alpha$ forest data at $2<z<4$ have been met with considerable scepticism, particularly since they appear to be in tension with other constraints on the temperature-density relation (TDR). We utilize here an ultra-high signal-to-noise spectrum of the QSO HE0940-1050 and a novel technique to study the low opacity part of the PDF. We show that there is indeed evidence (at 90% confidence level) that a significant volume fraction of the under-dense regions at $z \sim 3$ has temperatures as high or higher than those at densities comparable to the mean and above. We further demonstrate that this conclusion is nevertheless consistent with measurements of a slope of the TDR in over-dense regions that imply a decreasing temperature with decreasing density, as expected if photo-heating of ionised hydrogen is the dominant heating process. We briefly discuss implications of our findings for the need to invoke either spatial temperature fluctuations, as expected during helium reionization, or additional processes that heat a significant volume fraction of the low-density IGM.

We introduce a new set of large scale, high resolution hydrodynamical simulations of the intergalactic medium: the Sherwood simulation suite. These are performed in volumes 10^3-160^3 h^-3 comoving Mpc^{3}, span almost four orders of magnitude in mass resolution with up to 17.2 billion particles, and employ a variety of physics variations including warm dark matter and galactic outflows. We undertake a detailed comparison of the simulations to high resolution, high signal-to-noise observations of the Lyman-alpha forest over the redshift range 2 < z < 5. The simulations are in very good agreement with the observational data, lending further support to the paradigm that the Lyman-alpha forest is a natural consequence of the web-like distribution of matter arising in LCDM cosmological models. Only a small number of minor discrepancies remain with respect to the observational data. Saturated Lyman-alpha absorption lines with column densities N_HI > 10^14.5 cm^-2 at 2 < z < 2.5 are underpredicted in the models. An uncertain correction for continuum placement bias is required to match the distribution and power spectrum of the transmitted flux, particularly at z > 4. Finally, the temperature of intergalactic gas in the simulations may be slightly too low at z=2.7 and a flatter temperature-density relation is required at z=2.4, consistent with the expected effects of non-equilibrium ionisation during He-II reionisation.

We present models of low- and high-ionization metal-line absorbers (O I, C II, C IV and Mg II) during the end of the reionization epoch, at z ~ 6. Using four cosmological hydrodynamical simulations with different feedback schemes (including the Illustris and Sherwood simulations) and two different choices of hydro-solver, we investigate how the overall incidence rate and equivalent width distribution of metal-line absorbers varies with the galactic wind prescription. We find that the O I and C II absorbers are reasonably insensitive to the feedback scheme. All models, however, struggle to reproduce the observations of C IV and Mg II, which are probing down to lower overdensities than O I and C II at z ~ 6, suggesting that the metals in the simulations are not being transported out into the IGM efficiently enough. The situation is improved but not resolved if we choose a harder (but still reasonable) and/or (locally) increased UV background at z ~ 6.

We use cosmological hydrodynamical simulations to assess the feasibility of constraining the thermal history of the intergalactic medium during reionisation with the Ly$\alpha$ forest at $z\simeq5$. The integrated thermal history has a measureable impact on the transmitted flux power spectrum that can be isolated from Doppler broadening at this redshift. We parameterise this using the cumulative energy per proton, $u_0$, deposited into a gas parcel at the mean background density, a quantity that is tightly linked with the gas density power spectrum in the simulations. We construct mock observations of the line of sight Ly$\alpha$ forest power spectrum and use a Markov Chain Monte Carlo approach to recover $u_{0}$ at redshifts $5 \leq z \leq 12$. A statistical uncertainty of $\sim 20$ per cent is expected (at 68 per cent confidence) at $z\simeq 5$ using high resolution spectra with a total redshift path length of $\Delta z=4$ and a typical signal-to-noise ratio of $\rm S/N=15$ per pixel. Estimates for the expected systematic uncertainties are comparable, such that existing data should enable a measurement of $u_0$ to within $\sim 30$ per cent. This translates to distinguishing between reionisation scenarios with similar instantaneous temperatures at $z\simeq 5$, but with an energy deposited per proton that differs by $2$-$3\, \rm eV$ over the redshift interval $5\leq z \leq 12$. For an initial temperature of $T\sim 10^{4}\rm\,K$ following reionisation, this corresponds to the difference between early ($z_{\rm re}=12$) and late ($z_{\rm re}=7$) reionisation in our models.

MSE is an 11.25m aperture observatory with a 1.5 square degree field of view that will be fully dedicated to multi-object spectroscopy. More than 3200 fibres will feed spectrographs operating at low (R ~ 2000 - 3500) and moderate (R ~ 6000) spectral resolution, and approximately 1000 fibers will feed spectrographs operating at high (R ~ 40000) resolution. MSE is designed to enable transformational science in areas as diverse as tomographic mapping of the interstellar and intergalactic media; the in-situ chemical tagging of thick disk and halo stars; connecting galaxies to their large scale structure; measuring the mass functions of cold dark matter sub-halos in galaxy and cluster-scale hosts; reverberation mapping of supermassive black holes in quasars; next generation cosmological surveys using redshift space distortions and peculiar velocities. MSE is an essential follow-up facility to current and next generations of multi-wavelength imaging surveys, including LSST, Gaia, Euclid, WFIRST, PLATO, and the SKA, and is designed to complement and go beyond the science goals of other planned and current spectroscopic capabilities like VISTA/4MOST, WHT/WEAVE, AAT/HERMES and Subaru/PFS. It is an ideal feeder facility for E-ELT, TMT and GMT, and provides the missing link between wide field imaging and small field precision astronomy. MSE is optimized for high throughput, high signal-to-noise observations of the faintest sources in the Universe with high quality calibration and stability being ensured through the dedicated operational mode of the observatory. (abridged)

The post-reionization thermal state of the intergalactic medium is characterized by a power-law relationship between temperature and density, with a slope determined by the parameter $\gamma$. We describe a new method to measure $\gamma$ using the ratio of flux curvature in the Lyman-$\alpha$ and $\beta$ forests. At a given redshift, this curvature ratio incorporates information from the different gas densities traced by Lyman-$\alpha$ and $\beta$ absorption. It is relatively simple and fast to compute and appears robust against several observational uncertainties. We apply this technique to a sample of 27 high-resolution quasar spectra from the Very Large Telescope. While promising statistical errors on $\gamma$ appear to be achievable with these spectra, to reach its full potential, the dependence of the curvature ratio on the thermal state of the gas in the foreground Lyman-$\alpha$ forest will require further, detailed forward modelling.

Determining when and how the first galaxies reionized the intergalactic medium (IGM) promises to shed light on both the nature of the first objects and the cosmic history of baryons. Towards this goal, quasar absorption lines play a unique role by probing the properties of diffuse gas on galactic and intergalactic scales. In this review we examine the multiple ways in which absorption lines trace the connection between galaxies and the IGM near the reionization epoch. We first describe how the Ly$\alpha$ forest is used to determine the intensity of the ionizing ultraviolet background and the global ionizing emissivity budget. Critically, these measurements reflect the escaping ionizing radiation from all galaxies, including those too faint to detect directly. We then discuss insights from metal absorption lines into reionization-era galaxies and their surroundings. Current observations suggest a buildup of metals in the circumgalactic environments of galaxies over $z \sim 6$ to 5, although changes in ionization will also affect the evolution of metal line properties. A substantial fraction of metal absorbers at these redshifts may trace relatively low-mass galaxies. Finally, we review constraints from the Ly$\alpha$ forest and quasar near zones on the timing of reionization. Along with other probes of the high-redshift Universe, absorption line data are consistent with a relatively late end to reionization ($5.5 \lesssim z \lesssim 7$); however the constraints are still fairly weak. Significant progress is expected to come through improved analysis techniques, increases in the number of known high-redshift quasars from optical and infrared sky surveys, large gains in sensitivity from next-generation observing facilities, and synergies with other probes of the reionization era.

We compare cosmological hydrodynamical simulations combined with the homogeneous metagalactic UV background (UVB) of Haardt & Madau (2012) (HM2012) to observations of the Lyman-alpha forest that are sensitive to the thermal and ionization state of the intergalactic medium (IGM). The transition from optically thick to thin photoheating predicted by the simple one-zone, radiative transfer model implemented by HM2012 predicts a thermal history that is in remarkably good agreement with the observed rise of the IGM temperature at z~3 if we account for the expected evolution of the volume filling factor of HeIII. Our simulations indicate that there may be, however, some tension between the observed peak in the temperature evolution and the rather slow evolution of the HeII opacities suggested by recent Hubble Space Telescope/COS measurements. The HM2012 UVB also underpredicts the metagalactic hydrogen photoionization rate required by our simulations to match the observed opacity of the forest at z>4 and z<2.

We investigate the feasibility of detecting 21cm absorption features in the afterglow spectra of high redshift long Gamma Ray Bursts (GRBs). This is done employing simulations of cosmic reionization, together with the instrumental characteristics of the LOw Frequency ARray (LOFAR). We find that absorption features could be marginally (with a S/N larger than a few) detected by LOFAR at z>7 if the GRB originated from PopIII stars, while the detection would be easier if the noise were reduced by one order of magnitude, i.e. similar to what is expected for the first phase of the Square Kilometer Array (SKA1-low). On the other hand, more standard GRBs are too dim to be detected even with ten times the sensitivity of SKA1-low, and only in the most optimistic case can a S/N larger than a few be reached at z>9.

We combine high resolution hydrodynamical simulations with an intermediate resolution, dark matter only simulation and an analytical model for the growth of ionized regions to estimate the large scale distribution and redshift evolution of the visibility of Lyman-alpha emission in 6<=z<=8 galaxies. The inhomogeneous distribution of neutral hydrogen during the reionization process results in significant fluctuations in the Lyman-alpha transmissivity on large scales. The transmissivity depends not only on the ionized fraction of the intergalactic medium by volume and the amplitude of the local ionizing background, but is also rather sensitive to the evolution of the relative velocity shift of the Lyman-alpha emission line due to resonant scattering. We reproduce a decline in the space density of Lyman-alpha emitting galaxies as rapid as observed with a rather rapidly evolving neutral fraction between z=6-8, and a typical Lyman-alpha line velocity offset of 100 km/s redward of systemic at z=6 which decreases toward higher redshift. The new (02/2015) Planck results indicate such a recent end to reionization is no longer disfavoured by constraints from the cosmic microwave background.

We compare predictions of large-scale cosmological hydrodynamical simulations for neutral hydrogen absorption signatures in the vicinity of 1e11 - 1e12.5 MSun haloes with observational measurements. Two different hydrodynamical techniques and a variety of prescriptions for gas removal in high density regions are examined. Star formation and wind feedback play only secondary roles in the HI absorption signatures outside the virial radius, but play important roles within. Accordingly, we identify three distinct gaseous regions around a halo: the virialized region, the mesogalactic medium outside the virial radius arising from the extended haloes of galaxies out to about two turnaround radii, and the intergalactic medium beyond. Predictions for the amount of absorption from the mesogalactic and intergalactic media are robust across different methodologies, and the predictions agree with the amount of absorption observed around star-forming galaxies and QSO host galaxies. Recovering the measured amount of absorption within the virialized region, however, requires either a higher dynamic range in the simulations, additional physics, or both.

We develop a semi-analytic method for assessing the impact of the large-scale IGM temperature fluctuations expected following He${\rm\,{\scriptstyle II}}$ reionization on three-dimensional clustering measurements of the Ly$\alpha$ forest. Our methodology builds upon the existing large volume, mock Ly$\alpha$ forest survey simulations presented by Greig et al. by including a prescription for a spatially inhomogeneous ionizing background, temperature fluctuations induced by patchy He${\rm\,{\scriptstyle II}}$ photoheating and the clustering of quasars. This approach enables us to achieve a dynamic range within our semi-analytic model substantially larger than currently feasible with computationally expensive, fully numerical simulations. The results agree well with existing numerical simulations, with large-scale temperature fluctuations introducing a scale-dependent increase in the spherically averaged 3D Ly$\alpha$ forest power spectrum of up to 20-30 per cent at wavenumbers $k\sim0.02$ Mpc$^{-1}$. Although these large-scale thermal fluctuations will not substantially impact upon the recovery of the baryon acoustic oscillation scale from existing and forthcoming dark energy spectroscopic surveys, any complete forward modelling of the broad-band term in the Ly$\alpha$ correlation function will none the less require their inclusion.

We report the discovery of an extremely long ($\sim$110 Mpc/$h$) and dark ($\tau_{\rm eff} \gtrsim 7$) Ly$\alpha$ trough extending down to $z \simeq 5.5$ towards the $z_{\rm em} \simeq 6.0$ quasar ULAS J0148+0600. We use these new data in combination with Ly$\alpha$ forest measurements from 42 quasars at $4.5 \le z_{\rm em} \le 6.4$ to conduct an updated analysis of the line-of-sight variance in the intergalactic Ly$\alpha$ opacity over $4 \le z \le 6$. We find that the scatter in transmission among lines of sight near $z \sim 6$ significantly exceeds theoretical expectations for either a uniform ultraviolet background (UVB) or simple fluctuating UVB models in which the mean free path to ionizing photons is spatially invariant. The data, particularly near $z \simeq 5.6$-5.8, instead require fluctuations in the volume-weighted hydrogen neutral fraction that are a factor of 3 or more beyond those expected from density variations alone. We argue that these fluctuations are most likely driven by large-scale variations in the mean free path, consistent with expectations for the final stages of inhomogeneous hydrogen reionization. Even by $z \simeq 5.6$, however, a large fraction of the data are consistent with a uniform UVB, and by $z \sim 5$ the data are fully consistent with opacity fluctuations arising solely from the density field. This suggests that while reionization may be ongoing at $z \sim 6$, it has fully completed by $z \sim 5$.

The Ly$\alpha$ forest transmission probability distribution function (PDF) is an established probe of the intergalactic medium (IGM) astrophysics, especially the temperature-density relationship of the IGM. We measure the transmission PDF from 3393 Baryon Oscillations Spectroscopic Survey (BOSS) quasars from SDSS Data Release 9, and compare with mock spectra that include careful modeling of the noise, continuum, and astrophysical uncertainties. The BOSS transmission PDFs, measured at $\langle z \rangle = [2.3,2.6,3.0]$, are compared with PDFs created from mock spectra drawn from a suite of hydrodynamical simulations that sample the IGM temperature-density relationship, $\gamma$, and temperature at mean-density, $T_0$, where $T(\Delta) = T_0 \Delta^{\gamma-1}$. We find that a significant population of partial Lyman-limit systems with a column-density distribution slope of $\beta_\mathrm{pLLS} \sim -2$ are required to explain the data at the low-transmission end of transmission PDF, while uncertainties in the mean Ly$\alpha$ forest transmission affect the high-transmission end. After modelling the LLSs and marginalizing over mean-transmission uncertainties, we find that $\gamma=1.6$ best describes the data over our entire redshift range, although constraints on $T_0$ are affected by systematic uncertainties. Within our model framework, isothermal or inverted temperature-density relationships ($\gamma \leq 1$) are disfavored at a significance of over 4$\sigma$, although this could be somewhat weakened by cosmological and astrophysical uncertainties that we did not model.

We perform cosmological simulations of the intergalactic medium (IGM) at redshift z ~ 3 using the numerical gravity-hydrodynamics codes GADGET-3 and Enzo for the purpose of modelling the gaseous environments of galaxies. We identify haloes in the simulations using three different algorithms. Different rank orderings of the haloes by mass result, introducing a limiting factor in identifying haloes with observed galaxies. We also compare the physical properties of the gas between the two codes, focussing primarily on the gas outside the virial radius, motivated by recent HI absorption measurements of the gas around z ~ 2 - 3 galaxies. The internal dispersion velocities of the gas in the haloes have converged for a box size of 30 comoving Mpc, but the centre-of-mass peculiar velocities of the haloes have not up to a box size of 60 comoving Mpc. The density and temperature of the gas within the instantaneous turn-around radii of the haloes are adequately captured for box sizes 30 Mpc on a side, but the results are highly sensitive to the treatment of unresolved, rapidly cooling gas, with the gas mass fraction within the virial radius severely depleted by star formation in the GADGET-3 simulations. Convergence of the gas peculiar velocity field on large scales requires a box size of at least 60 Mpc. Outside the turn-around radius, the physical state of the gas agrees to 30 percent or better both with box size and between simulation methods. We conclude that generic IGM simulations make accurate predictions for the intergalactic gas properties beyond the halo turn-around radii, but the gas properties on smaller scales are highly dependent on star formation and feedback implementations.

We investigate the influence of High Mass X-ray Binaries on their high redshift environments. Using a one-dimensional radiative transfer code, we predict the ionization and temperature profiles surrounding a coeval stellar population, composed of main sequence stars and HMXBs, at various times after its formation. We consider both uniform density surroundings, and a cluster embedded in a 10^8 solar mass NFW halo. HMXBs in a constant density environment produce negligible enhanced ionization because of their high-energy SEDs and short lifetimes. In this case, HMXBs only marginally contribute to the local heating rate. For NFW profiles, radiation from main sequence stars cannot prevent the initially ionized volume from recombining since it is unable to penetrate the high density galactic core. However, HMXB photons stall recombinations behind the front, keeping it partially ionized for longer. The increased electron density in these partially ionized regions promotes further cooling, resulting in lower IGM temperatures. In the context of this starburst model, we have shown that HMXBs do not make a major contribution to reionization or IGM heating. However, X-ray escape fractions are high in both density profile cases. Continuous star formation may result in the build up of X-rays over time, reducing the ionization timescale and potentially leading to low level ionization of the distant IGM.

The signature left in quasar spectra by the presence of neutral hydrogen in the Universe allows one to constrain the sum of the neutrino masses with improved sensitivity, with respect to laboratory experiments, and may shed a new light on the neutrino mass hierarchy and on the absolute mass scale of neutrinos. Constraints on cosmological parameters and on the dark energy equation of state can also be derived, from a joint parameter estimation procedure. However, this requires a detailed modeling of the line-of-sight power spectrum of the transmitted flux in the Lyman-Alpha (LyA) forest on scales ranging from a few to hundreds of Mpcs, which in turns demands the inclusion and careful treatment of cosmological neutrinos. To this end, we present here a suite of state-of-the-art hydrodynamical simulations with cold dark matter, baryons and massive neutrinos, specifically targeted for modeling the low-density regions of the IGM as probed by the LyA forest at high-redshift. The simulations span volumes ranging from (25 Mpc/h)^3 to (100 Mpc/h)^3, and are made using either 3 X 192^3~21 millions or 3 X 768^3~1.4 billion particles. The resolution of the various runs can be further enhanced, so that we can reach the equivalent of 3 X 3072^3~87 billion particles in a (100 Mpc/h)^3 box size. The chosen cosmological parameters are compatible with the latest Planck (2013) results, although we also explore the effect of slight variations in the main cosmological and astrophysical parameters. We adopt a particle-type implementation of massive neutrinos, and consider three degenerate species having masses M_nu =0.1, 0.2, 0.3, 0.4 and 0.8 eV, respectively. We improve on previous studies in several ways, in particular with updated routines for IGM radiative cooling and heating processes, and initial conditions based on 2LPT rather than the Zeldovich approximation.

We present a suite of cosmological N-body simulations with cold dark matter and baryons aiming at modeling the low-density regions of the IGM as probed by the Lyman-$\alpha$ forests at high redshift. The simulations are designed to match the requirements imposed by the quality of BOSS and eBOSS data. They are made using either 2x768$^3$ or 2x192$^3$ particles, spanning volumes ranging from (25 Mpc.h$^{-1})^3$ for high-resolution simulations to (100 Mpc.h$^{-1})^3$ for large-volume ones. Using a splicing technique, the resolution is further enhanced to reach the equivalent of simulations with 2x3072$^3$= 58 billion particles in a (100 Mpc.h$^{-1}$)^3 box size, i.e. a mean mass per gas particle of 1.2x10$^5$M_sun.h$^{-1}$. We show that the resulting power spectrum is accurate at the 2% level over the full range from a few Mpc to several tens of Mpc. We explore the effect on the one-dimensional transmitted-flux power spectrum of 4 cosmological parameters ($n_s, \sigma_8, \Omega_m, H_0$) and 2 astrophysical parameters ($T_0, \gamma$) related to the heating rate of the IGM. By varying the input parameters around a central model chosen to be in agreement with the latest Planck results, we built a grid of simulations that allows the study of the impact on the flux power spectrum of these six relevant parameters. We improve upon previous studies by not only measuring the effect of each parameter individually, but also probing the impact of the simultaneous variation of each pair of parameters. We thus provide a full second-order expansion, including cross-terms, around our central model. We check the validity of the second-order expansion with independent simulations obtained either with different cosmological parameters or different seeds. Finally, a comparison to the one-dimensional Ly-$\alpha$ forest power spectrum obtained with BOSS shows an excellent agreement.

According to the photo-heating model of the intergalactic medium (IGM), He II reionization is expected to affect its thermal evolution. Evidence for additional energy injection into the IGM has been found at $3\lesssim z\lesssim4$, though the evidence for the subsequent fall-off below $z\sim2.8$ is weaker and depends on the slope of the temperature--density relation, $\gamma$. Here we present, for the first time, an extension of the IGM temperature measurements down to the atmospheric cut-off of the H I Lyman-$\alpha$ forest at $z\simeq1.5$. Applying the curvature method on a sample of 60 UVES spectra we investigated the thermal history of the IGM at $z<3$ with precision comparable to the higher redshift results. We find that the temperature of the cosmic gas traced by the Ly-$\alpha$ forest [$T(\bar{\Delta})]$ increases for increasing overdensity from $T(\bar{\Delta})\sim 22670$ K to 33740 K in the redshift range $z\sim2.8-1.6$. Under the assumption of two reasonable values for $\gamma$, the temperature at the mean density ($T_{0}$) shows a tendency to flatten at $z\lesssim 2.8$. In the case of $\gamma\sim1.5$, our results are consistent with previous ones which indicate a falling $T_{0}$ for redshifts $z\lesssim2.8$. Finally, our $T(\bar{\Delta})$ values show reasonable agreement with moderate blazar heating models.

We present new measurements of the thermal state of the intergalactic medium (IGM) at $z\sim2.4$ derived from absorption line profiles in the Ly$\alpha$ forest. We use a large set of high-resolution hydrodynamical simulations to calibrate the relationship between the temperature-density ($T$--$\Delta$) relation in the IGM and the distribution of HI column densities, $N_{\rm HI}$, and velocity widths, $b_{\rm HI}$, of discrete Ly$\alpha$ forest absorbers. This calibration is then applied to the measurement of the lower cut-off of the $b_{\rm HI}$--$N_{\rm HI}$ distribution recently presented by Rudie et al. (2012). We infer a power-law $T$--$\Delta$ relation, $T=T_{0}\Delta^{\gamma-1}$, with a temperature at mean density, $T_{0}=[1.00^{+0.32}_{-0.21}]\times10^{4}\rm\,K$ and slope $(\gamma-1)=0.54\pm0.11$. The slope is fully consistent with that advocated by the analysis of Rudie et al (2012); however, the temperature at mean density is lower by almost a factor of two, primarily due to an adjustment in the relationship between column density and physical density assumed by these authors. These new results are in excellent agreement with the recent temperature measurements of Becker et al. (2011), based on the curvature of the transmitted flux in the Ly$\alpha$ forest. This suggests that the thermal state of the IGM at this redshift is reasonably well characterised over the range of densities probed by these methods.

Low ionization metal absorption due to OI has been identified as an important probe of the physical state of the inter-/circumgalactic medium at the tail-end of reionization. We use here high-resolution hydrodynamic simulations to interpret the incidence rate of OI absorbers at z~6 as observed by Becker et al. (2011). We infer weak OI absorbers (EW > 0.1 A) to have typical HI column densities in the range of sub-DLAs, densities of 80 times the mean baryonic density and metallicities of about 1/500 th solar. This is similar to the metallicity inferred at similar overdensities at z~3, suggesting that the metal enrichment of the circumgalactic medium around low-mass galaxies has already progressed considerably by z~6. The apparently rapid evolution of the incidence rates for OI absorption over the redshift range 5<z<6 mirrors that of self-shielded Lyman-Limit systems at lower redshift and is mainly due to the rapid decrease of the meta-galactic photo-ionization rate at z>5. We predict the incidence rate of OI absorbers to continue to rise rapidly with increasing redshift as the IGM becomes more neutral. If the distribution of metals extends to lower density regions, OI absorbers will allow the metal enrichment of the increasingly neutral filamentary structures of the cosmic web to be probed.

We have developed two independent methods to measure the one-dimensional power spectrum of the transmitted flux in the Lyman-$\alpha$ forest. The first method is based on a Fourier transform, and the second on a maximum likelihood estimator. The two methods are independent and have different systematic uncertainties. The determination of the noise level in the data spectra was subject to a novel treatment, because of its significant impact on the derived power spectrum. We applied the two methods to 13,821 quasar spectra from SDSS-III/BOSS DR9 selected from a larger sample of over 60,000 spectra on the basis of their high quality, large signal-to-noise ratio, and good spectral resolution. The power spectra measured using either approach are in good agreement over all twelve redshift bins from $<z> = 2.2$ to $<z> = 4.4$, and scales from 0.001 $\rm(km/s)^{-1}$ to $0.02 \rm(km/s)^{-1}$. We determine the methodological and instrumental systematic uncertainties of our measurements. We provide a preliminary cosmological interpretation of our measurements using available hydrodynamical simulations. The improvement in precision over previously published results from SDSS is a factor 2--3 for constraints on relevant cosmological parameters. For a $\Lambda$CDM model and using a constraint on $H_0$ that encompasses measurements based on the local distance ladder and on CMB anisotropies, we infer $\sigma_8 =0.83\pm0.03$ and $n_s= 0.97\pm0.02$ based on \ion{H}{i} absorption in the range $2.1<z<3.7$.

We present new measurements of the intensity of the ionizing ultraviolet background and the global emissivity of ionizing photons over 2 < z < 5. Our results are based on a suite of updated measurements of physical properties of the high-redshift intergalactic medium (IGM), including gas temperatures and the opacity of the IGM to Ly-alpha and ionizing photons. Consistent with previous works, we find a relatively flat hydrogen photoionization rate over 2 < z < 5, although our measurements are roughly a factor of two higher than the 2008 values of Faucher-Giguere et al., due primarily to our lower gas temperatures. The ionizing emissivity we derive is also generally higher than other recent estimates due to a combination of lower gas temperatures, higher ionizing opacity, and an accounting of cosmological radiative transfer effects. We find evidence that the emissivity increases from z~3 to 5, reaching ~5 ionizing photons per atom per gigayear at z=4.75 for realistic galaxy spectra. We further find that galaxies must dominate the emissivity near 1 Ryd at z > 4, and possibly at all redshifts z > 2.4. Our results suggest that the globally-averaged ionizing "efficiency" of star-forming galaxies increases substantially with redshift over 3.2 < z < 4.75. This trend is consistent with the conclusion often drawn from reionization models that the ionizing efficiency of galaxies must be higher during reionization in order for galaxies to reionize the IGM by z=6. Our emissivity values at z~5 suggest that ionizing photons may have been a factor of two more abundant during the final stages of reionization than previously indicated. The evolution of the ionizing emissivity over 2 < z < 5 suggests, moreover, that the steep decline in the photoionization rate from z~5 to 6 may indicate a rapid evolution in the mean free path at z > 5.

We present updated constraints on the free-streaming of warm dark matter (WDM) particles derived from an analysis of the Lya flux power spectrum measured from high-resolution spectra of 25 z > 4 quasars obtained with the Keck High Resolution Echelle Spectrometer (HIRES) and the Magellan Inamori Kyocera Echelle (MIKE) spectrograph. We utilize a new suite of high-resolution hydrodynamical simulations that explore WDM masses of 1, 2 and 4 keV (assuming the WDM consists of thermal relics), along with different physically motivated thermal histories. We carefully address different sources of systematic error that may affect our final results and perform an analysis of the Lya flux power with conservative error estimates. By using a method that samples the multi-dimensional astrophysical and cosmological parameter space, we obtain a lower limit mwdm > 3.3 keV (2sigma) for warm dark matter particles in the form of early decoupled thermal relics. Adding the Sloan Digital Sky Survey (SDSS) Lya flux power spectrum does not improve this limit. Thermal relics of masses 1 keV, 2 keV and 2.5 keV are disfavoured by the data at about the 9sigma, 4sigma and 3sigma C.L., respectively. Our analysis disfavours WDM models where there is a suppression in the linear matter power spectrum at (non-linear) scales corresponding to k=10h/Mpc which deviates more than 10% from a LCDM model. Given this limit, the corresponding "free-streaming mass" below which the mass function may be suppressed is 2x10^8 Msun/h. There is thus very little room for a contribution of the free-streaming of WDM to the solution of what has been termed the small scale crisis of cold dark matter.

A variety of independent observational studies have now reported a significant decline in the fraction of Lyman-break galaxies which exhibit Ly-a emission over the redshift interval z=6-7. In combination with the strong damping wing extending redward of Ly-a in the spectrum of the bright z=7.085 quasar ULAS 1120+0641, this has strengthened suggestions that the hydrogen in the intergalactic medium (IGM) is still substantially neutral at z~7. Current theoretical models imply HI fractions as large as 40-90 per cent may be required to explain these data assuming there is no intrinsic evolution in the Ly-a emitter population. We propose that such large neutral fractions are not necessary. Based on a hydrodynamical simulation which reproduces the absorption spectra of high-redshift (z~6-7) quasars, we demonstrate that the opacity of the intervening IGM redward of rest-frame Ly-a can rise rapidly in average regions of the Universe simply because of the increasing incidence of absorption systems which are optically thick to Lyman continuum photons as the tail-end of reionisation is approached. Our simulations suggest these data do not require a large change in the IGM neutral fraction by several tens of per cent from z=6-7, but may instead be indicative of the rapid decrease in the typical mean free path for ionising photons expected during the final stages of reionisation.

We discuss the feasibility of the detection of the 21cm forest in the diffuse IGM with the radio telescope LOFAR. The optical depth to the 21cm line has been derived using simulations of reionization which include detailed radiative transfer of ionizing photons. We find that the spectra from reionization models with similar total comoving hydrogen ionizing emissivity but different frequency distribution look remarkably similar. Thus, unless the reionization histories are very different from each other (e.g. a predominance of UV vs. x-ray heating) we do not expect to distinguish them by means of observations of the 21cm forest. Because the presence of a strong x-ray background would make the detection of 21cm line absorption impossible, the lack of absorption could be used as a probe of the presence/intensity of the x-ray background and the thermal history of the universe. Along a random line of sight LOFAR could detect a global suppression of the spectrum from z>12, when the IGM is still mostly neutral and cold, in contrast with the more well-defined, albeit broad, absorption features visible at lower redshift. Sharp, strong absorption features associated with rare, high density pockets of gas could be detected also at z~7 along preferential lines of sight.

We investigate the thermal history of the intergalactic medium (IGM) in the redshift interval z=1.7--3.2 by studying the small-scale fluctuations in the Lyman alpha forest transmitted flux. We apply a wavelet filtering technique to eighteen high resolution quasar spectra obtained with the Ultraviolet and Visual Echelle Spectrograph (UVES), and compare these data to synthetic spectra drawn from a suite of hydrodynamical simulations in which the IGM thermal state and cosmological parameters are varied. From the wavelet analysis we obtain estimates of the IGM thermal state that are in good agreement with other recent, independent wavelet-based measurements. We also perform a reanalysis of the same data set using the Lyman alpha forest flux probability distribution function (PDF), which has previously been used to measure the IGM temperature-density relation. This provides an important consistency test for measurements of the IGM thermal state, as it enables a direct comparison of the constraints obtained using these two different methodologies. We find the constraints obtained from wavelets and the flux PDF are formally consistent with each other, although in agreement with previous studies, the flux PDF constraints favour an isothermal or inverted IGM temperature-density relation. We also perform a joint analysis by combining our wavelet and flux PDF measurements, constraining the IGM thermal state at z=2.1 to have a temperature at mean density of T0/[10^3 K]=17.3 +/- 1.9 and a power-law temperature-density relation exponent gamma=1.1 +/- 0.1 (1 sigma). Our results are consistent with previous observations that indicate there may be additional sources of heating in the IGM at z<4.

We investigate the effect of helium on hydrogen reionisation using a hydrodynamical simulation combined with the cosmological radiative transfer code CRASH. The simulations are run in a 35.12/h comoving Mpc box using a variety of assumptions for the amplitude and power-law extreme-UV (EUV) spectral index, alpha, of the ionising emissivity. We use an empirically motivated prescription for ionising sources which ensures all of the models are consistent with constraints on the Thomson scattering optical depth and the hydrogen photo-ionisation rate at z=6. The inclusion of helium slightly delays reionisation due to the small number of ionising photons which reionise neutral helium instead of hydrogen. However, helium has a significant impact on the thermal state of the IGM. Models with alpha=3 produce IGM temperatures at the mean density at z=6 which are about 20 % higher compared to models without helium photo-heating. Harder EUV indices produce even larger IGM temperature boosts. A comparison to recent observational estimates of the IGM temperature at z=5 - 6 suggests that hydrogen reionisation was primarily driven by pop-II stellar sources with a soft EUV index, alpha<3. We also find that faint, as yet undetected galaxies, characterised by a luminosity function with a steepening faint-end slope and an increasing Lyman continuum escape fraction (fesc=0.5), are required to reproduce the ionising emissivity used in our simulations at z>6. Finally, we note there is some tension between recent observational constraints which indicate the IGM is > 10% neutral by volume z=7, and estimates of the ionising emissivity at z=6 which indicate only between 1 and 3 ionising photons are emitted per hydrogen atom over a Hubble time. This tension may be alleviated by either a lower neutral fraction at z=7 or an IGM which still remains a few % neutral by volume at z=6.

We present a measurement of the Lyman alpha flux probability distribution function (PDF) measured from a set of eight high resolution quasar spectra with emission redshifts at 3.3 < z < 3.8. We carefully study the effect of metal absorption lines on the shape of the PDF. Metals have a larger impact on the PDF measurements at lower redshift, where there are fewer Lyman alpha absorption lines. This may be explained by an increase in the number of metal lines which are blended with Lyman alpha absorption lines toward higher redshift, but may also be due to the presence of fewer metals in the intergalactic medium with increasing lookback time. We also provide a new measurement of the redshift evolution of the effective optical depth, tau_eff, at 2.8 < z < 3.6, and find no evidence for a deviation from a power law evolution in the log(tau_eff)-log(1+z) plane. The flux PDF measurements are furthermore of interest for studies of the thermal state of the intergalactic medium (IGM) at z ~ 3 . By comparing the PDF to state-of-the-art cosmological hydrodynamical simulations, we place constraints on the temperature of the IGM and compare our results with previous measurements of the PDF at lower redshift. At redshift z=3, our new PDF measurements are consistent with an isothermal temperature-density relation, T=T_0 Delta^{gamma-1}, with a temperature at the mean density of T_0 = 19250 +/- 4800 K and a slope gamma=0.90+/-0.21 (1 sigma uncertainties). In comparison, joint constraints with previous PDF measurements at z<3 favour an inverted (gamma<1) temperature-density relation with T_0=17900 +/- 3500 K and gamma=0.70 +/- 0.12, in broad agreement with previous analyses.

Measurements of the intergalactic medium (IGM) temperature provide a potentially powerful constraint on the reionisation history due to the thermal imprint left by the photo-ionisation of neutral hydrogen. However, until recently IGM temperature measurements were limited to redshifts 2 < z < 4.8, restricting the ability of these data to probe the reionisation history at z > 6. In this work, we use recent measurements of the IGM temperature in the near-zones of seven quasars at z ~ 5.8 - 6.4, combined with a semi-numerical model for inhomogeneous reionisation, to establish new constraints on the redshift at which hydrogen reionisation completed. We calibrate the model to reproduce observational constraints on the electron scattering optical depth and the HI photo-ionisation rate, and compute the resulting spatially inhomogeneous temperature distribution at z ~ 6 for a variety of reionisation scenarios. Under standard assumptions for the ionising spectra of population-II sources, the near-zone temperature measurements constrain the redshift by which hydrogen reionisation was complete to be z > 7.9 (6.5) at 68 (95) per cent confidence. We conclude that future temperature measurements around other high redshift quasars will significantly increase the power of this technique, enabling these results to be tightened and generalised.

We present measurements of the intergalactic medium (IGM) temperature within ~5 proper Mpc of seven luminous quasars at z~6. The constraints are obtained from the Doppler widths of Lyman-alpha absorption lines in the quasar near-zones and build upon our previous measurement for the z=6.02 quasar SDSS J0818+1722. The expanded data set, combined with an improved treatment of systematic uncertainties, yields an average temperature at the mean density of log (T_0/K) = 4.21 \pm 0.03 (\pm^0.06_0.07) at 68 (95) per cent confidence for a flat prior distribution over 3.2 < log (T_0/K) < 4.8. In comparison, temperatures measured from the general IGM at z~5 are ~0.3 dex cooler, implying an additional source of heating around these quasars which is not yet present in the general IGM at slightly lower redshift. This heating is most likely due to the recent reionisation of He-II in vicinity of these quasars, which have hard, non-thermal ionising spectra. The elevated temperatures may therefore represent evidence for the earliest stages of He-II reionisation in the most biased regions of the high-redshift Universe. The temperature as a function of distance from the quasars is consistent with being constant, log(T_0/K)~4.2, with no evidence for a line-of-sight thermal proximity effect. However, the limited extent of the quasar near-zones prevents the detection of He-III regions larger than ~5 proper Mpc. Under the assumption the quasars have reionised the He-II in their vicinity, we infer the data are consistent with an average optically bright phase of duration in excess of 10^6.5 yr. These measurements represent the highest-redshift IGM temperature constraints to date, and thus provide a valuable data set for confronting models of H-I reionisation.

High redshift measurements of the baryonic acoustic oscillation scale (BAO) from large Ly-alpha forest surveys represent the next frontier of dark energy studies. As part of this effort, efficient simulations of the BAO signature from the Ly-alpha forest will be required. We construct a model for producing fast, large volume simulations of the Ly-alpha forest for this purpose. Utilising a calibrated semi-analytic approach, we are able to run very large simulations in 1 Gpc^3 volumes which fully resolve the Jeans scale in less than a day on a desktop PC using a GPU enabled version of our code. The Ly-alpha forest spectra extracted from our semi-analytical simulations are in excellent agreement with those obtained from a fully hydrodynamical reference simulation. Furthermore, we find our simulated data are in broad agreement with observational measurements of the flux probability distribution and 1D flux power spectrum. We are able to correctly recover the input BAO scale from the 3D Ly-alpha flux power spectrum measured from our simulated data, and estimate that a BOSS-like 10^4 deg^2 survey with ~15 background sources per square degree and a signal-to-noise of ~5 per pixel should achieve a measurement of the BAO scale to within ~1.4 per cent. We also use our simulations to provide simple power-law expressions for estimating the fractional error on the BAO scale on varying the signal-to-noise and the number density of background sources. The speed and flexibility of our approach is well suited for exploring parameter space and the impact of observational and astrophysical systematics on the recovery of the BAO signature from forthcoming large scale spectroscopic surveys.

The quasar ULAS J1120+0641 at redshift z=7.085 has a highly ionised near zone which is smaller than those around quasars of similar luminosity at z~6. The spectrum also exhibits evidence for a damping wing extending redward of the systemic Lya redshift. We use radiative transfer simulations in a cosmological context to investigate the implications for the ionisation state of the inhomogeneous IGM surrounding this quasar. Our simulations show that the transmission profile is consistent with an IGM in the vicinity of the quasar with a volume averaged HI fraction of f_HI>0.1 and that ULAS J1120+0641 has been bright for 10^6--10^7 yr. The observed spectrum is also consistent with smaller IGM neutral fractions, f_HI ~ 10^-3--10-4, if a damped Lya system in an otherwise highly ionised IGM lies within 5 proper Mpc of the quasar. This is, however, predicted to occur in only ~5 per cent of our simulated sight-lines for a bright phase of 10^6--10^7 yr. Unless ULAS J1120+0641 grows during a previous optically obscured phase, the low age inferred for the quasar adds to the theoretical challenge of forming a 2x10^9 M_sol black hole at this high redshift.

Spatial inhomogeneities in the spectral shape of the ultra-violet background (UVB) at the tail-end of HeII reionisation are thought to be the primary cause of the large fluctuations observed in the HeII to HI Ly-a forest optical depth ratio, tau_HeII/tau_HI, at z~2-3. These spectral hardness fluctuations will also influence the ionisation balance of intergalactic metals; we extract realistic quasar absorption spectra from a large hydrodynamical simulation to examine their impact on intergalactic SiIV and CIV absorbers. Using a variety of toy UVB models, we find that while the predicted spatial inhomogeneities in spectral hardness have a significant impact on tau_HeII/tau_HI, the longer mean free path for photons with frequencies above and below the HeII ionisation edge means these fluctuations have less effect on the SiIV and CIV ionisation balance. Furthermore, UVB models which produce the largest fluctuations in specific intensity at the HeII ionisation edge also have the softest ionising spectra, and thus result in photo-ionisation rates which are too low to produce significant fluctuations in the observed tau_SiIV/tau_CIV. Instead, we find spatial variations in the IGM metallicity will dominate any scatter in tau_SiIV/tau_CIV. Our results suggest that observational evidence for homogeneity in the observed tau_SiIV/tau_CIV distribution does not rule out the possibility of significant fluctuations in the UVB spectral shape at z~2-3. On the other hand, the scatter in metallicity inferred from observations of intergalactic CIV and SiIV absorption at z~2-3 using spatially uniform ionisation corrections is likely intrinsic, and therefore provides a valuable constraint on intergalactic metal enrichment scenarios at these redshifts.

We present measurements of the ionising ultraviolet background (UVB) at z ~ 5-6 using the quasar proximity effect. The fifteen quasars in our sample cover the range 4.6 < z_q < 6.4, enabling the first proximity effect measurements of the UVB at z > 5. The metagalactic hydrogen ionisation rate, Gamma_bkg, was determined by modelling the combined ionisation field from the quasar and the UVB in the proximity zone on a pixel-by-pixel basis. The optical depths in the spectra were corrected for the expected effect of the quasar until the mean flux in the proximity region equalled that in the average Ly-alpha forest, and from this we make a measurement of Gamma_bkg. A number of systematic effects were tested using synthetic spectra. Noise in the flux was found to be the largest source of bias at z ~ 5, while uncertainties in the mean transmitted Ly-alpha flux are responsible for the largest bias at z ~ 6. The impacts of large-scale overdensities and Lyman limit systems on Gamma_bkg were also investigated, but found to be small at z > 5. We find a decline in Gamma_bkg with redshift, from log(Gamma_bkg) = -12.15 $\pm$ 0.16 at z ~ 5 to log(Gamma_bkg) = -12.84 $\pm$ 0.18 at z ~ 6 (1 sigma errors). Compared to UVB measurements at lower redshifts, our measurements suggest a drop of a factor of five in the HI photoionisation rate between z ~ 4 and z ~ 6. The decline of Gamma_bkg appears to be gradual, and we find no evidence for a sudden change in the UVB at any redshift that would indicate a rapid change in the attenuation length of ionising photons. Combined with recent measurements of the evolution of the mean free path of ionising photons, our results imply decline in the emissivity of ionising photons by roughly a factor of two from z ~ 5 to 6, albeit with significant uncertainty due to the measurement errors in both Gamma_bkg and the mean free path.

We present new measurements of the temperature of the intergalactic medium (IGM) derived from the Lyman-alpha forest over 2.0 < z < 4.8. The small-scale structure in the forest of 61 high-resolution QSO spectra is quantified using a new statistic, the curvature, and the conversion to temperature calibrated using a suite of hydrodynamic simulations. At each redshift we focus on obtaining the temperature at an optimal overdensity probed by the Lyman-alpha forest, T(Delta), where the temperature is nearly a one-to-one function of the curvature regardless of the slope of the temperature-density relation. The median 2-sigma statistical uncertainty in these measurements is 8 per cent, though there may be comparable systematic errors due to the unknown amount of Jeans smoothing in the IGM. We use our T(Delta) results to infer the temperature at the mean density, T0. Even for a maximally steep temperature-density relation, T0 must increase from ~8000 K at z ~ 4.4 to >~12000 K at z ~ 2.8. This increase is not consistent with the monotonic decline in T0 expected in the absence of He II reionization. We therefore interpret the observed rise in temperature as evidence of He II reionization beginning at z >~ 4.4. The evolution of T0 is consistent with an end to He II reionization at z ~ 3, as suggested by opacity measurements of the He II Lyman-alpha forest, although the redshift at which T0 peaks will depend somewhat on the evolution of the temperature-density relation. These new temperature measurements suggest that the heat input due to the reionization of He II dominates the thermal balance of the IGM over an extended period with Delta_z >~ 1.

The discovery of quasars with redshifts higher than six has prompted a great deal of discussion in the literature regarding the role of quasars, both as sources of reionization, and as probes of the ionization state of the IGM. However the extreme ultra-violet (EUV) spectral index cannot be measured directly for high redshift quasars owing to absorption at frequencies above the Lyman limit, and as a result, studies of the impact of quasars on the intergalactic medium during reionization must assume a spectral energy distribution in the extreme ultra-violet based on observations at low redshift, z<1. In this paper we use regions of high Ly-alpha transmission (near-zones) around the highest redshift quasars to measure the quasar EUV spectral index at z~6. We jointly fit the available observations for variation of near-zone size with both redshift and luminosity, and propose that the observed relation provides evidence for an EUV spectral index that varies with absolute magnitude in the high redshift quasar sample, becoming softer at higher luminosity. Using a large suite of detailed numerical simulations we find that the typical value of spectral index for a luminous quasar at z~6 is constrained to be alpha=1.3+/-0.4 for a specific luminosity of the form L\propto\nu^{-alpha}. We find the scatter in spectral index among individual quasars to be in the range ~0.75-1.25. These values are in agreement with direct observations at low redshift, and indicate that there has been no significant evolution in the EUV spectral index of quasars over 90% of cosmic time.

The thermal state of the intergalactic medium (IGM) provides an indirect probe of both the HI and HeII reionisation epochs. Current constraints on the IGM temperature from the Lya forest are restricted to the redshift range 2<z<4.5, limiting the ability to probe the thermal memory of HI reionisation toward higher redshift. In this work, we present the first direct measurement of the IGM temperature around a z=6 quasar by analysing the Doppler widths of Lya absorption lines in the proximity zone of SDSS J0818+1722. We use a high resolution (R= 40000) Keck/HIRES spectrum in combination with detailed numerical modelling to obtain the temperature at mean density, T_0=23600\pm^5000_6900K (\pm^9200_9300K) at 68 (95) per cent confidence assuming a prior probability 13500K<T_0<38500 K following HI and HeII reionisation. This enables us to place an upper limit on the redshift of HI reionisation, z_H, within 33 comoving Mpc of SDSS J0818+1722. If the quasar reionises the HeII in its vicinity, then in the limit of instantaneous reionisation we infer z_H<9.0 (11.0) at 68 (95) per cent confidence assuming photoheating is the dominant heat source and that HI reionisation is driven by ionising sources with soft spectra, typical of population II stars. If the HI and HeII in the IGM around SDSS J0818+1722 are instead reionised simultaneously by a population of massive metal-free stars, characterised by very hard ionising spectra, we obtain a tighter upper limit of z_H<8.4 (9.4). Initiating reionisation at higher redshifts produces temperatures which are too low with respect to our constraint unless the HI ionising sources or the quasar itself have spectra significantly harder than typically assumed.

We use the probability distribution function (PDF) of the lya forest flux at z=2-3, measured from high-resolution UVES/VLT data, and hydrodynamical simulations to obtain constraints on cosmological parameters and the thermal state of the intergalactic medium (IGM) at z 2-3. The observed flux PDF at z=3 alone results in constraints on cosmological parameters in good agreement with those obtained from the WMAP data, albeit with about a factor two larger errors. The observed flux PDF is best fit with simulations with a matter fluctuation amplitude of sigma_8=0.8-0.85 \pm 0.07 and an inverted IGM temperature-density relation (gamma ~ 0.5-0.75), consistent with our previous results obtained using a simpler analysis. These results appear to be robust to uncertainties in the quasar (QSO) continuum placement. We further discuss constraints obtained by a combined analysis of the high-resolution flux PDF and the power spectrum measured from the Sloan Digital Sky Survey (SDSS) lya forest data. The joint analysis confirms the suggestion of an inverted temperature-density relation, but prefers somewhat higher values (sigma_8 ~ 0.9) of the matter fluctuation amplitude than the WMAP data and the best fit to the flux PDF alone. The joint analysis of the flux PDF and power spectrum (as well as an analysis of the power spectrum data alone) prefers rather large values for the temperature of the IGM, perhaps suggesting that we have identified a not yet accounted for systematic error in the SDSS flux power spectrum data or that the standard model describing the thermal state of the IGM at z ~ 2-3 is incomplete.

We use a large set of cosmological smoothed particle hydrodynamics (SPH) simulations to examine the effect of mass resolution and box size on synthetic Lya forest spectra at 2 \leq z \leq 5. The mass resolution requirements for the convergence of the mean Lya flux and flux power spectrum at z=5 are significantly stricter than at lower redshift. This is because transmission in the high redshift Lya forest is primarily due to underdense regions in the intergalactic medium (IGM), and these are less well resolved compared to the moderately overdense regions which dominate the Lya forest opacity at z~2-3. We further find that the gas density distribution in our simulations differs significantly from previous results in the literature at large overdensities (\Delta>10). We conclude that studies of the Lya forest at z=5 using SPH simulations require a gas particle mass of M_gas \leq 2x10^5 M_sol/h, which is >8 times the value required at z=2. A box size of at least 40 Mpc/h is preferable at all redshifts.

Three independent observational studies have now detected a narrow (\Delta z ~ 0.5) dip centred at z=3.2 in the otherwise smooth redshift evolution of the Lya forest effective optical depth. This feature has previously been interpreted as an indirect signature of rapid photo-heating in the IGM during the epoch of HeII reionisation. We examine this interpretation using a semi-analytic model of inhomogeneous HeII reionisation and high resolution hydrodynamical simulations of the Lya forest. We instead find that a rapid (\Delta z ~ 0.2) boost to the IGM temperature (\Delta T ~ 10^4 K) beginning at z=3.4 produces a well understood and generic evolution in the Lya effective optical depth, where a sudden reduction in the opacity is followed by a gradual, monotonic recovery driven largely by adiabatic cooling in the low density IGM. This behaviour is inconsistent with the narrow feature in the observational data. If photo-heating during HeII reionisation is instead extended over several redshift units, as recent theoretical studies suggest, then the Lya opacity will evolve smoothly with redshift. We conclude that the sharp dip observed in the Lya forest effective optical depth is instead most likely due to a narrow peak in the hydrogen photo-ionisation rate around z=3.2, and suggest that it may arise from the modulation of either reprocessed radiation during HeII reionisation, or the opacity of Lyman limit systems.

We use a combination of analytic and numerical arguments to consider the impact of quasar photo-heating during HeII reionisation on the thermal evolution of the intergalactic medium (IGM). We demonstrate that rapid (\Delta z< 0.1-0.2), strong (\Delta T > 10^4 K) photo-heating is difficult to achieve across the entire IGM unless quasar spectra are significantly harder than implied by current observational constraints. Although filtering of intrinsic quasar radiation through dense regions in the IGM does increase the mean excess energy per HeII photo-ionisation, it also weakens the radiation intensity and lowers the photo-ionisation rate, preventing rapid heating over time intervals shorter than the local photo-ionisation timescale. Moreover, the hard photons responsible for the strongest heating are more likely to deposit their energy inside dense clumps. The abundance of such clumps is, however, uncertain and model-dependent, leading to a fairly large uncertainty in the photo-heating rates. Nevertheless, although some of the IGM may be exposed to a hardened and weakened ionising background for long periods, most of the IGM must instead be reionised by the more abundant, softer photons and with accordingly modest heating rates (\Delta T < 10^4 K). The repeated ionisation of fossil quasar HeIII regions does not increase the net heating because the recombination times in these regions typically exceed the IGM cooling times and the average time lag between successive rounds of quasar activity. Detailed line-of-sight radiative transfer simulations confirm these expectations and predict a rich thermal structure in the IGM during HeII reionisation. [Abridged]

We compare the improved measurement of the Lya forest flux probability distribution at 1.7<z<3.2 presented by Kim et al. (2007) to a large set of hydrodynamical simulations of the Lya forest with different cosmological parameters and thermal histories. The simulations are in good agreement with the observational data if the temperature-density relation for the low density intergalactic medium (IGM), T=T_0 Delta^{gamma-1}, is either close to isothermal or inverted (gamma<1). Our results suggest that the voids in the IGM may be significantly hotter and the thermal state of the low density IGM may be substantially more complex than is usually assumed at these redshifts. We discuss radiative transfer effects which alter the spectral shape of ionising radiation during the epoch of HeII reionisation as a possible physical mechanism for achieving an inverted temperature-density relation at z~3.

We present constraints on the mass of warm dark matter (WDM) particles derived from the Lyman-alpha flux power spectrum of 55 high- resolution HIRES spectra at 2.0 < z < 6.4. From the HIRES spectra, we obtain a lower limit of mwdm > 1.2 keV 2 sigma if the WDM consists of early decoupled thermal relics and mwdm > 5.6 keV (2 sigma) for sterile neutrinos. Adding the Sloan Digital Sky Survey Lyman-alpha flux power spectrum, we get mwdm > 4 keV and mwdm > 28 keV (2 sigma) for thermal relics and sterile neutrinos. These results improve previous constraints by a factor two.

We have performed an extensive Voigt profile analysis of the neutral hydrogen (HI) and metal absorption present in a sample of 18 high resolution, high signal-to-noise QSO spectra observed with VLT/UVES. We use this analysis to separate the metal contribution from the HI absorption and present an improved measurement of the flux probability distribution function (PDF) due to HI absorption alone at <z> = 2.07, 2.52, and 2.94. The flux PDF is sensitive to the continuum fit in the normalised flux range 0.8 < F < 1.0 and to metal absorption at 0.2 < F < 0.8. Our new measurements of the flux PDF due to HI absorption alone are systematically lower at 0.2 < F < 0.8 by up to 30% compared to the widely used measurement of McDonald et al. (2000), based on a significantly smaller sample of Keck/HIRES data. This discrepancy is probably due to a combination of our improved removal of the metal absorption and cosmic variance, since variations in the flux PDF between different lines-of-sight are large. The HI effective optical depth at 1.7 < z < 4 is best fit with a single power law, (0.0023 +-0.0007) (1+z)^(3.65 +- 0.21), in good agreement with previous measurements from comparable data. As also found previously, the effect of noise on the flux distribution is not significant in high resolution, high signal-to-noise data.

We use a large set of hydrodynamical simulations, combined with measurements of the Lyman alpha opacity of the IGM taken from the literature, to obtain robust estimates for the photoionization rate per hydrogen atom at z=5 and 6. We find the photoionization rate drops by a factor of two and four, respectively, compared to our recent measurements at z = 2 - 4. The number of ionizing photons emitted by known sources at z=5 and 6, based on an extrapolation of source numbers below the detection limit and standard assumptions for the relationship between the ionizing emissivity and observed luminosity density at 1500 Angstroms, are in reasonable agreement with the photoionization rates inferred from the Lyman alpha forest if the escape fraction of ionizing photons from galaxies is large (>= 20 per cent). Claims to the contrary may be attributed to the adoption of an unduly high value for the clumping factor of ionized hydrogen. Using physically motivated assumptions for the mean free path of ionizing photons our measurements of the photoionization rate can be turned into an estimate of the ionizing emissivity. In comoving units the inferred ionizing emissivity is nearly constant over the redshift range 2-6 and corresponds to 1.5-3 photons emitted per hydrogen atom over a time interval corresponding to the age of the Universe at z=6. This strongly suggests that the epoch of reionization was photon-starved and extended. [Abridged]

Absorption spectra of high redshift quasars exhibit an increasingly thick Ly-alpha forest towards z~6. However, the interpretation of these spectra is complicated by the fact that the Ly-alpha optical depth is already large for neutral hydrogen fractions in excess of 10^-4, and also because quasars are expected to reside in dense regions of the IGM. We present a model for the evolution of the ionization state of the IGM which is applicable to the dense, biased regions around high-redshift quasars as well as more typical regions in the IGM, and combine this with numerical radiative transfer simulations. Our model is able to simultaneously reproduce the observed Ly-alpha forest opacity at 4<z<6, the ionizing photon mean-free-path at z~4 and the rapid evolution of highly ionized near-zone sizes around high-redshift quasars at 5.8<z<6.4. We find that within 5 physical Mpc of a high redshift quasar, the evolution of the ionization state of the IGM precedes that in more typical regions by around 0.3 redshift units. More importantly, when combined with the rapid increase in the ionizing photon mean-free-path expected shortly after overlap, this offset results in an ionizing background near the quasar which exceeds the value in the rest of the IGM by a factor of ~2-3. We further find that in the post-overlap phase of reionization the size of the observed quasar near-zones is not directly sensitive to the neutral hydrogen fraction of the IGM. Instead, these sizes probe the level of the background ionization rate and the temperature of the surrounding IGM. The observed rapid evolution of the quasar near-zone sizes at 5.8<z<6.4 can thus be explained by the rapid evolution of the ionizing background, which in our model is caused by the completion of overlap at the end of reionization by 6<z<7.

We examine a large set of synthetic quasar spectra to realistically assess the potential of using the relative sizes of highly ionized near-zones in the Lya and Lyb forest as a probe of the neutral hydrogen content of the intergalactic medium (IGM) at z>6. The scatter in the relative near-zone size distribution, induced by underlying fluctuations in the baryonic density field and the filtering of ionizing radiation, is considerable even for fixed assumptions about the IGM neutral fraction. As a consequence, the current observational data cannot distinguish between an IGM which is significantly neutral or highly ionized just above z=6. Under standard assumptions for quasar ages and ionizing luminosities, a future sample of several tens of high resolution Lya and Lyb near-zone spectra should be capable of distinguishing between a volume weighted neutral hydrogen fraction in the IGM which is greater or less than 10 per cent.

We use state-of-the-art hydrodynamical simulations combined with a 1D radiative transfer code to assess the extent to which the highly ionized regions observed close to z~6 quasars, which we refer to as near-zones, can constrain the ionization state of the surrounding IGM. We find the appearance in Lya absorption of a quasar HII ionization front expanding into a neutral IGM can be very similar to a classical proximity zone, produced by the enhancement in ionizing flux close to a quasar embedded in a highly ionized IGM. The observed sizes of these highly ionized near-zones and their redshift evolution can be reproduced for a wide range of IGM neutral hydrogen fractions for plausible values of the luminosity and lifetime of the quasars. The observed near-zone sizes at the highest observed redshifts are equally consistent with a significantly neutral and a highly ionized surrounding IGM. Stronger constraints on the IGM neutral hydrogen fraction can be obtained by considering the relative size of the near-zones in the Lya and Lyb regions of a quasar spectrum. A large sample of high quality quasar absorption spectra with accurate determinations of near-zone sizes and their redshift evolution in both the Lya and Lyb regions should confirm or exclude the possibility that the Universe is predominantly neutral at the highest observed redshifts. The width of the discrete absorption features in these near-zones will contain important additional information on the ionization state and the previous thermal history of the IGM at these redshifts.

The low density hydrogen and helium in the IGM probed by QSO absorption lines is sensitive to the amplitude and spectral shape of the metagalactic UV background. We use realistic HI and HeII Ly-alpha forest spectra, constructed from state-of-the-art hydrodynamical simulations of a Lambda-CDM Universe, to confirm the reliability of using line profile fitting techniques to infer the ratio of the metagalactic HI and HeII ionization rates. We further show that the large spatial variations and the anti-correlation with HI absorber density observed in the ratio of the measured HeII to HI column densities can be explained in a model where the HI ionization rate is dominated by the combined UV emission from young star forming galaxies and QSOs and the HeII ionization rate is dominated by emission from QSOs only. In such a model the large fluctuations in the column density ratio are due to the small number of QSOs expected to contribute at any given point to the HeII ionization rate. A significant contribution to UV emission at the HeII photoelectric edge from hot gas in galaxies and galaxy groups would decrease the expected fluctuations in the column density ratio. Consequently, this model appears difficult to reconcile with the large increase in HeII opacity fluctuations towards higher redshift. Our results further strengthen previous suggestions that observed HeII Ly-alpha forest spectra at z~2-3.5 probe the tail end of the reionization of HeII by QSOs.

Understanding the sources responsible for reionizing the Universe is a key goal of observational cosmology. A discrepancy has existed between the metagalactic hydrogen ionization rate, Gamma_HI, predicted by early hydrodynamical simulations of the Lyman-alpha forest if scaled to appropriate assumptions for the IGM temperature, when compared to values predicted from the proximity effect. We present new estimates for Gamma_HI in the redshift range 2<z<4 based on hydrodynamical simulations of the Lyman-alpha forest opacity. Within the current concordance cosmology, and assuming updated QSO emissivity rates, a substantial contribution to the UV background from young star-forming galaxies appears to be required over the entire redshift range. Our results are consistent with lower-end estimates from the proximity effect. It is also found that the errors on the ionization rate are dominated by uncertainties in the thermal state of the intergalactic medium and the r.m.s fluctuation amplitude at the Jeans scale.

Estimates of the metagalactic hydrogen ionization rate from the Lyman-alpha forest opacity in QSO absorption spectra depend on the complex density distribution of neutral hydrogen along the line-of-sight. We use a large suite of high resolution hydrodynamical simulations to investigate in detail the dependence of such estimates on physical and numerical parameters in the context of Lambda-CDM models. Adopting fiducial values for cosmological parameters together with published values of the temperature of the IGM and the effective optical depth, the metagalactic ionization rates which reproduce the Lyman-alpha effective optical depth at z=[2,3,4] are Gamma_HI=[1.3\pm^0.8_0.5, 0.9\pm0.3, 1.0\pm^0.5_0.3] \times 10^-12 s^-1, respectively. The errors include estimates of uncertainties in the relevant physical parameters and the numerical accuracy of the simulations. We find the errors are dominated by the uncertainty in the temperature of the low-density IGM. The estimated metagalactic hydrogen ionization rate for the neutral hydrogen distribution in the current concordance Lambda-CDM model is more than four times the value inferred for that in an Einstein-de Sitter model of the same r.m.s. density fluctuation amplitude sigma_8. The estimated ionization rate is also more than double that expected from updated estimates of the emissivity of observed QSOs alone. A substantial contribution from galaxies appears to be required at all redshifts.

We use a probabilistic method to compute the propagation of an ionization front corresponding to the re-ionization of the intergalactic medium in a LCDM cosmology, including both hydrogen and helium. The effects of radiative transfer substantially boost the temperature of the ionized gas over the case of uniform re-ionization. The resulting temperature-density relation of the ionized gas is both non-monotonic and multiple-valued, reflecting the non-local character of radiative transfer and suggesting that a single polytropic relation between local gas density and temperatue is a poor description of the thermodynamic state of baryons in the post-reionization universe.