Reconstruction techniques for intrinsic quasar continua are crucial for the precision study of Lyman-$\alpha$ (Ly-$\alpha$) and Lyman-$\beta$ (Ly-$\beta$) transmission at $z>5.0$, where the $\lambda<1215 A$ emission of quasars is nearly completely absorbed. While the number and quality of spectroscopic observations has become theoretically sufficient to quantify Ly-$\alpha$ transmission at $5.0<z<6.0$ to better than $1\%$, the biases and uncertainties arising from predicting the unabsorbed continuum are not known to the same level. In this paper, we systematically evaluate eight reconstruction techniques on a unified testing sample of $2.7<z<3.5$ quasars drawn from eBOSS. The methods include power-law extrapolation, stacking of neighbours, and six variants of Principal Component Analysis (PCA) using direct projection, fitting of components, or neural networks to perform weight mapping. We find that power-law reconstructions and the PCA with fewest components and smallest training sample display the largest biases in the Ly-$\alpha$ forest ($-9.58\%/+8.22\%$ respectively). Power-law extrapolations have larger scatters than previously assumed of $+13.1\%/-13.2\%$ over Ly-$\alpha$ and $+19.9\%/-20.1\%$ over Ly-$\beta$. We present two new PCAs which achieve the best current accuracies of $9\%$ for Ly-$\alpha$ and $17\%$ for Ly-$\beta$. We apply the eight techniques after accounting for wavelength-dependent biases and scatter to a sample $19$ quasars at $z>5.7$ with IR X-Shooter spectroscopy, obtaining well-characterised measurements for the mean flux transmission at $4.7<z<6.3$. Our results demonstrate the importance of testing and, when relevant, training, continuum reconstruction techniques in a systematic way.

Observations of the early Universe suggest that reionization was complete by $z\sim6$, however, the exact history of this process is still unknown. One method for measuring the evolution of the neutral fraction throughout this epoch is via observing the Ly$\alpha$ damping wings of high-redshift quasars. In order to constrain the neutral fraction from quasar observations, one needs an accurate model of the quasar spectrum around Ly$\alpha$, after the spectrum has been processed by its host galaxy but before it is altered by absorption and damping in the intervening IGM. In this paper, we present a novel machine learning approach, using artificial neural networks, to reconstruct quasar continua around Ly$\alpha$. Our QSANNdRA algorithm improves the error in this reconstruction compared to the state-of-the-art PCA-based model in the literature by 14.2% on average, and provides an improvement of 6.1% on average when compared to an extension thereof. In comparison with the extended PCA model, QSANNdRA further achieves an improvement of 22.1% and 16.8% when evaluated on low-redshift quasars most similar to the two high-redshift quasars under consideration, ULAS J1120+0641 at $z=7.0851$ and ULAS J1342+0928 at $z=7.5413$, respectively. Using our more accurate reconstructions of these two $z>7$ quasars, we estimate the neutral fraction of the IGM using a homogeneous reionization model and find $\bar{x}_\mathrm{HI} = 0.25^{+0.05}_{-0.05}$ at $z=7.0851$ and $\bar{x}_\mathrm{HI} = 0.60^{+0.11}_{-0.11}$ at $z=7.5413$. Our results are consistent with the literature and favour a rapid end to reionization.

The decline in abundance of Lyman-$\alpha$ (Ly$\alpha$) emitting galaxies at $z \gtrsim 6$ is a powerful and commonly used probe to constrain the progress of cosmic reionization. We use the CoDaII simulation, which is a radiation hydrodynamic simulation featuring a box of $\sim 94$ comoving Mpc side length, to compute the Ly$\alpha$ transmission properties of the intergalactic medium (IGM) at $z\sim 5.8$ to $7$. Our results mainly confirm previous studies, i.e., we find a declining Ly$\alpha$ transmission with redshift and a large sightline-to-sightline variation. However, motivated by the recent discovery of blue Ly$\alpha$ peaks at high redshift, we also analyze the IGM transmission on the blue side, which shows a rapid decline at $z\gtrsim 6$ of the blue transmission. This low transmission can be attributed not only to the presence of neutral regions but also to the residual neutral hydrogen within ionized regions, for which a density even as low as $n_{\rm HI}\sim 10^{-9}\,\mathrm{cm}^{-3}$ (sometimes combined with kinematic effects) leads to a significantly reduced visibility. Still, we find that $\sim 5\%$ of sightlines towards $M_{\mathrm{1600AB}}\sim -21$ galaxies at $z\sim 7$ are transparent enough to allow a transmission of a blue Ly$\alpha$ peak. We discuss our results in the context of the interpretation of observations.

We present improved results of the measurement of the correlation between galaxies and the intergalactic medium (IGM) transmission at the end of reionisation. We have gathered a sample of $13$ spectroscopically confirmed Lyman-break galaxies (LBGs) and $21$ Lyman-$\alpha$ emitters (LAEs) at angular separations $20'' \lesssim \theta \lesssim 10'$ ($\sim 0.1-4$ pMpc at $z\sim 6$) from the sightlines to $8$ background $z\gtrsim 6$ quasars. We report for the first time the detection of an excess of Lyman-$\alpha$ transmission spikes at $\sim 10-60$ cMpc from LAEs ($3.2\sigma$) and LBGs ($1.9\sigma$). We interpret the data with an improved model of the galaxy-Lyman-$\alpha$ transmission and two-point cross-correlations which includes the enhanced photoionisation due to clustered faint sources, enhanced gas densities around the central bright objects and spatial variations of the mean free path. The observed LAE(LBG)-Lyman-$\alpha$ transmission spike two-point cross-correlation function (2PCCF) constrains the luminosity-averaged escape fraction of all galaxies contributing to reionisation to $\langle f_{\rm esc} \rangle_{M_{\rm UV}<-12} = 0.14_{-0.05}^{+0.28}\,(0.23_{-0.12}^{+0.46})$. We investigate if the 2PCCF measurement can determine whether bright or faint galaxies are the dominant contributors to reionisation. Our results show that a contribution from faint galaxies ($M_{\rm UV} > -20 \, (2\sigma)$) is necessary to reproduce the observed 2PCCF and that reionisation might be driven by different sub-populations around LBGs and LAEs at $z\sim 6$.

We present a computationally efficient and fast semi-numerical technique for simulating the Lyman-$\alpha$ (Ly$\alpha$) absorption optical depth in presence of neutral hydrogen "islands" leftover from reionization at redshifts $5 \lesssim z \lesssim 6$. The main inputs to the analysis are (i) a semi-numerical photon-conserving model of ionized regions during reionization (named SCRIPT) and (ii) the fluctuating Gunn-Peterson approximation to model the Ly$\alpha$ absorption. Our model is then used for simulating the large-scale fluctuations in the effective optical depth as observed along sight lines towards high$-z$ quasars. We find that the model, with fiducial choice of free parameters, is in agreement with the results from more detailed radiative transfer simulations. By varying the free parameters, we obtain the constraints on reionization history at $5 \lesssim z \lesssim 6$ as allowed by the data. We confirm that reionization is not complete before $z \sim 5.6$ and the completion can be as late as $z \sim 5.2$ (both within $2-\sigma$), the exact limits depending on how the non-detections of the flux in the data are treated. With further improvements in the model and with more sight lines at $z \sim 6$, we can take advantage of the computational efficiency of our analysis to obtain more stringent constraints at the tail-end of reionization.

Observations of the redshift z=7.085 quasar J1120+0641 have been used to search for variations of the fine structure constant, alpha, over the redshift range 5.5 to 7.1. Observations at z=7.1 probe the physics of the universe when it was only 0.8 billion years old. These are the most distant direct measurements of alpha to date and the first measurements made with a near-IR spectrograph. A new AI analysis method has been employed. Four measurements from the X-SHOOTER spectrograph on the European Southern Observatory's Very Large Telescope (VLT) directly constrain any changes in alpha relative to the value measured on Earth (alpha_0). The weighted mean strength of the electromagnetic force over this redshift range in this location in the universe is da/a = (alpha_z - alpha_0)/alpha_0 = (-2.18 +/- 7.27) X 10^{-5}, i.e. we find no evidence for a temporal change from the 4 new very high redshift measurements. When the 4 new measurements are combined with a large existing sample of lower redshift measurements, a new limit on possible spatial variation of da/a is marginally preferred over a no-variation model at the 3.7 sigma level.

Quasar proximity zones at $z>5.5$ correspond to over-dense and over-ionized environments. Galaxies found inside proximity zones can therefore display features which would otherwise be masked by absorption in the IGM. We demonstrate the utility of this quasar-galaxy synergy by reporting the discovery of the first three `proximate Lyman-$\alpha$ emitters' (LAEs) within the proximity zone of quasar J0836 at $z=5.802$ (\textit{Aerith A, B} and \textit{C}). \textit{Aerith A}, located behind the quasar with an impact parameter $D_\perp = 278$ pkpc, provides the first detection of a Lyman-$\alpha$ transverse proximity effect. We model the transmission and show it constrains the onset of J0836's quasar phase to $0.2 \text{Myr}<t<20\text{Myr}$ in the past. The second object, \textit{Aerith B} at a distance $D=750$ pkpc from the quasar, displays a bright, broad double-peaked \lal emission line. Based on relations calibrated at $z\leq3$, the peak separation implies a low ionizing $f_{\text{esc}} \lesssim 1\%$, the most direct such constraint on a reionization-era galaxy. We fit the Ly-$\alpha$ line with an outflowing shell model, finding a completely typical central density $\text{log N}_{\text{HI}}/\text{cm}^{-2} = 19.3_{-0.2}^{+0.8}$, outflow velocity $v=16_{-11}^{+4}$ km s$^{-1}$, and gas temperature $\text{log} T/\text{K} = 3.8_{-0.7}^{+0.8}$ compared to $2<z<3$ analogue LAEs. Finally, we detect an emission line at $\lambda=8177$ \AA\ in object \textit{Aerith C} which, if it is \lal at $z=5.726$, would correspond closely with the end of the quasar's proximity zone ($\Delta z<0.02$ from the boundary) and suggests the quasar influences the IGM up to $\sim85$ cMpc away, making it the largest quasar proximity zone. Via the analyses conducted here, we illustrate how proximate LAEs offer unique insight into the ionizing properties of both quasars and galaxies during the epoch of reionization.

We present the results of a model-independent investigation of the rest-frame UV spectra from a comprehensive sample of $394$ quasars in the redshift range $1.5\leq z \leq 7.5$. We fit the main Broad Emission Lines (BELs) in the rest-frame range $1280 \text{\AA} \leq \lambda \leq 3000 \text{\AA}$ (O I, C II, Si IV, C III, C IV and Mg II) with a lightly-supervised spline fitting technique. Redshifts are derived from the peaks of each fitted BEL and used to compute relative velocity shifts. We show that our method gives unbiased velocity shifts and is insensitive to spectral resolution and instrumental parameters. It is found that the average blueshift of the \cfour\, line with respect to several low-ionisation lines in luminosity-matched samples does not significantly evolve over $1.5\gtrsim z\gtrsim6$. However, the average blueshift increases significantly by a factor $\sim 2.5$ at $z\gtrsim 6$. We propose that this redshift evolution can be explained by \cfour\, winds launched perpendicularly to an accretion disk with increased torus opacity at high-redshift, coupled with a potential orientation-driven selection bias. Our results open new exciting avenues of investigation into young quasars in the reionisation epoch.

We report the discovery of the first spectroscopically resolved C II /C II* 1334, 1335A doublet in the Lyman-break galaxy J0215-0555 at z = 5.754. The separation of the resonant and fluorescent emission channels was possible thanks to the large redshift of the source and long integration time, as well as the small velocity width of the feature, 0.6 +- 0.2A. We model this emission and find that at least two components are required to reproduce the combination of morphologies of C II* emission, C II absorption and emission, and Lyman-alpha emission from the object. We suggest that the close alignment between the fluorescence and Lyman-alpha emission could indicate an ionisation escape channel within the object. While the faintness of such a C II /C II* doublet makes it prohibitively difficult to pursue for similar systems with current facilities, we suggest it can become a valuable porosity diagnostic in the era of JWST and the upcoming generations of ELTs.

High-redshift QSO spectra show large spatial fluctuations in the Ly-alpha opacity of the intergalactic medium on surprisingly large scales at z>~5.5. We present a radiative transfer simulation of cosmic reionization driven by galaxies that reproduces this large scatter and the rapid evolution of the Ly-alpha opacity distribution at 5<z<6. The simulation also reproduces the low Thomson scattering optical depth reported by the latest CMB measurement and is consistent with the observed short near-zones and strong red damping wings in the highest-redshift QSOs. It also matches the rapid disappearance of observed Ly-alpha emission by galaxies at z>~6. Reionization is complete at z=5.3 in our model, and 50% of the volume of the Universe is ionized at z=7. Agreement with the Ly-alpha forest data in such a late reionization model requires a rapid evolution of the ionizing emissivity of galaxies that peaks at z~6.8. The late end of reionization results in a large scatter in the photoionisation rate and the neutral hydrogen fraction at redshifts as low as z<~5.5 with large residual neutral 'islands' that can produce very long Gunn-Peterson troughs resembling those seen in the data.

We present a new method to study the contribution of faint sources to the UV background using the 1D correlation of metal absorbers with the intergalactic medium (IGM) transmission in a Quasi Stellar Object (QSO) sightline. We take advantage of a sample of $25$ high signal-to-noise ratio QSO spectra to retrieve $150$ triply-ionised carbon (\cfour) absorbers at $4.5\lesssim z\lesssim 6.2$, of which $37$ systems whose expected H{~\small I} absorption lie in the Lyman-$\alpha$ forest. We derive improved constraints on the cosmic density of \cfour \,at $4.3< z < 6.2$ and infer from abundance-matching that \cfour \,absorbers trace $M_{\text{UV}}\lesssim -16$ galaxies. Correlation with the Lyman-$\alpha$ forest of the QSOs indicates that these objects are surrounded by a highly opaque region at $r\lesssim 5 $ cMpc/h followed by an excess of transmission at $r\gtrsim 10$ cMpc/h detected at $2.7\sigma$. This is in contrast to equivalent measurements at lower redshifts where only the opaque trough is detected. We interpret this excess as a statistical enhancement of the local photoionisation rate due to clustered faint galaxies around the \cfour \,absorbers. Using the analytical framework described in Paper I of this series, we derive a constraint on the average product of the escape fraction and the Lyman continuum photon production efficiency of the galaxy population clustered around the \cfour \,absorbers, $\log \langle f_{\text{esc}}\xi_{\text{ion}}\rangle /[{\rm erg^{-1}~Hz}] = 25.01^{+0.30}_{-0.19}$. This implies that faint galaxies beyond the reach of current facilities may have harder radiation fields and/or larger escape fractions than currently detected objects at the end of the reionisation epoch.

We present measurements of the mean and scatter of the IGM Lyman-{\alpha} opacity at 4.9 < z < 6.1 along the lines of sight of 62 quasars at z > 5.7, the largest sample assembled at these redshifts to date by a factor of two. The sample size enables us to sample cosmic variance at these redshifts more robustly than ever before. The spectra used here were obtained by the SDSS, DES-VHS and SHELLQs collaborations, drawn from the ESI and X-Shooter archives, reused from previous studies or observed specifically for this work. We measure the effective optical depth of Lyman-{\alpha} in bins of 10, 30, 50 and 70 cMpc h-1, construct cumulative distribution functions under two treatments of upper limits on flux and explore an empirical analytic fit to residual Lyman-{\alpha} transmission. We verify the consistency of our results with those of previous studies via bootstrap re-sampling and confirm the existence of tails towards high values in the opacity distributions, which may persist down to z = 5.2. Comparing our results with predictions from cosmological simulations, we find further strong evidence against models that include a spatially uniform ionizing background and temperature-density relation. We also compare to IGM models that include either a fluctuating UVB dominated by rare quasars or temperature fluctuations due to patchy reionization. Although both models produce better agreement with the observations, neither fully captures the observed scatter in IGM opacity. Our sample of 62 z > 5.7 quasar spectra opens many avenues for future study of the reionisation epoch.

We introduce a new method for determining the influence of galaxies and active galactic nuclei (AGN) on the physical state of the intergalactic medium (IGM) at high redshift and illustrate its potential via a first application to the field of the $z=6.42$ QSO J1148+5251. By correlating the spatial positions of spectroscopically-confirmed Lyman break galaxies (LBGs) with fluctuations in the Lyman alpha forest seen in the high signal-to-noise spectrum of a background QSO, we provide a statistical measure of the typical escape fraction of Lyman continuum photons close to the end of cosmic reionisation. Here we use Keck DEIMOS spectroscopy to locate 7 colour-selected LBGs in the redshift range $5.3\lesssim z\lesssim 6.4$ and confirm a faint $z=5.701$ AGN. We then examine the spatial correlation between this sample and Ly$\alpha$/Ly$\beta$ transmission fluctuations in a Keck ESI spectrum of the QSO. Interpreting the statistical HI proximity effect as arising from faint galaxies clustered around the detected LBGs, we translate the observed mean Ly$\alpha$ transmitted flux around an average detected LBG into a constraint on the mean escape fraction $\langle f_{\rm esc}\rangle\geq0.08$ at $z\simeq6$. We also report evidence of the individual transverse HI proximity effect of a $z=6.177$ luminous LBG via a Ly$\beta$ transmission spike and two broad Ly$\alpha$ transmission spikes around the $z=5.701$ AGN. We discuss the possible origin of such associations which suggest that while faint galaxies are primarily driving reionisation, luminous galaxies and AGN may provide important contributions to the UV background or thermal fluctuations of the IGM at $z\simeq6$. Although a limited sample, our results demonstrate the potential of making progress using this method in resolving one of the most challenging aspects of the contribution of galaxies and AGN to cosmic reionisation.

High-signal to noise observations of the Ly$\alpha$ forest transmissivity in the z = 7.085 QSO ULAS J1120+0641 show seven narrow transmission spikes followed by a long 240 cMpc/h trough. Here we use radiative transfer simulations of cosmic reionization previously calibrated to match a wider range of Ly$\alpha$ forest data to show that the occurrence of seven transmission spikes in the narrow redshift range z = 5.85 - 6.1 is very sensitive to the exact timing of reionization. Occurrence of the spikes requires the most under dense regions of the IGM to be already fully ionised. The rapid onset of a long trough at z = 6.12 requires a strong decrease of the photo-ionisation rate at z$\sim$6.1 in this line-of-sight, consistent with the end of percolation at this redshift. The narrow range of reionisation histories that we previously found to be consistent with a wider range of Ly$\alpha$ forest data have a reasonable probability of showing seven spikes and the mock absorption spectra provide an excellent match to the spikes and the trough in the observed spectrum of ULAS J1120+0641. Despite the large overall opacity of Ly$\alpha$ at z > 5.8, larger samples of high signal-to-noise observations of rare transmission spikes should therefore provide important further insights into the exact timing of the percolation of HII bubbles at the tail-end of reionization

We present a search for metal absorption line systems at the highest redshifts to date using a deep (30h) VLT/X-Shooter spectrum of the z = 7.084 quasi-stellar object (QSO) ULAS J1120+0641. We detect seven intervening systems at z > 5.5, with the highest-redshift system being a C IV absorber at z = 6.51. We find tentative evidence that the mass density of C IV remains flat or declines with redshift at z < 6, while the number density of C II systems remains relatively flat over 5 < z < 7. These trends are broadly consistent with models of chemical enrichment by star formation-driven winds that include a softening of the ultraviolet background towards higher redshifts. We find a larger number of weak ( W_rest < 0.3A ) Mg II systems over 5.9 < z < 7.0 than predicted by a power-law fit to the number density of stronger systems. This is consistent with trends in the number density of weak Mg II systems at z = 2.5, and suggests that the mechanisms that create these absorbers are already in place at z = 7. Finally, we investigate the associated narrow Si IV, C IV, and N V absorbers located near the QSO redshift, and find that at least one component shows evidence of partial covering of the continuum source.

Signs of damping wing absorption attenuating the Lyman-$\alpha$ emission line of the first known $z \sim 7$ quasar, ULAS J1120+0641, recently provided exciting evidence of a significantly neutral IGM. This long-awaited signature of reionization was inferred, in part, from a deficit of flux in the quasar's Lyman-$\alpha$ emission line based on predictions from a composite of lower-redshift quasars. The composite sample was chosen based on its C IV emission line properties; however, as the original study by Mortlock et al. noted, the composite contained a slight velocity offset in C IV compared to ULAS J1120+0641. Here we test whether this offset may be related to the predicted strength of the Lyman-$\alpha$ emission line. We confirm the significant ($\sim 10$ per cent at r.m.s.) scatter in Lyman-$\alpha$ flux for quasars of a given C IV velocity and equivalent width found by Mortlock et al. We further find that among lower-redshift objects chosen to more closely match the C IV properties of ULAS J1120+0641, its Lyman-$\alpha$ emission falls within the observed distribution of fluxes. Among lower-redshift quasars chosen to more closely match in C IV velocity and equivalent width, we find that ULAS J1120+0641 falls within the observed distribution of Lyman-$\alpha$ emission line strengths. This suggests that damping wing absorption may not be present, potentially weakening the case for neutral gas around this object. Larger samples of z$>$7 quasars may therefore be needed to establish a clearer picture of the IGM neutral fraction at these redshifts.

We present the combination of optical data from the Science Verification phase of the Dark Energy Survey (DES) with near infrared data from the ESO VISTA Hemisphere Survey (VHS). The deep optical detections from DES are used to extract fluxes and associated errors from the shallower VHS data. Joint 7-band ($grizYJK$) photometric catalogues are produced in a single 3 sq-deg DECam field centred at 02h26m$-$04d36m where the availability of ancillary multi-wavelength photometry and spectroscopy allows us to test the data quality. Dual photometry increases the number of DES galaxies with measured VHS fluxes by a factor of $\sim$4.5 relative to a simple catalogue level matching and results in a $\sim$1.5 mag increase in the 80\% completeness limit of the NIR data. Almost 70\% of DES sources have useful NIR flux measurements in this initial catalogue. Photometric redshifts are estimated for a subset of galaxies with spectroscopic redshifts and initial results, although currently limited by small number statistics, indicate that the VHS data can help reduce the photometric redshift scatter at both $z<0.5$ and $z>1$. We present example DES+VHS colour selection criteria for high redshift Luminous Red Galaxies (LRGs) at $z\sim0.7$ as well as luminous quasars. Using spectroscopic observations in this field we show that the additional VHS fluxes enable a cleaner selection of both populations with $<$10\% contamination from galactic stars in the case of spectroscopically confirmed quasars and $<0.5\%$ contamination from galactic stars in the case of spectroscopically confirmed LRGs. The combined DES+VHS dataset, which will eventually cover almost 5000 sq-deg, will therefore enable a range of new science and be ideally suited for target selection for future wide-field spectroscopic surveys.