We present the first limits on the Epoch of Reionization (EoR) 21-cm HI power spectra, in the redshift range $z=7.9-10.6$, using the Low-Frequency Array (LOFAR) High-Band Antenna (HBA). In total 13\,h of data were used from observations centred on the North Celestial Pole (NCP). After subtraction of the sky model and the noise bias, we detect a non-zero $\Delta^2_{\rm I} = (56 \pm 13 {\rm mK})^2$ (1-$\sigma$) excess variance and a best 2-$\sigma$ upper limit of $\Delta^2_{\rm 21} < (79.6 {\rm mK})^2$ at $k=0.053$$h$cMpc$^{-1}$ in the range $z=$9.6-10.6. The excess variance decreases when optimizing the smoothness of the direction- and frequency-dependent gain calibration, and with increasing the completeness of the sky model. It is likely caused by (i) residual side-lobe noise on calibration baselines, (ii) leverage due to non-linear effects, (iii) noise and ionosphere-induced gain errors, or a combination thereof. Further analyses of the excess variance will be discussed in forthcoming publications.

LOFAR is the LOw Frequency Radio interferometer ARray located at mid-latitude ($52^{\circ} 53'N$). Here, we present results on ionospheric structures derived from 29 LOFAR nighttime observations during the winters of 2012/2013 and 2013/2014. We show that LOFAR is able to determine differential ionospheric TEC values with an accuracy better than 1 mTECU over distances ranging between 1 and 100 km. For all observations the power law behavior of the phase structure function is confirmed over a long range of baseline lengths, between $1$ and $80$ km, with a slope that is in general larger than the $5/3$ expected for pure Kolmogorov turbulence. The measured average slope is $1.89$ with a one standard deviation spread of $0.1$. The diffractive scale, i.e. the length scale where the phase variance is $1\, \mathrm{rad^2}$, is shown to be an easily obtained single number that represents the ionospheric quality of a radio interferometric observation. A small diffractive scale is equivalent to high phase variability over the field of view as well as a short time coherence of the signal, which limits calibration and imaging quality. For the studied observations the diffractive scales at $150$ MHz vary between $3.5$ and $30\,$ km. A diffractive scale above $5$ km, pertinent to about $90 \%$ of the observations, is considered sufficient for the high dynamic range imaging needed for the LOFAR Epoch of Reionization project. For most nights the ionospheric irregularities were anisotropic, with the structures being aligned with the Earth magnetic field in about $60\%$ of the observations.

Detection of the global HI 21 cm signal from Cosmic Dawn and Epoch of Reionization is the key science driver for several ongoing ground-based and future ground/space-based experiments. The crucial spectral features in the global 21 cm signal (turning points) occur at low radio frequencies <100 MHz. In addition to the human-generated RFI, Earth's ionosphere drastically corrupts low-frequency radio observations from the ground. In this paper, we examine the effects of time-varying ionospheric refraction, absorption and thermal emission at these low radio frequencies and their combined effect on any ground-based global 21 cm experiment. It should be noted that this is the first study of the effect of a dynamic ionosphere on global 21 cm experiments. The fluctuations in the ionosphere are influenced by solar activity with flicker noise characteristics. The same characteristics are reflected in the ionospheric corruption to any radio signal passing through the ionosphere. As a result, any ground based observations of the faint global 21 cm signal are corrupted by flicker noise (or "$1/f$" noise, where "$f$" is the dynamical frequency) which scales as $\nu^{-2}$ (where $\nu$ is the frequency of observation) in the presence of a bright galactic foreground ($\propto \nu^{-s}$, where $s$ is radio spectral index). Hence, the calibration of the ionosphere for any such experiment is critical. Any attempt to calibrate the ionospheric effects will be subject to the inaccuracies in the current ionospheric measurements using GPS ionospheric measurements, riometer measurements, ionospheric soundings, etc. Even considering an optimistic improvement in the accuracy of GPS-TEC (Total Electron Content) measurements, we conclude that the detection of the global 21 cm signal below 100 MHz is best done from above the Earth's atmosphere in orbit of the Moon.

One approach to extracting the global 21-cm signal from total-power measurements at low radio frequencies is to parametrize the different contributions to the data and then fit for these parameters. We examine parametrizations of the 21-cm signal itself, and propose one based on modelling the Lyman-alpha background, IGM temperature and hydrogen ionized fraction using tanh functions. This captures the shape of the signal from a physical modelling code better than an earlier parametrization based on interpolating between maxima and minima of the signal, and imposes a greater level of physical plausibility. This allows less biased constraints on the turning points of the signal, even though these are not explicitly fit for. Biases can also be alleviated by discarding information which is less robustly described by the parametrization, for example by ignoring detailed shape information coming from the covariances between turning points or from the high-frequency parts of the signal, or by marginalizing over the high-frequency parts of the signal by fitting a more complex foreground model. The fits are sufficiently accurate to be usable for experiments gathering 1000 h of data, though in this case it may be important to choose observing windows which do not include the brightest areas of the foregrounds. Our assumption of pointed, single-antenna observations and very broad-band fitting makes these results particularly applicable to experiments such as the Dark Ages Radio Explorer, which would study the global 21-cm signal from the clean environment of a low lunar orbit, taking data from the far side.

Following our previous work, which related generic features in the sky-averaged (global) 21-cm signal to properties of the intergalactic medium, we now investigate the prospects for constraining a simple galaxy formation model with current and near-future experiments. Markov-Chain Monte Carlo fits to our synthetic dataset, which includes a realistic galactic foreground, a plausible model for the signal, and noise consistent with 100 hours of integration by an ideal instrument, suggest that a simple four-parameter model that links the production rate of Lyman-$\alpha$, Lyman-continuum, and X-ray photons to the growth rate of dark matter halos can be well-constrained (to $\sim 0.1$ dex in each dimension) so long as all three spectral features expected to occur between $40 \lesssim \nu / \mathrm{MHz} \lesssim 120$ are detected. Several important conclusions follow naturally from this basic numerical result, namely that measurements of the global 21-cm signal can in principle (i) identify the characteristic halo mass threshold for star formation at all redshifts $z \gtrsim 15$, (ii) extend $z \lesssim 4$ upper limits on the normalization of the X-ray luminosity star-formation rate ($L_X$-SFR) relation out to $z \sim 20$, and (iii) provide joint constraints on stellar spectra and the escape fraction of ionizing radiation at $z \sim 12$. Though our approach is general, the importance of a broad-band measurement renders our findings most relevant to the proposed Dark Ages Radio Explorer, which will have a clean view of the global 21-cm signal from $\sim 40-120$ MHz from its vantage point above the radio-quiet, ionosphere-free lunar far-side.

This study aims to characterize linear polarization structures in LOFAR observations of the interstellar medium (ISM) in the 3C196 field, one of the primary fields of the LOFAR-Epoch of Reionization key science project. We have used the high band antennas (HBA) of LOFAR to image this region and Rotation Measure (RM) synthesis to unravel the distribution of polarized structures in Faraday depth. The brightness temperature of the detected Galactic emission is $5-15~{\rm K}$ in polarized intensity and covers the range from -3 to +8 ${\rm rad~m^{-2}}$ in Faraday depth. The most interesting morphological feature is a strikingly straight filament at a Faraday depth of $+0.5~{\rm rad~m^{-2}}$ running from north to south, right through the centre of the field and parallel to the Galactic plane. There is also an interesting system of linear depolarization canals conspicuous in an image showing the peaks of Faraday spectra. We used the Westerbork Synthesis Radio Telescope (WSRT) at 350 MHz to image the same region. For the first time, we see some common morphology in the RM cubes made at 150 and 350~{\rm MHz}. There is no indication of diffuse emission in total intensity in the interferometric data, in line with results at higher frequencies and previous LOFAR observations. Based on our results, we determined physical parameters of the ISM and proposed a simple model that may explain the observed distribution of the intervening magneto-ionic medium. The mean line-of-sight magnetic field component, $B_\parallel$, is determined to be $0.3\pm0.1~{\rm \mu G}$ and its spatial variation across the 3C196 field is $0.1~{\rm \mu G}$. The filamentary structure is probably an ionized filament in the ISM, located somewhere within the Local Bubble. This filamentary structure shows an excess in thermal electron density ($n_e B_\parallel>6.2~{\rm cm^{-3}\mu G}$) compared to its surroundings.

We investigate the feasibility of detecting 21cm absorption features in the afterglow spectra of high redshift long Gamma Ray Bursts (GRBs). This is done employing simulations of cosmic reionization, together with the instrumental characteristics of the LOw Frequency ARray (LOFAR). We find that absorption features could be marginally (with a S/N larger than a few) detected by LOFAR at z>7 if the GRB originated from PopIII stars, while the detection would be easier if the noise were reduced by one order of magnitude, i.e. similar to what is expected for the first phase of the Square Kilometer Array (SKA1-low). On the other hand, more standard GRBs are too dim to be detected even with ten times the sensitivity of SKA1-low, and only in the most optimistic case can a S/N larger than a few be reached at z>9.

Detection of the 21-cm signal coming from the epoch of reionization (EoR) is challenging especially because, even after removing the foregrounds, the residual Stokes $I$ maps contain leakage from polarized emission that can mimic the signal. Here, we discuss the instrumental polarization of LOFAR and present realistic simulations of the leakages between Stokes parameters. From the LOFAR observations of polarized emission in the 3C196 field, we have quantified the level of polarization leakage caused by the nominal model beam of LOFAR, and compared it with the EoR signal using power spectrum analysis. We found that at 134--166 MHz, within the central 4$^\circ$ of the field the $(Q,U)\rightarrow I$ leakage power is lower than the EoR signal at $k<0.3$ Mpc$^{-1}$. The leakage was found to be localized around a Faraday depth of 0, and the rms of the leakage as a fraction of the rms of the polarized emission was shown to vary between 0.2-0.3\%, both of which could be utilized in the removal of leakage. Moreover, we could define an `EoR window' in terms of the polarization leakage in the cylindrical power spectrum above the PSF-induced wedge and below $k_\parallel\sim 0.5$ Mpc$^{-1}$, and the window extended up to $k_\parallel\sim 1$ Mpc$^{-1}$ at all $k_\perp$ when 70\% of the leakage had been removed. These LOFAR results show that even a modest polarimetric calibration over a field of view of $\lesssim 4^\circ$ in the future arrays like SKA will ensure that the polarization leakage remains well below the expected EoR signal at the scales of 0.02-1 Mpc$^{-1}$.

The precise form of the foregrounds for sky-averaged measurements of the 21-cm line during and before the epoch of reionization is unknown. We suggest that the level of complexity in the foreground models used to fit global 21-cm data should be driven by the data, under a Bayesian model selection methodology. A first test of this approach is carried out by applying nested sampling to simplified models of global 21-cm data to compute the Bayesian evidence for the models. If the foregrounds are assumed to be polynomials of order n in log-log space, we can infer the necessity to use n=4 rather than n=3 with <2h of integration with limited frequency coverage, for reasonable values of the n=4 coefficient. Using a higher-order polynomial does not necessarily prevent a significant detection of the 21-cm signal. Even for n=8, we can obtain very strong evidence distinguishing a reasonable model for the signal from a null model with 128h of integration. More subtle features of the signal may, however, be lost if the foregrounds are this complex. This is demonstrated using a simpler model for the signal that only includes absorption. The results highlight some pitfalls in trying to quantify the significance of a detection from errors on the parameters of the signal alone.

The exceptional sensitivity of the SKA will allow observations of the Cosmic Dawn and Epoch of Reionization (CD/EoR) in unprecedented detail, both spectrally and spatially. This wealth of information is buried under Galactic and extragalactic foregrounds, which must be removed accurately and precisely in order to reveal the cosmological signal. This problem has been addressed already for the previous generation of radio telescopes, but the application to SKA is different in many aspects. In this chapter we summarise the contributions to the field of foreground removal in the context of high redshift and high sensitivity 21-cm measurements. We use a state-of-the-art simulation of the SKA Phase 1 observations complete with cosmological signal, foregrounds and frequency-dependent instrumental effects to test both parametric and non-parametric foreground removal methods. We compare the recovered cosmological signal using several different statistics and explore one of the most exciting possibilities with the SKA --- imaging of the ionized bubbles. We find that with current methods it is possible to remove the foregrounds with great accuracy and to get impressive power spectra and images of the cosmological signal. The frequency-dependent PSF of the instrument complicates this recovery, so we resort to splitting the observation bandwidth into smaller segments, each of a common resolution. If the foregrounds are allowed a random variation from the smooth power law along the line of sight, methods exploiting the smoothness of foregrounds or a parametrization of their behaviour are challenged much more than non-parametric ones. However, we show that correction techniques can be implemented to restore the performances of parametric approaches, as long as the first-order approximation of a power law stands.

We present radio observations of the Moon between $35$ and $80$ MHz to demonstrate a novel technique of interferometrically measuring large-scale diffuse emission extending far beyond the primary beam (global signal) for the first time. In particular, we show that (i) the Moon appears as a negative-flux source at frequencies $35<\nu<80$ MHz since it is `colder' than the diffuse Galactic background it occults, (ii) using the (negative) flux of the lunar disc, we can reconstruct the spectrum of the diffuse Galactic emission with the lunar thermal emission as a reference, and (iii) that reflected RFI (radio-frequency interference) is concentrated at the center of the lunar disc due to specular nature of reflection, and can be independently measured. Our RFI measurements show that (i) Moon-based Cosmic Dawn experiments must design for an Earth-isolation of better than $80$ dB to achieve an RFI temperature $<1$ mK, (ii) Moon-reflected RFI contributes to a dipole temperature less than $20$ mK for Earth-based Cosmic Dawn experiments, (iii) man-made satellite-reflected RFI temperature exceeds $20$ mK if the aggregate cross section of visible satellites exceeds $80$ m$^2$ at $800$ km height, or $5$ m$^2$ at $400$ km height. Currently, our diffuse background spectrum is limited by sidelobe confusion on short baselines (10-15% level). Further refinement of our technique may yield constraints on the redshifted global $21$-cm signal from Cosmic Dawn ($40>z>12$) and the Epoch of Reionization ($12>z>5$).

This study aims to characterise the polarized foreground emission in the ELAIS-N1 field and to address its possible implications for the extraction of the cosmological 21-cm signal from the Low-Frequency Array - Epoch of Reionization (LOFAR-EoR) data. We use the high band antennas of LOFAR to image this region and RM-synthesis to unravel structures of polarized emission at high Galactic latitudes. The brightness temperature of the detected Galactic emission is on average 4 K in polarized intensity and covers the range from -10 to +13rad m^-2 in Faraday depth. The total polarized intensity and polarization angle show a wide range of morphological features. We have also used the Westerbork Synthesis Radio Telescope (WSRT) at 350 MHz to image the same region. The LOFAR and WSRT images show a similar complex morphology, at comparable brightness levels, but their spatial correlation is very low. The fractional polarization at 150 MHz, expressed as a percentage of the total intensity, amounts to 1.5%. There is no indication of diffuse emission in total intensity in the interferometric data, in line with results at higher frequencies. The wide frequency range, good angular resolution and good sensitivity make LOFAR an exquisite instrument for studying Galactic polarized emission at a resolution of 1-2 rad m^-2 in Faraday depth. The different polarised patterns observed at 150 MHz and 350 MHz are consistent with different source distributions along the line of sight wring in a variety of Faraday thin regions of emission. The presence of polarised foregrounds is a serious complication for Epoch of Reionization experiments. To avoid the leakage of polarized emission into total intensity, which can depend on frequency, we need to calibrate the instrumental polarization across the field of view to a small fraction of 1%.

Several experiments are underway to detect the cosmic redshifted 21-cm signal from neutral hydrogen from the Epoch of Reionization (EoR). Due to their very low signal-to-noise ratio, these observations aim for a statistical detection of the signal by measuring its power spectrum. We investigate the extraction of the variance of the signal as a first step towards detecting and constraining the global history of the EoR. Signal variance is the integral of the signal's power spectrum, and it is expected to be measured with a high significance. We demonstrate this through results from a simulation and parameter estimation pipeline developed for the Low Frequency Array (LOFAR)-EoR experiment. We show that LOFAR should be able to detect the EoR in 600 hours of integration using the variance statistic. Additionally, the redshift ($z_r$) and duration ($\Delta z$) of reionization can be constrained assuming a parametrization. We use an EoR simulation of $z_r = 7.68$ and $\Delta z = 0.43$ to test the pipeline. We are able to detect the simulated signal with a significance of 4 standard deviations and extract the EoR parameters as $z_r = 7.72^{+0.37}_{-0.18}$ and $\Delta z = 0.53^{+0.12}_{-0.23}$ in 600 hours, assuming that systematic errors can be adequately controlled. We further show that the significance of detection and constraints on EoR parameters can be improved by measuring the cross-variance of the signal by cross-correlating consecutive redshift bins.

The sky-averaged (global) 21-cm signal is a powerful probe of the intergalactic medium (IGM) prior to the completion of reionization. However, it has so far been unclear that even in the best case scenario, in which the signal is accurately extracted from the foregrounds, that it will provide more than crude estimates of when the Universe's first stars and black holes form. In contrast to previous work, which has focused on predicting the 21-cm signatures of the first luminous objects, we investigate an arbitrary realization of the signal, and attempt to translate its features to the physical properties of the IGM. Within a simplified global framework, the 21-cm signal yields quantitative constraints on the Lyman-alpha background intensity, net heat deposition, ionized fraction, and their time derivatives, without invoking models for the astrophysical sources themselves. The 21-cm absorption signal is most easily interpreted, setting strong limits on the heating rate density of the Universe with a measurement of its redshift alone, independent of the ionization history or details of the Lyman-alpha background evolution. In a companion paper we extend these results, focusing on the confidence with which one can infer source emissivities from IGM properties.

Faint undetected sources of radio-frequency interference (RFI) might become visible in long radio observations when they are consistently present over time. Thereby, they might obstruct the detection of the weak astronomical signals of interest. This issue is especially important for Epoch of Reionisation (EoR) projects that try to detect the faint redshifted HI signals from the time of the earliest structures in the Universe. We explore the RFI situation at 30-163 MHz by studying brightness histograms of visibility data observed with LOFAR, similar to radio-source-count analyses that are used in cosmology. An empirical RFI distribution model is derived that allows the simulation of RFI in radio observations. The brightness histograms show an RFI distribution that follows a power-law distribution with an estimated exponent around -1.5. With several assumptions, this can be explained with a uniform distribution of terrestrial radio sources whose radiation follows existing propagation models. Extrapolation of the power law implies that the current LOFAR EoR observations should be severely RFI limited if the strength of RFI sources remains strong after time integration. This is in contrast with actual observations, which almost reach the thermal noise and are thought not to be limited by RFI. Therefore, we conclude that it is unlikely that there are undetected RFI sources that will become visible in long observations. Consequently, there is no indication that RFI will prevent an EoR detection with LOFAR.

One of the most promising ways to study the epoch of reionization (EoR) is through radio observations of the redshifted 21-cm line emission from neutral hydrogen. These observations are complicated by the fact that the mapping of redshifts to line-of-sight positions is distorted by the peculiar velocities of the gas. Such distortions can be a source of error if they are not properly understood, but they also encode information about cosmology and astrophysics. We study the effects of redshift space distortions on the power spectrum of 21-cm radiation from the EoR using large scale $N$-body and radiative transfer simulations. We quantify the anisotropy introduced in the 21-cm power spectrum by redshift space distortions and show how it evolves as reionization progresses and how it relates to the underlying physics. We go on to study the effects of redshift space distortions on LOFAR observations, taking instrument noise and foreground subtraction into account. We find that LOFAR should be able to directly observe the power spectrum anisotropy due to redshift space distortions at spatial scales around $k \sim 0.1$ Mpc$^{-1}$ after $\gtrsim$ 1000 hours of integration time. At larger scales, sample errors become a limiting factor, while at smaller scales detector noise and foregrounds make the extraction of the signal problematic. Finally, we show how the astrophysical information contained in the evolution of the anisotropy of the 21-cm power spectrum can be extracted from LOFAR observations, and how it can be used to distinguish between different reionization scenarios.

Using a combination of N-body simulations, semi-analytic models and radiative transfer calculations, we have estimated the theoretical cross power spectrum between galaxies and the 21cm emission from neutral hydrogen during the epoch of reionization. In accordance with previous studies, we find that the 21cm emission is initially correlated with halos on large scales (> 30 Mpc), anti-correlated on intermediate (~ 5 Mpc), and uncorrelated on small (< 3 Mpc) scales. This picture quickly changes as reionization proceeds and the two fields become anti-correlated on large scales. The normalization of the cross power spectrum can be used to set constraints on the average neutral fraction in the intergalactic medium and its shape can be a tool to study the topology of reionization. When we apply a drop-out technique to select galaxies and add to the 21cm signal the noise expected from the LOFAR telescope, we find that while the normalization of the cross power spectrum remains a useful tool for probing reionization, its shape becomes too noisy to be informative. On the other hand, for a Lyalpha Emitter (LAE) survey both the normalization and the shape of the cross power spectrum are suitable probes of reionization. A closer look at a specific planned LAE observing program using Subaru Hyper-Suprime Cam reveals concerns about the strength of the 21cm signal at the planned redshifts. If the ionized fraction at z ~ 7 is lower that the one estimated here, then using the cross power spectrum may be a useful exercise given that at higher redshifts and neutral fractions it is able to distinguish between two toy models with different topologies.

The aim of the LOFAR Epoch of Reionization (EoR) project is to detect the spectral fluctuations of the redshifted HI 21cm signal. This signal is weaker by several orders of magnitude than the astrophysical foreground signals and hence, in order to achieve this, very long integrations, accurate calibration for stations and ionosphere and reliable foreground removal are essential. One of the prospective observing windows for the LOFAR EoR project will be centered at the North Celestial Pole (NCP). We present results from observations of the NCP window using the LOFAR highband antenna (HBA) array in the frequency range 115 MHz to 163 MHz. The data were obtained in April 2011 during the commissioning phase of LOFAR. We used baselines up to about 30 km. With about 3 nights, of 6 hours each, effective integration we have achieved a noise level of about 100 microJy/PSF in the NCP window. Close to the NCP, the noise level increases to about 180 microJy/PSF, mainly due to additional contamination from unsubtracted nearby sources. We estimate that in our best night, we have reached a noise level only a factor of 1.4 above the thermal limit set by the noise from our Galaxy and the receivers. Our continuum images are several times deeper than have been achieved previously using the WSRT and GMRT arrays. We derive an analytical explanation for the excess noise that we believe to be mainly due to sources at large angular separation from the NCP.

The accurate and precise removal of 21-cm foregrounds from Epoch of Reionization redshifted 21-cm emission data is essential if we are to gain insight into an unexplored cosmological era. We apply a non-parametric technique, Generalized Morphological Component Analysis or GMCA, to simulated LOFAR-EoR data and show that it has the ability to clean the foregrounds with high accuracy. We recover the 21-cm 1D, 2D and 3D power spectra with high accuracy across an impressive range of frequencies and scales. We show that GMCA preserves the 21-cm phase information, especially when the smallest spatial scale data is discarded. While it has been shown that LOFAR-EoR image recovery is theoretically possible using image smoothing, we add that wavelet decomposition is an efficient way of recovering 21-cm signal maps to the same or greater order of accuracy with more flexibility. By comparing the GMCA output residual maps (equal to the noise, 21-cm signal and any foreground fitting errors) with the 21-cm maps at one frequency and discarding the smaller wavelet scale information, we find a correlation coefficient of 0.689, compared to 0.588 for the equivalently smoothed image. Considering only the central 50% of the maps, these coefficients improve to 0.905 and 0.605 respectively and we conclude that wavelet decomposition is a significantly more powerful method to denoise reconstructed 21-cm maps than smoothing.

We discuss the feasibility of the detection of the 21cm forest in the diffuse IGM with the radio telescope LOFAR. The optical depth to the 21cm line has been derived using simulations of reionization which include detailed radiative transfer of ionizing photons. We find that the spectra from reionization models with similar total comoving hydrogen ionizing emissivity but different frequency distribution look remarkably similar. Thus, unless the reionization histories are very different from each other (e.g. a predominance of UV vs. x-ray heating) we do not expect to distinguish them by means of observations of the 21cm forest. Because the presence of a strong x-ray background would make the detection of 21cm line absorption impossible, the lack of absorption could be used as a probe of the presence/intensity of the x-ray background and the thermal history of the universe. Along a random line of sight LOFAR could detect a global suppression of the spectrum from z>12, when the IGM is still mostly neutral and cold, in contrast with the more well-defined, albeit broad, absorption features visible at lower redshift. Sharp, strong absorption features associated with rare, high density pockets of gas could be detected also at z~7 along preferential lines of sight.

Aims: This paper discusses the spectral occupancy for performing radio astronomy with the Low-Frequency Array (LOFAR), with a focus on imaging observations. Methods: We have analysed the radio-frequency interference (RFI) situation in two 24-h surveys with Dutch LOFAR stations, covering 30-78 MHz with low-band antennas and 115-163 MHz with high-band antennas. This is a subset of the full frequency range of LOFAR. The surveys have been observed with a 0.76 kHz / 1 s resolution. Results: We measured the RFI occupancy in the low and high frequency sets to be 1.8% and 3.2% respectively. These values are found to be representative values for the LOFAR radio environment. Between day and night, there is no significant difference in the radio environment. We find that lowering the current observational time and frequency resolutions of LOFAR results in a slight loss of flagging accuracy. At LOFAR's nominal resolution of 0.76 kHz and 1 s, the false-positives rate is about 0.5%. This rate increases approximately linearly when decreasing the data frequency resolution. Conclusions: Currently, by using an automated RFI detection strategy, the LOFAR radio environment poses no perceivable problems for sensitive observing. It remains to be seen if this is still true for very deep observations that integrate over tens of nights, but the situation looks promising. Reasons for the low impact of RFI are the high spectral and time resolution of LOFAR; accurate detection methods; strong filters and high receiver linearity; and the proximity of the antennas to the ground. We discuss some strategies that can be used once low-level RFI starts to become apparent. It is important that the frequency range of LOFAR remains free of broadband interference, such as DAB stations and windmills.

The first generation of redshifted 21 cm detection experiments, carried out with arrays like LOFAR, MWA and GMRT, will have a very low signal-to-noise ratio per resolution element (\sim 0.2). In addition, whereas the variance of the cosmological signal decreases on scales larger than the typical size of ionization bubbles, the variance of the formidable galactic foregrounds increases, making it hard to disentangle the two on such large scales. The poor sensitivity on small scales on the one hand, and the foregrounds effect on large scales on the other hand, make direct imaging of the Epoch of Reionization of the Universe very difficult, and detection of the signal therefore is expected to be statistical.Despite these hurdles, in this paper we argue that for many reionization scenarios low resolution images could be obtained from the expected data. This is because at the later stages of the process one still finds very large pockets of neutral regions in the IGM, reflecting the clustering of the large-scale structure, which stays strong up to scales of \sim 120 comoving Mpc/h (\sim 1 degree). The coherence of the emission on those scales allows us to reach sufficient S/N (\sim 3) so as to obtain reionization 21 cm images. Such images will be extremely valuable for answering many cosmological questions but above all they will be a very powerful tool to test our control of the systematics in the data. The existence of this typical scale (\sim 120 comoving Mpc/h) also argues for designing future EoR experiments, e.g., with SKA, with a field of view of at least 4 degree.

We introduce a new implementation of the FastICA algorithm on simulated LOFAR EoR data with the aim of accurately removing the foregrounds and extracting the 21-cm reionization signal. We find that the method successfully removes the foregrounds with an average fitting error of 0.5 per cent and that the 2D and 3D power spectra are recovered across the frequency range. We find that for scales above several PSF scales the 21-cm variance is successfully recovered though there is evidence of noise leakage into the reconstructed foreground components. We find that this blind independent component analysis technique provides encouraging results without the danger of prior foreground assumptions.

Efforts are being made to observe the 21-cm signal from the 'cosmic dawn' using sky-averaged observations with individual radio dipoles. In this paper, we develop a model of the observations accounting for the 21-cm signal, foregrounds, and several major instrumental effects. Given this model, we apply Markov Chain Monte Carlo techniques to demonstrate the ability of these instruments to separate the 21-cm signal from foregrounds and quantify their ability to constrain properties of the first galaxies. For concreteness, we investigate observations between 40 and 120 MHz with the proposed DARE mission in lunar orbit, showing its potential for science return.

A concept for a new space-based cosmology mission called the Dark Ages Radio Explore (DARE) is presented in this paper. DARE's science objectives include (1) When did the first stars form? (2) When did the first accreting black holes form? (3) When did Reionization begin? (4) What surprises does the end of the Dark Ages hold (e.g., Dark Matter decay)? DARE will use the highly-redshifted hyperfine 21-cm transition from neutral hydrogen to track the formation of the first luminous objects by their impact on the intergalactic medium during the end of the Dark Ages and during Cosmic Dawn (redshifts z=11-35). It will measure the sky-averaged spin temperature of neutral hydrogen at the unexplored epoch 80-420 million years after the Big Bang, providing the first evidence of the earliest stars and galaxies to illuminate the cosmos and testing our models of galaxy formation. DARE's approach is to measure the expected spectral features in the sky-averaged, redshifted 21-cm signal over a radio bandpass of 40-120 MHz. DARE orbits the Moon for a mission lifetime of 3 years and takes data above the lunar farside, the only location in the inner solar system proven to be free of human-generated radio frequency interference and any significant ionosphere. The science instrument is composed of a three-element radiometer, including electrically-short, tapered, bi-conical dipole antennas, a receiver, and a digital spectrometer. The smooth frequency response of the antennas and the differential spectral calibration approach using a Markov Chain Monte Carlo technique will be applied to detect the weak cosmic 21-cm signal in the presence of the intense solar system and Galactic foreground emissions.

In the coming years a new insight into galaxy formation and the thermal history of the Universe is expected to come from the detection of the highly redshifted cosmological 21 cm line. The cosmological 21 cm line signal is buried under Galactic and extragalactic foregrounds which are likely to be a few orders of magnitude brighter. Strategies and techniques for effective subtraction of these foreground sources require a detailed knowledge of their structure in both intensity and polarization on the relevant angular scales of 1-30 arcmin. We present results from observations conducted with the Westerbork telescope in the 140-160 MHz range with 2 arcmin resolution in two fields located at intermediate Galactic latitude, centred around the bright quasar 3C196 and the North Celestial Pole. They were observed with the purpose of characterizing the foreground properties in sky areas where actual observations of the cosmological 21 cm line could be carried out. The polarization data were analysed through the rotation measure synthesis technique. We have computed total intensity and polarization angular power spectra. Total intensity maps were carefully calibrated, reaching a high dynamic range, 150000:1 in the case of the 3C196 field. [abridged]

One of the aims of the Low Frequency Array (LOFAR) Epoch of Reionization (EoR) project is to measure the power spectrum of variations in the intensity of redshifted 21-cm radiation from the EoR. The sensitivity with which this power spectrum can be estimated depends on the level of thermal noise and sample variance, and also on the systematic errors arising from the extraction process, in particular from the subtraction of foreground contamination. We model the extraction process using realistic simulations of the cosmological signal, the foregrounds and noise, and so estimate the sensitivity of the LOFAR EoR experiment to the redshifted 21-cm power spectrum. Detection of emission from the EoR should be possible within 360 hours of observation with a single station beam. Integrating for longer, and synthesizing multiple station beams within the primary (tile) beam, then enables us to extract progressively more accurate estimates of the power at a greater range of scales and redshifts. We discuss different observational strategies which compromise between depth of observation, sky coverage and frequency coverage. A plan in which lower frequencies receive a larger fraction of the time appears to be promising. We also study the nature of the bias which foreground fitting errors induce on the inferred power spectrum, and discuss how to reduce and correct for this bias. The angular and line-of-sight power spectra have different merits in this respect, and we suggest considering them separately in the analysis of LOFAR data.

We present the first results from a series of observations conducted with the Westerbork telescope in the 140--160 MHz range with a 2 arcmin resolution aimed at characterizing the properties of the foregrounds for epoch of reionization experiments. For the first time we have detected fluctuations in the Galactic diffuse emission on scales greater than 13 arcmin at 150 MHz, in the low Galactic latitude area known as Fan region. Those fluctuations have an $rms$ of 14 K. The total intensity power spectrum shows a power--law behaviour down to $\ell \sim 900$ with slope $\beta^I_\ell = -2.2 \pm 0.3$. The detection of diffuse emission at smaller angular scales is limited by residual point sources. We measured an $rms$ confusion noise of $\sim$3 mJy beam$^{-1}$. Diffuse polarized emission was also detected for the first time at this frequency. The polarized signal shows complex structure both spatially and along the line of sight. The polarization power spectrum shows a power--law behaviour down to $\ell \sim 2700$ with slope $\beta^P_\ell = -1.65 \pm 0.15$. The $rms$ of polarization fluctuations is 7.2 K on 4 arcmin scales. By extrapolating the measured spectrum of total intensity emission, we find a contamination on the cosmological signal of $\delta T= \sqrt{\ell (\ell+1) C^I_\ell / 2\pi} \sim 5.7$ K on 5 arcmin scales and a corresponding $rms$ value of $\sim$18.3 K at the same angular scale. The level of the polarization power spectrum is $\delta T \sim 3.3$ K on 5 arcmin scales. Given its exceptionally bright polarized signal, the Fan region is likely to represent an upper limit on the sky brightness at moderate and high Galactic latitude.

An obstacle to the detection of redshifted 21cm emission from the epoch of reionization (EoR) is the presence of foregrounds which exceed the cosmological signal in intensity by orders of magnitude. We argue that in principle it would be better to fit the foregrounds non-parametrically - allowing the data to determine their shape - rather than selecting some functional form in advance and then fitting its parameters. Non-parametric fits often suffer from other problems, however. We discuss these before suggesting a non-parametric method, Wp smoothing, which seems to avoid some of them. After outlining the principles of Wp smoothing we describe an algorithm used to implement it. We then apply Wp smoothing to a synthetic data cube for the LOFAR EoR experiment. The performance of Wp smoothing, measured by the extent to which it is able to recover the variance of the cosmological signal and to which it avoids leakage of power from the foregrounds, is compared to that of a parametric fit, and to another non-parametric method (smoothing splines). We find that Wp smoothing is superior to smoothing splines for our application, and is competitive with parametric methods even though in the latter case we may choose the functional form of the fit with advance knowledge of the simulated foregrounds. Finally, we discuss how the quality of the fit is affected by the frequency resolution and range, by the characteristics of the cosmological signal and by edge effects.

Detecting redshifted 21cm emission from neutral hydrogen in the early Universe promises to give direct constraints on the epoch of reionization (EoR). It will, though, be very challenging to extract the cosmological signal (CS) from foregrounds and noise which are orders of magnitude larger. Fortunately, the signal has some characteristics which differentiate it from the foregrounds and noise, and we suggest that using the correct statistics may tease out signatures of reionization. We generate mock datacubes simulating the output of the Low Frequency Array (LOFAR) EoR experiment. These cubes combine realistic models for Galactic and extragalactic foregrounds and the noise with three different simulations of the CS. We fit out the foregrounds, which are smooth in the frequency direction, to produce residual images in each frequency band. We denoise these images and study the skewness of the one-point distribution in the images as a function of frequency. We find that, under sufficiently optimistic assumptions, we can recover the main features of the redshift evolution of the skewness in the 21cm signal. We argue that some of these features - such as a dip at the onset of reionization, followed by a rise towards its later stages - may be generic, and give us a promising route to a statistical detection of reionization.

A number of experiments are set to measure the 21-cm signal of neutral hydrogen from the Epoch of Reionization (EoR). The common denominator of these experiments are the large data sets produced, contaminated by various instrumental effects, ionospheric distortions, RFI and strong Galactic and extragalactic foregrounds. In this paper, the first in a series, we present the Data Model that will be the basis of the signal analysis for the LOFAR (Low Frequency Array) EoR Key Science Project (LOFAR EoR KSP). Using this data model we simulate realistic visibility data sets over a wide frequency band, taking properly into account all currently known instrumental corruptions (e.g. direction-dependent gains, complex gains, polarization effects, noise, etc). We then apply primary calibration errors to the data in a statistical sense, assuming that the calibration errors are random Gaussian variates at a level consistent with our current knowledge based on observations with the LOFAR Core Station 1. Our aim is to demonstrate how the systematics of an interferometric measurement affect the quality of the calibrated data, how errors correlate and propagate, and in the long run how this can lead to new calibration strategies. We present results of these simulations and the inversion process and extraction procedure. We also discuss some general properties of the coherency matrix and Jones formalism that might prove useful in solving the calibration problem of aperture synthesis arrays. We conclude that even in the presence of realistic noise and instrumental errors, the statistical signature of the EoR signal can be detected by LOFAR with relatively small errors. A detailed study of the statistical properties of our data model and more complex instrumental models will be considered in the future.

We present an efficient method to generate large simulations of the Epoch of Reionization (EoR) without the need for a full 3-dimensional radiative transfer code. Large dark-matter-only simulations are post-processed to produce maps of the redshifted 21cm emission from neutral hydrogen. Dark matter haloes are embedded with sources of radiation whose properties are either based on semi-analytical prescriptions or derived from hydrodynamical simulations. These sources could either be stars or power-law sources with varying spectral indices. Assuming spherical symmetry, ionized bubbles are created around these sources, whose radial ionized fraction and temperature profiles are derived from a catalogue of 1-D radiative transfer experiments. In case of overlap of these spheres, photons are conserved by redistributing them around the connected ionized regions corresponding to the spheres. The efficiency with which these maps are created allows us to span the large parameter space typically encountered in reionization simulations. We compare our results with other, more accurate, 3-D radiative transfer simulations and find excellent agreement for the redshifts and the spatial scales of interest to upcoming 21cm experiments. We generate a contiguous observational cube spanning redshift 6 to 12 and use these simulations to study the differences in the reionization histories between stars and quasars. Finally, the signal is convolved with the LOFAR beam response and its effects are analyzed and quantified. Statistics performed on this mock data set shed light on possible observational strategies for LOFAR.

Future high redshift 21-cm experiments will suffer from a high degree of contamination, due both to astrophysical foregrounds and to non-astrophysical and instrumental effects. In order to reliably extract the cosmological signal from the observed data, it is essential to understand very well all data components and their influence on the extracted signal. Here we present simulated astrophysical foregrounds datacubes and discuss their possible statistical effects on the data. The foreground maps are produced assuming 5 deg x 5 deg windows that match those expected to be observed by the LOFAR Epoch-of-Reionization (EoR) key science project. We show that with the expected LOFAR-EoR sky and receiver noise levels, which amount to ~52 mK at 150 MHz after 300 hours of total observing time, a simple polynomial fit allows a statistical reconstruction of the signal. We also show that the polynomial fitting will work for maps with realistic yet idealised instrument response, i.e., a response that includes only a uniform uv coverage as a function of frequency and ignores many other uncertainties. Polarized galactic synchrotron maps that include internal polarization and a number of Faraday screens along the line of sight are also simulated. The importance of these stems from the fact that the LOFAR instrument, in common with all current interferometric EoR experiments has an instrumentally polarized response.

We generate mock galaxy catalogues for a grid of different cosmologies, using rescaled N-body simulations in tandem with a semi-analytic model run using consistent parameters. Because we predict the galaxy bias, rather than fitting it as a nuisance parameter, we obtain an almost pure constraint on sigma_8 by comparing the projected two-point correlation function we obtain to that from the SDSS. A systematic error arises because different semi-analytic modelling assumptions allow us to fit the r-band luminosity function equally well. Combining our estimate of the error from this source with the statistical error, we find sigma_8=0.97 +/- 0.06. We obtain consistent results if we use galaxy samples with a different magnitude threshold, or if we select galaxies by b_J-band rather than r-band luminosity and compare to data from the 2dFGRS. Our estimate for sigma_8 is higher than that obtained for other analyses of galaxy data alone, and we attempt to find the source of this difference. We note that in any case, galaxy clustering data provide a very stringent constraint on galaxy formation models.

We study the environmental dependence of the formation epoch of dark matter haloes in the Millennium Simulation: a ten billion particle N-body simulation of standard LambdaCDM cosmology. A sensitive test of this dependence - the marked correlation function - reveals highly significant evidence that haloes of a given mass form earlier in denser regions. We define a marked cross-correlation function, which helps quantify how this effect depends upon the choice of the halo population used to define the environment. The mean halo formation redshift as a function of the local overdensity in dark matter is also well determined, and we see an especially clear dependence for galaxy-sized haloes. This contradicts one of the basic predictions of the excursion set model of structure formation, even though we see that this theory predicts other features of the distribution of halo formation epochs rather well. It also invalidates an assumption usually employed in the popular halo, or HOD, models of galaxy clustering, namely that the distribution of halo properties is a function of halo mass but not of halo environment.