LOFAR is the LOw Frequency Radio interferometer ARray located at mid-latitude ($52^{\circ} 53'N$). Here, we present results on ionospheric structures derived from 29 LOFAR nighttime observations during the winters of 2012/2013 and 2013/2014. We show that LOFAR is able to determine differential ionospheric TEC values with an accuracy better than 1 mTECU over distances ranging between 1 and 100 km. For all observations the power law behavior of the phase structure function is confirmed over a long range of baseline lengths, between $1$ and $80$ km, with a slope that is in general larger than the $5/3$ expected for pure Kolmogorov turbulence. The measured average slope is $1.89$ with a one standard deviation spread of $0.1$. The diffractive scale, i.e. the length scale where the phase variance is $1\, \mathrm{rad^2}$, is shown to be an easily obtained single number that represents the ionospheric quality of a radio interferometric observation. A small diffractive scale is equivalent to high phase variability over the field of view as well as a short time coherence of the signal, which limits calibration and imaging quality. For the studied observations the diffractive scales at $150$ MHz vary between $3.5$ and $30\,$ km. A diffractive scale above $5$ km, pertinent to about $90 \%$ of the observations, is considered sufficient for the high dynamic range imaging needed for the LOFAR Epoch of Reionization project. For most nights the ionospheric irregularities were anisotropic, with the structures being aligned with the Earth magnetic field in about $60\%$ of the observations.

This study aims to characterize linear polarization structures in LOFAR observations of the interstellar medium (ISM) in the 3C196 field, one of the primary fields of the LOFAR-Epoch of Reionization key science project. We have used the high band antennas (HBA) of LOFAR to image this region and Rotation Measure (RM) synthesis to unravel the distribution of polarized structures in Faraday depth. The brightness temperature of the detected Galactic emission is $5-15~{\rm K}$ in polarized intensity and covers the range from -3 to +8 ${\rm rad~m^{-2}}$ in Faraday depth. The most interesting morphological feature is a strikingly straight filament at a Faraday depth of $+0.5~{\rm rad~m^{-2}}$ running from north to south, right through the centre of the field and parallel to the Galactic plane. There is also an interesting system of linear depolarization canals conspicuous in an image showing the peaks of Faraday spectra. We used the Westerbork Synthesis Radio Telescope (WSRT) at 350 MHz to image the same region. For the first time, we see some common morphology in the RM cubes made at 150 and 350~{\rm MHz}. There is no indication of diffuse emission in total intensity in the interferometric data, in line with results at higher frequencies and previous LOFAR observations. Based on our results, we determined physical parameters of the ISM and proposed a simple model that may explain the observed distribution of the intervening magneto-ionic medium. The mean line-of-sight magnetic field component, $B_\parallel$, is determined to be $0.3\pm0.1~{\rm \mu G}$ and its spatial variation across the 3C196 field is $0.1~{\rm \mu G}$. The filamentary structure is probably an ionized filament in the ISM, located somewhere within the Local Bubble. This filamentary structure shows an excess in thermal electron density ($n_e B_\parallel>6.2~{\rm cm^{-3}\mu G}$) compared to its surroundings.

We investigate the feasibility of detecting 21cm absorption features in the afterglow spectra of high redshift long Gamma Ray Bursts (GRBs). This is done employing simulations of cosmic reionization, together with the instrumental characteristics of the LOw Frequency ARray (LOFAR). We find that absorption features could be marginally (with a S/N larger than a few) detected by LOFAR at z>7 if the GRB originated from PopIII stars, while the detection would be easier if the noise were reduced by one order of magnitude, i.e. similar to what is expected for the first phase of the Square Kilometer Array (SKA1-low). On the other hand, more standard GRBs are too dim to be detected even with ten times the sensitivity of SKA1-low, and only in the most optimistic case can a S/N larger than a few be reached at z>9.

The Square Kilometre Array (SKA) will form the largest radio telescope ever built and such a huge instrument in the desert poses enormous engineering and logistic challenges. Algorithmic and architectural breakthroughs are needed. Data is collected and processed in groups of antennas before transport for central processing. This processing includes beamforming, primarily so as to reduce the amount of data sent. The principal existing technique points to a region of interest independently of the sky model and how the other stations beamform. We propose a new collaborative beamforming algorithm in order to maximize information captured at the stations (thus reducing the amount of data transported). The method increases the diversity in measurements through randomized beam- forming. We demonstrate through numerical simulation the effectiveness of the method. In particular, we show that randomized beamforming can achieve the same image quality while producing 40% less data when compared to the prevailing method matched beamforming.

We present radio observations of the Moon between $35$ and $80$ MHz to demonstrate a novel technique of interferometrically measuring large-scale diffuse emission extending far beyond the primary beam (global signal) for the first time. In particular, we show that (i) the Moon appears as a negative-flux source at frequencies $35<\nu<80$ MHz since it is `colder' than the diffuse Galactic background it occults, (ii) using the (negative) flux of the lunar disc, we can reconstruct the spectrum of the diffuse Galactic emission with the lunar thermal emission as a reference, and (iii) that reflected RFI (radio-frequency interference) is concentrated at the center of the lunar disc due to specular nature of reflection, and can be independently measured. Our RFI measurements show that (i) Moon-based Cosmic Dawn experiments must design for an Earth-isolation of better than $80$ dB to achieve an RFI temperature $<1$ mK, (ii) Moon-reflected RFI contributes to a dipole temperature less than $20$ mK for Earth-based Cosmic Dawn experiments, (iii) man-made satellite-reflected RFI temperature exceeds $20$ mK if the aggregate cross section of visible satellites exceeds $80$ m$^2$ at $800$ km height, or $5$ m$^2$ at $400$ km height. Currently, our diffuse background spectrum is limited by sidelobe confusion on short baselines (10-15% level). Further refinement of our technique may yield constraints on the redshifted global $21$-cm signal from Cosmic Dawn ($40>z>12$) and the Epoch of Reionization ($12>z>5$).

This study aims to characterise the polarized foreground emission in the ELAIS-N1 field and to address its possible implications for the extraction of the cosmological 21-cm signal from the Low-Frequency Array - Epoch of Reionization (LOFAR-EoR) data. We use the high band antennas of LOFAR to image this region and RM-synthesis to unravel structures of polarized emission at high Galactic latitudes. The brightness temperature of the detected Galactic emission is on average 4 K in polarized intensity and covers the range from -10 to +13rad m^-2 in Faraday depth. The total polarized intensity and polarization angle show a wide range of morphological features. We have also used the Westerbork Synthesis Radio Telescope (WSRT) at 350 MHz to image the same region. The LOFAR and WSRT images show a similar complex morphology, at comparable brightness levels, but their spatial correlation is very low. The fractional polarization at 150 MHz, expressed as a percentage of the total intensity, amounts to 1.5%. There is no indication of diffuse emission in total intensity in the interferometric data, in line with results at higher frequencies. The wide frequency range, good angular resolution and good sensitivity make LOFAR an exquisite instrument for studying Galactic polarized emission at a resolution of 1-2 rad m^-2 in Faraday depth. The different polarised patterns observed at 150 MHz and 350 MHz are consistent with different source distributions along the line of sight wring in a variety of Faraday thin regions of emission. The presence of polarised foregrounds is a serious complication for Epoch of Reionization experiments. To avoid the leakage of polarized emission into total intensity, which can depend on frequency, we need to calibrate the instrumental polarization across the field of view to a small fraction of 1%.

Several experiments are underway to detect the cosmic redshifted 21-cm signal from neutral hydrogen from the Epoch of Reionization (EoR). Due to their very low signal-to-noise ratio, these observations aim for a statistical detection of the signal by measuring its power spectrum. We investigate the extraction of the variance of the signal as a first step towards detecting and constraining the global history of the EoR. Signal variance is the integral of the signal's power spectrum, and it is expected to be measured with a high significance. We demonstrate this through results from a simulation and parameter estimation pipeline developed for the Low Frequency Array (LOFAR)-EoR experiment. We show that LOFAR should be able to detect the EoR in 600 hours of integration using the variance statistic. Additionally, the redshift ($z_r$) and duration ($\Delta z$) of reionization can be constrained assuming a parametrization. We use an EoR simulation of $z_r = 7.68$ and $\Delta z = 0.43$ to test the pipeline. We are able to detect the simulated signal with a significance of 4 standard deviations and extract the EoR parameters as $z_r = 7.72^{+0.37}_{-0.18}$ and $\Delta z = 0.53^{+0.12}_{-0.23}$ in 600 hours, assuming that systematic errors can be adequately controlled. We further show that the significance of detection and constraints on EoR parameters can be improved by measuring the cross-variance of the signal by cross-correlating consecutive redshift bins.

One of the most promising ways to study the epoch of reionization (EoR) is through radio observations of the redshifted 21-cm line emission from neutral hydrogen. These observations are complicated by the fact that the mapping of redshifts to line-of-sight positions is distorted by the peculiar velocities of the gas. Such distortions can be a source of error if they are not properly understood, but they also encode information about cosmology and astrophysics. We study the effects of redshift space distortions on the power spectrum of 21-cm radiation from the EoR using large scale $N$-body and radiative transfer simulations. We quantify the anisotropy introduced in the 21-cm power spectrum by redshift space distortions and show how it evolves as reionization progresses and how it relates to the underlying physics. We go on to study the effects of redshift space distortions on LOFAR observations, taking instrument noise and foreground subtraction into account. We find that LOFAR should be able to directly observe the power spectrum anisotropy due to redshift space distortions at spatial scales around $k \sim 0.1$ Mpc$^{-1}$ after $\gtrsim$ 1000 hours of integration time. At larger scales, sample errors become a limiting factor, while at smaller scales detector noise and foregrounds make the extraction of the signal problematic. Finally, we show how the astrophysical information contained in the evolution of the anisotropy of the 21-cm power spectrum can be extracted from LOFAR observations, and how it can be used to distinguish between different reionization scenarios.

A major stage of radio interferometric data processing is calibration or the estimation of systematic errors in the data and the correction for such errors. A stochastic error (noise) model is assumed, and in most cases, this underlying model is assumed to be Gaussian. However, outliers in the data due to interference or due to errors in the sky model would have adverse effects on processing based on a Gaussian noise model. Most of the shortcomings of calibration such as the loss in flux or coherence, and the appearance of spurious sources, could be attributed to the deviations of the underlying noise model. In this paper, we propose to improve the robustness of calibration by using a noise model based on Student's t distribution. Student's t noise is a special case of Gaussian noise when the variance is unknown. Unlike Gaussian noise model based calibration, traditional least squares minimization would not directly extend to a case when we have a Student's t noise model. Therefore, we use a variant of the Expectation Maximization (EM) algorithm, called the Expectation-Conditional Maximization Either (ECME) algorithm when we have a Student's t noise model and use the Levenberg-Marquardt algorithm in the maximization step. We give simulation results to show the robustness of the proposed calibration method as opposed to traditional Gaussian noise model based calibration, especially in preserving the flux of weaker sources that are not included in the calibration model.

The main objective of this work is to accelerate the Maximum-Likelihood (ML) estimation procedure in radio interferometric calibration. We introduce the OS-LS and the OS-SAGE radio interferometric calibration methods, as a combination of the Ordered-Subsets (OS) method with the Least-Squares (LS) and Space Alternating Generalized Expectation maximization (SAGE) calibration techniques, respectively. The OS algorithm speeds up the ML estimation and achieves nearly the same level of accuracy of solutions as the one obtained by the non-OS methods. We apply the OS-LS and OS-SAGE calibration methods to simulated observations and show that these methods have a much higher convergence rate relative to the conventional LS and SAGE techniques. Moreover, the obtained results show that the OS-SAGE calibration technique has a superior performance compared to the OS-LS calibration method in the sense of achieving more accurate results while having significantly less computational cost.

Using a combination of N-body simulations, semi-analytic models and radiative transfer calculations, we have estimated the theoretical cross power spectrum between galaxies and the 21cm emission from neutral hydrogen during the epoch of reionization. In accordance with previous studies, we find that the 21cm emission is initially correlated with halos on large scales (> 30 Mpc), anti-correlated on intermediate (~ 5 Mpc), and uncorrelated on small (< 3 Mpc) scales. This picture quickly changes as reionization proceeds and the two fields become anti-correlated on large scales. The normalization of the cross power spectrum can be used to set constraints on the average neutral fraction in the intergalactic medium and its shape can be a tool to study the topology of reionization. When we apply a drop-out technique to select galaxies and add to the 21cm signal the noise expected from the LOFAR telescope, we find that while the normalization of the cross power spectrum remains a useful tool for probing reionization, its shape becomes too noisy to be informative. On the other hand, for a Lyalpha Emitter (LAE) survey both the normalization and the shape of the cross power spectrum are suitable probes of reionization. A closer look at a specific planned LAE observing program using Subaru Hyper-Suprime Cam reveals concerns about the strength of the 21cm signal at the planned redshifts. If the ionized fraction at z ~ 7 is lower that the one estimated here, then using the cross power spectrum may be a useful exercise given that at higher redshifts and neutral fractions it is able to distinguish between two toy models with different topologies.

The aim of the LOFAR Epoch of Reionization (EoR) project is to detect the spectral fluctuations of the redshifted HI 21cm signal. This signal is weaker by several orders of magnitude than the astrophysical foreground signals and hence, in order to achieve this, very long integrations, accurate calibration for stations and ionosphere and reliable foreground removal are essential. One of the prospective observing windows for the LOFAR EoR project will be centered at the North Celestial Pole (NCP). We present results from observations of the NCP window using the LOFAR highband antenna (HBA) array in the frequency range 115 MHz to 163 MHz. The data were obtained in April 2011 during the commissioning phase of LOFAR. We used baselines up to about 30 km. With about 3 nights, of 6 hours each, effective integration we have achieved a noise level of about 100 microJy/PSF in the NCP window. Close to the NCP, the noise level increases to about 180 microJy/PSF, mainly due to additional contamination from unsubtracted nearby sources. We estimate that in our best night, we have reached a noise level only a factor of 1.4 above the thermal limit set by the noise from our Galaxy and the receivers. Our continuum images are several times deeper than have been achieved previously using the WSRT and GMRT arrays. We derive an analytical explanation for the excess noise that we believe to be mainly due to sources at large angular separation from the NCP.

The new generation of radio synthesis arrays, such as LOFAR and SKA, have been designed to surpass existing arrays in terms of sensitivity, angular resolution and frequency coverage. This evolution has led to the development of advanced calibration techniques that ensure the delivery of accurate results at the lowest possible computational cost. However, the performance of such calibration techniques is still limited by the compact, bright sources in the sky, used as calibrators. It is important to have a bright enough source that is well distinguished from the background noise level in order to achieve satisfactory results in calibration. We present "clustered calibration" as a modification to traditional radio interferometric calibration, in order to accommodate faint sources that are almost below the background noise level into the calibration process. The main idea is to employ the information of the bright sources' measured signals as an aid to calibrate fainter sources that are nearby the bright sources. In the case where we do not have bright enough sources, a source cluster could act as a bright source that can be distinguished from background noise. We construct a number of source clusters assuming that the signals of the sources belonging to a single cluster are corrupted by almost the same errors, and each cluster is calibrated as a single source, using the combined coherencies of its sources simultaneously. This upgrades the power of an individual faint source by the effective power of its cluster. We give performance analysis of clustered calibration to show the superiority of this approach compared to the traditional unclustered calibration. We also provide analytical criteria to choose the optimum number of clusters for a given observation in an efficient manner.

We discuss the feasibility of the detection of the 21cm forest in the diffuse IGM with the radio telescope LOFAR. The optical depth to the 21cm line has been derived using simulations of reionization which include detailed radiative transfer of ionizing photons. We find that the spectra from reionization models with similar total comoving hydrogen ionizing emissivity but different frequency distribution look remarkably similar. Thus, unless the reionization histories are very different from each other (e.g. a predominance of UV vs. x-ray heating) we do not expect to distinguish them by means of observations of the 21cm forest. Because the presence of a strong x-ray background would make the detection of 21cm line absorption impossible, the lack of absorption could be used as a probe of the presence/intensity of the x-ray background and the thermal history of the universe. Along a random line of sight LOFAR could detect a global suppression of the spectrum from z>12, when the IGM is still mostly neutral and cold, in contrast with the more well-defined, albeit broad, absorption features visible at lower redshift. Sharp, strong absorption features associated with rare, high density pockets of gas could be detected also at z~7 along preferential lines of sight.

Aims: This paper discusses the spectral occupancy for performing radio astronomy with the Low-Frequency Array (LOFAR), with a focus on imaging observations. Methods: We have analysed the radio-frequency interference (RFI) situation in two 24-h surveys with Dutch LOFAR stations, covering 30-78 MHz with low-band antennas and 115-163 MHz with high-band antennas. This is a subset of the full frequency range of LOFAR. The surveys have been observed with a 0.76 kHz / 1 s resolution. Results: We measured the RFI occupancy in the low and high frequency sets to be 1.8% and 3.2% respectively. These values are found to be representative values for the LOFAR radio environment. Between day and night, there is no significant difference in the radio environment. We find that lowering the current observational time and frequency resolutions of LOFAR results in a slight loss of flagging accuracy. At LOFAR's nominal resolution of 0.76 kHz and 1 s, the false-positives rate is about 0.5%. This rate increases approximately linearly when decreasing the data frequency resolution. Conclusions: Currently, by using an automated RFI detection strategy, the LOFAR radio environment poses no perceivable problems for sensitive observing. It remains to be seen if this is still true for very deep observations that integrate over tens of nights, but the situation looks promising. Reasons for the low impact of RFI are the high spectral and time resolution of LOFAR; accurate detection methods; strong filters and high receiver linearity; and the proximity of the antennas to the ground. We discuss some strategies that can be used once low-level RFI starts to become apparent. It is important that the frequency range of LOFAR remains free of broadband interference, such as DAB stations and windmills.

The first generation of redshifted 21 cm detection experiments, carried out with arrays like LOFAR, MWA and GMRT, will have a very low signal-to-noise ratio per resolution element (\sim 0.2). In addition, whereas the variance of the cosmological signal decreases on scales larger than the typical size of ionization bubbles, the variance of the formidable galactic foregrounds increases, making it hard to disentangle the two on such large scales. The poor sensitivity on small scales on the one hand, and the foregrounds effect on large scales on the other hand, make direct imaging of the Epoch of Reionization of the Universe very difficult, and detection of the signal therefore is expected to be statistical.Despite these hurdles, in this paper we argue that for many reionization scenarios low resolution images could be obtained from the expected data. This is because at the later stages of the process one still finds very large pockets of neutral regions in the IGM, reflecting the clustering of the large-scale structure, which stays strong up to scales of \sim 120 comoving Mpc/h (\sim 1 degree). The coherence of the emission on those scales allows us to reach sufficient S/N (\sim 3) so as to obtain reionization 21 cm images. Such images will be extremely valuable for answering many cosmological questions but above all they will be a very powerful tool to test our control of the systematics in the data. The existence of this typical scale (\sim 120 comoving Mpc/h) also argues for designing future EoR experiments, e.g., with SKA, with a field of view of at least 4 degree.

This paper introduces an amendment to radio interferometric calibration of sources below the noise level. The main idea is to employ the information of the stronger sources' measured signals as a plug-in criterion to solve for the weaker ones. For this purpose, we construct a number of source clusters, with centroids mainly near the strongest sources, assuming that the signals of the sources belonging to a single cluster are corrupted by almost the same errors. Due to this characteristic of clusters, each cluster is calibrated as a single source, using all the coherencies of its sources simultaneously. The obtained solutions for every cluster are assigned to all the cluster's sources. An illustrative example reveals the superiority of this calibration compared to the un-clustered calibration.

The aim of the new generation of radio synthesis arrays such as LOFAR and SKA is to achieve much higher sensitivity, resolution and frequency coverage than what is available now, especially at low frequencies. To accomplish this goal, the accuracy of the calibration techniques used is of considerable importance. Moreover, since these telescopes produce huge amounts of data, speed of convergence of calibration is a major bottleneck. The errors in calibration are due to system noise (sky and instrumental) as well as the estimation errors introduced by the calibration technique itself, which we call solver noise. We define solver noise as the distance between the optimal solution (the true value of the unknowns, uncorrupted by the system noise) and the solution obtained by calibration. We present the Space Alternating Generalized Expectation Maximization (SAGE) calibration technique, which is a modification of the Expectation Maximization algorithm, and compare its performance with the traditional Least Squares calibration based on the level of solver noise introduced by each technique. For this purpose, we develop statistical methods that use the calibrated solutions to estimate the level of solver noise. The SAGE calibration algorithm yields very promising results both in terms of accuracy and speed of convergence. The comparison approaches we adopt introduce a new framework for assessing the performance of different calibration schemes.