A new upper limit on the 21-cm signal power spectrum at a redshift of $z \approx 9.1$ is presented, based on 141 hours of data obtained with the Low-Frequency Array (LOFAR). The analysis includes significant improvements in spectrally-smooth gain-calibration, Gaussian Process Regression (GPR) foreground mitigation and optimally-weighted power spectrum inference. Previously seen `excess power' due to spectral structure in the gain solutions has markedly reduced but some excess power still remains with a spectral correlation distinct from thermal noise. This excess has a spectral coherence scale of $0.25 - 0.45$\,MHz and is partially correlated between nights, especially in the foreground wedge region. The correlation is stronger between nights covering similar local sidereal times. A best 2-$\sigma$ upper limit of $\Delta^2_{21} < (73)^2\,\mathrm{mK^2}$ at $k = 0.075\,\mathrm{h\,cMpc^{-1}}$ is found, an improvement by a factor $\approx 8$ in power compared to the previously reported upper limit. The remaining excess power could be due to residual foreground emission from sources or diffuse emission far away from the phase centre, polarization leakage, chromatic calibration errors, ionosphere, or low-level radio-frequency interference. We discuss future improvements to the signal processing chain that can further reduce or even eliminate these causes of excess power.

Observations of the redshifted 21-cm hyperfine line of neutral hydrogen from early phases of the Universe such as Cosmic Dawn and the Epoch of Reionization promise to open a new window onto the early formation of stars and galaxies. We present the first upper limits on the power spectrum of redshifted 21-cm brightness temperature fluctuations in the redshift range $z = 19.8 - 25.2$ ($54-68$ MHz frequency range) using 14 hours of data obtained with the LOFAR-Low Band Antenna (LBA) array. We also demonstrate the application of a multiple pointing calibration technique to calibrate the LOFAR-LBA dual-pointing observations centred on the North Celestial Pole and the radio galaxy 3C220.3. We observe an unexplained excess of $\sim 30-50\%$ in Stokes $I$ noise compared to Stokes $V$ for the two observed fields, which decorrelates on $\gtrsim 12$ seconds and might have a physical origin. We show that enforcing smoothness of gain errors along frequency direction during calibration reduces the additional variance in Stokes $I$ compared Stokes $V$ introduced by the calibration on sub-band level. After subtraction of smooth foregrounds, we achieve a $2\sigma$ upper limit on the 21-cm power spectrum of $\Delta_{21}^2 < (14561\,\text{mK})^2$ at $k\sim 0.038\,h\,\text{cMpc}^{-1}$ and $\Delta_{21}^2 < (14886\,\text{mK})^2$ at $k\sim 0.038 \,h\,\text{cMpc}^{-1}$ for the 3C220 and NCP fields respectively and both upper limits are consistent with each other. The upper limits for the two fields are still dominated by systematics on most $k$ modes.

Calibration is a key step in the signal processing pipeline of any radio astronomical instrument. The required sky, ionospheric and instrumental models for this step can suffer from various kinds of incompleteness. In this paper we analyze several important calibration methods, ignoring for now the ionosphere. The aim is to use established statistical and signal processing tools to provide a generic method to assess calibratability of an instrument. We show how currently popular calibration techniques differ in their assumptions and also discuss their theoretical commonalities. We also study the effect of only using a sub-set of baselines on the calibration and provide theoretical methods to analyze excess noise and biases that it might introduce. In order to simplify the physical interpretation of the results, we introduce a new signal processing model which is capable of modeling instrumental direction dependent effects and spectral smoothness of the individual receiver gain within a beam-formed station. The statistical properties of this model are then studied by deriving the Cram\'er--Rao bound (CRB). We finally define a mathematical framework for calibratability of an instrument based on the model used which is generic and can be used to study different instruments. These theoretical results are then verified using numerical simulations.

The 21-cm signal of neutral hydrogen - emitted during the Epoch of Reionization - promises to be an important source of information for the study of the infant universe. However, its detection is impossible without sufficient mitigation of other strong signals in the data, which requires an accurate knowledge of the instrument. Using the result of instrument calibration, a large part of the contaminating signals are removed and the resulting residual data is further analyzed in order to detect the 21-cm signal. Direction dependent calibration (DDC) can strongly affect the 21-cm signal, however, its effect has not been precisely quantified. In the analysis presented here we show how to exactly calculate what part of the 21-cm signal is removed as a result of the DDC. We also show how a-priori information about the frequency behavior of the instrument can be used to reduce signal suppression. The theoretical results are tested using a realistic simulation based on the LOFAR setup. Our results show that low-order smooth gain functions (e.g. polynomials) over a bandwidth of ~10\,MHz - over which the signal is expected to be stationary - is sufficient to allow for calibration with limited, quantifiable, signal suppression in its power spectrum. We also show mathematically and in simulations that more incomplete sky models lead to larger 21-cm signal suppression, even if the gain models are enforced to be fully smooth. This result has immediate consequences for current and future radio telescopes with non-identical station beams, where DDC might be necessary (e.g. SKA-low).

Having an accurate calibration method is crucial for any scientific research done by a radio telescope. The next generation radio telescopes such as the Square Kilometre Array (SKA) will have a large number of receivers which will produce exabytes of data per day. In this paper we propose new direction-dependent and independent calibration algorithms that, while requiring much less storage during calibration, converge very fast. The calibration problem can be formulated as a non-linear least square optimization problem. We show that combining a block-LDU decomposition with Gauss-Newton iterations produces systems of equations with convergent matrices. This allows significant reduction in complexity per iteration and very fast converging algorithms. We also discuss extensions to direction-dependent calibration. The proposed algorithms are evaluated using simulations.

For subspace estimation with an unknown colored noise, Factor Analysis (FA) is a good candidate for replacing the popular eigenvalue decomposition (EVD). Finding the unknowns in factor analysis can be done by solving a non-linear least square problem. For this type of optimization problems, the Gauss-Newton (GN) algorithm is a powerful and simple method. The most expensive part of the GN algorithm is finding the direction of descent by solving a system of equations at each iteration. In this paper we show that for FA, the matrices involved in solving these systems of equations can be diagonalized in a closed form fashion and the solution can be found in a computationally efficient way. We show how the unknown parameters can be updated without actually constructing these matrices. The convergence performance of the algorithm is studied via numerical simulations.

Image formation for radio astronomy can be defined as estimating the spatial power distribution of celestial sources over the sky, given an array of antennas. One of the challenges with image formation is that the problem becomes ill-posed as the number of pixels becomes large. The introduction of constraints that incorporate a-priori knowledge is crucial. In this paper we show that in addition to non-negativity, the magnitude of each pixel in an image is also bounded from above. Indeed, the classical "dirty image" is an upper bound, but a much tighter upper bound can be formed from the data using array processing techniques. This formulates image formation as a least squares optimization problem with inequality constraints. We propose to solve this constrained least squares problem using active set techniques, and the steps needed to implement it are described. It is shown that the least squares part of the problem can be efficiently implemented with Krylov subspace based techniques, where the structure of the problem allows massive parallelism and reduced storage needs. The performance of the algorithm is evaluated using simulations.