The past two decades saw a renewed interest in low frequency radio astronomy, with a particular focus on frequencies above 30 MHz. However, at frequencies below 30 MHz, Earth-based observations are limited due to a combination of severe ionospheric distortions, almost full reflection of radio waves below 10 MHz, solar eruptions and human-made radio frequency interference (RFI). A space or Lunar-based ultra-low-frequency (or ultra-long-wavelength, ULW) array would suffer significantly less from these limitations and hence would open up the last, virtually unexplored frequency domain in the electromagnetic spectrum. A roadmap has been initiated in order to explore the opportunity of building a swarm of satellites to observe at the frequency band below 30 MHz. This roadmap, dubbed Orbiting Low Frequency Antennas for Radio Astronomy (OLFAR), presents a space-based ultra-low frequency radio telescope that will explore the Universe's so-called dark ages, map the interstellar medium, and study planetary and solar bursts in the solar system and search them in other planetary systems. Such a system will comprise of a swarm of hundreds to thousands of satellites, working together as a single aperture synthesis instrument deployed sufficiently far away from Earth to avoid terrestrial RFI. A number of key technologies of OLFAR are still to be developed and proven. The first step in this roadmap is the NCLE (Netherlands China Low Frequency Explorer) experiment launched in May 2018 on the Chinese Chang'e-4 mission. The NCLE payload consists of a three monopole antenna system from which the first data stream is expected in the second half of 2019, which will provide important feedback for future science and technology opportunities. In this paper, the roadmap towards OLFAR, a brief overview of the science opportunities, and the technological and programmatic challenges of the mission are presented.

Having an accurate calibration method is crucial for any scientific research done by a radio telescope. The next generation radio telescopes such as the Square Kilometre Array (SKA) will have a large number of receivers which will produce exabytes of data per day. In this paper we propose new direction-dependent and independent calibration algorithms that, while requiring much less storage during calibration, converge very fast. The calibration problem can be formulated as a non-linear least square optimization problem. We show that combining a block-LDU decomposition with Gauss-Newton iterations produces systems of equations with convergent matrices. This allows significant reduction in complexity per iteration and very fast converging algorithms. We also discuss extensions to direction-dependent calibration. The proposed algorithms are evaluated using simulations.

For subspace estimation with an unknown colored noise, Factor Analysis (FA) is a good candidate for replacing the popular eigenvalue decomposition (EVD). Finding the unknowns in factor analysis can be done by solving a non-linear least square problem. For this type of optimization problems, the Gauss-Newton (GN) algorithm is a powerful and simple method. The most expensive part of the GN algorithm is finding the direction of descent by solving a system of equations at each iteration. In this paper we show that for FA, the matrices involved in solving these systems of equations can be diagonalized in a closed form fashion and the solution can be found in a computationally efficient way. We show how the unknown parameters can be updated without actually constructing these matrices. The convergence performance of the algorithm is studied via numerical simulations.

The past decade has seen the rise of various radio astronomy arrays, particularly for low-frequency observations below 100MHz. These developments have been primarily driven by interesting and fundamental scientific questions, such as studying the dark ages and epoch of re-ionization, by detecting the highly red-shifted 21cm line emission. However, Earth-based radio astronomy below frequencies of 30MHz is severely restricted due to man-made interference, ionospheric distortion and almost complete non-transparency of the ionosphere below 10MHz. Therefore, this narrow spectral band remains possibly the last unexplored frequency range in radio astronomy. A straightforward solution to study the universe at these frequencies is to deploy a space-based antenna array far away from Earths' ionosphere. Various studies in the past were principally limited by technology and computing resources, however current processing and communication trends indicate otherwise. We briefly present the achievable science cases, and discuss the system design for selected scenarios, such as extra-galactic surveys. An extensive discussion is presented on various sub-systems of the potential satellite array, such as radio astronomical antenna design, the on-board signal processing, communication architectures and joint space-time estimation of the satellite network. In light of a scalable array and to avert single point of failure, we propose both centralized and distributed solutions for the ULW space-based array. We highlight the benefits of various deployment locations and summarize the technological challenges for future space-based radio arrays.

Image formation for radio astronomy can be defined as estimating the spatial power distribution of celestial sources over the sky, given an array of antennas. One of the challenges with image formation is that the problem becomes ill-posed as the number of pixels becomes large. The introduction of constraints that incorporate a-priori knowledge is crucial. In this paper we show that in addition to non-negativity, the magnitude of each pixel in an image is also bounded from above. Indeed, the classical "dirty image" is an upper bound, but a much tighter upper bound can be formed from the data using array processing techniques. This formulates image formation as a least squares optimization problem with inequality constraints. We propose to solve this constrained least squares problem using active set techniques, and the steps needed to implement it are described. It is shown that the least squares part of the problem can be efficiently implemented with Krylov subspace based techniques, where the structure of the problem allows massive parallelism and reduced storage needs. The performance of the algorithm is evaluated using simulations.

LOFAR, the LOw-Frequency ARray, is a new-generation radio interferometer constructed in the north of the Netherlands and across europe. Utilizing a novel phased-array design, LOFAR covers the largely unexplored low-frequency range from 10-240 MHz and provides a number of unique observing capabilities. Spreading out from a core located near the village of Exloo in the northeast of the Netherlands, a total of 40 LOFAR stations are nearing completion. A further five stations have been deployed throughout Germany, and one station has been built in each of France, Sweden, and the UK. Digital beam-forming techniques make the LOFAR system agile and allow for rapid repointing of the telescope as well as the potential for multiple simultaneous observations. With its dense core array and long interferometric baselines, LOFAR achieves unparalleled sensitivity and angular resolution in the low-frequency radio regime. The LOFAR facilities are jointly operated by the International LOFAR Telescope (ILT) foundation, as an observatory open to the global astronomical community. LOFAR is one of the first radio observatories to feature automated processing pipelines to deliver fully calibrated science products to its user community. LOFAR's new capabilities, techniques and modus operandi make it an important pathfinder for the Square Kilometre Array (SKA). We give an overview of the LOFAR instrument, its major hardware and software components, and the core science objectives that have driven its design. In addition, we present a selection of new results from the commissioning phase of this new radio observatory.

Instruments for radio astronomical observations have come a long way. While the first telescopes were based on very large dishes and 2-antenna interferometers, current instruments consist of dozens of steerable dishes, whereas future instruments will be even larger distributed sensor arrays with a hierarchy of phased array elements. For such arrays to provide meaningful output (images), accurate calibration is of critical importance. Calibration must solve for the unknown antenna gains and phases, as well as the unknown atmospheric and ionospheric disturbances. Future telescopes will have a large number of elements and a large field of view. In this case the parameters are strongly direction dependent, resulting in a large number of unknown parameters even if appropriately constrained physical or phenomenological descriptions are used. This makes calibration a daunting parameter estimation task, that is reviewed from a signal processing perspective in this article.

The radio astronomy community is currently building a number of phased array telescopes. The calibration of these telescopes is hampered by the fact that covariances of signals from closely spaced antennas are sensitive to noise coupling and to variations in sky brightness on large spatial scales. These effects are difficult and computationally expensive to model. We propose to model them phenomenologically using a non-diagonal noise covariance matrix. The parameters can be estimated using a weighted alternating least squares (WALS) algorithm iterating between the calibration parameters and the additive nuisance parameters. We demonstrate the effectiveness of our method using data from the low frequency array (LOFAR) prototype station.

The fidelity of radio astronomical images is generally assessed by practical experience, i.e. using rules of thumb, although some aspects and cases have been treated rigorously. In this paper we present a mathematical framework capable of describing the fundamental limits of radio astronomical imaging problems. Although the data model assumes a single snapshot observation, i.e. variations in time and frequency are not considered, this framework is sufficiently general to allow extension to synthesis observations. Using tools from statistical signal processing and linear algebra, we discuss the tractability of the imaging and deconvolution problem, the redistribution of noise in the map by the imaging and deconvolution process, the covariance of the image values due to propagation of calibration errors and thermal noise and the upper limit on the number of sources tractable by self calibration. The combination of covariance of the image values and the number of tractable sources determines the effective noise floor achievable in the imaging process. The effective noise provides a better figure of merit than dynamic range since it includes the spatial variations of the noise. Our results provide handles for improving the imaging performance by design of the array.

Calibration of a sensor array is more involved if the antennas have direction dependent gains and multiple calibrator sources are simultaneously present. We study this case for a sensor array with arbitrary geometry but identical elements, i.e. elements with the same direction dependent gain pattern. A weighted alternating least squares (WALS) algorithm is derived that iteratively solves for the direction independent complex gains of the array elements, their noise powers and their gains in the direction of the calibrator sources. An extension of the problem is the case where the apparent calibrator source locations are unknown, e.g., due to refractive propagation paths. For this case, the WALS method is supplemented with weighted subspace fitting (WSF) direction finding techniques. Using Monte Carlo simulations we demonstrate that both methods are asymptotically statistically efficient and converge within two iterations even in cases of low SNR.

Radio-astronomical observations are increasingly contaminated by interference, and suppression techniques become essential. A powerful candidate for interference mitigation is adaptive spatial filtering. We study the effect of spatial filtering techniques on radio astronomical imaging. Current deconvolution procedures such as CLEAN are shown to be unsuitable to spatially filtered data, and the necessary corrections are derived. To that end, we reformulate the imaging (deconvolution/calibration) process as a sequential estimation of the locations of astronomical sources. This not only leads to an extended CLEAN algorithm, the formulation also allows to insert other array signal processing techniques for direction finding, and gives estimates of the expected image quality and the amount of interference suppression that can be achieved. Finally, a maximum likelihood procedure for the imaging is derived, and an approximate ML image formation technique is proposed to overcome the computational burden involved. Some of the effects of the new algorithms are shown in simulated images. Keywords: Radio astronomy, synthesis imaging, parametric imaging, interference mitigation, spatial filtering, maximum likelihood, minimum variance, CLEAN.

Radio-astronomical observations are increasingly corrupted by RF interference, and online detection and filtering algorithms are becoming essential. To facilitate the introduction of such techniques into radio astronomy, we formulate the astronomical problem in an array signal processing language, and give an introduction to some elementary algorithms from that field. We consider two topics in detail: interference detection by rank estimation of short-term covariance matrices, and spatial filtering by subspace estimation and projection. We discuss experimental data collected at the Westerbork radio telescope, and illustrate the effectiveness of the space-time detection and blanking process on the recovery of a 3C48 absorption line in the presence of GSM mobile telephony interference.