The key challenge in the observation of the redshifted 21-cm signal from cosmic reionization is its separation from the much brighter foreground emission. Such separation relies on the different spectral properties of the two components, although, in real life, the foreground intrinsic spectrum is often corrupted by the instrumental response, inducing systematic effects that can further jeopardize the measurement of the 21-cm signal. In this paper, we use Gaussian Process Regression to model both foreground emission and instrumental systematics in $\sim 2$ hours of data from the Hydrogen Epoch of Reionization Array. We find that a simple co-variance model with three components matches the data well, giving a residual power spectrum with white noise properties. These consist of an "intrinsic" and instrumentally corrupted component with a coherence-scale of 20 MHz and 2.4 MHz respectively (dominating the line of sight power spectrum over scales $k_{\parallel} \le 0.2$ h cMpc$^{-1}$) and a baseline dependent periodic signal with a period of $\sim 1$ MHz (dominating over $k_{\parallel} \sim 0.4 - 0.8$h cMpc$^{-1}$) which should be distinguishable from the 21-cm EoR signal whose typical coherence-scales is $\sim 0.8$ MHz.

Radio interferometric gain calibration can be biased by incomplete sky models and radio frequency interference, resulting in calibration artefacts that can restrict the dynamic range of the resulting images. It has been suggested that calibration algorithms employing heavy-tailed likelihood functions are less susceptible to this due to their robustness against outliers in the data. We present an algorithm based on a Student's t-distribution which leverages the framework of complex optimisation and Wirtinger calculus for efficient and robust interferometric gain calibration. We integrate this algorithm as an option in the newly released calibration software package, CubiCal. We demonstrate that the algorithm can mitigate some of the biases introduced by incomplete sky models and radio frequency interference by applying it to both simulated and real data. Our results show significant improvements compared to a conventional least-squares solver which assumes a Gaussian likelihood function. Furthermore, we provide some insight into why the algorithm outperforms the conventional solver, and discuss specific scenarios (for both direction-independent and direction-dependent self-calibration) where this is expected to be the case.

It has recently been shown that radio interferometric gain calibration can be expressed succinctly in the language of complex optimisation. In addition to providing an elegant framework for further development, it exposes properties of the calibration problem which can be exploited to accelerate traditional non-linear least squares solvers such as Gauss-Newton and Levenberg-Marquardt. We extend existing derivations to chains of Jones terms: products of several gains which model different aberrant effects. In doing so, we find that the useful properties found in the single term case still hold. We also develop several specialised solvers which deal with complex gains parameterised by real values. The newly developed solvers have been implemented in a Python package called CubiCal, which uses a combination of Cython, multiprocessing and shared memory to leverage the power of modern hardware. We apply CubiCal to both simulated and real data, and perform both direction-independent and direction-dependent self-calibration. Finally, we present the results of some rudimentary profiling to show that CubiCal is competitive with respect to existing calibration tools such as MeqTrees.

New radio (MeerKAT and Parkes) and X-ray (XMM-Newton, Swift, Chandra, and NuSTAR) observations of PSR J1622-4950 indicate that the magnetar, in a quiescent state since at least early 2015, reactivated between 2017 March 19 and April 5. The radio flux density, while variable, is approximately 100x larger than during its dormant state. The X-ray flux one month after reactivation was at least 800x larger than during quiescence, and has been decaying exponentially on a 111+/-19 day timescale. This high-flux state, together with a radio-derived rotational ephemeris, enabled for the first time the detection of X-ray pulsations for this magnetar. At 5%, the 0.3-6 keV pulsed fraction is comparable to the smallest observed for magnetars. The overall pulsar geometry inferred from polarized radio emission appears to be broadly consistent with that determined 6-8 years earlier. However, rotating vector model fits suggest that we are now seeing radio emission from a different location in the magnetosphere than previously. This indicates a novel way in which radio emission from magnetars can differ from that of ordinary pulsars. The torque on the neutron star is varying rapidly and unsteadily, as is common for magnetars following outburst, having changed by a factor of 7 within six months of reactivation.

Observations of the redshifted 21-cm line from the epoch of reionization have recently motivated the construction of low frequency radio arrays with highly redundant configurations. These configurations provide an alternative calibration strategy - "redundant calibration" - and boosts sensitivity on specific spatial scales. In this paper, we formulate calibration of redundant interferometric arrays as a complex optimization problem. We solve this optimization problem via the Levenberg-Marquardt algorithm. This calibration approach is more robust to initial conditions than current algorithms and, by leveraging an approximate matrix inversion, allows for further optimization and an efficient implementation ("redundant StEfCal"). We also investigated using the preconditioned conjugate gradient method as an alternative to the approximate matrix inverse, but found that its computational performance is not competitive with respect to "redundant StEfCal". The efficient implementation of this new algorithm is made publicly available.

A critical challenge in the observation of the redshifted 21-cm line is its separation from bright Galactic and extragalactic foregrounds. In particular, the instrumental leakage of polarized foregrounds, which undergo significant Faraday rotation as they propagate through the interstellar medium, may harmfully contaminate the 21-cm power spectrum. We develop a formalism to describe the leakage due to instrumental widefield effects in visibility-based power spectra measured with redundant arrays, extending the delay-spectrum approach presented in Parsons et al. (2012). We construct polarized sky models and propagate them through the instrument model to simulate realistic full-sky observations with the Precision Array to Probe the Epoch of Reionization. We find that the leakage due to a population of polarized point sources is expected to be higher than diffuse Galactic polarization at any $k$ mode for a 30~m reference baseline. For the same reference baseline, a foreground-free window at $k > 0.3 \, h$~Mpc$^{-1}$ can be defined in terms of leakage from diffuse Galactic polarization even under the most pessimistic assumptions. If measurements of polarized foreground power spectra or a model of polarized foregrounds are given, our method is able to predict the polarization leakage in actual 21-cm observations, potentially enabling its statistical subtraction from the measured 21-cm power spectrum.

This is the third installment in a series of papers in which we investigate calibration artefacts. Calibration artefacts (also known as ghosts or spurious sources) are created when we calibrate with an incomplete model. In the first two papers of this series we developed a mathematical framework which enabled us to study the ghosting mechanism itself. An interesting concomitant of the second paper was that ghosts appear in symmetrical pairs. This could possibly account for spurious symmetrization. Spurious symmetrization refers to the appearance of a spurious source (the anti-ghost) symmetrically opposite an unmodelled source around a modelled source. The analysis in the first two papers indicates that the anti-ghost is usually very faint, in particular when a large number of antennas are used. This suggests that spurious symmetrization will mainly occur at an almost undetectable flux level. In this paper, we show that phase-only calibration produces an anti-ghost that is $N$-times (where $N$ denotes the number of antennas in the array) as bright as the one produced by phase and amplitude calibration and that this already bright ghost can be further amplified by the primary beam correction.

We present the results of a four-month campaign searching for low-frequency radio transients near the North Celestial Pole with the Low-Frequency Array (LOFAR), as part of the Multifrequency Snapshot Sky Survey (MSSS). The data were recorded between 2011 December and 2012 April and comprised 2149 11-minute snapshots, each covering 175 deg^2. We have found one convincing candidate astrophysical transient, with a duration of a few minutes and a flux density at 60 MHz of 15-25 Jy. The transient does not repeat and has no obvious optical or high-energy counterpart, as a result of which its nature is unclear. The detection of this event implies a transient rate at 60 MHz of 3.9 (+14.7, -3.7) x 10^-4 day^-1 deg^-2, and a transient surface density of 1.5 x 10^-5 deg^-2, at a 7.9-Jy limiting flux density and ~10-minute time-scale. The campaign data were also searched for transients at a range of other time-scales, from 0.5 to 297 min, which allowed us to place a range of limits on transient rates at 60 MHz as a function of observation duration.

This work investigates a particular class of artefacts, or ghost sources, in radio interferometric images. Earlier observations with (and simulations of) the Westerbork Synthesis Radio Telescope (WSRT) suggested that these were due to calibration with incomplete sky models. A theoretical framework is derived that validates this suggestion, and provides predictions of ghost formation in a two-source scenario. The predictions are found to accurately match the result of simulations, and qualitatively reproduce the ghosts previously seen in observational data. The theory also provides explanations for many previously puzzling features of these artefacts (regular geometry, PSF-like sidelobes, seeming independence on model flux), and shows that the observed phenomenon of flux suppression affecting unmodelled sources is due to the same mechanism. We demonstrate that this ghost formation mechanism is a fundamental feature of calibration, and exhibits a particularly strong and localized signature due to array redundancy. To some extent this mechanism will affect all observations (including those with non-redundant arrays), though in most cases the ghosts remain hidden below the noise or masked by other instrumental artefacts. The implications of such errors on future deep observations are discussed.