We report on the detection of extreme giant pulses (GPs) from one of the oldest-known pulsars, the highly variable PSR B0950+08, with the Amsterdam-ASTRON Radio Transient Facility And Analysis Centre (AARTFAAC), a parallel transient detection instrument operating as a subsystem of the LOw Frequency ARray (LOFAR). During processing of our Northern Hemisphere survey for low-frequency radio transients, a sample of 275 pulses with fluences ranging from 42 to 177 kJy ms were detected in one-second snapshot images. The brightest pulses are an order of magnitude brighter than those previously reported at 42 and 74 MHz, on par with the levels observed in a previous long-term study at 103 MHz. Both their rate and fluence distribution differ between and within the various studies done to date. The GP rate is highly variable, from 0 to 30 per hour, with only two three-hour observations accounting for nearly half of the pulses detected in the 96 h surveyed. It does not vary significantly within a few-hour observation, but can vary strongly one from day to the next. The spectra appear strongly and variably structured, with emission sometimes confined to a single 195.3 kHz subband, and the pulse spectra changing on a timescale of order 10 min.

We report the experimental setup and overall results of the AARTFAAC wide-field radio survey, which consists of observing the sky within 50 deg of Zenith with a bandwidth of 3.2 MHz at a cadence of 1 s, for 545 h. This yielded nearly 4 million snapshots, two per second, of on average 4800 square degrees and a sensitivity of around 60 Jy. We find two populations of transient events, one originating from PSR B0950+08 and one from strong ionospheric lensing events, as well as a possible single extragalactic transient. We also set a strong upper limit of 1.1 all-sky per day to the rate of any other populations of fast, bright transients. Lastly, we constrain some previously detected types of transient source by comparing our detections and limits with other low-frequency radio transient surveys.

With the arrival of a number of wide-field snapshot image-plane radio transient surveys, there will be a huge influx of images in the coming years making it impossible to manually analyse the datasets. Automated pipelines to process the information stored in the images are being developed, such as the LOFAR Transients Pipeline, outputting light curves and various transient parameters. These pipelines have a number of tuneable parameters that require training to meet the survey requirements. This paper utilises both observed and simulated datasets to demonstrate different machine learning strategies that can be used to train these parameters. The datasets used are from LOFAR observations and we process the data using the LOFAR Transients Pipeline; however the strategies developed are applicable to any light curve datasets at different frequencies and can be adapted to different automated pipelines. These machine learning strategies are publicly available as Python tools that can be downloaded and adapted to different datasets (https://github.com/AntoniaR/TraP_ML_tools).

We present a method for calibrating the flux density scale for images generated by the Amsterdam ASTRON Radio Transient Facility And Analysis Centre (AARTFAAC). AARTFAAC produces a stream of all-sky images at a rate of one second in order to survey the Northern Hemisphere for short duration, low frequency transients, such as the prompt EM counterpart to gravitational wave events, magnetar flares, blazars, and other as of yet unobserved phenomena. Therefore, an independent flux density scaling solution per image is calculated via bootstrapping, comparing the measured apparent brightness of sources in the field to a reference catalogue. However, the lack of accurate flux density measurements of bright sources below 74 MHz necessitated the creation of the AARTFAAC source catalogue, at 60 MHz, which contains 167 sources across the Northern Hemisphere. Using this as a reference results in a sufficiently high number of detected sources in each image to calculate a stable and accurate flux scale per one second snapshot, in real-time.

Kliko is a Docker-based container specification for running one or multiple related compute jobs. The key concepts of Kliko are the encapsulation of data processing software into a container and the formalization of the input, output and task parameters. By formalizing the parameters, the software is represented as abstract building blocks with a uniform and consistent interface. The main advantage is enhanced scriptability and empowering pipeline composition. Formalization is realized by bundling a container with a Kliko file, which describes the IO and task parameters. This Kliko container can then be opened and run by a Kliko runner. The Kliko runner will parse the Kliko definition and gather the values for these parameters, for example by requesting user input or retrieving pre-defined values from disk. Parameters can be various primitive types, for example: float, int or the path to a file. This paper will also discuss the implementation of a support library named Kliko which can be used to create Kliko containers, parse Kliko definitions, chain Kliko containers in workflows using a workflow manager library such as Luigi. The Kliko library can be used inside the container to interact with the Kliko runner. Finally, to illustrate the applicability of the Kliko definition, this paper will discuss two reference implementations based on the Kliko library: RODRIGUES, a web-based Kliko container scheduler, and output visualizer specifically for astronomical data, and VerMeerKAT, a multi-container workflow data reduction pipeline which is being used as a prototype pipeline for the commissioning of the MeerKAT radio telescope.

With their wide fields of view and often relatively long coverage of any position in the sky in imaging survey mode, modern radio telescopes provide a data stream that is naturally suited to searching for rare transients. However, Radio Frequency Interference (RFI) can show up in the data stream in similar ways to such transients, and thus the normal pre-treatment of filtering RFI (flagging) may also remove astrophysical transients from the data stream before imaging. In this paper we investigate how standard flagging affects the detectability of such transients by examining the case of transient detection in an observing mode used for Low Frequency Array (LOFAR; \citep{LOFAR}) surveys. We quantify the fluence range of transients that would be detected, and the reduction of their SNR due to partial flagging. We find that transients with a duration close to the integration sampling time, as well as bright transients with durations on the order of tens of seconds, are completely flagged. For longer transients on the order of several tens of seconds to minutes, the flagging effects are not as severe, although part of the signal is lost. For these transients, we present a modified flagging strategy which mitigates the effect of flagging on transient signals. We also present a script which uses the differences between the two strategies, and known differences between transient RFI and astrophysical transients, to notify the observer when a potential transient is in the data stream.

PySE is a Python software package for finding and measuring sources in radio telescope images. The software was designed to detect sources in the LOFAR telescope images, but can be used with images from other radio telescopes as well. We introduce the LOFAR Telescope, the context within which PySE was developed, the design of PySE, and describe how it is used. Detailed experiments on the validation and testing of PySE are then presented, along with results of performance testing. We discuss some of the current issues with the algorithms implemented in PySE and their inter- action with LOFAR images, concluding with the current status of PySE and its future development.

We present LOFAR high-band data over the frequency range 115-189 MHz for the X-ray binary SS 433, obtained in an observing campaign from 2013 February - 2014 May. Our results include a deep, wide-field map, allowing a detailed view of the surrounding supernova remnant W 50 at low radio frequencies, as well as a light curve for SS 433 determined from shorter monitoring runs. The complex morphology of W 50 is in excellent agreement with previously published higher-frequency maps; we find additional evidence for a spectral turnover in the eastern wing, potentially due to foreground free-free absorption. Furthermore, SS 433 is tentatively variable at 150 MHz, with both a debiased modulation index of 11 per cent and a $\chi^2$ probability of a flat light curve of $8.2 \times 10^{-3}$. By comparing the LOFAR flux densities with contemporaneous observations carried out at 4800 MHz with the RATAN-600 telescope, we suggest that an observed $\sim$0.5-1 Jy rise in the 150-MHz flux density may correspond to sustained flaring activity over a period of approximately six months at 4800 MHz. However, the increase is too large to be explained with a standard synchrotron bubble model. We also detect a wealth of structure along the nearby Galactic plane, including the most complete detection to date of the radio shell of the candidate supernova remnant G 38.7-1.4. This further demonstrates the potential of supernova remnant studies with the current generation of low-frequency radio telescopes.

KERN is a bi-annually released set of radio astronomical software packages. It should contain most of the standard tools that a radio astronomer needs to work with radio telescope data. The goal of KERN is to save time and prevent frustration in setting up of scientific pipelines, and to assist in achieving scientific reproducibility.

The Amsterdam-ASTRON Radio Transients Facility And Analysis Center (AARTFAAC) all sky monitor is a sensitive, real time transient detector based on the Low Frequency Array (LOFAR). It generates images of the low frequency radio sky with spatial resolution of 10s of arcmin, MHz bandwidths, and a time cadence of a few seconds, while simultaneously but independently observing with LOFAR. The image timeseries is then monitored for short and bright radio transients. On detection of a transient, a low latency trigger will be generated for LOFAR, which can interrupt its schedule to carry out follow-up observations of the trigger location at high sensitivity and resolutions. In this paper, we describe our heterogeneous, hierarchical design to manage the 240 Gbps raw data rate, and large scale computing to produce real-time images with minimum latency. We discuss the implementation of the instrumentation, its performance, and scalability.

The eclipses of certain types of binary millisecond pulsars (i.e. `black widows' and `redbacks') are often studied using high-time-resolution, `beamformed' radio observations. However, they may also be detected in images generated from interferometric data. As part of a larger imaging project to characterize the variable and transient sky at radio frequencies <200 MHz, we have blindly detected the redback system PSR J2215+5135 as a variable source of interest with the Low-Frequency Array (LOFAR). Using observations with cadences of 2 weeks - 6 months, we find preliminary evidence that the eclipse duration is frequency dependent ($\propto \nu^{-0.4}$), such that the pulsar is eclipsed for longer at lower frequencies, in broad agreement with beamformed studies of other similar sources. Furthermore, the detection of the eclipses in imaging data suggests an eclipsing medium that absorbs the pulsed emission, rather than scattering it. Our study is also a demonstration of the prospects of finding pulsars in wide-field imaging surveys with the current generation of low-frequency radio telescopes.

We present the results of a four-month campaign searching for low-frequency radio transients near the North Celestial Pole with the Low-Frequency Array (LOFAR), as part of the Multifrequency Snapshot Sky Survey (MSSS). The data were recorded between 2011 December and 2012 April and comprised 2149 11-minute snapshots, each covering 175 deg^2. We have found one convincing candidate astrophysical transient, with a duration of a few minutes and a flux density at 60 MHz of 15-25 Jy. The transient does not repeat and has no obvious optical or high-energy counterpart, as a result of which its nature is unclear. The detection of this event implies a transient rate at 60 MHz of 3.9 (+14.7, -3.7) x 10^-4 day^-1 deg^-2, and a transient surface density of 1.5 x 10^-5 deg^-2, at a 7.9-Jy limiting flux density and ~10-minute time-scale. The campaign data were also searched for transients at a range of other time-scales, from 0.5 to 297 min, which allowed us to place a range of limits on transient rates at 60 MHz as a function of observation duration.

Current and future astronomical survey facilities provide a remarkably rich opportunity for transient astronomy, combining unprecedented fields of view with high sensitivity and the ability to access previously unexplored wavelength regimes. This is particularly true of LOFAR, a recently-commissioned, low-frequency radio interferometer, based in the Netherlands and with stations across Europe. The identification of and response to transients is one of LOFAR's key science goals. However, the large data volumes which LOFAR produces, combined with the scientific requirement for rapid response, make automation essential. To support this, we have developed the LOFAR Transients Pipeline, or TraP. The TraP ingests multi-frequency image data from LOFAR or other instruments and searches it for transients and variables, providing automatic alerts of significant detections and populating a lightcurve database for further analysis by astronomers. Here, we discuss the scientific goals of the TraP and how it has been designed to meet them. We describe its implementation, including both the algorithms adopted to maximize performance as well as the development methodology used to ensure it is robust and reliable, particularly in the presence of artefacts typical of radio astronomy imaging. Finally, we report on a series of tests of the pipeline carried out using simulated LOFAR observations with a known population of transients.

We present the highest-quality polarisation profiles to date of 16 non-recycled pulsars and four millisecond pulsars, observed below 200 MHz with the LOFAR high-band antennas. Based on the observed profiles, we perform an initial investigation of expected observational effects resulting from the propagation of polarised emission in the pulsar magnetosphere and the interstellar medium. The predictions of magnetospheric birefringence in pulsars have been tested using spectra of the pulse width and fractional polarisation from multifrequency data. The derived spectra offer only partial support for the expected effects of birefringence on the polarisation properties, with only about half of our sample being consistent with the model's predictions. It is noted that for some pulsars these measurements are contaminated by the effects of interstellar scattering. For a number of pulsars in our sample, we have observed significant variations in the amount of Faraday rotation as a function of pulse phase, which is possibly an artefact of scattering. These variations are typically two orders of magnitude smaller than that observed at 1400 MHz by Noutsos et al. (2009), for a different sample of southern pulsars. In this paper we present a possible explanation for the difference in magnitude of this effect between the two frequencies, based on scattering. Finally, we have estimated the magnetospheric emission heights of low-frequency radiation from four pulsars, based on the phase lags between the flux-density and the PA profiles, and the theoretical framework of Blaskiewicz, Cordes & Wasserman (1991). These estimates yielded heights of a few hundred km; at least for PSR B1133+16, this is consistent with emission heights derived based on radius-to-frequency mapping, but is up to a few times larger than the recent upper limit based on pulsar timing.

Aims: We have analyzed low frequency radio data of tidal disruption event (TDE) Swift J1644+57 to search for a counterpart. We consider how brief transient signals (on the order of seconds or minutes) originating from this location would appear in our data. We also consider how automatic radio frequency interference (RFI) flagging at radio telescope observatories might affect these and other transient observations in the future, particularly with brief transients of a few seconds duration. Methods: We observed the field in the low-frequency regime at 149 MHz with data obtained over several months with the Low Frequency Array (LOFAR). We also present simulations where a brief transient is injected into the data in order to see how it would appear in our measurement sets, and how it would be affected by RFI flagging. Finally, both based on simulation work and the weighted average of the observed background over the course of the individual observations, we present the possibility of brief radio transients in the data. Results: Our observations of Swift J1644+57 yielded no detection of the source and a peak flux density at this position of 24.7 $\pm$ 8.9 mJy. Our upper limit on the transient rate of the snapshot surface density in this field at sensitivities < 0.5 Jy is $\rho < 2.2 \times10^{-2}$ deg$^{-2}$. We also conclude that we did not observe any brief transient signals originating specifically from the Swift J1644+57 source itself, and searches for such transients are severely limited by automatic RFI flagging algorithms which flag transients of less than 2 minutes duration. As such, careful consideration of RFI flagging techniques must occur when searching for transient signals.