With the arrival of a number of wide-field snapshot image-plane radio transient surveys, there will be a huge influx of images in the coming years making it impossible to manually analyse the datasets. Automated pipelines to process the information stored in the images are being developed, such as the LOFAR Transients Pipeline, outputting light curves and various transient parameters. These pipelines have a number of tuneable parameters that require training to meet the survey requirements. This paper utilises both observed and simulated datasets to demonstrate different machine learning strategies that can be used to train these parameters. The datasets used are from LOFAR observations and we process the data using the LOFAR Transients Pipeline; however the strategies developed are applicable to any light curve datasets at different frequencies and can be adapted to different automated pipelines. These machine learning strategies are publicly available as Python tools that can be downloaded and adapted to different datasets (https://github.com/AntoniaR/TraP_ML_tools).

Coming high-cadence wide-field optical telescopes will image hundreds of thousands of sources per minute. Besides inspecting the near real-time data streams for transient and variability events, the accumulated data archive is a wealthy laboratory for making complementary scientific discoveries. The goal of this work is to optimise column-oriented database techniques to enable the construction of a full-source and light-curve database for large-scale surveys, that is accessible by the astronomical community. We adopted LOFAR's Transients Pipeline as the baseline and modified it to enable the processing of optical images that have much higher source densities. The pipeline adds new source lists to the archive database, while cross-matching them with the known cataloged sources in order to build a full light-curve archive. We investigated several techniques of indexing and partitioning the largest tables, allowing for faster positional source look-ups in the cross matching algorithms. We monitored all query run times in long-term pipeline runs where we processed a subset of IPHAS data that have image source density peaks over $170,000$ per field of view ($500,000$ deg$^{-2}$). Our analysis demonstrates that horizontal table partitions of declination widths of one-degree control the query run times. Usage of an index strategy where the partitions are densily sorted according to source declination yields another improvement. Most queries run in sublinear time and a few (<20%) run in linear time, because of dependencies on input source-list and result-set size. We observed that for this logical database partitioning schema the limiting cadence the pipeline achieved with processing IPHAS data is 25 seconds.

We present the results of a four-month campaign searching for low-frequency radio transients near the North Celestial Pole with the Low-Frequency Array (LOFAR), as part of the Multifrequency Snapshot Sky Survey (MSSS). The data were recorded between 2011 December and 2012 April and comprised 2149 11-minute snapshots, each covering 175 deg^2. We have found one convincing candidate astrophysical transient, with a duration of a few minutes and a flux density at 60 MHz of 15-25 Jy. The transient does not repeat and has no obvious optical or high-energy counterpart, as a result of which its nature is unclear. The detection of this event implies a transient rate at 60 MHz of 3.9 (+14.7, -3.7) x 10^-4 day^-1 deg^-2, and a transient surface density of 1.5 x 10^-5 deg^-2, at a 7.9-Jy limiting flux density and ~10-minute time-scale. The campaign data were also searched for transients at a range of other time-scales, from 0.5 to 297 min, which allowed us to place a range of limits on transient rates at 60 MHz as a function of observation duration.

Current and future astronomical survey facilities provide a remarkably rich opportunity for transient astronomy, combining unprecedented fields of view with high sensitivity and the ability to access previously unexplored wavelength regimes. This is particularly true of LOFAR, a recently-commissioned, low-frequency radio interferometer, based in the Netherlands and with stations across Europe. The identification of and response to transients is one of LOFAR's key science goals. However, the large data volumes which LOFAR produces, combined with the scientific requirement for rapid response, make automation essential. To support this, we have developed the LOFAR Transients Pipeline, or TraP. The TraP ingests multi-frequency image data from LOFAR or other instruments and searches it for transients and variables, providing automatic alerts of significant detections and populating a lightcurve database for further analysis by astronomers. Here, we discuss the scientific goals of the TraP and how it has been designed to meet them. We describe its implementation, including both the algorithms adopted to maximize performance as well as the development methodology used to ensure it is robust and reliable, particularly in the presence of artefacts typical of radio astronomy imaging. Finally, we report on a series of tests of the pipeline carried out using simulated LOFAR observations with a known population of transients.

We present the highest-quality polarisation profiles to date of 16 non-recycled pulsars and four millisecond pulsars, observed below 200 MHz with the LOFAR high-band antennas. Based on the observed profiles, we perform an initial investigation of expected observational effects resulting from the propagation of polarised emission in the pulsar magnetosphere and the interstellar medium. The predictions of magnetospheric birefringence in pulsars have been tested using spectra of the pulse width and fractional polarisation from multifrequency data. The derived spectra offer only partial support for the expected effects of birefringence on the polarisation properties, with only about half of our sample being consistent with the model's predictions. It is noted that for some pulsars these measurements are contaminated by the effects of interstellar scattering. For a number of pulsars in our sample, we have observed significant variations in the amount of Faraday rotation as a function of pulse phase, which is possibly an artefact of scattering. These variations are typically two orders of magnitude smaller than that observed at 1400 MHz by Noutsos et al. (2009), for a different sample of southern pulsars. In this paper we present a possible explanation for the difference in magnitude of this effect between the two frequencies, based on scattering. Finally, we have estimated the magnetospheric emission heights of low-frequency radiation from four pulsars, based on the phase lags between the flux-density and the PA profiles, and the theoretical framework of Blaskiewicz, Cordes & Wasserman (1991). These estimates yielded heights of a few hundred km; at least for PSR B1133+16, this is consistent with emission heights derived based on radius-to-frequency mapping, but is up to a few times larger than the recent upper limit based on pulsar timing.

LOFAR, the LOw-Frequency ARray, is a new-generation radio interferometer constructed in the north of the Netherlands and across europe. Utilizing a novel phased-array design, LOFAR covers the largely unexplored low-frequency range from 10-240 MHz and provides a number of unique observing capabilities. Spreading out from a core located near the village of Exloo in the northeast of the Netherlands, a total of 40 LOFAR stations are nearing completion. A further five stations have been deployed throughout Germany, and one station has been built in each of France, Sweden, and the UK. Digital beam-forming techniques make the LOFAR system agile and allow for rapid repointing of the telescope as well as the potential for multiple simultaneous observations. With its dense core array and long interferometric baselines, LOFAR achieves unparalleled sensitivity and angular resolution in the low-frequency radio regime. The LOFAR facilities are jointly operated by the International LOFAR Telescope (ILT) foundation, as an observatory open to the global astronomical community. LOFAR is one of the first radio observatories to feature automated processing pipelines to deliver fully calibrated science products to its user community. LOFAR's new capabilities, techniques and modus operandi make it an important pathfinder for the Square Kilometre Array (SKA). We give an overview of the LOFAR instrument, its major hardware and software components, and the core science objectives that have driven its design. In addition, we present a selection of new results from the commissioning phase of this new radio observatory.

Cassiopeia A was observed using the Low-Band Antennas of the LOw Frequency ARray (LOFAR) with high spectral resolution. This allowed a search for radio recombination lines (RRLs) along the line-of-sight to this source. Five carbon-alpha RRLs were detected in absorption between 40 and 50 MHz with a signal-to-noise ratio of > 5 from two independent LOFAR datasets. The derived line velocities (v_LSR ~ -50 km/s) and integrated optical depths (~ 13 s^-1) of the RRLs in our spectra, extracted over the whole supernova remnant, are consistent within each LOFAR dataset and with those previously reported. For the first time, we are able to extract spectra against the brightest hotspot of the remnant at frequencies below 330 MHz. These spectra show significantly higher (15-80 %) integrated optical depths, indicating that there is small-scale angular structure on the order of ~1 pc in the absorbing gas distribution over the face of the remnant. We also place an upper limit of 3 x 10^-4 on the peak optical depths of hydrogen and helium RRLs. These results demonstrate that LOFAR has the desired spectral stability and sensitivity to study faint recombination lines in the decameter band.

Dispersion in the interstellar medium is a well known phenomenon that follows a simple relationship, which has been used to predict the time delay of dispersed radio pulses since the late 1960s. We performed wide-band simultaneous observations of four pulsars with LOFAR (at 40-190 MHz), the 76-m Lovell Telescope (at 1400 MHz) and the Effelsberg 100-m Telescope (at 8000 MHz) to test the accuracy of the dispersion law over a broad frequency range. In this paper we present the results of these observations which show that the dispersion law is accurate to better than 1 part in 100000 across our observing band. We use this fact to constrain some of the properties of the ISM along the line-of-sight and use the lack of any aberration or retardation effects to determine upper limits on emission heights in the pulsar magnetosphere. We also discuss the effect of pulse profile evolution on our observations, and the implications that it could have for precision pulsar timing projects such as the detection of gravitational waves with pulsar timing arrays.

Low frequency radio waves, while challenging to observe, are a rich source of information about pulsars. The LOw Frequency ARray (LOFAR) is a new radio interferometer operating in the lowest 4 octaves of the ionospheric "radio window": 10-240MHz, that will greatly facilitate observing pulsars at low radio frequencies. Through the huge collecting area, long baselines, and flexible digital hardware, it is expected that LOFAR will revolutionize radio astronomy at the lowest frequencies visible from Earth. LOFAR is a next-generation radio telescope and a pathfinder to the Square Kilometre Array (SKA), in that it incorporates advanced multi-beaming techniques between thousands of individual elements. We discuss the motivation for low-frequency pulsar observations in general and the potential of LOFAR in addressing these science goals. We present LOFAR as it is designed to perform high-time-resolution observations of pulsars and other fast transients, and outline the various relevant observing modes and data reduction pipelines that are already or will soon be implemented to facilitate these observations. A number of results obtained from commissioning observations are presented to demonstrate the exciting potential of the telescope. This paper outlines the case for low frequency pulsar observations and is also intended to serve as a reference for upcoming pulsar/fast transient science papers with LOFAR.

In this paper we present the results of a survey for radio transients using data obtained from the Very Large Array archive. We have reduced, using a pipeline procedure, 5037 observations of the most common pointings - i.e. the calibrator fields. These fields typically contain a relatively bright point source and are used to calibrate `target' observations: they are therefore rarely imaged themselves. The observations used span a time range ~ 1984 - 2008 and consist of eight different pointings, three different frequencies (8.4, 4.8 and 1.4 GHz) and have a total observing time of 435 hours. We have searched for transient and variable radio sources within these observations using components from the prototype LOFAR transient detection system. In this paper we present the methodology for reducing large volumes of Very Large Array data; and we also present a brief overview of the prototype LOFAR transient detection algorithms. No radio transients were detected in this survey, therefore we place an upper limit on the snapshot rate of GHz frequency transients > 8.0 mJy to rho less than or equal to 0.032 deg^-2 that have typical timescales 4.3 to 45.3 days. We compare and contrast our upper limit with the snapshot rates - derived from either detections or non-detections of transient and variable radio sources - reported in the literature. When compared with the current Log N - Log S distribution formed from previous surveys, we show that our upper limit is consistent with the observed population. Current and future radio transient surveys will hopefully further constrain these statistics, and potentially discover dominant transient source populations. In this paper we also briefly explore the current transient commissioning observations with LOFAR, and the impact they will make on the field.

The 2004 December 27 giant flare from SGR 1806-20 produced a radio nebula that was detectable for weeks. It was observed at a wide range of radio frequencies. We made a total of 19 WSRT observations. Most of these were performed quasi simultaneously at either two or three frequencies, starting 2005 January 4 and ending 2005 January 29. We reobserved the field in 2005 April/May, which facilitated an accurate subtraction of background sources. At 350 MHz, we find that the total intensity of the source is lower than expected from the GMRT 240 MHz and 610 MHz measurements and inconsistent with spectral indices published previously. Our 850 MHz flux densities, however, are consistent with earlier results. There is no compelling evidence for significant depolarization at any frequency. We do, however, find that polarization angles differ substantially from those at higher frequencies. Low frequency polarimetry and total intensity measurements provide a number of clues with regard to substructure in the radio nebula associated with SGR 1806-20. In general, for a more complete understanding of similar events, low frequency observations can provide new insights into the physics of the radio source.

Two WSRT observations were performed and five archival VLA data were reduced in order to redetect the enigmatic radio transient GCRT J1745-3009. The source was not redetected. We were, however, able to extract important new information from the discovery dataset. Our reanalysis excludes models that predict symmetric bursts, but the transient white dwarf pulsar is favoured. Although we now have more contraints on the properties of this source, we are still unsure about its basic model.

We explore the physics behind one of the brightest radio afterglows ever, GRB 030329, at late times when the jet is non-relativistic. We determine the physical parameters of the blast wave and its surroundings, in particular the index of the electron energy distribution, the energy of the blast wave, and the density (structure) of the circumburst medium. We then compare our results with those from image size measurements. We observed the GRB 030329 radio afterglow with the Westerbork Synthesis Radio Telescope and the Giant Metrewave Radio Telescope at frequencies from 325 MHz to 8.4 GHz, spanning a time range of 268-1128 days after the burst. We modeled all the available radio data and derived the physical parameters. The index of the electron energy distribution is p=2.1, the circumburst medium is homogeneous, and the transition to the non-relativistic phase happens at t_NR ~ 80 days. The energy of the blast wave and density of the surrounding medium are comparable to previous findings. Our findings indicate that the blast wave is roughly spherical at t_NR, and they agree with the implications from the VLBI studies of image size evolution. It is not clear from the presented dataset whether we have seen emission from the counter jet or not. We predict that the Low Frequency Array will be able to observe the afterglow of GRB 030329 and many other radio afterglows, constraining the physics of the blast wave during its non-relativistic phase even further.

LOFAR, the Low Frequency Array, is a new radio telescope under construction in the Netherlands, designed to operate between 30 and 240 MHz. The Transients Key Project is one of the four Key Science Projects which comprise the core LOFAR science case. The remit of the Transients Key Project is to study variable and transient radio sources detected by LOFAR, on timescales from milliseconds to years. This will be achieved via both regular snapshot monitoring of historical and newly-discovered radio variables and, most radically, the development of a `Radio Sky Monitor' which will survey a large fraction of the northern sky on a daily basis.