The detection of non-repeating or irregular events in time-domain radio astronomy has gained importance over the last decade due to the discovery of fast radio bursts. Existing or upcoming radio telescopes are gathering more and more data and consequently the software, which is an important part of these telescopes, must process large data volumes at high data rates. Data has to be searched through to detect new and interesting events, often in real-time. These requirements necessitate new and fast algorithms which must process data quickly and accurately. In this work we present new algorithms for single pulse detection using boxcar filters. We have quantified the signal loss introduced by single pulse detection algorithms which use boxcar filters and based on these results, we have designed two distinct "lossy" algorithms. Our lossy algorithms use an incomplete set of boxcar filters to accelerate detection at the expense of a small reduction in detected signal power. We present formulae for signal loss, descriptions of our algorithms and their parallel implementation on NVIDIA GPUs using CUDA. We also present tests of correctness, tests on artificial data and the performance achieved. Our implementation can process SKA-MID-like data 266$\times$ faster than real-time on a NVIDIA P100 GPU and 500x faster than real-time on a NVIDIA Titan V GPU with a mean signal power loss of 7%. We conclude with prospects for single pulse detection for beyond SKA era, nanosecond time resolution radio astronomy.

We present the data analysis pipeline, commissioning observations and initial results from the GREENBURST fast radio burst (FRB) detection system on the Robert C. Byrd Green Bank Telescope (GBT) previously described by Surnis et al. which uses the 21~cm receiver observing commensally with other projects. The pipeline makes use of a state-of-the-art deep learning classifier to winnow down the very large number of false positive single-pulse candidates that mostly result from radio frequency interference. In our observations totalling 156.5 days so far, we have detected individual pulses from 20 known radio pulsars which provide an excellent verification of the system performance. We also demonstrate, through blind injection analyses, that our pipeline is complete down to a signal-to-noise threshold of 12. Depending on the observing mode, this translates to peak flux sensitivities in the range 0.14--0.89~Jy. Although no FRBs have been detected to date, we have used our results to update the analysis of Lawrence et al. to constrain the FRB all-sky rate to be $1140^{+200}_{-180}$ per day above a peak flux density of 1~Jy. We also constrain the source count index $\alpha=0.83\pm0.06$ which indicates that the source count distribution is substantially flatter than expected from a Euclidean distribution of standard candles (where $\alpha=1.5$). We discuss this result in the context of the FRB redshift and luminosity distributions. Finally, we make predictions for detection rates with GREENBURST, as well as other ongoing and planned FRB experiments.

Upcoming large scale telescope projects such as the Square Kilometre Array (SKA) will see high data rates and large data volumes; requiring tools that can analyse telescope event data quickly and accurately. In modern radio telescopes, analysis software forms a core part of the data read out, and long-term software stability and maintainability are essential. AstroAccelerate is a many core accelerated software package that uses NVIDIA(R) GPUs to perform realtime analysis of radio telescope data, and it has been shown to be substantially faster than realtime at processing simulated SKA-like data. AstroAccelerate contains optimised GPU implementations of signal processing tools used in radio astronomy including dedispersion, Fourier domain acceleration search, single pulse detection, and others. This article describes the transformation of AstroAccelerate from a C-like prototype code to a production-ready software library with a C++ API and a Python interface; while preserving compatibility with legacy software that is implemented in C. The design of the software library interfaces, refactoring aspects, and coding techniques are discussed.

Binary pulsars are an important target for radio surveys because they present a natural laboratory for a wide range of astrophysics for example testing general relativity, including detection of gravitational waves. The orbital motion of a pulsar which is locked in a binary system causes a frequency shift (a Doppler shift) in their normally very periodic pulse emissions. These shifts cause a reduction in the sensitivity of traditional periodicity searches. To correct this smearing Ransom [2001], Ransom et al. [2002] developed the Fourier domain acceleration search (FDAS) which uses a matched filtering technique. This method is however limited to a constant pulsar acceleration. Therefore, Andersen and Ransom [2018] broadened the Fourier domain acceleration search to account also for a linear change in the acceleration by implementing the Fourier domain "jerk" search into the PRESTO software package. This extension increases the number of matched filters used significantly. We have implemented the Fourier domain "jerk" search (JERK) on GPUs using CUDA. We have achieved 90x performance increase when compared to the parallel implementation of JERK in PRESTO. This work is part of the AstroAccelerate project Armour et al. [2019], a many-core accelerated time-domain signal processing library for radio astronomy.

We describe the design and deployment of GREENBURST, a commensal Fast Radio Burst (FRB) search system at the Green Bank Telescope. GREENBURST uses the dedicated L-band receiver tap to search over the 960$-$1920 MHz frequency range for pulses with dispersion measures out to $10^4$ pc cm$^{-3}$. Due to its unique design, GREENBURST will obtain data even when the L-band receiver is not being used for scheduled observing. This makes it a sensitive single pixel detector capable of reaching deeper in the radio sky. While single pulses from Galactic pulsars and rotating radio transients will be detectable in our observations, and will form part of the database we archive, the primary goal is to detect and study FRBs. Based on recent determinations of the all-sky rate, we predict that the system will detect approximately one FRB for every 2$-$3 months of continuous operation. The high sensitivity of GREENBURST means that it will also be able to probe the slope of the FRB source function, which is currently uncertain in this observing band.

Time-domain radio astronomy utilizes a harmonic sum algorithm as part of the Fourier domain periodicity search, this type of search is used to discover single pulsars. The harmonic sum algorithm is also used as part of the Fourier domain acceleration search which aims to discover pulsars that are locked in orbit around another pulsar or compact object. However porting the harmonic sum to many-core architectures like GPUs is not a straightforward task. The main problem that must be overcome is the very unfavourable memory access pattern, which gets worse as the dimensionality of the harmonic sum increases. We present a set of algorithms for calculating the harmonic sum that are more suited to many-core architectures such as GPUs. We present an evaluation of the sensitivity of these different approaches, and their performance. This work forms part of the AstroAccelerate project which is a GPU accelerated software package for processing time-domain radio astronomy data.

The Square Kilometre Array (SKA) will be both the largest radio telescope ever constructed and the largest Big Data project in the known Universe. The first phase of the project will generate on the order of 5 zettabytes of data per year. A critical task for the SKA will be its ability to process data for science, which will need to be conducted by science pipelines. Together with polarization data from the LOFAR Multifrequency Snapshot Sky Survey (MSSS), we have been developing a realistic SKA-like science pipeline that can handle the large data volumes generated by LOFAR at 150 MHz. The pipeline uses task-based parallelism to image, detect sources, and perform Faraday Tomography across the entire LOFAR sky. The project thereby provides a unique opportunity to contribute to the technological development of the SKA telescope, while simultaneously enabling cutting-edge scientific results. In this paper, we provide an update on current efforts to develop a science pipeline that can enable tight constraints on the magnetised large-scale structure of the Universe.

The study of binary pulsars enables tests of general relativity. Orbital motion in binary systems causes the apparent pulsar spin frequency to drift, reducing the sensitivity of periodicity searches. Acceleration searches are methods that account for the effect of orbital acceleration. Existing methods are currently computationally expensive, and the vast amount of data that will be produced by next generation instruments such as the Square Kilometre Array (SKA) necessitates real-time acceleration searches, which in turn requires the use of High Performance Computing (HPC) platforms. We present our implementation of the Correlation Technique for the Fourier Domain Acceleration Search (FDAS) algorithm on Graphics Processor Units (GPUs). The correlation technique is applied as a convolution with multiple Finite Impulse Response filters in the Fourier domain. Two approaches are compared: the first uses the NVIDIA cuFFT library for applying Fast Fourier Transforms (FFTs) on the GPU, and the second contains a custom FFT implementation in GPU shared memory. We find that the FFT shared memory implementation performs between 1.5 and 3.2 times faster than our cuFFT-based application for smaller but sufficient filter sizes. It is also 4 to 6 times faster than the existing GPU and OpenMP implementations of FDAS. This work is part of the AstroAccelerate project, a many-core accelerated time-domain signal processing library for radio astronomy.

The Square Kilometre Array will be an amazing instrument for pulsar astronomy. While the full SKA will be sensitive enough to detect all pulsars in the Galaxy visible from Earth, already with SKA1, pulsar searches will discover enough pulsars to increase the currently known population by a factor of four, no doubt including a range of amazing unknown sources. Real time processing is needed to deal with the 60 PB of pulsar search data collected per day, using a signal processing pipeline required to perform more than 10 POps. Here we present the suggested design of the pulsar search engine for the SKA and discuss challenges and solutions to the pulsar search venture.

We present an improvement of our implementation of the Correlation Technique for the Fourier Domain Acceleration Search (FDAS) algorithm on Graphics Processor Units (GPUs) (Dimoudi & Armour 2015; Dimoudi et al. 2017). Our new improved convolution code which uses our custom GPU FFT code is between 2.5 and 3.9 times faster the than our cuFFT-based implementation (on an NVIDIA P100) and allows for a wider range of filter sizes then our previous version. By using this new version of our convolution code in FDAS we have achieved 44% performance increase over our previous best implementation. It is also approximately 8 times faster than the existing PRESTO GPU implementation of FDAS (Luo 2013). This work is part of the AstroAccelerate project (Armour et al. 2002), a many-core accelerated time-domain signal processing library for radio astronomy.

ALFABURST has been searching for Fast Radio Bursts (FRBs) commensally with other projects using the Arecibo L-band Feed Array (ALFA) receiver at the Arecibo Observatory since July 2015. We describe the observing system and report on the non-detection of any FRBs from that time until August 2017 for a total observing time of 518 hours. With current FRB rate models, along with measurements of telescope sensitivity and beam size, we estimate that this survey probed redshifts out to about 3.4 with an effective survey volume of around 600,000 Mpc$^3$. Based on this, we would expect, at the 99% confidence level, to see at most two FRBs. We discuss the implications of this non-detection in the context of results from other telescopes and the limitation of our search pipeline. During the survey, single pulses from 17 known pulsars were detected. We also report the discovery of a Galactic radio transient with a pulse width of 3 ms and dispersion measure of 281 pc cm$^{-3}$, which was detected while the telescope was slewing between fields.

Here, we present initial results from the ALFABURST radio transient survey, which is currently running in a commensal mode with the ALFA receiver at the Arecibo telescope. We observed for a total of 1400 hours and have detected single pulses from known pulsars but did not detect any FRBs. The non-detection of FRBs is consistent with the current FRB sky rates.

Radio astronomy has traditionally depended on observatories allocating time to observers for exclusive use of their telescopes. The disadvantage of this scheme is that the data thus collected is rarely used for other astronomy applications, and in many cases, is unsuitable. For example, properly calibrated pulsar search data can, with some reduction, be used for spectral line surveys. A backend that supports plugging in multiple applications to a telescope to perform commensal data analysis will vastly increase the science throughput of the facility. In this paper, we present 'SETIBURST', a robotic, commensal, realtime multi-science backend for the 305-m Arecibo Telescope. The system uses the 1.4 GHz, seven-beam Arecibo L-band Feed Array (ALFA) receiver whenever it is operated. SETIBURST currently supports two applications: SERENDIP VI, a SETI spectrometer that is conducting a search for signs of technological life, and ALFABURST, a fast transient search system that is conducting a survey of fast radio bursts (FRBs). Based on the FRB event rate and the expected usage of ALFA, we expect 0-5 FRB detections over the coming year. SETIBURST also provides the option of plugging in more applications. We outline the motivation for our instrumentation scheme and the scientific motivation of the two surveys, along with their descriptions and related discussions.

The detection of non-repeating events in the radio spectrum has become an important area of study in radio astronomy over the last decade due to the discovery of fast radio bursts (FRBs). We have implemented a single pulse detection algorithm, for NVIDIA GPUs, which use boxcar filters of varying widths. Our code performs the calculation of standard deviation, matched filtering by using boxcar filters and thresholding based on the signal-to-noise ratio. We present our parallel implementation of our single pulse detection algorithm. Our GPU algorithm is approximately 17x faster than our current CPU OpenMP code (NVIDIA Titan XP vs Intel E5-2650v3). This code is part of the AstroAccelerate project which is a many-core accelerated time-domain signal processing code for radio astronomy. This work allows our AstroAccelerate code to perform a single pulse search on SKA-like data 4.3x faster than real-time.

In this article we discuss our implementation of a polyphase filter for real-time data processing in radio astronomy. We describe in detail our implementation of the polyphase filter algorithm and its behaviour on three generations of NVIDIA GPU cards, on dual Intel Xeon CPUs and the Intel Xeon Phi (Knights Corner) platforms. All of our implementations aim to exploit the potential for data reuse that the algorithm offers. Our GPU implementations explore two different methods for achieving this, the first makes use of L1/Texture cache, the second uses shared memory. We discuss the usability of each of our implementations along with their behaviours. We measure performance in execution time, which is a critical factor for real-time systems, we also present results in terms of bandwidth (GB/s), compute (GFlop/s) and type conversions (GTc/s). We include a presentation of our results in terms of the sample rate which can be processed in real-time by a chosen platform, which more intuitively describes the expected performance in a signal processing setting. Our findings show that, for the GPUs considered, the performance of our polyphase filter when using lower precision input data is limited by type conversions rather than device bandwidth. We compare these results to an implementation on the Xeon Phi. We show that our Xeon Phi implementation has a performance that is 1.47x to 1.95x greater than our CPU implementation, however is not insufficient to compete with the performance of GPUs. We conclude with a comparison of our best performing code to two other implementations of the polyphase filter, showing that our implementation is faster in nearly all cases. This work forms part of the Astro-Accelerate project, a many-core accelerated real-time data processing library for digital signal processing of time-domain radio astronomy data.

Fast Radio Bursts (FRBs) are apparently one-time, relatively bright radio pulses that have been observed in recent years. The origin of FRBs is currently unknown and many instruments are being built to detect more of these bursts to better characterize their physical properties and identify the source population. ALFABURST is one such instrument. ALFABURST takes advantage of the 7-beam Arecibo L-band Feed Array (ALFA) receiver on the 305-m Arecibo Radio Telescope in Puerto Rico, to detect FRBs in real-time at L-band (1.4 GHz). We present the results of recent on-sky tests and observations undertaken during the commissioning phase of the instrument. ALFABURST is now available for commensal observations with other ALFA projects.

Pulsar acceleration searches are methods for recovering signals from radio telescopes, that may otherwise be lost due to the effect of orbital acceleration in binary systems. The vast amount of data that will be produced by next generation instruments such as the Square Kilometre Array (SKA) necessitates real-time acceleration searches, which in turn requires the use of HPC platforms. We present our implementation of the Fourier Domain Acceleration Search (FDAS) algorithm on Graphics Processor Units (GPUs) in the context of the SKA, as part of the Astro-Accelerate real-time data processing library, currently under development at the Oxford e-Research Centre (OeRC), University of Oxford.

Fast radio bursts (FRBs) constitute an emerging class of fast radio transient whose origin continues to be a mystery. Realizing the importance of increasing coverage of the search parameter space, we have designed, built, and deployed a realtime monitor for FRBs at the 305-m Arecibo radio telescope. Named 'ALFABURST', it is a commensal instrument that is triggered whenever the 1.4 GHz seven-beam Arecibo $L$-Band Feed Array (ALFA) receiver commences operation. The ongoing commensal survey we are conducting using ALFABURST has an instantaneous field of view of 0.02 sq. deg. within the FWHM of the beams, with the realtime software configurable to use up to 300 MHz of bandwidth. We search for FRBs with dispersion measure up to 2560 cm$^{-3}$ pc and pulse widths ranging from 0.128 ms to 16.384 ms. Commissioning observations performed over the past few months have demonstrated the capability of the instrument in detecting single pulses from known pulsars. In this paper, I describe the instrument and the associated survey.

Fast Radio Bursts (FRBs), are millisecond radio signals that exhibit dispersion larger than what the Galactic electron density can account for. We have conducted a 1446 hour survey for Fast Radio Bursts (FRBs) at 145~MHz, covering a total of 4193 sq. deg on the sky. We used the UK station of the LOFAR radio telescope -- the Rawlings Array -- , accompanied for a majority of the time by the LOFAR station at Nan\c{c}ay, observing the same fields at the same frequency. Our real-time search backend, ARTEMIS, utilizes graphics processing units to search for pulses with dispersion measures up to 320 cm$^{-3}$ pc. Previous derived FRB rates from surveys around 1.4~GHz, and favoured FRB interpretations, motivated this survey, despite all previous detections occurring at higher dispersion measures. We detected no new FRBs above a signal-to-noise threshold of 10, leading to the most stringent upper limit yet on the FRB event rate at these frequencies: 29 sky$^{-1}$ day$^{-1}$ for 5~ms-duration pulses above 62~Jy. The non-detection could be due to scatter-broadening, limitations on the volume and time searched, or the shape of FRB flux density spectra. Assuming the latter and that FRBs are standard candles, the non-detection is compatible with the published FRB sky rate, if their spectra follow a power law with frequency ($\propto \nu^{\alpha}$), with $\alpha\gtrsim+0.1$, demonstrating a marked difference from pulsar spectra. Our results suggest that surveys at higher frequencies, including the low frequency component of the Square Kilometre Array, will have better chances to detect, estimate rates and understand the origin and properties of FRBs.

The LOw Frequency ARray - LOFAR - is a new radio interferometer designed with emphasis on flexible digital hardware instead of mechanical solutions. The array elements, so-called stations, are located in the Netherlands and in neighbouring countries. The design of LOFAR allows independent use of its international stations, which, coupled with a dedicated backend, makes them very powerful telescopes in their own right. This backend is called the Advanced Radio Transient Event Monitor and Identification System (ARTEMIS). It is a combined software/hardware solution for both targeted observations and real-time searches for millisecond radio transients which uses Graphical Processing Unit (GPU) technology to remove interstellar dispersion and detect millisecond radio bursts from astronomical sources in real-time.

The LOw FRequency ARray - LOFAR is a new radio telescope that is moving the science of radio pulsars and transients into a new phase. Its design places emphasis on digital hardware and flexible software instead of mechanical solutions. LOFAR observes at radio frequencies between 10 and 240 MHz where radio pulsars and many transients are expected to be brightest. Radio frequency signals emitted from these objects allow us to study the intrinsic pulsar emission and phenomena such as propagation effects through the interstellar medium. The design of LOFAR allows independent use of its stations to conduct observations of known bright objects, or wide field monitoring of transient events. One such combined software/hardware solution is called the Advanced Radio Transient Event Monitor and Identification System (ARTEMIS). It is a backend for both targeted observations and real-time searches for millisecond radio transients which uses Graphical Processing Unit (GPU) technology to remove interstellar dispersion and detect millisecond radio bursts from astronomical sources in real-time using a single LOFAR station.

Astrophysical radio transients are excellent probes of extreme physical processes originating from compact sources within our Galaxy and beyond. Radio frequency signals emitted from these objects provide a means to study the intervening medium through which they travel. Next generation radio telescopes are designed to explore the vast unexplored parameter space of high time resolution astronomy, but require High Performance Computing (HPC) solutions to process the enormous volumes of data that are produced by these telescopes. We have developed a combined software /hardware solution (code named ARTEMIS) for real-time searches for millisecond radio transients, which uses GPU technology to remove interstellar dispersion and detect millisecond radio bursts from astronomical sources in real-time. Here we present an introduction to ARTEMIS. We give a brief overview of the software pipeline, then focus specifically on the intricacies of performing incoherent de-dispersion. We present results from two brute-force algorithms. The first is a GPU based algorithm, designed to exploit the L1 cache of the NVIDIA Fermi GPU. Our second algorithm is CPU based and exploits the new AVX units in Intel Sandy Bridge CPUs.