We present the discovery and subarcsecond localization of a new Fast Radio Burst with the Karl G. Jansky Very Large Array and realfast search system. The FRB was discovered on 2019 June 14 with a dispersion measure of 959 pc/cm3. This is the highest DM of any localized FRB and its measured burst fluence of 0.6 Jy ms is less than nearly all other FRBs. The source is not detected to repeat in 15 hours of VLA observing and 153 hours of CHIME/FRB observing. We describe a suite of statistical and data quality tests we used to verify the significance of the event and its localization precision. Follow-up optical/infrared photometry with Keck and Gemini associate the FRB to a pair of galaxies with $\rm{r}\sim23$ mag. The false-alarm rate for radio transients of this significance that are associated with a host galaxy is roughly $3\times10^{-4}\ \rm{hr}^{-1}$. The two putative host galaxies have similar photometric redshifts of $z_{\rm{phot}}\sim0.6$, but different colors and stellar masses. Comparing the host distance to that implied by the dispersion measure suggests a modest (~ 50 pc/cm3) electron column density associated with the FRB environment or host galaxy/galaxies.

We report the detection of new binary black hole merger events in the publicly available data from the second observing run of advanced LIGO and advanced Virgo (O2). The mergers were discovered using the new search pipeline described in Venumadhav et al. [Phys. Rev. D 100, 023011 (2019)], and are above the detection thresholds as defined in Abbott et al. (LIGO Scientific and Virgo Collaborations) [Phys. Rev. X 9, 031040 (2019).] Three of the mergers (GW170121, GW170304, GW170727) have inferred probabilities of being of astrophysical origin $p_{\rm astro} > 0.98$. The remaining three (GW170425, GW170202, GW170403) are less certain, with $p_{\rm astro}$ ranging from 0.5 to 0.8. The newly found mergers largely share the statistical properties of previously reported events, with the exception of GW170403, the least secure event, which has a highly negative effective spin parameter $\chi_{\rm eff}$ . The most secure new event, GW170121 ($p_{\rm astro} > 0.99$), is also notable due to its inferred negative value of $\chi_{\rm eff}$, which is inconsistent with being positive at the ~95.8% confidence level. The new mergers nearly double the sample of gravitational wave events reported from O2, and present a substantial opportunity to explore the statistics of the binary black hole population in the Universe. The number of detected events is not surprising since we estimate that the detection volume of our pipeline may be larger than that of other pipelines by as much as a factor of two (with significant uncertainties in the estimate). The increase in volume is larger when the constituent detectors of the network have very different sensitivities, as is likely to be the case in current and future runs.

We perform a detailed parameter estimation study of binary black hole merger events reported in Zackay et al. and Venumadhav et al.. These are some of the faintest signals reported so far, and hence, relative to the loud events in the GWTC-1 catalog, the data should have lesser constraining power on their intrinsic parameters. Hence we examine the robustness of parameter inference to choices made in the analysis, as well as any potential systematics. We check the impact of different methods of estimating the noise power spectral density, different waveform models, and different priors for the compact object spins. For most of the events, the resulting differences in the inferred values of the parameters are much smaller than their statistical uncertainties. The estimation of the effective spin parameter $\chi_{\mathrm{eff}}$, i.e. the projection of the mass-weighted total spin along the angular momentum, can be sensitive to analysis choices for two of the sources with the largest effective spin magnitudes, GW151216 and GW170403. The primary differences arise from using a 3D isotropic spin prior: the tails of the posterior distributions should be interpreted with care and due consideration of the other data analysis choices.

We introduce a new technique to search for gravitational wave events from compact binary mergers that produce a clear signal only in a single gravitational wave detector, and marginal signals in other detectors. Such a situation can arise when the detectors in a network have different sensitivities, or when sources have unfavorable sky locations or orientations. We start with a short list of loud single-detector triggers from regions of parameter space that are empirically unaffected by glitches (after applying signal-quality vetoes). For each of these triggers, we compute evidence for astrophysical origin from the rest of the detector network by coherently combining the likelihoods from all detectors and marginalizing over extrinsic geometric parameters. We report the discovery of two new binary black hole (BBH) mergers in the second observing run of Advanced LIGO and Virgo (O2), in addition to the ones that were reported in Abbott et al. (2018) and Venumadhav et al. (2019). We estimate that the two events have false alarm rates of one in 19 years (60 O2) and one in 11 years (36 O2). One of the events, GW170817A, has primary and secondary masses $m_1^{\rm src} = 56_{-10}^{+16} \, M_\odot$ and $m_2^{\rm src} = 40_{-11}^{+10} \, M_\odot$ in the source frame. The existence of GW170817A should be very informative about the theoretically predicted upper mass gap for stellar mass black holes. Its effective spin parameter is measured to be $\chi_{\rm eff} = 0.5 \pm 0.2$, which is consistent with the tendency of the heavier detected BBH systems to have large and positive effective spin parameters. The other event, GWC170402, will be discussed thoroughly in future work.

Searches for gravitational waves crucially depend on exact signal processing of noisy strain data from gravitational wave detectors, which are known to exhibit significant non-Gaussian behavior. In this paper, we study two distinct non-Gaussian effects in the LIGO/Virgo data which reduce the sensitivity of searches: first, variations in the noise power spectral density (PSD) on timescales of more than a few seconds; and second, loud and abrupt transient `glitches' of terrestrial or instrumental origin. We derive a simple procedure to correct, at first order, the effect of the variation in the PSD on the search background. Given the knowledge of the existence of localized glitches in particular segments of data, we also develop a method to insulate statistical inference from these glitches, so as to cleanly excise them without affecting the search background in neighboring seconds. We show the importance of applying these methods on the publicly available LIGO data, and measure an increase in the detection volume of at least $15\%$ from the PSD-drift correction alone, due to the improved background distribution.

High cadence transient surveys are able to capture supernovae closer to their first light than before. Applying analytical models to such early emission, we can constrain the progenitor stars properties. In this paper, we present observations of SN2018fif (ZTF18abokyfk). The supernova was discovered close to first light and monitored by the Zwicky Transient Facility (ZTF) and the Neil Gehrels Swift Observatory. Early spectroscopic observations suggest that the progenitor of SN2018fif was surrounded by relatively small amounts of circumstellar material (CSM) compared to all previous cases. This particularity, coupled with the high cadence multiple-band coverage, makes it a good candidate to investigate using shock-cooling models. We employ the SOPRANOS code, an implementation of the model by Sapir & Waxman (2017). Compared with previous implementations, SOPRANOS has the advantage of including a careful account of the limited temporal validity domain of the shock-cooling model. We find that the progenitor of SN2018fif was a large red supergiant, with a radius of R=1174_{-81}^{+208} solar radii, and an ejected mass of M=5.6_{-1.0}^{+9.1} solar masses. Our model also gives information on the explosion epoch, the progenitor inner structure, the shock velocity and the extinction. The large radius differs from previously modeled objects, and the difference could be either intrinsic or due to the relatively small amount of CSM around SN2018fif, perhaps making it a "cleaner" candidate for applying shock-cooling analytical models.

We introduce an algorithm for placing template waveforms for the search of compact binary mergers in gravitational wave interferometer data. We exploit the smooth dependence of the amplitude and unwrapped phase of the frequency-domain waveform on the parameters of the binary. We group waveforms with similar amplitude profiles and perform a singular value decomposition of the phase profiles to obtain an orthonormal basis for the phase functions. The leading basis functions span a lower-dimensional linear space in which the unwrapped phase of any physical waveform is well approximated. The optimal template placement is given by a regular grid in the space of linear coefficients. The algorithm is applicable to any frequency-domain waveform model and detector sensitivity curve. It is computationally efficient and requires little tuning. Applying this method, we construct a set of template banks suitable for the search of aligned-spin binary neutron star, neutron-star--black-hole and binary black hole mergers in LIGO--Virgo data.

We report a new binary black hole merger in the publicly available LIGO First Observing Run (O1) data release. The event has an inverse false alarm rate of one per six years in the detector-frame chirp-mass range $\mathcal{M}^{\rm det} \in [20,40]M_\odot$ in a new independent analysis pipeline that we developed. Our best estimate of the probability that the event is of astrophysical origin is $P_{\rm astro} \sim 0.71\, .$ The estimated physical parameters of the event indicate that it is the merger of two massive black holes, $\mathcal{M}^{\rm det} = 31^{+2}_{-3}\,M_\odot$ with an effective spin parameter, $\chi_{\rm eff} = 0.81^{+0.15}_{-0.21}$, making this the most highly spinning merger reported to date. It is also among the two highest redshift mergers observed so far. The high aligned spin of the merger supports the hypothesis that merging binary black holes can be created by binary stellar evolution.

In this paper, we report on the construction of a new and independent pipeline for analyzing the public data from the first observing run of advanced LIGO for mergers of compact binary systems. The pipeline incorporates different techniques and makes independent implementation choices in all its stages including the search design, the method to construct template banks, the automatic routines to detect bad data segments ("glitches") and to insulate good data from them, the procedure to account for the non-stationary nature of the detector noise, the signal-quality vetoes at the single-detector level and the methods to combine results from multiple detectors. Our pipeline enabled us to identify a new binary black-hole merger GW151216 in the public LIGO data. This paper serves as a bird's eye view of the pipeline's important stages. Full details and derivations underlying the various stages will appear in accompanying papers.

We show that recent observations of the compact binary, AM CVn type system, ES Ceti are fully consistent with theoretical predictions of stable mass transfer moderated by angular momentum loss due to gravitational-wave radiation. One of the main predictions of this model (for degenerate donors) is a widening of the binary. The mass transfer rate inferred from the observed rate of change in the orbital frequency is consistent with that inferred from the observed flux using the recent Gaia DR2 parallax

SN2010jl was a luminous Type IIn supernova (SN), detected in radio, optical, X-ray and hard X-rays. Here we report on its six year R- and g-band light curves obtained using the Palomar Transient Factory. The light curve was generated using a pipeline based on the proper image subtraction method and we discuss the algorithm performances. As noted before, the R-band light curve, up to about 300 days after maximum light is well described by a power-law decline with a power-law index of about -0.5. Between day 300 and day 2300 after maximum light, it is consistent with a power-law decline, with a power-law index of about -3.4. The longevity of the light curve suggests that the massive circum-stellar material around the progenitor was ejected on time scales of at least tens of years prior to the progenitor explosion.

Identification of linear features (streaks) in astronomical images is important for several reasons, including: detecting fast-moving near-Earth asteroids; detecting or flagging faint satellites streaks; and flagging or removing diffraction spikes, pixel bleeding, line-like cosmic rays and bad-pixel features. Here we discuss an efficient and optimal algorithm for the detection of such streaks. The optimal method to detect streaks in astronomical images is by cross-correlating the image with a template of a line broadened by the point spread function of the system. To do so efficiently, the cross-correlation of the streak position and angle is performed using the Radon transform, which is the integral of pixel values along all possible lines through an image. A fast version of the Radon transform exists, which we here extend to efficiently detect arbitrarily short lines. While the brute force Radon transform requires an order of N^3 operations for an N by N image, the fast Radon transform has a complexity of the order of N^2 log(N). We apply this method to simulated images, recovering the theoretical signal-to-noise ratio, and to real images, finding long streaks of low-Earth-orbit satellites and shorter streaks of Global Positioning System satellites. We detect streaks that are barely visible to the eye, out of hundreds of images, without a-priori knowledge of the streaks' positions or angles. We provide implementation of this algorithm in Python and MATLAB.

Gravitational waves emitted from compact binary coalescence can be subject to wave diffraction if they are gravitationally lensed by an intervening mass clump whose Schwarzschild timescale matches the wave period. Waves in the ground-based frequency band $f\sim 10$--$10^3\,$Hz are sensitive to clumps with masses $M_E \sim 10^2$--$10^3\,M_\odot$ enclosed within the impact parameter. These can be the central parts of low mass $M_L \sim 10^3$--$10^6\,M_\odot$ dark matter halos, which are predicted in Cold Dark Matter scenarios but are challenging to observe. Neglecting finely-tuned impact parameters, we focus on lenses aligned generally on the Einstein scale for which multiple lensed images may not form in the case of an extended lens. In this case, diffraction induces amplitude and phase modulations whose sizes $\sim 10\%$--$20\%$ are small enough so that standard matched filtering with unlensed waveforms do not degrade, but are still detectable for events with high signal-to-noise ratio. We develop and test an agnostic detection method based on dynamic programming, which does not require a detailed model of the lensed waveforms. For pseudo-Jaffe lenses aligned up to the Einstein radius, we demonstrate that a pair of fully upgraded aLIGO/Virgo detectors can extract diffraction imprints from binary black hole mergers out to $z_s \sim 0.2$--$0.3$. The prospect will improve dramatically for a third-generation detector for which binary black hole mergers out to $z_s \sim 2$--$4$ will all become valuable sources.

Most telescope designs have a circular-shape aperture. We demonstrate that telescopes with an elongated pupil have better contrast, at lower separations, between a bright central star and a faint companion. We simulate images for an elongated-pupil telescope and for a circular-pupil telescope of equal aperture area and integration time, investigating specifically what is the maximal contrast for finding faint companions around bright stars as a function of angular separation. We show that this design gives better contrast at lower separation from a bright star. This is shown for diffraction-limited (for perfect and imperfect optics) and seeing-limited speckle images, assuming equal aperture area and observing time. We also show the results are robust to errors in measurement of the point spread function. To compensate for the wider point spread function of the short axis, images should be taken at different rotation angles, either by rotating the telescope around the optical axis or by allowing a stationary mirror array to scan different parallactic angles with time. Images taken at different rotation angles are added using the proper image coaddition algorithms developed by Zackay & Ofek. The final image has the same contrast in all angles, rather than in specific areas of diffraction nulls. We obtained speckle observations with a small, ground based elongated-aperture telescope and show the results are consistent with simulations.

We present a method to accelerate the evaluation of the likelihood in gravitational wave parameter estimation. Parameter estimation codes compute likelihoods of similar waveforms, whose phases and amplitudes differ smoothly with frequency. We exploit this by precomputing frequency-binned overlaps of the best-fit waveform with the data. We show how these summary data can be used to approximate the likelihood of any waveform that is sufficiently probable within the required accuracy. We demonstrate that $\simeq 60$ bins suffice to accurately compute likelihoods for strain data at a sampling rate of $4096\,$Hz and duration of $T=2048\,$s around the binary neutron star merger GW170817. Relative binning speeds up parameter estimation for frequency domain waveform models by a factor of $\sim 10^4$ compared to naive matched filtering and $\sim 10$ compared to reduced order quadrature.

Relative binning is a new method for fast and accurate evaluation of the likelihood of gravitational wave strain data. This technique can be used to produce reliable posterior distributions for compact object mergers with very moderate computational resources. We use a fast likelihood evaluation code based on this technique to estimate the parameters of the double neutron-star merger event GW170817 using publicly available LIGO data. We obtain statistically similar posteriors using either Markov-chain Monte-Carlo or nested sampling. The results do not favor non-zero aligned spins at a statistically significant level. There is no significant sign of non-zero tidal deformability (as quantified by the Bayesian evidence), whether or not high-spin or low-spin priors are adopted. Our posterior samples are publicly available, and we also provide a tutorial Python code to implement fast likelihood evaluation using the relative binning method.

Detection of templates (e.g., sources) embedded in low-number count Poisson noise is a common problem in astrophysics. Examples include source detection in X-ray images, gamma-rays, UV, neutrinos, and search for clusters of galaxies and stellar streams. However, the solutions in the X-ray-related literature are sub-optimal -- in some cases by considerable factors. Using the lemma of Neyman-Pearson we derive the optimal statistics for template detection in the presence of Poisson noise. We demonstrate that this method provides higher completeness, for a fixed false-alarm probability value, compared with filtering the image with the point-spread function (PSF). In turn, we find that filtering by the PSF is better than filtering the image using the Mexican-hat wavelet (used by wavedetect). For some background levels, our method improves the sensitivity of source detection by more than a factor of two over the popular Mexican-hat wavelet filtering. This filtering technique can also be used also for fast PSF photometry and flare detection, and it is efficient, as well as straight forward to implement. We provide an implementation in MATLAB.

We report the detection of an ultra-bright fast radio burst (FRB) from a modest, 3.4-day pilot survey with the Australian Square Kilometre Array Pathfinder. The survey was conducted in a wide-field fly's-eye configuration using the phased-array-feed technology deployed on the array to instantaneously observe an effective area of $160$ deg$^2$, and achieve an exposure totaling $13200$ deg$^2$ hr. We constrain the position of FRB 170107 to a region $8'\times8'$ in size (90% containment) and its fluence to be $58\pm6$ Jy ms. The spectrum of the burst shows a sharp cutoff above $1400$ MHz, which could be either due to scintillation or an intrinsic feature of the burst. This confirms the existence of an ultra-bright ($>20$ Jy ms) population of FRBs.

Transient detection and flux measurement via image subtraction stand at the base of time domain astronomy. Due to the varying seeing conditions, the image subtraction process is non-trivial, and existing solutions suffer from a variety of problems. Starting from basic statistical principles, we develop the optimal statistic for transient detection, flux measurement and any image-difference hypothesis testing. We derive a closed-form statistic that: (i) Is mathematically proven to be the optimal transient detection statistic in the limit of background-dominated noise; (ii) Is numerically stable; (iii) For accurately registered, adequately sampled images, does not leave subtraction or deconvolution artifacts; (iv) Allows automatic transient detection to the theoretical sensitivity limit by providing credible detection significance; (v) Has uncorrelated white noise; (vi) Is a sufficient statistic for any further statistical test on the difference image, and in particular, allows to distinguish particle hits and other image artifacts from real transients; (vii) Is symmetric to the exchange of the new and reference images; (viii) Is at least an order of magnitude faster to compute than some popular methods; and (ix) Is straightforward to implement. Furthermore, we present extensions of this method that make it resilient to registration errors, color-refraction errors, and any noise source that can be modelled. In addition, we show that the optimal way to prepare a reference image is the proper image coaddition presented in Zackay \& Ofek (2015b). We demonstrate this method on simulated data and real observations from the Palomar Transient Factory data release 2. We provide an implementation of this algorithm in MATLAB and Python.

Stacks of digital astronomical images are combined in order to increase image depth. The variable seeing conditions, sky background and transparency of ground-based observations make the coaddition process non-trivial. We present image coaddition methods optimized for source detection and flux measurement, that maximize the signal-to-noise ratio (S/N). We show that for these purposes the best way to combine images is to apply a matched filter to each image using its own point spread function (PSF) and only then to sum the images with the appropriate weights. Methods that either match filter after coaddition, or perform PSF homogenization prior to coaddition will result in loss of sensitivity. We argue that our method provides an increase of between a few and 25 percent in the survey speed of deep ground-based imaging surveys compared with weighted coaddition techniques. We demonstrate this claim using simulated data as well as data from the Palomar Transient Factory data release 2. We present a variant of this coaddition method which is optimal for PSF or aperture photometry. We also provide an analytic formula for calculating the S/N for PSF photometry on single or multiple observations. In the next paper in this series we present a method for image coaddition in the limit of background-dominated noise which is optimal for any statistical test or measurement on the constant-in-time image (e.g., source detection, shape or flux measurement or star-galaxy separation), making the original data redundant. We provide an implementation of this algorithm in MATLAB.

Image coaddition is one of the most basic operations that astronomers perform. In Paper~I, we presented the optimal ways to coadd images in order to detect faint sources and to perfrom flux measurements under the assumption that the noise is approximately Gaussian. Here, we build on these results and derive from first principles a coaddition technique which is optimal for any hypothesis testing and measurement (e.g., source detection, flux or shape measurements and star/galaxy separation), in the background-noise-dominated case. This method has several important properties. The pixels of the resulting coadd image are uncorrelated. This image preserves all the information (from the original individual images) on all spatial frequencies. Any hypothesis testing or measurement that can be done on all the individual images simultaneously, can be done on the coadded image without any loss of information. The PSF of this image is typically as narrow, or narrower than the PSF of the best image in the ensemble. Moreover, this image is practically indistinguishable from a regular single image, meaning that any code that measures any property on a regular astronomical image can be applied to it unchanged. In particular, the optimal source detection statistic derived in paper~I is reproduced by matched filtering this image with its own PSF. This coaddition process, which we call proper coaddition, can be understood as a the maximum signal-to-noise ratio measurement of the Fourier transform of the image, weighted in such a way that the noise in the entire Fourier domain is of equal variance. This method has important implications for multi-epoch seeing-limited deep surveys, weak lensing galaxy shape measurements, and diffraction-limited imaging via speckle observations. The last topic will be covered in depth in future papers. We provide an implementation of this algorithm in MATLAB.

Astronomical radio bursts disperse while traveling through the interstellar medium. To optimally detect a short-duration signal within a frequency band, we have to precisely compensate for the pulse dispersion, which is a computationally demanding task. We present the Fast Dispersion Measure Transform (FDMT) algorithm for optimal detection of such signals. Our algorithm has a low theoretical complexity of 2N_f N_t+ N_t N_d log_2(N_f) where N_f, N_t and N_d are the numbers of frequency bins, time bins, and dispersion measure bins, respectively. Unlike previously suggested fast algorithms our algorithm conserves the sensitivity of brute force dedispersion. Our tests indicate that this algorithm, running on a standard desktop computer, and implemented in a high-level programming language, is already faster than the state of the art dedispersion codes running on graphical processing units (GPUs). We also present a variant of the algorithm that can be efficiently implemented on GPUs. The latter algorithm's computation and data transport requirements are similar to those of two-dimensional FFT, indicating that incoherent dedispersion can now be considered a non-issue while planning future surveys. We further present a fast algorithm for sensitive dedispersion of pulses shorter than normally allowed by incoherent dedispersion. In typical cases this algorithm is orders of magnitude faster than coherent dedispersion by convolution. We analyze the computational complexity of pulsed signal searches by radio interferometers. We conclude that, using our suggested algorithms, maximally sensitive blind searches for such pulses is feasible using existing facilities. We provide an implementation of these algorithms in Python and MATLAB.

We present the method of multiplexed imaging designed for astronomical observations of large sky areas in the IR, visible and UV frequencies. Our method relies on the sparse nature of astronomical observations. The method consists of an optical system that directs light from different locations on the focal plane of a telescope onto the same detector area and an algorithm that reconstructs the original wide-field image. In this way we can use a physically small detector to cover a wide field of view. We test our reconstruction algorithm using public space telescope data. Our tests demonstrate the reliability and power of the multiplexed imaging method. Using our method it will be possible to increase the sky area covered with space telescopes by 1-3 orders of magnitude, depending on the specific scientific goal and optical parameters. This method can significantly increase the volume of astronomical surveys, including search programs for exoplanets and transients using space and ground instruments.