Normalized to: Kartik, S.
[1]
oai:arXiv.org:1709.03950 [pdf] - 1588274
Robust dimensionality reduction for interferometric imaging of Cygnus A
Submitted: 2017-09-12
Extremely high data rates expected in next-generation radio interferometers
necessitate a fast and robust way to process measurements in a big data
context. Dimensionality reduction can alleviate computational load needed to
process these data, in terms of both computing speed and memory usage. In this
article, we present image reconstruction results from highly reduced
radio-interferometric data, following our previously proposed data
dimensionality reduction method, $\mathrm{R}_{\mathrm{sing}}$, based on
studying the distribution of the singular values of the measurement operator.
This method comprises a simple weighted, subsampled discrete Fourier transform
of the dirty image. Additionally, we show that an alternative gridding-based
reduction method works well for target data sizes of the same order as the
image size. We reconstruct images from well-calibrated VLA data to showcase the
robustness of our proposed method down to very low data sizes in a 'real data'
setting. We show through comparisons with the conventional reduction method of
time- and frequency-averaging, that our proposed method produces more accurate
reconstructions while reducing data size much further, and is particularly
robust when data sizes are aggressively reduced to low fractions of the image
size. $\mathrm{R}_{\mathrm{sing}}$ can function in a block-wise fashion, and
could be used in the future to process incoming data by blocks in real-time,
thus opening up the possibility of performing 'on-line' imaging as the data are
being acquired. MATLAB code for the proposed dimensionality reduction method is
available on GitHub.
[2]
oai:arXiv.org:1609.02097 [pdf] - 1570915
A Fourier dimensionality reduction model for big data interferometric
imaging
Submitted: 2016-09-07, last modified: 2017-02-28
Data dimensionality reduction in radio interferometry can provide savings of
computational resources for image reconstruction through reduced memory
footprints and lighter computations per iteration, which is important for the
scalability of imaging methods to the big data setting of the next-generation
telescopes. This article sheds new light on dimensionality reduction from the
perspective of compressed sensing theory and studies its interplay with imaging
algorithms designed in the context of convex optimization. We propose a
post-gridding linear data embedding to the space spanned by the left singular
vectors of the measurement operator, providing a dimensionality reduction below
image size. This embedding preserves the null space of the measurement operator
and hence also its sampling properties as per compressed sensing theory. We
show that this can be approximated by first computing the dirty image and then
applying a weighted subsampled discrete Fourier transform to obtain the final
reduced data vector. This Fourier dimensionality reduction model ensures a fast
implementation of the full measurement operator, essential for any iterative
image reconstruction method. The proposed reduction also preserves the i.i.d.
Gaussian properties of the original measurement noise. For convex
optimization-based imaging algorithms, this is key to justify the use of the
standard L2-norm as the data fidelity term. Our simulations confirm that this
dimensionality reduction approach can be leveraged by convex optimization
algorithms with no loss in imaging quality relative to reconstructing the image
from the complete visibility data set. Reconstruction results in simulation
settings with no direction dependent effects or calibration errors show
promising performance of the proposed dimensionality reduction. MATLAB code
implementing the proposed reduction method is available on GitHub.