Normalized to: Kitaeff, V.
[1]
oai:arXiv.org:1411.7088 [pdf] - 904330
Compression of Visibility Data for Murchison Widefield Array
Submitted: 2014-11-25, last modified: 2014-12-06
The Murchison Widefield Array (MWA) is a new low frequency radio telescope
operating on the Square Kilometre Array site in Western Australia. MWA is
generating tens of terabytes of data daily. The size of the required data
storage has become a significant operational limitation and cost. We present a
simple binary compression technique and a system for the floating point
visibility data developed MWA. We present the statistics of the impact of such
compression on the data with the typical compression ratio up to 1:3.1.
[2]
oai:arXiv.org:1403.2801 [pdf] - 844806
Astronomical Imagery: Considerations For a Contemporary Approach with
JPEG2000
Submitted: 2014-03-11, last modified: 2014-06-30
The new wide-field radio telescopes, such as: ASKAP, MWA, LOFAR, eVLA and
SKA; will produce spectral-imaging data-cubes (SIDC) of unprecedented size --
in the order of hundreds of Petabytes. Servicing such data as images to the
end-user in a traditional manner and formats is likely going to encounter
significant performance fallbacks. We discuss the requirements for extremely
large SIDCs, and in this light we analyse the applicability of the approach
taken in the JPEG2000 (ISO/IEC 15444) standards. We argue the case for the
adaptation of contemporary industry standards and technologies vs the
modification of legacy astronomy standards or the development new from scratch.
[3]
oai:arXiv.org:1401.7433 [pdf] - 844108
The impact of JPEG2000 lossy compression on the scientific quality of
radio astronomy imagery
Submitted: 2014-01-29, last modified: 2014-06-30
The sheer volume of data anticipated to be captured by future radio
telescopes, such as, The Square Kilometer Array (SKA) and its precursors
present new data challenges, including the cost and technical feasibility of
data transport and storage. Image and data compression are going to be
important techniques to reduce the data size. We provide a quantitative
analysis of the effects of JPEG2000's lossy wavelet image compression algorithm
on the quality of the radio astronomy imagery data. This analysis is completed
by evaluating the completeness, soundness and source parameterisation of the
Duchamp source finder using compressed data. Here we found the JPEG2000 image
compression has the potential to denoise image cubes, however this effect is
only significant at high compression rates where the accuracy of source
parameterisation is decreased.
[4]
oai:arXiv.org:1209.1877 [pdf] - 560881
SkuareView: Client-Server Framework for Accessing Extremely Large Radio
Astronomy Image Data
Submitted: 2012-09-10
The new wide-field radio telescopes, such as: ASKAP, MWA, and SKA; will
produce spectral-imaging data-cubes (SIDC) of unprecedented volume. This
requires new approaches to managing and servicing the data to the end-user. We
present a new integrated framework based on the JPEG2000/ISO/IEC 15444 standard
to address the challenges of working with extremely large SIDC. We also present
the developed j2k software, that converts and encodes FITS image cubes into
JPEG2000 images, paving the way to implementing the pre- sented framework.