Recently, a full-scale data processing workflow of the Square Kilometre Array (SKA) Phase 1 was successfully executed on the world's fastest supercomputer Summit, proving that scientists have the expertise, software tools and computing resources to process the SKA data. The SKA-Summit experiment shows the importance of multidisciplinary cooperation between astronomy, computer science and others communities. The SKA science cannot be achieved without the joint efforts of talents from multiple fields.

We present a study of 16 HI-detected galaxies found in 178 hours of observations from Epoch 1 of the COSMOS HI Large Extragalactic Survey (CHILES). We focus on two redshift ranges between 0.108 <= z <= 0.127 and 0.162 <= z <= 0.183 which are among the worst affected by radio frequency interference (RFI). While this represents only 10% of the total frequency coverage and 18% of the total expected time on source compared to what will be the full CHILES survey, we demonstrate that our data reduction pipeline recovers high quality data even in regions severely impacted by RFI. We report on our in-depth testing of an automated spectral line source finder to produce HI total intensity maps which we present side-by-side with significance maps to evaluate the reliability of the morphology recovered by the source finder. We recommend that this become a common place manner of presenting data from upcoming HI surveys of resolved objects. We use the COSMOS 20k group catalogue, and we extract filamentary structure using the topological DisPerSE algorithm to evaluate the \hi\ morphology in the context of both local and large-scale environments and we discuss the shortcomings of both methods. Many of the detections show disturbed HI morphologies suggesting they have undergone a recent interaction which is not evident from deep optical imaging alone. Overall, the sample showcases the broad range of ways in which galaxies interact with their environment. This is a first look at the population of galaxies and their local and large-scale environments observed in HI by CHILES at redshifts beyond the z=0.1 Universe.

In this paper, we investigate the Casacore Table Data System (CTDS) used in the casacore and CASA libraries, and methods to parallelize it. CTDS provides a storage manager plugin mechanism for third-party devel- opers to design and implement their own CTDS storage managers. Hav- ing this in mind, we looked into various storage backend techniques that can possibly enable parallel I/O for CTDS by implementing new storage managers. After carrying on benchmarks showing the excellent parallel I/O throughput of the Adaptive IO System (ADIOS), we implemented an ADIOS based parallel CTDS storage manager. We then applied the CASA MSTransform frequency split task to verify the ADIOS Storage Manager. We also ran a series of performance tests to examine the I/O throughput in a massively parallel scenario.

This document describes the structures making up the VOTable standard. The main part of this document describes the adopted part of the VOTable standard; it is followed by appendices presenting extensions which have been proposed and/or discussed, but which are not part of the standard.

Our current understanding of galaxy evolution still has many uncertainties associated with the details of accretion, processing, and removal of gas across cosmic time. The next generation of radio telescopes will image the neutral hydrogen (HI) in galaxies over large volumes at high redshifts, which will provide key insights into these processes. We are conducting the COSMOS HI Large Extragalactic Survey (CHILES) with the Karl G. Jansky Very Large Array, which is the first survey to simultaneously observe HI from z=0 to z~0.5. Here, we report the highest redshift HI 21-cm detection in emission to date of the luminous infrared galaxy (LIRG) COSMOS J100054.83+023126.2 at z=0.376 with the first 178 hours of CHILES data. The total HI mass is $(2.9\pm1.0)\times10^{10}~M_\odot$, and the spatial distribution is asymmetric and extends beyond the galaxy. While optically the galaxy looks undisturbed, the HI distribution suggests an interaction with candidate a candidate companion. In addition, we present follow-up Large Millimeter Telescope CO observations that show it is rich in molecular hydrogen, with a range of possible masses of $(1.8-9.9)\times10^{10}~M_\odot$. This is the first study of the HI and CO in emission for a single galaxy beyond z~0.2.

We present the results of our investigations into options for the computing platform for the imaging pipeline in the CHILES project, an ultra-deep HI pathfinder for the era of the Square Kilometre Array. CHILES pushes the current computing infrastructure to its limits and understanding how to deliver the images from this project is clarifying the Science Data Processing requirements for the SKA. We have tested three platforms: a moderately sized cluster, a massive High Performance Computing (HPC) system, and the Amazon Web Services (AWS) cloud computing platform. We have used well-established tools for data reduction and performance measurement to investigate the behaviour of these platforms for the complicated access patterns of real-life Radio Astronomy data reduction. All of these platforms have strengths and weaknesses and the system tools allow us to identify and evaluate them in a quantitative manner. With the insights from these tests we are able to complete the imaging pipeline processing on both the HPC platform and also on the cloud computing platform, which paves the way for meeting big data challenges in the era of SKA in the field of Radio Astronomy. We discuss the implications that all similar projects will have to consider, in both performance and costs, to make recommendations for the planning of Radio Astronomy imaging workflows.

The SKA will be capable of producing a stream of science data products that are Exa-scale in terms of their storage and processing requirements. This Google-scale enterprise is attracting considerable international interest and excitement from within the industrial and academic communities. In this chapter we examine the data flow, storage and processing requirements of a number of key SKA survey science projects to be executed on the baseline SKA1 configuration. Based on a set of conservative assumptions about trends for HPC and storage costs, and the data flow process within the SKA Observatory, it is apparent that survey projects of the scale proposed will potentially drive construction and operations costs beyond the current anticipated SKA1 budget. This implies a sharing of the resources and costs to deliver SKA science between the community and what is contained within the SKA Observatory. A similar situation was apparent to the designers of the LHC more than 10 years ago. We propose that it is time for the SKA project and community to consider the effort and process needed to design and implement a distributed SKA science data system that leans on the lessons of other projects and looks to recent developments in Cloud technologies to ensure an affordable, effective and global achievement of SKA science goals.

The new wide-field radio telescopes, such as: ASKAP, MWA, LOFAR, eVLA and SKA; will produce spectral-imaging data-cubes (SIDC) of unprecedented size -- in the order of hundreds of Petabytes. Servicing such data as images to the end-user in a traditional manner and formats is likely going to encounter significant performance fallbacks. We discuss the requirements for extremely large SIDCs, and in this light we analyse the applicability of the approach taken in the JPEG2000 (ISO/IEC 15444) standards. We argue the case for the adaptation of contemporary industry standards and technologies vs the modification of legacy astronomy standards or the development new from scratch.

The Murchison Widefield Array (MWA) is a next-generation radio telescope, generating visibility data products continuously at about 400 MB/s. Efficiently managing and archiving this data is a challenge. The MWA Archive consists of dataflows and storage sub-systems distributed across three tiers. At its core is the open source software - the Next-Generation Archive System (NGAS) - that was initially developed in ESO. However, to meet the MWA data challenge, we have tailored and optimised NGAS to achieve high-throughput data ingestion, efficient dataflow management, multi-tiered data storage and processing-aware data staging.

The new widefield radio telescopes, such as: ASKAP,MWA, LOFAR, eVLA and SKA; will produce spectral-imaging data-cubes (SIDC) of unprecedented volumes in the order of hundreds of Petabytes. Servicing such data as images to the end-user may encounter challenges unforeseen during the development of IVOA SIAP. We discuss the requirements for extremely large SIDC, and in this light we analyse the applicability of approach taken in the ISO/IEC 15444 (JPEG2000) standards.

The Murchison Widefield Array is a low frequency (80 - 300 MHz) SKA Precursor, comprising 128 aperture array elements distributed over an area of 3 km diameter. The MWA is located at the extraordinarily radio quiet Murchison Radioastronomy Observatory in the mid-west of Western Australia, the selected home for the Phase 1 and Phase 2 SKA low frequency arrays. The MWA science goals include: 1) detection of fluctuations in the brightness temperature of the diffuse redshifted 21 cm line of neutral hydrogen from the epoch of reionisation; 2) studies of Galactic and extragalactic processes based on deep, confusion-limited surveys of the full sky visible to the array; 3) time domain astrophysics through exploration of the variable radio sky; and 4) solar imaging and characterisation of the heliosphere and ionosphere via propagation effects on background radio source emission. This paper will focus on a brief discussion of the as-built MWA system, highlighting several novel characteristics of the instrument, and a brief progress report (as of June 2012) on the final construction phase. Practical completion of the MWA is expected in November 2012, with commissioning commencing from approximately August 2012 and operations commencing near mid 2013. A brief description of recent science results from the MWA prototype instrument is given.

We introduce \emph{Astronomy and Computing}, a new journal for the growing population of people working in the domain where astronomy overlaps with computer science and information technology. The journal aims to provide a new communication channel within that community, which is not well served by current journals, and to help secure recognition of its true importance within modern astronomy. In this inaugural editorial, we describe the rationale for creating the journal, outline its scope and ambitions, and seek input from the community in defining in detail how the journal should work towards its high-level goals.

The new wide-field radio telescopes, such as: ASKAP, MWA, and SKA; will produce spectral-imaging data-cubes (SIDC) of unprecedented volume. This requires new approaches to managing and servicing the data to the end-user. We present a new integrated framework based on the JPEG2000/ISO/IEC 15444 standard to address the challenges of working with extremely large SIDC. We also present the developed j2k software, that converts and encodes FITS image cubes into JPEG2000 images, paving the way to implementing the pre- sented framework.

The Murchison Widefield Array (MWA) is one of three Square Kilometre Array Precursor telescopes and is located at the Murchison Radio-astronomy Observatory in the Murchison Shire of the mid-west of Western Australia, a location chosen for its extremely low levels of radio frequency interference. The MWA operates at low radio frequencies, 80-300 MHz, with a processed bandwidth of 30.72 MHz for both linear polarisations, and consists of 128 aperture arrays (known as tiles) distributed over a ~3 km diameter area. Novel hybrid hardware/software correlation and a real-time imaging and calibration systems comprise the MWA signal processing backend. In this paper the as-built MWA is described both at a system and sub-system level, the expected performance of the array is presented, and the science goals of the instrument are summarised.

Starting from the Strasbourg ESO Catalogue (SEC) of Planetary Nebulae (PNe), the largest PNe compilation available with ~ 1500 objects, we undertook a comprehensive study of the whole PN population, never carried out so far, only using on-line catalogues and data from public imaging surveys. The study includes the PN dynamics through their measured proper motions (PMs), the study of their galactocentric orbits, the study of their interactions with the interstellar medium (ISM), and the study of their UV-to-IR spectral energy distribution (SED). As a preliminary step required to perform cross-correlations with on-line catalogues, we first went through a systematic reassessment of the PN coordinates (Kerber et al. 2003a).

This paper presents infrared data obtained from observations carried out at the ESO 3.5m New Technology Telescope (NTT) of the Hubble Deep Field South (HDF-S) and the Chandra Deep Field South (CDF-S). These data were taken as part of the ESO Imaging Survey (EIS) program, a public survey conducted by ESO to promote follow-up observations with the VLT. In the HDF-S field the infrared observations cover an area of ~53 square arcmin, encompassing the HST WFPC2 and STIS fields, in the JHKs passbands. The seeing measured in the final stacked images ranges from 0.79" to 1.22" and the median limiting magnitudes (AB system, 2" aperture, 5sigma detection limit) are J_AB~23.0, H_AB~22.8 and K_AB~23.0 mag. Less complete data are also available in JKs for the adjacent HST NICMOS field. For CDF-S, the infrared observations cover a total area of \~100 square arcmin, reaching median limiting magnitudes (as defined above) of J_AB~23.6 and K_AB~22.7 mag. For one CDF-S field H-band data are also available. This paper describes the observations and presents the results of new reductions carried out entirely through the un-supervised, high-throughput EIS Data Reduction System and its associated EIS/MVM C++-based image processing library developed, over the past 5 years, by the EIS project and now publicly available. The paper also presents source catalogs extracted from the final co-added images which are used to evaluate the scientific quality of the survey products, and hence the performance of the software. This is done comparing the results obtained in the present work with those obtained by other authors from independent data and/or reductions carried out with different software packages and techniques. The final science-grade catalogs and co-added images are available at CDS.

This paper presents multi-passband optical data obtained from observations of the Chandra Deep Field South (CDF-S), located at alpha ~ 3h 32m, delta ~ -27d 48m. The observations were conducted at the ESO/MPG 2.2m telescope at La Silla using the 8kx8k Wide-Field Imager (WFI). This data set, taken over a period of one year, represents the first field to be completed by the ongoing Deep Public Survey (DPS) being carried out by the ESO Imaging Survey (EIS) project. This paper describes the optical observations, the techniques employed for un-supervised pipeline processing and the general characteristics of the final data set. The paper includes data taken in six different filters U'UBVRI. The data cover an area of about 0.25 square degrees reaching 5 sigma limiting magnitudes of U'_AB=26.0, U_AB=25.7, B_AB=26.4$, V_AB=25.4, R_AB=25.5 and I_AB= 24.7 mag, as measured within a 2xFWHM aperture. The optical data covers the area of ~ 0.1

This paper presents new J and Ks near-infrared data obtained from observations of the Chandra Deep Field South (CDF-S) conducted at the ESO 3.5m New Technology Telescope (NTT). These data were taken as part of the ongoing Deep Public Survey (DPS) being carried out by the ESO Imaging Survey (EIS) program, extending the EIS-DEEP survey. Combined these surveys now provide a contiguous coverage over an area of 400 square arcmin in the near-infrared, nearly matching that covered by the deep X-ray observations of Chandra, four times the area of the original EIS-DEEP survey. The paper briefly describes the observations and the new techniques being employed for pipeline processing jittered infrared observations, which include unbiased de-fringing and sky-background subtraction, pixel-based astrometry and stacking and pixel registration based on a multi-resolution decomposition of the images. The astrometric solution is based on a pre-release of the GSC-II catalog and has an accuracy of < 0.15 arcsec. The final images for 12 pointings presented here reach median 5 sigma limiting magnitudes of J_AB~23.4 and K_AB~22.6 as measured within an aperture 2xFWHM. The frame to frame variation of the photometric zero-point is estimated to be <0.09 mag. The data are publicly available in the form of fully calibrated J and Ks pixel maps and source lists extracted for each pointing. These data can be requested through the URL ``http://www.eso.org/eis''.

The ESO Imaging Survey (EIS) is an ongoing project to carry out public imaging surveys to support programs on the ESO Very Large Telescope (VLT). The first phase of the project started in July 1997 and consisted of a moderately deep, large-area survey (EIS-WIDE) and a deep optical/infrared survey (EIS-DEEP) using the ESO New Technology Telescope (NTT). EIS has recently reached another milestone with the completion of a Pilot Survey using the Wide-Field Image (WFI), an 8k by 8k mosaic CCD camera mounted on the MPG/ESO 2.2m telescope at La Silla. This paper briefly reviews the results of the original EIS and gives an update of the results obtained from the observations carried out as part of the Pilot Survey. Work in progress on the development of an advanced pipeline for handling data from large CCD mosaics and facilities to make the access to data products easier for external users are also discussed.

This paper presents ground-based data obtained from deep optical and infrared observations carried out at the ESO 3.5 New Technology Telescope (NTT) of a field selected for its low HI content for deep observations with AXAF. These data were taken as part of the ESO Imaging Survey (EIS) program, a public survey conducted in preparation for the first year of operation of the VLT. Deep CCD images are available for five optical passbands, reaching 2 sigma limiting magnitudes of U_AB~27.0, B_AB~27, V_AB~26.5, R_AB~26.5 and I_AB~26. An area of ~56 square arcmin is covered by UBVR observations, and ~30 square arcmin also in I. The infrared observations cover a total area of ~83 square arcmin, reaching J_AB~24.5 and K_AB~23.5. This paper describes the observations and data reduction. It also presents images of the surveyed region and lists the optical and infrared photometric parameters of the objects detected on the co-added images of each passband, as well as multicolor optical and infrared catalogs. These catalogs together with the astrometrically and photometrically calibrated co-added images are public and can be retrieved from the URL http://www.eso.org/eis/ . This data set completes the ESO Imaging Survey program sixteen months after it began in July 1997.

This paper presents ground-based data obtained from deep optical and infrared observations of the HST Hubble Deep Field South (HDF-S) field carried out at the ESO 3.5 New Technology Telescope (NTT). These data were taken as part of the ESO Imaging Survey (EIS) program, a public survey coordinated by ESO and member states, in preparation for the first year of operation of the VLT. Deep CCD images are available for five optical passbands, reaching 2 sigma limiting magnitudes of U_AB~27.0, B_AB~26.5, V_AB~26, R_AB~26, I_AB~25, covering a region of ~25 square arcmin, which includes the HST WPFC2 field. The infrared observations cover a total area of ~42 square arcmin and include both the HST WFPC2 and STIS fields. The observations of the WFPC2 region were conducted in JHKs passbands, reaching J_AB~25, and H_AB and K_AB~24.0. Due to time constraints, the adjacent field, covering the STIS field, has been observed only in R, I and JHKs, while no observations were conducted covering the NIC3 field. This paper describes the observations and data reduction. It also presents images of the surveyed region and lists the optical and infrared photometric parameters of the objects detected on the co-added images of each passband, as well as multicolor optical and infrared catalogs. These catalogs together with the astrometrically and photometrically calibrated co-added images are being made public world-wide and can be retrieved from the world-wide web (http://www.eso.org/eis).

In this paper the list of candidate clusters identified from the I-band data of the ESO Imaging Survey (EIS) is completed using the images obtained over a total area of about 12 square degrees. Together with the data reported earlier the total I-band coverage of EIS is 17 square degrees, which has yielded a sample of 252 cluster candidates in the redshift range $0.2 \lsim z \lsim 1.3$. This is the largest optically-selected sample currently available in the Southern Hemisphere. It is also well distributed in the sky thus providing targets for a variety of VLT programs nearly year round.

This paper presents the I-band data obtained by the ESO Imaging Survey (EIS) over two patches of the sky, 6 square degrees each, centered at $\alpha \sim 5^h40^m$, $\delta \sim -24^\circ50^m$, and $\alpha \sim 9^h50^m$, $\delta \sim -21^\circ 00^m$. The data are being made public in the form of object catalogs and, photometrically and astrometrically calibrated pixel maps. These products together with other useful information can be found at "http://www.eso.org/eis". The overall quality of the data in the two fields is significantly better than the other two patches released earlier and cover a much larger contiguous area. The total number of objects in the catalogs extracted from these frames is over 700,000 down to $I\sim23$, where the galaxy catalogs are 80% complete. The star counts are consistent with model predictions computed at the position of the patches considered. The galaxy counts and the angular two-point correlation functions are also consistent with those of the other patches showing that the EIS data set is homogeneous and that the galaxy catalogs are uniform.

This paper presents preliminary lists of potentially interesting point-like sources extracted from multicolor data obtained for a 1.7 square degree region near the South Galactic Pole. The region has been covered by the ESO Imaging Survey (EIS) in B, V,I, and offers a unique combination of area and depth.These lists, containing a total of 330 objects nearly all brighter than I~21.5, over 1.27 square degrees (after removing some bad regions), are by-products of the process of verification and quality control of the object catalogs being produced. Among the color selected targets are candidate very low mass stars/brown dwarfs (54), white-dwarfs (32), and quasars (244). In addition, a probable fast moving asteroid was identified. The objects presented here are natural candidates for follow-up spectroscopic observations and illustrate the usefulness of the EIS data for a broad range of science and for providing possible samples for the first year of the VLT.

This paper presents 19 additional candidate clusters detected using the galaxy catalog extracted from the I-band images taken for the ESO Imaging Survey (EIS). The candidates are found over a region of 1.1 square degrees, located near the South Galactic Pole. Combined with the sample reported earlier, the number of candidates in the Southern Galactic Cap is now 54 over a total area of 3.6 square degrees. Images in V band are also available over 2.7 square degrees, and galaxy catalogs extracted from them over a uniform area of 2 square degrees have been used to further explore the reality of the I cluster candidates. Nearly all the I candidates with estimated redshifts <~ 0.5 are also identified in V. At higher redshifts, only rich candidates are detected in both bands.

This paper presents multicolor data obtained for a 1.7 square degree region near the South Galactic Pole (patch B) as part of the ESO Imaging Survey (EIS). So far the observations have been conducted in B,V and I but are expected to be complemented by observations in the U band later in 1998. Object catalogs extracted from single exposure images are 80% complete down to B~24, V~23.5 and I ~22.5 and once coadded should reach about 0.5 mag deeper. The data are being made public in the form of catalogs, pixel maps, target lists and image "postage stamps" which can be retrieved from the Web. Counts of stars and galaxies and the angular two-point correlation function of galaxies are computed and compared to other available data to evaluate the depth and uniformity of the extrtacted object catalogs. In addition, color distributions of stellar objects are presented and compared to model predictions to examine the reliability of the colors. The results suggest that the overall quality of the catalogs extracted from the images is good and suitable for the science goals of the survey.

This paper presents the preliminary results of the ESO Imaging Survey (EIS), a public survey being carried out by ESO and member states, in preparation for the VLT first-light. The survey goals, organization, strategy and observations are discussed and an overview is given of the survey pipeline developed to handle EIS data and produce object catalogs. A report is presented on moderately deep I-band observations obtained in the first of four patches surveyed, covering a region of 3.2 square degrees centered at R.A. 22h40m and Dec. -40d. The products available to the community, including pixel maps (with astrometric and photometric calibrations) and the corresponding object catalogs, are also described. In order to evaluate the quality of the data, preliminary estimates are presented for the star and galaxy number counts, and for the angular two-point correlation function obtained from the available data. The present work is meant as a preview of the final release of the EIS data that will become available later this year.

Preliminary results of a search for distant clusters of galaxies using the recently released I-band data obtained by the ESO Imaging Survey are presented. In this first installment of the survey, data covering about 3 square degrees in I-band are being used. The matched filter algorithm is applied to two sets of frames that cover the whole patch contiguously and these independent realizations are used to assess the performance of the algorithm and to establish, from the data itself, a robust detection threshold. A preliminary catalog of distant clusters is presented, containing 39 cluster candidates with estimated redshifts 0.3 < z < 1.3 over an area of 2.5 square degrees.

The ESO Imaging Survey (EIS) presented in early issues of the Messenger, and with up-to-date information on the ongoing observations available on the Web (http://www.eso.org/eis), is a concerted effort by ESO and the Member State community to provide targets for the first year of operation of the VLT. It consists of two parts: a relatively wide-angle survey (EIS-WIDE) to cover four pre-selected patches of sky, 6 square degrees each, spread in right ascension to search for distant clusters and quasars and a deep, multicolor survey of four optical (SUSI-2) and two infrared (SOFI) covering the HST/Hubble Deep Field South (HDFS) and its flanking fields (EIS-DEEP). From the start, the main challenge has been to carry out a public survey in a limited amount of time requiring observations, software development and data reduction with the goal of distributing the survey data products before the call for proposal for the VLT. To cope with this one-year timetable, a novel type of collaboration between ESO and the community has been established which has allowed EIS to combine the scientific and technical expertise fo the community with in-house know-how and infrastructure. In spite of the adverse weather conditions in some of the earlier runs, EIS has already proved to be successful experiment achieving most of its scientific and technical goals, thereby laying the ground work for future imaging surveys.