Normalized to: Louys, M.
[1]
oai:arXiv.org:1812.00878 [pdf] - 1791937
Provenance tools for Astronomy
Submitted: 2018-12-03
In the context of astronomy projects, scientists have been confronted with
the problem of describing in a standardized way how their data have been
produced. As presented in a talk at last year's ADASS, the International
Virtual Observatory Alliance (IVOA) is working on the definition of a
Provenance Data Model, compatible with the W3C PROV model, which shall describe
how provenance metadata can be modeled, stored and exchanged in astronomy. In
this poster, we present the current status of our developments of libraries and
tools, mainly open source, which implement the IVOA Provenance Data Model in
order to produce, serve, load and visualize provenance information. These
implementations are also needed to validate and adjust the data model and the
standard definitions for accessing provenance. The provenance tools developed
and created for the W3C framework are reused and extended when possible to
tackle the domain of astronomical data.
[2]
oai:arXiv.org:1806.00447 [pdf] - 1692574
Provenance as a requirement for large-scale complex astronomical
instruments
Submitted: 2018-06-01
We developed several pieces of software to enable the tracking of provenance
information for the large-scale complex astronomical observatory CTA, the
Cherenkov Telescope Array. Such major facilities produce data that will be
publicly released to a large community of scientists. There are thus strong
requirements to ensure data quality, reliability and trustworthiness. Among
those requirements, traceability and reproducibility of the data products have
to be included in the development of large projects. Those requirements can be
answered by structuring and storing the provenance information for each data
product. We followed the Provenance data model, currently discussed at the
IVOA, and implemented solutions to collect provenance information during the
CTA data processing and the execution of jobs on a work cluster.
[5]
oai:arXiv.org:1601.02491 [pdf] - 1338251
IVOA Provenance data model: hints from the CTA Provenance prototype
Submitted: 2016-01-11
We present the last developments on the IVOA Provenance data model, mainly
based on the W3C PROV concept. In the context of the Cherenkov astronomy, the
data processing stages imply both assumptions and comparison to dedicated
simulations. As a consequence, Provenance information is crucial to the end
user in order to interpret the high level data products. The Cherenkov
Telescope Array (CTA), currently in preparation, is thus a perfect test case
for the development of an IVOA standard on Provenance information. We describe
general use-cases for the computational Provenance in the CTA production
pipeline and explore the proposed W3C notations like PROV-N formats, as well as
Provenance access solutions.
[6]
oai:arXiv.org:1509.07267 [pdf] - 1886361
IVOA recommendation: Units in the VO
Submitted: 2015-09-24
This document describes a recommended syntax for writing the string
representation of unit labels ("VOUnits"). In addition, it describes a set of
recognised and deprecated units, which is as far as possible consistent with
other relevant standards (BIPM, ISO/IEC and the IAU). The intention is that
units written to conform to this specification will likely also be parsable by
other well-known parsers. To this end, we include machine-readable grammars for
other units syntaxes.
[7]
oai:arXiv.org:1402.4752 [pdf] - 1886356
IVOA Recommendation: IVOA Photometry Data Model
Salgado, Jesus;
Rodrigo, Carlos;
Osuna, Pedro;
Allen, Mark;
Louys, Mireille;
McDowell, Jonathan;
Baines, Deborah;
Apellaniz, Jesus Maiz;
Hatziminaoglou, Evanthia;
Derriere, Sebastien;
Lemson, Gerard
Submitted: 2014-02-19
The Photometry Data Model (PhotDM) standard describes photometry filters,
photometric systems, magnitude systems, zero points and its interrelation with
the other IVOA data models through a simple data model. Particular attention is
given necessarily to optical photometry where specifications of magnitude
systems and photometric zero points are required to convert photometric
measurements into physical flux density units.
[8]
oai:arXiv.org:1402.4744 [pdf] - 1886352
IVOA Recommendation: Simulation Data Model
Lemson, Gerard;
Bourges, Laurent;
Cervino, Miguel;
Gheller, Claudio;
Gray, Norman;
LePetit, Franck;
Louys, Mireille;
Ooghe, Benjamin;
Wagner, Rick;
Wozniak, Herve
Submitted: 2014-02-19
In this document and the accompanying documents we describe a data model
(Simulation Data Model) describing numerical computer simulations of
astrophysical systems. The primary goal of this standard is to support
discovery of simulations by describing those aspects of them that scientists
might wish to query on, i.e. it is a model for meta-data describing
simulations. This document does not propose a protocol for using this model.
IVOA protocols are being developed and are supposed to use the model, either in
its original form or in a form derived from the model proposed here, but more
suited to the particular protocol.
The SimDM has been developed in the IVOA Theory Interest Group with
assistance of representatives of relevant working groups, in particular DM and
Semantics.
[9]
oai:arXiv.org:1211.4687 [pdf] - 1157919
Simultaneous multi-band detection of Low Surface Brightness galaxies
with Markovian modelling
Vollmer, B.;
Perret, B.;
Petremand, M.;
Lavigne, F.;
Collet, Ch.;
van Driel, W.;
Bonnarel, F.;
Louys, M.;
Sabatini, S.;
MacArthur, L. A.
Submitted: 2012-11-20
We present an algorithm for the detection of Low Surface Brightness (LSB)
galaxies in images, called MARSIAA (MARkovian Software for Image Analysis in
Astronomy), which is based on multi-scale Markovian modeling. MARSIAA can be
applied simultaneously to different bands. It segments an image into a
user-defined number of classes, according to their surface brightness and
surroundings - typically, one or two classes contain the LSB structures. We
have developed an algorithm, called DetectLSB, which allows the efficient
identification of LSB galaxies from among the candidate sources selected by
MARSIAA. To assess the robustness of our method, the method was applied to a
set of 18 B and I band images (covering 1.3 square degrees in total) of the
Virgo cluster. To further assess the completeness of the results of our method,
both MARSIAA, SExtractor, and DetectLSB were applied to search for (i) mock
Virgo LSB galaxies inserted into a set of deep Next Generation Virgo Survey
(NGVS) gri-band subimages and (ii) Virgo LSB galaxies identified by eye in a
full set of NGVS square degree gri images. MARSIAA/DetectLSB recovered ~20%
more mock LSB galaxies and ~40% more LSB galaxies identified by eye than
SExtractor/DetectLSB. With a 90% fraction of false positives from an entirely
unsupervised pipeline, a completeness of 90% is reached for sources with r_e >
3" at a mean surface brightness level of mu_g=27.7 mag/arcsec^2 and a central
surface brightness of mu^0 g=26.7 mag/arcsec^2. About 10% of the false
positives are artifacts, the rest being background galaxies. We have found our
method to be complementary to the application of matched filters and an
optimized use of SExtractor, and to have the following advantages: it is
scale-free, can be applied simultaneously to several bands, and is well adapted
for crowded regions on the sky.
[10]
oai:arXiv.org:1210.0709 [pdf] - 570294
Reduction and analysis of MUSE data
Richard, J.;
Bacon, R.;
Weilbacher, P. M.;
Streicher, O.;
Wisotzki, L.;
Herenz, E. C.;
Slezak, E.;
Petremand, M.;
Jalobeanu, A.;
Collet, C.;
Louys, M.;
MUSE, the;
teams, DAHLIA
Submitted: 2012-10-02
MUSE, the Multi Unit Spectroscopic Explorer, is a 2nd generation
integral-field spectrograph under final assembly to see first light at the Very
Large Telescope in 2013. By capturing ~ 90000 optical spectra in a single
exposure, MUSE represents a challenge for data reduction and analysis. We
summarise here the main features of the Data Reduction System, as well as some
of the tools under development by the MUSE consortium and the DAHLIA team to
handle the large MUSE datacubes (about 4x?10^8 pixels) to recover the original
astrophysical signal.
[11]
oai:arXiv.org:1112.5193 [pdf] - 455782
Evolution of the IVOA Characterisation Data Model
Submitted: 2011-12-21
The Characterisation data model is a standard of the International Virtual
Observatory Alliance (IVOA) that describes observational datasets in the
multi-dimensional parameter space. Defining three properties: coverage,
resolution, and sampling along different physical axes (e.g. spatial, spectral,
flux) with variable level of details for the description, this model has been
used in several IVOA contexts: Simple Spectral Access Protocol, Spectrum Data
Model, ObsTAP (Table Access Protocol for the Core Components of the Observation
Data Model. Here we propose a new version which addresses more completely the
most detailed level of description (level 4) dealing with variation maps of
coverage, resolution, and sampling. It also introduces new specific axes in
order to cover various photometric measurements, velocity and polarimetry.
Special care is given for composed data sets. These improvements and add-ons
follow the evolution of needs expressed to the uptake of VO tools in various
observation domains for data discovery but also for data analysis requirements.
This is also introduced to tackle use-cases designed to analyse scientifically
datasets in the V0 context together with calibration/provenance information.
[12]
oai:arXiv.org:1112.5192 [pdf] - 455781
Lessons learnt in building VO resources: binding together several VO
standards into an operational service
Submitted: 2011-12-21
The International Virtual Observatory Alliance (IVOA) developed numerous
interoperability standards during the last several years. Most of them are
quite simple to implement from the technical point of view and even contain
"SIMPLE" in the title. Does it mean that it is also simple to build a working
VO resource using those standards? Yes and no. "Yes" because the standards are
indeed simple, and "no" because usually one needs to implement a lot more than
it was thought in the beginning of the project so the time management of the
team becomes difficult. In our presentation we will start with a basic case of
a simple spectral data collection. Then we will describe several examples of
small" technologically advanced VO resources built in CDS and VO-Paris and will
show that many standards are hidden from managers' eyes at the initial stage of
the project development. The projects will be: (1) the GalMer database
providing access to the results of numerical simulations of galaxy
interactions; (2) the full spectrum fitting service that allows one to extract
internal kinematics and stellar populations from spectra of galaxies available
in the VO. We conclude that: (a) with the existing set of IVOA standards one
can already build very advanced VO-enabled archives and tools useful for
scientists; (b) managers have to be very careful when estimating the project
development timelines for VO-enabled resources.
[13]
oai:arXiv.org:1111.1758 [pdf] - 1886347
IVOA Recommendation: Observation Data Model Core Components and its
Implementation in the Table Access Protocol Version 1.0
Louys, Mireille;
Bonnarel, Francois;
Schade, David;
Dowler, Patrick;
Micol, Alberto;
Durand, Daniel;
Tody, Doug;
Michel, Laurent;
Salgado, Jesus;
Chilingarian, Igor;
Rino, Bruno;
Santander-Vela, J. D.;
Skoda, Petr
Submitted: 2011-11-07, last modified: 2011-11-14
This document defines the core components of the Observation data model that
are necessary to perform data discovery when querying data centers for
observations of interest. It exposes use-cases to be carried out, explains the
model and provides guidelines for its implementation as a data access service
based on the Table Access Protocol (TAP). It aims at providing a simple model
easy to understand and to implement by data providers that wish to publish
their data into the Virtual Observatory. This interface integrates data
modeling and data access aspects in a single service and is named ObsTAP. It
will be referenced as such in the IVOA registries. There will be a separate
document to cover the full Observation data model. In this document, the
Observation Data Model Core Components (ObsCoreDM) defines the core components
of queryable metadata required for global discovery of observational data. It
is meant to allow a single query to be posed to TAP services at multiple sites
to perform global data discovery without having to understand the details of
the services present at each site. It defines a minimal set of basic metadata
and thus allows for a reasonable cost of implementation by data providers. The
combination of the ObsCoreDM with TAP is referred to as an ObsTAP service. As
with most of the VO Data Models, ObsCoreDM makes use of STC, Utypes, Units and
UCDs. The ObsCoreDM can be serialized as a VOTable. ObsCoreDM can make
reference to more complete data models such as ObsProvDM (the Observation
Provenance Data Model, to come), Characterisation DM, Spectrum DM or Simple
Spectral Line Data Model (SSLDM).
[14]
oai:arXiv.org:1111.2281 [pdf] - 1886348
IVOA Recommendation: Data Model for Astronomical DataSet
Characterisation
Submitted: 2011-11-09
This document defines the high level metadata necessary to describe the
physical parameter space of observed or simulated astronomical data sets, such
as 2D-images, data cubes, X-ray event lists, IFU data, etc.. The
Characterisation data model is an abstraction which can be used to derive a
structured description of any relevant data and thus to facilitate its
discovery and scientific interpretation. The model aims at facilitating the
manipulation of heterogeneous data in any VO framework or portal. A VO
Characterisation instance can include descriptions of the data axes, the range
of coordinates covered by the data, and details of the data sampling and
resolution on each axis. These descriptions should be in terms of physical
variables, independent of instrumental signatures as far as possible.
Implementations of this model has been described in the IVOA Note available
at: http://www.ivoa.net/Documents/latest/ImplementationCharacterisation.html
Utypes derived from this version of the UML model are listed and commented in
the following IVOA Note:
http://www.ivoa.net/Documents/latest/UtypeListCharacterisationDM.html
An XML schema has been build up from the UML model and is available at:
http://www.ivoa.net/xml/Characterisation/Characterisation-v1.11.xsd
[15]
oai:arXiv.org:0912.4174 [pdf] - 1018866
The SPECFIND V2.0 catalogue of radio cross-identifications and spectra.
SPECFIND meets the Virtual Observatory
Submitted: 2009-12-21
The new release of the SPECFIND radio cross-identification catalogue,
SPECFIND V2.0, is presented. It contains 107488 cross-identified objects with
at least three radio sources observed at three independent frequencies.
Compared to the previous release the number of entry radio catalogues is
increased from 20 to 97 containing 115 tables. This large increase was only
made possible by the development of four tools at CDS which use the standards
and infrastructure of the Virtual Observatory (VO). This was done in the
framework of the VO-TECH European Design Study of the Sixth Framework Program.
We give an overview of the different classes of radio sources that a user can
encounter. Due to the increase of frequency coverage of the input radio
catalogues, this release demonstrates that the SPECFIND algorithm is able to
detect spectral breaks around a frequency of ~1 GHz.
[16]
oai:arXiv.org:0711.0341 [pdf] - 6657
ASPID-SR: Prototype of a VO-compliant Science-Ready Data Archive
Submitted: 2007-11-02
ASPID stands for the "Archive of Spectral, Photometric, and Interferometric
Data". The world largest collection of raw 3D spectroscopic observations of
galactic and extragalactic sources is provided. ASPID-SR is a prototype of an
archive of heterogeneous science ready data, fed by ASPID, where we try to
exploit all the power of the IVOA Characterisation Data Model. Multi-level
Characterisation metadata is provided for every dataset. The archive provides
powerful metadata query mechanism with access to every data model element,
vital for the efficient scientific usage of a complex informational system. We
provide a set of access interfaces: SIAP/SSAP, HTTP-based characterisation
metadata query, Web-service accepting ADQL/x.
[17]
oai:arXiv.org:0711.0412 [pdf] - 6672
3D Spectroscopy in the Virtual Observatory: Current Status
Submitted: 2007-11-02
Three cornerstones for the 3D data support in the Virtual Observatory are:
(1) data model to describe them, (2) data access services providing access to
fully-reduced datasets, and (3) client applications which can deal with 3D
data. Presently all these components became available in the VO. We demonstrate
an application of the IVOA Characterisation data model to description of IFU
and Fabry-Perot datasets. Two services providing SSA-like access to 3D-spectral
data and Characterisation metadata have been implemented by us: ASPID-SR at SAO
RAS for accessing IFU and Fabry-Perot data from the Russian 6-m telescope, and
the Giraffe Archive at the VO Paris portal for the VLT FLAMES-Giraffe datasets.
We have implemented VO Paris Euro3D Client, handling Euro3D FITS format, that
interacts with CDS Aladin and ESA VOSpec using PLASTIC to display spatial and
spectral cutouts of 3D datasets. Though the prototype we are presenting is yet
rather simple, it demonstrates how 3D spectroscopic data can be fully
integrated into the VO infrastructure.
[18]
oai:arXiv.org:astro-ph/0002109 [pdf] - 34452
The ALADIN Interactive Sky Atlas
Submitted: 2000-02-04
The Aladin interactive sky atlas, developed at CDS, is a service providing
simultaneous access to digitized images of the sky, astronomical catalogues,
and databases.
The driving motivation is to facilitate direct, visual comparison of
observational data at any wavelength with images of the optical sky, and with
reference catalogues.
The set of available sky images consists of the STScI Digitized Sky Surveys,
completed with high resolution images of crowded regions scanned at the MAMA
facility in Paris.
A Java WWW interface to the system is available at:
http://aladin.u-strasbg.fr/