Normalized to: Bonnarel, F.
[1]
oai:arXiv.org:1911.08205 [pdf] - 2000357
Integrating the VO Framework in the EOSC
Molinaro, Marco;
Allen, Mark;
Bertocco, Sara;
Boisson, Catherine;
Bonnarel, François;
Neves, Margarida Castro;
Demleitner, Markus;
Genova, Françoise;
Morris, Dave;
Schaaff, André;
Taffoni, Giuliano;
Voutsinas, Stelios
Submitted: 2019-11-19
The European Open Science Cloud (EOSC) is in its early stages, but already
some aspects of the EOSC vision are starting to become reality, for example the
EOSC portal and the development of metadata catalogues. In the astrophysical
domain already exists an open approach to science data: the Virtual Observatory
view put in place by the International Virtual Observatory Alliance (IVOA)
architecture of standards. The ESCAPE (European Science Cluster of Astronomy &
Particle physics ESFRI research infrastructures) project has, among its tasks,
to demonstrate that the VO architecture can be integrated within the EOSC
building one and to provide guidelines to ESFRI partners (European Strategy
Forum on Research Infrastructures) in doing this. This contribution reports on
the progress of this integration after the first months of work inside ESCAPE.
[2]
oai:arXiv.org:1812.00878 [pdf] - 1791937
Provenance tools for Astronomy
Submitted: 2018-12-03
In the context of astronomy projects, scientists have been confronted with
the problem of describing in a standardized way how their data have been
produced. As presented in a talk at last year's ADASS, the International
Virtual Observatory Alliance (IVOA) is working on the definition of a
Provenance Data Model, compatible with the W3C PROV model, which shall describe
how provenance metadata can be modeled, stored and exchanged in astronomy. In
this poster, we present the current status of our developments of libraries and
tools, mainly open source, which implement the IVOA Provenance Data Model in
order to produce, serve, load and visualize provenance information. These
implementations are also needed to validate and adjust the data model and the
standard definitions for accessing provenance. The provenance tools developed
and created for the W3C framework are reused and extended when possible to
tackle the domain of astronomical data.
[3]
oai:arXiv.org:1806.00447 [pdf] - 1692574
Provenance as a requirement for large-scale complex astronomical
instruments
Submitted: 2018-06-01
We developed several pieces of software to enable the tracking of provenance
information for the large-scale complex astronomical observatory CTA, the
Cherenkov Telescope Array. Such major facilities produce data that will be
publicly released to a large community of scientists. There are thus strong
requirements to ensure data quality, reliability and trustworthiness. Among
those requirements, traceability and reproducibility of the data products have
to be included in the development of large projects. Those requirements can be
answered by structuring and storing the provenance information for each data
product. We followed the Provenance data model, currently discussed at the
IVOA, and implemented solutions to collect provenance information during the
CTA data processing and the execution of jobs on a work cluster.
[4]
oai:arXiv.org:1710.08791 [pdf] - 1886371
IVOA Recommendation: Server-side Operations for Data Access
Submitted: 2017-10-24
This document describes the Server-side Operations for Data Access (SODA) web
service capability. SODA is a low-level data access capability or server side
data processing that can act upon the data files, performing various kinds of
operations: filtering/subsection, transformations, pixel operations, and
applying functions to the data.
[5]
oai:arXiv.org:1612.00299 [pdf] - 1525850
IVOA Data Access Layer: Goals, Achievements and Current Trends
Submitted: 2016-12-01
The IVOA Data Access Layer (DAL) working group was created in 2002 to define
protocols to homogenize data discovery, data description, data retrieval, and
data access processes. We describe its history and status today, and look at
current trends for future development of the DAL protocols.
[7]
oai:arXiv.org:1601.02491 [pdf] - 1338251
IVOA Provenance data model: hints from the CTA Provenance prototype
Submitted: 2016-01-11
We present the last developments on the IVOA Provenance data model, mainly
based on the W3C PROV concept. In the context of the Cherenkov astronomy, the
data processing stages imply both assumptions and comparison to dedicated
simulations. As a consequence, Provenance information is crucial to the end
user in order to interpret the high level data products. The Cherenkov
Telescope Array (CTA), currently in preparation, is thus a perfect test case
for the development of an IVOA standard on Provenance information. We describe
general use-cases for the computational Provenance in the CTA production
pipeline and explore the proposed W3C notations like PROV-N formats, as well as
Provenance access solutions.
[8]
oai:arXiv.org:1601.00519 [pdf] - 1335137
IVOA Simple Image Access
Submitted: 2016-01-04
The Simple Image Access protocol (SIA) provides capabilities for the
discovery, description, access, and retrieval of multi-dimensional image
datasets, including 2-D images as well as datacubes of three or more
dimensions. SIA data discovery is based on the ObsCore Data Model (ObsCoreDM),
which primarily describes data products by the physical axes (spatial,
spectral, time, and polarization). Image datasets with dimension greater than 2
are often referred to as datacubes, cube or image cube datasets and may be
considered examples of hypercube or n-cube data. In this document the term
"image" refers to general multi-dimensional datasets and is synonymous with
these other terms unless the image dimensionality is otherwise specified. SIA
provides capabilities for image discovery and access. Data discovery and
metadata access (using ObsCoreDM) are defined here. The capabilities for
drilling down to data files (and related resources) and services for remote
access are defined elsewhere, but SIA also allows for direct access to
retrieval.
[9]
oai:arXiv.org:1509.06152 [pdf] - 1886360
IVOA recommendation: IVOA DataLink
Submitted: 2015-09-21
This document describes the linking of data discovery metadata to access to
the data itself, further detailed metadata, related resources, and to services
that perform operations on the data. The web service capability supports a
drill-down into the details of a specific dataset and provides a set of links
to the dataset file(s) and related resources. This specification also includes
a VOTable-specific method of providing descriptions of one or more services and
their input(s), usually using parameter values from elsewhere in the VOTable
document. Providers are able to describe services that are relevant to the
records (usually datasets with identifiers) by including service descriptors in
a result document.
[10]
oai:arXiv.org:1505.02291 [pdf] - 1183004
Hierarchical progressive surveys. Multi-resolution HEALPix data
structures for astronomical images, catalogues, and 3-dimensional data cubes
Fernique, P.;
Allen, M. G.;
Boch, T.;
Oberto, A.;
Pineau, F-X.;
Durand, D.;
Bot, C.;
Cambresy, L.;
Derriere, S.;
Genova, F.;
Bonnarel, F.
Submitted: 2015-05-09
Scientific exploitation of the ever increasing volumes of astronomical data
requires efficient and practical methods for data access, visualisation, and
analysis. Hierarchical sky tessellation techniques enable a multi-resolution
approach to organising data on angular scales from the full sky down to the
individual image pixels. Aims. We aim to show that the Hierarchical progressive
survey (HiPS) scheme for describing astronomical images, source catalogues, and
three-dimensional data cubes is a practical solution to managing large volumes
of heterogeneous data and that it enables a new level of scientific
interoperability across large collections of data of these different data
types. Methods. HiPS uses the HEALPix tessellation of the sphere to define a
hierarchical tile and pixel structure to describe and organise astronomical
data. HiPS is designed to conserve the scientific properties of the data
alongside both visualisation considerations and emphasis on the ease of
implementation. We describe the development of HiPS to manage a large number of
diverse image surveys, as well as the extension of hierarchical image systems
to cube and catalogue data. We demonstrate the interoperability of HiPS and
Multi-Order Coverage (MOC) maps and highlight the HiPS mechanism to provide
links to the original data. Results. Hierarchical progressive surveys have been
generated by various data centres and groups for ~200 data collections
including many wide area sky surveys, and archives of pointed observations.
These can be accessed and visualised in Aladin, Aladin Lite, and other
applications. HiPS provides a basis for further innovations in the use of
hierarchical data structures to facilitate the description and statistical
analysis of large astronomical data sets.
[11]
oai:arXiv.org:1411.6514 [pdf] - 904262
Using the Virtual Observatory: multi-instrument, multi-wavelength study
of high-energy sources
Submitted: 2014-11-24
This paper presents a tutorial explaining the use of Virtual Observatory
tools in high energy astrophysics. Most of the tools used in this paper were
developed at the Strasbourg astronomical Data Center and we show how they can
be applied to conduct a multi-instrument, multi-wavelength analysis of sources
detected by the High Energy Stereoscopic System and the Fermi Large Area
Telescope. The analysis involves queries of different data catalogs, selection
and cross-correlation techniques on multi-waveband images, and the construction
of high energy color-color plots and multi-wavelength spectra. The tutorial is
publicly available on the website of the European Virtual Observatory project.
[12]
oai:arXiv.org:1211.4687 [pdf] - 1157919
Simultaneous multi-band detection of Low Surface Brightness galaxies
with Markovian modelling
Vollmer, B.;
Perret, B.;
Petremand, M.;
Lavigne, F.;
Collet, Ch.;
van Driel, W.;
Bonnarel, F.;
Louys, M.;
Sabatini, S.;
MacArthur, L. A.
Submitted: 2012-11-20
We present an algorithm for the detection of Low Surface Brightness (LSB)
galaxies in images, called MARSIAA (MARkovian Software for Image Analysis in
Astronomy), which is based on multi-scale Markovian modeling. MARSIAA can be
applied simultaneously to different bands. It segments an image into a
user-defined number of classes, according to their surface brightness and
surroundings - typically, one or two classes contain the LSB structures. We
have developed an algorithm, called DetectLSB, which allows the efficient
identification of LSB galaxies from among the candidate sources selected by
MARSIAA. To assess the robustness of our method, the method was applied to a
set of 18 B and I band images (covering 1.3 square degrees in total) of the
Virgo cluster. To further assess the completeness of the results of our method,
both MARSIAA, SExtractor, and DetectLSB were applied to search for (i) mock
Virgo LSB galaxies inserted into a set of deep Next Generation Virgo Survey
(NGVS) gri-band subimages and (ii) Virgo LSB galaxies identified by eye in a
full set of NGVS square degree gri images. MARSIAA/DetectLSB recovered ~20%
more mock LSB galaxies and ~40% more LSB galaxies identified by eye than
SExtractor/DetectLSB. With a 90% fraction of false positives from an entirely
unsupervised pipeline, a completeness of 90% is reached for sources with r_e >
3" at a mean surface brightness level of mu_g=27.7 mag/arcsec^2 and a central
surface brightness of mu^0 g=26.7 mag/arcsec^2. About 10% of the false
positives are artifacts, the rest being background galaxies. We have found our
method to be complementary to the application of matched filters and an
optimized use of SExtractor, and to have the following advantages: it is
scale-free, can be applied simultaneously to several bands, and is well adapted
for crowded regions on the sky.
[13]
oai:arXiv.org:1203.5725 [pdf] - 1886349
IVOA Recommendation: Simple Spectral Access Protocol Version 1.1
Tody, Doug;
Dolensky, Markus;
McDowell, Jonathan;
Bonnarel, Francois;
Budavari, Tamas;
Busko, Ivo;
Micol, Alberto;
Osuna, Pedro;
Salgado, Jesus;
Skoda, Petr;
Thompson, Randy;
Valdes, Frank;
group, the Data Access Layer working
Submitted: 2012-03-26
The Simple Spectral Access (SSA) Protocol (SSAP) defines a uniform interface
to remotely discover and access one dimensional spectra. SSA is a member of an
integrated family of data access interfaces altogether comprising the Data
Access Layer (DAL) of the IVOA. SSA is based on a more general data model
capable of describing most tabular spectrophotometric data, including time
series and spectral energy distributions (SEDs) as well as 1-D spectra; however
the scope of the SSA interface as specified in this document is limited to
simple 1-D spectra, including simple aggregations of 1-D spectra. The form of
the SSA interface is simple: clients first query the global resource registry
to find services of interest and then issue a data discovery query to selected
services to determine what relevant data is available from each service; the
candidate datasets available are described uniformly in a VOTable format
document which is returned in response to the query. Finally, the client may
retrieve selected datasets for analysis. Spectrum datasets returned by an SSA
spectrum service may be either precomputed, archival datasets, or they may be
virtual data which is computed on the fly to respond to a client request.
Spectrum datasets may conform to a standard data model defined by SSA, or may
be native spectra with custom project-defined content. Spectra may be returned
in any of a number of standard data formats. Spectral data is generally stored
externally to the VO in a format specific to each spectral data collection;
currently there is no standard way to represent astronomical spectra, and
virtually every project does it differently. Hence spectra may be actively
mediated to the standard SSA-defined data model at access time by the service,
so that client analysis programs do not have to be familiar with the
idiosyncratic details of each data collection to be accessed.
[14]
oai:arXiv.org:1112.5192 [pdf] - 455781
Lessons learnt in building VO resources: binding together several VO
standards into an operational service
Submitted: 2011-12-21
The International Virtual Observatory Alliance (IVOA) developed numerous
interoperability standards during the last several years. Most of them are
quite simple to implement from the technical point of view and even contain
"SIMPLE" in the title. Does it mean that it is also simple to build a working
VO resource using those standards? Yes and no. "Yes" because the standards are
indeed simple, and "no" because usually one needs to implement a lot more than
it was thought in the beginning of the project so the time management of the
team becomes difficult. In our presentation we will start with a basic case of
a simple spectral data collection. Then we will describe several examples of
small" technologically advanced VO resources built in CDS and VO-Paris and will
show that many standards are hidden from managers' eyes at the initial stage of
the project development. The projects will be: (1) the GalMer database
providing access to the results of numerical simulations of galaxy
interactions; (2) the full spectrum fitting service that allows one to extract
internal kinematics and stellar populations from spectra of galaxies available
in the VO. We conclude that: (a) with the existing set of IVOA standards one
can already build very advanced VO-enabled archives and tools useful for
scientists; (b) managers have to be very careful when estimating the project
development timelines for VO-enabled resources.
[15]
oai:arXiv.org:1112.5193 [pdf] - 455782
Evolution of the IVOA Characterisation Data Model
Submitted: 2011-12-21
The Characterisation data model is a standard of the International Virtual
Observatory Alliance (IVOA) that describes observational datasets in the
multi-dimensional parameter space. Defining three properties: coverage,
resolution, and sampling along different physical axes (e.g. spatial, spectral,
flux) with variable level of details for the description, this model has been
used in several IVOA contexts: Simple Spectral Access Protocol, Spectrum Data
Model, ObsTAP (Table Access Protocol for the Core Components of the Observation
Data Model. Here we propose a new version which addresses more completely the
most detailed level of description (level 4) dealing with variation maps of
coverage, resolution, and sampling. It also introduces new specific axes in
order to cover various photometric measurements, velocity and polarimetry.
Special care is given for composed data sets. These improvements and add-ons
follow the evolution of needs expressed to the uptake of VO tools in various
observation domains for data discovery but also for data analysis requirements.
This is also introduced to tackle use-cases designed to analyse scientifically
datasets in the V0 context together with calibration/provenance information.
[16]
oai:arXiv.org:1111.1758 [pdf] - 1886347
IVOA Recommendation: Observation Data Model Core Components and its
Implementation in the Table Access Protocol Version 1.0
Louys, Mireille;
Bonnarel, Francois;
Schade, David;
Dowler, Patrick;
Micol, Alberto;
Durand, Daniel;
Tody, Doug;
Michel, Laurent;
Salgado, Jesus;
Chilingarian, Igor;
Rino, Bruno;
Santander-Vela, J. D.;
Skoda, Petr
Submitted: 2011-11-07, last modified: 2011-11-14
This document defines the core components of the Observation data model that
are necessary to perform data discovery when querying data centers for
observations of interest. It exposes use-cases to be carried out, explains the
model and provides guidelines for its implementation as a data access service
based on the Table Access Protocol (TAP). It aims at providing a simple model
easy to understand and to implement by data providers that wish to publish
their data into the Virtual Observatory. This interface integrates data
modeling and data access aspects in a single service and is named ObsTAP. It
will be referenced as such in the IVOA registries. There will be a separate
document to cover the full Observation data model. In this document, the
Observation Data Model Core Components (ObsCoreDM) defines the core components
of queryable metadata required for global discovery of observational data. It
is meant to allow a single query to be posed to TAP services at multiple sites
to perform global data discovery without having to understand the details of
the services present at each site. It defines a minimal set of basic metadata
and thus allows for a reasonable cost of implementation by data providers. The
combination of the ObsCoreDM with TAP is referred to as an ObsTAP service. As
with most of the VO Data Models, ObsCoreDM makes use of STC, Utypes, Units and
UCDs. The ObsCoreDM can be serialized as a VOTable. ObsCoreDM can make
reference to more complete data models such as ObsProvDM (the Observation
Provenance Data Model, to come), Characterisation DM, Spectrum DM or Simple
Spectral Line Data Model (SSLDM).
[17]
oai:arXiv.org:1111.2281 [pdf] - 1886348
IVOA Recommendation: Data Model for Astronomical DataSet
Characterisation
Submitted: 2011-11-09
This document defines the high level metadata necessary to describe the
physical parameter space of observed or simulated astronomical data sets, such
as 2D-images, data cubes, X-ray event lists, IFU data, etc.. The
Characterisation data model is an abstraction which can be used to derive a
structured description of any relevant data and thus to facilitate its
discovery and scientific interpretation. The model aims at facilitating the
manipulation of heterogeneous data in any VO framework or portal. A VO
Characterisation instance can include descriptions of the data axes, the range
of coordinates covered by the data, and details of the data sampling and
resolution on each axis. These descriptions should be in terms of physical
variables, independent of instrumental signatures as far as possible.
Implementations of this model has been described in the IVOA Note available
at: http://www.ivoa.net/Documents/latest/ImplementationCharacterisation.html
Utypes derived from this version of the UML model are listed and commented in
the following IVOA Note:
http://www.ivoa.net/Documents/latest/UtypeListCharacterisationDM.html
An XML schema has been build up from the UML model and is available at:
http://www.ivoa.net/xml/Characterisation/Characterisation-v1.11.xsd
[18]
oai:arXiv.org:0912.4174 [pdf] - 1018866
The SPECFIND V2.0 catalogue of radio cross-identifications and spectra.
SPECFIND meets the Virtual Observatory
Submitted: 2009-12-21
The new release of the SPECFIND radio cross-identification catalogue,
SPECFIND V2.0, is presented. It contains 107488 cross-identified objects with
at least three radio sources observed at three independent frequencies.
Compared to the previous release the number of entry radio catalogues is
increased from 20 to 97 containing 115 tables. This large increase was only
made possible by the development of four tools at CDS which use the standards
and infrastructure of the Virtual Observatory (VO). This was done in the
framework of the VO-TECH European Design Study of the Sixth Framework Program.
We give an overview of the different classes of radio sources that a user can
encounter. Due to the increase of frequency coverage of the input radio
catalogues, this release demonstrates that the SPECFIND algorithm is able to
detect spectral breaks around a frequency of ~1 GHz.
[19]
oai:arXiv.org:0711.0341 [pdf] - 6657
ASPID-SR: Prototype of a VO-compliant Science-Ready Data Archive
Submitted: 2007-11-02
ASPID stands for the "Archive of Spectral, Photometric, and Interferometric
Data". The world largest collection of raw 3D spectroscopic observations of
galactic and extragalactic sources is provided. ASPID-SR is a prototype of an
archive of heterogeneous science ready data, fed by ASPID, where we try to
exploit all the power of the IVOA Characterisation Data Model. Multi-level
Characterisation metadata is provided for every dataset. The archive provides
powerful metadata query mechanism with access to every data model element,
vital for the efficient scientific usage of a complex informational system. We
provide a set of access interfaces: SIAP/SSAP, HTTP-based characterisation
metadata query, Web-service accepting ADQL/x.
[20]
oai:arXiv.org:0711.0412 [pdf] - 6672
3D Spectroscopy in the Virtual Observatory: Current Status
Submitted: 2007-11-02
Three cornerstones for the 3D data support in the Virtual Observatory are:
(1) data model to describe them, (2) data access services providing access to
fully-reduced datasets, and (3) client applications which can deal with 3D
data. Presently all these components became available in the VO. We demonstrate
an application of the IVOA Characterisation data model to description of IFU
and Fabry-Perot datasets. Two services providing SSA-like access to 3D-spectral
data and Characterisation metadata have been implemented by us: ASPID-SR at SAO
RAS for accessing IFU and Fabry-Perot data from the Russian 6-m telescope, and
the Giraffe Archive at the VO Paris portal for the VLT FLAMES-Giraffe datasets.
We have implemented VO Paris Euro3D Client, handling Euro3D FITS format, that
interacts with CDS Aladin and ESA VOSpec using PLASTIC to display spatial and
spectral cutouts of 3D datasets. Though the prototype we are presenting is yet
rather simple, it demonstrates how 3D spectroscopic data can be fully
integrated into the VO infrastructure.
[21]
oai:arXiv.org:0711.0342 [pdf] - 6658
Comprehensive Metadata Query Interface for Heterogeneous Data Archives
Based on Open Source PostgreSQL ORDBMS
Submitted: 2007-11-02
We use PostgreSQL DBMS for storing XML metadata, described by the IVOA
Characterisation Data Model. Initial XML type support in the PostgreSQL has
recently been implemented. We make heavy use of this feature in order to
provide comprehensive search over Characterisation metadata tree. We built a
prototype of the Characterisation metadata query service, implementing two
access methods: (1) HTTP-GET/POST based interface implements almost direct
translation of the query parameter name into XPath of the data model element in
the XML serialisation; (2) Web-Service based interface to receive XQuery which
is also directly translated into XPath. This service will be used in the
ASPID-SR archive, containing science-ready data obtained with the Russian 6-m
telescope.
[22]
oai:arXiv.org:astro-ph/0002110 [pdf] - 1232410
The SIMBAD astronomical database
Wenger, Marc;
Ochsenbein, Francois;
Egret, Daniel;
Dubois, Pascal;
Bonnarel, Francois;
Borde, Suzanne;
Genova, Francoise;
Jasniewicz, Gerard;
Laloe, Suzanne;
Lesteven, Soizick;
Monier, Richard
Submitted: 2000-02-04
Simbad is the reference database for identification and bibliography of
astronomical objects. It contains identifications, `basic data', bibliography,
and selected observational measurements for several million astronomical
objects. Simbad is developed and maintained by CDS, Strasbourg. Building the
database contents is achieved with the help of several contributing institutes.
Scanning the bibliography is the result of the collaboration of CDS with
bibliographers in Observatoire de Paris (DASGAL), Institut d'Astrophysique de
Paris, and Observatoire de Bordeaux. When selecting catalogues and tables for
inclusion, priority is given to optimal multi-wavelength coverage of the
database, and to support of research developments linked to large projects. In
parallel, the systematic scanning of the bibliography reflects the diversity
and general trends of astronomical research.
A WWW interface to Simbad is available at: http://simbad.u-strasbg.fr/Simbad
[23]
oai:arXiv.org:astro-ph/0002109 [pdf] - 34452
The ALADIN Interactive Sky Atlas
Submitted: 2000-02-04
The Aladin interactive sky atlas, developed at CDS, is a service providing
simultaneous access to digitized images of the sky, astronomical catalogues,
and databases.
The driving motivation is to facilitate direct, visual comparison of
observational data at any wavelength with images of the optical sky, and with
reference catalogues.
The set of available sky images consists of the STScI Digitized Sky Surveys,
completed with high resolution images of crowded regions scanned at the MAMA
facility in Paris.
A Java WWW interface to the system is available at:
http://aladin.u-strasbg.fr/
[24]
oai:arXiv.org:astro-ph/0002095 [pdf] - 34438
The CDS information hub
Genova, Francoise;
Egret, Daniel;
Bienayme, Olivier;
Bonnarel, Francois;
Dubois, Pascal;
Fernique, Pierre;
Jasniewicz, Gerard;
Lesteven, Soizick;
Monier, Richard;
Ochsenbein, Francois;
Wenger, Marc
Submitted: 2000-02-04
The Centre de Donnees astronomiques de Strasbourg (CDS) provides homogeneous
access to heterogeneous information of various origins: information about
astronomical objects in Simbad; catalogs and observation logs in VizieR and in
the catalogue service; reference images and overlays in Aladin; nomenclature in
the Dictionary of Nomenclature; Yellow Page services; the AstroGLU resource
discovery tool; mirror copies of other reference services; and documentation.
With the implementation of links between the CDS services, and with other
on--line reference information, CDS has become a major hub in the rapidly
evolving world of information retrieval in astronomy, developing efficient
tools to help astronomers to navigate in the world-wide `Virtual Observatory'
under construction, from data in the observatory archives to results published
in journals. The WWW interface to the CDS services is available at:
http://cdsweb.u-strasbg.fr/
