Normalized to: Berriman, B.
[1]
oai:arXiv.org:1911.11779 [pdf] - 2005643
Enabling real-time multi-messenger astrophysics discoveries with deep
learning
Huerta, E. A.;
Allen, Gabrielle;
Andreoni, Igor;
Antelis, Javier M.;
Bachelet, Etienne;
Berriman, Bruce;
Bianco, Federica;
Biswas, Rahul;
Carrasco, Matias;
Chard, Kyle;
Cho, Minsik;
Cowperthwaite, Philip S.;
Etienne, Zachariah B.;
Fishbach, Maya;
Förster, Francisco;
George, Daniel;
Gibbs, Tom;
Graham, Matthew;
Gropp, William;
Gruendl, Robert;
Gupta, Anushri;
Haas, Roland;
Habib, Sarah;
Jennings, Elise;
Johnson, Margaret W. G.;
Katsavounidis, Erik;
Katz, Daniel S.;
Khan, Asad;
Kindratenko, Volodymyr;
Kramer, William T. C.;
Liu, Xin;
Mahabal, Ashish;
Marka, Zsuzsa;
McHenry, Kenton;
Miller, Jonah;
Moreno, Claudia;
Neubauer, Mark;
Oberlin, Steve;
Olivas, Alexander R.;
Petravick, Donald;
Rebei, Adam;
Rosofsky, Shawn;
Ruiz, Milton;
Saxton, Aaron;
Schutz, Bernard F.;
Schwing, Alex;
Seidel, Ed;
Shapiro, Stuart L.;
Shen, Hongyu;
Shen, Yue;
Singer, Leo;
Sipőcz, Brigitta M.;
Sun, Lunan;
Towns, John;
Tsokaros, Antonios;
Wei, Wei;
Wells, Jack;
Williams, Timothy J.;
Xiong, Jinjun;
Zhao, Zhizhen
Submitted: 2019-11-26
Multi-messenger astrophysics is a fast-growing, interdisciplinary field that
combines data, which vary in volume and speed of data processing, from many
different instruments that probe the Universe using different cosmic
messengers: electromagnetic waves, cosmic rays, gravitational waves and
neutrinos. In this Expert Recommendation, we review the key challenges of
real-time observations of gravitational wave sources and their electromagnetic
and astroparticle counterparts, and make a number of recommendations to
maximize their potential for scientific discovery. These recommendations refer
to the design of scalable and computationally efficient machine learning
algorithms; the cyber-infrastructure to numerically simulate astrophysical
sources, and to process and interpret multi-messenger astrophysics data; the
management of gravitational wave detections to trigger real-time alerts for
electromagnetic and astroparticle follow-ups; a vision to harness future
developments of machine learning and cyber-infrastructure resources to cope
with the big-data requirements; and the need to build a community of experts to
realize the goals of multi-messenger astrophysics.
[2]
oai:arXiv.org:1909.02161 [pdf] - 1956011
The Potential of Exozodiacal Disks Observations with the WFIRST
Coronagraph Instrument
Mennesson, B.;
Bailey, V.;
Kasdin, J.;
Trauger, J.;
Absil, O.;
Akeson, R.;
Armus, L.;
Baudino, J. L.;
Baudoz, P.;
Bellini, A.;
Bennett, D.;
Berriman, B.;
Boccaletti, A.;
Calchi-Novati, S.;
Carpenter, K.;
Chen, C.;
Danchi, W.;
Debes, J.;
Defrere, D.;
Ertel, S.;
Frerking, M.;
Gelino, C.;
Girard, J.;
Groff, T.;
Kane, S.;
Helou, G.;
Kalirai, J.;
Kral, Q.;
Krist, J.;
Kruk, J.;
Hasegawa, Y.;
Lagrange, A. M.;
Laine, S.;
Langlois, M.;
Lowrance, P.;
Maire, A. L.;
Malhotra, S.;
Mandell, A.;
Marshall, P.;
McElwain, M.;
Meshkat, T.;
Millan-Gabet, R.;
Moustakas, L.;
Nemati, B.;
Paladini, R.;
Postman, M.;
Pueyo, L.;
Quintana, E.;
Ramirez, S.;
Rhodes, J.;
Riggs, A. J. E.;
Rizzo, M.;
Rouan, D.;
Soummer, R.;
Stapelfeldt, K.;
Stark, C.;
Turnbull, M.;
van der Marel, R.;
Vigan, A.;
Ygouf, M.;
Wyatt, M.;
Zhao, F.;
Zimmerman, N.
Submitted: 2019-09-04
The Wide Field Infrared Survey Telescope (WFIRST) Coronagraph Instrument
(CGI) will be the first high-performance stellar coronagraph using active
wavefront control for deep starlight suppression in space, providing
unprecedented levels of contrast, spatial resolution, and sensitivity for
astronomical observations in the optical. One science case enabled by the CGI
will be taking images and(R~50)spectra of faint interplanetary dust structures
present in the habitable zone of nearby sunlike stars (~10 pc) and within the
snow-line of more distant ones(~20pc), down to dust density levels commensurate
with that of the solar system zodiacal cloud. Reaching contrast levels
below~10-7 for the first time, CGI will cross an important threshold in debris
disks physics, accessing disks with low enough optical depths that their
structure is dominated by transport phenomena than collisions. Hence, CGI
results will be crucial for determining how exozodiacal dust grains are
produced and transported in low-density disks around mature stars.
Additionally, CGI will be able to measure the brightness level and constrain
the degree of asymmetry of exozodiacal clouds around individual nearby sunlike
stars in the optical, at the ~10x solar zodiacal emission level. This
information will be extremely valuable for optimizing the observational
strategy of possible future exo-Earth direct imaging missions, especially those
planning to operate at optical wavelengths, such as Habitable Exoplanet
Observatory (HabEx) and the Large Ultraviolet/Optical/Infrared Surveyor
(LUVOIR).
[3]
oai:arXiv.org:1907.06981 [pdf] - 1917113
Astro2020 APC White Paper: Elevating the Role of Software as a Product
of the Research Enterprise
Smith, Arfon M.;
Norman, Dara;
Cruz, Kelle;
Desai, Vandana;
Bellm, Eric;
Lundgren, Britt;
Economou, Frossie;
Nord, Brian D.;
Schafer, Chad;
Narayan, Gautham;
Harrington, Joseph;
Tollerud, Erik;
Sipőcz, Brigitta;
Pickering, Timothy;
Peeples, Molly S.;
Berriman, Bruce;
Teuben, Peter;
Rodriguez, David;
Gradvohl, Andre;
Shamir, Lior;
Allen, Alice;
Brownstein, Joel R.;
Ginsburg, Adam;
Sinha, Manodeep;
Hummels, Cameron;
Smith, Britton;
Stevance, Heloise;
Price-Whelan, Adrian;
Cherinka, Brian;
Chan, Chi-kwan;
Kartaltepe, Jeyhan;
Turk, Matthew;
Weiner, Benjamin;
Modjaz, Maryam;
Nemiroff, Robert J.;
Kerzendorf, Wolfgang;
Laginja, Iva;
Dong, Chuanfei;
Merín, Bruno;
Sobeck, Jennifer;
Buzasi, Derek;
Faherty, Jacqueline K;
Momcheva, Ivelina;
Connolly, Andrew;
Golkhou, V. Zach
Submitted: 2019-07-14
Software is a critical part of modern research, and yet there are
insufficient mechanisms in the scholarly ecosystem to acknowledge, cite, and
measure the impact of research software. The majority of academic fields rely
on a one-dimensional credit model whereby academic articles (and their
associated citations) are the dominant factor in the success of a researcher's
career. In the petabyte era of astronomical science, citing software and
measuring its impact enables academia to retain and reward researchers that
make significant software contributions. These highly skilled researchers must
be retained to maximize the scientific return from petabyte-scale datasets.
Evolving beyond the one-dimensional credit model requires overcoming several
key challenges, including the current scholarly ecosystem and scientific
culture issues. This white paper will present these challenges and suggest
practical solutions for elevating the role of software as a product of the
research enterprise.
[4]
oai:arXiv.org:1901.04050 [pdf] - 1814326
Key Technologies for the Wide Field Infrared Survey Telescope
Coronagraph Instrument
Bailey, Vanessa P.;
Armus, Lee;
Balasubramanian, Bala;
Baudoz, Pierre;
Bellini, Andrea;
Benford, Dominic;
Berriman, Bruce;
Bhattacharya, Aparna;
Boccaletti, Anthony;
Cady, Eric;
Novati, Sebastiano Calchi;
Carpenter, Kenneth;
Ciardi, David;
Crill, Brendan;
Danchi, William;
Debes, John;
Demers, Richard;
Dohlen, Kjetil;
Effinger, Robert;
Ferrari, Marc;
Frerking, Margaret;
Gelino, Dawn;
Girard, Julien;
Grady, Kevin;
Groff, Tyler;
Harding, Leon;
Helou, George;
Henning, Avenhaus;
Janson, Markus;
Kalirai, Jason;
Kane, Stephen;
Kasdin, N. Jeremy;
Kenworthy, Matthew;
Kern, Brian;
Krist, John;
Kruk, Jeffrey;
Lagrange, Anne Marie;
Laine, Seppo;
Langlois, Maud;
Coroller, Herve Le;
Lindensmith, Chris;
Lowrance, Patrick;
Maire, Anne-Lise;
Malhotra, Sangeeta;
Mandell, Avi;
McElwain, Michael;
Prada, Camilo Mejia;
Mennesson, Bertrand;
Meshkat, Tiffany;
Moody, Dwight;
Morrissey, Patrick;
Moustakas, Leonidas;
N'Diaye, Mamadou;
Nemati, Bijan;
Noecker, Charley;
Paladini, Roberta;
Perrin, Marshall;
Poberezhskiy, Ilya;
Postman, Marc;
Pueyo, Laurent;
Ramirez, Solange;
Ranc, Clement;
Rhodes, Jason;
Riggs, A. J. E.;
Rizzo, Maxime;
Roberge, Aki;
Rouan, Daniel;
Schlieder, Joshua;
Seo, Byoung-Joon;
Shaklan, Stuart;
Shi, Fang;
Soummer, Remi;
Spergel, David;
Stapelfeldt, Karl;
Stark, Christopher;
Tamura, Motohide;
Tang, Hong;
Trauger, John;
Turnbull, Margaret;
van der Marel, Roeland;
Vigan, Arthur;
Williams, Benjamin;
Wollack, Edward J.;
Ygouf, Marie;
Zhao, Feng;
Zhoud, Hanying;
Zimmerman, Neil
Submitted: 2019-01-13
The Wide Field Infrared Survey Telescope (WFIRST) Coronagraph Instrument
(CGI) is a high-contrast imager and integral field spectrograph that will
enable the study of exoplanets and circumstellar disks at visible wavelengths.
Ground-based high-contrast instrumentation has fundamentally limited
performance at small working angles, even under optimistic assumptions for
30m-class telescopes. There is a strong scientific driver for better
performance, particularly at visible wavelengths. Future flagship mission
concepts aim to image Earth analogues with visible light flux ratios of more
than 10^10. CGI is a critical intermediate step toward that goal, with a
predicted 10^8-9 flux ratio capability in the visible. CGI achieves this
through improvements over current ground and space systems in several areas:
(i) Hardware: space-qualified (TRL9) deformable mirrors, detectors, and
coronagraphs, (ii) Algorithms: wavefront sensing and control; post-processing
of integral field spectrograph, polarimetric, and extended object data, and
(iii) Validation of telescope and instrument models at high accuracy and
precision. This white paper, submitted to the 2018 NAS Exoplanet Science
Strategy call, describes the status of key CGI technologies and presents ways
in which performance is likely to evolve as the CGI design matures.
[5]
oai:arXiv.org:1803.07490 [pdf] - 1652610
The VO: A powerful tool for global astronomy
Arviset, Christophe;
Allen, Mark;
Aloisi, Alessandra;
Berriman, Bruce;
Boisson, Catherine;
Cecconi, Baptiste;
Ciardi, David;
Evans, Janet;
Fabbiano, Giuseppina;
Genova, Francoise;
Jenness, Tim;
Mann, Bob;
McGlynn, Tom;
OMullane, William;
Schade, David;
Stoehr, Felix;
Zacchi, Andrea
Submitted: 2018-03-20
Since its inception in the early 2000, the Virtual Observatory (VO),
developed as a collaboration of many national and international projects, has
become a major factor in the discovery and dissemination of astronomical
information worldwide. The IVOA has been coordinating all these efforts
worldwide to ensure a common VO framework that enables transparent access to
and interoperability of astronomy resources (data and software) around the
world. The VO is not a magic solution to all astronomy data management
challenges but it does bring useful solutions in many areas borne out by the
fact that VO interfaces are broadly found in astronomy major data centres and
projects worldwide. Astronomy data centres have been building VO services on
top of their existing data services to increase interoperability with other
VO-compliant data resources to take advantage of the continuous and increasing
development of VO applications. VO applications have made multi-instrument and
multi-wavelength science, a difficult and fruitful part of astronomy, somewhat
easier. More recently, several major new astronomy projects have been directly
adopting VO standards to build their data management infrastructure, giving
birth to VO built-in archives. Embracing the VO framework from the beginning
brings the double gain of not needing to reinvent the wheel and ensuring from
the start interoperability with other astronomy VO resources. Some of the IVOA
standards are also starting to be used by neighbour disciplines like planetary
sciences. There is still quite a lot to be done on the VO, in particular
tackling the upcoming big data challenge and how to find interoperable
solutions to the new data analysis paradigm of bringing and running the
software close to the data.
[6]
oai:arXiv.org:1802.00552 [pdf] - 1628793
Best Practices for a Future Open Code Policy: Experiences and Vision of
the Astrophysics Source Code Library
Submitted: 2018-02-01
We are members of the Astrophysics Source Code Library's Advisory Committee
and its editor-in-chief. The Astrophysics Source Code Library (ASCL, ascl.net)
is a successful initiative that advocates for open research software and
provides an infrastructure for registering, discovering, sharing, and citing
this software. Started in 1999, the ASCL has been expanding in recent years,
with an average of over 200 codes added each year, and now houses over 1,600
code entries.
[7]
oai:arXiv.org:1312.7352 [pdf] - 764839
Ideas for Advancing Code Sharing (A Different Kind of Hack Day)
Teuben, Peter;
Allen, Alice;
Berriman, Bruce;
DuPrie, Kimberly;
Hanisch, Robert J.;
Mink, Jessica;
Nemiroff, Robert;
Shamir, Lior;
Shortridge, Keith;
Taylor, Mark;
Wallin, John
Submitted: 2013-12-27
How do we as a community encourage the reuse of software for telescope
operations, data processing, and calibration? How can we support making codes
used in research available for others to examine? Continuing the discussion
from last year Bring out your codes! BoF session, participants separated into
groups to brainstorm ideas to mitigate factors which inhibit code sharing and
nurture those which encourage code sharing. The BoF concluded with the sharing
of ideas that arose from the brainstorming sessions and a brief summary by the
moderator.
[8]
oai:arXiv.org:1312.6693 [pdf] - 763719
Astrophysics Source Code Library: Incite to Cite!
DuPrie, Kimberly;
Allen, Alice;
Berriman, Bruce;
Hanisch, Robert J.;
Mink, Jessica;
Nemiroff, Robert J.;
Shamir, Lior;
Shortridge, Keith;
Taylor, Mark B.;
Teuben, Peter;
Wallin, John F.
Submitted: 2013-12-23
The Astrophysics Source Code Library (ASCL, http://ascl.net/) is an online
registry of over 700 source codes that are of interest to astrophysicists, with
more being added regularly. The ASCL actively seeks out codes as well as
accepting submissions from the code authors, and all entries are citable and
indexed by ADS. All codes have been used to generate results published in or
submitted to a refereed journal and are available either via a download site or
froman identified source. In addition to being the largest directory of
scientist-written astrophysics programs available, the ASCL is also an active
participant in the reproducible research movement with presentations at various
conferences, numerous blog posts and a journal article. This poster provides a
description of the ASCL and the changes that we are starting to see in the
astrophysics community as a result of the work we are doing.
[9]
oai:arXiv.org:1312.5334 [pdf] - 761885
The Astrophysics Source Code Library: Where do we go from here?
Allen, Alice;
Berriman, Bruce;
DuPrie, Kimberly;
Hanisch, Robert J.;
Mink, Jessica;
Nemiroff, Robert;
Shamir, Lior;
Shortridge, Keith;
Taylor, Mark;
Teuben, Peter;
Wallin, John
Submitted: 2013-12-18
The Astrophysics Source Code Library, started in 1999, has in the past three
years grown from a repository for 40 codes to a registry of over 700 codes that
are now indexed by ADS. What comes next? We examine the future of the ASCL, the
challenges facing it, the rationale behind its practices, and the need to
balance what we might do with what we have the resources to accomplish.
[10]
oai:arXiv.org:1304.6780 [pdf] - 656546
Practices in source code sharing in astrophysics
Submitted: 2013-04-24
While software and algorithms have become increasingly important in
astronomy, the majority of authors who publish computational astronomy research
do not share the source code they develop, making it difficult to replicate and
reuse the work. In this paper we discuss the importance of sharing scientific
source code with the entire astrophysics community, and propose that journals
require authors to make their code publicly available when a paper is
published. That is, we suggest that a paper that involves a computer program
not be accepted for publication unless the source code becomes publicly
available. The adoption of such a policy by editors, editorial boards, and
reviewers will improve the ability to replicate scientific results, and will
also make the computational astronomy methods more available to other
researchers who wish to apply them to their data.
[11]
oai:arXiv.org:1301.5193 [pdf] - 617254
Unproceedings of the Fourth .Astronomy Conference (.Astronomy 4),
Heidelberg, Germany, July 9-11 2012
Simpson, Robert J.;
Lintott, Chris;
Bauer, Amanda;
Berriman, Bruce;
Gomez, Edward;
Kendrew, Sarah;
Kitching, Thomas;
Muench, August;
Muna, Demitri;
Robitaille, Thomas;
Schwamb, Megan E.;
Simmons, Brooke
Submitted: 2013-01-16
The goal of the .Astronomy conference series is to bring together
astronomers, educators, developers and others interested in using the Internet
as a medium for astronomy. Attendance at the event is limited to approximately
50 participants, and days are split into mornings of scheduled talks, followed
by 'unconference' afternoons, where sessions are defined by participants during
the course of the event. Participants in unconference sessions are discouraged
from formal presentations, with discussion, workshop-style formats or informal
practical tutorials encouraged. The conference also designates one day as a
'hack day', in which attendees collaborate in groups on day-long projects for
presentation the following morning. These hacks are often a way of
concentrating effort, learning new skills, and exploring ideas in a practical
fashion. The emphasis on informal, focused interaction makes recording
proceedings more difficult than for a normal meeting. While the first
.Astronomy conference is preserved formally in a book, more recent iterations
are not documented. We therefore, in the spirit of .Astronomy, report
'unproceedings' from .Astronomy 4, which was held in Heidelberg in July 2012.
[12]
oai:arXiv.org:1212.1916 [pdf] - 600844
Astrophysics Source Code Library
Submitted: 2012-12-09
The Astrophysics Source Code Library (ASCL), founded in 1999, is a free
on-line registry for source codes of interest to astronomers and
astrophysicists. The library is housed on the discussion forum for Astronomy
Picture of the Day (APOD) and can be accessed at http://ascl.net. The ASCL has
a comprehensive listing that covers a significant number of the astrophysics
source codes used to generate results published in or submitted to refereed
journals and continues to grow. The ASCL currently has entries for over 500
codes; its records are citable and are indexed by ADS. The editors of the ASCL
and members of its Advisory Committee were on hand at a demonstration table in
the ADASS poster room to present the ASCL, accept code submissions, show how
the ASCL is starting to be used by the astrophysics community, and take
questions on and suggestions for improving the resource.
[13]
oai:arXiv.org:1212.1915 [pdf] - 600843
Bring out your codes! Bring out your codes! (Increasing Software
Visibility and Re-use)
Allen, Alice;
Berriman, Bruce;
Brunner, Robert;
Burger, Dan;
DuPrie, Kimberly;
Hanisch, Robert J.;
Mann, Robert;
Mink, Jessica;
Sandin, Christer;
Shortridge, Keith;
Teuben, Peter
Submitted: 2012-12-09
Progress is being made in code discoverability and preservation, but as
discussed at ADASS XXI, many codes still remain hidden from public view. With
the Astrophysics Source Code Library (ASCL) now indexed by the SAO/NASA
Astrophysics Data System (ADS), the introduction of a new journal, Astronomy &
Computing, focused on astrophysics software, and the increasing success of
education efforts such as Software Carpentry and SciCoder, the community has
the opportunity to set a higher standard for its science by encouraging the
release of software for examination and possible reuse. We assembled
representatives of the community to present issues inhibiting code release and
sought suggestions for tackling these factors.
The session began with brief statements by panelists; the floor was then
opened for discussion and ideas. Comments covered a diverse range of related
topics and points of view, with apparent support for the propositions that
algorithms should be readily available, code used to produce published
scientific results should be made available, and there should be discovery
mechanisms to allow these to be found easily. With increased use of resources
such as GitHub (for code availability), ASCL (for code discovery), and a stated
strong preference from the new journal Astronomy & Computing for code release,
we expect to see additional progress over the next few years.
[14]
oai:arXiv.org:1010.4822 [pdf] - 955511
Data Sharing Options for Scientific Workflows on Amazon EC2
Submitted: 2010-10-22
Efficient data management is a key component in achieving good performance
for scientific workflows in distributed environments. Workflow applications
typically communicate data between tasks using files. When tasks are
distributed, these files are either transferred from one computational node to
another, or accessed through a shared storage system. In grids and clusters,
workflow data is often stored on network and parallel file systems. In this
paper we investigate some of the ways in which data can be managed for
workflows in the cloud. We ran experiments using three typical workflow
applications on Amazon's EC2. We discuss the various storage and file systems
we used, describe the issues and problems we encountered deploying them on EC2,
and analyze the resulting performance and cost of the workflows.
[15]
oai:arXiv.org:1006.2441 [pdf] - 1033074
Accurate Coordinates and 2MASS Cross-IDs for (Almost) All Gliese Catalog
Stars
Stauffer, John;
Tanner, Angelle M.;
Bryden, Geoffrey;
Ramirez, Solange;
Berriman, Bruce;
Ciardi, David R.;
Kane, Stephen;
Mizusawa, Trisha;
Payne, Alan;
Plavchan, Peter;
von Braun, Kaspar;
Wyatt, Pamela;
Kirkpatrick, J. Davy
Submitted: 2010-06-12
We provide precise J2000, epoch 2000 coordinates and cross-identifications to
sources in the 2MASS point source catalog for nearly all stars in the Gliese,
Gliese and Jahreiss, and Woolley catalogs of nearby stars. The only Gliese
objects where we were not successful are two Gliese sources that are actually
QSOs, two proposed companions to brighter stars which we believe do not exist,
four stars included in one of the catalogs but identified there as only optical
companions, one probable plate flaw, and two stars which simply remain
un-recovered. For the 4251 recovered stars, 2693 have coordinates based on
Hipparcos positions, 1549 have coordinates based on 2MASS data, and 9 have
positions from other astrometric sources. All positions have been calculated at
epoch 2000 using proper motions from the literature, which are also given here.
[16]
oai:arXiv.org:1005.4457 [pdf] - 170900
Pipeline-Centric Provenance Model
Submitted: 2010-05-24
In this paper we propose a new provenance model which is tailored to a class
of workflow-based applications. We motivate the approach with use cases from
the astronomy community. We generalize the class of applications the approach
is relevant to and propose a pipeline-centric provenance model. Finally, we
evaluate the benefits in terms of storage needed by the approach when applied
to an astronomy application.
[17]
oai:arXiv.org:1005.2718 [pdf] - 1513445
Scientific Workflow Applications on Amazon EC2
Submitted: 2010-05-15
The proliferation of commercial cloud computing providers has generated
significant interest in the scientific computing community. Much recent
research has attempted to determine the benefits and drawbacks of cloud
computing for scientific applications. Although clouds have many attractive
features, such as virtualization, on-demand provisioning, and "pay as you go"
usage-based pricing, it is not clear whether they are able to deliver the
performance required for scientific applications at a reasonable price. In this
paper we examine the performance and cost of clouds from the perspective of
scientific workflow applications. We use three characteristic workflows to
compare the performance of a commercial cloud with that of a typical HPC
system, and we analyze the various costs associated with running those
workflows in the cloud. We find that the performance of clouds is not
unreasonable given the hardware resources provided, and that performance
comparable to HPC systems can be achieved given similar resources. We also find
that the cost of running workflows on a commercial cloud can be reduced by
storing data in the cloud rather than transferring it from outside.
[18]
oai:arXiv.org:1005.2643 [pdf] - 166170
Metadata and provenance management
Submitted: 2010-05-14
Scientists today collect, analyze, and generate TeraBytes and PetaBytes of
data. These data are often shared and further processed and analyzed among
collaborators. In order to facilitate sharing and data interpretations, data
need to carry with it metadata about how the data was collected or generated,
and provenance information about how the data was processed. This chapter
describes metadata and provenance in the context of the data lifecycle. It also
gives an overview of the approaches to metadata and provenance management,
followed by examples of how applications use metadata and provenance in their
scientific processes.