sort results by

Use logical operators AND, OR, NOT and round brackets to construct complex queries. Whitespace-separated words are treated as ANDed.

Show articles per page in mode

Berriman, G. Bruce

Normalized to: Berriman, G.

46 article(s) in total. 519 co-authors, from 1 to 18 common article(s). Median position in authors list is 3,0.

[1]  oai:arXiv.org:2001.10659  [pdf] - 2039818
Creating High Quality All-Sky Visualizations of Astronomy Image Data Sets: HiPS and Montage
Comments: 4 pages, 2 figures. Submitted to the Proceedings of ADASS2019, Groningen, NL. (Oct 6-10. 2019)
Submitted: 2020-01-28
We describe a case study to use the Montage image mosaic engine to create maps of the ALLWISE image data set in the Hierarchical Progressive Survey (HiPS) sky-tesselation scheme. Our approach demonstrates that Montage reveals the science content of infrared images in greater detail than has hitherto been possible in HiPS maps. The approach exploits two unique (to our knowledge) characteristics of the Montage image mosaic engine: background modeling to rectify the time variable image backgrounds to common levels; and an adaptive image stretch to present images for visualization. The creation of the maps is supported by the development of four new tools that when fully tested will become part of the Montage distribution. The compute intensive part of the processing lies in the reprojection of the images, and we show how we optimized the processing for efficient creation of mosaics that are used in turn to create maps in the HiPS tiling scheme. We plan to apply our methodology to infrared image data sets such a those delivered by Spitzer, 2MASS, IRAS and Planck.
[2]  oai:arXiv.org:1912.01481  [pdf] - 2008102
The International Virtual Observatory Alliance in 2019
Comments: 4 pages, submitted to proceedings of ADASS XXIV to be published in ASP Conf. Series
Submitted: 2019-12-03
The International Virtual Observatory Alliance (IVOA) held its bi-annual Interoperability Meetings in May 2019, and in October 2019 following the ADASS XXIX conference. We provide a brief report on the status of the IVOA and the activities of the Interoperability Meetings.
[3]  oai:arXiv.org:1910.01259  [pdf] - 1973237
Joint Survey Processing of LSST, Euclid and WFIRST: Enabling a broad array of astrophysics and cosmology through pixel level combinations of datasets
Comments: Astro2020 APC White Paper, 11 pages
Submitted: 2019-10-02
Joint survey processing (JSP) is the pixel level combination of LSST, Euclid, and WFIRST datasets. By combining the high spatial resolution of the space-based datasets with deep, seeing-limited, ground-based images in the optical bands, systematics like source confusion and astrometric mismatch can be addressed to derive the highest precision optical/infrared photometric catalogs. This white paper highlights the scientific motivation, computational and algorithmic needs to build joint pixel level processing capabilities, which the individual projects by themselves will not be able to support. Through this white paper, we request that the Astro2020 decadal committee recognize the JSP effort as a multi-agency project with the natural outcome being a collaborative effort among groups which are normally supported by a single agency. JSP will allow the U.S. (and international) astronomical community to manipulate the flagship data sets and undertake innovative science investigations ranging from solar system object characterization, exoplanet detections, nearby galaxy rotation rates and dark matter properties, to epoch of reionization studies. It will also result in the ultimate constraints on cosmological parameters and the nature of dark energy, with far smaller uncertainties and a better handle on systematics than by any one survey alone.
[4]  oai:arXiv.org:1908.09753  [pdf] - 1948938
Image Processing in Python With Montage
Comments: 4 pages, 1 figure. Submitted to Proceedings of ADASS XXVIII
Submitted: 2019-08-26
The Montage image mosaic engine has found wide applicability in astronomy research, integration into processing environments, and is an examplar application for the development of advanced cyber-infrastructure. It is written in C to provide performance and portability. Linking C/C++ libraries to the Python kernel at run time as binary extensions allows them to run under Python at compiled speeds and enables users to take advantage of all the functionality in Python. We have built Python binary extensions of the 59 ANSI-C modules that make up version 5 of the Montage toolkit. This has involved a turning the code into a C library, with driver code fully separated to reproduce the calling sequence of the command-line tools; and then adding Python and C linkage code with the Cython library, which acts as a bridge between general C libraries and the Python interface. We will demonstrate how to use these Python binary extensions to perform image processing, including reprojecting and resampling images, rectifying background emission to a common level, creation of image mosaics that preserve the calibration and astrometric fidelity of the input images, creating visualizations with an adaptive stretch algorithm, processing HEALPix images, and analyzing and managing image metadata.
[5]  oai:arXiv.org:1903.06634  [pdf] - 1850834
Increasing the Discovery Space in Astrophysics - A Collation of Six Submitted White Papers
Comments:
Submitted: 2019-03-15, last modified: 2019-03-18
We write in response to the call from the 2020 Decadal Survey to submit white papers illustrating the most pressing scientific questions in astrophysics for the coming decade. We propose exploration as the central question for the Decadal Committee's discussions.The history of astronomy shows that paradigm changing discoveries are not driven by well formulated scientific questions, based on the knowledge of the time. They were instead the result of the increase in discovery space fostered by new telescopes and instruments. An additional tool for increasing the discovery space is provided by the analysis and mining of the increasingly larger amount of archival data available to astronomers. Revolutionary observing facilities, and the state of the art astronomy archives needed to support these facilities, will open up the universe to new discovery. Here we focus on exploration for compact objects and multi messenger science. This white paper includes science examples of the power of the discovery approach, encompassing all the areas of astrophysics covered by the 2020 Decadal Survey.
[6]  oai:arXiv.org:1902.00522  [pdf] - 1826217
Deep Learning for Multi-Messenger Astrophysics: A Gateway for Discovery in the Big Data Era
Comments: 15 pages, no figures. White paper based on the "Deep Learning for Multi-Messenger Astrophysics: Real-time Discovery at Scale" workshop, hosted at NCSA, October 17-19, 2018 http://www.ncsa.illinois.edu/Conferences/DeepLearningLSST/
Submitted: 2019-02-01
This report provides an overview of recent work that harnesses the Big Data Revolution and Large Scale Computing to address grand computational challenges in Multi-Messenger Astrophysics, with a particular emphasis on real-time discovery campaigns. Acknowledging the transdisciplinary nature of Multi-Messenger Astrophysics, this document has been prepared by members of the physics, astronomy, computer science, data science, software and cyberinfrastructure communities who attended the NSF-, DOE- and NVIDIA-funded "Deep Learning for Multi-Messenger Astrophysics: Real-time Discovery at Scale" workshop, hosted at the National Center for Supercomputing Applications, October 17-19, 2018. Highlights of this report include unanimous agreement that it is critical to accelerate the development and deployment of novel, signal-processing algorithms that use the synergy between artificial intelligence (AI) and high performance computing to maximize the potential for scientific discovery with Multi-Messenger Astrophysics. We discuss key aspects to realize this endeavor, namely (i) the design and exploitation of scalable and computationally efficient AI algorithms for Multi-Messenger Astrophysics; (ii) cyberinfrastructure requirements to numerically simulate astrophysical sources, and to process and interpret Multi-Messenger Astrophysics data; (iii) management of gravitational wave detections and triggers to enable electromagnetic and astro-particle follow-ups; (iv) a vision to harness future developments of machine and deep learning and cyberinfrastructure resources to cope with the scale of discovery in the Big Data Era; (v) and the need to build a community that brings domain experts together with data scientists on equal footing to maximize and accelerate discovery in the nascent field of Multi-Messenger Astrophysics.
[7]  oai:arXiv.org:1803.01869  [pdf] - 1779501
The KELT Follow-Up Network and Transit False Positive Catalog: Pre-vetted False Positives for TESS
Collins, Karen A.; Collins, Kevin I.; Pepper, Joshua; Labadie-Bartz, Jonathan; Stassun, Keivan; Gaudi, B. Scott; Bayliss, Daniel; Bento, Joao; Colón, Knicole D.; Feliz, Dax; James, David; Johnson, Marshall C.; Kuhn, Rudolf B.; Lund, Michael B.; Penny, Matthew T.; Rodriguez, Joseph E.; Siverd, Robert J.; Stevens, Daniel J.; Yao, Xinyu; Zhou, George; Akshay, Mundra; Aldi, Giulio F.; Ashcraft, Cliff; Awiphan, Supachai; Baştürk, Özgür; Baker, David; Beatty, Thomas G.; Benni, Paul; Berlind, Perry; Berriman, G. Bruce; Berta-Thompson, Zach; Bieryla, Allyson; Bozza, Valerio; Novati, Sebastiano Calchi; Calkins, Michael L.; Cann, Jenna M.; Ciardi, David R.; Clark, Ian R.; Cochran, William D.; Cohen, David H.; Conti, Dennis; Crepp, Justin R.; Curtis, Ivan A.; D'Ago, Giuseppe; Diazeguigure, Kenny A.; Dressing, Courtney D.; Dubois, Franky; Ellingson, Erica; Ellis, Tyler G.; Esquerdo, Gilbert A.; Evans, Phil; Friedli, Alison; Fukui, Akihiko; Fulton, Benjamin J.; Gonzales, Erica J.; Good, John C.; Gregorio, Joao; Gumusayak, Tolga; Hancock, Daniel A.; Harada, Caleb K.; Hart, Rhodes; Hintz, Eric G.; Jang-Condell, Hannah; Jeffery, Elizabeth J.; Jensen, Eric L. N.; Jofré, Emiliano; Joner, Michael D.; Kar, Aman; Kasper, David H.; Keten, Burak; Kielkopf, John F.; Komonjinda, Siramas; Kotnik, Cliff; Latham, David W.; Leuquire, Jacob; Lewis, Tiffany R.; Logie, Ludwig; Lowther, Simon J.; MacQueen, Phillip J.; Martin, Trevor J.; Mawet, Dimitri; McLeod, Kim K.; Murawski, Gabriel; Narita, Norio; Nordhausen, Jim; Oberst, Thomas E.; Odden, Caroline; Panka, Peter A.; Petrucci, Romina; Plavchan, Peter; Quinn, Samuel N.; Rau, Steve; Reed, Phillip A.; Relles, Howard; Renaud, Joe P.; Scarpetta, Gaetano; Sorber, Rebecca L.; Spencer, Alex D.; Spencer, Michelle; Stephens, Denise C.; Stockdale, Chris; Tan, Thiam-Guan; Trueblood, Mark; Trueblood, Patricia; Vanaverbeke, Siegfried; Villanueva, Steven; Warner, Elizabeth M.; West, Mary Lou; Yalçınkaya, Selçuk; Yeigh, Rex; Zambelli, Roberto
Comments: Accepted for publication in AJ, 21 pages, 12 figures, 7 tables
Submitted: 2018-03-05, last modified: 2018-09-19
The Kilodegree Extremely Little Telescope (KELT) project has been conducting a photometric survey for transiting planets orbiting bright stars for over ten years. The KELT images have a pixel scale of ~23"/pixel---very similar to that of NASA's Transiting Exoplanet Survey Satellite (TESS)---as well as a large point spread function, and the KELT reduction pipeline uses a weighted photometric aperture with radius 3'. At this angular scale, multiple stars are typically blended in the photometric apertures. In order to identify false positives and confirm transiting exoplanets, we have assembled a follow-up network (KELT-FUN) to conduct imaging with higher spatial resolution, cadence, and photometric precision than the KELT telescopes, as well as spectroscopic observations of the candidate host stars. The KELT-FUN team has followed-up over 1,600 planet candidates since 2011, resulting in more than 20 planet discoveries. Excluding ~450 false alarms of non-astrophysical origin (i.e., instrumental noise or systematics), we present an all-sky catalog of the 1,128 bright stars (6<V<10) that show transit-like features in the KELT light curves, but which were subsequently determined to be astrophysical false positives (FPs) after photometric and/or spectroscopic follow-up observations. The KELT-FUN team continues to pursue KELT and other planet candidates and will eventually follow up certain classes of TESS candidates. The KELT FP catalog will help minimize the duplication of follow-up observations by current and future transit surveys such as TESS.
[8]  oai:arXiv.org:1806.08866  [pdf] - 1704567
A Study of the Efficiency of Spatial Indexing Methods Applied to Large Astronomical Databases
Comments: 4 pages, 4 figures. Submitted for publication in the Proceedings of ADASS XXVII, Santiago, Chile (2017)
Submitted: 2018-06-22
We report the results of a study to compare the performance of two common database indexing methods, HTM and HEALPix, on Solaris and Windows database servers installed with PostgreSQL, and a Windows Server installed with MS SQL Server. The indexing was applied to the 2MASS All-Sky Catalog and to the Hubble Source Catalog, which approximate the diversity of catalogs common in astronomy. On each server, the study compared indexing performance by submitting 1 million queries at each index level with random sky positions and random cone search radius, which was computed on a logarithmic scale between 1 arcsec and 1 degree, and measuring the time to complete the query and write the output. These simulated queries, intended to model realistic use patterns, were run in a uniform way on many combinations of indexing method and indexing depth. The query times in all simulations are strongly I/O-bound and are linear with number of records returned for large numbers of sources. There are, however, considerable differences between simulations, which reveal that hardware I/O throughput is a more important factor in managing the performance of a DBMS than the choice of indexing scheme. The choice of index itself is relatively unimportant: for comparable index levels, the performance is consistent within the scatter of the timings. At small index levels (large cells; e.g. level 4; cell size 3.7 deg), there is large scatter in the timings because of wide variations in the number of sources found in the cells. At larger index levels, performance improves and scatter decreases, but the improvement at level 8 (14 arcmin) and higher is masked to some extent in the timing scatter caused by the range of query sizes. At very high levels (20; 0.0004 arsec), the granularity of the cells becomes so high that a large number of extraneous empty cells begin to degrade performance.
[9]  oai:arXiv.org:1806.04095  [pdf] - 1697240
Sustaining the Montage Image Mosaic Engine Since 2002
Comments: 12 pages, 8 figures. Software and Cyberinfrastructure for Astronomy V (Conference 10707), SPIE SPIE Astronomical Telescopes + Instrumentation, Austin TX. June 10-15, 2018
Submitted: 2018-06-11
This paper describes how we have sustained the Montage image mosaic engine (http://montage.ipac.caltech.edu) first released in 2002, to support the ever-growing scale and complexity of modern data sets. The key to its longevity has been its design as a toolkit written in ANSI-C, with each tool performing one distinct task, for easy integration into scripts, pipelines and workflows. The same code base now supports Windows, JavaScript and Python by taking advantage of recent advances in compilers. The design has led to applicability of Montage far beyond what was anticipated when Montage was first built, such as supporting observation planning for the JWST. Moreover, Montage is highly scalable and is in wide use within the IT community to develop advanced, fault-tolerant cyber-infrastructure, such as job schedulers for grids, workflow orchestration, and restructuring techniques for processing complex workflows and pipelines.
[10]  oai:arXiv.org:1712.02973  [pdf] - 1600971
The Astrophysics Source Code Library: What's new, what's coming
Comments: 4 pages; to be published in proceedings of the October 22-26 2017 ADASS XXVII meeting in Santiago, Chile
Submitted: 2017-12-08
The Astrophysics Source Code Library (ASCL, ascl.net), established in 1999, is a citable online registry of source codes used in research that are available for download; the ASCL's main purpose is to improve the transparency, reproducibility, and falsifiability of research. In 2017, improvements to the resource included real-time data backup for submissions and newly-published entries, improved cross-matching of research papers with software entries in ADS, and expansion of preferred citation information for the software in the ASCL.
[11]  oai:arXiv.org:1712.02398  [pdf] - 1600371
Software metadata: How much is enough?
Comments: 4 pages; to be published in ADASS XXVII (held Oct 22-26, 2017 in Santiago, Chile) proceedings
Submitted: 2017-12-06
Broad efforts are underway to capture metadata about research software and retain it across services; notable in this regard is the CodeMeta project. What metadata are important to have about (research) software? What metadata are useful for searching for codes? What would you like to learn about astronomy software? This BoF sought to gather information on metadata most desired by researchers and users of astro software and others interested in registering, indexing, capturing, and doing research on this software. Information from this BoF could conceivably result in changes to the Astrophysics Source Code Library (ASCL) or other resources for the benefit of the community or provide input into other projects concerned with software metadata.
[12]  oai:arXiv.org:1709.09566  [pdf] - 1588975
NASA's Long-Term Astrophysics Data Archives
Comments: To appear in ADASS 2016 conference proceedings (invited talk)
Submitted: 2017-09-27
NASA regards data handling and archiving as an integral part of space missions, and has a strong track record of serving astrophysics data to the public, beginning with the the IRAS satellite in 1983. Archives enable a major science return on the significant investment required to develop a space mission. In fact, the presence and accessibility of an archive can more than double the number of papers resulting from the data. In order for the community to be able to use the data, they have to be able to find the data (ease of access) and interpret the data (ease of use). Funding of archival research (e.g., the ADAP program) is also important not only for making scientific progress, but also for encouraging authors to deliver data products back to the archives to be used in future studies. NASA has also enabled a robust system that can be maintained over the long term, through technical innovation and careful attention to resource allocation. This article provides a brief overview of some of NASA's major astrophysics archive systems, including IRSA, MAST, HEASARC, KOA, NED, the Exoplanet Archive, and ADS.
[13]  oai:arXiv.org:1702.02593  [pdf] - 1567676
The Application of the Montage Image Mosaic Engine To The Visualization Of Astronomical Images
Comments: 16 pages, 9 figures; accepted for publication in the PASP Special Focus Issue: Techniques and Methods for Astrophysical Data Visualization
Submitted: 2017-02-08
The Montage Image Mosaic Engine was designed as a scalable toolkit, written in C for performance and portability across *nix platforms, that assembles FITS images into mosaics. The code is freely available and has been widely used in the astronomy and IT communities for research, product generation and for developing next-generation cyber-infrastructure. Recently, it has begun to finding applicability in the field of visualization. This has come about because the toolkit design allows easy integration into scalable systems that process data for subsequent visualization in a browser or client. And it includes a visualization tool suitable for automation and for integration into Python: mViewer creates, with a single command, complex multi-color images overlaid with coordinate displays, labels, and observation footprints, and includes an adaptive image histogram equalization method that preserves the structure of a stretched image over its dynamic range. The Montage toolkit contains functionality originally developed to support the creation and management of mosaics but which also offers value to visualization: a background rectification algorithm that reveals the faint structure in an image; and tools for creating cutout and down-sampled versions of large images. Version 5 of Montage offers support for visualizing data written in HEALPix sky-tessellation scheme, and functionality for processing and organizing images to comply with the TOAST sky-tessellation scheme required for consumption by the World Wide Telescope (WWT). Four online tutorials enable readers to reproduce and extend all the visualizations presented in this paper.
[14]  oai:arXiv.org:1611.06232  [pdf] - 1517681
Implementing Ideas for Improving Software Citation and Credit
Comments: 4 pages; to be published in ADASS XXVI (held Oct 16-20, 2016) proceedings
Submitted: 2016-11-18
Improving software citation and credit continues to be a topic of interest across and within many disciplines, with numerous efforts underway. In this Birds of a Feather (BoF) session, we started with a list of actionable ideas from last year's BoF and other similar efforts and worked alone or in small groups to begin implementing them. Work was captured in a common Google document; the session organizers will disseminate or otherwise put this information to use in or for the community in collaboration with those who contributed.
[15]  oai:arXiv.org:1611.06219  [pdf] - 1516967
Astrophysics Source Code Library: Here we grow again!
Comments: 4 pages, 2 figures; to be published in ADASS XXVI (held October 16-20, 2016) proceedings
Submitted: 2016-11-18
The Astrophysics Source Code Library (ASCL) is a free online registry of research codes; it is indexed by ADS and Web of Science and has over 1300 code entries. Its entries are increasingly used to cite software; citations have been doubling each year since 2012 and every major astronomy journal accepts citations to the ASCL. Codes in the resource cover all aspects of astrophysics research and many programming languages are represented. In the past year, the ASCL added dashboards for users and administrators, started minting Digital Objective Identifiers (DOIs) for software it houses, and added metadata fields requested by users. This presentation covers the ASCL's growth in the past year and the opportunities afforded it as one of the few domain libraries for science research codes.
[16]  oai:arXiv.org:1610.03159  [pdf] - 1494915
The Astropy Problem
Muna, Demitri; Alexander, Michael; Allen, Alice; Ashley, Richard; Asmus, Daniel; Azzollini, Ruyman; Bannister, Michele; Beaton, Rachael; Benson, Andrew; Berriman, G. Bruce; Bilicki, Maciej; Boyce, Peter; Bridge, Joanna; Cami, Jan; Cangi, Eryn; Chen, Xian; Christiny, Nicholas; Clark, Christopher; Collins, Michelle; Comparat, Johan; Cook, Neil; Croton, Darren; Davids, Isak Delberth; Depagne, Éric; Donor, John; Santos, Leonardo A. dos; Douglas, Stephanie; Du, Alan; Durbin, Meredith; Erb, Dawn; Faes, Daniel; Fernández-Trincado, J. G.; Foley, Anthony; Fotopoulou, Sotiria; Frimann, Søren; Frinchaboy, Peter; Garcia-Dias, Rafael; Gawryszczak, Artur; George, Elizabeth; Gonzalez, Sebastian; Gordon, Karl; Gorgone, Nicholas; Gosmeyer, Catherine; Grasha, Katie; Greenfield, Perry; Grellmann, Rebekka; Guillochon, James; Gurwell, Mark; Haas, Marcel; Hagen, Alex; Haggard, Daryl; Haines, Tim; Hall, Patrick; Hellwing, Wojciech; Herenz, Edmund Christian; Hinton, Samuel; Hlozek, Renee; Hoffman, John; Holman, Derek; Holwerda, Benne Willem; Horton, Anthony; Hummels, Cameron; Jacobs, Daniel; Jensen, Jens Juel; Jones, David; Karick, Arna; Kelley, Luke; Kenworthy, Matthew; Kitchener, Ben; Klaes, Dominik; Kohn, Saul; Konorski, Piotr; Krawczyk, Coleman; Kuehn, Kyler; Kuutma, Teet; Lam, Michael T.; Lane, Richard; Liske, Jochen; Lopez-Camara, Diego; Mack, Katherine; Mangham, Sam; Mao, Qingqing; Marsh, David J. E.; Mateu, Cecilia; Maurin, Loïc; McCormac, James; Momcheva, Ivelina; Monteiro, Hektor; Mueller, Michael; Munoz, Roberto; Naidu, Rohan; Nelson, Nicholas; Nitschelm, Christian; North, Chris; Nunez-Iglesias, Juan; Ogaz, Sara; Owen, Russell; Parejko, John; Patrício, Vera; Pepper, Joshua; Perrin, Marshall; Pickering, Timothy; Piscionere, Jennifer; Pogge, Richard; Poleski, Radek; Pourtsidou, Alkistis; Price-Whelan, Adrian M.; Rawls, Meredith L.; Read, Shaun; Rees, Glen; Rein, Hanno; Rice, Thomas; Riemer-Sørensen, Signe; Rusomarov, Naum; Sanchez, Sebastian F.; Santander-García, Miguel; Sarid, Gal; Schoenell, William; Scholz, Aleks; Schuhmann, Robert L.; Schuster, William; Scicluna, Peter; Seidel, Marja; Shao, Lijing; Sharma, Pranav; Shulevski, Aleksandar; Shupe, David; Sifón, Cristóbal; Simmons, Brooke; Sinha, Manodeep; Skillen, Ian; Soergel, Bjoern; Spriggs, Thomas; Srinivasan, Sundar; Stevens, Abigail; Streicher, Ole; Suchyta, Eric; Tan, Joshua; Telford, O. Grace; Thomas, Romain; Tonini, Chiara; Tremblay, Grant; Tuttle, Sarah; Urrutia, Tanya; Vaughan, Sam; Verdugo, Miguel; Wagner, Alexander; Walawender, Josh; Wetzel, Andrew; Willett, Kyle; Williams, Peter K. G.; Yang, Guang; Zhu, Guangtun; Zonca, Andrea
Comments:
Submitted: 2016-10-10
The Astropy Project (http://astropy.org) is, in its own words, "a community effort to develop a single core package for Astronomy in Python and foster interoperability between Python astronomy packages." For five years this project has been managed, written, and operated as a grassroots, self-organized, almost entirely volunteer effort while the software is used by the majority of the astronomical community. Despite this, the project has always been and remains to this day effectively unfunded. Further, contributors receive little or no formal recognition for creating and supporting what is now critical software. This paper explores the problem in detail, outlines possible solutions to correct this, and presents a few suggestions on how to address the sustainability of general purpose astronomical software.
[17]  oai:arXiv.org:1608.02642  [pdf] - 1528138
A case study in adaptable and reusable infrastructure at the Keck Observatory Archive: VO interfaces, moving targets, and more
Comments: 16 pages, 8 figures, 5 tables. SPIE Astronomical Telescopes and Instrumentation, Software and Cyberinfrastructure for Astronomy
Submitted: 2016-08-08
This paper describes how the Keck Observatory Archive (KOA) is extending open source software components to develop new services. In August 2015, KOA deployed a program interface to discover public data from all instruments equipped with an imaging mode. The interface complies with version 2 of the Simple Imaging Access Protocol (SIAP), under development by the International Virtual Observatory Alliance (IVOA), which defines a standard mechanism for discovering images through spatial queries. The heart of the KOA service is an R-tree-based, database-indexing mechanism prototyped by the Virtual Astronomical Observatory (VAO) and further developed by the Montage Image Mosaic project, designed to provide fast access to large imaging data sets as a first step in creating wide-area image mosaics. The KOA service uses the results of the spatial R-tree search to create an SQLite data database for further relational filtering. The service uses a JSON configuration file to describe the association between instrument parameters and the service query parameters, and to make it applicable beyond the Keck instruments. The R-tree program was itself extended to support temporal (in addition to spatial) indexing, in response to requests from the planetary science community for a search engine to discover observations of Solar System objects. With this 3D-indexing scheme, the service performs very fast time and spatial matches between the target ephemerides, obtained from the JPL SPICE service. Our experiments indicate these matches can be more than 100 times faster than when separating temporal and spatial searches. Images of the tracks of the moving targets, overlaid with the image footprints, are computed with a new command-line visualization tool, mViewer, released with the Montage distribution. The service is currently in test and will be released in Fall 2016.
[18]  oai:arXiv.org:1608.02649  [pdf] - 1451975
The Next Generation of the Montage Image Mosaic Toolkit
Comments: 4 pages, ADASS XXV, Sydney, Australia
Submitted: 2016-08-08
The scientific computing landscape has evolved dramatically in the past few years, with new schemes for organizing and storing data that reflect the growth in size and complexity of astronomical data sets. In response to this changing landscape, we are, over the next two years, deploying the next generation of the Montage toolkit ([ascl:1010.036]). The first release (October 2015) supports multi-dimensional data sets ("data cubes"), and insertion of XMP/AVM tags that allows images to "drop-in" to the WWT. The same release offers a beta-version of web-based interactive visualization of images; this includes wrappers for visualization in Python. Subsequent releases will support HEALPix (now standard in cosmic background experiments); incorporation of Montage into package managers (which enable automated management of software builds), and support for a library that will enable Montage to be called directly from Python. This next generation toolkit will inherit the architectural benefits of the current engine - component based tools, ANSI-C portability across Unix platforms and scalability for distributed processing. With the expanded functionality under development, Montage can be viewed not simply as a mosaic engine, but as a scalable, portable toolkit for managing, organizing and processing images.
[19]  oai:arXiv.org:1512.07919  [pdf] - 1332632
Improving Software Citation and Credit
Comments: Birds of a Feather session organized by the Astrophysics Source Code Library (ASCL, http://ascl.net/ ); to be published in Proceedings of ADASS XXV (Sydney, Australia; October, 2015). 4 pages
Submitted: 2015-12-24
The past year has seen movement on several fronts for improving software citation, including the Center for Open Science's Transparency and Openness Promotion (TOP) Guidelines, the Software Publishing Special Interest Group that was started at January's AAS meeting in Seattle at the request of that organization's Working Group on Astronomical Software, a Sloan-sponsored meeting at GitHub in San Francisco to begin work on a cohesive research software citation-enabling platform, the work of Force11 to "transform and improve" research communication, and WSSSPE's ongoing efforts that include software publication, citation, credit, and sustainability. Brief reports on these efforts were shared at the BoF, after which participants discussed ideas for improving software citation, generating a list of recommendations to the community of software authors, journal publishers, ADS, and research authors. The discussion, recommendations, and feedback will help form recommendations for software citation to those publishers represented in the Software Publishing Special Interest Group and the broader community.
[20]  oai:arXiv.org:1505.03529  [pdf] - 1280859
The First Data Release of the KODIAQ Survey
Comments: 14 pages, 9 figures, Submitted to AJ. All data products available at the Keck Observatory Archive beginning May 15, 2015. URL: https://koa.ipac.caltech.edu/applications/KODIAQ
Submitted: 2015-05-13
We present and make publicly available the first data release (DR1) of the Keck Observatory Database of Ionized Absorption toward Quasars (KODIAQ) survey. The KODIAQ survey is aimed at studying galactic and circumgalactic gas in absorption at high-redshift, with a focus on highly-ionized gas traced by OVI, using the HIRES spectrograph on the Keck-I telescope. KODIAQ DR1 consists of a fully-reduced sample of 170 quasars at 0.29 < z_em < 5.29 observed with HIRES at high resolution (36,000 <= R <= 103,000) between 2004 and 2012. DR1 contains 247 spectra available in continuum normalized form, representing a sum total exposure time of ~1.6 megaseconds. These co-added spectra arise from a total of 567 individual exposures of quasars taken from the Keck Observatory Archive (KOA) in raw form and uniformly processed using a HIRES data reduction package made available through the XIDL distribution. DR1 is publicly available to the community, housed as a higher level science product at the KOA. We will provide future data releases that make further QSOs, including those with pre-2004 observations taken with the previous-generation HIRES detectors.
[21]  oai:arXiv.org:1504.02133  [pdf] - 977393
The Virtual Astronomical Observatory: Re-engineering Access to Astronomical Data
Comments: Abstract abridged for arXiv limit; 23 pages, 15 figures; to appear in a special issue of Astronomy & Computing
Submitted: 2015-04-08
The U.S. Virtual Astronomical Observatory was a software infrastructure and development project designed both to begin the establishment of an operational Virtual Observatory (VO) and to provide the U.S. coordination with the international VO effort. The concept of the VO is to provide the means by which an astronomer is able to discover, access, and process data seamlessly, regardless of its physical location. This paper describes the origins of the VAO, including the predecessor efforts within the U.S. National Virtual Observatory, and summarizes its main accomplishments. These accomplishments include the development of both scripting toolkits that allow scientists to incorporate VO data directly into their reduction and analysis environments and high-level science applications for data discovery, integration, analysis, and catalog cross-comparison. Working with the international community, and based on the experience from the software development, the VAO was a major contributor to international standards within the International Virtual Observatory Alliance. The VAO also demonstrated how an operational virtual observatory could be deployed, providing a robust operational environment in which VO services worldwide were routinely checked for aliveness and compliance with international standards. Finally, the VAO engaged in community outreach, developing a comprehensive web site with on-line tutorials, announcements, links to both U.S. and internationally developed tools and services, and exhibits and hands-on training .... All digital products of the VAO Project, including software, documentation, and tutorials, are stored in a repository for community access. The enduring legacy of the VAO is an increasing expectation that new telescopes and facilities incorporate VO capabilities during the design of their data management systems.
[22]  oai:arXiv.org:1502.05958  [pdf] - 943848
Significant problems in FITS limit its use in modern astronomical research
Comments: Astronomical Data Analysis Software and Systems XXIII. Proceedings of a meeting held 29 September - 3 October 2013 at Waikoloa Beach Marriott, Hawaii, USA. Edited by N. Manset and P. Forshay ASP conference series, vol. 485, 2014, p.351
Submitted: 2015-02-20
The Flexible Image Transport System (FITS) standard has been a great boon to astronomy, allowing observatories, scientists and the public to exchange astronomical information easily. The FITS standard is, however, showing its age. Developed in the late 1970s the FITS authors made a number of implementation choices for the format that, while common at the time, are now seen to limit its utility with modern data. The authors of the FITS standard could not appreciate the challenges which we would be facing today in astronomical computing. Difficulties we now face include, but are not limited to, having to address the need to handle an expanded range of specialized data product types (data models), being more conducive to the networked exchange and storage of data, handling very large datasets and the need to capture significantly more complex metadata and data relationships. There are members of the community today who find some (or all) of these limitations unworkable, and have decided to move ahead with storing data in other formats. This reaction should be taken as a wakeup call to the FITS community to make changes in the FITS standard, or to see its usage fall. In this paper we detail some selected important problems which exist within the FITS standard today. It is not our intention to prescribe specific remedies to these issues; rather, we hope to call attention of the FITS and greater astronomical computing communities to these issues in the hopes that it will spur action to address them.
[23]  oai:arXiv.org:1502.00996  [pdf] - 934374
Learning from FITS: Limitations in use in modern astronomical research
Comments:
Submitted: 2015-02-03, last modified: 2015-02-10
The Flexible Image Transport System (FITS) standard has been a great boon to astronomy, allowing observatories, scientists and the public to exchange astronomical information easily. The FITS standard, however, is showing its age. Developed in the late 1970s, the FITS authors made a number of implementation choices that, while common at the time, are now seen to limit its utility with modern data. The authors of the FITS standard could not anticipate the challenges which we are facing today in astronomical computing. Difficulties we now face include, but are not limited to, addressing the need to handle an expanded range of specialized data product types (data models), being more conducive to the networked exchange and storage of data, handling very large datasets, and capturing significantly more complex metadata and data relationships. There are members of the community today who find some or all of these limitations unworkable, and have decided to move ahead with storing data in other formats. If this fragmentation continues, we risk abandoning the advantages of broad interoperability, and ready archivability, that the FITS format provides for astronomy. In this paper we detail some selected important problems which exist within the FITS standard today. These problems may provide insight into deeper underlying issues which reside in the format and we provide a discussion of some lessons learned. It is not our intention here to prescribe specific remedies to these issues; rather, it is to call attention of the FITS and greater astronomical computing communities to these problems in the hope that it will spur action to address them.
[24]  oai:arXiv.org:1411.2031  [pdf] - 894814
Astrophysics Source Code Library Enhancements
Comments: 4 pages; to be published in ADASS XXIV Proceedings. ASCL can be accessed at http://ascl.net/
Submitted: 2014-11-07
The Astrophysics Source Code Library (ASCL; ascl.net) is a free online registry of codes used in astronomy research; it currently contains over 900 codes and is indexed by ADS. The ASCL has recently moved a new infrastructure into production. The new site provides a true database for the code entries and integrates the WordPress news and information pages and the discussion forum into one site. Previous capabilities are retained and permalinks to ascl.net continue to work. This improvement offers more functionality and flexibility than the previous site, is easier to maintain, and offers new possibilities for collaboration. This presentation covers these recent changes to the ASCL.
[25]  oai:arXiv.org:1408.5187  [pdf] - 1216465
Metadata and Data Management for the Keck Observatory Archive
Comments: 9 pages, SPIE Astronomical Telescopes and Instrumentation 2014: Software and Cyberinfrastructure for Astronomy III, Proc. SPIE 9152-92
Submitted: 2014-08-21
A collaboration between the W. M. Keck Observatory (WMKO) in Hawaii and the NASA Exoplanet Science Institute (NExScI) in California, the Keck Observatory Archive (KOA) was commissioned in 2004 to archive observing data from WMKO, which operates two classically scheduled 10 m ground-based telescopes. The observing data from Keck is not suitable for direct ingestion into the archive since the metadata contained in the original FITS headers lack the information necessary for proper archiving. Coupled with different standards among instrument builders and the heterogeneous nature of the data inherent in classical observing, in which observers have complete control of the instruments and their observations, the data pose a number of technical challenges for KOA. We describe the methodologies and tools that we have developed to successfully address these difficulties, adding content to the FITS headers and "retrofitting" the metadata in order to support archiving Keck data, especially those obtained before the archive was designed. With the expertise gained from having successfully archived observations taken with all eight currently active instruments at WMKO, we have developed lessons learned from handling this complex array of heterogeneous metadata that help ensure a smooth ingestion of data not only for current but also future instruments, as well as a better experience for the archive user.
[26]  oai:arXiv.org:1408.0835  [pdf] - 1216105
The Design and Operation of The Keck Observatory Archive
Comments: 12 pages, 4 figs, 4 tables. Presented at Software and Cyberinfrastructure for Astronomy III, SPIE Astronomical Telescopes + Instrumentation 2014. June 2014, Montreal, Canada
Submitted: 2014-08-04
The Infrared Processing and Analysis Center (IPAC) and the W. M. Keck Observatory (WMKO) operate an archive for the Keck Observatory. At the end of 2013, KOA completed the ingestion of data from all eight active observatory instruments. KOA will continue to ingest all newly obtained observations, at an anticipated volume of 4 TB per year. The data are transmitted electronically from WMKO to IPAC for storage and curation. Access to data is governed by a data use policy, and approximately two-thirds of the data in the archive are public.
[27]  oai:arXiv.org:1312.6723  [pdf] - 763725
Creating A Galactic Plane Atlas With Amazon Web Services
Comments: 7 pages, 1 table, 2 figures. Submitted to IEEE Special Edition on Computing in Astronomy
Submitted: 2013-12-23
This paper describes by example how astronomers can use cloud-computing resources offered by Amazon Web Services (AWS) to create new datasets at scale. We have created from existing surveys an atlas of the Galactic Plane at 16 wavelengths from 1 {\mu}m to 24 {\mu}m with pixels co-registered at spatial sampling of 1 arcsec. We explain how open source tools support management and operation of a virtual cluster on AWS platforms to process data at scale, and describe the technical issues that users will need to consider, such as optimization of resources, resource costs, and management of virtual machine instances.
[28]  oai:arXiv.org:1307.2944  [pdf] - 1172640
The NASA Exoplanet Archive: Data and Tools for Exoplanet Research
Comments: Accepted for publication in the Publications of the Astronomical Society of the Pacific, 4 figures
Submitted: 2013-07-10
We describe the contents and functionality of the NASA Exoplanet Archive, a database and tool set funded by NASA to support astronomers in the exoplanet community. The current content of the database includes interactive tables containing properties of all published exoplanets, Kepler planet candidates, threshold-crossing events, data validation reports and target stellar parameters, light curves from the Kepler and CoRoT missions and from several ground-based surveys, and spectra and radial velocity measurements from the literature. Tools provided to work with these data include a transit ephemeris predictor, both for single planets and for observing locations, light curve viewing and normalization utilities, and a periodogram and phased light curve service. The archive can be accessed at http://exoplanetarchive.ipac.caltech.edu.
[29]  oai:arXiv.org:1211.4055  [pdf] - 591793
A Tale Of 160 Scientists, Three Applications, A Workshop and A Cloud
Comments: 4 pages, 1 figure, 1 table. Submitted to Astronomical Data Analysis Software and Systems XXII
Submitted: 2012-11-16
The NASA Exoplanet Science Institute (NExScI) hosts the annual Sagan Workshops, thematic meetings aimed at introducing researchers to the latest tools and methodologies in exoplanet research. The theme of the Summer 2012 workshop, held from July 23 to July 27 at Caltech, was to explore the use of exoplanet light curves to study planetary system architectures and atmospheres. A major part of the workshop was to use hands-on sessions to instruct attendees in the use of three open source tools for the analysis of light curves, especially from the Kepler mission. Each hands-on session involved the 160 attendees using their laptops to follow step-by-step tutorials given by experts. We describe how we used the Amazon Elastic Cloud 2 to run these applications.
[30]  oai:arXiv.org:1206.4493  [pdf] - 1124256
Running a distributed virtual observatory: US Virtual Astronomical Observatory operations
Comments: 7 pages with 2 figures included within PDF
Submitted: 2012-06-20
Operation of the US Virtual Astronomical Observatory shares some issues with modern physical observatories, e.g., intimidating data volumes and rapid technological change, and must also address unique concerns like the lack of direct control of the underlying and scattered data resources, and the distributed nature of the observatory itself. In this paper we discuss how the VAO has addressed these challenges to provide the astronomical community with a coherent set of science-enabling tools and services. The distributed nature of our virtual observatory-with data and personnel spanning geographic, institutional and regime boundaries-is simultaneously a major operational headache and the primary science motivation for the VAO. Most astronomy today uses data from many resources. Facilitation of matching heterogeneous datasets is a fundamental reason for the virtual observatory. Key aspects of our approach include continuous monitoring and validation of VAO and VO services and the datasets provided by the community, monitoring of user requests to optimize access, caching for large datasets, and providing distributed storage services that allow user to collect results near large data repositories. Some elements are now fully implemented, while others are planned for subsequent years. The distributed nature of the VAO requires careful attention to what can be a straightforward operation at a conventional observatory, e.g., the organization of the web site or the collection and combined analysis of logs. Many of these strategies use and extend protocols developed by the international virtual observatory community.
[31]  oai:arXiv.org:1206.4079  [pdf] - 1124212
The organization and management of the Virtual Astronomical Observatory
Comments: 9 pages, 3 figures. SPIE Conference 8449: Modeling, Systems Engineering, and Project Management for Astronomy V
Submitted: 2012-06-18
The U.S. Virtual Astronomical Observatory (VAO; http://www.us-vao.org/) has been in operation since May 2010. Its goal is to enable new science through efficient integration of distributed multi-wavelength data. This paper describes the management and organization of the VAO, and emphasizes the techniques used to ensure efficiency in a distributed organization. Management methods include using an annual program plan as the basis for establishing contracts with member organizations, regular communication, and monitoring of processes.
[32]  oai:arXiv.org:1206.4076  [pdf] - 1124211
The role in the Virtual Astronomical Observatory in the era of massive data sets
Comments: 10 pages, 3 figures. SPIE Conference 8448: Observatory Operations: Strategies, Processes, and Systems IV
Submitted: 2012-06-18
The Virtual Observatory (VO) is realizing global electronic integration of astronomy data. One of the long-term goals of the U.S. VO project, the Virtual Astronomical Observatory (VAO), is development of services and protocols that respond to the growing size and complexity of astronomy data sets. This paper describes how VAO staff are active in such development efforts, especially in innovative strategies and techniques that recognize the limited operating budgets likely available to astronomers even as demand increases. The project has a program of professional outreach whereby new services and protocols are evaluated.
[33]  oai:arXiv.org:1111.0075  [pdf] - 432360
How Will Astronomy Archives Survive The Data Tsunami?
Comments: 8 pages, 3 figures; ACM Queue. Vol 9, Number 10, October 2011 (http://queue.acm.org/detail.cfm?id=2047483)
Submitted: 2011-10-31
The field of astronomy is starting to generate more data than can be managed, served and processed by current techniques. This paper has outlined practices for developing next-generation tools and techniques for surviving this data tsunami, including rigorous evaluation of new technologies, partnerships between astronomers and computer scientists, and training of scientists in high-end software engineering engineering skills.
[34]  oai:arXiv.org:1107.1933  [pdf] - 383559
The NStED Periodogram Service and Interface for Public CoRoT Data
Comments: 2 pages, 1 figure. To appear in "Transiting Planets, Vibrating Stars, and Their Connection", Conference Proceedings of the 2nd CoRoT Symposium, Eds: A. Baglin, M. Deleuil, E. Michel, C. Moutou
Submitted: 2011-07-11
As part of the NASA-CNES agreement, the NASA Star and Exoplanet Database (NStED) serves as the official US portal for the public CoRoT data products. NStED is a general purpose archive with the aim of providing support for NASA's planet finding and characterization goals. Consequently, the NASA Exoplanet Science Institute (NExScI) developed, and NStED adapted, a periodogram service for CoRoT data to determine periods of variability phenomena and create phased photometric light curves. Through the NStED periodogram interface, the user may choose three different period detection algorithms to use on any photometric time series product, or even upload and analyze their own data. Additionally, the NStED periodogram is remotely accessed by the CoRoT archive as part of its interface. NStED is available at {\bf http://nsted.ipac.caltech.edu}.
[35]  oai:arXiv.org:1103.1160  [pdf] - 1052523
A Cross-Match of 2MASS and SDSS. II. Peculiar L Dwarfs, Unresolved Binaries, and the Space Density of T Dwarf Secondaries
Comments: Accepted by ApJ
Submitted: 2011-03-06
We present the completion of a program to cross-correlate the SDSS Data Release 1 and 2MASS Point Source Catalog in search for extremely red L and T dwarfs. The program was initiated by Metchev and collaborators, who presented the findings on all newly identified T dwarfs in SDSS DR1, and estimated the space density of isolated T0--T8 dwarfs in the solar neighbourhood. In the current work we present most of the L dwarf discoveries. Our red-sensitive (z-J > 2.75 mag) cross-match proves to be efficient in detecting peculiarly red L dwarfs, adding two new ones, including one of the reddest known L dwarfs. Our search also nets a new peculiarly blue L7 dwarf and, surprisingly, two M8 dwarfs. We further broaden our analysis to detect unresolved binary L or T dwarfs through spectral template fitting to all L and T dwarfs presented here and in the earlier work by Metchev and collaborators. We identify nine probable binaries, six of which are new and eight harbour likely T dwarf secondaries. We combine this result with current knowledge of the mass ratio distribution and frequency of substellar companions to estimate an overall space density of 0.005--0.05 pc^{-3} for individual T0--T8 dwarfs.
[36]  oai:arXiv.org:1011.5294  [pdf] - 955602
Collaborative Astronomical Image Mosaics
Comments: 16 pages, 3 figures. To be published in "Reshaping Research and Development using Web 2.0-based technologies." Mark Baker, ed. Nova Science Publishers, Inc.(2011)
Submitted: 2010-11-23
This chapter describes how astronomical imaging survey data have become a vital part of modern astronomy, how these data are archived and then served to the astronomical community through on-line data access portals. The Virtual Observatory, now under development, aims to make all these data accessible through a uniform set of interfaces. This chapter also describes the scientific need for one common image processing task, that of composing individual images into large scale mosaics and introduces Montage as a tool for this task. Montage, as distributed, can be used in four ways: as a single thread/process on a single CPU, in parallel using MPI to distribute similar tasks across a parallel computer, in parallel using grid tools (Pegasus/DAGMan) to distributed tasks across a grid, or in parallel using a script-driven approach (Swift). An on-request web based Montage service is available for users who do not need to build a local version. We also introduce some work on a new scripted version of Montage, which offers ease of customization for users. Then, we discuss various ideas where Web 2.0 technologies can help the Montage community.
[37]  oai:arXiv.org:1010.4813  [pdf] - 955510
The Application of Cloud Computing to Astronomy: A Study of Cost and Performance
Comments: 7 pages, accepted for publication in the Proceedings of the e-Science in Astronomy Conference (Brisbane, Australia, December 2010)
Submitted: 2010-10-22
Cloud computing is a powerful new technology that is widely used in the business world. Recently, we have been investigating the benefits it offers to scientific computing. We have used three workflow applications to compare the performance of processing data on the Amazon EC2 cloud with the performance on the Abe high-performance cluster at the National Center for Supercomputing Applications (NCSA). We show that the Amazon EC2 cloud offers better performance and value for processor- and memory-limited applications than for I/O-bound applications. We provide an example of how the cloud is well suited to the generation of a science product: an atlas of periodograms for the 210,000 light curves released by the NASA Kepler Mission. This atlas will support the identification of periodic signals, including those due to transiting exoplanets, in the Kepler data sets.
[38]  oai:arXiv.org:1006.4860  [pdf] - 1033307
The Application of Cloud Computing to the Creation of Image Mosaics and Management of Their Provenance
Comments: 15 pages, 3 figure
Submitted: 2010-06-24
We have used the Montage image mosaic engine to investigate the cost and performance of processing images on the Amazon EC2 cloud, and to inform the requirements that higher-level products impose on provenance management technologies. We will present a detailed comparison of the performance of Montage on the cloud and on the Abe high performance cluster at the National Center for Supercomputing Applications (NCSA). Because Montage generates many intermediate products, we have used it to understand the science requirements that higher-level products impose on provenance management technologies. We describe experiments with provenance management technologies such as the "Provenance Aware Service Oriented Architecture" (PASOA).
[39]  oai:arXiv.org:1005.4454  [pdf] - 170899
Montage: a grid portal and software toolkit for science-grade astronomical image mosaicking
Comments: 16 pages, 11 figures
Submitted: 2010-05-24
Montage is a portable software toolkit for constructing custom, science-grade mosaics by composing multiple astronomical images. The mosaics constructed by Montage preserve the astrometry (position) and photometry (intensity) of the sources in the input images. The mosaic to be constructed is specified by the user in terms of a set of parameters, including dataset and wavelength to be used, location and size on the sky, coordinate system and projection, and spatial sampling rate. Many astronomical datasets are massive, and are stored in distributed archives that are, in most cases, remote with respect to the available computational resources. Montage can be run on both single- and multi-processor computers, including clusters and grids. Standard grid tools are used to run Montage in the case where the data or computers used to construct a mosaic are located remotely on the Internet. This paper describes the architecture, algorithms, and usage of Montage as both a software toolkit and as a grid portal. Timing results are provided to show how Montage performance scales with number of processors on a cluster computer. In addition, we compare the performance of two methods of running Montage in parallel on a grid.
[40]  oai:arXiv.org:1005.3358  [pdf] - 168467
The Role of Provenance Management in Accelerating the Rate of Astronomical Research
Comments: 8 pages, 1 figure; Proceedings of Science, 2010
Submitted: 2010-05-19
The availability of vast quantities of data through electronic archives has transformed astronomical research. It has also enabled the creation of new products, models and simulations, often from distributed input data and models, that are themselves made electronically available. These products will only provide maximal long-term value to astronomers when accompanied by records of their provenance; that is, records of the data and processes used in the creation of such products. We use the creation of image mosaics with the Montage grid-enabled mosaic engine to emphasize the necessity of provenance management and to understand the science requirements that higher-level products impose on provenance management technologies. We describe experiments with one technology, the "Provenance Aware Service Oriented Architecture" (PASOA), that stores provenance information at each step in the computation of a mosaic. The results inform the technical specifications of provenance management systems, including the need for extensible systems built on common standards. Finally, we describe examples of provenance management technology emerging from the fields of geophysics and oceanography that have applicability to astronomy applications.
[41]  oai:arXiv.org:0907.3405  [pdf] - 1002983
The LAEX and NASA portals for CoRoT public data
Comments: Accepted for publication in Astronomy & Astrophysics
Submitted: 2009-07-20
* Aims. We describe here the main functionalities of the LAEX (Laboratorio de Astrofisica Estelar y Exoplanetas/Laboratory for Stellar Astrophysics and Exoplanets) and NASA portals for CoRoT Public Data. The CoRoT archive at LAEX was opened to the community in January 2009 and is managed in the framework of the Spanish Virtual Observatory. NStED (NASA Star and Exoplanet Database) serves as the CoRoT portal for the US astronomical community. NStED is a general purpose stellar and exoplanet archive with the aim of providing support for NASA planet finding and characterisation goals, and the planning and support of NASA and other space missions. CoRoT data at LAEX and NStED can be accessed at http://sdc.laeff.inta.es/corotfa/ and http://nsted.ipac.caltech.edu,respectively. * Methods. Based on considerable experience with astronomical archives, the aforementioned archives are designed with the aim of delivering science-quality data in a simple and efficient way. * Results. LAEX and NStED not only provide access to CoRoT Public Data but furthermore serve a variety of observed and calculated astrophysical data. In particular, NStED provides scientifically validated information on stellar and planetary data related to the search for and characterization of extrasolar planets, and LAEX makes any information from Virtual Observatory services available to the astronomical community.
[42]  oai:arXiv.org:0903.2505  [pdf] - 22376
The NASA/IPAC/NExScI Star and Exoplanet Database
Comments: 4 pages, AIP style
Submitted: 2009-03-13
The NASA/IPAC/NExScI Star and Exoplanet Database (NStED) is a general purpose stellar archive which supports NASA planet-finding and planet-characterization goals, stellar astrophysics, and the planning of NASA and other space missions. There are two principal components of NStED: a database of 140,000 nearby stars and exoplanet-hosting stars, and an archive dedicated to high precision photometric surveys for transiting exoplanets (NStED-ETSS). We present summaries of these components. The NStED stellar database currently serves published parameters for 140,000 stars. These parameters include coordinates, multiplicity, proper motion, parallax, spectral type, multiband photometry, radial velocity, metallicity, chromospheric and coronal activity index, rotation velocity/period, infrared excess. NStED-ETSS currently serves data from the TrES survey of the Kepler field as well as dedicated photometric surveys of four stellar clusters. NStED-ETSS aims to serve both the surveys and the broader astronomical community by archiving these data and making them available in a homogeneous format.
[43]  oai:arXiv.org:0806.4611  [pdf] - 13995
The NStED Stellar and Exoplanet Hosting Star Service
Comments: To appear in the Proceedings of the 253rd IAU Symposium: "Transiting Planets", May 2008, Cambridge, MA. 4 pages, 4 figures
Submitted: 2008-06-27
The NASA Star and Exoplanet Database (NStED) is a general purpose stellar archive with the aim of providing support for NASA's planet finding and characterization goals, stellar astrophysics, and the planning of NASA and other space missions. There are two principal components of NStED: a database of (currently) 140,000 nearby stars and exoplanet-hosting stars, and an archive dedicated to high precision photometric surveys for transiting exoplanets. We present a summary of the NStED stellar database, functionality, tools, and user interface. NStED currently serves the following kinds of data for 140,000 stars (where available): coordinates, multiplicity, proper motion, parallax, spectral type, multiband photometry, radial velocity, metallicity, chromospheric and coronal activity index, and rotation velocity/period. Furthermore, the following derived quantities are given wherever possible: distance, effective temperature, mass, radius, luminosity, space motions, and physical/angular dimensions of habitable zone. Queries to NStED can be made using constraints on any combination of the above parameters. In addition, NStED provides tools to derive specific inferred quantities for the stars in the database, cross-referenced with available extra-solar planetary data for those host stars. NStED can be accessed at http://nsted.ipac.caltech.edu
[44]  oai:arXiv.org:0806.3979  [pdf] - 13853
The NStED Exoplanet Transit Survey Service
Comments: To appear in the Proceedings of the 253rd IAU Symposium: "Transiting Planets", May 2008, Cambridge, MA. 4 pages, 2 figures
Submitted: 2008-06-24
The NASA Star and Exoplanet Database (NStED) is a general purpose stellar archive with the aim of providing support for NASA's planet finding and characterization goals, stellar astrophysics, and the planning of NASA and other space missions. There are two principal components of NStED: a database of (currently) 140,000 nearby stars and exoplanet-hosting stars, and an archive dedicated to high-precision photometric surveys for transiting exoplanets. We present a summary of the latter component: the NStED Exoplanet Transit Survey Service (NStED-ETSS), along with its content, functionality, tools, and user interface. NStED-ETSS currently serves data from the TrES Survey of the Kepler Field as well as dedicated photometric surveys of four stellar clusters. <CA>NStED-ETSS aims to serve both the surveys and the broader astronomical community by archiving these data and making them available in a homogeneous format. Examples of usability of ETSS include investigation of any time-variable phenomena in data sets not studied by the original survey team, application of different techniques or algorithms for planet transit detections, combination of data from different surveys for given objects, statistical studies, etc. NStED-ETSS can be accessed at \tt{http://nsted.ipac.caltech.edu}
[45]  oai:arXiv.org:0710.4157  [pdf] - 6293
A Cross-Match of 2MASS and SDSS: Newly-Found L and T Dwarfs and an Estimate of the Space Densitfy of T Dwarfs
Comments: To appear in ApJ, Feb 10, 2008 issue. 37 pages, including 12 figures and 14 tables
Submitted: 2007-10-22
We report new L and T dwarfs found in a cross-match of the SDSS Data Release 1 and 2MASS. Our simultaneous search of the two databases effectively allows us to relax the criteria for object detection in either survey and to explore the combined databases to a greater completeness level. We find two new T dwarfs in addition to the 13 already known in the SDSS DR1 footprint. We also identify 22 new candidate and bona-fide L dwarfs, including a new young L2 dwarf and a peculiar L2 dwarf with unusually blue near-IR colors: potentially the result of mildly sub-solar metallicity. These discoveries underscore the utility of simultaneous database cross-correlation in searching for rare objects. Our cross-match completes the census of T dwarfs within the joint SDSS and 2MASS flux limits to the 97% level. Hence, we are able to accurately infer the space density of T dwarfs. We employ Monte Carlo tools to simulate the observed population of SDSS DR1 T dwarfs with 2MASS counterparts and find that the space density of T0-T8 dwarf systems is 0.0070 (-0.0030; +0.0032) per cubic parsec (95% confidence interval), i.e., about one per 140 cubic parsecs. Compared to predictions for the T dwarf space density that depend on various assumptions for the sub-stellar mass function, this result is most consistent with models that assume a flat sub-stellar mass function dN/dM ~ M^0. No >T8 dwarfs were discovered in the present cross-match, though less than one was expected in the limited area (2099 sq. degrees) of SDSS DR1.
[46]  oai:arXiv.org:astro-ph/0309194  [pdf] - 59021
Single and Composite Hot Subdwarf Stars in the Light of 2MASS All-Sky Photometry
Comments: 4 pages, 1 figure. To appear in "Extreme Horizontal Branch Stars and Related Objects", Astrophysics and Space Science, Kluwer Academic Publishers, proceedings of the meeting held in Keele, UK, June 16-20, 2003
Submitted: 2003-09-05
Utilizing the Two Micron All Sky Survey (2MASS) All-Sky Data Release Catalog, we have retrieved useful near-IR J, H, and Ks magnitudes for more than 800 hot subdwarfs (sdO and sdB stars) drawn from the "Catalogue of Spectroscopically Identified Hot Subdwarfs" (Kilkenny, Heber, & Drilling 1988, 1992). This sample size greatly exceeds previous studies of hot subdwarfs. We find that, of the hot subdwarfs in Kilkenny et al., ~40% in a magnitude limited sample have colors that are consistent with the presence of an unresolved late type (FGK) companion. Binary stars are over-represented in a magnitude limited sample. In an approximately volume limited sample the fraction of composite-color binaries is ~25%.