Normalized to: Shapiro, J.
[1]
oai:arXiv.org:1807.07153 [pdf] - 1719101
Mining the GPIES database
Submitted: 2018-07-18
The Gemini Planet Imager Exoplanet Survey (GPIES) is a direct imaging
campaign designed to search for young, self-luminous, giant exoplanets. To
date, GPIES has observed nearly 500 targets, and generated over 30,000
individual exposures using its integral field spectrograph (IFS) instrument.
The GPIES team has developed a campaign data system with a database
incorporating all of the metadata for all individual raw data products,
including environmental conditions and instrument performance metrics. The same
database also indexes metadata associated with multiple levels of reduced data
products, including contrast measures for individual images and combined image
sequences, which serve as the primary metric of performance for the final
science products. The database is also used to track telemetry products from
the adaptive optics subsystem, and associate these with corresponding IFS data.
Here, we discuss several data exploration and visualization projects enabled by
the GPIES database. Of particular interest are any correlations between
instrument performance and environmental or operating conditions. We show
single and multiple-parameter fits of single-image and observing sequence
contrast as functions of various seeing measures, and discuss automated outlier
rejection and other fitting concerns. Supervised learning techniques are
employed in order to partition the space of raw (single image) to final (full
sequence) contrast in order to better predict the value of the final data set
from the first few completed observations. Finally, we discuss the particular
features of the database design that aid in performing these analyses, and
suggest potential future upgrades and refinements.
[2]
oai:arXiv.org:1801.01902 [pdf] - 1623859
Automated data processing architecture for the Gemini Planet Imager
Exoplanet Survey
Wang, Jason;
Perrin, Marshall;
Savransky, Dmitry;
Arriaga, Pauline;
Chilcote, Jeffrey;
De Rosa, Robert;
Millar-Blanchaer, Maxwell;
Marois, Christian;
Rameau, Julien;
Wolff, Schuyler;
Shapiro, Jacob;
Ruffio, Jean-Baptiste;
Maire, Jérôme;
Marchis, Franck;
Graham, James;
Macintosh, Bruce;
Ammons, S. Mark;
Bailey, Vanessa;
Barman, Travis;
Bruzzone, Sebastian;
Bulger, Joanna;
Cotten, Tara;
Doyon, René;
Duchêne, Gaspard;
Fitzgerald, Michael;
Follette, Katherine;
Goodsell, Stephen;
Greenbaum, Alexandra;
Hibon, Pascale;
Hung, Li-Wei;
Ingraham, Patrick;
Kalas, Paul;
Konopacky, Quinn;
Larkin, James;
Marley, Mark;
Metchev, Stanimir;
Nielsen, Eric;
Oppenheimer, Rebecca;
Palmer, David;
Patience, Jennifer;
Poyneer, Lisa;
Pueyo, Laurent;
Rajan, Abhijith;
Rantakyrö, Fredrik;
Schneider, Adam;
Sivaramakrishnan, Anand;
Song, Inseok;
Soummer, Remi;
Thomas, Sandrine;
Wallace, J. Kent;
Ward-Duong, Kimberly;
Wiktorowicz, Sloane
Submitted: 2018-01-05
The Gemini Planet Imager Exoplanet Survey (GPIES) is a multi-year direct
imaging survey of 600 stars to discover and characterize young Jovian
exoplanets and their environments. We have developed an automated data
architecture to process and index all data related to the survey uniformly. An
automated and flexible data processing framework, which we term the Data
Cruncher, combines multiple data reduction pipelines together to process all
spectroscopic, polarimetric, and calibration data taken with GPIES. With no
human intervention, fully reduced and calibrated data products are available
less than an hour after the data are taken to expedite follow-up on potential
objects of interest. The Data Cruncher can run on a supercomputer to reprocess
all GPIES data in a single day as improvements are made to our data reduction
pipelines. A backend MySQL database indexes all files, which are synced to the
cloud, and a front-end web server allows for easy browsing of all files
associated with GPIES. To help observers, quicklook displays show reduced data
as they are processed in real-time, and chatbots on Slack post observing
information as well as reduced data products. Together, the GPIES automated
data processing architecture reduces our workload, provides real-time data
reduction, optimizes our observing strategy, and maintains a homogeneously
reduced dataset to study planet occurrence and instrument performance.