Normalized to: Gal, Y.
[1]
oai:arXiv.org:1912.09279 [pdf] - 2017816
FDL: Mission Support Challenge
Submitted: 2019-12-17
The Frontier Development Lab (FDL) is a National Aeronautics and Space
Administration (NASA) machine learning program with the stated aim of
conducting artificial intelligence research for space exploration and all
humankind with support in the European program from the European Space Agency
(ESA). Interdisciplinary teams of researchers and data-scientists are brought
together to tackle a range of challenging, real-world problems in the
space-domain. The program primarily consists of a sprint phase during which
teams tackle separate problems in the spirit of 'coopetition'. Teams are given
a problem brief by real stakeholders and mentored by a range of experts. With
access to exceptional computational resources, we were challenged to make a
serious contribution within just eight weeks.
Stated simply, our team was tasked with producing a system capable of
scheduling downloads from satellites autonomously. Scheduling is a difficult
problem in general, of course, complicated further in this scenario by
ill-defined objectives & measures of success, the difficulty of communicating
tacit knowledge and the standard challenges of real-world data. Taking a
broader perspective, spacecraft scheduling is a problem that currently lacks an
intelligent solution and, with the advent of mega-constellations, presents a
serious operational bottleneck for the missions of tomorrow.
[2]
oai:arXiv.org:1911.04008 [pdf] - 1996219
Auto-Calibration of Remote Sensing Solar Telescopes with Deep Learning
Submitted: 2019-11-10
As a part of NASA's Heliophysics System Observatory (HSO) fleet of
satellites,the Solar Dynamics Observatory (SDO) has continuously monitored the
Sun since2010. Ultraviolet (UV) and Extreme UV (EUV) instruments in orbit, such
asSDO's Atmospheric Imaging Assembly (AIA) instrument, suffer time-dependent
degradation which reduces instrument sensitivity. Accurate calibration for
(E)UV instruments currently depends on periodic sounding rockets, which are
infrequent and not practical for heliophysics missions in deep space. In the
present work, we develop a Convolutional Neural Network (CNN) that
auto-calibrates SDO/AIA channels and corrects sensitivity degradation by
exploiting spatial patterns in multi-wavelength observations to arrive at a
self-calibration of (E)UV imaging instruments. Our results remove a major
impediment to developing future HSOmissions of the same scientific caliber as
SDO but in deep space, able to observe the Sun from more vantage points than
just SDO's current geosynchronous orbit.This approach can be adopted to perform
autocalibration of other imaging systems exhibiting similar forms of
degradation
[3]
oai:arXiv.org:1911.04006 [pdf] - 1996218
Using U-Nets to Create High-Fidelity Virtual Observations of the Solar
Corona
Submitted: 2019-11-10
Understanding and monitoring the complex and dynamic processes of the Sun is
important for a number of human activities on Earth and in space. For this
reason, NASA's Solar Dynamics Observatory (SDO) has been continuously
monitoring the multi-layered Sun's atmosphere in high-resolution since its
launch in 2010, generating terabytes of observational data every day. The
synergy between machine learning and this enormous amount of data has the
potential, still largely unexploited, to advance our understanding of the Sun
and extend the capabilities of heliophysics missions. In the present work, we
show that deep learning applied to SDO data can be successfully used to create
a high-fidelity virtual telescope that generates synthetic observations of the
solar corona by image translation. Towards this end we developed a deep neural
network, structured as an encoder-decoder with skip connections (U-Net), that
reconstructs the Sun's image of one instrument channel given temporally aligned
images in three other channels. The approach we present has the potential to
reduce the telemetry needs of SDO, enhance the capabilities of missions that
have less observing channels, and transform the concept development of future
missions.
[4]
oai:arXiv.org:1911.01490 [pdf] - 1994369
Single-Frame Super-Resolution of Solar Magnetograms: Investigating
Physics-Based Metrics \& Losses
Jungbluth, Anna;
Gitiaux, Xavier;
Maloney, Shane A.;
Shneider, Carl;
Wright, Paul J.;
Kalaitzis, Alfredo;
Deudon, Michel;
Baydin, Atılım Güneş;
Gal, Yarin;
Muñoz-Jaramillo, Andrés
Submitted: 2019-11-04
Breakthroughs in our understanding of physical phenomena have traditionally
followed improvements in instrumentation. Studies of the magnetic field of the
Sun, and its influence on the solar dynamo and space weather events, have
benefited from improvements in resolution and measurement frequency of new
instruments. However, in order to fully understand the solar cycle,
high-quality data across time-scales longer than the typical lifespan of a
solar instrument are required. At the moment, discrepancies between measurement
surveys prevent the combined use of all available data. In this work, we show
that machine learning can help bridge the gap between measurement surveys by
learning to \textbf{super-resolve} low-resolution magnetic field images and
\textbf{translate} between characteristics of contemporary instruments in
orbit. We also introduce the notion of physics-based metrics and losses for
super-resolution to preserve underlying physics and constrain the solution
space of possible super-resolution outputs.
[5]
oai:arXiv.org:1911.01486 [pdf] - 1994368
Probabilistic Super-Resolution of Solar Magnetograms: Generating Many
Explanations and Measuring Uncertainties
Gitiaux, Xavier;
Maloney, Shane A.;
Jungbluth, Anna;
Shneider, Carl;
Wright, Paul J.;
Baydin, Atılım Güneş;
Deudon, Michel;
Gal, Yarin;
Kalaitzis, Alfredo;
Muñoz-Jaramillo, Andrés
Submitted: 2019-11-04
Machine learning techniques have been successfully applied to
super-resolution tasks on natural images where visually pleasing results are
sufficient. However in many scientific domains this is not adequate and
estimations of errors and uncertainties are crucial. To address this issue we
propose a Bayesian framework that decomposes uncertainties into epistemic and
aleatoric uncertainties. We test the validity of our approach by
super-resolving images of the Sun's magnetic field and by generating maps
measuring the range of possible high resolution explanations compatible with a
given low resolution magnetogram.
[6]
oai:arXiv.org:1905.07424 [pdf] - 1973675
Galaxy Zoo: Probabilistic Morphology through Bayesian CNNs and Active
Learning
Walmsley, Mike;
Smith, Lewis;
Lintott, Chris;
Gal, Yarin;
Bamford, Steven;
Dickinson, Hugh;
Fortson, Lucy;
Kruk, Sandor;
Masters, Karen;
Scarlata, Claudia;
Simmons, Brooke;
Smethurst, Rebecca;
Wright, Darryl
Submitted: 2019-05-17, last modified: 2019-10-04
We use Bayesian convolutional neural networks and a novel generative model of
Galaxy Zoo volunteer responses to infer posteriors for the visual morphology of
galaxies. Bayesian CNN can learn from galaxy images with uncertain labels and
then, for previously unlabelled galaxies, predict the probability of each
possible label. Our posteriors are well-calibrated (e.g. for predicting bars,
we achieve coverage errors of 11.8% within a vote fraction deviation of 0.2)
and hence are reliable for practical use. Further, using our posteriors, we
apply the active learning strategy BALD to request volunteer responses for the
subset of galaxies which, if labelled, would be most informative for training
our network. We show that training our Bayesian CNNs using active learning
requires up to 35-60% fewer labelled galaxies, depending on the morphological
feature being classified. By combining human and machine intelligence, Galaxy
Zoo will be able to classify surveys of any conceivable scale on a timescale of
weeks, providing massive and detailed morphology catalogues to support research
into galaxy evolution.
[7]
oai:arXiv.org:1910.03085 [pdf] - 1975526
Correlation of Auroral Dynamics and GNSS Scintillation with an
Autoencoder
Lamb, Kara;
Malhotra, Garima;
Vlontzos, Athanasios;
Wagstaff, Edward;
Baydin, Atılım Günes;
Bhiwandiwalla, Anahita;
Gal, Yarin;
Kalaitzis, Alfredo;
Reina, Anthony;
Bhatt, Asti
Submitted: 2019-10-04
High energy particles originating from solar activity travel along the the
Earth's magnetic field and interact with the atmosphere around the higher
latitudes. These interactions often manifest as aurora in the form of visible
light in the Earth's ionosphere. These interactions also result in
irregularities in the electron density, which cause disruptions in the
amplitude and phase of the radio signals from the Global Navigation Satellite
Systems (GNSS), known as 'scintillation'. In this paper we use a multi-scale
residual autoencoder (Res-AE) to show the correlation between specific dynamic
structures of the aurora and the magnitude of the GNSS phase scintillations
($\sigma_{\phi}$). Auroral images are encoded in a lower dimensional feature
space using the Res-AE, which in turn are clustered with t-SNE and UMAP. Both
methods produce similar clusters, and specific clusters demonstrate greater
correlations with observed phase scintillations. Our results suggest that
specific dynamic structures of auroras are highly correlated with GNSS phase
scintillations.
[8]
oai:arXiv.org:1905.10659 [pdf] - 1912877
An Ensemble of Bayesian Neural Networks for Exoplanetary Atmospheric
Retrieval
Cobb, Adam D.;
Himes, Michael D.;
Soboczenski, Frank;
Zorzan, Simone;
O'Beirne, Molly D.;
Baydin, Atılım Güneş;
Gal, Yarin;
Domagal-Goldman, Shawn D.;
Arney, Giada N.;
Angerhausen, Daniel
Submitted: 2019-05-25
Machine learning is now used in many areas of astrophysics, from detecting
exoplanets in Kepler transit signals to removing telescope systematics. Recent
work demonstrated the potential of using machine learning algorithms for
atmospheric retrieval by implementing a random forest to perform retrievals in
seconds that are consistent with the traditional, computationally-expensive
nested-sampling retrieval method. We expand upon their approach by presenting a
new machine learning model, \texttt{plan-net}, based on an ensemble of Bayesian
neural networks that yields more accurate inferences than the random forest for
the same data set of synthetic transmission spectra. We demonstrate that an
ensemble provides greater accuracy and more robust uncertainties than a single
model. In addition to being the first to use Bayesian neural networks for
atmospheric retrieval, we also introduce a new loss function for Bayesian
neural networks that learns correlations between the model outputs.
Importantly, we show that designing machine learning models to explicitly
incorporate domain-specific knowledge both improves performance and provides
additional insight by inferring the covariance of the retrieved atmospheric
parameters. We apply \texttt{plan-net} to the Hubble Space Telescope Wide Field
Camera 3 transmission spectrum for WASP-12b and retrieve an isothermal
temperature and water abundance consistent with the literature. We highlight
that our method is flexible and can be expanded to higher-resolution spectra
and a larger number of atmospheric parameters.
[9]
oai:arXiv.org:1811.03390 [pdf] - 1791343
Bayesian Deep Learning for Exoplanet Atmospheric Retrieval
Soboczenski, Frank;
Himes, Michael D.;
O'Beirne, Molly D.;
Zorzan, Simone;
Baydin, Atilim Gunes;
Cobb, Adam D.;
Gal, Yarin;
Angerhausen, Daniel;
Mascaro, Massimo;
Arney, Giada N.;
Domagal-Goldman, Shawn D.
Submitted: 2018-11-08, last modified: 2018-12-02
Over the past decade, the study of extrasolar planets has evolved rapidly
from plain detection and identification to comprehensive categorization and
characterization of exoplanet systems and their atmospheres. Atmospheric
retrieval, the inverse modeling technique used to determine an exoplanetary
atmosphere's temperature structure and composition from an observed spectrum,
is both time-consuming and compute-intensive, requiring complex algorithms that
compare thousands to millions of atmospheric models to the observational data
to find the most probable values and associated uncertainties for each model
parameter. For rocky, terrestrial planets, the retrieved atmospheric
composition can give insight into the surface fluxes of gaseous species
necessary to maintain the stability of that atmosphere, which may in turn
provide insight into the geological and/or biological processes active on the
planet. These atmospheres contain many molecules, some of them biosignatures,
spectral fingerprints indicative of biological activity, which will become
observable with the next generation of telescopes. Runtimes of traditional
retrieval models scale with the number of model parameters, so as more
molecular species are considered, runtimes can become prohibitively long.
Recent advances in machine learning (ML) and computer vision offer new ways to
reduce the time to perform a retrieval by orders of magnitude, given a
sufficient data set to train with. Here we present an ML-based retrieval
framework called Intelligent exoplaNet Atmospheric RetrievAl (INARA) that
consists of a Bayesian deep learning model for retrieval and a data set of
3,000,000 synthetic rocky exoplanetary spectra generated using the NASA
Planetary Spectrum Generator. Our work represents the first ML retrieval model
for rocky, terrestrial exoplanets and the first synthetic data set of
terrestrial spectra generated at this scale.