Normalized to: Boehm, V.
[1]
oai:arXiv.org:2003.01926 [pdf] - 2059276
Transformation Importance with Applications to Cosmology
Submitted: 2020-03-04
Machine learning lies at the heart of new possibilities for scientific
discovery, knowledge generation, and artificial intelligence. Its potential
benefits to these fields requires going beyond predictive accuracy and focusing
on interpretability. In particular, many scientific problems require
interpretations in a domain-specific interpretable feature space (e.g. the
frequency domain) whereas attributions to the raw features (e.g. the pixel
space) may be unintelligible or even misleading. To address this challenge, we
propose TRIM (TRansformation IMportance), a novel approach which attributes
importances to features in a transformed space and can be applied post-hoc to a
fully trained model. TRIM is motivated by a cosmological parameter estimation
problem using deep neural networks (DNNs) on simulated data, but it is
generally applicable across domains/models and can be combined with any local
interpretation method. In our cosmology example, combining TRIM with contextual
decomposition shows promising results for identifying which frequencies a DNN
uses, helping cosmologists to understand and validate that the model learns
appropriate physical features rather than simulation artifacts.
[2]
oai:arXiv.org:1410.6289 [pdf] - 941733
Signal inference with unknown response: Calibration-uncertainty
renormalized estimator
Submitted: 2014-10-23, last modified: 2015-03-02
The calibration of a measurement device is crucial for every scientific
experiment, where a signal has to be inferred from data. We present CURE, the
calibration uncertainty renormalized estimator, to reconstruct a signal and
simultaneously the instrument's calibration from the same data without knowing
the exact calibration, but its covariance structure. The idea of CURE,
developed in the framework of information field theory, is starting with an
assumed calibration to successively include more and more portions of
calibration uncertainty into the signal inference equations and to absorb the
resulting corrections into renormalized signal (and calibration) solutions.
Thereby, the signal inference and calibration problem turns into solving a
single system of ordinary differential equations and can be identified with
common resummation techniques used in field theories. We verify CURE by
applying it to a simplistic toy example and compare it against existent
self-calibration schemes, Wiener filter solutions, and Markov Chain Monte Carlo
sampling. We conclude that the method is able to keep up in accuracy with the
best self-calibration methods and serves as a non-iterative alternative to it.