Normalized to: Malakar, N.
[1]
oai:arXiv.org:1411.3013 [pdf] - 1314916
Bayesian Evidence and Model Selection
Submitted: 2014-11-11, last modified: 2015-11-23
In this paper we review the concepts of Bayesian evidence and Bayes factors,
also known as log odds ratios, and their application to model selection. The
theory is presented along with a discussion of analytic, approximate and
numerical techniques. Specific attention is paid to the Laplace approximation,
variational Bayes, importance sampling, thermodynamic integration, and nested
sampling and its recent variants. Analogies to statistical physics, from which
many of these techniques originate, are discussed in order to provide readers
with deeper insights that may lead to new techniques. The utility of Bayesian
model testing in the domain sciences is demonstrated by presenting four
specific practical examples considered within the context of signal processing
in the areas of signal detection, sensor characterization, scientific model
selection and molecular force characterization.
[2]
oai:arXiv.org:1402.2169 [pdf] - 782087
The Spatial Sensitivity Function of a Light Sensor
Submitted: 2014-02-10
The Spatial Sensitivity Function (SSF) is used to quantify a detector's
sensitivity to a spatially-distributed input signal. By weighting the incoming
signal with the SSF and integrating, the overall scalar response of the
detector can be estimated. This project focuses on estimating the SSF of a
light intensity sensor consisting of a photodiode. This light sensor has been
used previously in the Knuth Cyberphysics Laboratory on a robotic arm that
performs its own experiments to locate a white circle in a dark field (Knuth et
al., 2007). To use the light sensor to learn about its surroundings, the
robot's inference software must be able to model and predict the light sensor's
response to a hypothesized stimulus. Previous models of the light sensor
treated it as a point sensor and ignored its spatial characteristics. Here we
propose a parametric approach where the SSF is described by a mixture of
Gaussians (MOG). By performing controlled calibration experiments with known
stimulus inputs, we used nested sampling to estimate the SSF of the light
sensor using an MOG model with the number of Gaussians ranging from one to
five. By comparing the evidence computed for each MOG model, we found that one
Gaussian is sufficient to describe the SSF to the accuracy we require. Future
work will involve incorporating this more accurate SSF into the Bayesian
machine learning software for the robotic system and studying how this detailed
information about the properties of the light sensor will improve robot's
ability to learn.
[3]
oai:arXiv.org:1303.4385 [pdf] - 641021
Modeling a Sensor to Improve its Efficacy
Submitted: 2013-03-18
Robots rely on sensors to provide them with information about their
surroundings. However, high-quality sensors can be extremely expensive and
cost-prohibitive. Thus many robotic systems must make due with lower-quality
sensors. Here we demonstrate via a case study how modeling a sensor can improve
its efficacy when employed within a Bayesian inferential framework. As a test
bed we employ a robotic arm that is designed to autonomously take its own
measurements using an inexpensive LEGO light sensor to estimate the position
and radius of a white circle on a black field. The light sensor integrates the
light arriving from a spatially distributed region within its field of view
weighted by its Spatial Sensitivity Function (SSF). We demonstrate that by
incorporating an accurate model of the light sensor SSF into the likelihood
function of a Bayesian inference engine, an autonomous system can make improved
inferences about its surroundings. The method presented here is data-based,
fairly general, and made with plug-and play in mind so that it could be
implemented in similar problems.