Normalized to: Pederson, S.
[1]
oai:arXiv.org:1602.06888 [pdf] - 1516256
The Matsu Wheel: A Cloud-based Framework for Efficient Analysis and
Reanalysis of Earth Satellite Imagery
Patterson, Maria T;
Anderson, Nikolas;
Bennett, Collin;
Bruggemann, Jacob;
Grossman, Robert;
Handy, Matthew;
Ly, Vuong;
Mandl, Dan;
Pederson, Shane;
Pivarski, Jim;
Powell, Ray;
Spring, Jonathan;
Wells, Walt
Submitted: 2016-02-22
Project Matsu is a collaboration between the Open Commons Consortium and NASA
focused on developing open source technology for the cloud-based processing of
Earth satellite imagery. A particular focus is the development of applications
for detecting fires and floods to help support natural disaster detection and
relief. Project Matsu has developed an open source cloud-based infrastructure
to process, analyze, and reanalyze large collections of hyperspectral satellite
image data using OpenStack, Hadoop, MapReduce, Storm and related technologies.
We describe a framework for efficient analysis of large amounts of data
called the Matsu "Wheel." The Matsu Wheel is currently used to process incoming
hyperspectral satellite data produced daily by NASA's Earth Observing-1 (EO-1)
satellite. The framework is designed to be able to support scanning queries
using cloud computing applications, such as Hadoop and Accumulo. A scanning
query processes all, or most of the data, in a database or data repository.
We also describe our preliminary Wheel analytics, including an anomaly
detector for rare spectral signatures or thermal anomalies in hyperspectral
data and a land cover classifier that can be used for water and flood
detection. Each of these analytics can generate visual reports accessible via
the web for the public and interested decision makers. The resultant products
of the analytics are also made accessible through an Open Geospatial Compliant
(OGC)-compliant Web Map Service (WMS) for further distribution. The Matsu Wheel
allows many shared data services to be performed together to efficiently use
resources for processing hyperspectral satellite image data and other, e.g.,
large environmental datasets that may be analyzed for many purposes.