Normalized to: Donaldson, T.
[1]
oai:arXiv.org:1806.08866 [pdf] - 1704567
A Study of the Efficiency of Spatial Indexing Methods Applied to Large
Astronomical Databases
Submitted: 2018-06-22
We report the results of a study to compare the performance of two common
database indexing methods, HTM and HEALPix, on Solaris and Windows database
servers installed with PostgreSQL, and a Windows Server installed with MS SQL
Server. The indexing was applied to the 2MASS All-Sky Catalog and to the Hubble
Source Catalog, which approximate the diversity of catalogs common in
astronomy. On each server, the study compared indexing performance by
submitting 1 million queries at each index level with random sky positions and
random cone search radius, which was computed on a logarithmic scale between 1
arcsec and 1 degree, and measuring the time to complete the query and write the
output. These simulated queries, intended to model realistic use patterns, were
run in a uniform way on many combinations of indexing method and indexing
depth. The query times in all simulations are strongly I/O-bound and are linear
with number of records returned for large numbers of sources. There are,
however, considerable differences between simulations, which reveal that
hardware I/O throughput is a more important factor in managing the performance
of a DBMS than the choice of indexing scheme. The choice of index itself is
relatively unimportant: for comparable index levels, the performance is
consistent within the scatter of the timings. At small index levels (large
cells; e.g. level 4; cell size 3.7 deg), there is large scatter in the timings
because of wide variations in the number of sources found in the cells. At
larger index levels, performance improves and scatter decreases, but the
improvement at level 8 (14 arcmin) and higher is masked to some extent in the
timing scatter caused by the range of query sizes. At very high levels (20;
0.0004 arsec), the granularity of the cells becomes so high that a large number
of extraneous empty cells begin to degrade performance.
[2]
oai:arXiv.org:1708.09704 [pdf] - 1886369
IVOA Recommendation: HiPS - Hierarchical Progressive Survey
Submitted: 2017-08-31
This document presents HiPS, a hierarchical scheme for the description,
storage and access of sky survey data. The system is based on hierarchical
tiling of sky regions at finer and finer spatial resolution which facilitates a
progressive view of a survey, and supports multi-resolution zooming and
panning. HiPS uses the HEALPix tessellation of the sky as the basis for the
scheme and is implemented as a simple file structure with a direct indexing
scheme that leads to practical implementations.
[3]
oai:arXiv.org:1602.04861 [pdf] - 1411325
Version 1 of the Hubble Source Catalog
Whitmore, Bradley C.;
Allam, Sahar S.;
Budavari, Tamas;
Casertano, Stefano;
Downes, Ronald A.;
Donaldson, Thomas;
Fall, S. Michael;
Lubow, Stephen H.;
Quick, Lee;
Strolger, Louis-Gregory;
Wallace, Geoff;
White, Richard L.
Submitted: 2016-02-15
The Hubble Source Catalog is designed to help optimize science from the
Hubble Space Telescope by combining the tens of thousands of visit-based source
lists in the Hubble Legacy Archive into a single master catalog. Version 1 of
the Hubble Source Catalog includes WFPC2, ACS/WFC, WFC3/UVIS, and WFC3/IR
photometric data generated using SExtractor software to produce the individual
source lists. The catalog includes roughly 80 million detections of 30 million
objects involving 112 different detector/filter combinations, and about 160
thousand HST exposures. Source lists from Data Release 8 of the Hubble Legacy
Archive are matched using an algorithm developed by Budavari & Lubow (2012).
The mean photometric accuracy for the catalog as a whole is better than 0.10
mag, with relative accuracy as good as 0.02 mag in certain circumstances (e.g.,
bright isolated stars). The relative astrometric residuals are typically within
10 mas, with a value for the mode (i.e., most common value) of 2.3 mas. The
absolute astrometric accuracy is better than $\sim$0.1 arcsec for most sources,
but can be much larger for a fraction of fields that could not be matched to
the PanSTARRS, SDSS, or 2MASS reference systems. In this paper we describe the
database design with emphasis on those aspects that enable the users to fully
exploit the catalog while avoiding common misunderstandings and potential
pitfalls. We provide usage examples to illustrate some of the science
capabilities and data quality characteristics, and briefly discuss plans for
future improvements to the Hubble Source Catalog.
[4]
oai:arXiv.org:1505.02937 [pdf] - 1886358
MOC - HEALPix Multi-Order Coverage map Version 1.0
Submitted: 2015-05-12
This document describes the Multi-Order Coverage map method (MOC) to specify
arbitrary sky regions. The goal is to be able to provide a very fast comparison
mechanism between coverage maps. The mechanism is based on the HEALPix sky
tessellation algorithm. It is essentially a simple way to map regions of the
sky into hierarchically grouped predefined cells.