Normalized to: Pesenson, M.
[1]
oai:arXiv.org:1003.0879 [pdf] - 1025519
The Data Big Bang and the Expanding Digital Universe: High-Dimensional,
Complex and Massive Data Sets in an Inflationary Epoch
Submitted: 2010-03-03
Recent and forthcoming advances in instrumentation, and giant new surveys,
are creating astronomical data sets that are not amenable to the methods of
analysis familiar to astronomers. Traditional methods are often inadequate not
merely because of the size in bytes of the data sets, but also because of the
complexity of modern data sets. Mathematical limitations of familiar algorithms
and techniques in dealing with such data sets create a critical need for new
paradigms for the representation, analysis and scientific visualization (as
opposed to illustrative visualization) of heterogeneous, multiresolution data
across application domains. Some of the problems presented by the new data sets
have been addressed by other disciplines such as applied mathematics,
statistics and machine learning and have been utilized by other sciences such
as space-based geosciences. Unfortunately, valuable results pertaining to these
problems are mostly to be found only in publications outside of astronomy. Here
we offer brief overviews of a number of concepts, techniques and developments,
some "old" and some new. These are generally unknown to most of the
astronomical community, but are vital to the analysis and visualization of
complex datasets and images. In order for astronomers to take advantage of the
richness and complexity of the new era of data, and to be able to identify,
adopt, and apply new solutions, the astronomical community needs a certain
degree of awareness and understanding of the new concepts. One of the goals of
this paper is to help bridge the gap between applied mathematics, artificial
intelligence and computer science on the one side and astronomy on the other.
[2]
oai:arXiv.org:astro-ph/0509649 [pdf] - 1468866
Spitzer 70 and 160-micron Observations of the Extragalactic First Look
Survey
Frayer, D. T.;
Fadda, D.;
Yan, L.;
Marleau, F. R.;
Choi, P. I.;
Helou, G.;
Soifer, B. T.;
Appleton, P. N.;
Armus, L.;
Beck, R.;
Dole, H.;
Engelbracht, C. W.;
Fang, F.;
Gordon, K. D.;
Heinrichsen, I.;
Henderson, D.;
Hesselroth, T.;
Im, M.;
Kelly, D. M.;
Lacy, M.;
Laine, S.;
Latter, W. B.;
Mahoney, W.;
Makovoz, D.;
Masci, F. J.;
Morrison, J. E.;
Moshir, M.;
Noriega-Crespo, A.;
Padgett, D. L.;
Pesenson, M.;
Shupe, D. L.;
Squires, G. K.;
Storrie-Lombardi, L. J.;
Surace, J. A.;
Teplitz, H. I.;
Wilson, G.
Submitted: 2005-09-21
We present Spitzer 70um and 160um observations of the Spitzer extragalactic
First Look Survey (xFLS). The data reduction techniques and the methods for
producing co-added mosaics and source catalogs are discussed. Currently, 26% of
the 70um sample and 49% of the 160um-selected sources have redshifts. The
majority of sources with redshifts are star-forming galaxies at z<0.5, while
about 5% have infrared colors consistent with AGN. The observed infrared colors
agree with the spectral energy distribution (SEDs) of local galaxies previously
determined from IRAS and ISO data. The average 160um/70um color temperature for
the dust is Td~= 30+/-5 K, and the average 70um/24um spectral index is alpha~=
2.4+/-0.4. The observed infrared to radio correlation varies with redshift as
expected out to z~1 based on the SEDs of local galaxies. The xFLS number counts
at 70um and 160um are consistent within uncertainties with the models of galaxy
evolution, but there are indications that the current models may require slight
modifications. Deeper 70um observations are needed to constrain the models, and
redshifts for the faint sources are required to measure the evolution of the
infrared luminosity function.