Normalized to: Tomashek, T.
[1]
oai:arXiv.org:1207.3189 [pdf] - 1124813
The Dark Energy Survey Data Processing and Calibration System
Mohr, Joseph J.;
Armstrong, Robert;
Bertin, Emmanuel;
Daues, Gregory E.;
Desai, Shantanu;
Gower, Michelle;
Gruendl, Robert;
Hanlon, William;
Kuropatkin, Nikolay;
Lin, Huan;
Marriner, John;
Petravick, Don;
Sevilla, Ignacio;
Swanson, Molly;
Tomashek, Todd;
Tucker, Douglas;
Yanny, Brian;
Collaboration, the Dark Energy Survey
Submitted: 2012-07-13
The Dark Energy Survey (DES) is a 5000 deg2 grizY survey reaching
characteristic photometric depths of 24th magnitude (10 sigma) and enabling
accurate photometry and morphology of objects ten times fainter than in SDSS.
Preparations for DES have included building a dedicated 3 deg2 CCD camera
(DECam), upgrading the existing CTIO Blanco 4m telescope and developing a new
high performance computing (HPC) enabled data management system (DESDM).
The DESDM system will be used for processing, calibrating and serving the DES
data. The total data volumes are high (~2PB), and so considerable effort has
gone into designing an automated processing and quality control system. Special
purpose image detrending and photometric calibration codes have been developed
to meet the data quality requirements, while survey astrometric calibration,
coaddition and cataloging rely on new extensions of the AstrOmatic codes which
now include tools for PSF modeling, PSF homogenization, PSF corrected model
fitting cataloging and joint model fitting across multiple input images.
The DESDM system has been deployed on dedicated development clusters and HPC
systems in the US and Germany. An extensive program of testing with small rapid
turn-around and larger campaign simulated datasets has been carried out. The
system has also been tested on large real datasets, including Blanco Cosmology
Survey data from the Mosaic2 camera. In Fall 2012 the DESDM system will be used
for DECam commissioning, and, thereafter, the system will go into full science
operations.
[2]
oai:arXiv.org:1109.6741 [pdf] - 1934642
The Dark Energy Survey Data Management System
Sevilla, I.;
Armstrong, R.;
Bertin, E.;
Carlson, A.;
Daues, G.;
Desai, S.;
Gower, M.;
Gruendl, R.;
Hanlon, W.;
Jarvis, M.;
Kessler, R.;
Kuropatkin, N.;
Lin, H.;
Marriner, J.;
Mohr, J.;
Petravick, D.;
Sheldon, E.;
Swanson, M. E. C.;
Tomashek, T.;
Tucker, D.;
Yang, Y.;
Yanny, B.
Submitted: 2011-09-30
The Dark Energy Survey (DES) is a project with the goal of building,
installing and exploiting a new 74 CCD-camera at the Blanco telescope, in order
to study the nature of cosmic acceleration. It will cover 5000 square degrees
of the southern hemisphere sky and will record the positions and shapes of 300
million galaxies up to redshift 1.4. The survey will be completed using 525
nights during a 5-year period starting in 2012. About O(1 TB) of raw data will
be produced every night, including science and calibration images. The DES data
management system has been designed for the processing, calibration and
archiving of these data. It is being developed by collaborating DES
institutions, led by NCSA. In this contribution, we describe the basic
functions of the system, what kind of scientific codes are involved and how the
Data Challenge process works, to improve simultaneously the Data Management
system algorithms and the Science Working Group analysis codes.