Normalized to: Daues, G.
[1]
oai:arXiv.org:1801.03181 [pdf] - 1871376
The Dark Energy Survey Data Release 1
Abbott, T. M. C.;
Abdalla, F. B.;
Allam, S.;
Amara, A.;
Annis, J.;
Asorey, J.;
Avila, S.;
Ballester, O.;
Banerji, M.;
Barkhouse, W.;
Baruah, L.;
Baumer, M.;
Bechtol, K.;
Becker, M . R.;
Benoit-Lévy, A.;
Bernstein, G. M.;
Bertin, E.;
Blazek, J.;
Bocquet, S.;
Brooks, D.;
Brout, D.;
Buckley-Geer, E.;
Burke, D. L.;
Busti, V.;
Campisano, R.;
Cardiel-Sas, L.;
Rosell, A. C arnero;
Kind, M. Carrasco;
Carretero, J.;
Castander, F. J.;
Cawthon, R.;
Chang, C.;
Chen, X.;
Conselice, C.;
Costa, G.;
Crocce, M.;
Cunha, C. E.;
D'Andrea, C. B.;
da Costa, L. N.;
Das, R.;
Daues, G.;
Davis, T. M.;
Davis, C.;
De Vicente, J.;
DePoy, D. L.;
DeRose, J.;
Desai, S.;
Diehl, H. T.;
Dietrich, J. P.;
Dodelson, S.;
Doel, P.;
Drlica-Wagner, A.;
Eifler, T. F.;
Elliott, A. E.;
Evrard, A. E.;
Farahi, A.;
Neto, A. Fausti;
Fernandez, E.;
Finley, D. A.;
Fitzpatrick, M.;
Flaugher, B.;
Foley, R. J.;
Fosalba, P.;
Friedel, D. N.;
Frieman, J.;
García-Bellido, J.;
tanaga, E. Gaz;
Gerdes, D. W.;
Giannantonio, T.;
Gill, M. S. S.;
Glazebrook, K.;
Goldstein, D. A.;
Gower, M.;
Gruen, D.;
Gruendl, R. A.;
Gschwend, J.;
Gupta, R. R.;
Gutierrez, G.;
Hamilton, S.;
Hartley, W. G.;
Hinton, S. R.;
Hislop, J. M.;
Hollowood, D.;
Honscheid, K.;
Hoyle, B.;
Huterer, D.;
Jain, B.;
James, D. J.;
Jeltema, T.;
Johnson, M. W. G.;
Johnson, M. D.;
Juneau, S.;
Kacprzak, T.;
Kent, S.;
Khullar, G.;
Klein, M.;
Kovacs, A.;
Koziol, A. M. G.;
Krause, E.;
Kremin, A.;
Kron, R.;
Kuehn, K.;
Kuhlmann, S.;
Kuropatkin, N.;
Lahav, O.;
Lasker, J.;
Li, T. S.;
Li, R. T.;
Liddle, A. R.;
Lima, M.;
Lin, H.;
López-Reyes, P.;
MacCrann, N.;
Maia, M. A. G.;
Maloney, J. D.;
Manera, M.;
March, M.;
Marriner, J.;
Marshall, J. L.;
Martini, P.;
McClintock, T.;
McKay, T.;
McMahon, R . G.;
Melchior, P.;
Menanteau, F.;
Miller, C. J.;
Miquel, R.;
Mohr, J. J.;
Morganson, E.;
Mould, J.;
Neilsen, E.;
Nichol, R. C.;
Nidever, D.;
Nikutta, R.;
Nogueira, F.;
Nord, B.;
Nugent, P.;
Nunes, L.;
Ogando, R. L. C.;
Old, L.;
Olsen, K.;
Pace, A. B.;
Palmese, A.;
Paz-Chinchón, F.;
Peiris, H. V.;
Percival, W. J.;
Petravick, D.;
Plazas, A. A.;
Poh, J.;
Pond, C.;
redon, A. Por;
Pujol, A.;
Refregier, A.;
Reil, K.;
Ricker, P. M.;
Rollins, R. P.;
Romer, A. K.;
Roodman, A.;
Rooney, P.;
Ross, A. J.;
Rykoff, E. S.;
Sako, M.;
Sanchez, E.;
Sanchez, M. L.;
Santiago, B.;
Saro, A.;
Scarpine, V.;
Scolnic, D.;
Scott, A.;
Serrano, S.;
Sevilla-Noarbe, I.;
Sheldon, E.;
Shipp, N.;
Silveira, M. L.;
Smith, R. C.;
Smith, J. A.;
Smith, M.;
Soares-Santos, M.;
ira, F. Sobre;
Song, J.;
Stebbins, A.;
Suchyta, E.;
Sullivan, M.;
Swanson, M. E. C.;
Tarle, G.;
Thaler, J.;
Thomas, D.;
Thomas, R. C.;
Troxel, M. A.;
Tucker, D. L.;
Vikram, V.;
Vivas, A. K.;
ker, A. R. Wal;
Wechsler, R. H.;
Weller, J.;
Wester, W.;
Wolf, R. C.;
Wu, H.;
Yanny, B.;
Zenteno, A.;
Zhang, Y.;
Zuntz, J.
Submitted: 2018-01-09, last modified: 2019-04-23
We describe the first public data release of the Dark Energy Survey, DES DR1,
consisting of reduced single epoch images, coadded images, coadded source
catalogs, and associated products and services assembled over the first three
years of DES science operations. DES DR1 is based on optical/near-infrared
imaging from 345 distinct nights (August 2013 to February 2016) by the Dark
Energy Camera mounted on the 4-m Blanco telescope at Cerro Tololo
Inter-American Observatory in Chile. We release data from the DES wide-area
survey covering ~5,000 sq. deg. of the southern Galactic cap in five broad
photometric bands, grizY. DES DR1 has a median delivered point-spread function
of g = 1.12, r = 0.96, i = 0.88, z = 0.84, and Y = 0.90 arcsec FWHM, a
photometric precision of < 1% in all bands, and an astrometric precision of 151
mas. The median coadded catalog depth for a 1.95" diameter aperture at S/N = 10
is g = 24.33, r = 24.08, i = 23.44, z = 22.69, and Y = 21.44 mag. DES DR1
includes nearly 400M distinct astronomical objects detected in ~10,000 coadd
tiles of size 0.534 sq. deg. produced from ~39,000 individual exposures.
Benchmark galaxy and stellar samples contain ~310M and ~ 80M objects,
respectively, following a basic object quality selection. These data are
accessible through a range of interfaces, including query web clients, image
cutout servers, jupyter notebooks, and an interactive coadd image visualization
tool. DES DR1 constitutes the largest photometric data set to date at the
achieved depth and photometric precision.
[2]
oai:arXiv.org:0805.2366 [pdf] - 1934226
LSST: from Science Drivers to Reference Design and Anticipated Data
Products
Ivezić, Željko;
Kahn, Steven M.;
Tyson, J. Anthony;
Abel, Bob;
Acosta, Emily;
Allsman, Robyn;
Alonso, David;
AlSayyad, Yusra;
Anderson, Scott F.;
Andrew, John;
Angel, James Roger P.;
Angeli, George Z.;
Ansari, Reza;
Antilogus, Pierre;
Araujo, Constanza;
Armstrong, Robert;
Arndt, Kirk T.;
Astier, Pierre;
Aubourg, Éric;
Auza, Nicole;
Axelrod, Tim S.;
Bard, Deborah J.;
Barr, Jeff D.;
Barrau, Aurelian;
Bartlett, James G.;
Bauer, Amanda E.;
Bauman, Brian J.;
Baumont, Sylvain;
Becker, Andrew C.;
Becla, Jacek;
Beldica, Cristina;
Bellavia, Steve;
Bianco, Federica B.;
Biswas, Rahul;
Blanc, Guillaume;
Blazek, Jonathan;
Blandford, Roger D.;
Bloom, Josh S.;
Bogart, Joanne;
Bond, Tim W.;
Borgland, Anders W.;
Borne, Kirk;
Bosch, James F.;
Boutigny, Dominique;
Brackett, Craig A.;
Bradshaw, Andrew;
Brandt, William Nielsen;
Brown, Michael E.;
Bullock, James S.;
Burchat, Patricia;
Burke, David L.;
Cagnoli, Gianpietro;
Calabrese, Daniel;
Callahan, Shawn;
Callen, Alice L.;
Chandrasekharan, Srinivasan;
Charles-Emerson, Glenaver;
Chesley, Steve;
Cheu, Elliott C.;
Chiang, Hsin-Fang;
Chiang, James;
Chirino, Carol;
Chow, Derek;
Ciardi, David R.;
Claver, Charles F.;
Cohen-Tanugi, Johann;
Cockrum, Joseph J.;
Coles, Rebecca;
Connolly, Andrew J.;
Cook, Kem H.;
Cooray, Asantha;
Covey, Kevin R.;
Cribbs, Chris;
Cui, Wei;
Cutri, Roc;
Daly, Philip N.;
Daniel, Scott F.;
Daruich, Felipe;
Daubard, Guillaume;
Daues, Greg;
Dawson, William;
Delgado, Francisco;
Dellapenna, Alfred;
de Peyster, Robert;
de Val-Borro, Miguel;
Digel, Seth W.;
Doherty, Peter;
Dubois, Richard;
Dubois-Felsmann, Gregory P.;
Durech, Josef;
Economou, Frossie;
Eracleous, Michael;
Ferguson, Henry;
Figueroa, Enrique;
Fisher-Levine, Merlin;
Focke, Warren;
Foss, Michael D.;
Frank, James;
Freemon, Michael D.;
Gangler, Emmanuel;
Gawiser, Eric;
Geary, John C.;
Gee, Perry;
Geha, Marla;
Gessner, Charles J. B.;
Gibson, Robert R.;
Gilmore, D. Kirk;
Glanzman, Thomas;
Glick, William;
Goldina, Tatiana;
Goldstein, Daniel A.;
Goodenow, Iain;
Graham, Melissa L.;
Gressler, William J.;
Gris, Philippe;
Guy, Leanne P.;
Guyonnet, Augustin;
Haller, Gunther;
Harris, Ron;
Hascall, Patrick A.;
Haupt, Justine;
Hernandez, Fabio;
Herrmann, Sven;
Hileman, Edward;
Hoblitt, Joshua;
Hodgson, John A.;
Hogan, Craig;
Huang, Dajun;
Huffer, Michael E.;
Ingraham, Patrick;
Innes, Walter R.;
Jacoby, Suzanne H.;
Jain, Bhuvnesh;
Jammes, Fabrice;
Jee, James;
Jenness, Tim;
Jernigan, Garrett;
Jevremović, Darko;
Johns, Kenneth;
Johnson, Anthony S.;
Johnson, Margaret W. G.;
Jones, R. Lynne;
Juramy-Gilles, Claire;
Jurić, Mario;
Kalirai, Jason S.;
Kallivayalil, Nitya J.;
Kalmbach, Bryce;
Kantor, Jeffrey P.;
Karst, Pierre;
Kasliwal, Mansi M.;
Kelly, Heather;
Kessler, Richard;
Kinnison, Veronica;
Kirkby, David;
Knox, Lloyd;
Kotov, Ivan V.;
Krabbendam, Victor L.;
Krughoff, K. Simon;
Kubánek, Petr;
Kuczewski, John;
Kulkarni, Shri;
Ku, John;
Kurita, Nadine R.;
Lage, Craig S.;
Lambert, Ron;
Lange, Travis;
Langton, J. Brian;
Guillou, Laurent Le;
Levine, Deborah;
Liang, Ming;
Lim, Kian-Tat;
Lintott, Chris J.;
Long, Kevin E.;
Lopez, Margaux;
Lotz, Paul J.;
Lupton, Robert H.;
Lust, Nate B.;
MacArthur, Lauren A.;
Mahabal, Ashish;
Mandelbaum, Rachel;
Marsh, Darren S.;
Marshall, Philip J.;
Marshall, Stuart;
May, Morgan;
McKercher, Robert;
McQueen, Michelle;
Meyers, Joshua;
Migliore, Myriam;
Miller, Michelle;
Mills, David J.;
Miraval, Connor;
Moeyens, Joachim;
Monet, David G.;
Moniez, Marc;
Monkewitz, Serge;
Montgomery, Christopher;
Mueller, Fritz;
Muller, Gary P.;
Arancibia, Freddy Muñoz;
Neill, Douglas R.;
Newbry, Scott P.;
Nief, Jean-Yves;
Nomerotski, Andrei;
Nordby, Martin;
O'Connor, Paul;
Oliver, John;
Olivier, Scot S.;
Olsen, Knut;
O'Mullane, William;
Ortiz, Sandra;
Osier, Shawn;
Owen, Russell E.;
Pain, Reynald;
Palecek, Paul E.;
Parejko, John K.;
Parsons, James B.;
Pease, Nathan M.;
Peterson, J. Matt;
Peterson, John R.;
Petravick, Donald L.;
Petrick, M. E. Libby;
Petry, Cathy E.;
Pierfederici, Francesco;
Pietrowicz, Stephen;
Pike, Rob;
Pinto, Philip A.;
Plante, Raymond;
Plate, Stephen;
Price, Paul A.;
Prouza, Michael;
Radeka, Veljko;
Rajagopal, Jayadev;
Rasmussen, Andrew P.;
Regnault, Nicolas;
Reil, Kevin A.;
Reiss, David J.;
Reuter, Michael A.;
Ridgway, Stephen T.;
Riot, Vincent J.;
Ritz, Steve;
Robinson, Sean;
Roby, William;
Roodman, Aaron;
Rosing, Wayne;
Roucelle, Cecille;
Rumore, Matthew R.;
Russo, Stefano;
Saha, Abhijit;
Sassolas, Benoit;
Schalk, Terry L.;
Schellart, Pim;
Schindler, Rafe H.;
Schmidt, Samuel;
Schneider, Donald P.;
Schneider, Michael D.;
Schoening, William;
Schumacher, German;
Schwamb, Megan E.;
Sebag, Jacques;
Selvy, Brian;
Sembroski, Glenn H.;
Seppala, Lynn G.;
Serio, Andrew;
Serrano, Eduardo;
Shaw, Richard A.;
Shipsey, Ian;
Sick, Jonathan;
Silvestri, Nicole;
Slater, Colin T.;
Smith, J. Allyn;
Smith, R. Chris;
Sobhani, Shahram;
Soldahl, Christine;
Storrie-Lombardi, Lisa;
Stover, Edward;
Strauss, Michael A.;
Street, Rachel A.;
Stubbs, Christopher W.;
Sullivan, Ian S.;
Sweeney, Donald;
Swinbank, John D.;
Szalay, Alexander;
Takacs, Peter;
Tether, Stephen A.;
Thaler, Jon J.;
Thayer, John Gregg;
Thomas, Sandrine;
Thukral, Vaikunth;
Tice, Jeffrey;
Trilling, David E.;
Turri, Max;
Van Berg, Richard;
Berk, Daniel Vanden;
Vetter, Kurt;
Virieux, Francoise;
Vucina, Tomislav;
Wahl, William;
Walkowicz, Lucianne;
Walsh, Brian;
Walter, Christopher W.;
Wang, Daniel L.;
Wang, Shin-Yawn;
Warner, Michael;
Wiecha, Oliver;
Willman, Beth;
Winters, Scott E.;
Wittman, David;
Wolff, Sidney C.;
Wood-Vasey, W. Michael;
Wu, Xiuqin;
Xin, Bo;
Yoachim, Peter;
Zhan, Hu
Submitted: 2008-05-15, last modified: 2018-05-23
(Abridged) We describe here the most ambitious survey currently planned in
the optical, the Large Synoptic Survey Telescope (LSST). A vast array of
science will be enabled by a single wide-deep-fast sky survey, and LSST will
have unique survey capability in the faint time domain. The LSST design is
driven by four main science themes: probing dark energy and dark matter, taking
an inventory of the Solar System, exploring the transient optical sky, and
mapping the Milky Way. LSST will be a wide-field ground-based system sited at
Cerro Pach\'{o}n in northern Chile. The telescope will have an 8.4 m (6.5 m
effective) primary mirror, a 9.6 deg$^2$ field of view, and a 3.2 Gigapixel
camera. The standard observing sequence will consist of pairs of 15-second
exposures in a given field, with two such visits in each pointing in a given
night. With these repeats, the LSST system is capable of imaging about 10,000
square degrees of sky in a single filter in three nights. The typical 5$\sigma$
point-source depth in a single visit in $r$ will be $\sim 24.5$ (AB). The
project is in the construction phase and will begin regular survey operations
by 2022. The survey area will be contained within 30,000 deg$^2$ with
$\delta<+34.5^\circ$, and will be imaged multiple times in six bands, $ugrizy$,
covering the wavelength range 320--1050 nm. About 90\% of the observing time
will be devoted to a deep-wide-fast survey mode which will uniformly observe a
18,000 deg$^2$ region about 800 times (summed over all six bands) during the
anticipated 10 years of operations, and yield a coadded map to $r\sim27.5$. The
remaining 10\% of the observing time will be allocated to projects such as a
Very Deep and Fast time domain survey. The goal is to make LSST data products,
including a relational database of about 32 trillion observations of 40 billion
objects, available to the public and scientists around the world.
[3]
oai:arXiv.org:1801.03177 [pdf] - 1686715
The Dark Energy Survey Image Processing Pipeline
Morganson, E.;
Gruendl, R. A.;
Menanteau, F.;
Kind, M. Carrasco;
Chen, Y. -C.;
Daues, G.;
Drlica-Wagner, A.;
Friedel, D. N.;
Gower, M.;
Johnson, M. W. G.;
Johnson, M. D.;
Kessler, R.;
Paz-Chinchón, F.;
Petravick, D.;
Pond, C.;
Yanny, B.;
Allam, S.;
Armstrong, R.;
Barkhouse, W.;
Bechtol, K.;
Benoit-Lévy, A.;
Bernstein, G. M.;
Bertin, E.;
Buckley-Geer, E.;
Covarrubias, R.;
Desai, S.;
Diehl, H. T.;
Goldstein, D. A.;
Gruen, D.;
Li, T. S.;
Lin, H.;
Marriner, J.;
Mohr, J. J.;
Neilsen, E.;
Ngeow, C. -C.;
Paech, K.;
Rykoff, E. S.;
Sako, M.;
Sevilla-Noarbe, I.;
Sheldon, E.;
Sobreira, F.;
Tucker, D. L.;
Wester, W.
Submitted: 2018-01-09
The Dark Energy Survey (DES) is a five-year optical imaging campaign with the
goal of understanding the origin of cosmic acceleration. DES performs a 5000
square degree survey of the southern sky in five optical bands (g,r,i,z,Y) to a
depth of ~24th magnitude. Contemporaneously, DES performs a deep, time-domain
survey in four optical bands (g,r,i,z) over 27 square degrees. DES exposures
are processed nightly with an evolving data reduction pipeline and evaluated
for image quality to determine if they need to be retaken. Difference imaging
and transient source detection are also performed in the time domain component
nightly. On a bi-annual basis, DES exposures are reprocessed with a refined
pipeline and coadded to maximize imaging depth. Here we describe the DES image
processing pipeline in support of DES science, as a reference for users of
archival DES data, and as a guide for future astronomical surveys.
[4]
oai:arXiv.org:1512.07914 [pdf] - 1938162
The LSST Data Management System
Jurić, Mario;
Kantor, Jeffrey;
Lim, K-T;
Lupton, Robert H.;
Dubois-Felsmann, Gregory;
Jenness, Tim;
Axelrod, Tim S.;
Aleksić, Jovan;
Allsman, Roberta A.;
AlSayyad, Yusra;
Alt, Jason;
Armstrong, Robert;
Basney, Jim;
Becker, Andrew C.;
Becla, Jacek;
Bickerton, Steven J.;
Biswas, Rahul;
Bosch, James;
Boutigny, Dominique;
Kind, Matias Carrasco;
Ciardi, David R.;
Connolly, Andrew J.;
Daniel, Scott F.;
Daues, Gregory E.;
Economou, Frossie;
Chiang, Hsin-Fang;
Fausti, Angelo;
Fisher-Levine, Merlin;
Freemon, D. Michael;
Gee, Perry;
Gris, Philippe;
Hernandez, Fabio;
Hoblitt, Joshua;
Ivezić, Željko;
Jammes, Fabrice;
Jevremović, Darko;
Jones, R. Lynne;
Kalmbach, J. Bryce;
Kasliwal, Vishal P.;
Krughoff, K. Simon;
Lang, Dustin;
Lurie, John;
Lust, Nate B.;
Mullally, Fergal;
MacArthur, Lauren A.;
Melchior, Peter;
Moeyens, Joachim;
Nidever, David L.;
Owen, Russell;
Parejko, John K;
Peterson, J. Matt;
Petravick, Donald;
Pietrowicz, Stephen R.;
Price, Paul A.;
Reiss, David J.;
Shaw, Richard A.;
Sick, Jonathan;
Slater, Colin T.;
Strauss, Michael A.;
Sullivan, Ian S.;
Swinbank, John D.;
Van Dyk, Schuyler;
Vujčić, Veljko;
Withers, Alexander;
Yoachim, Peter
Submitted: 2015-12-24
The Large Synoptic Survey Telescope (LSST) is a large-aperture, wide-field,
ground-based survey system that will image the sky in six optical bands from
320 to 1050 nm, uniformly covering approximately $18,000$deg$^2$ of the sky
over 800 times. The LSST is currently under construction on Cerro Pach\'on in
Chile, and expected to enter operations in 2022. Once operational, the LSST
will explore a wide range of astrophysical questions, from discovering "killer"
asteroids to examining the nature of Dark Energy.
The LSST will generate on average 15 TB of data per night, and will require a
comprehensive Data Management system to reduce the raw data to scientifically
useful catalogs and images with minimum human intervention. These reductions
will result in a real-time alert stream, and eleven data releases over the
10-year duration of LSST operations. To enable this processing, the LSST
project is developing a new, general-purpose, high-performance, scalable, well
documented, open source data processing software stack for O/IR surveys.
Prototypes of this stack are already capable of processing data from existing
cameras (e.g., SDSS, DECam, MegaCam), and form the basis of the Hyper-Suprime
Cam (HSC) Survey data reduction pipeline.
[5]
oai:arXiv.org:1207.3189 [pdf] - 1124813
The Dark Energy Survey Data Processing and Calibration System
Mohr, Joseph J.;
Armstrong, Robert;
Bertin, Emmanuel;
Daues, Gregory E.;
Desai, Shantanu;
Gower, Michelle;
Gruendl, Robert;
Hanlon, William;
Kuropatkin, Nikolay;
Lin, Huan;
Marriner, John;
Petravick, Don;
Sevilla, Ignacio;
Swanson, Molly;
Tomashek, Todd;
Tucker, Douglas;
Yanny, Brian;
Collaboration, the Dark Energy Survey
Submitted: 2012-07-13
The Dark Energy Survey (DES) is a 5000 deg2 grizY survey reaching
characteristic photometric depths of 24th magnitude (10 sigma) and enabling
accurate photometry and morphology of objects ten times fainter than in SDSS.
Preparations for DES have included building a dedicated 3 deg2 CCD camera
(DECam), upgrading the existing CTIO Blanco 4m telescope and developing a new
high performance computing (HPC) enabled data management system (DESDM).
The DESDM system will be used for processing, calibrating and serving the DES
data. The total data volumes are high (~2PB), and so considerable effort has
gone into designing an automated processing and quality control system. Special
purpose image detrending and photometric calibration codes have been developed
to meet the data quality requirements, while survey astrometric calibration,
coaddition and cataloging rely on new extensions of the AstrOmatic codes which
now include tools for PSF modeling, PSF homogenization, PSF corrected model
fitting cataloging and joint model fitting across multiple input images.
The DESDM system has been deployed on dedicated development clusters and HPC
systems in the US and Germany. An extensive program of testing with small rapid
turn-around and larger campaign simulated datasets has been carried out. The
system has also been tested on large real datasets, including Blanco Cosmology
Survey data from the Mosaic2 camera. In Fall 2012 the DESDM system will be used
for DECam commissioning, and, thereafter, the system will go into full science
operations.
[6]
oai:arXiv.org:1109.6741 [pdf] - 1934642
The Dark Energy Survey Data Management System
Sevilla, I.;
Armstrong, R.;
Bertin, E.;
Carlson, A.;
Daues, G.;
Desai, S.;
Gower, M.;
Gruendl, R.;
Hanlon, W.;
Jarvis, M.;
Kessler, R.;
Kuropatkin, N.;
Lin, H.;
Marriner, J.;
Mohr, J.;
Petravick, D.;
Sheldon, E.;
Swanson, M. E. C.;
Tomashek, T.;
Tucker, D.;
Yang, Y.;
Yanny, B.
Submitted: 2011-09-30
The Dark Energy Survey (DES) is a project with the goal of building,
installing and exploiting a new 74 CCD-camera at the Blanco telescope, in order
to study the nature of cosmic acceleration. It will cover 5000 square degrees
of the southern hemisphere sky and will record the positions and shapes of 300
million galaxies up to redshift 1.4. The survey will be completed using 525
nights during a 5-year period starting in 2012. About O(1 TB) of raw data will
be produced every night, including science and calibration images. The DES data
management system has been designed for the processing, calibration and
archiving of these data. It is being developed by collaborating DES
institutions, led by NCSA. In this contribution, we describe the basic
functions of the system, what kind of scientific codes are involved and how the
Data Challenge process works, to improve simultaneously the Data Management
system algorithms and the Science Working Group analysis codes.
[7]
oai:arXiv.org:0905.0659 [pdf] - 23956
The Dark Energy Survey Data Management System: The Processing Framework
Gower, Michelle;
Mohr, Joseph J.;
Adams, Darren;
Cai, Y. Dora;
Daues, Gregory E.;
Darnell, Tony;
Ngeow, Chow-Choong;
Desai, Shantanu;
Beldica, Cristina;
Freemon, Mike;
Lin, Huan;
Neilsen, Eric H.;
Tucker, Douglas;
Bertin, Emmanuel;
da Costa, Luiz A. Nicolaci;
Martelli, Leandro;
Ogando, Ricardo L. C.;
Jarvis, Michael;
Sheldon, Erin
Submitted: 2009-05-05
The Dark Energy Survey Data Management (DESDM) system will process and
archive the data from the Dark Energy Survey (DES) over the five year period of
operation. This paper focuses on a new adaptable processing framework developed
to perform highly automated, high performance data parallel processing. The new
processing framework has been used to process 45 nights of simulated DECam
supernova imaging data, and was extensively used in the DES Data Challenge 4,
where it was used to process thousands of square degrees of simulated DES data.
[8]
oai:arXiv.org:0807.2515 [pdf] - 14558
The Dark Energy Survey Data Management System
Mohr, Joseph J.;
Barkhouse, Wayne;
Beldica, Cristina;
Bertin, Emmanuel;
Cai, Y. Dora;
da Costa, Luiz;
Darnell, J. Anthony;
Daues, Gregory E.;
Jarvis, Michael;
Gower, Michelle;
Lin, Huan;
Martelli, leandro;
Neilsen, Eric;
Ngeow, Chow-Choong;
Ogando, Ricardo;
Parga, Alex;
Sheldon, Erin;
Tucker, Douglas;
Kuropatkin, Nikolay;
Stoughton, Chris
Submitted: 2008-07-16
The Dark Energy Survey collaboration will study cosmic acceleration with a
5000 deg2 griZY survey in the southern sky over 525 nights from 2011-2016. The
DES data management (DESDM) system will be used to process and archive these
data and the resulting science ready data products. The DESDM system consists
of an integrated archive, a processing framework, an ensemble of astronomy
codes and a data access framework. We are developing the DESDM system for
operation in the high performance computing (HPC) environments at NCSA and
Fermilab. Operating the DESDM system in an HPC environment offers both speed
and flexibility. We will employ it for our regular nightly processing needs,
and for more compute-intensive tasks such as large scale image coaddition
campaigns, extraction of weak lensing shear from the full survey dataset, and
massive seasonal reprocessing of the DES data. Data products will be available
to the Collaboration and later to the public through a virtual-observatory
compatible web portal. Our approach leverages investments in publicly available
HPC systems, greatly reducing hardware and maintenance costs to the project,
which must deploy and maintain only the storage, database platforms and
orchestration and web portal nodes that are specific to DESDM. In Fall 2007, we
tested the current DESDM system on both simulated and real survey data. We used
Teragrid to process 10 simulated DES nights (3TB of raw data), ingesting and
calibrating approximately 250 million objects into the DES Archive database. We
also used DESDM to process and calibrate over 50 nights of survey data acquired
with the Mosaic2 camera. Comparison to truth tables in the case of the
simulated data and internal crosschecks in the case of the real data indicate
that astrometric and photometric data quality is excellent.
[9]
oai:arXiv.org:astro-ph/0611137 [pdf] - 1938981
Photometric Calibration of the DES
Tucker, Douglas L.;
Annis, James T.;
Lin, Huan;
Kent, Stephen;
Stoughton, Chris;
Peoples, John;
Allam, Sahar;
Mohr, Joseph J.;
Barkhouse, Wayne A.;
Ngeow, Choong;
Alam, Tanweer;
Beldica, Cristina;
Cai, Dora;
Daues, Greg;
Plante, Ray;
Miller, Chris;
Smith, Chris;
Suntzeff, Nicholas B.
Submitted: 2006-11-03
The Dark Energy Survey (DES) is a 5000 sq deg griz imaging survey to be
conducted using a proposed 3 sq deg (2.2deg-diameter) wide-field mosaic camera
on the CTIO Blanco 4m telescope. The primary scientific goal of the DES is to
constrain dark energy cosmological parameters via four complementary methods:
galaxy cluster counting, weak lensing, galaxy angular correlations, and Type Ia
supernovae, supported by precision photometric redshifts. Here we present the
photometric calibration plans for the DES, including a discussion of standard
stars and field-to-field calibrations.
[10]
oai:arXiv.org:astro-ph/0608246 [pdf] - 84123
Cyber-infrastructure to Support Science and Data Management for the Dark
Energy Survey
Ngeow, C.;
Mohr, J. J.;
Alam, T.;
Barkhouse, W. A.;
Beldica, C.;
Cai, D.;
Daues, G.;
Plante, R.;
Annis, J.;
Lin, H.;
Tucker, D.;
Smith, R. C.
Submitted: 2006-08-11
The Dark Energy Survey (DES; operations 2009-2015) will address the nature of
dark energy using four independent and complementary techniques: (1) a galaxy
cluster survey over 4000 deg2 in collaboration with the South Pole Telescope
Sunyaev-Zel'dovich effect mapping experiment, (2) a cosmic shear measurement
over 5000 deg2, (3) a galaxy angular clustering measurement within redshift
shells to redshift=1.35, and (4) distance measurements to 1900 supernovae Ia.
The DES will produce 200 TB of raw data in four bands, These data will be
processed into science ready images and catalogs and co-added into deeper,
higher quality images and catalogs. In total, the DES dataset will exceed 1 PB,
including a 100 TB catalog database that will serve as a key science analysis
tool for the astronomy/cosmology community. The data rate, volume, and duration
of the survey require a new type of data management (DM) system that (1) offers
a high degree of automation and robustness and (2) leverages the existing high
performance computing infrastructure to meet the project's DM targets. The DES
DM system consists of (1) a grid-enabled, flexible and scalable middleware
developed at NCSA for the broader scientific community, (2) astronomy modules
that build upon community software, and (3) a DES archive to support automated
processing and to serve DES catalogs and images to the collaboration and the
public. In the recent DES Data Challenge 1 we deployed and tested the first
version of the DES DM system, successfully reducing 700 GB of raw simulated
images into 5 TB of reduced data products and cataloguing 50 million objects
with calibrated astrometry and photometry.
[11]
oai:arXiv.org:astro-ph/0005183 [pdf] - 35955
Simulated Cluster Archive: A Computational Catalog of X-Ray Clusters in
a Lambda-CDM Universe
Submitted: 2000-05-08
We have simulated the evolution of a large sample of X-ray clusters in a
Lambda-CDM universe at high spatial resolution using adaptive mesh refinement
and placed the results in an online archive for public access. The Simulated
Cluster Archive website http://sca.ncsa.uiuc.edu provides tools for interactive
2D and 3D analysis of gas and dark matter fields, X-ray and SZ imaging, and
data export. We encourage community use and solicit their feedback.