Normalized to: Korytov, D.
[1]
oai:arXiv.org:2006.01697 [pdf] - 2105868
The Last Journey. I. An Extreme-Scale Simulation on the Mira
Supercomputer
Heitmann, Katrin;
Frontiere, Nicholas;
Rangel, Esteban;
Larsen, Patricia;
Pope, Adrian;
Sultan, Imran;
Uram, Thomas;
Habib, Salman;
Finkel, Hal;
Korytov, Danila;
Kovacs, Eve;
Rizzi, Silvio;
Insley, Joe
Submitted: 2020-06-02
The Last Journey is a large-volume, gravity-only, cosmological N-body
simulation evolving more than 1.24 trillion particles in a periodic box with a
side-length of 5.025Gpc. It was implemented using the HACC simulation and
analysis framework on the BG/Q system, Mira. The cosmological parameters are
chosen to be consistent with the results from the Planck satellite. A range of
analysis tools have been run in situ to enable a diverse set of science
projects, and at the same time, to keep the resulting data amount manageable.
Analysis outputs have been generated starting at redshift z~10 to allow for
construction of synthetic galaxy catalogs using a semi-analytic modeling
approach in post-processing. As part of our in situ analysis pipeline we employ
a new method for tracking halo sub-structures, introducing the concept of
subhalo cores. The production of multi-wavelength synthetic sky maps is
facilitated by generating particle lightcones in situ, also beginning at z~10.
We provide an overview of the simulation set-up and the generated data
products; a first set of analysis results is presented. A subset of the data is
publicly available.
[2]
oai:arXiv.org:1904.11966 [pdf] - 1973123
HACC Cosmological Simulations: First Data Release
Heitmann, Katrin;
Uram, Thomas D.;
Finkel, Hal;
Frontiere, Nicholas;
Habib, Salman;
Pope, Adrian;
Rangel, Esteban;
Hollowed, Joseph;
Korytov, Danila;
Larsen, Patricia;
Allen, Benjamin S.;
Chard, Kyle;
Foster, Ian
Submitted: 2019-04-26, last modified: 2019-10-03
We describe the first major public data release from cosmological simulations
carried out with Argonne's HACC code. This initial release covers a range of
datasets from large gravity-only simulations. The data products include halo
information for multiple redshifts, down-sampled particles, and lightcone
outputs. We provide data from two very large LCDM simulations as well as
beyond-LCDM simulations spanning eleven w0-wa cosmologies. Our release platform
uses Petrel, a research data service, located at the Argonne Leadership
Computing Facility. Petrel offers fast data transfer mechanisms and
authentication via Globus, enabling simple and efficient access to stored
datasets. Easy browsing of the available data products is provided via a web
portal that allows the user to navigate simulation products efficiently. The
data hub will be extended by adding more types of data products and by enabling
computational capabilities to allow direct interactions with simulation
results.
[3]
oai:arXiv.org:1909.07340 [pdf] - 2109906
Generating Synthetic Cosmological Data with GalSampler
Submitted: 2019-09-16
As part of the effort to meet the needs of the Large Synoptic Survey
Telescope Dark Energy Science Collaboration (LSST DESC) for accurate,
realistically complex mock galaxy catalogs, we have developed GalSampler, an
open-source python package that assists in generating large volumes of
synthetic cosmological data. The key idea behind GalSampler is to recast
hydrodynamical simulations and semi-analytic models as physically-motivated
galaxy libraries. GalSampler populates a new, larger-volume halo catalog with
galaxies drawn from the baseline library; by using weighted sampling guided by
empirical modeling techniques, GalSampler inherits statistical accuracy from
the empirical model and physically-motivated complexity from the baseline
library. We have recently used GalSampler to produce the cosmoDC2 extragalactic
catalog made for the LSST DESC Data Challenge 2. Using cosmoDC2 as a guiding
example, we outline how GalSampler can continue to support ongoing and
near-future galaxy surveys such as the Dark Energy Survey (DES), the Dark
Energy Spectroscopic Instrument (DESI), WFIRST, and Euclid.
[4]
oai:arXiv.org:1907.06530 [pdf] - 2025623
CosmoDC2: A Synthetic Sky Catalog for Dark Energy Science with LSST
Korytov, Danila;
Hearin, Andrew;
Kovacs, Eve;
Larsen, Patricia;
Rangel, Esteban;
Hollowed, Joseph;
Benson, Andrew J.;
Heitmann, Katrin;
Mao, Yao-Yuan;
Bahmanyar, Anita;
Chang, Chihway;
Campbell, Duncan;
Derose, Joseph;
Finkel, Hal;
Frontiere, Nicholas;
Gawiser, Eric;
Habib, Salman;
Joachimi, Benjamin;
Lanusse, François;
Li, Nan;
Mandelbaum, Rachel;
Morrison, Christopher;
Newman, Jeffrey A.;
Pope, Adrian;
Rykoff, Eli;
Simet, Melanie;
To, Chun-Hao;
Vikraman, Vinu;
Wechsler, Risa H.;
White, Martin
Submitted: 2019-07-15, last modified: 2019-07-27
This paper introduces cosmoDC2, a large synthetic galaxy catalog designed to
support precision dark energy science with the Large Synoptic Survey Telescope
(LSST). CosmoDC2 is the starting point for the second data challenge (DC2)
carried out by the LSST Dark Energy Science Collaboration (LSST DESC). The
catalog is based on a trillion-particle, 4.225 Gpc^3 box cosmological N-body
simulation, the `Outer Rim' run. It covers 440 deg^2 of sky area to a redshift
of z=3 and is complete to a magnitude depth of 28 in the r-band. Each galaxy is
characterized by a multitude of properties including stellar mass, morphology,
spectral energy distributions, broadband filter magnitudes, host halo
information and weak lensing shear. The size and complexity of cosmoDC2
requires an efficient catalog generation methodology; our approach is based on
a new hybrid technique that combines data-driven empirical approaches with
semi-analytic galaxy modeling. A wide range of observation-based validation
tests has been implemented to ensure that cosmoDC2 enables the science goals of
the planned LSST DESC DC2 analyses. This paper also represents the official
release of the cosmoDC2 data set, including an efficient reader that
facilitates interaction with the data.
[5]
oai:arXiv.org:1904.11970 [pdf] - 2025486
The Outer Rim Simulation: A Path to Many-Core Supercomputers
Heitmann, Katrin;
Finkel, Hal;
Pope, Adrian;
Morozov, Vitali;
Frontiere, Nicholas;
Habib, Salman;
Rangel, Esteban;
Uram, Thomas;
Korytov, Danila;
Child, Hillary;
Flender, Samuel;
Insley, Joe;
Rizzi, Silvio
Submitted: 2019-04-26, last modified: 2019-04-28
We describe the Outer Rim cosmological simulation, one of the largest
high-resolution N-body simulations performed to date, aimed at promoting
science to be carried out with large-scale structure surveys. The simulation
covers a volume of (4.225Gpc)^3 and evolves more than one trillion particles.
It was executed on Mira, a BlueGene/Q system at the Argonne Leadership
Computing Facility. We discuss some of the computational challenges posed by a
system like Mira, a many-core supercomputer, and how the simulation code, HACC,
has been designed to overcome these challenges. We have carried out a large
range of analyses on the simulation data and we report on the results as well
as the data products that have been generated. The full data set generated by
the simulation totals more than 5PB of data, making data curation and data
handling a large challenge in of itself. The simulation results have been used
to generate synthetic catalogs for large-scale structure surveys, including
DESI and eBOSS, as well as CMB experiments. A detailed catalog for the LSST
DESC data challenges has been created as well. We publicly release some of the
Outer Rim halo catalogs, downsampled particle information, and lightcone data.