Normalized to: Rizzi, S.
[1]
oai:arXiv.org:2006.01697 [pdf] - 2105868
The Last Journey. I. An Extreme-Scale Simulation on the Mira
Supercomputer
Heitmann, Katrin;
Frontiere, Nicholas;
Rangel, Esteban;
Larsen, Patricia;
Pope, Adrian;
Sultan, Imran;
Uram, Thomas;
Habib, Salman;
Finkel, Hal;
Korytov, Danila;
Kovacs, Eve;
Rizzi, Silvio;
Insley, Joe
Submitted: 2020-06-02
The Last Journey is a large-volume, gravity-only, cosmological N-body
simulation evolving more than 1.24 trillion particles in a periodic box with a
side-length of 5.025Gpc. It was implemented using the HACC simulation and
analysis framework on the BG/Q system, Mira. The cosmological parameters are
chosen to be consistent with the results from the Planck satellite. A range of
analysis tools have been run in situ to enable a diverse set of science
projects, and at the same time, to keep the resulting data amount manageable.
Analysis outputs have been generated starting at redshift z~10 to allow for
construction of synthetic galaxy catalogs using a semi-analytic modeling
approach in post-processing. As part of our in situ analysis pipeline we employ
a new method for tracking halo sub-structures, introducing the concept of
subhalo cores. The production of multi-wavelength synthetic sky maps is
facilitated by generating particle lightcones in situ, also beginning at z~10.
We provide an overview of the simulation set-up and the generated data
products; a first set of analysis results is presented. A subset of the data is
publicly available.
[2]
oai:arXiv.org:1904.11970 [pdf] - 2025486
The Outer Rim Simulation: A Path to Many-Core Supercomputers
Heitmann, Katrin;
Finkel, Hal;
Pope, Adrian;
Morozov, Vitali;
Frontiere, Nicholas;
Habib, Salman;
Rangel, Esteban;
Uram, Thomas;
Korytov, Danila;
Child, Hillary;
Flender, Samuel;
Insley, Joe;
Rizzi, Silvio
Submitted: 2019-04-26, last modified: 2019-04-28
We describe the Outer Rim cosmological simulation, one of the largest
high-resolution N-body simulations performed to date, aimed at promoting
science to be carried out with large-scale structure surveys. The simulation
covers a volume of (4.225Gpc)^3 and evolves more than one trillion particles.
It was executed on Mira, a BlueGene/Q system at the Argonne Leadership
Computing Facility. We discuss some of the computational challenges posed by a
system like Mira, a many-core supercomputer, and how the simulation code, HACC,
has been designed to overcome these challenges. We have carried out a large
range of analyses on the simulation data and we report on the results as well
as the data products that have been generated. The full data set generated by
the simulation totals more than 5PB of data, making data curation and data
handling a large challenge in of itself. The simulation results have been used
to generate synthetic catalogs for large-scale structure surveys, including
DESI and eBOSS, as well as CMB experiments. A detailed catalog for the LSST
DESC data challenges has been created as well. We publicly release some of the
Outer Rim halo catalogs, downsampled particle information, and lightcone data.
[3]
oai:arXiv.org:1411.3396 [pdf] - 1273044
The Q Continuum Simulation: Harnessing the Power of GPU Accelerated
Supercomputers
Submitted: 2014-11-12
Modeling large-scale sky survey observations is a key driver for the
continuing development of high resolution, large-volume, cosmological
simulations. We report the first results from the 'Q Continuum' cosmological
N-body simulation run carried out on the GPU-accelerated supercomputer Titan.
The simulation encompasses a volume of (1300 Mpc)^3 and evolves more than half
a trillion particles, leading to a particle mass resolution of ~1.5 X 10^8
M_sun. At this mass resolution, the Q Continuum run is currently the largest
cosmology simulation available. It enables the construction of detailed
synthetic sky catalogs, encompassing different modeling methodologies,
including semi-analytic modeling and sub-halo abundance matching in a large,
cosmological volume. Here we describe the simulation and outputs in detail and
present first results for a range of cosmological statistics, such as mass
power spectra, halo mass functions, and halo mass-concentration relations for
different epochs. We also provide details on challenges connected to running a
simulation on almost 90% of Titan, one of the fastest supercomputers in the
world, including our usage of Titan's GPU accelerators.