Normalized to: Uram, T.
[1]
oai:arXiv.org:2006.01697 [pdf] - 2105868
The Last Journey. I. An Extreme-Scale Simulation on the Mira
Supercomputer
Heitmann, Katrin;
Frontiere, Nicholas;
Rangel, Esteban;
Larsen, Patricia;
Pope, Adrian;
Sultan, Imran;
Uram, Thomas;
Habib, Salman;
Finkel, Hal;
Korytov, Danila;
Kovacs, Eve;
Rizzi, Silvio;
Insley, Joe
Submitted: 2020-06-02
The Last Journey is a large-volume, gravity-only, cosmological N-body
simulation evolving more than 1.24 trillion particles in a periodic box with a
side-length of 5.025Gpc. It was implemented using the HACC simulation and
analysis framework on the BG/Q system, Mira. The cosmological parameters are
chosen to be consistent with the results from the Planck satellite. A range of
analysis tools have been run in situ to enable a diverse set of science
projects, and at the same time, to keep the resulting data amount manageable.
Analysis outputs have been generated starting at redshift z~10 to allow for
construction of synthetic galaxy catalogs using a semi-analytic modeling
approach in post-processing. As part of our in situ analysis pipeline we employ
a new method for tracking halo sub-structures, introducing the concept of
subhalo cores. The production of multi-wavelength synthetic sky maps is
facilitated by generating particle lightcones in situ, also beginning at z~10.
We provide an overview of the simulation set-up and the generated data
products; a first set of analysis results is presented. A subset of the data is
publicly available.
[2]
oai:arXiv.org:2003.12116 [pdf] - 2071117
The Mira-Titan Universe. III. Emulation of the Halo Mass Function
Submitted: 2020-03-26
We construct an emulator for the halo mass function over group and cluster
mass scales for a range of cosmologies, including the effects of dynamical dark
energy and massive neutrinos. The emulator is based on the recently completed
Mira-Titan Universe suite of cosmological $N$-body simulations. The main set of
simulations spans 111 cosmological models with 2.1 Gpc boxes. We extract halo
catalogs in the redshift range $z=[0.0, 2.0]$ and for masses
$M_{200\mathrm{c}}\geq 10^{13}M_\odot/h$. The emulator covers an 8-dimensional
hypercube spanned by {$\Omega_\mathrm{m}h^2$, $\Omega_\mathrm{b}h^2$,
$\Omega_\nu h^2$, $\sigma_8$, $h$, $n_s$, $w_0$, $w_a$}; spatial flatness is
assumed. We obtain smooth halo mass functions by fitting piecewise second-order
polynomials to the halo catalogs and employ Gaussian process regression to
construct the emulator while keeping track of the statistical noise in the
input halo catalogs and uncertainties in the regression process. For redshifts
$z\lesssim1$, the typical emulator precision is better than $2\%$ for
$10^{13}-10^{14} M_\odot/h$ and $<10\%$ for $M\simeq 10^{15}M_\odot/h$. For
comparison, fitting functions using the traditional universal form for the halo
mass function can be biased at up to 30\% at $M\simeq 10^{14}M_\odot/h$ for
$z=0$. Our emulator is publicly available at
\url{https://github.com/SebastianBocquet/MiraTitanHMFemulator}.
[3]
oai:arXiv.org:1904.11966 [pdf] - 1973123
HACC Cosmological Simulations: First Data Release
Heitmann, Katrin;
Uram, Thomas D.;
Finkel, Hal;
Frontiere, Nicholas;
Habib, Salman;
Pope, Adrian;
Rangel, Esteban;
Hollowed, Joseph;
Korytov, Danila;
Larsen, Patricia;
Allen, Benjamin S.;
Chard, Kyle;
Foster, Ian
Submitted: 2019-04-26, last modified: 2019-10-03
We describe the first major public data release from cosmological simulations
carried out with Argonne's HACC code. This initial release covers a range of
datasets from large gravity-only simulations. The data products include halo
information for multiple redshifts, down-sampled particles, and lightcone
outputs. We provide data from two very large LCDM simulations as well as
beyond-LCDM simulations spanning eleven w0-wa cosmologies. Our release platform
uses Petrel, a research data service, located at the Argonne Leadership
Computing Facility. Petrel offers fast data transfer mechanisms and
authentication via Globus, enabling simple and efficient access to stored
datasets. Easy browsing of the available data products is provided via a web
portal that allows the user to navigate simulation products efficiently. The
data hub will be extended by adding more types of data products and by enabling
computational capabilities to allow direct interactions with simulation
results.
[4]
oai:arXiv.org:1904.11970 [pdf] - 2025486
The Outer Rim Simulation: A Path to Many-Core Supercomputers
Heitmann, Katrin;
Finkel, Hal;
Pope, Adrian;
Morozov, Vitali;
Frontiere, Nicholas;
Habib, Salman;
Rangel, Esteban;
Uram, Thomas;
Korytov, Danila;
Child, Hillary;
Flender, Samuel;
Insley, Joe;
Rizzi, Silvio
Submitted: 2019-04-26, last modified: 2019-04-28
We describe the Outer Rim cosmological simulation, one of the largest
high-resolution N-body simulations performed to date, aimed at promoting
science to be carried out with large-scale structure surveys. The simulation
covers a volume of (4.225Gpc)^3 and evolves more than one trillion particles.
It was executed on Mira, a BlueGene/Q system at the Argonne Leadership
Computing Facility. We discuss some of the computational challenges posed by a
system like Mira, a many-core supercomputer, and how the simulation code, HACC,
has been designed to overcome these challenges. We have carried out a large
range of analyses on the simulation data and we report on the results as well
as the data products that have been generated. The full data set generated by
the simulation totals more than 5PB of data, making data curation and data
handling a large challenge in of itself. The simulation results have been used
to generate synthetic catalogs for large-scale structure surveys, including
DESI and eBOSS, as well as CMB experiments. A detailed catalog for the LSST
DESC data challenges has been created as well. We publicly release some of the
Outer Rim halo catalogs, downsampled particle information, and lightcone data.
[5]
oai:arXiv.org:1709.09665 [pdf] - 1935438
DESCQA: An Automated Validation Framework for Synthetic Sky Catalogs
Mao, Yao-Yuan;
Kovacs, Eve;
Heitmann, Katrin;
Uram, Thomas D.;
Benson, Andrew J.;
Campbell, Duncan;
Cora, Sofía A.;
DeRose, Joseph;
Di Matteo, Tiziana;
Habib, Salman;
Hearin, Andrew P.;
Kalmbach, J. Bryce;
Krughoff, K. Simon;
Lanusse, François;
Lukić, Zarija;
Mandelbaum, Rachel;
Newman, Jeffrey A.;
Padilla, Nelson;
Paillas, Enrique;
Pope, Adrian;
Ricker, Paul M.;
Ruiz, Andrés N.;
Tenneti, Ananth;
Vega-Martínez, Cristian;
Wechsler, Risa H.;
Zhou, Rongpu;
Zu, Ying
Submitted: 2017-09-27, last modified: 2018-02-08
The use of high-quality simulated sky catalogs is essential for the success
of cosmological surveys. The catalogs have diverse applications, such as
investigating signatures of fundamental physics in cosmological observables,
understanding the effect of systematic uncertainties on measured signals and
testing mitigation strategies for reducing these uncertainties, aiding analysis
pipeline development and testing, and survey strategy optimization. The list of
applications is growing with improvements in the quality of the catalogs and
the details that they can provide. Given the importance of simulated catalogs,
it is critical to provide rigorous validation protocols that enable both
catalog providers and users to assess the quality of the catalogs in a
straightforward and comprehensive way. For this purpose, we have developed the
DESCQA framework for the Large Synoptic Survey Telescope Dark Energy Science
Collaboration as well as for the broader community. The goal of DESCQA is to
enable the inspection, validation, and comparison of an inhomogeneous set of
synthetic catalogs via the provision of a common interface within an automated
framework. In this paper, we present the design concept and first
implementation of DESCQA. In order to establish and demonstrate its full
functionality we use a set of interim catalogs and validation tests. We
highlight several important aspects, both technical and scientific, that
require thoughtful consideration when designing a validation framework,
including validation metrics and how these metrics impose requirements on the
synthetic sky catalogs.