Normalized to: Katz, M.
[1]
oai:arXiv.org:2007.05218 [pdf] - 2131970
Preparing Nuclear Astrophysics for Exascale
Katz, Max P.;
Almgren, Ann;
Sazo, Maria Barrios;
Eiden, Kiran;
Gott, Kevin;
Harpole, Alice;
Sexton, Jean M.;
Willcox, Don E.;
Zhang, Weiqun;
Zingale, Michael
Submitted: 2020-07-10
Astrophysical explosions such as supernovae are fascinating events that
require sophisticated algorithms and substantial computational power to model.
Castro and MAESTROeX are nuclear astrophysics codes that simulate thermonuclear
fusion in the context of supernovae and X-ray bursts. Examining these nuclear
burning processes using high resolution simulations is critical for
understanding how these astrophysical explosions occur. In this paper we
describe the changes that have been made to these codes to transform them from
standard MPI + OpenMP codes targeted at petascale CPU-based systems into a form
compatible with the pre-exascale systems now online and the exascale systems
coming soon. We then discuss what new science is possible to run on systems
such as Summit and Perlmutter that could not have been achieved on the previous
generation of supercomputers.
[2]
oai:arXiv.org:2006.12513 [pdf] - 2120104
On the inspiral of coalescing massive black hole binaries with LISA in
the era of Multi-Messenger Astrophysics
Submitted: 2020-06-22
Massive black hole binaries (MBHBs) of $10^5 \, \rm M_\odot - 3 \times 10^7
\, \rm M_\odot $ merging in low redshift galaxies ($z\le4$) are sufficiently
loud to be detected weeks before coalescence with the Laser Interferometer
Space Antenna (LISA). This allows us to perform the parameter estimation $on$
$the$ $fly$, i.e. as a function of the time to coalescence during the inspiral
phase, relevant for early warning of the planned LISA protected periods and for
searches of electromagnetic signals. In this work, we study the evolution of
the sky position, luminosity distance, chirp mass and mass ratio uncertainties
as function of time left before merger. Overall, light systems with total
intrinsic mass $\rm M_{\rm tot} = 3 \times 10^5 \, \rm M_\odot$ are
characterized by smaller uncertainties than heavy ones ($\rm M_{\rm tot} = 10^7
\, \rm M_\odot$) during the inspiral. Luminosity distance, chirp mass and mass
ratio are well constrained at the end of the inspiral. Concerning sky position,
at $z=1$, MBHBs with $\rm M_{\rm tot} = 3 \times 10^5 \, \rm M_\odot$ can be
localized with a median precision of $\simeq 10^2 \, \rm deg^2 (\simeq 1 \, \rm
deg^2)$ at 1 month (1 hour) from merger, while the sky position of heavy MBHBs
can be determined to $10 \, \rm deg^2$ only 1 hour before merger. However the
uncertainty around the median values broadens with time, ranging in between
0.04 -- 20 $\rm deg^2$ (0.3 -- 3 $\times 10^3 \, \rm deg^2$) for light (heavy)
systems at 1 hour before merger. At merger the sky localization improves down
to $\simeq 10^{-1} \, \rm deg^2$ for all masses. For the benefit of the
observer community, we provide the full set of data from our simulations and
simple and ready-to-use analytical fits to describe the time evolution of
uncertainties in the aforementioned parameters, valid for systems with total
mass between $10^5$--$10^7 \, \rm M_\odot$ and redshift $0.3$--$3$.
[3]
oai:arXiv.org:2006.06866 [pdf] - 2113410
GPU-Accelerated Periodic Source Identification in Large-Scale Surveys:
Measuring $P$ and $\dot{P}$
Submitted: 2020-06-11
Many inspiraling and merging stellar remnants emit both gravitational and
electromagnetic radiation as they orbit or collide. These gravitational wave
events together with their associated electromagnetic counterparts provide
insight about the nature of the merger, allowing us to further constrain
parameters about the properties of the binary. With the future launch of the
Laser Interferometer Space Antenna (LISA), follow up observations and models
are needed of ultracompact binary (UCB) systems. Current and upcoming long
baseline time domain surveys will observe many of these UCBs. We present a new
fast periodic object search tool based on the Conditional Entropy algorithm.
This new implementation of Conditional Entropy allows for a grid search over
both the period ($P$) and the time derivative of the period ($\dot{P}$). To
demonstrate the performance and usage of this tool, we use a galactic
population of UCBs generated from the population synthesis code COSMIC, as well
as a Curated catalog for varying periods at fixed intrinsic parameters. We
simulate light curves as likely to be observed by future time domain surveys by
using an existing eclipsing binary light curve model accounting for the change
in orbital period due to gravitational radiation. We find that a search with
$\dot{P}$ values is necessary for detecting binaries at orbital periods less
than $\sim$10 min. We also show it is useful in finding and characterizing
binaries with longer periods, but at a higher computational cost. Our code is
called gce (GPU-Accelerated Conditional Entropy). It is available at
https://github.com/mikekatz04/gce.
[4]
oai:arXiv.org:1908.11375 [pdf] - 2099712
The Missing Link in Gravitational-Wave Astronomy: Discoveries waiting in
the decihertz range
Sedda, Manuel Arca;
Berry, Christopher P. L.;
Jani, Karan;
Amaro-Seoane, Pau;
Auclair, Pierre;
Baird, Jonathon;
Baker, Tessa;
Berti, Emanuele;
Breivik, Katelyn;
Burrows, Adam;
Caprini, Chiara;
Chen, Xian;
Doneva, Daniela;
Ezquiaga, Jose M.;
Ford, K. E. Saavik;
Katz, Michael L.;
Kolkowitz, Shimon;
McKernan, Barry;
Mueller, Guido;
Nardini, Germano;
Pikovski, Igor;
Rajendran, Surjeet;
Sesana, Alberto;
Shao, Lijing;
Tamanini, Nicola;
Vartanyan, David;
Warburton, Niels;
Witek, Helvi;
Wong, Kaze;
Zevin, Michael
Submitted: 2019-08-29, last modified: 2020-05-21
The gravitational-wave astronomical revolution began in 2015 with LIGO's
observation of the coalescence of two stellar-mass black holes. Over the coming
decades, ground-based detectors like LIGO will extend their reach, discovering
thousands of stellar-mass binaries. In the 2030s, the space-based LISA will
enable gravitational-wave observations of the massive black holes in galactic
centres. Between LISA and ground-based observatories lies the unexplored
decihertz gravitational-wave frequency band. Here, we propose a Decihertz
Observatory to cover this band, and complement observations made by other
gravitational-wave observatories. The decihertz band is uniquely suited to
observation of intermediate-mass ($\sim 10^2$-$10^4 M_\odot$) black holes,
which may form the missing link between stellar-mass and massive black holes,
offering a unique opportunity to measure their properties. Decihertz
observations will be able to detect stellar-mass binaries days to years before
they merge and are observed by ground-based detectors, providing early warning
of nearby binary neutron star mergers, and enabling measurements of the
eccentricity of binary black holes, providing revealing insights into their
formation. Observing decihertz gravitational-waves also opens the possibility
of testing fundamental physics in a new laboratory, permitting unique tests of
general relativity and the Standard Model of particle physics. Overall, a
Decihertz Observatory will answer key questions about how black holes form and
evolve across cosmic time, open new avenues for multimessenger astronomy, and
advance our understanding of gravitation, particle physics and cosmology.
[5]
oai:arXiv.org:1912.04956 [pdf] - 2089049
Dynamics of Laterally Propagating Flames in X-ray Bursts. I. Burning
Front Structure
Submitted: 2019-12-10
We investigate the structure of laterally-propagating flames through the
highly-stratified burning layer in an X-ray burst. Two-dimensional
hydrodynamics simulations of flame propagation are performed through a rotating
plane-parallel atmosphere, exploring the structure of the flame. We discuss the
approximations needed to capture the length and time scales at play in an X-ray
burst and describe the flame acceleration observed. Our studies complement
other multidimensional studies of burning in X-ray bursts.
[6]
oai:arXiv.org:1908.05779 [pdf] - 2025702
Probing Massive Black Hole Binary Populations with LISA
Submitted: 2019-08-15, last modified: 2019-11-01
ESA and NASA are moving forward with plans to launch LISA around 2034. With
data from the Illustris cosmological simulation, we provide analysis of LISA
detection rates accompanied by characterization of the merging massive black
hole population. Massive black holes of total mass $\sim10^5-10^{10} M_\odot$
are the focus of this study. We evolve Illustris massive black hole mergers,
which form at separations on the order of the simulation resolution ($\sim$kpc
scales), through coalescence with two different treatments for the binary
massive black hole evolutionary process. The coalescence times of the
population, as well as physical properties of the black holes, form a
statistical basis for each evolutionary treatment. From these bases, we Monte
Carlo synthesize many realizations of the merging massive black hole population
to build mock LISA detection catalogs. We analyze how our massive black hole
binary evolutionary models affect detection rates and the associated parameter
distributions measured by LISA. With our models, we find massive black hole
binary detection rates with LISA of $\sim0.5-1$ yr$^{-1}$ for massive black
holes with masses greater than $10^5M_\odot$. This should be treated as a lower
limit primarily because our massive black hole sample does not include masses
below $10^5M_\odot$, which may significantly add to the observed rate. We
suggest reasons why we predict lower detection rates compared to much of the
literature.
[7]
oai:arXiv.org:1910.12979 [pdf] - 1987533
Modelling low Mach number stellar hydrodynamics with MAESTROeX
Submitted: 2019-10-28
Modelling long-time convective flows in the interiors of stars is extremely
challenging using conventional compressible hydrodynamics codes due to the
acoustic timestep limitation. Many of these flows are in the low Mach number
regime, which allows us to exploit the relationship between acoustic and
advective time scales to develop a more computationally efficient approach.
MAESTROeX is an open source low Mach number stellar hydrodynamics code that
allows much larger timesteps to be taken, therefore enabling systems to be
modelled for much longer periods of time. This is particularly important for
the problem of convection in the cores of rotating massive stars prior to core
collapse. To fully capture the dynamics, it is necessary to model these systems
in three dimensions at high resolution over many rotational periods. We present
an overview of MAESTROeX's current capabilities, describe ongoing work to
incorporate the effects of rotation and discuss how we are optimising the code
to run on GPUs.
[8]
oai:arXiv.org:1910.12578 [pdf] - 1986932
The Castro AMR Simulation Code: Current and Future Developments
Zingale, M.;
Almgren, A. S.;
Sazo, M. Barrios;
Bell, J. B.;
Eiden, K.;
Harpole, A.;
Katz, M. P.;
Nonaka, A. J.;
Willcox, D. E.;
Zhang, W.
Submitted: 2019-10-28
We describe recent developments to the Castro astrophysics simulation code,
focusing on new features that enable our simulations of X-ray bursts. Two
highlights of Castro's ongoing development are the new integration technique to
couple hydrodynamics and reactions to high order and GPU offloading. We discuss
how these features will help offset some of the computational expense in X-ray
burst models.
[9]
oai:arXiv.org:1908.03661 [pdf] - 2025686
Improved Coupling of Hydrodynamics and Nuclear Reactions via Spectral
Deferred Corrections
Submitted: 2019-08-09, last modified: 2019-10-12
Simulations in stellar astrophysics involve the coupling of hydrodynamics and
nuclear reactions under a wide variety of conditions, from simmering convective
flows to explosive nucleosynthesis. Numerical techniques such as operator
splitting (most notably Strang splitting) are usually employed to couple the
physical processes, but this can affect the accuracy of the simulation,
particularly when the burning is vigorous. Furthermore, Strang splitting does
not have a straightforward extension to higher-order integration in time. We
present a new temporal integration strategy based on spectral deferred
corrections and describe the second- and fourth-order implementations in the
open-source, finite-volume, compressible hydrodynamics code Castro. One notable
advantage to these schemes is that they combine standard low-order
discretizations for individual physical processes in a way that achieves an
arbitrarily high order of accuracy. We demonstrate the improved accuracy of the
new methods on several test problems of increasing complexity.
[10]
oai:arXiv.org:1903.00132 [pdf] - 1864013
Numerical Stability of Detonations in White Dwarf Simulations
Submitted: 2019-02-28, last modified: 2019-03-03
Some simulations of Type Ia supernovae feature self-consistent thermonuclear
detonations. However, these detonations are not meaningful if the simulations
are not resolved, so it is important to establish the requirements for
achieving a numerically converged detonation. In this study we examine a test
detonation problem inspired by collisions of white dwarfs. This test problem
demonstrates that achieving a converged thermonuclear ignition requires spatial
resolution much finer than 1 km in the burning region. Current computational
resource constraints place this stringent resolution requirement out of reach
for multi-dimensional supernova simulations. Consequently, contemporary
simulations that self-consistently demonstrate detonations are possibly not
converged and should be treated with caution.
[11]
oai:arXiv.org:1811.11812 [pdf] - 1846852
Post-Newtonian Dynamics in Dense Star Clusters: Binary Black Holes in
the LISA Band
Kremer, Kyle;
Rodriguez, Carl L.;
Amaro-Seoane, Pau;
Breivik, Katelyn;
Chatterjee, Sourav;
Katz, Michael L.;
Larson, Shane L.;
Rasio, Frederic A.;
Samsing, Johan;
Ye, Claire S.;
Zevin, Michael
Submitted: 2018-11-28, last modified: 2019-02-26
The dynamical processing of black holes in the dense cores of globular
clusters (GCs), makes them efficient factories for producing binary black holes
(BBHs). Here we explore the population of BBHs that form dynamically in GCs and
may be observable at mHz frequencies or higher with LISA. We use our Monte
Carlo stellar dynamics code, which includes gravitational radiation reaction
effects for all BH encounters. By creating a representative local universe of
GCs, we show that up to dozens of these systems may be resolvable by LISA with
signal-to-noise ratios of at least 5. Approximately one third of these binaries
will have measurable eccentricities ($e > 10^{-3}$) in the LISA band and a
small number ($\lesssim 5$) may evolve from the LISA band to the LIGO band
during the LISA mission.
[12]
oai:arXiv.org:1810.04720 [pdf] - 1971155
Toward Resolved Simulations of Burning Fronts in Thermonuclear X-ray
Bursts
Zingale, M.;
Eiden, K.;
Cavecchi, Y.;
Harpole, A.;
Bell, J. B.;
Chang, M.;
Hawke, I.;
Katz, M. P.;
Malone, C. M.;
Nonaka, A. J.;
Willcox, D. E.;
Zhang, W.
Submitted: 2018-10-10, last modified: 2019-01-08
We discuss the challenges of modeling X-ray bursts in multi-dimensions,
review the different calculations done to date, and discuss our new set of
ongoing simulations. We also describe algorithmic improvements that may help in
the future to offset some of the expense of these simulations, and describe
what may be possible with exascale computing.
[13]
oai:arXiv.org:1805.09954 [pdf] - 1894148
Quantification of Incertitude in Black Box Simulation Codes
Submitted: 2018-05-24
We present early results from a study addressing the question of how one
treats the propagation of incertitude, that is, epistemic uncertainty, in input
parameters in astrophysical simulations. As an example, we look at the
propagation of incertitude in control parameters for stellar winds in MESA
stellar evolution simulations. We apply two methods of incertitude propagation,
the Cauchy Deviates method and the Quadratic Response Surface method, to
quantify the output uncertainty in the final white dwarf mass given a range of
values for wind parameters. The methodology we apply is applicable to the
problem of propagating input incertitudes through any simulation code treated
as a "black box," i.e. a code for which the algorithmic details are either
inaccessible or prohibitively complicated. We have made the tools developed for
this study freely available to the community.
[14]
oai:arXiv.org:1711.06203 [pdf] - 1809513
Meeting the Challenges of Modeling Astrophysical Thermonuclear
Explosions: Castro, Maestro, and the AMReX Astrophysics Suite
Zingale, M.;
Almgren, A. S.;
Sazo, M. G. Barrios;
Beckner, V. E.;
Bell, J. B.;
Friesen, B.;
Jacobs, A. M.;
Katz, M. P.;
Malone, C. M.;
Nonaka, A. J.;
Willcox, D. E.;
Zhang, W.
Submitted: 2017-11-16
We describe the AMReX suite of astrophysics codes and their application to
modeling problems in stellar astrophysics. Maestro is tuned to efficiently
model subsonic convective flows while Castro models the highly compressible
flows associated with stellar explosions. Both are built on the
block-structured adaptive mesh refinement library AMReX. Together, these codes
enable a thorough investigation of stellar phenomena, including Type Ia
supernovae and X-ray bursts. We describe these science applications and the
approach we are taking to make these codes performant on current and future
many-core and GPU-based architectures.
[15]
oai:arXiv.org:1512.06099 [pdf] - 1374228
White Dwarf Mergers on Adaptive Meshes I. Methodology and Code
Verification
Submitted: 2015-12-18, last modified: 2016-01-19
The Type Ia supernova progenitor problem is one of the most perplexing and
exciting problems in astrophysics, requiring detailed numerical modeling to
complement observations of these explosions. One possible progenitor that has
merited recent theoretical attention is the white dwarf merger scenario, which
has the potential to naturally explain many of the observed characteristics of
Type Ia supernovae. To date there have been relatively few self-consistent
simulations of merging white dwarf systems using mesh-based hydrodynamics. This
is the first paper in a series describing simulations of these systems using a
hydrodynamics code with adaptive mesh refinement. In this paper we describe our
numerical methodology and discuss our implementation in the compressible
hydrodynamics code CASTRO, which solves the Euler equations, and the Poisson
equation for self-gravity, and couples the gravitational and rotation forces to
the hydrodynamics. Standard techniques for coupling gravitation and rotation
forces to the hydrodynamics do not adequately conserve the total energy of the
system for our problem, but recent advances in the literature allow progress
and we discuss our implementation here. We present a set of test problems
demonstrating the extent to which our software sufficiently models a system
where large amounts of mass are advected on the computational domain over long
timescales. Future papers in this series will describe our treatment of the
initial conditions of these systems and will examine the early phases of the
merger to determine its viability for triggering a thermonuclear detonation.
[16]
oai:arXiv.org:1501.01923 [pdf] - 1223921
On the Piecewise Parabolic Method for Compressible Flow with Stellar
Equations of State
Submitted: 2015-01-08
The piecewise parabolic method and related schemes are widely used to model
stellar flows. Several different methods for extending the validity of these
methods to a general equation of state have been proposed over time, but direct
comparisons amongst one-another and exact solutions with stellar equations of
state are not widely available. We introduce some simple test problems with
exact solutions run with a popular stellar equation of state and test how two
existing codes with different approaches to incorporating general gases
perform. The source code for generating the exact solutions is made available.
[17]
oai:arXiv.org:1006.3344 [pdf] - 1033149
Supernova Remnants and Star Formation in the Large Magellanic Cloud
Desai, K. M.;
Chu, Y. -H.;
Gruendl, R. A.;
Dluger, W.;
Katz, M.;
Wong, T.;
Chen, C. -H. R.;
Looney, L. W.;
Hughes, A.;
Muller, E.;
Ott, J.;
Pineda, J. L.
Submitted: 2010-06-16
It has often been suggested that supernova remnants (SNRs) can trigger star
formation. To investigate the relationship between SNRs and star formation, we
have examined the known sample of 45 SNRs in the Large Magellanic Cloud to
search for associated young stellar objects (YSOs) and molecular clouds. We
find seven SNRs associated with both YSOs and molecular clouds, three SNRs
associated with YSOs but not molecular clouds, and eight SNRs near molecular
clouds but not associated with YSOs. Among the 10 SNRs associated with YSOs,
the association between the YSOs and SNRs can be either rejected or cannot be
convincingly established for eight cases. Only two SNRs have YSOs closely
aligned along their rims; however, the time elapsed since the SNR began to
interact with the YSOs' natal clouds is much shorter than the contraction
timescales of the YSOs, and thus we do not see any evidence of SNR-triggered
star formation in the LMC. The 15 SNRs that are near molecular clouds may
trigger star formation in the future when the SNR shocks have slowed down to
<45 km/s. We discuss how SNRs can alter the physical properties and abundances
of YSOs.