Normalized to: Cielo, S.
[1]
oai:arXiv.org:2002.08161 [pdf] - 2109019
Honing and proofing Astrophysical codes on the road to Exascale.
Experiences from code modernization on many-core systems
Submitted: 2020-02-19
The complexity of modern and upcoming computing architectures poses severe
challenges for code developers and application specialists, and forces them to
expose the highest possible degree of parallelism, in order to make the best
use of the available hardware. The Intel$^{(R)}$ Xeon Phi$^{(TM)}$ of second
generation (code-named Knights Landing, henceforth KNL) is the latest many-core
system, which implements several interesting hardware features like for example
a large number of cores per node (up to 72), the 512 bits-wide vector registers
and the high-bandwidth memory. The unique features of KNL make this platform a
powerful testbed for modern HPC applications. The performance of codes on KNL
is therefore a useful proxy of their readiness for future architectures. In
this work we describe the lessons learnt during the optimisation of the widely
used codes for computational astrophysics P-Gadget-3, Flash and Echo. Moreover,
we present results for the visualisation and analysis tools VisIt and yt. These
examples show that modern architectures benefit from code optimisation at
different levels, even more than traditional multi-core systems. However, the
level of modernisation of typical community codes still needs improvements, for
them to fully utilise resources of novel architectures.
[2]
oai:arXiv.org:1910.07855 [pdf] - 1981856
Speeding simulation analysis up with yt and Intel Distribution for
Python
Submitted: 2019-10-17
As modern scientific simulations grow ever more in size and complexity, even
their analysis and post-processing becomes increasingly demanding, calling for
the use of HPC resources and methods. yt is a parallel, open source
post-processing python package for numerical simulations in astrophysics, made
popular by its cross-format compatibility, its active community of developers
and its integration with several other professional Python instruments. The
Intel Distribution for Python enhances yt's performance and parallel
scalability, through the optimization of lower-level libraries Numpy and Scipy,
which make use of the optimized Intel Math Kernel Library (Intel-MKL) and the
Intel MPI library for distributed computing. The library package yt is used for
several analysis tasks, including integration of derived quantities, volumetric
rendering, 2D phase plots, cosmological halo analysis and production of
synthetic X-ray observation. In this paper, we provide a brief tutorial for the
installation of yt and the Intel Distribution for Python, and the execution of
each analysis task. Compared to the Anaconda python distribution, using the
provided solution one can achieve net speedups up to 4.6x on Intel Xeon
Scalable processors (codename Skylake).
[3]
oai:arXiv.org:1910.07850 [pdf] - 1981855
Visualizing the world's largest turbulence simulation
Submitted: 2019-10-17
In this exploratory submission we present the visualization of the largest
interstellar turbulence simulations ever performed, unravelling key
astrophysical processes concerning the formation of stars and the relative role
of magnetic fields. The simulations, including pure hydrodynamical (HD) and
magneto-hydrodynamical (MHD) runs, up to a size of $10048^3$ grid elements,
were produced on the supercomputers of the Leibniz Supercomputing Centre and
visualized using the hybrid parallel (MPI+TBB) ray-tracing engine OSPRay
associated with VisIt. Besides revealing features of turbulence with an
unprecedented resolution, the visualizations brilliantly showcase the
stretching-and-folding mechanisms through which astrophysical processes such as
supernova explosions drive turbulence and amplify the magnetic field in the
interstellar gas, and how the first structures, the seeds of newborn stars are
shaped by this process.
[4]
oai:arXiv.org:1801.04276 [pdf] - 1751744
Feedback from Reorienting AGN Jets
Submitted: 2018-01-12, last modified: 2018-08-17
[abridged] Aims: We test the effects of re-orienting jets from an active
galactic nucleus (AGN) on the intracluster medium in a galaxy cluster
environment with short central cooling time. We investigate appearance and
properties of the resulting cavities, and the efficiency of jets in providing
near-isotropic heating to the cooling cluster core.
Methods: We use numerical simulations to explore four models of jets over
several active/inactive cycles. We keep the jet power and duration fixed,
varying only the jet angle prescription. We track the total energy of the
intracluster medium (ICM) in the cluster core over time, and the fraction of
the jet energy transferred to the ICM, paying attention to where the energy is
deposited. We also compare synthetic X-ray images of the simulated cluster to
actual observations.
Results: Jets whose re-orientation is minimal ($\lesssim 20^{\circ}$)
typically produce conical structures of interconnected cavities, with the
opening angle of the cones being $\sim 15-20^{\circ}$, extending to $\sim 300$
kpc from the cluster centre. Such jets transfer about $60\%$ of their energy to
the ICM, yet they are not very efficient at heating the cluster core, as the
jet energy is deposited further out. Jets that re-orient by $\gtrsim
20^{\circ}$ generally produce multiple pairs of detached cavities. Although
smaller, these cavities are inflated within the central 50~kpc and are more
isotropically distributed, resulting in more effective heating of the core.
Such jets, over few hundreds Myr, can deposit up to $80\%$ of their energy
where it is required. Consequently, these models come the closest to an
heating/cooling balance and to mitigating runaway cooling of the core, even
though all models have identical power/duration profiles. Additionally, the
corresponding synthetic X-ray images exhibit structures closely resembling
those seen in real cool-core clusters.
[5]
oai:arXiv.org:1712.03955 [pdf] - 1656222
AGN Feedback Compared: Jets versus Radiation
Submitted: 2017-12-11
Feedback by Active Galactic Nuclei is often divided into quasar and radio
mode, powered by radiation or radio jets, respectively. Both are fundamental in
galaxy evolution, especially in late-type galaxies, as shown by cosmological
simulations and observations of jet-ISM interactions in these systems. We
compare AGN feedback by radiation and by collimated jets through a suite of
simulations, in which a central AGN interacts with a clumpy, fractal galactic
disc. We test AGN of $10^{43}$ and $10^{46}$ erg/s, considering jets
perpendicular or parallel to the disc. Mechanical jets drive the more powerful
outflows, exhibiting stronger mass and momentum coupling with the dense gas,
while radiation heats and rarifies the gas more. Radiation and perpendicular
jets evolve to be quite similar in outflow properties and effect on the cold
ISM, while inclined jets interact more efficiently with all the disc gas,
removing the densest $20\%$ in $20$ Myr, and thereby reducing the amount of
cold gas available for star formation. All simulations show small-scale inflows
of $0.01-0.1$ M$_\odot$/yr, which can easily reach down to the Bondi radius of
the central supermassive black hole (especially for radiation and perpendicular
jets), implying that AGN modulate their own duty cycle in a feedback/feeding
cycle.
[6]
oai:arXiv.org:1701.07825 [pdf] - 1535079
Backflows by AGN jets: Global properties and influence on SMBH accretion
Submitted: 2017-01-26, last modified: 2017-02-21
Jets from Active Galactic Nuclei (AGN) inflate large cavities in the hot gas
environment around galaxies and galaxy clusters. The large-scale gas
circulation promoted within such cavities by the jet itself gives rise to
backflows that propagate back to the center of the jet-cocoon system, spanning
all the physical scales relevant for the AGN.
Using an Adaptive Mesh Refinement code, we study these backflows through a
series of numerical experiments, aiming at understanding how their global
properties depend on jet parameters. We are able to characterize their mass
flux down to a scale of a few kiloparsecs to about $0.5\,\mathrm{M_\odot/y}$for
as long as $15$ or $20$ Myr, depending on jet power. We find that backflows are
both spatially coherent and temporally textbf{intermittent}, independently of
jet power in the range $10^{43-45}$ erg/s.
Using the mass flux thus measured, we model analytically the effect of
backflows on the central accretion region, where a Magnetically Arrested Disk
lies at the center of a thin circumnuclear disk. Backflow accretion onto the
disk modifies its density profile, producing a flat core and tail.
We use this analytic model to predict how accretion beyond the BH
magnetopause is modified, and thus how the jet power is temporally modulated.
Under the assumption that the magnetic flux stays frozen in the accreting
matter, and that the jets are always launched via the Blandford-Znajek (1977)
mechanism, we find that backflows are capable of boosting the jet power up to
tenfold during relatively short time episodes (a few Myr).
[7]
oai:arXiv.org:1305.1663 [pdf] - 862340
Evolution of the Mass-Metallicity relations in passive and star-forming
galaxies from SPH-cosmological simulations
Submitted: 2013-05-07, last modified: 2014-09-04
We present results from SPH-cosmological simulations, including
self-consistent modelling of SN feedback and chemical evolution, of galaxies
belonging to two clusters and twelve groups. We reproduce the mass-metallicity
(ZM) relation of galaxies classified in two samples according to their
star-forming activity, as parametrized by their sSFR, across a redshift range
up to z=2.
Its slope shows irrelevant evolution in the passive sample, being steeper in
groups than in clusters. However, the sub-sample of high-mass passive galaxies
only is characterized by a steep increase of the slope with redshift, from
which it can be inferred that the bulk of the slope evolution of the ZM
relation is driven by the more massive passive objects. (...ABRIDGED...)
The ZM relation for the star-forming sample reveals an increasing scatter
with redshift, indicating that it is still being built at early epochs. The
star-forming galaxies make up a tight sequence in the SFR-M_* plane at high
redshift, whose scatter increases with time alongside with the consolidation of
the passive sequence. We also confirm the anti-correlation between sSFR and
stellar mass, pointing at a key role of the former in determining the galaxy
downsizing, as the most significant means of diagnostics of the star formation
efficiency. Likewise, an anti-correlation between sSFR and metallicity can be
established for the star-forming galaxies, while on the contrary more active
galaxies in terms of simple SFR are also metal-richer.
We discuss these results in terms of the mechanisms driving the evolution
within the high- and low-mass regimes at different epochs: mergers,
feedback-driven outflows and the intrinsic variation of the star formation
efficiency.
[8]
oai:arXiv.org:1311.5562 [pdf] - 796943
3D simulations of the early stages of AGN jets: geometry, thermodynamics
and backflow
Submitted: 2013-11-21, last modified: 2014-03-14
We investigate the interplay between jets from Active Galactic Nuclei (AGNs)
and the surrounding InterStellar Medium (ISM) through full 3D, high resolution,
Adaptive Mesh Refinement simulations performed with the FLASH code. We follow
the jet- ISM system for several Myr in its transition from an early, compact
source to an extended one including a large cocoon. During the jet evolution,
we identify three major evolutionary stages and we find that, contrary to the
prediction of popular theoretical models, none of the simulations shows a
self-similar behavior. We also follow the evolution of the energy budget, and
find that the fraction of input power deposited into the ISM (the AGN coupling
constant) is of order of a few percent during the first few Myr. This is in
broad agreement with galaxy formation models employing AGN feedback. However,
we find that in these early stages, this energy is deposited only in a small
fraction (< 1%) of the total ISM volume. Finally we demonstrate the relevance
of backflows arising within the extended cocoon generated by a relativistic AGN
jet within the ISM of its host galaxy, previously proposed as a mechanism for
self-regulating the gas accretion onto the central object. These backflows tend
later to be destabilized by the 3D dynamics, rather than by hydrodynamic
(Kelvin- Helmholtz) instabilities. Yet, in the first few hundred thousand
years, backflows may create a central accretion region of significant extent,
and convey there as much as a few millions of solar masses.
[9]
oai:arXiv.org:1003.3877 [pdf] - 1025834
Dissecting the spin distribution of Dark Matter halos
Submitted: 2010-03-19, last modified: 2010-07-16
(Abridged) We apply a very general statistical theorem introduced by Cramer
(1936) to study the origin of the deviations of the halo spin PDF from the
reference lognormal shape. We find that these deviations originate from
correlations between two quantities entering the definition of spin, namely the
ratio $J/M^{5/2}$ (which depends only on mass) and the total gravitational
binding energy $E$. To reach this conclusion, we have made usage of the results
deduced from two high spatial- and mass resolution simulations. Our simulations
cover a relatively small volume and produce a sample of more than 16.000
gravitationally bound halos, each traced by at least 300 particles. We verify
that our results are stable to different systematics, by comparing our results
with those derived by the GIF2 and by a more recent simulation performed by
Maccio' et al. We find that the spin probability distribution function shows
systematic deviations from a lognormal, at all redshifts z <= 1. These
deviations depend on mass and redshift: at small masses they change little with
redshift, and also the best lognormal fits are more stable. The J-M
relationship is well described by a power law of exponent $\alpha$ very near to
the linear theory prediction (alpha=5/3), but systematically lower than this at
z<= 0.3. We argue that the fact that deviations from a lognormal PDF are
present only for high-spin halos could point to a role of large-scale tidal
fields in the evolution of the spin PDF.