Normalized to: Arth, A.
[1]
oai:arXiv.org:2003.10850 [pdf] - 2069198
Gadget3 on GPUs with OpenACC
Submitted: 2020-03-24
We present preliminary results of a GPU porting of all main Gadget3 modules
(gravity computation, SPH density computation, SPH hydrodynamic force, and
thermal conduction) using OpenACC directives. Here we assign one GPU to each
MPI rank and exploit both the host and accellerator capabilities by overlapping
computations on the CPUs and GPUs: while GPUs asynchronously compute
interactions between particles within their MPI ranks, CPUs perform tree-walks
and MPI communications of neighbouring particles. We profile various portions
of the code to understand the origin of our speedup, where we find that a peak
speedup is not achieved because of time-steps with few active particles. We run
a hydrodynamic cosmological simulation from the Magneticum project, with
$2\cdot10^{7}$ particles, where we find a final total speedup of $\approx 2.$
We also present the results of an encouraging scaling test of a preliminary
gravity-only OpenACC porting, run in the context of the EuroHack17 event, where
the prototype of the porting proved to keep a constant speedup up to $1024$
GPUs.
[2]
oai:arXiv.org:1907.11250 [pdf] - 1926981
WVTICs -- SPH initial conditions for everyone
Submitted: 2019-07-25, last modified: 2019-07-31
We present a novel and fast application to generate glass-like initial
conditions for Lagrangian hydrodynamic schemes (e.g. Smoothed Particle
Hydrodynamics (SPH)) following arbitrary density models based on weighted
Voronoi tessellations and combine it with improved initial configurations and
an additional particle reshuffling scheme. We show our application's ability to
sample different kinds of density features and to converge properly towards the
given model density as well as a glass-like particle configuration. We analyse
convergence with iterations as well as with varying particle number.
Additionally, we demonstrate the versatility of the implemented algorithms by
providing an extensive test suite for standard (magneto-) hydrodynamic test
cases as well as a few common astrophysical applications. We indicate the
potential to bridge further between observational astronomy and simulations as
well as applicability to other fields of science by advanced features such as
describing a density model using gridded data for exampling from an image file
instead of an analytic model.
[3]
oai:arXiv.org:1901.05969 [pdf] - 1823099
The Three Hundred Project: Ram pressure and gas content of haloes and
subhaloes in the phase-space plane
Arthur, Jake;
Pearce, Frazer R.;
Gray, Meghan E.;
Knebe, Alexander;
Cui, Weiguang;
Elahi, Pascal J.;
Power, Chris;
Yepes, Gustavo;
Arth, Alexander;
De Petris, Marco;
Dolag, Klaus;
Garratt-Smithson, Lilian;
Old, Lyndsay J.;
Rasia, Elena;
Stevens, Adam R. H.
Submitted: 2019-01-17
We use TheThreeHundred project, a suite of 324 resimulated massive galaxy
clusters embedded in a broad range of environments, to investigate (i) how the
gas content of surrounding haloes correlates with phase-space position at
$z=0$, and (ii) to investigate the role that ram pressure plays in this
correlation. By stacking all 324 normalised phase-space planes containing
169287 haloes and subhaloes, we show that the halo gas content is tightly
correlated with phase-space position. At $\sim\,1.5-2\,\text{R}_{\text{200}}$
of the cluster dark matter halo, we find an extremely steep decline in the halo
gas content of infalling haloes and subhaloes irrespective of cluster mass,
possibly indicating the presence of an accretion shock. We also find that
subhaloes are particularly gas-poor, even in the cluster outskirts, which could
indicate active regions of ongoing pre-processing. By modelling the
instantaneous ram pressure experienced by each halo and subhalo at $z=0$, we
show that the ram pressure intensity is also well correlated with phase-space
position, which is again irrespective of cluster mass. In fact, we show that
regions in the phase-space plane with high differential velocity between a halo
or subhalo and its local gas environment, are almost mutually exclusive with
high halo gas content regions. This suggests a causal link between the gas
content of objects and the instantaneous ram pressure they experience, where
the dominant factor is the differential velocity.
[4]
oai:arXiv.org:1812.04009 [pdf] - 1807361
The Three Hundred Project: The evolution of galaxy cluster density
profiles
Submitted: 2018-12-10
Recent numerical studies of the dark matter density profiles of massive
galaxy clusters ($M_{\rm halo} > 10^{15}$M$_{\odot}$) show that their median
radial mass density profile remains unchanged up to $z > 1$, displaying a
highly self-similar evolution. We verify this by using the data set of the THE
THREE HUNDRED project, i.e. 324 cluster-sized haloes as found in full physics
hydrodynamical simulations. We track the progenitors of the mass-complete
sample of clusters at $z=0$, and find that their median shape is already in
place by $z=2.5$. However, selecting a dynamically relaxed subsample ($\sim16$
per cent of the clusters), we observe a shift of the scale radius $r_s$ towards
larger values at earlier times. Classifying the whole sample by formation time,
this evolution is understood as a result of a two-phase halo mass accretion
process. Early-forming clusters -- identified as relaxed today -- have already
entered their slow accretion phase, hence their mass growth occurs mostly at
the outskirts. Late-forming clusters -- which are still unrelaxed today -- are
in their fast accretion phase, thus the central region of the clusters is still
growing. We conclude that the density profile of galaxy clusters shows a
profound self-similarity out to redshifts $z\sim2.5$. This result holds for
both gas and total density profiles when including baryonic physics, as
reported here for two rather distinct sub-grid models.
[5]
oai:arXiv.org:1809.05244 [pdf] - 1791018
The Three Hundred Project: The influence of environment on simulated
galaxy properties
Wang, Yang;
Pearce, Frazer R.;
Knebe, Alexander;
Yepes, Gustavo;
Cui, Weiguang;
Power, Chris;
Arth, Alexander;
Gottlober, Stefan;
De Petris, Marco;
Brown, Shaun;
Feng, Longlong
Submitted: 2018-09-13, last modified: 2018-12-04
The relationship between galaxy properties and environment is a widely
discussed topic within astrophysics. Here we use galaxy samples from
hydrodynamical re-simulations to examine this relationship. We use the
over-density ($\delta_1$) within a $1 h^{-1}{\rm Mpc}$ sphere around a galaxy
to evaluate its environment. Then the relations between galaxy properties, such
as specific star formation rate(sSFR), fraction of star forming galaxies, $g-r$
colour and $\delta_1$ are examined within three galactic samples formed from
galaxies within large clusters, those in the vicinity of large clusters and
those in the field. We find tight environmental correlations for these galaxy
properties. In brief, galaxies in denser environments tend to be redder and are
more likely to be quenched. This is consistent with observations. We find that
although the sSFR decreases with $\delta_1$, this is mainly because that
galaxies with higher stellar mass reside in environment with higher
overdensity. At fixed over-density a galaxy's color is also independent of
whether it lives within a cluster or within the field, but the relative
fractions of the two samples varies dramatically with over-density and this
drives an apparent evolution.
[6]
oai:arXiv.org:1809.04622 [pdf] - 1749784
The Three Hundred project: a large catalogue of theoretically modelled
galaxy clusters for cosmological and astrophysical applications
Cui, Weiguang;
Knebe, Alexander;
Yepes, Gustavo;
Pearce, Frazer;
Power, Chris;
Dave, Romeel;
Arth, Alexander;
Borgani, Stefano;
Dolag, Klaus;
Elahi, Pascal;
Mostoghiu, Robert;
Murante, Giuseppe;
Rasia, Elena;
Stoppacher, Doris;
Vega-Ferrero, Jesus;
Wang, Yang;
Yang, Xiaohu;
Benson, Andrew;
Cora, Sofía A.;
Croton, Darren J.;
Sinha, Manodeep;
Stevens, Adam R. H.;
Vega-Martínez, Cristian A.;
Arthur, Jake;
Baldi, Anna S.;
Cañas, Rodrigo;
Cialone, Giammarco;
Cunnama, Daniel;
De Petris, Marco;
Durando, Giacomo;
Ettori, Stefano;
Gottlöber, Stefan;
Nuza, Sebastián E.;
Old, Lyndsay J.;
Pilipenko, Sergey;
Sorce, Jenny G.;
Welker, Charlotte
Submitted: 2018-09-12
We introduce the THE THREE HUNDRED project, an endeavour to model 324 large
galaxy clusters with full-physics hydrodynamical re-simulations. Here we
present the data set and study the differences to observations for fundamental
galaxy cluster properties and scaling relations. We find that the modelled
galaxy clusters are generally in reasonable agreement with observations with
respect to baryonic fractions and gas scaling relations at redshift z = 0.
However, there are still some (model-dependent) differences, such as central
galaxies being too massive, and galaxy colours (g - r) being bluer (about 0.2
dex lower at the peak position) than in observations. The agreement in gas
scaling relations down to 10^{13} h^{-1} M_{\odot} between the simulations
indicates that particulars of the sub-grid modelling of the baryonic physics
only has a weak influence on these relations. We also include - where
appropriate - a comparison to three semi-analytical galaxy formation models as
applied to the same underlying dark-matter-only simulation. All simulations and
derived data products are publicly available.
[7]
oai:arXiv.org:1808.09975 [pdf] - 1790954
Magnetic buoyancy in simulated galactic discs with a realistic circum
galactic medium
Submitted: 2018-08-29
We present simulations of isolated disc galaxies in a realistic environment
performed with the Tree-SPMHD-Code Gadget-3. Our simulations include a
spherical circum-galactic medium (CGM) surrounding the galactic disc, motivated
by observations and the results of cosmological simulations. We present three
galactic models with different halo masses between 10e10 Msol and 10e12 Msol,
and for each we use two different approaches to seed the magnetic field, as
well as a control simulation without a magnetic field. We find that the
amplification of the magnetic field in the centre of the disc leads to a
biconical magnetic outflow of gas that magnetizes the CGM. This biconical
magnetic outflow reduces the star formation rate (SFR) of the galaxy by roughly
40 percent compared to the simulations without magnetic fields. As the key
aspect of our simulations, we find that small scale turbulent motion of the gas
in the disc leads to the amplification of the magnetic field up to tens of
10e-6 G, as long as the magnetic field strength is low. For stronger magnetic
fields turbulent motion does not lead to significant amplification but is
replaced by an alpha-omega dynamo. The occurance of a small scale turbulent
dynamo becomes apparent through the magnetic power spectrum and analysis of the
field lines' curvature. In accordance with recent observations we find an
anti-correlation between the spiral structure in the gas density and in the
magnetic field due to a diffusion term added to the induction equation.
[8]
oai:arXiv.org:1803.03652 [pdf] - 1647648
SPH to Grid: a new integral conserving method
Submitted: 2018-03-09
Analysing data from Smoothed Particle Hydrodynamics (SPH) simulations is
about understanding global fluid properties rather than individual fluid
elements. Therefore, in order to properly understand the outcome of such
simulations it is crucial to transition from a particle to a grid based
picture. In this paper we briefly summarise different methods of calculating a
representative volume discretisation from SPH data and propose an improved
version of commonly used techniques. We present a possibility to generate
accurate 2D data directly without the CPU time and memory consuming detour over
a 3D grid. We lay out the importance of an accurate algorithm to conserve
integral fluid properties and to properly treat small scale structures using a
typical galaxy simulation snapshot. For demonstration purposes we additionally
calculate velocity power spectra and as expected find the main differences on
small scales. Finally we propose two new multi-purpose analysis packages which
utilise the new algorithms: Pygad and SPHMapper.
[9]
oai:arXiv.org:1711.07985 [pdf] - 1648704
Declining rotation curves at $z=2$ in $\Lambda$CDM galaxy formation
simulations
Submitted: 2017-11-21, last modified: 2018-02-14
Selecting disk galaxies from the cosmological, hydrodynamical simulation
Magneticum Pathfinder we show that almost half of our poster child disk
galaxies at $z=2$ show significantly declining rotation curves and low dark
matter fractions, very similar to recently reported observations. These
galaxies do not show any anomalous behavior, reside in standard dark matter
halos and typically grow significantly in mass until $z = 0$, where they span
all morphological classes, including disk galaxies matching present day
rotation curves and observed dark matter fractions. Our findings demonstrate
that declining rotation curves and low dark matter fractions in rotation
dominated galaxies at $z=2$ appear naturally within the $\Lambda$CDM paradigm
and reflect the complex baryonic physics, which plays a role at the peak epoch
of star-formation. In addition, we find some dispersion dominated galaxies at
$z=2$ which host a significant gas disk and exhibit similar shaped rotation
curves as the disk galaxy population, rendering it difficult to differentiate
between these two populations with currently available observation techniques.
[10]
oai:arXiv.org:1412.6533 [pdf] - 1579580
Anisotropic thermal conduction in galaxy clusters with MHD in Gadget
Submitted: 2014-12-19, last modified: 2017-09-15
We present an implementation of thermal conduction including the anisotropic
effects of magnetic fields for SPH. The anisotropic thermal conduction is
mainly proceeding parallel to magnetic fields and suppressed perpendicular to
the fields. We derive the SPH formalism for the anisotropic heat transport and
solve the corresponding equation with an implicit conjugate gradient scheme. We
discuss several issues of unphysical heat transport in the cases of extreme
ansiotropies or unmagnetized regions and present possible numerical
workarounds. We implement our algorithm into the GADGET code and study its
behaviour in several test cases. In general, we reproduce the analytical
solutions of our idealised test problems, and obtain good results in
cosmological simulations of galaxy cluster formations. Within galaxy clusters,
the anisotropic conduction produces a net heat transport similar to an
isotropic Spitzer conduction model with an efficiency of one per cent. In
contrast to isotropic conduction our new formalism allows small-scale structure
in the temperature distribution to remain stable, because of their decoupling
caused by magnetic field lines. Compared to observations, isotropic conduction
with more than 10 per cent of the Spitzer value leads to an oversmoothed
temperature distribution within clusters, while the results obtained with
anisotropic thermal conduction reproduce the observed temperature fluctuations
well. A proper treatment of heat transport is crucial especially in the
outskirts of clusters and also in high density regions. It's connection to the
local dynamical state of the cluster also might contribute to the observed
bimodal distribution of cool core and non cool core clusters. Our new scheme
significantly advances the modelling of thermal conduction in numerical
simulations and overall gives better results compared to observations.
[11]
oai:arXiv.org:1502.07358 [pdf] - 1296120
An improved SPH scheme for cosmological simulations
Beck, A. M.;
Murante, G.;
Arth, A.;
Remus, R. -S.;
Teklu, A. F.;
Donnert, J. M. F.;
Planelles, S.;
Beck, M. C.;
Foerster, P.;
Imgrund, M.;
Dolag, K.;
Borgani, S.
Submitted: 2015-02-25, last modified: 2015-10-20
We present an implementation of smoothed particle hydrodynamics (SPH) with
improved accuracy for simulations of galaxies and the large-scale structure. In
particular, we combine, implement, modify and test a vast majority of SPH
improvement techniques in the latest instalment of the GADGET code. We use the
Wendland kernel functions, a particle wake-up time-step limiting mechanism and
a time-dependent scheme for artificial viscosity, which includes a high-order
gradient computation and shear flow limiter. Additionally, we include a novel
prescription for time-dependent artificial conduction, which corrects for
gravitationally induced pressure gradients and largely improves the SPH
performance in capturing the development of gas-dynamical instabilities. We
extensively test our new implementation in a wide range of hydrodynamical
standard tests including weak and strong shocks as well as shear flows,
turbulent spectra, gas mixing, hydrostatic equilibria and self-gravitating gas
clouds. We jointly employ all modifications; however, when necessary we study
the performance of individual code modules. We approximate hydrodynamical
states more accurately and with significantly less noise than standard SPH.
Furthermore, the new implementation promotes the mixing of entropy between
different fluid phases, also within cosmological simulations. Finally, we study
the performance of the hydrodynamical solver in the context of radiative galaxy
formation and non-radiative galaxy cluster formation. We find galactic disks to
be colder, thinner and more extended and our results on galaxy clusters show
entropy cores instead of steadily declining entropy profiles. In summary, we
demonstrate that our improved SPH implementation overcomes most of the
undesirable limitations of standard SPH, thus becoming the core of an efficient
code for large cosmological simulations.