Scientific applications are often complex, irregular, and computationally-intensive. To accommodate the ever-increasing computational demands of scientific applications, high-performance computing (HPC) systems have become larger and more complex, offering parallelism at multiple levels (e.g., nodes, cores per node, threads per core). Scientific applications need to exploit all the available multilevel hardware parallelism to harness the available computational power. The performance of applications executing on such HPC systems may adversely be affected by load imbalance at multiple levels, caused by problem, algorithmic, and systemic characteristics. Nevertheless, most existing load balancing methods do not simultaneously address load imbalance at multiple levels. This work investigates the impact of load imbalance on the performance of three scientific applications at the thread and process levels. We jointly apply and evaluate selected dynamic loop self-scheduling (DLS) techniques to both levels. Specifically, we employ the extended LaPeSD OpenMP runtime library at the thread level and extend the DLS4LB MPI-based dynamic load balancing library at the process level. This approach is generic and applicable to any multiprocess-multithreaded computationally-intensive application (programmed using MPI and OpenMP). We conduct an exhaustive set of experiments to assess and compare six DLS techniques at the thread level and eleven at the process level. The results show that improved application performance, by up to 21%, can only be achieved by jointly addressing load imbalance at the two levels. We offer insights into the performance of the selected DLS techniques and discuss the interplay of load balancing at the thread level and process level.

One of the most computationally demanding aspects of the hydrodynamical modelling of Astrophysical phenomena is the transport of energy by radiation or relativistic particles. Physical processes involving energy transport are ubiquitous and of capital importance in many scenarios ranging from planet formation to cosmic structure evolution, including explosive events like core collapse supernova or gamma-ray bursts. Moreover, the ability to model and hence understand these processes has often been limited by the approximations and incompleteness in the treatment of radiation and relativistic particles. The DIAPHANE project has focused in developing a portable and scalable library that handles the transport of radiation and particles (in particular neutrinos) independently of the underlying hydrodynamic code. In this work, we present the computational framework and the functionalities of the first version of the DIAPHANE library, which has been successfully ported to three different smoothed-particle hydrodynamic codes, GADGET2, GASOLINE and SPHYNX. We also present validation of different modules solving the equations of radiation and neutrino transport using different numerical schemes.

Hydrodynamical instabilities and shocks are ubiquitous in astrophysical scenarios. Therefore, an accurate numerical simulation of these phenomena is mandatory to correctly model and understand many astrophysical events, such as Supernovas, stellar collisions, or planetary formation. In this work, we attempt to address many of the problems that the smoothed particle hydrodynamics (SPH) technique has when dealing with subsonic hydrodynamical instabilities or shocks. To that aim we built a new SPH code named SPHYNX, that includes many of the recent advances in the SPH technique and some other new ones, which we present here. SPHYNX is of Newtonian type and grounded in the Euler-Lagrange formulation of the SPH technique. Its distinctive features are: the use of an integral approach to estimating the gradients; the use of a flexible family of interpolators called sinc kernels, which suppress pairing instability; and the incorporation of a new type of volume element which provides a better partition of the unity. Unlike other modern formulations, which consider volume elements linked to pressure, our volume element choice relies on density. SPHYNX conserves mass, linear and angular momentum, energy, entropy, and preserves kernel normalization even in strong shocks. The coupling between the integral approach to calculate gradients and the new family of volume elements reduces the so-called tensile instability. Both features help to suppress the damp which often prevents the growth of hydrodynamic instabilities in regular SPH codes. On the whole, SPHYNX has passed the verification tests described below. For identical particle setting and initial conditions the results were similar (or better in some particular cases) than those obtained with other SPH schemes such as GADGET-2, PSPH or with the recent density-independent formulation (DISPH) and conservative reproducing kernel (CRKSPH) techniques.

We present a detailed, 3D hydrodynamics study of the neutrino-driven winds that emerge from the remnant of a NS merger. Our simulations are performed with the Newtonian, Eulerian code FISH, augmented by a detailed, spectral neutrino leakage scheme that accounts for heating due to neutrino absorption in optically thin conditions. Consistent with the 2D study of Dessart et al. (2009), we find that a strong baryonic wind is blown out along the original binary rotation axis within $100$ ms after the merger. We compute a lower limit on the expelled mass of $3.5 \times 10^{-3} M_{\odot}$, large enough to be relevant for heavy element nucleosynthesis. The physical properties vary significantly between different wind regions. For example, due to stronger neutrino irradiation, the polar regions show substantially larger $Y_e$ than those at lower latitudes. This has its bearings on the nucleosynthesis: the polar ejecta produce interesting r-process contributions from $A\sim 80$ to about 130, while the more neutron-rich, lower-latitude parts produce also elements up to the third r-process peak near $A\sim 195$. We also calculate the properties of electromagnetic transients that are powered by the radioactivity in the wind, in addition to the macronova transient that stems from the dynamic ejecta. The high-latitude (polar) regions produce UV/optical transients reaching luminosities up to $10^{41} {\rm erg \, s^{-1}}$, which peak around 1 day in optical and 0.3 days in bolometric luminosity. The lower-latitude regions, due to their contamination with high-opacity heavy elements, produce dimmer and more red signals, peaking after $\sim 2$ days in optical and infrared. Our numerical experiments indicate that it will be difficult to infer the collapse time-scale of the HMNS to a BH based on the wind electromagnetic transient, at least for collapse time-scales larger than the wind production time-scale.

We introduce a new algorithm for the calculation of multidimensional optical depths in approximate radiative transport schemes, equally applicable to neutrinos and photons. Motivated by (but not limited to) neutrino transport in three-dimensional simulations of core-collapse supernovae and neutron star mergers, our method makes no assumptions about the geometry of the matter distribution, apart from expecting optically transparent boundaries. Based on local information about opacities, the algorithm figures out an escape route that tends to minimize the optical depth without assuming any pre-defined paths for radiation. Its adaptivity makes it suitable for a variety of astrophysical settings with complicated geometry (e.g., core-collapse supernovae, compact binary mergers, tidal disruptions, star formation, etc.). We implement the MODA algorithm into both a Eulerian hydrodynamics code with a fixed, uniform grid and into an SPH code where we make use a tree structure that is otherwise used for searching neighbours and calculating gravity. In a series of numerical experiments, we compare the MODA results with analytically known solutions. We also use snapshots from actual 3D simulations and compare the results of MODA with those obtained with other methods such as the global and local ray-by-ray method. It turns out that MODA achieves excellent accuracy at a moderate computational cost. In an appendix we also discuss implementation details and parallelization strategies.

The behavior of IAD_0 scheme, a fully conservative SPH scheme based on a tensor formulation, is analyzed in connection with several astrophysical scenarios, and compared to the same simulations carried out with the standard SPH technique. The proposed hydrodynamic scheme is validated using a variety of numerical tests that cover important topics in astrophysics, such as the evolution of supernova remnants, the stability of self-gravitating bodies and the coalescence of compact objects. The results suggest that the SPH scheme built with the integral approach to the derivatives premise improves the results of the standard SPH technique. In particular, it is observed a better development of hydrodynamic instabilities, an improved description of self-gravitant structures in equilibrium and a reasonable description of the process of coalescence of two white dwarfs. A good energy, and linear and angular momentum conservation, generally better than that of standard SPH, was also obtained. In addition the new scheme is less susceptible to suffer pairing instability.

In this paper we develop and test a fully conservative SPH scheme based on a tensor formulation that can be applied to simulate astrophysical systems. In the proposed scheme, derivatives are calculated from an integral expression that leads to a tensor (instead of a vectorial) estimation of gradients and reduces to the standard formulation in the continuum limit. The new formulation improves the interpolation of physical magnitudes, leading to a set of conservative equations that resembles those of standard SPH. The resulting scheme is verified using a variety of well-known tests, all of them simulated in two dimensions. We also discuss an application of the proposed tensor method to astrophysics by simulating the stability of a Sun-like polytrope calculated in three dimensions.

Observational evidences point to a common explosion mechanism of Type Ia supernovae based on a delayed detonation of a white dwarf. However, all attempts to find a convincing ignition mechanism based on a delayed detonation in a destabilized, expanding, white dwarf have been elusive so far. One of the possibilities that has been invoked is that an inefficient deflagration leads to pulsation of a Chandrasekhar-mass white dwarf, followed by formation of an accretion shock that confines a carbon-oxygen rich core, while transforming the kinetic energy of the collapsing halo into thermal energy of the core, until an inward moving detonation is formed. This chain of events has been termed Pulsating Reverse Detonation (PRD). In this work we present three dimensional numerical simulations of PRD models from the time of detonation initiation up to homologous expansion. Different models characterized by the amount of mass burned during the deflagration phase, M_defl, give explosions spanning a range of kinetic energies, K ~ (1.0-1.2) foes, and 56Ni masses, M(56Ni) ~ 0.6-0.8 M_sun, which are compatible with what is expected for typical Type Ia supernovae. Spectra and light curves of angle-averaged spherically symmetric versions of the PRD models are discussed. Type Ia supernova spectra pose the most stringent requirements on PRD models.

The axisymmetric form of the hydrodynamic equations within the smoothed particle hydrodynamics (SPH) formalism is presented and checked using idealized scenarios taken from astrophysics (free fall collapse, implosion and further pulsation of a sun-like star), gas dynamics (wall heating problem, collision of two streams of gas) and inertial confinement fusion (ICF, -ablative implosion of a small capsule-). New material concerning the standard SPH formalism is given. That includes the numerical handling of those mass points which move close to the singularity axis, more accurate expressions for the artificial viscosity and the heat conduction term and an easy way to incorporate self-gravity in the simulations. The algorithm developed to compute gravity does not rely in any sort of grid, leading to a numerical scheme totally compatible with the lagrangian nature of the SPH equations.

A set of interpolating functions of the type f(v)={(sin[v pi/2])/(v pi/2)}^n is analyzed in the context of the smoothed-particle hydrodynamics (SPH) technique. The behaviour of these kernels for several values of the parameter n has been studied either analytically as well as numerically in connection with several tests carried out in two dimensions. The main advantage of this kernel relies in its flexibility because for n=3 it is similar to the standard widely used cubic-spline, whereas for n>3 the interpolating function becomes more centrally condensed, being well suited to track discontinuities such as shock fronts and thermal waves.

The physical structure of a nuclear flame is a basic ingredient of the theory of Type Ia supernovae (SNIa). Assuming an exponential density reduction with several characteristic times we have followed the evolution of a planar nuclear flame in an expanding background from an initial density 6.6 10^7 g/cm3 down to 2 10^6 g/cm3. The total amount of synthesized intermediate-mass elements (IME), from silicon to calcium, was monitored during the calculation. We have made use of the computed mass fractions, X_IME, of these elements to give an estimation of the total amount of IME synthesized during the deflagration of a massive white dwarf. Using X_IME and adopting the usual hypothesis that turbulence decouples the effective burning velocity from the laminar flame speed, so that the relevant flame speed is actually the turbulent speed on the integral length-scale, we have built a simple geometrical approach to model the region where IME are thought to be produced. It turns out that a healthy production of IME involves the combination of not too short expansion times, t_c > 0.2 s, and high turbulent intensities. According to our results it could be difficult to produce much more than 0.2 solar masses of intermediate-mass elements within the deflagrative paradigma. The calculations also suggest that the mass of IME scales with the mass of Fe-peak elements, making it difficult to conciliate energetic explosions with low ejected nickel masses, as in the well observed SN1991bg or in SN1998de. Thus a large production of Si-peak elements, especially in combination with a low or a moderate production of iron, could be better addressed by either the delayed detonation route in standard Chandrasekhar-mass models or, perhaps, by the off-center helium detonation in the sub Chandrasekhar-mass scenario.