We present nsCouette, a highly scalable software tool to solve the Navier-Stokes equations for incompressible fluid flow between differentially heated and independently rotating, concentric cylinders. It is based on a pseudospectral spatial discretization and dynamic time-stepping. It is implemented in modern Fortran with a hybrid MPI-OpenMP parallelization scheme and thus designed to compute turbulent flows at high Reynolds and Rayleigh numbers. An additional GPU implementation (C-CUDA) for intermediate problem sizes and a basic version for turbulent pipe flow (nsPipe) are also provided.

We report a direct-numerical-simulation study of Taylor-Couette flow in the quasi-Keplerian regime at shear Reynolds numbers up to $\mathcal{O}(10^5)$. Quasi-Keplerian rotating flow has been investigated for decades as a simplified model system to study the origin of turbulence in accretion disks that is not fully understood. The flow in this study is axially periodic and thus the experimental end-wall effects on the stability of the flow are avoided. Using optimal linear perturbations as initial conditions, our simulations find no sustained turbulence: the strong initial perturbations distort the velocity profile and trigger turbulence that eventually decays.

The numerical simulation of turbulence and flows in almost ideal, large-Reynolds-number astrophysical plasmas motivates the implementation of almost conservative MHD computer codes. They should efficiently calculate, use highly parallelized schemes scaling well with large numbers of CPU cores, allows to obtain a high grid resolution over large simulation domains and which can easily be adapted to new computer architectures as well as to new initial and boundary conditions, allow modular extensions. The new massively parallel simulation code GOEMHD3 enables efficient and fast simulations of almost ideal, large-Reynolds-number astrophysical plasma flows, well resolved and on huge grids covering large domains. Its abilities are validated by major tests of ideal and weakly dissipative plasma phenomena. The high resolution ($2048^3$ grid points) simulation of a large part of the solar corona above an observed active region proved the excellent parallel scalability of the code using more than 30.000 processor cores.

A hybrid-parallel direct-numerical-simulation method with application to turbulent Taylor-Couette flow is presented. The Navier-Stokes equations are discretized in cylindrical coordinates with the spectral Fourier-Galerkin method in the axial and azimuthal directions, and high-order finite differences in the radial direction. Time is advanced by a second-order, semi-implicit projection scheme, which requires the solution of five Helmholtz/Poisson equations, avoids staggered grids and renders very small slip velocities. Nonlinear terms are computed with the pseudospectral method. The code is parallelized using a hybrid MPI-OpenMP strategy, which is simpler to implement, reduces inter-node communications and is more efficient compared to a flat MPI parallelization. A strong scaling study shows that the hybrid code maintains very good scalability up to more than 20000 processor cores and thus allows to perform simulations at higher resolutions than previously feasible, and opens up the possibility to simulate turbulent Taylor-Couette flows at Reynolds numbers up to $\mathcal{O}(10^5)$. This enables to probe hydrodynamic turbulence in Keplerian flows in experimentally relevant regimes.

The VERTEX code is employed for multi-dimensional neutrino-radiation hydrodynamics simulations of core-collapse supernova explosions from first principles. The code is considered state-of-the-art in supernova research and it has been used for modeling for more than a decade, resulting in numerous scientific publications. The computational performance of the code, which is currently deployed on several high-performance computing (HPC) systems up to the Tier-0 class (e.g. in the framework of the European PRACE initiative and the German GAUSS program), however, has so far not been extensively documented. This paper presents a high-level overview of the relevant algorithms and parallelization strategies and outlines the technical challenges and achievements encountered along the evolution of the code from the gigaflops scale with the first, serial simulations in 2000, up to almost petaflops capabilities, as demonstrated lately on the SuperMUC system of the Leibniz Supercomputing Centre (LRZ). In particular, we shall document the parallel scalability and computational efficiency of VERTEX at the large scale and on the major, contemporary HPC platforms. We will outline upcoming scientific requirements and discuss the resulting challenges for the future development and operation of the code.

We have developed GPU versions for two major high-performance-computing (HPC) applications originating from two different scientific domains. GENE is a plasma microturbulence code which is employed for simulations of nuclear fusion plasmas. VERTEX is a neutrino-radiation hydrodynamics code for "first principles"-simulations of core-collapse supernova explosions. The codes are considered state of the art in their respective scientific domains, both concerning their scientific scope and functionality as well as the achievable compute performance, in particular parallel scalability on all relevant HPC platforms. GENE and VERTEX were ported by us to HPC cluster architectures with two NVidia Kepler GPUs mounted in each node in addition to two Intel Xeon CPUs of the Sandy Bridge family. On such platforms we achieve up to twofold gains in the overall application performance in the sense of a reduction of the time to solution for a given setup with respect to a pure CPU cluster. The paper describes our basic porting strategies and benchmarking methodology, and details the main algorithmic and technical challenges we faced on the new, heterogeneous architecture.

1D and 2D supernova simulations for stars between 11 and 25 solar masses are presented, making use of the Prometheus/Vertex neutrino-hydrodynamics code, which employs a full spectral treatment of the neutrino transport. Multi-dimensional transport aspects are treated by the ``ray-by-ray plus'' approximation described in Paper I. Our set of models includes a 2D calculation for a 15 solar mass star whose iron core is assumed to rotate rigidly with an angular frequency of 0.5 rad/s before collapse. No important differences were found depending on whether random seed perturbations for triggering convection are included already during core collapse, or whether they are imposed on a 1D collapse model shortly after bounce. Convection below the neutrinosphere sets in about 40 ms p.b. at a density above 10**12 g/cm^3 in all 2D models, and encompasses a layer of growing mass as time goes on. It leads to a more extended proto-neutron star structure with accelerated lepton number and energy loss and significantly higher muon and tau neutrino luminosities, but reduced mean energies of the radiated neutrinos, at times later than ~100 ms p.b. In case of an 11.2 solar mass star we find that low (l = 1,2) convective modes cause a probably rather weak explosion by the convectively supported neutrino-heating mechanism after ~150 ms p.b. when the 2D simulation is performed with a full 180 degree grid, whereas the same simulation with 90 degree wedge fails to explode like all other models. This sensitivity demonstrates the proximity of our 2D models to the borderline between success and failure, and stresses the need of simulations in 3D, ultimately without the axis singularity of a polar grid. (abridged)

Supernova models with a full spectral treatment of the neutrino transport are presented, employing the Prometheus/Vertex neutrino-hydrodynamics code with a ``ray-by-ray plus'' approximation for treating two- (or three-) dimensional problems. The method is described in detail and critically assessed with respect to its capabilities, limitations, and inaccuracies in the context of supernova simulations. In this first paper of a series, 1D and 2D core-collapse calculations for a (nonrotating) 15 M_sun star are discussed, uncertainties in the treatment of the equation of state -- numerical and physical -- are tested, Newtonian results are compared with simulations using a general relativistic potential, bremsstrahlung and interactions of neutrinos of different flavors are investigated, and the standard approximation in neutrino-nucleon interactions with zero energy transfer is replaced by rates that include corrections due to nucleon recoil, thermal motions, weak magnetism, and nucleon correlations. Models with the full implementation of the ``ray-by-ray plus'' spectral transport were found not to explode, neither in spherical symmetry nor in 2D with a 90 degree lateral wedge. The success of previous 2D simulations with grey, flux-limited neutrino diffusion can therefore not be confirmed. Omitting the radial velocity terms in the neutrino momentum equation leads to ``artificial'' explosions by increasing the neutrino energy density in the convective gain layer by about 20--30% and thus the integral neutrino energy deposition in this region by about a factor of two. (abbreviated)

The role of ion-ion correlations in suppressing neutrino-nucleus elastic scattering during stellar core collapse is reinvestigated, using two different equations of state. We test the improved description by Itoh et al. against the treatment suggested by Horowitz and find that the stronger cross section reduction for small momentum transfer in the former case does not lead to noticeable changes of the core deleptonization and entropy increase during collapse, because the improvements are relevant below neutrino trapping conditions only for very low neutrino energies, corresponding to a very small phase space volume. Treating screening effects for ionic mixtures by the linear mixing rule, applied to the collection of representative heavy nucleus, alpha particles, and free nucleons, which is assumed to characterize the composition in nuclear statistical equilibrium, we cannot determine mentionable differences during stellar collapse, because alpha particles are not sufficiently abundant and their coherent scattering opacity is too small.

One of the robust features found in simulations of core-collapse supernovae (SNe) is the prompt neutronization burst, i.e. the first $\sim 25$ milliseconds after bounce when the SN emits with very high luminosity mainly $\nu_e$ neutrinos. We examine the dependence of this burst on variations in the input of current SN models and find that recent improvements of the electron capture rates as well as uncertainties in the nuclear equation of state or a variation of the progenitor mass have only little effect on the signature of the neutronization peak in a megaton water Cherenkov detector for different neutrino mixing schemes. We show that exploiting the time-structure of the neutronization peak allows one to identify the case of a normal mass hierarchy and large 13-mixing angle $\theta_{13}$, where the peak is absent. The robustness of the predicted total event number in the neutronization burst makes a measurement of the distance to the SN feasible with a precision of about 5%, even in the likely case that the SN is optically obscured.

New simulations demonstrate that low-mode, nonradial hydrodynamic instabilities of the accretion shock help starting hot-bubble convection in supernovae and thus support explosions by the neutrino-heating mechanism. The prevailing conditions depend on the high-density equation of state which governs stellar core collapse, core bounce, and neutron star formation. Tests of this sensitivity to nuclear physics variations are shown for spherically symmetric models. Implications of current explosion models for r-process nucleosynthesis are addressed.

Accurate neutrino transport has been built into spherically symmetric simulations of stellar core collapse and postbounce evolution. The results of such simulations agree that spherically symmetric models with standard microphysical input fail to explode by the delayed, neutrino-driven mechanism. Independent groups implemented fundamentally different numerical methods to tackle the Boltzmann neutrino transport equation. Here we present a direct and detailed comparison of such neutrino radiation-hydrodynamical simulations for two codes, Agile-Boltztran of the Oak Ridge-Basel group and Vertex of the Garching group. The former solves the Boltzmann equation directly by an implicit, general relativistic discrete angle method on the adaptive grid of a conservative implicit hydrodynamics code with second-order TVD advection. In contrast, the latter couples a variable Eddington factor technique with an explicit, moving-grid, conservative high-order Riemann solver with important relativistic effects treated by an effective gravitational potential. The presented study is meant to test both neutrino radiation-hydrodynamics implementations and to provide a data basis for comparisons and verifications of supernova codes to be developed in the future. Results are discussed for simulations of the core collapse and post-bounce evolution of a 13 solar mass star with Newtonian gravity and a 15 solar mass star with relativistic gravity.

We briefly summarize recent efforts in Garching for modeling stellar core collapse and post-bounce evolution in one and two dimensions. The transport of neutrinos of all flavors is treated by iteratively solving the coupled system of frequency-dependent moment equations together with a model Boltzmann equation which provides the closure. A variety of progenitor stars, different nuclear equations of state, stellar rotation, and global asymmetries due to large-mode hydrodynamic instabilities have been investigated to ascertain the road to finally successful, convectively supported neutrino-driven explosions.

Recent progress in modeling core-collapse supernovae is summarized and set in perspective. Two-dimensional simulations with state-of-the-art treatment of neutrino transport still fail to produce powerful explosions, but evidence is presented that they are very close to success.

We have computed the gravitational wave signal from supernova core collapse using the presently most realistic input physics available. We start from state-of-the-art progenitor models of rotating and non-rotating massive stars, and simulate the dynamics of their core collapse by integrating the equations of axisymmetric hydrodynamics together with the Boltzmann equation for the neutrino transport including an elaborate description of neutrino interactions, and a realistic equation of state. We compute the quadrupole wave amplitudes, the Fourier wave spectra, the amount of energy radiated in form of gravitational waves, and the S/N ratios for the LIGO and the tuned Advanced LIGO interferometers resulting both from non-radial mass motion and anisotropic neutrino emission. The simulations demonstrate that the dominant contribution to the gravitational wave signal is produced by neutrino-driven convection behind the supernova shock. For stellar cores rotating at the extreme of current stellar evolution predictions, the core-bounce signal is detectable with advanced LIGO up to a distance of 5kpc, whereas the signal from post-shock convection is observable up to a distance of about 100kpc. If the core is non-rotating its gravitational wave emission can be measured up to a distance of 15kpc, while the signal from the Ledoux convection in the deleptonizing, nascent neutron star can be detected up to a distance of 10kpc. Both kinds of signals are generically produced by convection in any core collapse supernova.

Transporting nu_mu and nu_tau in a supernova (SN) core involves several processes that have been neglected in traditional simulations. Based on a Monte Carlo study we find that the flavor-dependent spectral differences are much smaller than is often stated in the literature. A full-scale SN simulation using a Boltzmann solver and including all relevant neutrino reactions confirms these results. The flavor-dependent flux differences are largest during the initial accretion phase.

Two-dimensional hydrodynamic simulations of stellar core-collapse with and without rotation are presented which for the first time were performed by solving the Boltzmann equation for the neutrino transport including a state-of-the-art description of neutrino interactions. Although convection develops below the neutrinosphere and in the neutrino-heated region behind the supernova shock, the models do not explode. This suggests missing physics, possibly with respect to the nuclear equation of state and weak interactions in the subnuclear regime. However, it might also indicate a fundamental problem of the neutrino-driven explosion mechanism.

Supernova simulations to date have assumed that during core collapse electron captures occur dominantly on free protons, while captures on heavy nuclei are Pauli-blocked and are ignored. We have calculated rates for electron capture on nuclei with mass numbers A=65-112 for the temperatures and densities appropriate for core collapse. We find that these rates are large enough so that, in contrast to previous assumptions, electron capture on nuclei dominates over capture on free protons. This leads to significant changes in core collapse simulations.

One of the central problems in supernova theory is the question how massive stars explode. Understanding the physical processes that drive the explosion is crucial for linking the stellar progenitors to the final remnants and for predicting observable properties like explosion energies, neutron star and black hole masses, nucleosynthetic yields, explosion anisotropies, and pulsar kicks. Here we review different suggestions for the explosion mechanism and discuss the constraints that can or cannot be deduced from observations. The most refined and detailed hydrodynamical models are available for neutrino-driven supernova explosions, although the viability of this mechanism has yet to be demonstrated convincingly. Since spherical models do not explode, the hope rests on the helpful effects of convection inside the nascent neutron star and in the neutrino-heated region behind the stalled shock. We present the first two-dimensional simulations of these processes which have been performed with a Boltzmann solver for the neutrino transport and a state-of-the-art description of neutrino-matter interactions. Our most complete models fail, but convection brings them encouragingly close to a success. An explosion could be obtained by just a minor modification of the neutrino transport, in which case the exploding model fulfills important requirements from observations (abridged).

The rapidly growing base of observational data for supernova explosions of massive stars demands theoretical explanations. Central of these is a self-consistent model for the physical mechanism that provides the energy to start and drive the disruption of the star. We give arguments why the delayed neutrino-heating mechanism should still be regarded as the standard paradigm to explain most explosions of massive stars and show how large-scale and even global asymmetries can result as a natural consequence of convective overturn in the neutrino-heating region behind the supernova shock. Since the explosion is a threshold phenomenon and depends sensitively on the efficiency of the energy transfer by neutrinos, even relatively minor differences in numerical simulations can matter on the secular timescale of the delayed mechanism. To enhance this point, we present some results of recent one- and two-dimensional computations, which we have performed with a Boltzmann solver for the neutrino transport and a state-of-the-art description of neutrino-matter interactions. Although our most complete models fail to explode, the simulations demonstrate that one is encouragingly close to the critical threshold because a modest variation of the neutrino transport in combination with postshock convection leads to a weak neutrino-driven explosion with properties that fulfill important requirements from observations.

We present here the first results of two-dimensional hydrodynamical simulations of the neutrino-heating phase in the collapsed core of a 15 solar mass star, where the neutrino transport is treated with a variable Eddington factor method for solving the Boltzmann transport equation, and the neutrino interactions include nucleon-nucleon bremsstrahlung, nucleon recoils and correlations, and weak-magnetism effects as well as direct interactions between neutrinos of different flavors. With the given input physics (neutrino reactions and nuclear equation of state), our best simulations do not develop strong convection in the neutrino-heating layer behind the shock and do not yield explosions. With about 30% higher neutrino-energy deposition behind the shock, however, an explosion occurs on a timescale of 150 ms after core bounce. It leaves behind a neutron star with an initial baryonic mass of 1.4 solar masses and ejects the N = 50 isotopes of Sr, Y and Zr in amounts consistent with Galactic abundances.

Neutrino transport and neutrino interactions in dense matter play a crucial role in stellar core collapse, supernova explosions and neutron star formation. Here we present a detailed description of a new numerical code for treating the time and energy dependent neutrino transport in hydrodynamical simulations of such events. The code is based on a variable Eddington factor method to deal with the integro-differential character of the Boltzmann equation. The moments of the neutrino distribution function and the energy and lepton number exchange with the stellar medium are determined by iteratively solving the zeroth and first order moment equations in combination with a model Boltzmann equation. The latter is discretized on a grid of tangent rays. The integration of the transport equations and the neutrino source terms is performed in a time-implicit way. In the present version of the program, the transport part is coupled to an explicit hydrodynamics code which follows the evolution of the stellar plasma by a finite-volume method with piecewise parabolic interpolation, using a Riemann solver for calculating the hydrodynamic states. The neutrino source terms are implemented in an operator-split step. Neutrino transport and hydrodynamics can be calculated with different spatial grids and different time steppings. The structure of the described code is modular and offers a high degree of flexibility for an application to relativistic and multi-dimensional problems at different levels of refinement and accuracy. We critically evaluate results for a number of test cases, including neutrino transport in rapidly moving stellar media and approximate relativistic core collapse, and suggest a path for generalizing the code to be used in multi-dimensional simulations of convection in neutron stars and supernovae.

We show that in a supernova core the annihilation process nu_e nu_e-bar -> nu_{mu,tau} nu_{mu,tau}-bar is always more important than the traditional reaction e^+ e^- -> nu_{mu,tau} nu_{mu,tau}-bar as a source for muon and tau neutrino pairs. We study the impact of the new process by means of a Monte Carlo transport code with a static stellar background model and by means of a self-consistent hydrodynamical simulation with Boltzmann neutrino transport. Nucleon bremsstrahlung NN -> NN nu_{mu,tau} nu_{mu,tau}-bar is also included as another important source term. Taking into account nu_e nu_e-bar -> nu_{mu,tau} nu_{mu,tau}-bar increases the nu_mu and nu_tau luminosities by as much as 20% while the spectra remain almost unaffected. In our hydrodynamical simulation the shock was somewhat weakened. Elastic nu_{mu,tau} nu_e and nu_{mu,tau} nu_e scattering is not negligible but less important than nu_{mu,tau} e^+ or e^- scattering. Its influence on the nu_{mu,tau} fluxes and spectra is small after all other processes have been included.

Spherically symmetric simulations of stellar core collapse and post-bounce evolution are used to test the sensitivity of the supernova dynamics to different variations of the input physics. We consider a state-of-the-art description of the neutrino-nucleon interactions, possible lepton-number changing neutrino reactions in the neutron star, and the potential impact of hydrodynamic mixing behind the supernova shock.

The current picture of the collapse and explosion of massive stars and the formation of neutron stars is reviewed. According to the favored scenario, however by no means proven and undisputed, neutrinos deposit the energy of the explosion in the stellar medium which surrounds the nascent neutron star. Observations, in particular of Supernova~1987A, suggest that mixing processes play an important role in the expanding star, and multi-dimensional simulations show that these are linked to convective instabilities in the immediate vicinity of the neutron star. Convectively enhanced energy transport inside the neutron star can have important consequences for the neutrino emission and thus the neutrino-heating mechanism. This also holds for a suppression of the neutrino interactions at nuclear densities. Multi-dimensional hydrodynamics, general relativity, and a better understanding of the neutrino interactions in neutron star matter may be crucial to resolve the problem that state-of-the-art spherical models do not yield explosions even with a very accurate treatment of neutrino transport by solving the Boltzmann equation.

We present a spherically symmetric, Newtonian core-collapse simulation of a 15 solar mass star with a 1.28 solar mass iron core. The time-, energy-, and angle-dependent transport of electron neutrinos and antineutrinos was treated with a new code which iteratively solves the Boltzmann equation and the equations for neutrino number, energy and momentum to order O(v/c) in the velocity v of the stellar medium. The supernova shock expands to a maximum radius of 350 km instead of only about 240 km as in a comparable calculation with multi-group flux-limited diffusion (MGFLD) by Bruenn, Mezzacappa, & Dineva (1995). This may be explained by stronger neutrino heating due to the more accurate transport in our model. Nevertheless, after 180 ms of expansion the shock finally recedes to a radius around 250 km (compared to about 170 km in the MGFLD run). The effect of an accurate neutrino transport is helpful, but not large enough to cause an explosion of the considered 15 solar mass star. Therefore postshock convection and/or an enhancement of the core neutrino luminosity by convection or reduced neutrino opacities in the neutron star seem necessary for neutrino-driven explosions of such stars. We find an electron fraction Y_e > 0.5 in the neutrino-heated matter, which suggests that the overproduction problem of neutron-rich nuclei with mass numbers around A = 90 in exploding models may be absent when a Boltzmann solver is used for the electron neutrino and antineutrino transport.

We report on the first three-dimensional hydrodynamic simulations of secular and dynamical non-axisymmetric instabilities in collapsing, rapidly rotating stellar cores which extend well beyond core bounce. The resulting gravitational radiation has been calculated using the quadrupole approximation. We find that secular instabilities do not occur during the simulated time interval of several 10 ms. Models which become dynamically unstable during core collapse show a strong nonlinear growth of non-axisymmetric instabilities. Both random and coherent large scale initial perturbations eventually give rise to a dominant bar-like deformation ($\exp(\pm im\phi$) with $m=2$). In spite of the pronounced tri-axial deformation of certain parts of the core no considerable enhancement of the gravitational radiation is found. This is due to the fact that rapidly rotating cores re-expand after core bounce on a dynamical time scale before non-axisymmetric instabilities enter the nonlinear regime. Hence, when the core becomes tri-axial, it is no longer very compact.

The dynamics, time evolution of the mass distribution, and gravitational wave signature of coalescing neutron stars described by polytropes are compared with three simulations published previously: (a) ``Run 2'' of Zhuge et al. (1994), (b) ``Model III'' of Shibata et al. (1992), and (c) ``Model A64'' of Ruffert et al. (1996). We aim at studying the differences due to the use of different numerical methods, different implementations of the gravitational wave backreaction, and different equations of state. Comparison (a) confronts the results of our grid-based PPM scheme with those from an SPH code. We found that due to the lower numerical viscosity of the PPM code, the post-merging oscillations and pulsations could be followed for a longer time and lead to larger secondary and tertiary maxima of the gravitational wave luminosity. In case (b) two grid based codes with the same backreaction formalism but differing hydrodynamic integrators and different numerical resolution are compared. Satisfactory agreement of the amplitude of the gravitational wave luminosity is established, although due to the different initial conditions a small time delay develops in the onset of the dynamical instability. In (c) we find that using a polytropic equation of state instead of the high-density equation of state of Lattimer & Swesty (1991) does not change the overall dynamical evolution of the merger and yields agreement of the gravitational wave signature to within 20% accuracy. However, differences of the structure and evolution of the outer layers of the neutron stars are present, which has important implications for questions like mass loss and disk formation during the merging of binary neutron stars.