We estimate the halo mass function (HMF) by applying the excursion set approach to the non-linear cosmic density field. Thereby, we account for the non-Gaussianity of today's density distribution and constrain the HMF independent of the linear collapse threshold $\delta_{\textrm{crit}}$. We consider a spherical region as a halo, if its density today exceeds the virial overdensity threshold $\Delta$. We model the probability distribution of the non-linear density field by a superposition of a Gaussian and a lognormal distribution, which we constrain with the bispectrum of density fluctuations, predicted by the kinetic field theory description of cosmic structure formation. Two different excursion set approaches are compared. The first treats the density $\delta$ as an uncorrelated random walk of the smoothing scale $R$. The second assumes $\delta(R)$ to be correlated. We find that the resulting HMFs correspond well to the HMF found in numerical simulations if the correlation of $\delta(R)$ is taken into account. Furthermore, the HMF depends only weakly on the choice of the density threshold $\Delta$.

A recent comparison of the massive galaxy cluster Abell 2744 with the Millennium XXL (MXXL) N-body simulation has hinted at a tension between the observed substructure distribution and the predictions of LambdaCDM. Follow-up investigations indicated that this could be due to the contribution from the host halo and the subhalo finding algorithm used. To be independent of any subhalo finding algorithm, we therefore investigate the particle data of the MXXL simulation directly. We propose a new method to find substructures in 2D mass maps using a wavelet transform, which treats the simulation and observations equally. Using the same criteria to define a subhalo in observations and simulated data, we find three Abell 2744 analogues in the MXXL simulation. Thus the observations in Abell 2744 are in agreement with the predictions of LambdaCDM. We investigate the reasons for the discrepancy between the results obtained from the SUBFIND and full particle data analyses. We find that this is due to incompatible substructure definitions in observations and SUBFIND.

We present a gravitational lensing and X-ray analysis of a massive galaxy cluster and its surroundings. The core of MACS\,J0717.5+3745 ($M(R<1\,{\rm Mpc})\sim$\,$2$$\times$$10^{15}\,\msun$, $z$=$0.54$) is already known to contain four merging components. We show that this is surrounded by at least seven additional substructures with masses ranging from $3.8-6.5\times10^{13}\,\msun$, at projected radii $1.6$ to $4.9$\,Mpc. We compare MACS\,J0717 to mock lensing and X-ray observations of similarly rich clusters in cosmological simulations. The low gas fraction of substructures predicted by simulations turns out to match our observed values of $1$--$4\%$. Comparing our data to three similar simulated halos, we infer a typical growth rate and substructure infall velocity. That suggests MACS\,J0717 could evolve into a system similar to, but more massive than, Abell\,2744 by $z=0.31$, and into a $\sim$\,$10^{16}\,\msun$ supercluster by $z=0$. The radial distribution of infalling substructure suggests that merger events are strongly episodic; however we find that the smooth accretion of surrounding material remains the main source of mass growth even for such massive clusters.

The massive substructures found in Abell 2744 by Jauzac et al. (2016) present a challenge to the cold dark matter paradigm due to their number and proximity to the cluster centre. We use one of the biggest N-body simulations, the Millennium XXL, to investigate the substructure in a large sample of massive dark matter haloes. A range of effects which influence the comparison with the observations is considered, extending the preliminary evaluation carried out by Jauzac et al. (2016). There are many tens of haloes in the simulation with a total mass comparable with or larger than that of Abell 2744. However, we find no haloes with a number and distribution of massive substructures (> 5 10^13 Msun) that is close to that inferred from the observations of Abell 2744. The application of extreme value statistics suggests that we would need a simulation of at least ten times the volume of the Millennium XXL to find a single dark matter halo with a similar internal structure to Abell 2744. Explaining the distribution of massive substructures in clusters is a new hurdle for hierarchical models to negotiate, which is not weakened by appeals to baryonic physics or uncertainty over the nature of the dark matter particle.

We present a joint optical/X-ray analysis of the massive galaxy cluster Abell 2744 (z=0.308). Our strong- and weak-lensing analysis within the central region of the cluster, i.e., at R<1Mpc from the brightest cluster galaxy, reveals eight substructures, including the main core. All of these dark-matter halos are detected with a significance of at least 5sigma and feature masses ranging from 0.5 to 1.4x10^{14}Msun within R<150kpc. Merten et al. (2011) and Medezinski et al. (2016) substructures are also detected by us. We measure a slightly higher mass for the main core component than reported previously and attribute the discrepancy to the inclusion of our tightly constrained strong-lensing mass model built on Hubble Frontier Fields data. X-ray data obtained by XMM-Newton reveal four remnant cores, one of them a new detection, and three shocks. Unlike Merten et al. (2011), we find all cores to have both dark and luminous counterparts. A comparison with clusters of similar mass in the MXXL simulations yields no objects with as many massive substructures as observed in Abell 2744, confirming that Abell 2744 is an extreme system. We stress that these properties still do not constitute a challenge to $\Lambda$CDM, as caveats apply to both the simulation and the observations: for instance, the projected mass measurements from gravitational lensing and the limited resolution of the sub-haloes finders. We discuss implications of Abell 2744 for the plausibility of different dark-matter candidates and, finally, measure a new upper limit on the self-interaction cross-section of dark matter of sigma_{DM}<1.28cm2/g(68\% CL), in good agreement with previous results from Harvey et al. (2015).