We study the stochastic formalism of inflation beyond the usual slow-roll approximation. We verify that the assumptions on which the stochastic formalism relies still hold even far from the slow-roll attractor. This includes demonstrating the validity of the separate universe approach to evolving long-wavelength scalar field perturbations beyond slow roll. We also explain that, in general, there is a gauge correction to the amplitude of the stochastic noise. This is because the amplitude is usually calculated in the spatially-flat gauge, while the number of e-folds is used as the time variable (hence one works in the uniform-$N$ gauge) in the Langevin equations. We show that these corrections vanish in the slow-roll limit, but we also explain how to calculate them in general. We compute them in difference cases, including ultra-slow roll and the Starobinsky model that interpolates between slow roll and ultra-slow roll, and find the corrections to be negligible in practice. This confirms the validity of the stochastic formalism for studying quantum backreaction effects in the very early universe beyond slow roll.

It is often claimed that the ultra-slow-roll regime of inflation, where the dynamics of the inflaton field are friction dominated, is a non-attractor and/or transient. In this work we carry out a phase-space analysis of ultra-slow roll in an arbitrary potential, $V(\phi)$. We show that while standard slow roll is always a dynamical attractor whenever it is a self-consistent approximation, ultra-slow roll is stable for an inflaton field rolling down a convex potential with $M_{\scriptscriptstyle{\mathrm{Pl}}} V''>|V'|$ (or for a field rolling up a concave potential with $M_{\scriptscriptstyle{\mathrm{Pl}}} V''<-|V'|$). In particular, when approaching a flat inflection point, ultra-slow roll is always stable and a large number of $e$-folds may be realised in this regime. However, in ultra-slow roll, $\dot{\phi}$ is not a unique function of $\phi$ as it is in slow roll and dependence on initial conditions is retained. We confirm our analytical results with numerical examples.

We calculate the full probability density function (PDF) of inflationary curvature perturbations, even in the presence of large quantum backreaction. Making use of the stochastic-$\delta N$ formalism, two complementary methods are developed, one based on solving an ordinary differential equation for the characteristic function of the PDF, and the other based on solving a heat equation for the PDF directly. In the classical limit where quantum diffusion is small, we develop an expansion scheme that not only recovers the standard Gaussian PDF at leading order, but also allows us to calculate the first non-Gaussian corrections to the usual result. In the opposite limit where quantum diffusion is large, we find that the PDF is given by an elliptic theta function, which is fully characterised by the ratio between the squared width and height (in Planck mass units) of the region where stochastic effects dominate. We then apply these results to the calculation of the mass fraction of primordial black holes from inflation, and show that no more than $\sim 1$ $e$-fold can be spent in regions of the potential dominated by quantum diffusion. We explain how this requirement constrains inflationary potentials with two examples.