We perform a comprehensive analysis of the redshift evolution of the rest-UV spectra of star-forming galaxies out to z~5. We combine new z~5 measurements of HI Ly$\alpha$ and low- and high-ionization interstellar metal absorption features with comparable measurements at z~2-4. We measure the equivalent widths of interstellar absorption features using stacked spectra in bins of Ly$\alpha$ equivalent width, performing corrections to Ly$\alpha$ strengths based on a model for the transmission of the intergalactic medium. We find a strong correlation between decreasing low-ionization absorption strength and increasing Ly$\alpha$ emission strength over the redshift range z~2-5, suggesting that both of these quantities are fundamentally linked to neutral gas covering fraction. At the highest Ly$\alpha$ equivalent widths, we observe evolution at $z\sim5$ towards greater Ly$\alpha$ emission strength at fixed low-ionization absorption strength. If we interpret the non-evolving relationship of Ly$\alpha$ emission strength and low-ionization line strength at z~2-4 as primarily reflecting the radiative transfer of Ly$\alpha$ photons, this evolution at z~5 suggests a higher intrinsic production rate of Ly$\alpha$ photons than at lower redshift. Our conclusion is supported by the joint evolution of the relationships among Ly$\alpha$ emission strength, interstellar absorption strength, and dust reddening. We perform additional analysis in bins of stellar mass, star-formation rate, UV luminosity, and age, examining how the relationships between galaxy properties and Ly$\alpha$ emission evolve towards higher redshift. We conclude that increasing intrinsic Ly$\alpha$ photon production and strong detection of nebular CIV emission (signaling lower metallicity) at z~5 indicate an elevated ionized photon production efficiency ($\xi_{\rm ion}$).

To date no direct detection of Lyman continuum emission has been measured for intermediate--redshift z~1 star-forming galaxies . We combine HST grism spectroscopy with GALEX UV and ground--based optical imaging to extend the search for escaping Lyman continuum to a large (~600) sample of z~1 low-mass, moderately star-forming galaxies selected initially on H$\alpha$ emission. The characteristic escape fraction of LyC from SFGs that populate this parameter space remains weakly constrained by previous surveys, but these faint SFGs are assumed to play a significant role in the reionization of neutral hydrogen in the intergalactic medium (IGM) at high redshift (z>6). We do not make an unambiguous detection of escaping LyC radiation from this $z\sim1$ sample, individual non--detections to constrain the absolute Lyman continuum escape fraction, $f_{esc}$<2.1% (3$\sigma$). We measure upper limits of $f_{esc}$<9.6% from a sample of SFGs selected on high H$\alpha$ equivalent width (EW>200\AA), which are thought to be close analogs of high redshift sources of reionization. For reference, we also present an emissivity--weighted escape fraction which is useful as a measurement of the general contribution of the SFGs to the z~1 ionizing UV background. In the discussion, we consider the implications of these intermediate redshift constraints for the reionization of hydrogen in the intergalactic medium at high (z > 6) redshift. If we assume our $z\sim1$ SFGs, for which we measure this emissivity-weighted $f_{esc}$, are analogs to the high redshift sources of reionization, we find is difficult reconcile reionization by faint (M$_{UV}<-13$) SFGs with a low escape fraction ($f_{esc}<$3%), with constraints from independent high redshift observations. If $f_{esc}$ evolves with redshift, reionization by SFGs may be consistent with observations from Planck.