The Galactic diffuse soft gamma-ray (30-800 keV) emission has been measured from the Galactic Center by the HIREGS balloon-borne germanium spectrometer to determine the spectral characteristics and origin of the emission. The resulting Galactic diffuse continuum is found to agree well with a single power-law (plus positronium) over the entire energy range, consistent with RXTE and COMPTEL/CGRO observations at lower and higher energies, respectively. We find no evidence of spectral steepening below 200 keV, as has been reported in previous observations. The spatial distribution along the Galactic ridge is found to be nearly flat, with upper limits set on the longitudinal gradient, and with no evidence of an edge in the observed region. The soft gamma-ray diffuse spectrum is well modeled by inverse Compton scattering of interstellar radiation off of cosmic-ray electrons, minimizing the need to invoke inefficient nonthermal bremsstrahlung emission. The resulting power requirement is well within that provided by Galactic supernovae. We speculate that the measured spectrum provides the first direct constraints on the cosmic-ray electron spectrum below 300 MeV.