The recent coincident detection of gravitational waves (GW) from a binary neutron star merger with aLIGO/Virgo and short-lived gamma-ray emission with Fermi/GBM (called GW 170817) is a milestone for the establishment of multi-messenger astronomy. Merging neutron stars (NS) represent the standard scenario for short-duration (< 2 sec) gamma-ray bursts (GRBs) which are produced in a collimated, relativistically expanding jet with an opening angle of a few degrees and a bulk Lorentz factor of 300-1000. While the present aLIGO detection is consistent with predictions, the measured faint gamma-ray emission from GW 170817A, if associated to the merger event at a distance of 40 Mpc, is about 1000x less luminous than known short-duration GRBs (sGRBs). Hence, the presence of this sGRB in the local Universe is either a very rare event, or points to a dramatic ignorance of the emission properties of sGRBs outside their narrow jets. Here we show that the majority of previously detected faint sGRBs are local, at redshift smaller than 0.1, seen off-axis. In contrast, the brighter sGRBs are seen on-axis, and therefore out to larger distances, consistent with the measured redshift distribution. Examining the observer-frame parameter space of all Fermi/GBM sGRBs shows that the sGRB associated with GW 170817A is extreme in its combination of flux, spectral softness and temporal structure. We identify a group of similar GRBs, one of which has been associated to a bright galaxy at 75 Mpc. We incorporate off-axis emission in the estimate of the rates of sGRBs, and predict that the majority of future GW-detections of NS-NS mergers will be accompanied by faint gamma-ray emission, contrary to previous thinking. The much more frequent off-axis emission of sGRBs also implies a much higher deadly rate of gamma-rays for extraterrestrial life in the Universe.