We show that the detection of neutrinos from a typical gamma ray burst requires a kilometer-scale detector. We argue that large bursts should be visible with the neutrino telescopes under construction. We emphasize the 3 techniques by which neutrino telescopes can perform this search: by triggering on i) bursts of muons from muon neutrinos, ii) muons from air cascades initiated by high energy gamma rays and iii) showers made by relatively low energy ($\simeq 100\,\mev$) electron neutrinos. Timing of neutrino-photon coincidences may yield a measurement of the neutrino mass to order $10^{-5}$~eV, an interesting range in light of the solar neutrino anomaly.