The delensing procedure is an effective tool for removing lensing-induced $B$-mode polarization in the Cosmic Microwave Background to allow for deep searches of primordial $B$-modes. However, the delensing algorithm existing in the literature breaks down if the target $B$-mode signals overlap significantly with the lensing $B$-mode ($\sim 300<l<2000$) in multipole-$l$ space. In this paper, we identify the cause of the breakdown to be correlations between the input $B$-map and the deflection field estimator ($EB$). The amplitude of this bias is quantified by numerical simulations and compared to the analytically derived functional form. We also propose a revised delensing procedure that circumvents the bias. While the newly identified bias does not affect the search of degree scale $B$-mode generated by tensor perturbations, the modified delensing algorithm makes it possible to perform deep searches of high-$l$ $B$-modes such as those generated by patchy reionization, cosmic strings, or rotation of polarization angles. Finally, we estimate how well future polarization experiments can do in detecting tensor- and cosmic string- generated $B$-mode after delensing and comment on different survey strategies.