We consider the evolution of millisecond radio pulsars in binary systems with a main-sequence or evolved stellar companion. Evolution of non-accreting binary systems with "eclipsing" milisecond pulsars was described by Klu\'zniak, Czerny & Ray (1992) who predicted that systems like the one containing the Terzan 5 PSR 1744-24A will in the future become accreting low mass X-ray binaries (LMXBs), while PSR 1957+20 may evaporate its companion. The model presented in the current paper gives similar results for these two objects and allows to obtain diverse evolutionary tracks of millisecond pulsars with low mass companions (black widows). Our results suggest that the properties of many black widow systems can be explained by an ablation phase lasting a few hundred million years. Some of these sources may regain Roche lobe contact in a comparable time, and become LMXBs.