The new three year WMAP data seem to confirm the presence of non-standard large scale features in the Cosmic Microwave Anisotropies power spectrum. While these features may hint at uncorrected experimental systematics, it is also possible to generate, in a cosmological way, oscillations on large angular scales by introducing a sharp step in the inflaton potential. Using current cosmological data, we derive constraints on the position, magnitude and gradient of a possible step. We show that a step in the inflaton potential, while strongly constrained by current data, is still allowed and may provide an interesting explanation to the currently measured deviations from the standard featureless spectrum. Moreover, we show that inflationary oscillations in the primordial power spectrum can significantly bias parameter estimates from standard ruler methods involving measurements of baryon oscillations.