As Compact Steep Spectrum radio sources have been shown to be more asymmetrical than larger sources of similar powers, there is a high probability that they interact with an asymmetric medium in the central regions of the host elliptical galaxy. We consider a simple analytical model of the propagation of radio jets through a reasonable asymmetric environment and show that they can yield the range of arm-length and luminosity asymmetries that have been observed. We then generalize this to allow for the effects of orientation, and quantify the substantial enhancements of the asymmetries that can be produced in this fashion. We present two-dimensional and three-dimensional simulations of jets propagating through multi-phase media and note that the results from the simulations are also broadly consistent with the observations.