Bayesian statistics and MCMC (Markov Chain Monte Carlo) algorithms have found their place in the field of Cosmology. They have become important mathematical and numerical tools, especially in parameter estimation and model comparison. In this paper we review some of the fundamental concepts to understand Bayesian statistics, to then introduce the MCMC algorithms and samplers that allow us to perform the parameter inference procedure. We also provide a general description of the standard cosmological model, known as the $\Lambda$CDM model, along with several alternatives to it; and current datasets coming from astrophysical and cosmological observations. Finally, with the tools acquired we use a MCMC algorithm implemented in python -called SimpleMC- to test the cosmological models and find out the combination of parameters that best describes the universe.