We present observations collected in the CFHTLS-VIPERS region in the ultraviolet (UV) with the GALEX satellite (far and near UV channels) and the near infrared with the CFHT/WIRCam camera ($K_s$-band) over an area of 22 and 27 deg$^2$, respectively. The depth of the photometry was optimized to measure the physical properties (e.g., SFR, stellar masses) of all the galaxies in the VIPERS spectroscopic survey. The large volume explored by VIPERS will enable a unique investigation of the relationship between the galaxy properties and their environment (density field and cosmic web) at high redshift (0.5 < z < 1.2). In this paper, we present the observations, the data reductions and the build-up of the multi-color catalogues. The CFHTLS-T0007 (gri-{\chi}^2) images are used as reference to detect and measure the $K_s$-band photometry, while the T0007 u-selected sources are used as priors to perform the GALEX photometry based on a dedicated software (EMphot). Our final sample reaches $NUV_{AB}$~25 (at 5{\sigma}) and $K_{AB}$~22 (at 3{\sigma}). The large spectroscopic sample (~51,000 spectroscopic redshifts) allows us to highlight the robustness of our star/galaxy separation, and the reliability of our photometric redshifts with a typical accuracy $\sigma_z \le$ 0.04 and a catastrophic failure rate {\eta} < 2% down to i~23. We present various tests on the $K_s$ band completeness and photometric redshift accuracy by comparing with existing, overlapping deep photometric catalogues. Finally, we discuss the BzK sample of passive and active galaxies at high redshift and the evolution of galaxy morphology in the (NUV-r) vs (r-K_s) diagram at low redshift (z < 0.25) thanks to the high image quality of the CFHTLS. The images, catalogues and photometric redshifts for 1.5 million sources (down to $NUV \le$ 25 or $K_s \le$ 22) are released and available at this URL: http://cesam.lam.fr/vipers-mls/