Processing of raw data from modern astronomical instruments is nowadays often carried out using dedicated software, so-called "pipelines" which are largely run in automated operation. In this paper we describe the data reduction pipeline of the Multi Unit Spectroscopic Explorer (MUSE) integral field spectrograph operated at ESO's Paranal observatory. This spectrograph is a complex machine: it records data of 1152 separate spatial elements on detectors in its 24 integral field units. Efficiently handling such data requires sophisticated software, a high degree of automation and parallelization. We describe the algorithms of all processing steps that operate on calibrations and science data in detail, and explain how the raw science data gets transformed into calibrated datacubes. We finally check the quality of selected procedures and output data products, and demonstrate that the pipeline provides datacubes ready for scientific analysis.

The Lya emitter (LAE) fraction, X_LAE, is a potentially powerful probe of the evolution of the intergalactic neutral hydrogen gas fraction. However, uncertainties in the measurement of X_LAE are still debated. Thanks to deep data obtained with MUSE, we can measure the evolution of X_LAE homogeneously over a wide redshift range of z~3-6 for UV-faint galaxies (down to M_1500~-17.75). This is significantly fainter than in former studies, and allows us to probe the bulk of the population of high-z star-forming galaxies. We construct a UV-complete photo-redshift sample following UV luminosity functions and measure the Lya emission with MUSE using the second data release from the MUSE HUDF Survey. We derive the redshift evolution of X_LAE for M_1500 in [-21.75;-17.75] for the first time with a equivalent width range EW(Lya)>=65 A and find low values of X_ LAE<~30% at z<~6. For M_1500 in [-20.25;-18.75] and EW(Lya)<~25 A, our X_LAE values are consistent with those in the literature within 1sigma at z<~5, but our median values are systematically lower than reported values over the whole redshift range. In addition, we do not find a significant dependence of X_LAE on M_1500 for EW(Lya)>~50 A at z~3-4, in contrast with previous work. The differences in X_LAE mainly arise from selection biases for Lyman Break Galaxies (LBGs) in the literature: UV-faint LBGs are more easily selected if they have strong Lya emission, hence X_LAE is biased towards higher values. Our results suggest either a lower increase of X_LAE towards z~6 than previously suggested, or even a turnover of X_LAE at z~5.5, which may be the signature of a late or patchy reionization process. We compared our results with predictions from a cosmological galaxy evolution model. We find that a model with a bursty star formation (SF) can reproduce our observed X_LAE much better than models where SF is a smooth function of time.

Here we describe a simple, efficient, and most importantly fully operational point-spread-function(PSF)-reconstruction approach for laser-assisted ground layer adaptive optics (GLAO) in the frame of the Multi Unit Spectroscopic Explorer (MUSE) Wide Field Mode. Based on clear astrophysical requirements derived by the MUSE team and using the functionality of the current ESO Adaptive Optics Facility we aim to develop an operational PSF-reconstruction (PSFR) algorithm and test it both in simulations and using on-sky data. The PSFR approach is based on a Fourier description of the GLAO correction to which the specific instrumental effects of MUSE Wide Field Mode (pixel size, internal aberrations, etc.) have been added. It was first thoroughly validated with full end-to-end simulations. Sensitivity to the main atmospheric and AO system parameters was analysed and the code was re-optimised to account for the sensitivity found. Finally, the optimised algorithm was tested and commissioned using more than one year of on-sky MUSE data. We demonstrate with an on-sky data analysis that our algorithm meets all the requirements imposed by the MUSE scientists, namely an accuracy better than a few percent on the critical PSF parameters including full width at half maximum and global PSF shape through the kurtosis parameter of a Moffat function. The PSFR algorithm is publicly available and is used routinely to assess the MUSE image quality for each observation. It can be included in any post-processing activity which requires knowledge of the PSF.

We present spatially resolved maps of six individually-detected Lyman alpha haloes (LAHs) as well as a first statistical analysis of the Lyman alpha (Lya) spectral signature in the circum-galactic medium of high-redshift star-forming galaxies using MUSE. Our resolved spectroscopic analysis of the LAHs reveals significant intrahalo variations of the Lya line profile. Using a three-dimensional two-component model for the Lya emission, we measure the full width at half maximum (FWHM), the peak velocity shift and the asymmetry of the Lya line in the core and in the halo of 19 galaxies. We find that the Lya line shape is statistically different in the halo compared to the core for ~40% of our galaxies. Similarly to object-by-object based studies and a recent resolved study using lensing, we find a correlation between the peak velocity shift and the width of the Lya line both at the interstellar and circum-galactic scales. While there is a lack of correlation between the spectral properties and the spatial scale lengths of our LAHs, we find a correlation between the width of the line in the LAH and the halo flux fraction. Interestingly, UV bright galaxies show broader, more redshifted and less asymmetric Lya lines in their haloes. The most significant correlation found is for the FWHM of the line and the UV continuum slope of the galaxy, suggesting that the redder galaxies have broader Lya lines. The generally broad and red line shapes found in the halo component suggests that the Lya haloes are powered either by scattering processes through an outflowing medium, fluorescent emission from outflowing cold clumps of gas, or a mix of both. Considering the large diversity of the Lya line profiles observed in our sample and the lack of strong correlation, the interpretation of our results is still broadly open and underlines the need for realistic spatially resolved models of the LAHs.

One of the major science cases of the MUSE integral field spectrograph is the detection of Lyman-alpha emitters at high redshifts. The on-going and planned deep fields observations will allow for one large sample of these sources. An efficient tool to perform blind detection of faint emitters in MUSE datacubes is a prerequisite of such an endeavor. Several line detection algorithms exist but their performance during the deepest MUSE exposures is hard to quantify, in particular with respect to their actual false detection rate, or purity. {The aim of this work is to design and validate} an algorithm that efficiently detects faint spatial-spectral emission signatures, while allowing for a stable false detection rate over the data cube and providing in the same time an automated and reliable estimation of the purity. Results on simulated data cubes providing ground truth show that the method reaches its aims in terms of purity and completeness. When applied to the deep 30-hour exposure MUSE datacube in the Hubble Ultra Deep Field, the algorithms allows for the confirmed detection of 133 intermediate redshifts galaxies and 248 Lyman Alpha Emitters, including 86 sources with no HST counterpart. The algorithm fulfills its aims in terms of detection power and reliability. It is consequently implemented as a Python package whose code and documentation are available on GitHub and readthedocs.

We use the MusE GAs FLOw and Wind (MEGAFLOW) survey to study the kinematics of extended disk-like structures of cold gas around $z\approx1$ star-forming galaxies. The combination of VLT/MUSE and VLT/UVES observations allows us to connect the kinematics of the gas measured through MgII quasar absorption spectroscopy to the kinematics and orientation of the associated galaxies constrained through integral field spectroscopy. Confirming previous results, we find that the galaxy-absorber pairs of the MEGAFLOW survey follow a strong bimodal distribution, consistent with a picture of MgII absorption being predominantly present in outflow cones and extended disk-like structures. This allows us to select a bona-fide sample of galaxy-absorber pairs probing these disks for impact parameters of 10-70 kpc. We test the hypothesis that the disk-like gas is co-rotating with the galaxy disks, and find that for 7 out of 9 pairs the absorption velocity shares the sign of the disk velocity, disfavouring random orbits. We further show that the data are roughly consistent with inflow velocities and angular momenta predicted by simulations, and that the corresponding mass accretion rates are sufficient to balance the star formation rates.

The Astropy project supports and fosters the development of open-source and openly-developed Python packages that provide commonly-needed functionality to the astronomical community. A key element of the Astropy project is the core package Astropy, which serves as the foundation for more specialized projects and packages. In this article, we provide an overview of the organization of the Astropy project and summarize key features in the core package as of the recent major release, version 2.0. We then describe the project infrastructure designed to facilitate and support development for a broader ecosystem of inter-operable packages. We conclude with a future outlook of planned new features and directions for the broader Astropy project.

We present the deepest study to date of the Lya luminosity function (LF) in a blank field using blind integral field spectroscopy from MUSE. We constructed a sample of 604 Lya emitters (LAEs) across the redshift range 2.91 < z < 6.64 using automatic detection software in the Hubble Ultra Deep Field. We calculate accurate total Lya fluxes capturing low surface brightness extended Lya emission now known to be a generic property of high-redshift star-forming galaxies. We simulated realistic extended LAEs to characterise the selection function of our samples, and performed flux-recovery experiments to test and correct for bias in our determination of total Lya fluxes. We find an accurate completeness correction accounting for extended emission reveals a very steep faint-end slope of the LF, alpha, down to luminosities of log10 L erg s^-1< 41.5, applying both the 1/Vmax and maximum likelihood estimators. Splitting the sample into three broad redshift bins, we see the faint-end slope increasing from -2.03+1.42-inf at z ~ 3.44 to -2.86+0.76-inf at z ~ 5.48, however no strong evolution is seen between the 68% confidence regions in L*-alpha parameter space. Using the Lya line flux as a proxy for star formation activity, and integrating the observed LFs, we find that LAEs' contribution to the cosmic SFRD rises with redshift until it is comparable to that from continuum-selected samples by z ~ 6. This implies that LAEs may contribute more to the star-formation activity of the early Universe than previously thought - any additional interglactic medium correction would act to further boost the Lya luminosities. Finally, assuming fiducial values for the escape of Lya and LyC radiation, and the clumpiness of the IGM, we integrated the maximum likelihood LF at 5.00 < z < 6.64 and find we require only a small extrapolation beyond the data (< 1 dex in L) for LAEs alone to maintain an ionised IGM at z ~ 6.

We report the detection of extended Lyman-alpha (Lya) haloes around 145 individual star-forming galaxies at redshifts 3<z<6 in the Hubble Ultra Deep Field observed with the Multi-Unit Spectroscopic Explorer at ESO-VLT. Our sample consists of continuum-faint (-15> M_{UV}> -22) Lya emitters (LAEs). Using a 2D, two-component decomposition of Lya emission assuming circular exponential distributions, we measure scale lengths and luminosities of Lya haloes. We find that 80% of our objects having reliable Lya halo measurements show Lya emission that is significantly more extended than the UV continuum detected by HST (by a factor ~4 to >20). The median exponential scale length of the Lya haloes in our sample is ~4.5 kpc. By comparing the maximal detected extent of the Lya emission with the predicted dark matter halo virial radii of simulated galaxies, we show that the detected Lya emission of our selected sample of LAEs probes a significant portion of the cold circum-galactic medium (CGM) of these galaxies (>50% in average). This result shows that there must be significant HI reservoirs in the CGM and reinforces the idea that Lya haloes are ubiquitous around high-redshift Lya emitting galaxies. Our characterization of the Lya haloes indicates that the majority of the Lya flux comes from the halo (~65%) and that their scale lengths seem to be linked to the UV properties of the galaxies. We do not observe a significant Lya halo size evolution with redshift. We also find that the Lya lines cover a large range of full width at half maximum (FWHM) from 118 to 512 km/s. While the FWHM does not seem to be correlated to the Lya scale length, most compact Lya haloes and those that are not detected with high significance tend to have narrower Lya profiles. Finally, we investigate the origin of the extended Lya emission but we conclude that our data do not allow us to disentangle the possible processes.

MUSE (Multi Unit Spectroscopic Explorer) is an integral-field spectrograph mounted on the Very Large Telescope (VLT) in Chile and made available to the European community since October 2014. The Centre de Recherche Astrophysique de Lyon has developed a dedicated software to help MUSE users analyze the reduced data. In this paper we introduce MPDAF, the MUSE Python Data Analysis Framework, based on several well-known Python libraries (Numpy, Scipy, Matplotlib, Astropy) which offers new tools to manipulate MUSE-specific data. We present different examples showing how this Python package may be useful for MUSE data analysis.

We have conducted a two-layered spectroscopic survey (1'x1' ultra deep and 3'x3' deep regions) in the Hubble Ultra Deep Field (HUDF) with the Multi Unit Spectroscopic Explorer (MUSE). The combination of a large field of view, high sensitivity, and wide wavelength coverage provides an order of magnitude improvement in spectroscopically confirmed redshifts in the HUDF; i.e., 1206 secure spectroscopic redshifts for HST continuum selected objects, which corresponds to 15% of the total (7904). The redshift distribution extends well beyond z>3 and to HST/F775W magnitudes as faint as ~30 mag (AB, 1-sigma). In addition, 132 secure redshifts were obtained for sources with no HST counterparts that were discovered in the MUSE data cubes by a blind search for emission-line features. In total, we present 1338 high quality redshifts, which is a factor of eight increase compared with the previously known spectroscopic redshifts in the same field. We assessed redshifts mainly with the spectral features [OII] at z<1.5 (473 objects) and Lya at 2.9<z<6.7 (692 objects). With respect to F775W magnitude, a 50% completeness is reached at 26.5 mag for ultra deep and 25.5 mag for deep fields, and the completeness remains >~20% up to 28-29 mag and ~27 mag, respectively. We used the determined redshifts to test continuum color selection (dropout) diagrams of high-z galaxies. The selection condition for F336W dropouts successfully captures ~80% of the targeted z~2.7 galaxies. However, for higher redshift selections (F435W, F606W, and F775W dropouts), the success rates decrease to ~20-40%. We empirically redefine the selection boundaries to make an attempt to improve them to ~60%. The revised boundaries allow bluer colors that capture Lya emitters with high Lya equivalent widths falling in the broadbands used for the color-color selection. Along with this paper, we release the redshift and line flux catalog.

We present the MUSE Hubble Ultra Deep Survey, a mosaic of nine MUSE fields covering 90\% of the entire HUDF region with a 10-hour deep exposure time, plus a deeper 31-hour exposure in a single 1.15 arcmin2 field. The improved observing strategy and advanced data reduction results in datacubes with sub-arcsecond spatial resolution (0.65 arcsec at 7000 A) and accurate astrometry (0.07 arcsec rms). We compare the broadband photometric properties of the datacubes to HST photometry, finding a good agreement in zeropoint up to mAB=28 but with an increasing scatter for faint objects. We have investigated the noise properties and developed an empirical way to account for the impact of the correlation introduced by the 3D drizzle interpolation. The achieved 3 sigma emission line detection limit for a point source is 1.5 and 3.1 10-19 erg.s-1.cm-2 for the single ultra-deep datacube and the mosaic, respectively. We extracted 6288 sources using an optimal extraction scheme that takes the published HST source locations as prior. In parallel, we performed a blind search of emission line galaxies using an original method based on advanced test statistics and filter matching. The blind search results in 1251 emission line galaxy candidates in the mosaic and 306 in the ultradeep datacube, including 72 sources without HST counterparts (mAB>31). In addition 88 sources missed in the HST catalog but with clear HST counterparts were identified. This data set is the deepest spectroscopic survey ever performed. In just over 100 hours of integration time, it provides nearly an order of magnitude more spectroscopic redshifts compared to the data that has been accumulated on the UDF over the past decade. The depth and high quality of these datacubes enables new and detailed studies of the physical properties of the galaxy population and their environments over a large redshift range.

Recent theoretical models suggest that the early phase of galaxy formation could involve an epoch when galaxies are gas-rich but inefficient at forming stars: a "dark galaxy" phase. Here, we report the results of our MUSE (Multi Unit Spectroscopic Explorer) survey for dark galaxies fluorescently illuminated by quasars at $z>3$. Compared to previous studies which are based on deep narrow-band (NB) imaging, our integral field survey provides a nearly uniform sensitivity coverage over a large volume in redshift space around the quasars as well as full spectral information at each location. Thanks to these unique features, we are able to build control samples at large redshift distances from the quasars using the same data taken under the same conditions. By comparing the rest-frame equivalent width (EW$_{0}$) distributions of the Ly$\alpha$ sources detected in proximity to the quasars and in control samples, we detect a clear correlation between the locations of high EW$_{0}$ objects and the quasars. This correlation is not seen in other properties such as Ly$\alpha$ luminosities or volume overdensities, suggesting the possible fluorescent nature of at least some of these objects. Among these, we find 6 sources without continuum counterparts and EW$_{0}$ limits larger than $240\,\mathrm{\AA}$ that are the best candidates for dark galaxies in our survey at $z>3.5$. The volume densities and properties, including inferred gas masses and star formation efficiencies, of these dark galaxy candidates are similar to previously detected candidates at $z\approx2.4$ in NB surveys. Moreover, if the most distant of these are fluorescently illuminated by the quasar, our results also provide a lower limit of $t=60$ Myr on the quasar lifetime.

The Multi Unit Spectroscopic Explorer (MUSE) is an integral-field spectrograph operating in the visible wavelength range, and installed at the Very Large Telescope (VLT). The official MUSE pipeline is available from ESO. However, for the data reduction of the Deep Fields program (Bacon et al., in prep.), we have built a more sophisticated reduction pipeline, with additional reduction tasks, to extend the official pipeline and produce cubes with fewer instrumental residuals.

We present observations collected in the CFHTLS-VIPERS region in the ultraviolet (UV) with the GALEX satellite (far and near UV channels) and the near infrared with the CFHT/WIRCam camera ($K_s$-band) over an area of 22 and 27 deg$^2$, respectively. The depth of the photometry was optimized to measure the physical properties (e.g., SFR, stellar masses) of all the galaxies in the VIPERS spectroscopic survey. The large volume explored by VIPERS will enable a unique investigation of the relationship between the galaxy properties and their environment (density field and cosmic web) at high redshift (0.5 < z < 1.2). In this paper, we present the observations, the data reductions and the build-up of the multi-color catalogues. The CFHTLS-T0007 (gri-{\chi}^2) images are used as reference to detect and measure the $K_s$-band photometry, while the T0007 u-selected sources are used as priors to perform the GALEX photometry based on a dedicated software (EMphot). Our final sample reaches $NUV_{AB}$~25 (at 5{\sigma}) and $K_{AB}$~22 (at 3{\sigma}). The large spectroscopic sample (~51,000 spectroscopic redshifts) allows us to highlight the robustness of our star/galaxy separation, and the reliability of our photometric redshifts with a typical accuracy $\sigma_z \le$ 0.04 and a catastrophic failure rate {\eta} < 2% down to i~23. We present various tests on the $K_s$ band completeness and photometric redshift accuracy by comparing with existing, overlapping deep photometric catalogues. Finally, we discuss the BzK sample of passive and active galaxies at high redshift and the evolution of galaxy morphology in the (NUV-r) vs (r-K_s) diagram at low redshift (z < 0.25) thanks to the high image quality of the CFHTLS. The images, catalogues and photometric redshifts for 1.5 million sources (down to $NUV \le$ 25 or $K_s \le$ 22) are released and available at this URL: http://cesam.lam.fr/vipers-mls/

We introduce Zurich Atmosphere Purge (ZAP), an approach to sky subtraction based on principal component analysis (PCA) that we have developed for the Multi Unit Spectrographic Explorer (MUSE) integral field spectrograph. ZAP employs filtering and data segmentation to enhance the inherent capabilities of PCA for sky subtraction. Extensive testing shows that ZAP reduces sky emission residuals while robustly preserving the flux and line shapes of astronomical sources. The method works in a variety of observational situations from sparse fields with a low density of sources to filled fields in which the target source fills the field of view. With the inclusion of both of these situations the method is generally applicable to many different science cases and should also be useful for other instrumentation. ZAP is available for download at http://muse-vlt.eu/science/tools.

We present the first public version (v0.2) of the open-source and community-developed Python package, Astropy. This package provides core astronomy-related functionality to the community, including support for domain-specific file formats such as Flexible Image Transport System (FITS) files, Virtual Observatory (VO) tables, and common ASCII table formats, unit and physical quantity conversions, physical constants specific to astronomy, celestial coordinate and time transformations, world coordinate system (WCS) support, generalized containers for representing gridded as well as tabular data, and a framework for cosmological transformations and conversions. Significant functionality is under active development, such as a model fitting framework, VO client and server tools, and aperture and point spread function (PSF) photometry tools. The core development team is actively making additions and enhancements to the current code base, and we encourage anyone interested to participate in the development of future Astropy versions.