Processing of raw data from modern astronomical instruments is nowadays often carried out using dedicated software, so-called "pipelines" which are largely run in automated operation. In this paper we describe the data reduction pipeline of the Multi Unit Spectroscopic Explorer (MUSE) integral field spectrograph operated at ESO's Paranal observatory. This spectrograph is a complex machine: it records data of 1152 separate spatial elements on detectors in its 24 integral field units. Efficiently handling such data requires sophisticated software, a high degree of automation and parallelization. We describe the algorithms of all processing steps that operate on calibrations and science data in detail, and explain how the raw science data gets transformed into calibrated datacubes. We finally check the quality of selected procedures and output data products, and demonstrate that the pipeline provides datacubes ready for scientific analysis.

The Astropy project supports and fosters the development of open-source and openly-developed Python packages that provide commonly-needed functionality to the astronomical community. A key element of the Astropy project is the core package Astropy, which serves as the foundation for more specialized projects and packages. In this article, we provide an overview of the organization of the Astropy project and summarize key features in the core package as of the recent major release, version 2.0. We then describe the project infrastructure designed to facilitate and support development for a broader ecosystem of inter-operable packages. We conclude with a future outlook of planned new features and directions for the broader Astropy project.

Debian Astro is a Debian Pure Blend that aims to distribute the available astronomy software within the Debian operating system. Using Debian as the foundation has unique advantages for end-users and developers such as an easy installation and upgrading of packages, an open distribution and development model, or the reproducibility due to the standardized build system.

The Astropy Project (http://astropy.org) is, in its own words, "a community effort to develop a single core package for Astronomy in Python and foster interoperability between Python astronomy packages." For five years this project has been managed, written, and operated as a grassroots, self-organized, almost entirely volunteer effort while the software is used by the majority of the astronomical community. Despite this, the project has always been and remains to this day effectively unfunded. Further, contributors receive little or no formal recognition for creating and supporting what is now critical software. This paper explores the problem in detail, outlines possible solutions to correct this, and presents a few suggestions on how to address the sustainability of general purpose astronomical software.

MUSE, a giant integral field spectrograph, is about to become the newest facility instrument at the VLT. It will see first light in February 2014. Here, we summarize the properties of the instrument as built and outline functionality of the data reduction system, that transforms the raw data that gets recorded separately in 24 IFUs by 4k CCDs, into a fully calibrated, scientifically usable data cube. We then describe recent work regarding geometrical calibration of the instrument and testing of the processing pipeline, before concluding with results of the Preliminary Acceptance in Europe and an outlook to the on-sky commissioning.

The Flexible Image Transport System (FITS) standard has been a great boon to astronomy, allowing observatories, scientists and the public to exchange astronomical information easily. The FITS standard, however, is showing its age. Developed in the late 1970s, the FITS authors made a number of implementation choices that, while common at the time, are now seen to limit its utility with modern data. The authors of the FITS standard could not anticipate the challenges which we are facing today in astronomical computing. Difficulties we now face include, but are not limited to, addressing the need to handle an expanded range of specialized data product types (data models), being more conducive to the networked exchange and storage of data, handling very large datasets, and capturing significantly more complex metadata and data relationships. There are members of the community today who find some or all of these limitations unworkable, and have decided to move ahead with storing data in other formats. If this fragmentation continues, we risk abandoning the advantages of broad interoperability, and ready archivability, that the FITS format provides for astronomy. In this paper we detail some selected important problems which exist within the FITS standard today. These problems may provide insight into deeper underlying issues which reside in the format and we provide a discussion of some lessons learned. It is not our intention here to prescribe specific remedies to these issues; rather, it is to call attention of the FITS and greater astronomical computing communities to these problems in the hope that it will spur action to address them.

We present the first public version (v0.2) of the open-source and community-developed Python package, Astropy. This package provides core astronomy-related functionality to the community, including support for domain-specific file formats such as Flexible Image Transport System (FITS) files, Virtual Observatory (VO) tables, and common ASCII table formats, unit and physical quantity conversions, physical constants specific to astronomy, celestial coordinate and time transformations, world coordinate system (WCS) support, generalized containers for representing gridded as well as tabular data, and a framework for cosmological transformations and conversions. Significant functionality is under active development, such as a model fitting framework, VO client and server tools, and aperture and point spread function (PSF) photometry tools. The core development team is actively making additions and enhancements to the current code base, and we encourage anyone interested to participate in the development of future Astropy versions.

MUSE, the Multi Unit Spectroscopic Explorer, is a 2nd generation integral-field spectrograph under final assembly to see first light at the Very Large Telescope in 2013. By capturing ~ 90000 optical spectra in a single exposure, MUSE represents a challenge for data reduction and analysis. We summarise here the main features of the Data Reduction System, as well as some of the tools under development by the MUSE consortium and the DAHLIA team to handle the large MUSE datacubes (about 4x?10^8 pixels) to recover the original astrophysical signal.

[abridged] We carry out an integral field spectroscopy (IFS) study of a sample of luminous BCGs, with the aim to probe the morphology, kinematics, dust extinction and excitation mechanisms of their warm interstellar medium (ISM). IFS data for five luminous BCGs were obtained using VIRUS-P, the prototype instrument for the Visible Integral Field Replicable Unit Spectrograph, attached to the 2.7m Harlan J. Smith Telescope at the McDonald Observatory. VIRUS-P consists of a square array of 247 optical fibers, which covers a 109"x109" field of view, with a spatial sampling of 4.2" and a 0.3 filling factor. We observed in the 3550-5850 Angstrom spectral range, with a resolution of 5 A FWHM. From these data we built two-dimensional maps of the continuum and the most prominent emission-lines ([OII]3727, Hgamma, Hbeta and [OIII]5007), and investigate the morphology of diagnostic emission-line ratios and the extinction patterns in the ISM as well as stellar and gas kinematics. Additionally, from integrated spectra we infer total line fluxes and luminosity-weighted extinction coefficients and gas-phase metallicities. All galaxies exhibit an overall regular morphology in the stellar continuum, while their warm ISM morphology is more complex: in II Zw 33 and Mrk 314, the star-forming regions are aligned along a chain-structure; Haro 1, NGC 4670 and III Zw 102 display several salient features, such as extended gaseous filaments and bubbles. A significant intrinsic absorption by dust is present in all galaxies, the most extreme case being III Zw 102. Our data reveal a manifold of kinematical patterns, from overall regular gas and stellar rotation to complex velocity fields produced by structurally and kinematically distinct components.

(ABRIDGED) We present an analysis of NGC588 based on IFS data with PMAS, together with Spitzer images at 8 mi and 24 mi. The extinction distribution in the optical shows complex structure, with maxima correlating in position with those of the emission at 24 mi and 8 mi. The Ha luminosity absorbed by the dust within the GHIIR reproduces the structure observed in the 24 mi image, supporting the use of this band as a tracer of recent star formation. A velocity difference of ~50 km/s was measured between the areas of high and low surface brightness, which would be expected if NGC588 were an evolved GHIIR. Line ratios used in the BPT diagnostic diagrams show a larger range of variation in the low surface brightness areas. The ranges are ~0.5 to 1.2 dex for [NII]/Ha, 0.7 to 1.7 dex for [SII]/Ha, and 0.3 to 0.5 dex for [OIII]/Hb. Ratios corresponding to large ionization parameter (U) are found between the peak of the emission in Hb and the main ionizing source decreasing radially outwards within the region. Differences between the integrated and local values of the U tracers can be as high as ~0.8 dex. [OII]/Hb and [OIII]/[OII] yield similar local values for U and consistent with those expected from the integrated spectrum of an HII region ionized by a single star. The ratio [SII]/Ha departs significantly from the range predicted by this scenario, indicating the complex ionization structure in GHIIRs. There is a significant scatter in derivations of Z using strong line tracers as a function of position, caused by variations in the degree of ionization. The scatter is smaller for N2O3 which points to this tracer as a better Z tracer than N2. The comparison between integrated and local line ratio values indicates that measurements of the line ratios of GHIIR in galaxies at distances >~25 Mpc may be dominated by the ionization conditions in their low surface brightness areas.

New LED-transmitters have been used to develop a new method of fast analog transmission of PMT pulses over large distances. The transmitters, consisting basically of InGaAsP LEDs with the maximum emission of light at 1300 nm, allow the transmission of fast photomultiplier pulses over distances of more than 2 km. The shape of the photomultiplier pulses is maintained, with an attenuation less than 1 dB/km. Typical applications of analog optical signal transmission are surface air shower detectors and underwater/ice neutrino experiments, which measure fast Cherenkov or scintillator pulses at large detector distances to the central DAQ system.