We describe the design and performance of the near-infrared (1.51--1.70 micron), fiber-fed, multi-object (300 fibers), high resolution (R = lambda/delta lambda ~ 22,500) spectrograph built for the Apache Point Observatory Galactic Evolution Experiment (APOGEE). APOGEE is a survey of ~ 10^5 red giant stars that systematically sampled all Milky Way populations (bulge, disk, and halo) to study the Galaxy's chemical and kinematical history. It was part of the Sloan Digital Sky Survey III (SDSS-III) from 2011 -- 2014 using the 2.5 m Sloan Foundation Telescope at Apache Point Observatory, New Mexico. The APOGEE-2 survey is now using the spectrograph as part of SDSS-IV, as well as a second spectrograph, a close copy of the first, operating at the 2.5 m du Pont Telescope at Las Campanas Observatory in Chile. Although several fiber-fed, multi-object, high resolution spectrographs have been built for visual wavelength spectroscopy, the APOGEE spectrograph is one of the first such instruments built for observations in the near-infrared. The instrument's successful development was enabled by several key innovations, including a "gang connector" to allow simultaneous connections of 300 fibers; hermetically sealed feedthroughs to allow fibers to pass through the cryostat wall continuously; the first cryogenically deployed mosaic volume phase holographic grating; and a large refractive camera that includes mono-crystalline silicon and fused silica elements with diameters as large as ~ 400 mm. This paper contains a comprehensive description of all aspects of the instrument including the fiber system, optics and opto-mechanics, detector arrays, mechanics and cryogenics, instrument control, calibration system, optical performance and stability, lessons learned, and design changes for the second instrument.

On the strength of a double Nobel prize winning experiment (Super)Kamiokande and an extremely successful long baseline neutrino programme, the third generation Water Cherenkov detector, Hyper-Kamiokande, is being developed by an international collaboration as a leading worldwide experiment based in Japan. The Hyper-Kamiokande detector will be hosted in the Tochibora mine, about 295 km away from the J-PARC proton accelerator research complex in Tokai, Japan. The currently existing accelerator will be steadily upgraded to reach a MW beam by the start of the experiment. A suite of near detectors will be vital to constrain the beam for neutrino oscillation measurements. A new cavern will be excavated at the Tochibora mine to host the detector. The experiment will be the largest underground water Cherenkov detector in the world and will be instrumented with new technology photosensors, faster and with higher quantum efficiency than the ones in Super-Kamiokande. The science that will be developed will be able to shape the future theoretical framework and generations of experiments. Hyper-Kamiokande will be able to measure with the highest precision the leptonic CP violation that could explain the baryon asymmetry in the Universe. The experiment also has a demonstrated excellent capability to search for proton decay, providing a significant improvement in discovery sensitivity over current searches for the proton lifetime. The atmospheric neutrinos will allow to determine the neutrino mass ordering and, together with the beam, able to precisely test the three-flavour neutrino oscillation paradigm and search for new phenomena. A strong astrophysical programme will be carried out at the experiment that will detect supernova neutrinos and will measure precisely solar neutrino oscillation.

(Abridged) We describe here the most ambitious survey currently planned in the optical, the Large Synoptic Survey Telescope (LSST). A vast array of science will be enabled by a single wide-deep-fast sky survey, and LSST will have unique survey capability in the faint time domain. The LSST design is driven by four main science themes: probing dark energy and dark matter, taking an inventory of the Solar System, exploring the transient optical sky, and mapping the Milky Way. LSST will be a wide-field ground-based system sited at Cerro Pach\'{o}n in northern Chile. The telescope will have an 8.4 m (6.5 m effective) primary mirror, a 9.6 deg$^2$ field of view, and a 3.2 Gigapixel camera. The standard observing sequence will consist of pairs of 15-second exposures in a given field, with two such visits in each pointing in a given night. With these repeats, the LSST system is capable of imaging about 10,000 square degrees of sky in a single filter in three nights. The typical 5$\sigma$ point-source depth in a single visit in $r$ will be $\sim 24.5$ (AB). The project is in the construction phase and will begin regular survey operations by 2022. The survey area will be contained within 30,000 deg$^2$ with $\delta<+34.5^\circ$, and will be imaged multiple times in six bands, $ugrizy$, covering the wavelength range 320--1050 nm. About 90\% of the observing time will be devoted to a deep-wide-fast survey mode which will uniformly observe a 18,000 deg$^2$ region about 800 times (summed over all six bands) during the anticipated 10 years of operations, and yield a coadded map to $r\sim27.5$. The remaining 10\% of the observing time will be allocated to projects such as a Very Deep and Fast time domain survey. The goal is to make LSST data products, including a relational database of about 32 trillion observations of 40 billion objects, available to the public and scientists around the world.

In this paper, we describe the optical imaging data processing pipeline developed for the Subaru Telescope's Hyper Suprime-Cam (HSC) instrument. The HSC Pipeline builds on the prototype pipeline being developed by the Large Synoptic Survey Telescope's Data Management system, adding customizations for HSC, large-scale processing capabilities, and novel algorithms that have since been reincorporated into the LSST codebase. While designed primarily to reduce HSC Subaru Strategic Program (SSP) data, it is also the recommended pipeline for reducing general-observer HSC data. The HSC pipeline includes high level processing steps that generate coadded images and science-ready catalogs as well as low-level detrending and image characterizations.

The Astropy Project (http://astropy.org) is, in its own words, "a community effort to develop a single core package for Astronomy in Python and foster interoperability between Python astronomy packages." For five years this project has been managed, written, and operated as a grassroots, self-organized, almost entirely volunteer effort while the software is used by the majority of the astronomical community. Despite this, the project has always been and remains to this day effectively unfunded. Further, contributors receive little or no formal recognition for creating and supporting what is now critical software. This paper explores the problem in detail, outlines possible solutions to correct this, and presents a few suggestions on how to address the sustainability of general purpose astronomical software.

The Large Synoptic Survey Telescope (LSST) is a large-aperture, wide-field, ground-based survey system that will image the sky in six optical bands from 320 to 1050 nm, uniformly covering approximately $18,000$deg$^2$ of the sky over 800 times. The LSST is currently under construction on Cerro Pach\'on in Chile, and expected to enter operations in 2022. Once operational, the LSST will explore a wide range of astrophysical questions, from discovering "killer" asteroids to examining the nature of Dark Energy. The LSST will generate on average 15 TB of data per night, and will require a comprehensive Data Management system to reduce the raw data to scientifically useful catalogs and images with minimum human intervention. These reductions will result in a real-time alert stream, and eleven data releases over the 10-year duration of LSST operations. To enable this processing, the LSST project is developing a new, general-purpose, high-performance, scalable, well documented, open source data processing software stack for O/IR surveys. Prototypes of this stack are already capable of processing data from existing cameras (e.g., SDSS, DECam, MegaCam), and form the basis of the Hyper-Suprime Cam (HSC) Survey data reduction pipeline.

The third generation of the Sloan Digital Sky Survey (SDSS-III) took data from 2008 to 2014 using the original SDSS wide-field imager, the original and an upgraded multi-object fiber-fed optical spectrograph, a new near-infrared high-resolution spectrograph, and a novel optical interferometer. All the data from SDSS-III are now made public. In particular, this paper describes Data Release 11 (DR11) including all data acquired through 2013 July, and Data Release 12 (DR12) adding data acquired through 2014 July (including all data included in previous data releases), marking the end of SDSS-III observing. Relative to our previous public release (DR10), DR12 adds one million new spectra of galaxies and quasars from the Baryon Oscillation Spectroscopic Survey (BOSS) over an additional 3000 sq. deg of sky, more than triples the number of H-band spectra of stars as part of the Apache Point Observatory (APO) Galactic Evolution Experiment (APOGEE), and includes repeated accurate radial velocity measurements of 5500 stars from the Multi-Object APO Radial Velocity Exoplanet Large-area Survey (MARVELS). The APOGEE outputs now include measured abundances of 15 different elements for each star. In total, SDSS-III added 2350 sq. deg of ugriz imaging; 155,520 spectra of 138,099 stars as part of the Sloan Exploration of Galactic Understanding and Evolution 2 (SEGUE-2) survey; 2,497,484 BOSS spectra of 1,372,737 galaxies, 294,512 quasars, and 247,216 stars over 9376 sq. deg; 618,080 APOGEE spectra of 156,593 stars; and 197,040 MARVELS spectra of 5,513 stars. Since its first light in 1998, SDSS has imaged over 1/3 of the Celestial sphere in five bands and obtained over five million astronomical spectra.

The Sloan Digital Sky Survey (SDSS) has been in operation since 2000 April. This paper presents the tenth public data release (DR10) from its current incarnation, SDSS-III. This data release includes the first spectroscopic data from the Apache Point Observatory Galaxy Evolution Experiment (APOGEE), along with spectroscopic data from the Baryon Oscillation Spectroscopic Survey (BOSS) taken through 2012 July. The APOGEE instrument is a near-infrared R~22,500 300-fiber spectrograph covering 1.514--1.696 microns. The APOGEE survey is studying the chemical abundances and radial velocities of roughly 100,000 red giant star candidates in the bulge, bar, disk, and halo of the Milky Way. DR10 includes 178,397 spectra of 57,454 stars, each typically observed three or more times, from APOGEE. Derived quantities from these spectra (radial velocities, effective temperatures, surface gravities, and metallicities) are also included.DR10 also roughly doubles the number of BOSS spectra over those included in the ninth data release. DR10 includes a total of 1,507,954 BOSS spectra, comprising 927,844 galaxy spectra; 182,009 quasar spectra; and 159,327 stellar spectra, selected over 6373.2 square degrees.

We present the design and performance of the multi-object fiber spectrographs for the Sloan Digital Sky Survey (SDSS) and their upgrade for the Baryon Oscillation Spectroscopic Survey (BOSS). Originally commissioned in Fall 1999 on the 2.5-m aperture Sloan Telescope at Apache Point Observatory, the spectrographs produced more than 1.5 million spectra for the SDSS and SDSS-II surveys, enabling a wide variety of Galactic and extra-galactic science including the first observation of baryon acoustic oscillations in 2005. The spectrographs were upgraded in 2009 and are currently in use for BOSS, the flagship survey of the third-generation SDSS-III project. BOSS will measure redshifts of 1.35 million massive galaxies to redshift 0.7 and Lyman-alpha absorption of 160,000 high redshift quasars over 10,000 square degrees of sky, making percent level measurements of the absolute cosmic distance scale of the Universe and placing tight constraints on the equation of state of dark energy. The twin multi-object fiber spectrographs utilize a simple optical layout with reflective collimators, gratings, all-refractive cameras, and state-of-the-art CCD detectors to produce hundreds of spectra simultaneously in two channels over a bandpass covering the near ultraviolet to the near infrared, with a resolving power R = \lambda/FWHM ~ 2000. Building on proven heritage, the spectrographs were upgraded for BOSS with volume-phase holographic gratings and modern CCD detectors, improving the peak throughput by nearly a factor of two, extending the bandpass to cover 360 < \lambda < 1000 nm, and increasing the number of fibers from 640 to 1000 per exposure. In this paper we describe the original SDSS spectrograph design and the upgrades implemented for BOSS, and document the predicted and measured performances.

The Baryon Oscillation Spectroscopic Survey (BOSS) is designed to measure the scale of baryon acoustic oscillations (BAO) in the clustering of matter over a larger volume than the combined efforts of all previous spectroscopic surveys of large scale structure. BOSS uses 1.5 million luminous galaxies as faint as i=19.9 over 10,000 square degrees to measure BAO to redshifts z<0.7. Observations of neutral hydrogen in the Lyman alpha forest in more than 150,000 quasar spectra (g<22) will constrain BAO over the redshift range 2.15<z<3.5. Early results from BOSS include the first detection of the large-scale three-dimensional clustering of the Lyman alpha forest and a strong detection from the Data Release 9 data set of the BAO in the clustering of massive galaxies at an effective redshift z = 0.57. We project that BOSS will yield measurements of the angular diameter distance D_A to an accuracy of 1.0% at redshifts z=0.3 and z=0.57 and measurements of H(z) to 1.8% and 1.7% at the same redshifts. Forecasts for Lyman alpha forest constraints predict a measurement of an overall dilation factor that scales the highly degenerate D_A(z) and H^{-1}(z) parameters to an accuracy of 1.9% at z~2.5 when the survey is complete. Here, we provide an overview of the selection of spectroscopic targets, planning of observations, and analysis of data and data quality of BOSS.

The Sloan Digital Sky Survey III (SDSS-III) presents the first spectroscopic data from the Baryon Oscillation Spectroscopic Survey (BOSS). This ninth data release (DR9) of the SDSS project includes 535,995 new galaxy spectra (median z=0.52), 102,100 new quasar spectra (median z=2.32), and 90,897 new stellar spectra, along with the data presented in previous data releases. These spectra were obtained with the new BOSS spectrograph and were taken between 2009 December and 2011 July. In addition, the stellar parameters pipeline, which determines radial velocities, surface temperatures, surface gravities, and metallicities of stars, has been updated and refined with improvements in temperature estimates for stars with T_eff<5000 K and in metallicity estimates for stars with [Fe/H]>-0.5. DR9 includes new stellar parameters for all stars presented in DR8, including stars from SDSS-I and II, as well as those observed as part of the SDSS-III Sloan Extension for Galactic Understanding and Exploration-2 (SEGUE-2). The astrometry error introduced in the DR8 imaging catalogs has been corrected in the DR9 data products. The next data release for SDSS-III will be in Summer 2013, which will present the first data from the Apache Point Observatory Galactic Evolution Experiment (APOGEE) along with another year of data from BOSS, followed by the final SDSS-III data release in December 2014.

Using archival XMM-Newton observations of the diffuse and unresolved components emission in the inner disc of M33 we exclude the possible contribution from narrow line emission in the energy range 0.5-5 keV more intense than 10^{-6}-10^{-5} erg/s. Under the hypothesis that sterile neutrinos constitute the majority of the dark matter in M33, we use this result in order to put constraints on their parameter space in the 1-10 keV mass range.

We review current methods for building PSF-matching kernels for the purposes of image subtraction or coaddition. Such methods use a linear decomposition of the kernel on a series of basis functions. The correct choice of these basis functions is fundamental to the efficiency and effectiveness of the matching - the chosen bases should represent the underlying signal using a reasonably small number of shapes, and/or have a minimum number of user-adjustable tuning parameters. We examine methods whose bases comprise multiple Gauss-Hermite polynomials, as well as a form free basis composed of delta-functions. Kernels derived from delta-functions are unsurprisingly shown to be more expressive; they are able to take more general shapes and perform better in situations where sum-of-Gaussian methods are known to fail. However, due to its many degrees of freedom (the maximum number allowed by the kernel size) this basis tends to overfit the problem, and yields noisy kernels having large variance. We introduce a new technique to regularize these delta-function kernel solutions, which bridges the gap between the generality of delta-function kernels, and the compactness of sum-of-Gaussian kernels. Through this regularization we are able to create general kernel solutions that represent the intrinsic shape of the PSF-matching kernel with only one degree of freedom, the strength of the regularization lambda. The role of lambda is effectively to exchange variance in the resulting difference image with variance in the kernel itself. We examine considerations in choosing the value of lambda, including statistical risk estimators and the ability of the solution to predict solutions for adjacent areas. Both of these suggest moderate strengths of lambda between 0.1 and 1.0, although this optimization is likely dataset dependent.

The Small Magellanic Cloud (SMC) hosts a large number of Be/X-ray binaries, however no Be/white dwarf system is known so far, although population synthesis calculations predict that they might be more frequent than Be/neutron star systems. XMMUJ010147.5-715550 was found as a new faint super-soft X-ray source (SSS) with a likely Be star optical counterpart. We investigate the nature of this system and search for further high-absorbed candidates in the SMC. We analysed the XMM-Newton X-ray spectrum and light curve, optical photometry, and the I-band OGLE III light curve. The X-ray spectrum is well represented by black-body and white dwarf atmosphere models with highly model-dependent temperature between 20 and 100 eV. The likely optical counterpart AzV 281 showed low near infrared emission during X-ray activity, followed by a brightening in the I-band afterwards. We find further candidates for high-absorbed SSSs with a blue star as counterpart. We discuss XMMUJ010147.5-715550 as the first candidate for a Be/white dwarf binary system in the SMC.

When one splits spacetime into space plus time, the spacetime curvature (Weyl tensor) gets split into an "electric" part E_{jk} that describes tidal gravity and a "magnetic" part B_{jk} that describes differential dragging of inertial frames. We introduce tools for visualizing B_{jk} (frame-drag vortex lines, their vorticity, and vortexes) and E_{jk} (tidal tendex lines, their tendicity, and tendexes), and also visualizations of a black-hole horizon's (scalar) vorticity and tendicity. We use these tools to elucidate the nonlinear dynamics of curved spacetime in merging black-hole binaries.

Aims: IKT 16 is an X-ray and radio-faint supernova remnant (SNR) in the Small Magellanic Cloud (SMC). A previous X-ray study of this SNR found a hard X-ray source near its centre. Using all available archival and proprietary XMM-Newton data, alongside new multi-frequency radio-continuum surveys and optical observations at H-alpha and forbidden [SII] and [OIII] lines, we aim to constrain the properties of the SNR and discover the nature of the hard source within. Methods: We combine XMM-Newton datasets to produce the highest quality X-ray image of IKT 16 to date. We use this, in combination with radio and optical images, to conduct a multi-wavelength morphological analysis of the remnant. We extract separate spectra from the SNR and the bright source near its centre, and conduct spectral fitting of both regions. Results: We find IKT 16 to have a radius of 37+-3 pc, with the bright source located 8+-2 pc from the centre. This is the largest known SNR in the SMC. The large size of the remnant suggests it is likely in the Sedov-adiabatic phase of evolution. Using a Sedov model to fit the SNR spectrum, we find an electron temperature kT of 1.03+-0.12 keV and an age of 14700 yr. The absorption found requires the remnant to be located deep within the SMC. The bright source is fit with a power law with index 1.58+-0.07, and is associated with diffuse radio emission extending towards the centre of the SNR. We argue that this source is likely to be the neutron star remnant of the supernova explosion, and infer its transverse kick velocity to be 580+-100 km/s. The X-ray and radio properties of this source strongly favour a pulsar wind nebula (PWN) origin.

Large, multi-frequency imaging surveys, such as the Large Synaptic Survey Telescope (LSST), need to do near-real time analysis of very large datasets. This raises a host of statistical and computational problems where standard methods do not work. In this paper, we study a proposed method for combining stacks of images into a single summary image, sometimes referred to as a template. This task is commonly referred to as image coaddition. In part, we focus on a method proposed in previous work, which outlines a procedure for combining stacks of images in an online fashion in the Fourier domain. We evaluate this method by comparing it to two straightforward methods through the use of various criteria and simulations. Note that the goal is not to propose these comparison methods for use in their own right, but to ensure that additional complexity also provides substantially improved performance.

We present a study, based on archival XMM-Newton observations, of the extended X-ray emission associated with the inner disk of M33. After the exclusion of point sources with L_X > 2 x 10^{35} erg/s (0.3-6 keV), we investigate the morphology and spectrum of the residual X-ray emission. This residual emission has a soft X-ray spectrum which can be fitted with a two-temperature thermal model, with kT = 0.2 keV and 0.6 keV. The soft X-ray surface brightness distribution shows a strong correlation with FUV emission, indicative of a close connection between recent star-formation activity and the production of soft X-rays. Within 3.5 kpc of the nucleus of M33, the soft X-ray and FUV surface brightness distributions exhibit similar radial profiles. This implies that the ratio of the soft X-ray luminosity (0.3-2.0 keV) to the star formation rate (SFR) per unit disk area remains fairly constant within this inner disk region. We derive a value for this ratio of 1-1.5 x 10^{39} (erg/s)/(M_sun/yr), consistent with previous studies. In the same region, the ratio of soft X-ray luminosity to stellar mass (derived from K-band photometry) is 4 x 10^{28} erg/s/M_sun, a factor of 5-10 higher than is typical of dwarf elliptical galaxies, suggesting that 10-20% of the unresolved emission seen in M33 may originate in its old stellar population. The remainder of the soft X-ray emission is equally split between two spatial components, one which closely traces the spiral arms of the galaxy and the other more smoothly distributed across the inner disk of M33. The former must represent a highly clumped low-filling factor component linked to sites of recent or ongoing star formation, whereas the distribution of the latter gives few clues as to its exact origin.

We present a study of the X-ray properties of a sample of six nearby late-type spiral galaxies based on XMM-Newton observations. Since our primary focus is on the linkage between X-ray emission and star formation in extended, extranuclear galactic disks, we have selected galaxies with near face-on aspect and sufficient angular extent so as to be readily amenable to investigation with the moderate spatial resolution afforded by XMM-Newton. After excluding regions in each galaxy dominated by bright point sources, we study both the morphology and spectral properties of the residual X-ray emission, comprised of both diffuse emission and the integrated signal of the fainter discrete source populations. The soft X-ray morphology generally traces the inner spiral arms and shows a strong correlation with the distribution of UV light, indicative of a close connection between the X-ray emission and recent star formation. The soft (0.3-2 keV) X-ray luminosity to star formation rate (SFR) ratio varies from 1-5 x 10^39 erg/s(/Msun/yr), with an indication that the lower range of this ratio relates to regions of lower SFR density. The X-ray spectra are well matched by a two-temperature thermal model with derived temperatures of typically ~0.2 keV and ~0.65 keV, in line with published results for other normal and star-forming galaxies. The hot component contributes a higher fraction of the soft luminosity in the galaxies with highest X-ray/SFR ratio, suggesting a link between plasma temperature and X-ray production efficiency. The physical properties of the gas present in the galactic disks are consistent with a clumpy thin-disk distribution, presumably composed of diffuse structures such as superbubbles together with the integrated emission of unresolved discrete sources including young supernova remnants.

We have developed an end-to-end photometric data processing pipeline to compare current photometric algorithms commonly used on ground-based imaging data. This testbed is exceedingly adaptable, and enables us to perform many research and development tasks, including image subtraction and co-addition, object detection and measurements, the production of photometric catalogs, and the creation and stocking of database tables with time-series information. This testing has been undertaken to evaluate existing photometry algorithms for consideration by a next-generation image processing pipeline for the Large Synoptic Survey Telescope (LSST). We outline the results of our tests for four packages: The Sloan Digital Sky Survey's (SDSS) Photo package, Daophot and Allframe, DoPhot, and two versions of Source Extractor (SExtractor). The ability of these algorithms to perform point-source photometry, astrometry, shape measurements, star-galaxy separation, and to measure objects at low signal-to-noise is quantified. We also perform a detailed crowded field comparison of Daophot and Allframe, and profile the speed and memory requirements in detail for SExtractor. We find that both Daophot and Photo are able to perform aperture photometry to high enough precision to meet LSST's science requirements, and less adequately at PSF-fitting photometry. Photo performs the best at simultaneous point and extended-source shape and brightness measurements. SExtractor is the fastest algorithm, and recent upgrades in the software yield high-quality centroid and shape measurements with little bias towards faint magnitudes. Allframe yields the best photometric results in crowded fields.

We present a study of the X-ray properties of the nearby face-on Scd spiral galaxy M101 based on recent XMM-Newton observations. In this third and final paper in the present series, we focus on the spatial and spectral properties of the residual emission, after excluding bright X-ray sources with L(X) > 10^37 erg/s. Within a central region of radius 10 arcmins (21 kpc), the X-ray emission broadly traces the pattern of the spiral arms, establishing a strong link with recent star formation, but it also exhibits a radial scale length of \~2.6 arcmins (5.4 kpc) consistent with optical data. We estimate the soft X-ray luminosity within the central 5 arcmins (10.5 kpc) region to be L(X) ~2.1 x 10^39 erg/s (0.5-2 keV), the bulk of which appears to originate as diffuse emission. We find a two-temperature thermal model best fits the spectral data with derived temperatures of 0.20 +/- 0.01 keV and 0.68^(+0.06)_(-0.04) keV which are very typical of the diffuse components seen in other normal and starburst galaxies. More detailed investigation of the X-ray morphology reveals a strong correlation with images recorded in the far-UV through to V band, with the best match being with the U band. We interpret these results in terms of a clumpy thin-disk component which traces the spiral arms of M101 plus an extended lower-halo component with large filling factor.