In any imaging survey, measuring accurately the astronomical background light is crucial to obtain good photometry. This paper introduces BKGnet, a deep neural network to predict the background and its associated error. BKGnet has been developed for data from the Physics of the Accelerating Universe Survey (PAUS), an imaging survey using a 40 narrow-band filter camera (PAUCam). Images obtained with PAUCam are affected by scattered light: an optical effect consisting of light multiply that deposits energy in specific detector regions contaminating the science measurements. Fortunately, scattered light is not a random effect, but it can be predicted and corrected for. We have found that BKGnet background predictions are very robust to distorting effects, while still being statistically accurate. On average, the use of BKGnet improves the photometric flux measurements by 7% and up to 20% at the bright end. BKGnet also removes a systematic trend in the background error estimation with magnitude in the i-band that is present with the current PAU data management method. With BKGnet, we reduce the photometric redshift outlier rate

In this paper we introduce the \textsc{Deepz} deep learning photometric redshift (photo-$z$) code. As a test case, we apply the code to the PAU survey (PAUS) data in the COSMOS field. \textsc{Deepz} reduces the $\sigma_{68}$ scatter statistic by 50\% at $i_{\rm AB}=22.5$ compared to existing algorithms. This improvement is achieved through various methods, including transfer learning from simulations where the training set consists of simulations as well as observations, which reduces the need for training data. The redshift probability distribution is estimated with a mixture density network (MDN), which produces accurate redshift distributions. Our code includes an autoencoder to reduce noise and extract features from the galaxy SEDs. It also benefits from combining multiple networks, which lowers the photo-$z$ scatter by 10 percent. Furthermore, training with randomly constructed coadded fluxes adds information about individual exposures, reducing the impact of photometric outliers. In addition to opening up the route for higher redshift precision with narrow bands, these machine learning techniques can also be valuable for broad-band surveys.

We present CosmoHub (https://cosmohub.pic.es), a web application based on Hadoop to perform interactive exploration and distribution of massive cosmological datasets. Recent Cosmology seeks to unveil the nature of both dark matter and dark energy mapping the large-scale structure of the Universe, through the analysis of massive amounts of astronomical data, progressively increasing during the last (and future) decades with the digitization and automation of the experimental techniques. CosmoHub, hosted and developed at the Port d'Informaci\'o Cient\'ifica (PIC), provides support to a worldwide community of scientists, without requiring the end user to know any Structured Query Language (SQL). It is serving data of several large international collaborations such as the Euclid space mission, the Dark Energy Survey (DES), the Physics of the Accelerating Universe Survey (PAUS) and the Marenostrum Institut de Ci\`encies de l'Espai (MICE) numerical simulations. While originally developed as a PostgreSQL relational database web frontend, this work describes the current version of CosmoHub, built on top of Apache Hive, which facilitates scalable reading, writing and managing huge datasets. As CosmoHub's datasets are seldomly modified, Hive it is a better fit. Over 60 TiB of catalogued information and $50 \times 10^9$ astronomical objects can be interactively explored using an integrated visualization tool which includes 1D histogram and 2D heatmap plots. In our current implementation, online exploration of datasets of $10^9$ objects can be done in a timescale of tens of seconds. Users can also download customized subsets of data in standard formats generated in few minutes.

The PAU Survey (PAUS) is an innovative photometric survey with 40 narrow bands at the William Herschel Telescope (WHT). The narrow bands are spaced at 100\AA\ intervals covering the range 4500\AA\ to 8500\AA\ and, in combination with standard broad bands, enable excellent redshift precision. This paper describes the technique, galaxy templates and additional photometric calibration used to determine early photometric redshifts from PAUS. Using BCNz2, a new photometric redshift code developed for this purpose, we characterise the photometric redshift performance using PAUS data on the COSMOS field. Comparison to secure spectra from zCOSMOS DR3 shows that PAUS achieves $\sigma_{68} /(1+z) = 0.0037$ to $i_{\mathrm{AB}} < 22.5$ when selecting the best 50% of the sources based on a photometric redshift quality cut. Furthermore, a higher photo-z precision ($\sigma_{68}/(1+z) \sim 0.001$) is obtained for a bright and high quality selection, which is driven by the identification of emission lines. We conclude that PAUS meets its design goals, opening up a hitherto uncharted regime of deep, wide, and dense galaxy survey with precise redshifts that will provide unique insights into the formation, evolution and clustering of galaxies, as well as their intrinsic alignments.

The PAU (Physics of the Accelerating Universe) Survey goal is to obtain photometric redshifts (photo-z) and Spectral Energy Distribution (SED) of astronomical objects with a resolution roughly one order of magnitude better than current broad band photometric surveys. To accomplish this, a new large field of view camera (PAUCam) has been designed, built, commissioned and is now operated at the William Herschel Telescope (WHT). With the current WHT Prime Focus corrector, the camera covers ~1-degree diameter Field of View (FoV), of which, only the inner ~40 arcmin diameter are unvignetted. The focal plane consists of a mosaic of 18 2k$x4k Hamamatsu fully depleted CCDs, with high quantum efficiency up to 1 micrometers in wavelength. To maximize the detector coverage within the FoV, filters are placed in front of the CCDs inside the camera cryostat (made out of carbon fiber) using a challenging movable tray system. The camera uses a set of 40 narrow band filters ranging from ~4500 to ~8500 Angstroms complemented with six standard broad-band filters, ugrizY. The PAU Survey aims to cover roughly 100 square degrees over fields with existing deep photometry and galaxy shapes to obtain accurate photometric redshifts for galaxies down to i_AB~22.5, detecting also galaxies down to i_AB~24 with less precision in redshift. With this data set we will be able to measure intrinsic alignments, galaxy clustering and perform galaxy evolution studies in a new range of densities and redshifts. Here, we describe the PAU camera, its first commissioning results and performance.

Classification of stars and galaxies is a well-known astronomical problem that has been treated using different approaches, most of them relying on morphological information. In this paper, we tackle this issue using the low-resolution spectra from narrow band photometry, provided by the PAUS (Physics of the Accelerating Universe) survey. We find that, with the photometric fluxes from the 40 narrow band filters and without including morphological information, it is possible to separate stars and galaxies to very high precision, 98.4% purity with a completeness of 98.8% for objects brighter than I = 22.5. This precision is obtained with a Convolutional Neural Network as a classification algorithm, applied to the objects' spectra. We have also applied the method to the ALHAMBRA photometric survey and we provide an updated classification for its Gold sample.

The Physics of the Accelerating Universe (PAU) Survey is an international project for the study of cosmological parameters associated with Dark Energy. PAU's 18-CCD camera (PAUCam), installed at the prime focus of the William Herschel Telescope at the Roque de los Muchachos Observatory (La Palma, Canary Islands), scans part of the northern sky, to collect low resolution spectral information of millions of galaxies with its unique set of 40 narrow-band filters in the optical range from 450 nm to 850 nm, and a set of 6 standard broad band filters. The PAU data management (PAUdm) team is in charge of treating the data, including data transfer from the observatory to the PAU Survey data center, hosted at Port d'Informaci\'o Cient\'ifica (PIC). PAUdm is also in charge of the storage, data reduction and, finally, of making the results available to the scientific community. We describe the technical solutions adopted to cover different aspects of the PAU Survey data management, from the computing infrastructure to support the operations, to the software tools and web services for the data process orchestration and exploration. In particular we will focus on the PAU database, developed for the coordination of the different PAUdm tasks, and to preserve and guarantee the consistency of data and metadata.