In this work, we provide an efficient and realistic data-driven approach to simulate astronomical images using deep generative models from machine learning. Our solution is based on a variant of the generative adversarial network (GAN) with progressive training methodology and Wasserstein cost function. The proposed solution generates naturalistic images of galaxies that show complex structures and high diversity, which suggests that data-driven simulations using machine learning can replace many of the expensive model-driven methods used in astronomical data processing.

The HIFI data processing pipeline was developed to systematically process diagnostic, calibration and astronomical observations taken with the HIFI science instrumentas part of the Herschel mission. The HIFI pipeline processed data from all HIFI observing modes within the Herschel automated processing environment, as well as, within an interactive environment. A common software framework was developed to best support the use cases required by the instrument teams and by the general astronomers. The HIFI pipeline was built on top of that and was designed with a high degree of modularity. This modular design provided the necessary flexibility and extensibility to deal with the complexity of batch-processing eighteen different observing modes, to support the astronomers in the interactive analysis and to cope with adjustments necessary to improve the pipeline and the quality of the end-products. This approach to the software development and data processing effort was arrived at by coalescing the lessons learned from similar research based projects with the understanding that a degree of foresight was required given the overall length of the project. In this article, both the successes and challenges of the HIFI software development process are presented. To support future similar projects and retain experience gained lessons learned are extracted.

IRIS performs solar observations over a large range of atmospheric heights, including the chromosphere where the majority of flare energy is dissipated. The strong Mg II h&k spectral lines are capable of providing excellent atmospheric diagnostics, but have not been fully utilized for flaring atmospheres. We aim to investigate whether the physics of the chromosphere is identical for all flare observations by analyzing if there are certain spectra that occur in all flares. To achieve this, we automatically analyze hundreds of thousands of Mg II h&k line profiles from a set of 33 flares, and use a machine learning technique which we call supervised hierarchical k-means, to cluster all profile shapes. We identify a single peaked Mg II profile, in contrast to the double-peaked quiet Sun profiles, appearing in every flare. Additionally, we find extremely broad profiles with characteristic blue shifted central reversals appearing at the front of fast-moving flare ribbons. These profiles occur during the impulsive phase of the flare, and we present results of their temporal and spatial correlation with non-thermal hard X-ray signatures, suggesting that flare-accelerated electrons play an important role in the formation of these profiles. The ratio of the integrated Mg II h&k lines can also serve as an opacity diagnostic, and we find higher opacities during each flare maximum. Our study shows that machine learning is a powerful tool for large scale statistical solar analyses.

{Context}. The HIFI instrument on the Herschel Space Observatory performed over 9100 astronomical observations, almost 900 of which were calibration observations in the course of the nearly four-year Herschel mission. The data from each observation had to be converted from raw telemetry into calibrated products and were included in the Herschel Science Archive. {Aims}. The HIFI pipeline was designed to provide robust conversion from raw telemetry into calibrated data throughout all phases of the HIFI missions. Pre-launch laboratory testing was supported as were routine mission operations. {Methods}. A modular software design allowed components to be easily added, removed, amended and/or extended as the understanding of the HIFI data developed during and after mission operations. {Results}. The HIFI pipeline processed data from all HIFI observing modes within the Herschel automated processing environment as well as within an interactive environment. The same software can be used by the general astronomical community to reprocess any standard HIFI observation. The pipeline also recorded the consistency of processing results and provided automated quality reports. Many pipeline modules were in use since the HIFI pre-launch instrument level testing. {Conclusions}. Processing in steps facilitated data analysis to discover and address instrument artefacts and uncertainties. The availability of the same pipeline components from pre-launch throughout the mission made for well-understood, tested, and stable processing. A smooth transition from one phase to the next significantly enhanced processing reliability and robustness.

Euclid is a Europe-led cosmology space mission dedicated to a visible and near infrared survey of the entire extra-galactic sky. Its purpose is to deepen our knowledge of the dark content of our Universe. After an overview of the Euclid mission and science, this contribution describes how the community is getting organized to face the data analysis challenges, both in software development and in operational data processing matters. It ends with a more specific account of some of the main contributions of the Swiss Science Data Center (SDC-CH).

Hydrides are simple compounds containing one or a few hydrogen atoms bonded to a heavier atom. They are fundamental precursor molecules in cosmic chemistry and many hydride ions have become observable in high quality for the first time thanks to the Herschel Space Observatory. Ionized hydrides, such as CH+ and OH+, and also HCO+ that affect the chemistry of molecules such as water, provide complementary information on irradiation by far UV (FUV) or X-rays and gas temperature. The targeted lines of CH+, OH+, H2O+, C+ and CH are detected mostly in blue-shifted absorption. H3O+ and SH+ are detected in emission and only toward some high-mass objects. The observed line parameters and correlations suggest two different origins, related to gas entrained by the outflows and to the circumstellar envelope. The column density ratios of CH+/OH+ are estimated from chemical slab models, assuming that the H2 density is given by the specific density model of each object at the beam radius. For the low-mass YSOs the observed ratio can be reproduced for an FUV flux of 2-400 times the ISRF at the location of the molecules. In two high-mass objects, the UV flux is 20-200 times the ISRF derived from absorption lines, and 300-600 ISRF using emission lines. If the FUV flux required for low-mass objects originates at the central protostar, a substantial FUV luminosity, up to 1.5 L_sun, is required. There is no molecular evidence for X-ray induced chemistry in the low-mass objects on the observed scales of a few 1000 AU. For high-mass regions, the FUV flux required to produce the observed molecular ratios is smaller than the unattenuated flux expected from the central object(s) at the Herschel beam radius. This is consistent with an FUV flux reduced by circumstellar extinction or by bloating of the protostar.

Euclid is a space-based survey mission from the European Space Agency designed to understand the origin of the Universe's accelerating expansion. It will use cosmological probes to investigate the nature of dark energy, dark matter and gravity by tracking their observational signatures on the geometry of the universe and on the cosmic history of structure formation. The mission is optimised for two independent primary cosmological probes: Weak gravitational Lensing (WL) and Baryonic Acoustic Oscillations (BAO). The Euclid payload consists of a 1.2 m Korsch telescope designed to provide a large field of view. It carries two instruments with a common field-of-view of ~0.54 deg2: the visual imager (VIS) and the near infrared instrument (NISP) which contains a slitless spectrometer and a three bands photometer. The Euclid wide survey will cover 15,000 deg2 of the extragalactic sky and is complemented by two 20 deg2 deep fields. For WL, Euclid measures the shapes of 30-40 resolved galaxies per arcmin2 in one broad visible R+I+Z band (550-920 nm). The photometric redshifts for these galaxies reach a precision of dz/(1+z) < 0.05. They are derived from three additional Euclid NIR bands (Y, J, H in the range 0.92-2.0 micron), complemented by ground based photometry in visible bands derived from public data or through engaged collaborations. The BAO are determined from a spectroscopic survey with a redshift accuracy dz/(1+z) =0.001. The slitless spectrometer, with spectral resolution ~250, predominantly detects Ha emission line galaxies. Euclid is a Medium Class mission of the ESA Cosmic Vision 2015-2025 programme, with a foreseen launch date in 2019. This report (also known as the Euclid Red Book) describes the outcome of the Phase A study.

Using Herschel's HIFI instrument we have observed [C II] along a cut through S140 and high-J transitions of CO and HCO+ at two positions on the cut, corresponding to the externally irradiated ionization front and the embedded massive star forming core IRS1. The HIFI data were combined with available ground-based observations and modeled using the KOSMA-tau model for photon dominated regions. Here we derive the physical conditions in S140 and in particular the origin of [C II] emission around IRS1. We identify three distinct regions of [C II] emission from the cut, one close to the embedded source IRS1, one associated with the ionization front and one further into the cloud. The line emission can be understood in terms of a clumpy model of photon-dominated regions. At the position of IRS1, we identify at least two distinct components contributing to the [C II] emission, one of them a small, hot component, which can possibly be identified with the irradiated outflow walls. This is consistent with the fact that the [C II] peak at IRS1 coincides with shocked H2 emission at the edges of the outflow cavity. We note that previously available observations of IRS1 can be well reproduced by a single-component KOSMA-tau model. Thus it is HIFI's unprecedented spatial and spectral resolution, as well as its sensitivity which has allowed us to uncover an additional hot gas component in the S140 region.

The Heterodyne Instrument for the Far Infrared (HIFI) onboard the Herschel Space Observatory allows the first observations of light diatomic molecules at high spectral resolution and in multiple transitions. Here, we report deep integrations using HIFI in different lines of hydrides towards the high-mass star forming region AFGL 2591. Detected are CH, CH+, NH, OH+, H2O+, while NH+ and SH+ have not been detected. All molecules except for CH and CH+ are seen in absorption with low excitation temperatures and at velocities different from the systemic velocity of the protostellar envelope. Surprisingly, the CH(JF,P = 3/2_2,- - 1/2_1,+) and CH+(J = 1 - 0, J = 2 - 1) lines are detected in emission at the systemic velocity. We can assign the absorption features to a foreground cloud and an outflow lobe, while the CH and CH+ emission stems from the envelope. The observed abundance and excitation of CH and CH+ can be explained in the scenario of FUV irradiated outflow walls, where a cavity etched out by the outflow allows protostellar FUV photons to irradiate and heat the envelope at larger distances driving the chemical reactions that produce these molecules.

Water in Star-forming regions with Herschel (WISH) is a Herschel Key Program investigating the water chemistry in young stellar objects (YSOs) during protostellar evolution. Hydroxyl (OH) is one of the reactants in the chemical network most closely linked to the formation and destruction of H2O. High-temperature chemistry connects OH and H2O through the OH + H2 <-> H2O + H reactions. Formation of H2O from OH is efficient in the high-temperature regime found in shocks and the innermost part of protostellar envelopes. Moreover, in the presence of UV photons, OH can be produced from the photo-dissociation of H2O. High-resolution spectroscopy of the OH 163.12 micron triplet towards HH 46 and NGC 1333 IRAS 2A was carried out with the Heterodyne Instrument for the Far Infrared (HIFI) on board Herschel. The low- and intermediate-mass YSOs HH 46, TMR 1, IRAS 15398-3359, DK Cha, NGC 7129 FIRS 2, and NGC 1333 IRAS 2A were observed with the Photodetector Array Camera and Spectrometer (PACS) in four transitions of OH and two [OI] lines. The OH transitions at 79, 84, 119, and 163 micron and [OI] emission at 63 and 145 micron were detected with PACS towards the class I low-mass YSOs as well as the intermediate-mass and class I Herbig Ae sources. No OH emission was detected from the class 0 YSO NGC 1333 IRAS 2A, though the 119 micron was detected in absorption. With HIFI, the 163.12 micron was not detected from HH 46 and only tentatively detected from NGC 1333 IRAS 2A. The combination of the PACS and HIFI results for HH 46 constrains the line width (FWHM > 11 km/s) and indicates that the OH emission likely originates from shocked gas. This scenario is supported by trends of the OH flux increasing with the [OI] flux and the bolometric luminosity. Similar OH line ratios for most sources suggest that OH has comparable excitation temperatures despite the different physical properties of the sources.

Mon R2, at a distance of 830 pc, is the only ultracompact HII region (UC HII) where the photon-dominated region (PDR) between the ionized gas and the molecular cloud can be resolved with Herschel. HIFI observations of the abundant compounds 13CO, C18O, o-H2-18O, HCO+, CS, CH, and NH have been used to derive the physical and chemical conditions in the PDR, in particular the water abundance. The 13CO, C18O, o-H2-18O, HCO+ and CS observations are well described assuming that the emission is coming from a dense (n=5E6 cm-3, N(H2)>1E22 cm-2) layer of molecular gas around the UC HII. Based on our o-H2-18O observations, we estimate an o-H2O abundance of ~2E-8. This is the average ortho-water abundance in the PDR. Additional H2-18O and/or water lines are required to derive the water abundance profile. A lower density envelope (n~1E5 cm-3, N(H2)=2-5E22 cm-2) is responsible for the absorption in the NH 1_1-0_2 line. The emission of the CH ground state triplet is coming from both regions with a complex and self-absorbed profile in the main component. The radiative transfer modeling shows that the 13CO and HCO+ line profiles are consistent with an expansion of the molecular gas with a velocity law, v_e =0.5 x (r/Rout)^{-1} km/s, although the expansion velocity is poorly constrained by the observations presented here.

We identify a prominent absorption feature at 1115 GHz, detected in first HIFI spectra towards high-mass star-forming regions, and interpret its astrophysical origin. The characteristic hyperfine pattern of the H2O+ ground-state rotational transition, and the lack of other known low-energy transitions in this frequency range, identifies the feature as H2O+ absorption against the dust continuum background and allows us to derive the velocity profile of the absorbing gas. By comparing this velocity profile with velocity profiles of other tracers in the DR21 star-forming region, we constrain the frequency of the transition and the conditions for its formation. In DR21, the velocity distribution of H2O+ matches that of the [CII] line at 158\mu\m and of OH cm-wave absorption, both stemming from the hot and dense clump surfaces facing the HII-region and dynamically affected by the blister outflow. Diffuse foreground gas dominates the absorption towards Sgr B2. The integrated intensity of the absorption line allows us to derive lower limits to the H2O+ column density of 7.2e12 cm^-2 in NGC 6334, 2.3e13 cm^-2 in DR21, and 1.1e15 cm^-2 in Sgr B2.