We present the discovery of the second binary with a Roche lobe-filling hot subdwarf transferring mass to a white dwarf (WD) companion. This 56 minute binary was discovered using data from the Zwicky Transient Facility. Spectroscopic observations reveal an He-sdOB star with an effective temperature of $T_{\rm eff}=33,700\pm1000$ K and a surface gravity of $log(g)=5.54\pm0.11$. The GTC+HiPERCAM light curve is dominated by the ellipsoidal deformation of the He-sdOB star and shows an eclipse of the He-sdOB by an accretion disk as well as a weak eclipse of the WD. We infer a He-sdOB mass of $M_{\rm sdOB}=0.41\pm0.04$ M$_\odot$ and a WD mass of $M_{\rm WD}=0.68\pm0.05$ M$_\odot$. The weak eclipses imply a WD black-body temperature of $63,000\pm10,000$ K and a radius $R_{\rm WD}=0.0148\pm0.0020$ M$_\odot$ as expected for a WD of such high temperature. The He-sdOB star is likely undergoing hydrogen shell burning and will continue transferring mass for $\approx1$ Myrs at a rate of $10^{-9} M_\odot {\rm yr}^{-1}$ which is consistent with the high WD temperature. The hot subdwarf will then turn into a WD and the system will merge in $\approx30$ Myrs. We suggest that Galactic reddening could bias discoveries towards preferentially finding Roche lobe-filling systems during the short-lived shell burning phase. Studies using reddening corrected samples should reveal a large population of helium core-burning hot subdwarfs with $T_{\rm eff}\approx25,000$ K in binaries of 60-90 minutes with WDs. Though not yet in contact, these binaries would eventually come into contact through gravitational wave emission and explode as a sub-luminous thermonuclear supernova or evolve into a massive single WD.

Early observations of Type Ia supernovae (SNe$\,$Ia) provide essential clues for understanding the progenitor system that gave rise to the terminal thermonuclear explosion. We present exquisite observations of SN$\,$2019yvq, the second observed SN$\,$Ia, after iPTF$\,$14atg, to display an early flash of emission in the ultraviolet (UV) and optical. Our analysis finds that SN$\,$2019yvq was unusual, even when ignoring the initial flash, in that it was moderately underluminous for an SN$\,$Ia ($M_g \approx -18.5\,$mag at peak) yet featured very high absorption velocities ($v \approx 15,000\,\mathrm{km\,s}^{-1}$ for Si II $\lambda$6355 at peak). We find that many of the observational features of SN$\,$2019yvq, aside from the flash, can be explained if the explosive yield of radioactive $^{56}\mathrm{Ni}$ is relatively low (we measure $M_{^{56}\mathrm{Ni}} = 0.31 \pm 0.05\,M_\odot$) and it and other iron-group elements are concentrated in the innermost layers of the ejecta. To explain both the UV/optical flash and peak properties of SN$\,$2019yvq we consider four different models: interaction between the SN ejecta and a nondegenerate companion, extended clumps of $^{56}\mathrm{Ni}$ in the outer ejecta, a double-detonation explosion, and the violent merger of two white dwarfs. Each of these models has shortcomings when compared to the observations; it is clear additional tuning is required to better match SN$\,$2019yvq. In closing, we predict that the nebular spectra of SN$\,$2019yvq will feature either H or He emission, if the ejecta collided with a companion, strong [Ca II] emission, if it was a double detonation, or narrow [O I] emission, if it was due to a violent merger.

We report the discovery and panchromatic followup observations of the young Type Ic supernova, SN2020oi, in M100, a grand design spiral galaxy at a mere distance of $14$ Mpc. We followed up with observations at radio, X-ray and optical wavelengths from only a few days to several months after explosion. The optical behaviour of the supernova is similar to those of other normal Type Ic supernovae. The event was not detected in the X-ray band but our radio observation revealed a bright mJy source ($L_{\nu} \approx 1.2 \times 10^{27} {\rm erg\,s}^{-1} {\rm Hz}^{-1}$). Given, the relatively small number of stripped envelope SNe for which radio emission is detectable, we used this opportunity to perform a detailed analysis of the comprehensive radio dataset we obtained. The radio emitting electrons initially experience a phase of inverse Compton cooling which leads to steepening of the spectral index of the radio emission. Our analysis of the cooling frequency points to a large deviation from equipartition at the level of $\epsilon_e/\epsilon_B \gtrsim 200$, similar to a few other cases of stripped envelope SNe. Our modeling of the radio data suggests that the shockwave driven by the SN ejecta into the circumstellar matter (CSM) is moving at $\sim 3\times 10^{4}\,{\rm km\,s}^{-1}$. Assuming a constant mass-loss from the stellar progenitor, we find that the mass-loss rate is $\dot{M} \approx 1.4\times 10^{-4}\,{M}_{\odot}\,{\rm yr}^{-1}$, for an assumed wind velocity of $1000\,{\rm km\,s}^{-1}$. The temporal evolution of the radio emission suggests a radial CSM density structure steeper than the standard $r^{-2}$.

Helium is expected to be present in the ejecta of some hydrogen-poor superluminous supernovae (SLSN-I). However, so far only one event, PTF10hgi has been identified with He features in its photospheric spectra (Quimby et al. 2018). At $z=0.0866$, ZTF19aawfbtg (SN2019hge) has more than 10 optical spectra at phases from $-41$ to $+103$ days. Most of these spectra match well with that of PTF10hgi, suggesting SN2019hge as the second case of a He-rich SLSN-I. Confirmation comes from its near-IR spectrum taken at $+34$ days, revealing He I features with P-Cygni profiles at 1.083 and 2.058$\mu$m. Using the optical spectra of PTF10hgi and SN2019hge as templates, we examine 70 SLSN-I discovered by ZTF in the first two years of operation and found additional five SLSN-I with distinct He-features, yielding a lower limit to the He-rich fraction of $\sim9$\%. It is suggested that the excitation of He I atoms requires non-thermal radiation. These He-rich events can not be explained by traditional $^{56}$Ni mixing model because of their blue spectra, high peak luminosity and slow rising time scales. Magnetar models offer a possible solution since pulsar winds naturally generate high energy particles as sources of non-thermal excitation. However, how the magnetar energy is transported to the outer layers is unclear. An alternative model is ejecta interaction with H-poor CSM which may be supported by the observed light curve undulations. These six SLSN-Ib appear to have relatively low-peak luminosities, around $-20.06\pm0.16$ mag ($g$-band, rest-frame), in comparison to the full range of $-20$ to $-23$ mag covered by SLSN-I.

We report the first plausible optical electromagnetic (EM) counterpart to a (candidate) binary black hole (BBH) merger. Detected by the Zwicky Transient Facility (ZTF), the EM flare is consistent with expectations for a kicked BBH merger in the accretion disk of an active galactic nucleus (AGN), and is unlikely ($<O(0.01\%$)) due to intrinsic variability of this source. The lack of color evolution implies that it is not a supernovae and instead is strongly suggestive of a constant temperature shock. Other false-positive events, such as microlensing or a tidal disruption event, are ruled out or constrained to be $<O(0.1\%$). If the flare is associated with S190521g, we find plausible values of: total mass $ M_{\rm BBH} \sim 100 M_{\odot}$, kick velocity $v_k \sim 200\, {\rm km}\, {\rm s}^{-1}$ at $\theta \sim 60^{\circ}$ in a disk with aspect ratio $H/a \sim 0.01$ (i.e., disk height $H$ at radius $a$) and gas density $\rho \sim 10^{-10}\, {\rm g}\, {\rm cm}^{-3}$. The merger could have occurred at a disk migration trap ($a \sim 700\, r_{g}$; $r_g \equiv G M_{\rm SMBH} / c^2$, where $M_{\rm SMBH}$ is the mass of the AGN supermassive black hole). The combination of parameters implies a significant spin for at least one of the black holes in S190521g. The timing of our spectroscopy prevents useful constraints on broad-line asymmetry due to an off-center flare. We predict a repeat flare in this source due to a re-encountering with the disk in $\sim 1.6\, {\rm yr}\, (M_{\rm SMBH}/10^{8}M_{\odot})\, (a/10^{3}r_{g})^{3/2}$.

We present ZTF20aajnksq (AT2020blt), a fast-fading ($\Delta r=2.4$ mag in $\Delta t=1.3$ days) red ($g-r\approx0.6$ mag) and luminous ($M_{1626}=-25.9$) optical transient at $z=2.9$ discovered by the Zwicky Transient Facility (ZTF). AT2020blt shares several features in common with afterglows to long-duration gamma-ray bursts (GRBs): (1) an optical light curve well-described by a broken power-law with a break at $t_\mathrm{j}=1$ day (observer-frame); (2) a luminous $(L_X = 10^{46}$ $\mathrm{erg}$ $\mathrm{s}^{-1})$ X-ray counterpart; and (3) luminous ($L_\nu = 4 \times 10^{31}$ $\mathrm{erg}$ $\mathrm{sec}^{-1}$ $\mathrm{Hz}^{-1}$ at 10 GHz) radio emission. However, no GRB was detected in the 0.74d between the last ZTF non-detection ($r > 20.64$) and the first ZTF detection ($r = 19.57$), with an upper limit on the isotropic-equivalent gamma-ray energy release of $E_{\gamma,\mathrm{iso}} < 7 \times 10^{52}$ erg. AT2020blt is thus the third afterglow-like transient discovered without a detected GRB counterpart (after PTF11agg and ZTF19abvizsw) and the second (after ZTF19abvizsw) with a redshift measurement. We conclude that the properties of AT2020blt are consistent with a classical (initial Lorentz factor $\Gamma_0 \gtrsim 100$) on-axis GRB that was missed by high-energy satellites. Furthermore, by estimating the rate of transients with light curves similar to that of AT2020blt in ZTF high-cadence data, we agree with previous results that there is no evidence for an afterglow-like phenomenon that is significantly more common than classical GRBs. We conclude by discussing the status and future of fast-transient searches in wide-field high-cadence optical surveys.

We present observations of ZTF18abfcmjw (SN2019dge), a helium-rich supernova with a fast-evolving light curve indicating an extremely low ejecta mass ($\approx 0.3\,M_\odot$) and low kinetic energy ($\approx 1.2\times 10^{50}\,{\rm erg}$). Early-time (<4 d after explosion) photometry reveal evidence of shock cooling from an extended helium-rich envelope of $\sim0.1\,M_\odot$ located at $\sim 3\times 10^{12}\,{\rm cm}$ from the progenitor. Early-time He II line emission and subsequent spectra show signatures of interaction with helium-rich circumstellar material, which extends from $\gtrsim 5\times 10^{13}\,{\rm cm}$ to $\gtrsim 2\times 10^{16}\,{\rm cm}$. We interpret SN2019dge as a helium-rich supernova from an ultra-stripped progenitor, which originates from a close binary system consisting of a mass-losing helium star and a low-mass main sequence star or a compact object (i.e., a white dwarf, a neutron star, or a black hole). We infer that the local volumetric birth rate of 19dge-like ultra-stripped SNe is in the range of 1400--8200$\,{\rm Gpc^{-3}\, yr^{-1}}$ (i.e., 2--12% of core-collapse supernova rate). This can be compared to the observed coalescence rate of compact neutron star binaries that are not formed by dynamical capture.

Recently, Kundu et al (2019) reported that the globular cluster NGC 5024 (M53) possesses five extra-tidal RR Lyrae. In fact, four of them were instead known members of a nearby globular cluster NGC 5053. The status of the remaining extra-tidal RR Lyrae is controversial depending on the adopted tidal radius of NGC 5024. We have also searched for additional extra-tidal RR Lyrae within an area of $\sim8$~deg$^2$ covering both globular clusters. This includes other known RR Lyrae within the search area, as well as stars that fall within the expected range of magnitudes and colors for RR Lyrae (and yet outside the cutoff of 2/3 of the tidal radii of each globular clusters for something to be called "extra-tidal") if they were extra-tidal RR Lyrae candidates for NGC 5024 or NGC 5053. Based on the the proper motion information and their locations on the color-magnitude diagram, none of the known RR Lyrae belong to the extra-tidal RR Lyrae of either globular clusters. In the cases where the stars satisfied the magnitude and color ranges of RR Lyrae, analysis of time series data taken from the Zwicky Transient Facility do not reveal periodicities, suggesting that none of these stars are RR Lyrae. We conclude that there are no extra-tidal RR Lyrae associated with either NGC 5024 or NGC 5053 located within our search area.

Cosmic neutrinos provide a unique window into the otherwise-hidden mechanism of particle acceleration in astrophysical objects. A flux of high-energy neutrinos was discovered in 2013, and the IceCube Collaboration recently associated one high-energy neutrino with a flare from the relativistic jet of an active galaxy pointed towards the Earth. However a combined analysis of many similar active galaxies revealed no excess from the broader population, leaving the vast majority of the cosmic neutrino flux unexplained. Here we present the association of a radio-emitting tidal disruption event (AT2019dsg) with another high-energy neutrino, identified as part of our systematic search for optical counterparts to high-energy neutrinos with the Zwicky Transient Facility (ZTF). The probability of finding any radio-emitting tidal disruption event by chance is 0.5%, while the probability of finding one as bright in bolometric energy flux as AT2019dsg is 0.2%. Our electromagnetic observations can be explained through a multi-zone model, with radio analysis revealing a central engine, embedded in a UV photosphere, that powers an extended synchrotron-emitting outflow. This provides an ideal site for PeV neutrino production. The association suggests that tidal disruption events contribute to the cosmic neutrino flux. Unlike previous work which considered the rare subset of tidal disruption events with relativistic jets, our observations of AT2019dsg suggest an empirical model with a mildly-relativistic outflow.

Colors of Type Ia supernovae in the first few days after explosion provide a potential discriminant between different models. In this paper, we present $g-r$ colors of 65 Type Ia supernovae discovered within 5 days from first light by the Zwicky Transient Facility in 2018, a sample that is about three times larger than that in the literature. We find that $g-r$ colors are intrinsically rather homogeneous at early phases, with about half of the dispersion attributable to photometric uncertainties ($\sigma_\mathrm{noise}\sim\sigma_\mathrm{int}\sim$ 0.18 mag). Colors are nearly constant starting from 6 days after first light ($g-r\sim-0.15$ mag), while the time evolution at earlier epochs is characterized by a continuous range of slopes, from events rapidly transitioning from redder to bluer colors (slope of $\sim-0.25$ mag day$^{-1}$) to events with a flatter evolution. The continuum in the slope distribution is in good agreement both with models requiring some amount of $^{56}$Ni mixed in the outermost regions of the ejecta and with "double-detonation" models having thin helium layers ($M_\mathrm{He}=0.01\,M_\odot$) and varying carbon-oxygen core masses. At the same time, six events show evidence for a distinctive "red bump" signature predicted by "double-detonation" models with larger helium masses. We finally identify a significant correlation between the early-time $g-r$ slopes and supernova brightness, with brighter events associated to flatter color evolution (p-value=0.006). The distribution of slopes, however, is consistent with being drawn from a single population, with no evidence for two components as claimed in the literature based on $B-V$ colors.

We present optical, radio, and X-ray observations of SN2020bvc (=ASASSN20bs; ZTF20aalxlis), a nearby ($z=0.0252$; $d$=114 Mpc) broad-lined (BL) Type Ic supernova (SN). Our observations show that SN2020bvc shares several properties in common with the Ic-BL SN2006aj, which was associated with the low-luminosity gamma-ray burst (LLGRB) 060218. First, the 10 GHz radio light curve is on the faint end of LLGRB-SNe ($L_\mathrm{radio} \approx 10^{37}$erg/s): we model our VLA observations (spanning 13-43 d) as synchrotron emission from a mildly relativistic ($v \gtrsim 0.3c$) forward shock. Second, with Swift and Chandra we detect X-ray emission ($L_X \approx 10^{41}$erg/s) that is not naturally explained as inverse Compton emission or as part of the same synchrotron spectrum as the radio emission. Third, high-cadence ($6\times$/night) data from the Zwicky Transient Facility (ZTF) shows a double-peaked optical light curve, the first peak from shock-cooling emission from extended low-mass material (mass $M<10^{-2} M_\odot$ at radius $R>10^{12}$cm) and the second peak from the radioactive decay of Ni-56. SN2020bvc is the first confirmed double-peaked Ic-BL SN discovered without a GRB trigger, and shows X-ray and radio emission similar to LLGRB-SNe: this is consistent with models in which the same mechanism produces both the LLGRB and the shock-cooling emission. For four of the five other nearby ($z\lesssim0.05$) Ic-BL SNe with ZTF high-cadence data, we rule out a first peak like that seen in SN2006aj and SN2020bvc, i.e. that lasts $\approx 1$d and reaches a peak luminosity $M \approx -18$. X-ray and radio follow-up observations of future such events will establish whether double-peaked optical light curves are indeed predictive of LLGRB-like X-ray and radio emission.

(Abridged) Using the Zwicky Transient Facility alert stream, we are conducting a large campaign to spectroscopically classify all transients occurring in galaxies in the Census of the Local Universe (CLU) catalog. The aim of the experiment is to construct a spectroscopically complete, volume-limited sample of transients coincident within 100" of CLU galaxies out to 200 Mpc, and to a depth of 20 mag. We describe the survey design and spectroscopic completeness from the first 16 months of operations. We present results from a systematic search for Calcium rich gap transients in the sample of 22 low luminosity (peak absolute magnitude $M > -17$), hydrogen poor events found in the experiment (out of 754 spectroscopically classified SNe). We report the detection of eight Calcium rich gap transients, and constrain their volumetric rate to be at least $\approx 15\pm5$% of the SN Ia rate. Combining this sample with ten events from the literature, we find a likely continuum of spectroscopic properties ranging from events with SN Ia-like features (Ca-Ia objects) to SN Ib/c-like features (Ca-Ib/c objects) at peak light. Within the Ca-Ib/c events, we find two populations of events distinguished by their red ($g - r \approx 1.5$ mag) or green ($g - r \approx 0.5$ mag) spectral colors at $r$-band peak, wherein redder events show strong line blanketing signatures, slower light curves, weaker He lines and lower [Ca II]/[O I] in the nebular phase. Together, we find that the spectroscopic continuum, volumetric rates and striking old environments are consistent with the explosive burning of He shells on low mass white dwarfs. We posit that Ca-Ia and red Ca-Ib/c objects are consistent with the double detonation of He shells with high He burning efficiency, while green Ca-Ib/c objects could arise from less efficient He burning scenarios such as detonations in low density He shells or He shell deflagrations.

We present ZTF18abvkwla (the "Koala"), a fast blue optical transient discovered in the Zwicky Transient Facility (ZTF) One-Day Cadence (1DC) Survey. ZTF18abvkwla has a number of features in common with the groundbreaking transient AT2018cow: blue colors at peak ($g-r\approx-0.5$ mag), a short rise time from half-max of under two days, a decay time to half-max of only three days, a high optical luminosity ($M_{g,\mathrm{peak}}\approx-20.6$mag), a hot ($\gtrsim 40,000$K) featureless spectrum at peak light, and a luminous radio counterpart. At late times ($\Delta t>80$d) the radio luminosity of ZTF18abvkwla ($\nu L_\nu \gtrsim 10^{40}$erg/s at 10 GHz, observer-frame) is most similar to that of long-duration gamma-ray bursts (GRBs). The host galaxy is a dwarf starburst galaxy ($M\approx5\times10^{8}M_\odot$, $\mathrm{SFR}\approx7 M_\odot$/yr) that is moderately metal-enriched ($\log\mathrm{[O/H]} \approx 8.5$), similar to the hosts of GRBs and superluminous supernovae. As in AT2018cow, the radio and optical emission in ZTF18abvkwla likely arise from two separate components: the radio from fast-moving ejecta ($\Gamma \beta c >0.38c$) and the optical from shock-interaction with confined dense material ($<0.07M_\odot$ in $\sim 10^{15}$cm). Compiling transients in the literature with $t_\mathrm{rise} <5$d and $M_\mathrm{peak}<-20$mag, we find that a significant number are engine-powered, and suggest that the high peak optical luminosity is directly related to the presence of this engine. From 18 months of the 1DC survey, we find that transients in this rise-luminosity phase space are at least two to three orders of magnitude less common than CC SNe. Finally, we discuss strategies for identifying such events with future facilities like the Large Synoptic Survey Telescope, and prospects for detecting accompanying X-ray and radio emission.

We present ZTF18aaqjovh (SN 2018bvw), a high-velocity ("broad-lined") stripped-envelope (Type Ic) supernova (Ic-BL SN) discovered in the Zwicky Transient Facility one-day cadence survey. ZTF18aaqjovh shares a number of features in common with engine-driven explosions: the photospheric velocity and the shape of the optical light curve are very similar to that of the Type Ic-BL SN 1998bw, which was associated with a low-luminosity gamma-ray burst (LLGRB) and had relativistic ejecta. However, the radio luminosity of ZTF18aaqjovh is almost two orders of magnitude fainter than that of SN 1998bw at the same velocity phase, and the shock velocity is at most mildly relativistic (v=0.06-0.4c). A search of high-energy catalogs reveals no compelling GRB counterpart to ZTF18aaqjovh, and the limit on the prompt GRB luminosity of $L_{\gamma,\mathrm{iso}} \approx 1.6 \times 10^{48}$ erg/sec excludes a classical GRB but not an LLGRB. Altogether, ZTF18aaqjovh represents another transition event between engine-driven SNe associated with GRBs and "ordinary" Ic-BL SNe.

We report the discovery of the first short period binary in which a hot subdwarf star (sdOB) fills its Roche lobe and started mass transfer to its companion. The object was discovered as part of a dedicated high-cadence survey of the Galactic Plane named the Zwicky Transient Facility and exhibits a period of $P_{\rm orb}=39.3401(1)$ min, making it the most compact hot subdwarf binary currently known. Spectroscopic observations are consistent with an intermediate He-sdOB star with an effective temperature of $T_{\rm eff}=42,400\pm300$ K and a surface gravity of $\log(g)=5.77\pm0.05$. A high-signal-to noise GTC+HiPERCAM light curve is dominated by the ellipsoidal deformation of the sdOB star and an eclipse of the sdOB by an accretion disk. We infer a low-mass hot subdwarf donor with a mass $M_{\rm sdOB}=0.337\pm0.015$ M$_\odot$ and a white dwarf accretor with a mass $M_{\rm WD}=0.545\pm0.020$ M$_\odot$. Theoretical binary modeling indicates the hot subdwarf formed during a common envelope phase when a $2.5-2.8$ M$_\odot$ star lost its envelope when crossing the Hertzsprung Gap. To match its current $P_{\rm orb}$, $T_{\rm eff}$, $\log(g)$, and masses, we estimate a post-common envelope period of $P_{\rm orb}\approx150$ min, and find the sdOB star is currently undergoing hydrogen shell burning. We estimate that the hot subdwarf will become a white dwarf with a thick helium layer of $\approx0.1$ M$_\odot$ and will merge with its carbon/oxygen white dwarf companion after $\approx17$ Myr and presumably explode as a thermonuclear supernova or form an R CrB star.

The Zwicky Transient Facility (ZTF) is currently surveying the entire northern sky, including dense Galactic plane fields. Here, we present preliminary results of the search for gravitational microlensing events in the ZTF data collected from the beginning of the survey (March 20, 2018) through June 30, 2019.

We present a survey of the early evolution of 12 Type IIn supernovae (SNe IIn) in the Ultra-Violet (UV) and visible light. We use this survey to constrain the geometry of the circumstellar material (CSM) surrounding SN IIn explosions, which may shed light on their progenitor diversity. In order to distinguish between aspherical and spherical circumstellar material (CSM), we estimate the blackbody radius temporal evolution of the SNe IIn of our sample, following the method introduced by Soumagnac et al. We find that higher luminosity objects tend to show evidence for aspherical CSM. Depending on whether this correlation is due to physical reasons or to some selection bias, we derive a lower limit between 35% and 66% on the fraction of SNe IIn showing evidence for aspherical CSM. This result suggests that asphericity of the CSM surrounding SNe IIn is common - consistent with data from resolved images of stars undergoing considerable mass loss. It should be taken into account for more realistic modelling of these events.

While it is clear that Type Ia supernovae (SNe) are the result of thermonuclear explosions in C/O white dwarfs (WDs), a great deal remains uncertain about the binary companion that facilitates the explosive disruption of the WD. Here, we present a comprehensive analysis of a unique, and large, data set of 127 SNe Ia with exquisite coverage by the Zwicky Transient Facility (ZTF). High-cadence (6 observations per night) ZTF observations allow us to measure the SN rise time and examine its initial evolution. We develop a Bayesian framework to model the early rise as a power-law in time, which enables the inclusion of priors in our model. For a volume-limited subset of normal SNe Ia, we find the mean power-law index is consistent with 2 in the $r_\mathrm{ztf}$-band ($\alpha_r = 2.01\pm0.02$), as expected in the expanding fireball model. There are, however, individual SNe that are clearly inconsistent with $\alpha_r=2$. We estimate a mean rise time of 18.5$\,$d (with a range extending from $\sim$15$-$22$\,$d), though this is subject to the adopted prior. We identify an important, previously unknown, bias whereby the rise times for higher redshift SNe within a flux-limited survey are systematically underestimated. This effect can be partially alleviated if the power-law index is fixed to $\alpha=2$, in which case we estimate a mean rise time of 21.0$\,$d (with a range from $\sim$18$-$23$\,$d). The sample includes a handful or rare and peculiar SNe Ia. Finally, we conclude with a discussion of lessons learned from the ZTF sample that can eventually be applied to Large Synoptic Survey Telescope observations.

While tidal disruption events (TDEs) have long been heralded as laboratories for the study of quiescent black holes, the small number of known TDEs and uncertainties in their emission mechanism have hindered progress towards this promise. Here present 17 new TDEs that have been detected recently by the Zwicky Transient Facility along with Swift UV and X-ray follow-up observations. Our homogeneous analysis of the optical/UV light curves, including 22 previously known TDEs from the literature, reveals a clean separation of light curve properties with spectroscopic class. The TDEs with Bowen fluorescence features in their optical spectra have smaller blackbody radii, as well as longer rise times and higher disruption rates compared to the rest of the sample. The Bowen fluorescence mechanism requires a high density which can be reached at smaller radii, which in turn yields longer diffusion timescales. Thus, the difference in rise times suggests the pre-peak TDE light curves are governed not by the fallback timescale, but instead by the diffusion of photons through the tidal debris. The small subset of TDEs that show only helium emission lines in their spectra have the longest rise times, the highest luminosities and the lowest rates. We also report, for the first time, the detection of soft X-ray flares from a TDE on day timescales. Based on the fact the flares peak at a luminosity similar to the optical/UV blackbody luminosity, we attribute them to brief glimpses through a reprocessing layer that otherwise obscures the inner accretion flow.

Comet 2I/Borisov, the first unambiguous interstellar comet ever found, was discovered in August 2019 at $\sim3$ au from the Sun on its inbound leg. No pre-discovery detection beyond 3 au has yet been reported, mostly due to the comet's proximity to the Sun as seen from the Earth. Here we present a search for pre-discovery detections of comet Borisov using images taken by the Catalina Sky Survey (CSS), Pan-STARRS and Zwicky Transient Facility (ZTF), with a further comprehensive follow-up campaign being presented in \citet{Bolin2019}. We identified comet Borisov in ZTF images taken in May 2019 and use these data to update its orbit. This allowed us to identify the comet in images acquired as far back as December 2018, when it was 7.8 au from the Sun. The comet was not detected in November 2018 when it was 8.6 au from the Sun, possibly implying an onset of activity around this time. This suggests that the activity of the comet is either driven by a more volatile species other than H$_2$O, such as CO or CO$_2$, or by exothermic crystallization of amorphous ice. We derive the radius of the nucleus to be $<7$ km using the non-detection in November 2018, and estimate an area of $\sim0.5$---$10 \mathrm{km^2}$ has been active between December 2018 and September 2019, though this number is model-dependent and is highly uncertain. The behavior of comet Borisov during its inbound leg is observationally consistent with dynamically new comets observed in our solar system, suggesting some similarities between the two.

We present detailed observations of ZTF18abukavn (SN2018gep), discovered in high-cadence data from the Zwicky Transient Facility as a rapidly rising ($1.4\pm0.1$ mag/hr) and luminous ($M_{g,\mathrm{peak}}=-20$ mag) transient. It is spectroscopically classified as a broad-lined stripped-envelope supernova (Ic-BL SN). The high peak luminosity ($L_{\mathrm{bol}} \gtrsim 3 \times 10^{44}$ erg $\mathrm{sec}^{-1}$), the short rise time ($t_{\mathrm{rise}}= 3$ days in $g$-band), and the blue colors at peak ($g-r\sim-0.4$) all resemble the high-redshift Ic-BL iPTF16asu, as well as several other unclassified fast transients. The early discovery of SN2018gep (within an hour of shock breakout) enabled an intensive spectroscopic campaign, including the highest-temperature ($T_{\mathrm{eff}}\gtrsim40,000$ K) spectra of a stripped-envelope SN. A retrospective search revealed luminous ($M_g \sim M_r \approx -14\,$mag) emission in the days to weeks before explosion, the first definitive detection of precursor emission for a Ic-BL. We find a limit on the isotropic gamma-ray energy release $E_\mathrm{\gamma,iso}<4.9 \times 10^{48}$ erg, a limit on X-ray emission $L_{\mathrm{X}} < 10^{40}\,$erg sec$^{-1}$, and a limit on radio emission $\nu L_\nu \lesssim 10^{37}\,$erg sec$^{-1}$. Taken together, we find that the early ($<10\,$days) data are best explained by shock breakout in a massive shell of dense circumstellar material ($0.02\,M_\odot$) at large radii ($3 \times 10^{14}\,$cm) that was ejected in eruptive pre-explosion mass-loss episodes. The late-time ($>10$ days) light curve requires an additional energy source, which could be the radioactive decay of Ni-56.

Comets are primitive objects that formed in the protoplanetary disk, and have been largely preserved over the history of the Solar System. However, they are not pristine, and surfaces of cometary nuclei do evolve. In order to understand the extent of their primitive nature, we must define the mechanisms that affect their surfaces and comae. We examine the lightcurve of comet 240P/NEAT over three consecutive orbits, and investigate three events of significant brightening ($\Delta m \sim -2$ mag). Unlike typical cometary outbursts, each of the three events are long-lived, with enhanced activity for at least 3 to 6 months. The third event, observed by the Zwicky Transient Facility, occurred in at least two stages. The anomalous behavior appears to have started after the comet was perturbed by Jupiter in 2007, reducing its perihelion distance from 2.53 to 2.12 au. We suggest that the brightening events are temporary transitions to a higher baseline activity level, brought on by the increased insolation, which has warmed previously insulated sub-surface layers. The new activity is isolated to one or two locations on the nucleus, indicating that the surface or immediate sub-surface is heterogeneous. Further study of this phenomenon may provide insight into cometary outbursts, the structure of the near-surface nucleus, and cometary nucleus mantling.

The Zwicky Transient Facility (ZTF) is performing a three-day cadence survey of the visible Northern sky (~3$\pi$). The transient candidates found in this survey are announced via public alerts. As a supplementary product ZTF is also conducting a large spectroscopic campaign: the ZTF Bright Transient Survey (BTS). The goal of the BTS is to spectroscopically classify all extragalactic transients brighter than 18.5 mag at peak brightness and immediately announce those classifications to the public. Extragalactic discoveries from ZTF are predominantly Supernovae (SNe). The BTS is the largest flux-limited SN survey to date. Here we present a catalog of the761 SNe that were classified during the first nine months of the survey (2018 Apr. 1 to 2018 Dec. 31). The BTS SN catalog contains redshifts based on SN template matching and spectroscopic host galaxy redshifts when available. Based on this data we perform an analysis of the redshift completeness of local galaxy catalogs, dubbed as the Redshift Completeness Fraction (RCF; the number of SN host galaxies with known spectroscopic redshift prior to SN discovery divided by the total number of SN hosts). In total, we identify the host galaxies of 512 Type Ia supernovae, 227 of which have known spectroscopic redshifts, yielding an RCF estimate of $44\% \pm1\%$. We find a steady decrease in the RCF with increasing distance in the local universe. For z<0.05, or ~200 Mpc, we find RCF=0.6, which has important ramifications when searching for multimessenger astronomical events. Prospects for dramatically increasing the RCF are limited to new multi-fiber spectroscopic instruments, or wide-field narrowband surveys. We find that existing galaxy redshift catalogs are only $50\%$ complete at $r\approx16.9$ mag. Pushing this limit several magnitudes deeper will pay huge dividends when searching for electromagnetic counterparts to gravitational wave events.

Context: Type Ibn supernovae (SNe) are rapidly-evolving and luminous (M$_\text{R,peak}$ $\sim-19$) transients interacting with He-rich circumstellar material (CSM). SN 2018bcc, detected by the ZTF shortly after explosion, provides the best constraints on the shape of the rising lightcurve of a fast Type Ibn. Aims: We use the high-quality data set of SN 2018bcc to study observational signatures of the class. Additionally, the powering mechanism of SN 2018bcc offers insights into the debated progenitor connection of Type Ibn SNe. Methods: Well-constrained lightcurve properties obtained from empirical models are compared with the literature. We fit the pseudo-bolometric lightcurve with semi-analytical models powered by radioactive decay and CSM interaction. The line profiles and emissivity of the prominent He I lines are modeled to study the formation of P-Cygni profiles and to estimate CSM properties. Results: SN 2018bcc has a risetime to peak of $5.6^{+0.2}_{-0.1}$ days in the rest frame with a rising shape powerlaw index near 2, and seems to be a typical rapidly-evolving Type Ibn SN. The spectrum lacks signatures of SN-like ejecta and is dominated by over 15 He emission features at 20 days past peak, alongside Ca and Mg, all with V$_{\text{FWHM}} \sim 2000~\text{km}~\text{s}^{-1}$. The luminous and rapidly-evolving lightcurve can be powered by CSM interaction but not by the decay of radioactive $^{56}$Ni. Modeling of the He I lines indicates a dense and optically thick CSM that can explain the P-Cygni profiles. Conclusions: Like other rapidly-evolving Type Ibn SNe, SN 2018bcc is a luminous transient with a rapid rise to peak powered by shock-interaction inside a dense and He-rich CSM. Its spectra do not support the existence of two Type Ibn spectral classes. We also note the remarkable observational match to pulsational pair instability (PPI) SN models.

Early-time observations of Type Ia supernovae (SNe Ia) are essential to constrain their progenitor properties. In this paper, we present high-quality light curves of 127 SNe Ia discovered by the Zwicky Transient Facility (ZTF) in 2018. We describe our method to perform forced point spread function (PSF) photometry, which can be applied to other types of extragalactic transients. With a planned cadence of six observations per night ($3g+3r$), all of the 127 SNe Ia are detected in both $g$ and $r$ band more than 10\,d (in the rest frame) prior to the epoch of $g$-band maximum light. The redshifts of these objects range from $z=0.0181$ to 0.165; the median redshift is 0.074. Among the 127 SNe, 50 are detected at least 14\,d prior to maximum light (in the rest frame), with a subset of 9 objects being detected more than 17\,d before $g$-band peak. This is the largest sample of young SNe Ia collected to date; it can be used to study the shape and color evolution of the rising light curves in unprecedented detail. We discuss six peculiar events in this sample, including one 02cx-like event ZTF18abclfee (SN\,2018crl), one Ia-CSM SN ZTF18aaykjei (SN\,2018cxk), and four objects with possible super-Chandrasekhar mass progenitors: ZTF18abhpgje (SN\,2018eul), ZTF18abdpvnd (SN\,2018dvf), ZTF18aawpcel (SN\,2018cir) and ZTF18abddmrf (SN\,2018dsx).

We present photometry and spectroscopy of four hydrogen-poor luminous supernovae discovered during the two-month science commissioning and early operations of the Zwicky Transient Facility (ZTF) survey. Three of these objects, SN2018bym (ZTF18aapgrxo), SN2018avk (ZTF18aaisyyp) and SN2018bgv (ZTF18aavrmcg) resemble typical SLSN-I spectroscopically, while SN2018don (ZTF18aajqcue) may be an object similar to SN2007bi experiencing considerable host galaxy reddening, or an intrinsically long-lived, luminous and red SN Ic. We analyze the light curves, spectra, and host galaxy properties of these four objects and put them in context of the population of SLSN-I. SN2018bgv stands out as the fastest-rising SLSN-I observed to date, with a rest-frame g-band rise time of just 10 days from explosion to peak -- if it is powered by magnetar spin-down, the implied ejecta mass is only ~1 M$_{\odot}$. SN2018don also displays unusual properties -- in addition to its red colors and comparatively massive host galaxy, the light curve undergoes some of the strongest light curve undulations post-peak seen in a SLSN-I, which we speculate may be due to interaction with circumstellar material. We discuss the promises and challenges of finding SLSNe in large-scale surveys like ZTF given the observed diversity in the population.

The third observing run by LVC has brought the discovery of many compact binary coalescences. Following the detection of the first binary neutron star merger in this run (LIGO/Virgo S190425z), we performed a dedicated follow-up campaign with the Zwicky Transient Facility (ZTF) and Palomar Gattini-IR telescopes. The initial skymap of this single-detector gravitational wave (GW) trigger spanned most of the sky observable from Palomar Observatory. Covering 8000 deg$^2$ of the initial skymap over the next two nights, corresponding to 46\% integrated probability, ZTF system achieved a depth of $\approx$\,21 $m_\textrm{AB}$ in $g$- and $r$-bands. Palomar Gattini-IR covered 2200 square degrees in $J$-band to a depth of 15.5\,mag, including 32\% integrated probability based on the initial sky map. The revised skymap issued the following day reduced these numbers to 21\% for the Zwicky Transient Facility and 19\% for Palomar Gattini-IR. We narrowed 338,646 ZTF transient "alerts" over the first two nights of observations to 15 candidate counterparts. Two candidates, ZTF19aarykkb and ZTF19aarzaod, were particularly compelling given that their location, distance, and age were consistent with the GW event, and their early optical lightcurves were photometrically consistent with that of kilonovae. These two candidates were spectroscopically classified as young core-collapse supernovae. The remaining candidates were ruled-out as supernovae. Palomar Gattini-IR did not identify any viable candidates with multiple detections only after merger time. We demonstrate that even with single-detector GW events localized to thousands of square degrees, systematic kilonova discovery is feasible.

Joint survey processing (JSP) is the pixel level combination of LSST, Euclid, and WFIRST datasets. By combining the high spatial resolution of the space-based datasets with deep, seeing-limited, ground-based images in the optical bands, systematics like source confusion and astrometric mismatch can be addressed to derive the highest precision optical/infrared photometric catalogs. This white paper highlights the scientific motivation, computational and algorithmic needs to build joint pixel level processing capabilities, which the individual projects by themselves will not be able to support. Through this white paper, we request that the Astro2020 decadal committee recognize the JSP effort as a multi-agency project with the natural outcome being a collaborative effort among groups which are normally supported by a single agency. JSP will allow the U.S. (and international) astronomical community to manipulate the flagship data sets and undertake innovative science investigations ranging from solar system object characterization, exoplanet detections, nearby galaxy rotation rates and dark matter properties, to epoch of reionization studies. It will also result in the ultimate constraints on cosmological parameters and the nature of dark energy, with far smaller uncertainties and a better handle on systematics than by any one survey alone.

We report the discovery of six active galactic nuclei (AGN) caught "turning on" during the first nine months of the Zwicky Transient Facility (ZTF) survey. The host galaxies were classified as LINERs by weak narrow forbidden line emission in their archival SDSS spectra, and detected by ZTF as nuclear transients. In five of the cases, we found via follow-up spectroscopy that they had transformed into broad-line AGN, reminiscent of the changing-look LINER iPTF 16bco. In one case, ZTF18aajupnt/AT2018dyk, follow-up HST UV and ground-based optical spectra revealed the transformation into a narrow-line Seyfert 1 (NLS1) with strong [Fe VII, X, XIV] and He II 4686 coronal lines. Swift monitoring observations of this source reveal bright UV emission that tracks the optical flare, accompanied by a luminous soft X-ray flare that peaks ~60 days later. Spitzer follow-up observations also detect a luminous mid-infrared flare implying a large covering fraction of dust. Archival light curves of the entire sample from CRTS, ATLAS, and ASAS-SN constrain the onset of the optical nuclear flaring from a prolonged quiescent state. Here we present the systematic selection and follow-up of this new class of changing-look LINERs, compare their properties to previously reported changing-look Seyfert galaxies, and conclude that they are a unique class of transients well-suited to test the uncertain physical processes associated with the LINER accretion state.

We present the discovery of an optical transient (OT) in Messier 51, designated M51 OT2019-1 (also ZTF19aadyppr, AT 2019abn, ATLAS19bzl), by the Zwicky Transient Facility (ZTF). The OT rose over 15 days to an observed luminosity of $M_r=-13$ (${\nu}L_{\nu}=9\times10^6~L_{\odot}$), in the luminosity gap between novae and typical supernovae (SNe). Spectra during the outburst show a red continuum, Balmer emission with a velocity width of $\approx400$ km s$^{-1}$, Ca II and [Ca II] emission, and absorption features characteristic of an F-type supergiant. The spectra and multiband light curves are similar to the so-called "SN impostors" and intermediate-luminosity red transients (ILRTs). We directly identify the likely progenitor in archival Spitzer Space Telescope imaging with a $4.5~\mu$m luminosity of $M_{[4.5]}\approx-12.2$ and a $[3.6]-[4.5]$ color redder than 0.74 mag, similar to those of the prototype ILRTs SN 2008S and NGC 300 OT2008-1. Intensive monitoring of M51 with Spitzer further reveals evidence for variability of the progenitor candidate at [4.5] in the years before the OT. The progenitor is not detected in pre-outburst Hubble Space Telescope optical and near-IR images. The optical colors during outburst combined with spectroscopic temperature constraints imply a higher reddening of $E(B-V)\approx0.7$ mag and higher intrinsic luminosity of $M_r\approx-14.9$ (${\nu}L_{\nu}=5.3\times10^7~L_{\odot}$) near peak than seen in previous ILRT candidates. Moreover, the extinction estimate is higher on the rise than on the plateau, suggestive of an extended phase of circumstellar dust destruction. These results, enabled by the early discovery of M51 OT2019-1 and extensive pre-outburst archival coverage, offer new clues about the debated origins of ILRTs and may challenge the hypothesis that they arise from the electron-capture induced collapse of extreme asymptotic giant branch stars.

Efficient automated detection of flux-transient, reoccurring flux-variable, and moving objects is increasingly important for large-scale astronomical surveys. We present braai, a convolutional-neural-network, deep-learning real/bogus classifier designed to separate genuine astrophysical events and objects from false positive, or bogus, detections in the data of the Zwicky Transient Facility (ZTF), a new robotic time-domain survey currently in operation at the Palomar Observatory in California, USA. Braai demonstrates a state-of-the-art performance as quantified by its low false negative and false positive rates. We describe the open-source software tools used internally at Caltech to archive and access ZTF's alerts and light curves (Kowalski), and to label the data (Zwickyverse). We also report the initial results of the classifier deployment on the Edge Tensor Processing Units (TPUs) that show comparable performance in terms of accuracy, but in a much more (cost-) efficient manner, which has significant implications for current and future surveys.

High cadence transient surveys are able to capture supernovae closer to their first light than before. Applying analytical models to such early emission, we can constrain the progenitor stars properties. In this paper, we present observations of SN2018fif (ZTF18abokyfk). The supernova was discovered close to first light and monitored by the Zwicky Transient Facility (ZTF) and the Neil Gehrels Swift Observatory. Early spectroscopic observations suggest that the progenitor of SN2018fif was surrounded by relatively small amounts of circumstellar material (CSM) compared to all previous cases. This particularity, coupled with the high cadence multiple-band coverage, makes it a good candidate to investigate using shock-cooling models. We employ the SOPRANOS code, an implementation of the model by Sapir & Waxman (2017). Compared with previous implementations, SOPRANOS has the advantage of including a careful account of the limited temporal validity domain of the shock-cooling model. We find that the progenitor of SN2018fif was a large red supergiant, with a radius of R=1174_{-81}^{+208} solar radii, and an ejected mass of M=5.6_{-1.0}^{+9.1} solar masses. Our model also gives information on the explosion epoch, the progenitor inner structure, the shock velocity and the extinction. The large radius differs from previously modeled objects, and the difference could be either intrinsic or due to the relatively small amount of CSM around SN2018fif, perhaps making it a "cleaner" candidate for applying shock-cooling analytical models.

We describe ZStreak, a semi-real-time pipeline specialized in detecting small, fast-moving near-Earth asteroids (NEAs) that is currently operating on the data from the newly-commissioned Zwicky Transient Facility (ZTF) survey. Based on a prototype originally developed by Waszczak et al. (2017) for the Palomar Transient Factory (PTF), the predecessor of ZTF, ZStreak features an improved machine-learning model that can cope with the $10\times$ data rate increment between PTF and ZTF. Since its first discovery on 2018 February 5 (2018 CL), ZTF/ZStreak has discovered $45$ confirmed new NEAs over a total of 232 observable nights until 2018 December 31. Most of the discoveries are small NEAs, with diameters less than $\sim100$ m. By analyzing the discovery circumstances, we find that objects having the first to last detection time interval under 2 hr are at risk of being lost. We will further improve real-time follow-up capabilities, and work on suppressing false positives using deep learning.

We investigate ZTF18aalrxas, a double-peaked Type IIb core-collapse supernova (SN) discovered during science validation of the Zwicky Transient Facility (ZTF). ZTF18aalrxas was discovered while the optical emission was still rising towards the initial cooling peak (0.7 mag over 2 days). Our observations consist of multi-band (UV, optical) light-curves, and optical spectra spanning from $\approx0.7$ d to $\approx180$ d past the explosion. We use a Monte-Carlo based non-local thermodynamic equilibrium (NLTE) model, that simultanously reproduces both the $\rm ^{56}Ni$ powered bolometric light curve and our nebular spectrum. This model is used to constrain the synthesized radioactive nickel mass (0.17 $\mathrm{M}_{\odot}$) and the total ejecta mass (1.7 $\mathrm{M}_{\odot}$) of the SN. The cooling emission is modeled using semi-analytical extended envelope models to constrain the progenitor radius ($790-1050$ $\mathrm{R}_{\odot}$) at the time of explosion. Our nebular spectrum shows signs of interaction with a dense circumstellar medium (CSM), and this spetrum is modeled and analysed to constrain the amount of ejected oxygen ($0.3-0.5$ $\mathrm{M}_{\odot}$) and the total hydrogen mass ($\approx0.15$ $\mathrm{M}_{\odot}$) in the envelope of the progenitor. The oxygen mass of ZTF18aalrxas is consistent with a low ($12-13$ $\mathrm{M}_{\odot}$) Zero Age Main Sequence mass progenitor. The light curves and spectra of ZTF18aalrxas are not consistent with massive single star SN Type IIb progenitor models. The presence of an extended hydrogen envelope of low mass, the presence of a dense CSM, the derived ejecta mass, and the late-time oxygen emission can all be explained in a binary model scenario.

We report the discovery of non-stellar hydrogen Balmer and metastable helium absorption lines accompanying a transient, high-velocity (0.05$c$) broad absorption line (BAL) system in the optical spectra of the tidal disruption event (TDE) AT2018zr ($z=0.071$). In the HST UV spectra, absorption of high- and low-ionization lines are also present at this velocity, making AT2018zr resemble a low-ionization broad absorption line (LoBAL) QSO. We conclude that these transient absorption features are more likely to arise in fast outflows produced by the TDE than absorbed by the unbound debris. In accordance with the outflow picture, we are able to reproduce the flat-topped H$\alpha$ emission in a spherically expanding medium, without invoking the typical prescription of an elliptical disk. We also report the appearance of narrow ($\sim$1000~km~s$^{-1}$) NIII$\lambda$4640, HeII$\lambda4686$, H$\alpha$, and H$\beta$, emission in the late-time optical spectra of AT2018zr, which may be a result of UV continuum hardening at late time as observed by Swift. Including AT2018zr, we find a high association rate (3 out of 4) of BALs in the UV spectra of TDEs. This suggests that outflows may be ubiquitous among TDEs and may be less sensitive to viewing angle effects compared to QSO outflows.

We present Zwicky Transient Facility (ZTF) observations of the tidal disruption flare AT2018zr/PS18kh reported by Holoien et al. and detected during ZTF commissioning. The ZTF light curve of the tidal disruption event (TDE) samples the rise-to-peak exceptionally well, with 50 days of g- and r-band detections before the time of maximum light. We also present our multi-wavelength follow-up observations, including the detection of a thermal (kT~100 eV) X-ray source that is two orders of magnitude fainter than the contemporaneous optical/UV blackbody luminosity, and a stringent upper limit to the radio emission. We use observations of 128 known active galactic nuclei (AGN) to assess the quality of the ZTF astrometry, finding a median host-flare distance of 0.2" for genuine nuclear flares. Using ZTF observations of variability from known AGN and supernovae we show how these sources can be separated from TDEs. A combination of light-curve shape, color, and location in the host galaxy can be used to select a clean TDE sample from multi-band optical surveys such as ZTF or LSST.

The Zwicky Transient Facility (ZTF) survey generates real-time alerts for optical transients, variables, and moving objects discovered in its wide-field survey. We describe the ZTF alert stream distribution and processing (filtering) system. The system uses existing open-source technologies developed in industry: Kafka, a real-time streaming platform, and Avro, a binary serialization format. The technologies used in this system provide a number of advantages for the ZTF use case, including (1) built-in replication, scalability, and stream rewind for the distribution mechanism; (2) structured messages with strictly enforced schemas and dynamic typing for fast parsing; and (3) a Python-based stream processing interface that is similar to batch for a familiar and user-friendly plug-in filter system, all in a modular, primarily containerized system. The production deployment has successfully supported streaming up to 1.2 million alerts or roughly 70 GB of data per night, with each alert available to a consumer within about 10 s of alert candidate production. Data transfer rates of about 80,000 alerts/minute have been observed. In this paper, we discuss this alert distribution and processing system, the design motivations for the technology choices for the framework, performance in production, and how this system may be generally suitable for other alert stream use cases, including the upcoming Large Synoptic Survey Telescope.

The Zwicky Transient Facility (ZTF) is a new optical time-domain survey that uses the Palomar 48-inch Schmidt telescope. A custom-built wide-field camera provides a 47 deg$^2$ field of view and 8 second readout time, yielding more than an order of magnitude improvement in survey speed relative to its predecessor survey, the Palomar Transient Factory (PTF). We describe the design and implementation of the camera and observing system. The ZTF data system at the Infrared Processing and Analysis Center provides near-real-time reduction to identify moving and varying objects. We outline the analysis pipelines, data products, and associated archive. Finally, we present on-sky performance analysis and first scientific results from commissioning and the early survey. ZTF's public alert stream will serve as a useful precursor for that of the Large Synoptic Survey Telescope.

The Zwicky Transient Facility (ZTF), a public-private enterprise, is a new time domain survey employing a dedicated camera on the Palomar 48-inch Schmidt telescope with a 47 deg$^2$ field of view and 8 second readout time. It is well positioned in the development of time domain astronomy, offering operations at 10% of the scale and style of the Large Synoptic Survey Telescope (LSST) with a single 1-m class survey telescope. The public surveys will cover the observable northern sky every three nights in g and r filters and the visible Galactic plane every night in g and r. Alerts generated by these surveys are sent in real time to brokers. A consortium of universities which provided funding ("partnership") are undertaking several boutique surveys. The combination of these surveys producing one million alerts per night allows for exploration of transient and variable astrophysical phenomena brighter than r $\sim$ 20.5 on timescales of minutes to years. We describe the primary science objectives driving ZTF including the physics of supernovae and relativistic explosions, multi-messenger astrophysics, supernova cosmology, active galactic nuclei and tidal disruption events, stellar variability, and Solar System objects.

The Zwicky Transient Facility (ZTF) is a new robotic time-domain survey currently in progress using the Palomar 48-inch Schmidt Telescope. ZTF uses a 47 square degree field with a 600 megapixel camera to scan the entire northern visible sky at rates of ~3760 square degrees/hour to median depths of g ~ 20.8 and r ~ 20.6 mag (AB, 5sigma in 30 sec). We describe the Science Data System that is housed at IPAC, Caltech. This comprises the data-processing pipelines, alert production system, data archive, and user interfaces for accessing and analyzing the products. The realtime pipeline employs a novel image-differencing algorithm, optimized for the detection of point source transient events. These events are vetted for reliability using a machine-learned classifier and combined with contextual information to generate data-rich alert packets. The packets become available for distribution typically within 13 minutes (95th percentile) of observation. Detected events are also linked to generate candidate moving-object tracks using a novel algorithm. Objects that move fast enough to streak in the individual exposures are also extracted and vetted. The reconstructed astrometric accuracy per science image with respect to Gaia is typically 45 to 85 milliarcsec. This is the RMS per axis on the sky for sources extracted with photometric S/N >= 10. The derived photometric precision (repeatability) at bright unsaturated fluxes varies between 8 and 25 millimag. Photometric calibration accuracy with respect to Pan-STARRS1 is generally better than 2%. The products support a broad range of scientific applications: fast and young supernovae, rare flux transients, variable stars, eclipsing binaries, variability from active galactic nuclei, counterparts to gravitational wave sources, a more complete census of Type Ia supernovae, and Solar System objects.

The Zwicky Transient Facility is a large optical survey in multiple filters producing hundreds of thousands of transient alerts per night. We describe here various machine learning (ML) implementations and plans to make the maximal use of the large data set by taking advantage of the temporal nature of the data, and further combining it with other data sets. We start with the initial steps of separating bogus candidates from real ones, separating stars and galaxies, and go on to the classification of real objects into various classes. Besides the usual methods (e.g., based on features extracted from light curves) we also describe early plans for alternate methods including the use of domain adaptation, and deep learning. In a similar fashion we describe efforts to detect fast moving asteroids. We also describe the use of the Zooniverse platform for helping with classifications through the creation of training samples, and active learning. Finally we mention the synergistic aspects of ZTF and LSST from the ML perspective.

There is significant interest in the models for production of short gamma-ray bursts. Until now, the number of known short gamma-ray bursts with multi-wavelength afterglows has been small. While the {\it Fermi} Gamma-Ray Burst Monitor detects many gamma-ray bursts relative to the Neil Gehrels {\it Swift} Observatory, the large localization regions makes the search for counterparts difficult. With the Zwicky Transient Facility recently achieving first light, it is now fruitful to use its combination of depth ($m_\textrm{AB} \sim 20.6$), field of view ($\approx$ 47 square degrees), and survey cadence (every $\sim 3$ days) to perform Target of Opportunity observations. We demonstrate this capability on GRB 180523B, which was recently announced by the {\it Fermi} Gamma-Ray Burst Monitor as a short gamma-ray burst. ZTF imaged $\approx$ 2900\,square degrees of the localization region, resulting in the coverage of 61.6\,\% of the enclosed probability over 2 nights to a depth of $m_\textrm{AB} \sim 20.5$. We characterized 14 previously unidentified transients, and none were found to be consistent with a short gamma-ray burst counterpart. This search with the Zwicky Transient Facility shows it is an efficient camera for searching for coarsely-localized short gamma-ray burst and gravitational-wave counterparts, allowing for a sensitive search with minimal interruption to its nominal cadence.

We present cluster counts and corresponding cosmological constraints from the Planck full mission data set. Our catalogue consists of 439 clusters detected via their Sunyaev-Zeldovich (SZ) signal down to a signal-to-noise ratio of 6, and is more than a factor of 2 larger than the 2013 Planck cluster cosmology sample. The counts are consistent with those from 2013 and yield compatible constraints under the same modelling assumptions. Taking advantage of the larger catalogue, we extend our analysis to the two-dimensional distribution in redshift and signal-to-noise. We use mass estimates from two recent studies of gravitational lensing of background galaxies by Planck clusters to provide priors on the hydrostatic bias parameter, $(1-b)$. In addition, we use lensing of cosmic microwave background (CMB) temperature fluctuations by Planck clusters as an independent constraint on this parameter. These various calibrations imply constraints on the present-day amplitude of matter fluctuations in varying degrees of tension with those from the Planck analysis of primary fluctuations in the CMB; for the lowest estimated values of $(1-b)$ the tension is mild, only a little over one standard deviation, while it remains substantial ($3.7\,\sigma$) for the largest estimated value. We also examine constraints on extensions to the base flat $\Lambda$CDM model by combining the cluster and CMB constraints. The combination appears to favour non-minimal neutrino masses, but this possibility does little to relieve the overall tension because it simultaneously lowers the implied value of the Hubble parameter, thereby exacerbating the discrepancy with most current astrophysical estimates. Improving the precision of cluster mass calibrations from the current 10%-level to 1% would significantly strengthen these combined analyses and provide a stringent test of the base $\Lambda$CDM model.

The Zwicky Transient Facility is a new robotic-observing program, in which a newly engineered 600-MP digital camera with a pioneeringly large field of view, 47~square degrees, will be installed into the 48-inch Samuel Oschin Telescope at the Palomar Observatory. The camera will generate $\sim 1$~petabyte of raw image data over three years of operations. In parallel related work, new hardware and software systems are being developed to process these data in real time and build a long-term archive for the processed products. The first public release of archived products is planned for early 2019, which will include processed images and astronomical-source catalogs of the northern sky in the $g$ and $r$ bands. Source catalogs based on two different methods will be generated for the archive: aperture photometry and point-spread-function fitting.

We present the implications for cosmic inflation of the Planck measurements of the cosmic microwave background (CMB) anisotropies in both temperature and polarization based on the full Planck survey. The Planck full mission temperature data and a first release of polarization data on large angular scales measure the spectral index of curvature perturbations to be $n_\mathrm{s} = 0.968 \pm 0.006$ and tightly constrain its scale dependence to $d n_s/d \ln k =-0.003 \pm 0.007$ when combined with the Planck lensing likelihood. When the high-$\ell$ polarization data is included, the results are consistent and uncertainties are reduced. The upper bound on the tensor-to-scalar ratio is $r_{0.002} < 0.11$ (95% CL), consistent with the B-mode polarization constraint $r< 0.12$ (95% CL) obtained from a joint BICEP2/Keck Array and Planck analysis. These results imply that $V(\phi) \propto \phi^2$ and natural inflation are now disfavoured compared to models predicting a smaller tensor-to-scalar ratio, such as $R^2$ inflation. Three independent methods reconstructing the primordial power spectrum are investigated. The Planck data are consistent with adiabatic primordial perturbations. We investigate inflationary models producing an anisotropic modulation of the primordial curvature power spectrum as well as generalized models of inflation not governed by a scalar field with a canonical kinetic term. The 2015 results are consistent with the 2013 analysis based on the nominal mission data.

This paper presents a study of the ISW effect from the Planck 2015 temperature and polarization data release. The CMB is cross-correlated with different LSS tracers: the NVSS, SDSS and WISE catalogues, and the Planck 2015 lensing map. This cross-correlation yields a detection at $4\,\sigma$, where most of the signal-to-noise is due to the Planck lensing and NVSS. In fact, the ISW effect is detected only from the Planck data (through the ISW-lensing bispectrum) at $\approx 3\,\sigma$, which is similar to the detection level achieved by combining the cross-correlation signal coming from all the catalogues. The ISW signal allow us to detect $\Omega_\Lambda$ at more than $3\,\sigma$. This cross-correlation analysis is performed only with the Planck temperature data, since the polarization scales available in the 2015 release do not permit significant improvement of the CMB-LSS cross-correlation detectability. Nevertheless, polarization data is used to study the anomalously large ISW signal previously reported through the stacking of CMB features at the locations of known superstructures. We find that the current Planck polarization data do not exclude that this signal could be caused by the ISW effect. In addition, the stacking of the Planck lensing map on the locations of superstructures exhibits a positive cross-correlation with these large-scale structures. Finally, we have improved our previous reconstruction of the ISW temperature fluctuations by combining the information encoded in all the previously mentioned LSS tracers. In particular, we construct a map of the ISW secondary anisotropies and the corresponding uncertainties map, obtained from simulations. We also explore the reconstruction of the ISW anisotropies caused by the LSS traced by the 2MPZ survey by directly inverting the density field into the gravitational potential field.

The secondary cosmic microwave background (CMB) $B$-modes stem from the post-decoupling distortion of the polarization $E$-modes due to the gravitational lensing effect of large-scale structures. These lensing-induced $B$-modes constitute both a valuable probe of the dark matter distribution and an important contaminant for the extraction of the primary CMB $B$-modes from inflation. Planck provides accurate nearly all-sky measurements of both the polarization $E$-modes and the integrated mass distribution via the reconstruction of the CMB lensing potential. By combining these two data products, we have produced an all-sky template map of the lensing-induced $B$-modes using a real-space algorithm that minimizes the impact of sky masks. The cross-correlation of this template with an observed (primordial and secondary) $B$-mode map can be used to measure the lensing $B$-mode power spectrum at multipoles up to $2000$. In particular, when cross-correlating with the $B$-mode contribution directly derived from the Planck polarization maps, we obtain lensing-induced $B$-mode power spectrum measurement at a significance level of $12\,\sigma$, which agrees with the theoretical expectation derived from the Planck best-fit $\Lambda$CDM model. This unique nearly all-sky secondary $B$-mode template, which includes the lensing-induced information from intermediate to small ($10\lesssim \ell\lesssim 1000$) angular scales, is delivered as part of the Planck 2015 public data release. It will be particularly useful for experiments searching for primordial $B$-modes, such as BICEP2/Keck Array or LiteBIRD, since it will enable an estimate to be made of the lensing-induced contribution to the measured total CMB $B$-modes.

We present the most significant measurement of the cosmic microwave background (CMB) lensing potential to date (at a level of 40 sigma), using temperature and polarization data from the Planck 2015 full-mission release. Using a polarization-only estimator we detect lensing at a significance of 5 sigma. We cross-check the accuracy of our measurement using the wide frequency coverage and complementarity of the temperature and polarization measurements. Public products based on this measurement include an estimate of the lensing potential over approximately 70% of the sky, an estimate of the lensing potential power spectrum in bandpowers for the multipole range 40<L<400 and an associated likelihood for cosmological parameter constraints. We find good agreement between our measurement of the lensing potential power spectrum and that found in the best-fitting LCDM model based on the Planck temperature and polarization power spectra. Using the lensing likelihood alone we obtain a percent-level measurement of the parameter combination $\sigma_8 \Omega_m^{0.25} = 0.591\pm 0.021$. We combine our determination of the lensing potential with the E-mode polarization also measured by Planck to generate an estimate of the lensing B-mode. We show that this lensing B-mode estimate is correlated with the B-modes observed directly by Planck at the expected level and with a statistical significance of 10 sigma, confirming Planck's sensitivity to this known sky signal. We also correlate our lensing potential estimate with the large-scale temperature anisotropies, detecting a cross-correlation at the 3 sigma level, as expected due to dark energy in the concordance LCDM model.

The scientific computing landscape has evolved dramatically in the past few years, with new schemes for organizing and storing data that reflect the growth in size and complexity of astronomical data sets. In response to this changing landscape, we are, over the next two years, deploying the next generation of the Montage toolkit ([ascl:1010.036]). The first release (October 2015) supports multi-dimensional data sets ("data cubes"), and insertion of XMP/AVM tags that allows images to "drop-in" to the WWT. The same release offers a beta-version of web-based interactive visualization of images; this includes wrappers for visualization in Python. Subsequent releases will support HEALPix (now standard in cosmic background experiments); incorporation of Montage into package managers (which enable automated management of software builds), and support for a library that will enable Montage to be called directly from Python. This next generation toolkit will inherit the architectural benefits of the current engine - component based tools, ANSI-C portability across Unix platforms and scalability for distributed processing. With the expanded functionality under development, Montage can be viewed not simply as a mosaic engine, but as a scalable, portable toolkit for managing, organizing and processing images.

The Planck full mission cosmic microwave background(CMB) temperature and E-mode polarization maps are analysed to obtain constraints on primordial non-Gaussianity(NG). Using three classes of optimal bispectrum estimators - separable template-fitting (KSW), binned, and modal - we obtain consistent values for the local, equilateral, and orthogonal bispectrum amplitudes, quoting as our final result from temperature alone fNL^local=2.5+\-5.7, fNL^equil=-16+\-70 and fNL^ortho=-34+\-33(68%CL). Combining temperature and polarization data we obtain fNL^local=0.8+\-5.0, fNL^equil=-4+\-43 and fNL^ortho=-26+\-21 (68%CL). The results are based on cross-validation of these estimators on simulations, are stable across component separation techniques, pass an extensive suite of tests, and are consistent with Minkowski functionals based measurements. The effect of time-domain de-glitching systematics on the bispectrum is negligible. In spite of these test outcomes we conservatively label the results including polarization data as preliminary, owing to a known mismatch of the noise model in simulations and the data. Beyond fNL estimates, we present model-independent reconstructions of the CMB bispectrum and derive constraints on early universe scenarios that generate NG, including general single-field and axion inflation, initial state modifications, parity-violating tensor bispectra, and directionally dependent vector models. We also present a wide survey of scale-dependent oscillatory bispectra, and we look for isocurvature NG. Our constraint on the local primordial trispectrum amplitude is gNL^local=(-9.0+\-7.7)x10^4 (68%CL), and we perform an analysis of additional trispectrum shapes. The global picture is one of consistency with the premises of the LambdaCDM cosmology, namely that the structure we observe today was sourced by adiabatic, passive, Gaussian, and primordial seed perturbations.[abridged]

This paper presents the Planck 2015 likelihoods, statistical descriptions of the 2-point correlations of CMB data, using the hybrid approach employed previously: pixel-based at $\ell<30$ and a Gaussian approximation to the distribution of spectra at higher $\ell$. The main improvements are the use of more and better processed data and of Planck polarization data, and more detailed foreground and instrumental models, allowing further checks and enhanced immunity to systematics. Progress in foreground modelling enables a larger sky fraction. Improvements in processing and instrumental models further reduce uncertainties. For temperature, we perform an analysis of end-to-end instrumental simulations fed into the data processing pipeline; this does not reveal biases from residual instrumental systematics. The $\Lambda$CDM cosmological model continues to offer a very good fit to Planck data. The slope of primordial scalar fluctuations, $n_s$, is confirmed smaller than unity at more than 5{\sigma} from Planck alone. We further validate robustness against specific extensions to the baseline cosmology. E.g., the effective number of neutrino species remains compatible with the canonical value of 3.046. This first detailed analysis of Planck polarization concentrates on E modes. At low $\ell$ we use temperature at all frequencies and a subset of polarization. The frequency range improves CMB-foreground separation. Within the baseline model this requires a reionization optical depth $\tau=0.078\pm0.019$, significantly lower than without high-frequency data for explicit dust monitoring. At high $\ell$ we detect residual errors in E, typically O($\mu$K$^2$); we recommend temperature alone as the high-$\ell$ baseline. Nevertheless, Planck high-$\ell$ polarization allows a separate determination of $\Lambda$CDM parameters consistent with those from temperature alone.

We present results based on full-mission Planck observations of temperature and polarization anisotropies of the CMB. These data are consistent with the six-parameter inflationary LCDM cosmology. From the Planck temperature and lensing data, for this cosmology we find a Hubble constant, H0= (67.8 +/- 0.9) km/s/Mpc, a matter density parameter Omega_m = 0.308 +/- 0.012 and a scalar spectral index with n_s = 0.968 +/- 0.006. (We quote 68% errors on measured parameters and 95% limits on other parameters.) Combined with Planck temperature and lensing data, Planck LFI polarization measurements lead to a reionization optical depth of tau = 0.066 +/- 0.016. Combining Planck with other astrophysical data we find N_ eff = 3.15 +/- 0.23 for the effective number of relativistic degrees of freedom and the sum of neutrino masses is constrained to < 0.23 eV. Spatial curvature is found to be |Omega_K| < 0.005. For LCDM we find a limit on the tensor-to-scalar ratio of r <0.11 consistent with the B-mode constraints from an analysis of BICEP2, Keck Array, and Planck (BKP) data. Adding the BKP data leads to a tighter constraint of r < 0.09. We find no evidence for isocurvature perturbations or cosmic defects. The equation of state of dark energy is constrained to w = -1.006 +/- 0.045. Standard big bang nucleosynthesis predictions for the Planck LCDM cosmology are in excellent agreement with observations. We investigate annihilating dark matter and deviations from standard recombination, finding no evidence for new physics. The Planck results for base LCDM are in agreement with BAO data and with the JLA SNe sample. However the amplitude of the fluctuations is found to be higher than inferred from rich cluster counts and weak gravitational lensing. Apart from these tensions, the base LCDM cosmology provides an excellent description of the Planck CMB observations and many other astrophysical data sets.

Continuum spectra covering centimetre to submillimetre wavelengths are presented for a northern sample of 104 extragalactic radio sources, mainly active galactic nuclei, based on four-epoch Planck data. The nine Planck frequencies, from 30 to 857 GHz, are complemented by a set of simultaneous ground-based radio observations between 1.1 and 37 GHz. The single-survey Planck data confirm that the flattest high-frequency radio spectral indices are close to zero, indicating that the original accelerated electron energy spectrum is much harder than commonly thought, with power-law index around 1.5 instead of the canonical 2.5. The radio spectra peak at high frequencies and exhibit a variety of shapes. For a small set of low-z sources, we find a spectral upturn at high frequencies, indicating the presence of intrinsic cold dust. Variability can generally be approximated by achromatic variations, while sources with clear signatures of evolving shocks appear to be limited to the strongest outbursts.

(abridged) We discuss the Galactic foreground emission between 20 and 100GHz based on observations by Planck/WMAP. The Commander component-separation tool has been used to separate the various astrophysical processes in total intensity. Comparison with RRL templates verifies the recovery of the free-free emission along the Galactic plane. Comparison of the high-latitude Halpha emission with our free-free map shows residuals that correlate with dust optical depth, consistent with a fraction (~30%) of Halpha having been scattered by high-latitude dust. We highlight a number of diffuse spinning dust morphological features at high latitude. There is substantial spatial variation in the spinning dust spectrum, with the emission peak ranging from below 20GHz to more than 50GHz. There is a strong tendency for the spinning dust component near many prominent HII regions to have a higher peak frequency, suggesting that this increase in peak frequency is associated with dust in the photodissociation regions around the nebulae. The emissivity of spinning dust in these diffuse regions is of the same order as previous detections in the literature. Over the entire sky, the commander solution finds more anomalous microwave emission than the WMAP component maps, at the expense of synchrotron and free-free emission. This can be explained by the difficulty in separating multiple broadband components with a limited number of frequency maps. Future surveys (5-20GHz), will greatly improve the separation by constraining the synchrotron spectrum. We combine Planck/WMAP data to make the highest S/N ratio maps yet of the intensity of the all-sky polarized synchrotron emission at frequencies above a few GHz. Most of the high-latitude polarized emission is associated with distinct large-scale loops and spurs, and we re-discuss their structure...

Full-sky CMB maps from the 2015 Planck release allow us to detect departures from global isotropy on the largest scales. We present the first searches using CMB polarization for correlations induced by a non-trivial topology with a fundamental domain intersecting, or nearly intersecting, the last scattering surface (at comoving distance $\chi_{rec}$). We specialize to flat spaces with toroidal and slab topologies, finding that explicit searches for the latter are sensitive to other topologies with antipodal symmetry. These searches yield no detection of a compact topology at a scale below the diameter of the last scattering surface. The limits on the radius $R_i$ of the largest sphere inscribed in the topological domain (at log-likelihood-ratio $\Delta\ln{L}>-5$ relative to a simply-connected flat Planck best-fit model) are $R_i>0.97\chi_{rec}$ for the cubic torus and $R_i>0.56\chi_{rec}$ for the slab. The limit for the cubic torus from the matched-circles search is numerically equivalent, $R_i>0.97\chi_{rec}$ (99% CL) from polarisation data alone. We also perform a Bayesian search for a Bianchi VII$_h$ geometry. In the non-physical setting where the Bianchi cosmology is decoupled from the standard cosmology, Planck temperature data favour the inclusion of a Bianchi component. However, the cosmological parameters generating this pattern are in strong disagreement with those found from CMB anisotropy data alone. Fitting the induced polarization pattern for this model to Planck data requires an amplitude of $-0.1\pm0.04$ compared to +1 if the model were to be correct. In the physical setting where the Bianchi parameters are fit simultaneously with the standard cosmological parameters, we find no evidence for a Bianchi VII$_h$ cosmology and constrain the vorticity of such models to $(\omega/H)_0<7.6\times10^{-10}$ (95% CL). [Abridged]

Recent models for the large-scale Galactic magnetic fields in the literature have been largely constrained by synchrotron emission and Faraday rotation measures. We use three different but representative models to compare their predicted polarized synchrotron and dust emission with that measured by the Planck satellite. We first update these models to match the Planck synchrotron products using a common model for the cosmic-ray leptons. We discuss the impact on this analysis of the ongoing problems of component separation in the Planck microwave bands and of the uncertain cosmic-ray spectrum. In particular, the inferred degree of ordering in the magnetic fields is sensitive to these systematic uncertainties, and we further show the importance of considering the expected variations in the observables in addition to their mean morphology. We then compare the resulting simulated emission to the observed dust polarization and find that the dust predictions do not match the morphology in the Planck data but underpredict the dust polarization away from the plane. We modify one of the models to roughly match both observables at high latitudes by increasing the field ordering in the thin disc near the observer. Though this specific analysis is dependent on the component separation issues, we present the improved model as a proof of concept for how these studies can be advanced in future using complementary information from ongoing and planned observational projects.

We study the implications of Planck data for models of dark energy (DE) and modified gravity (MG), beyond the cosmological constant scenario. We start with cases where the DE only directly affects the background evolution, considering Taylor expansions of the equation of state, principal component analysis and parameterizations related to the potential of a minimally coupled DE scalar field. When estimating the density of DE at early times, we significantly improve present constraints. We then move to general parameterizations of the DE or MG perturbations that encompass both effective field theories and the phenomenology of gravitational potentials in MG models. Lastly, we test a range of specific models, such as k-essence, f(R) theories and coupled DE. In addition to the latest Planck data, for our main analyses we use baryonic acoustic oscillations, type-Ia supernovae and local measurements of the Hubble constant. We further show the impact of measurements of the cosmological perturbations, such as redshift-space distortions and weak gravitational lensing. These additional probes are important tools for testing MG models and for breaking degeneracies that are still present in the combination of Planck and background data sets. All results that include only background parameterizations are in agreement with LCDM. When testing models that also change perturbations (even when the background is fixed to LCDM), some tensions appear in a few scenarios: the maximum one found is \sim 2 sigma for Planck TT+lowP when parameterizing observables related to the gravitational potentials with a chosen time dependence; the tension increases to at most 3 sigma when external data sets are included. It however disappears when including CMB lensing.

Although infrared (IR) overall dust emission from clusters of galaxies has been statistically detected using data from the Infrared Astronomical Satellite (IRAS), it has not been possible to sample the spectral energy distribution (SED) of this emission over its peak, and thus to break the degeneracy between dust temperature and mass. By complementing the IRAS spectral coverage with Planck satellite data from 100 to 857 GHz, we provide new constraints on the IR spectrum of thermal dust emission in clusters of galaxies. We achieve this by using a stacking approach for a sample of several hundred objects from the Planck cluster sample; this procedure averages out fluctuations from the IR sky, allowing us to reach a significant detection of the faint cluster contribution. We also use the large frequency range probed by Planck, together with component-separation techniques, to remove the contamination from both cosmic microwave background anisotropies and the thermal Sunyaev-Zeldovich effect (tSZ) signal, which dominate below 353 GHz. By excluding dominant spurious signals or systematic effects, averaged detections are reported at frequencies between 353 and 5000 GHz. We confirm the presence of dust in clusters of galaxies at low and intermediate redshifts, yielding an SED with a shape similar to that of the Milky Way. Planck's beam does not allow us to investigate the detailed spatial distribution of this emission (e.g., whether it comes from intergalactic dust or simply the dust content of the cluster galaxies), but the radial distribution of the emission appears to follow that of the stacked SZ signal, and thus the extent of the clusters. The recovered SED allows us to constrain the dust mass responsible for the signal, as well as its temperature. We additionally explore the evolution of the IR emission as a function of cluster mass and redshift.

We compute and investigate four types of imprint of a stochastic background of primordial magnetic fields (PMFs) on the cosmic microwave background (CMB) anisotropies: the impact of PMFs on the CMB spectra; the effect on CMB polarization induced by Faraday rotation; the impact of PMFs on the ionization history; magnetically-induced non-Gaussianities; and the magnetically-induced breaking of statistical isotropy. Overall, Planck data constrain the amplitude of PMFs to less than a few nanogauss. In particular, individual limits coming from the analysis of the CMB angular power spectra, using the Planck likelihood, are $B_{1\,\mathrm{Mpc}}< 4.4$ nG (where $B_{1\,\mathrm{Mpc}}$ is the comoving field amplitude at a scale of 1 Mpc) at 95% confidence level, assuming zero helicity, and $B_{1\,\mathrm{Mpc}}< 5.6$ nG for a maximally helical field.For nearly scale-invariant PMFs we obtain $B_{1\,\mathrm{Mpc}}<2.0$ nG and $B_{1\,\mathrm{Mpc}}<0.9$ nG if the impact of PMFs on the ionization history of the Universe is included. From the analysis of magnetically-induced non-Gaussianity we obtain three different values, corresponding to three applied methods, all below 5 nG. The constraint from the magnetically-induced passive-tensor bispectrum is $B_{1\,\mathrm{Mpc}}< 2.8$ nG. A search for preferred directions in the magnetically-induced passive bispectrum yields $B_{1\,\mathrm{Mpc}}< 4.5$ nG, whereas the the compensated-scalar bispectrum gives $B_{1\,\mathrm{Mpc}}< 3$ nG. The analysis of the Faraday rotation of CMB polarization by PMFs uses the Planck power spectra in $EE$ and $BB$ at 70 GHz and gives $B_{1\,\mathrm{Mpc}}< 1380$ nG. In our final analysis, we consider the harmonic-space correlations produced by Alfv\'en waves, finding no significant evidence for the presence of these waves. Together, these results comprise a comprehensive set of constraints on possible PMFs with Planck data.

We present an updated description of the Planck Low Frequency Instrument (LFI) data processing pipeline, associated with the 2015 data release. We point out the places where our results and methods have remained unchanged since the 2013 paper and we highlight the changes made for the 2015 release, describing the products (especially timelines) and the ways in which they were obtained. We demonstrate that the pipeline is self-consistent (principally based on simulations) and report all null tests. For the first time, we present LFI maps in Stokes Q and U polarization. We refer to other related papers where more detailed descriptions of the LFI data processing pipeline may be found if needed.

We present all-sky modelling of the high resolution Planck, IRAS, and WISE infrared (IR) observations using the physical dust model presented by Draine and Li in 2007 (DL). We study the performance and results of this model, and discuss implications for future dust modelling. The present work extends the DL dust modelling carried out on nearby galaxies using Herschel and Spitzer data to Galactic dust emission. We employ the DL dust model to generate maps of the dust mass surface density, the optical extinction Av, and the starlight intensity parametrized by Umin. The DL model reproduces the observed spectral energy distribution (SED) satisfactorily over most of the sky, with small deviations in the inner Galactic disk and in low ecliptic latitude areas. We compare the DL optical extinction Av for the diffuse interstellar medium with optical estimates for 2 10^5 quasi-stellar objects (QSOs) observed in the Sloan digital sky survey. The DL Av estimates are larger than those determined towards QSOs by a factor of about 2, which depends on Umin. The DL fitting parameter Umin, effectively determined by the wavelength where the SED peaks, appears to trace variations in the far-IR opacity of the dust grains per unit Av, and not only in the starlight intensity. To circumvent the model deficiency, we propose an empirical renormalization of the DL Av estimate, dependent of Umin, which compensates for the systematic differences found with QSO observations. This renormalization also brings into agreement the DL Av estimates with those derived for molecular clouds from the near-IR colours of stars in the 2 micron all sky survey. The DL model and the QSOs data are used to compress the spectral information in the Planck and IRAS observations for the diffuse ISM to a family of 20 SEDs normalized per Av, parameterized by Umin, which may be used to test and empirically calibrate dust models.

The Second Planck Catalogue of Compact Sources is a catalogue of sources detected in single-frequency maps from the full duration of the Planck mission and supersedes previous versions of the Planck compact source catalogues. It consists of compact sources, both Galactic and extragalactic, detected over the entire sky. Compact sources detected in the lower frequency channels are assigned to the PCCS2, while at higher frequencies they are assigned to one of two sub-catalogues, the PCCS2 or PCCS2E, depending on their location on the sky. The first of these catalogues covers most of the sky and allows the user to produce subsamples at higher reliabilities than the target 80% integral reliability of the catalogue. The PCCS2E contains sources detected in sky regions where the diffuse emission makes it difficult to quantify the reliability of the detections. Both the PCCS2 and PCCS2E include polarization measurements, in the form of polarized flux densities, or upper limits, and orientation angles for all seven polarization-sensitive Planck channels. The improved data-processing of the full-mission maps and their reduced noise levels allow us to increase the number of objects in the catalogue, improving its completeness for the target 80 % reliability as compared with the previous versions, the PCCS and ERCSC catalogues.

We present the results of approximately three years of observations of Planck Sunyaev-Zeldovich (SZ) sources with telescopes at the Canary Islands observatories as part of the general optical follow-up programme undertaken by the Planck collaboration. In total, 78 SZ sources are discussed. Deep-imaging observations were obtained for most of these sources; spectroscopic observations in either in long-slit or multi-object modes were obtained for many. We effectively used 37.5 clear nights. We found optical counterparts for 73 of the 78 candidates. This sample includes 53 spectroscopic redshift determinations, 20 of them obtained with a multi-object spectroscopic mode. The sample contains new redshifts for 27 Planck clusters that were not included in the first Planck SZ source catalogue (PSZ1).

The all-sky Planck survey in 9 frequency bands was used to search for emission from all 274 known Galactic supernova remnants. Of these, 16 were detected in at least two Planck frequencies. The radio-through-microwave spectral energy distributions were compiled to determine the emission mechanism for microwave emission. In only one case, IC 443, is there high-frequency emission clearly from dust associated with the supernova remnant.In all cases, the low-frequency emission is from synchrotron radiation. A single power law, as predicted for a population of relativistic particles with energy distribution that extends continuously to high energies, is evident for many sources, including the Crab and PKS 1209-51/52. A decrease in flux density relative to the extrapolation of radio emission is evident in several sources. Their spectral energy distributions can be approximated as broken power laws, $S_\nu\propto\nu^{-\alpha}$, with the spectral index, alpha, increasing by 0.5-1 above a break frequency in the range 10-60 GHz. The break could be due to synchrotron losses.

We present the current accounting of systematic effect uncertainties for the Low Frequency Instrument (LFI) that are relevant to the 2015 release of the Planck cosmological results, showing the robustness and consistency of our data set, especially for polarization analysis. We use two complementary approaches: (i) simulations based on measured data and physical models of the known systematic effects; and (ii) analysis of difference maps containing the same sky signal ("null-maps"). The LFI temperature data are limited by instrumental noise. At large angular scales the systematic effects are below the cosmic microwave background (CMB) temperature power spectrum by several orders of magnitude. In polarization the systematic uncertainties are dominated by calibration uncertainties and compete with the CMB $E$-modes in the multipole range 10--20. Based on our model of all known systematic effects, we show that these effects introduce a slight bias of around $0.2\,\sigma$ on the reionization optical depth derived from the 70\,GHz $EE$ spectrum using the 30 and 353\,GHz channels as foreground templates. At 30\,GHz the systematic effects are smaller than the Galactic foreground at all scales in temperature and polarization, which allows us to consider this channel as a reliable template of synchrotron emission. We assess the residual uncertainties due to LFI effects on CMB maps and power spectra after component separation and show that these effects are smaller than the CMB amplitude at all scales. We also assess the impact on non-Gaussianity studies and find it to be negligible. Some residuals still appear in null maps from particular sky survey pairs, particularly at 30 GHz, suggesting possible straylight contamination due to an imperfect knowledge of the beam far sidelobes.

We test the statistical isotropy and Gaussianity of the cosmic microwave background (CMB) anisotropies using observations made by the Planck satellite. Our results are based mainly on the full Planck mission for temperature, but also include some polarization measurements. In particular, we consider the CMB anisotropy maps derived from the multi-frequency Planck data by several component-separation methods. For the temperature anisotropies, we find excellent agreement between results based on these sky maps over both a very large fraction of the sky and a broad range of angular scales, establishing that potential foreground residuals do not affect our studies. Tests of skewness, kurtosis, multi-normality, N-point functions, and Minkowski functionals indicate consistency with Gaussianity, while a power deficit at large angular scales is manifested in several ways, for example low map variance. The results of a peak statistics analysis are consistent with the expectations of a Gaussian random field. The "Cold Spot" is detected with several methods, including map kurtosis, peak statistics, and mean temperature profile. We thoroughly probe the large-scale dipolar power asymmetry, detecting it with several independent tests, and address the subject of a posteriori correction. Tests of directionality suggest the presence of angular clustering from large to small scales, but at a significance that is dependent on the details of the approach. We perform the first examination of polarization data, finding the morphology of stacked peaks to be consistent with the expectations of statistically isotropic simulations. Where they overlap, these results are consistent with the Planck 2013 analysis based on the nominal mission data and provide our most thorough view of the statistics of the CMB fluctuations to date.

We present a description of the pipeline used to calibrate the Planck Low Frequency Instrument (LFI) timelines into thermodynamic temperatures for the Planck 2015 data release, covering four years of uninterrupted operations. As in the 2013 data release, our calibrator is provided by the spin-synchronous modulation of the cosmic microwave background dipole, but we now use the orbital component, rather than adopting the Wilkinson Microwave Anisotropy Probe (WMAP) solar dipole. This allows our 2015 LFI analysis to provide an independent Solar dipole estimate, which is in excellent agreement with that of HFI and within $1\sigma$ (0.3% in amplitude) of the WMAP value. This 0.3% shift in the peak-to-peak dipole temperature from WMAP and a global overhaul of the iterative calibration code increases the overall level of the LFI maps by 0.45% (30 GHz), 0.64% (44 GHz), and 0.82% (70 GHz) in temperature with respect to the 2013 Planck data release, thus reducing the discrepancy with the power spectrum measured by WMAP. We estimate that the LFI calibration uncertainty is now at the level of 0.20% for the 70 GHz map, 0.26% for the 44 GHz map, and 0.35% for the 30 GHz map. We provide a detailed description of the impact of all the changes implemented in the calibration since the previous data release.

The Virgo cluster is the largest Sunyaev-Zeldovich (SZ) source in the sky, both in terms of angular size and total integrated flux. Planck's wide angular scale and frequency coverage, together with its high sensitivity, allow a detailed study of this large object through the SZ effect. Virgo is well resolved by Planck, showing an elongated structure, which correlates well with the morphology observed from X-rays, but extends beyond the observed X-ray signal. We find a good agreement between the SZ signal (or Compton paranmeter, y_c) observed by Planck and the expected signal inferred from X-ray observations and simple analytical models. Due to its proximity to us, the gas beyond the virial radius can be studied with unprecedented sensitivity by integrating the SZ signal over tens of square degrees. We study the signal in the outskirts of Virgo and compare it with analytical models and a constrained simulation of the environment of Virgo. Planck data suggest that significant amounts of low-density plasma surround Virgo out to twice the virial radius. We find the SZ signal in the outskirts of Virgo to be consistent with a simple model that extrapolates the inferred pressure at lower radii while assuming that the temperature stays in the keV range beyond the virial radius. The observed signal is also consistent with simulations and points to a shallow pressure profile in the outskirts of the cluster. This reservoir of gas at large radii can be linked with the hottest phase of the elusive warm/hot intergalactic medium. Taking the lack of symmetry of Virgo into account, we find that a prolate model is favoured by the combination of SZ and X-ray data, in agreement with predictions.

By looking at the kinetic Sunyaev-Zeldovich effect (kSZ) in Planck nominal mission data, we present a significant detection of baryons participating in large-scale bulk flows around central galaxies (CGs) at redshift $z\approx 0.1$. We estimate the pairwise momentum of the kSZ temperature fluctuations at the positions of the CGC (Central Galaxy Catalogue) samples extracted from Sloan Digital Sky Survey (DR7) data. For the foreground-cleaned maps, we find $1.8$-$2.5\sigma$ detections of the kSZ signal, which are consistent with the kSZ evidence found in individual Planck raw frequency maps, although lower than found in the WMAP-9yr W band ($3.3\sigma$). We further reconstruct the peculiar velocity field from the CG density field, and compute for the first time the cross-correlation function between kSZ temperature fluctuations and estimates of CG radial peculiar velocities. This correlation function yields a $3.0$-$3.7$$\sigma$ detection of the peculiar motion of extended gas on Mpc scales, in flows correlated up to distances of 80-100 $h^{-1}$ Mpc. Both the pairwise momentum estimates and kSZ temperature-velocity field correlation find evidence for kSZ signatures out to apertures of 8 arcmin and beyond, corresponding to a physical radius of $> 1$ Mpc, more than twice the mean virial radius of halos. This is consistent with the predictions from hydro simulations that most of the baryons are outside the virialized halos. We fit a simple model, in which the temperature-velocity cross-correlation is proportional to the signal seen in a semi-analytic model built upon N-body simulations, and interpret the proportionality constant as an "effective" optical depth to Thomson scattering. We find $\tau_T=(1.4\pm0.5)\times 10^{-4}$; the simplest interpretation of this measurement is that much of the gas is in a diffuse phase, which contributes little signal to X-ray or thermal SZ observations.