We present the discovery of the second binary with a Roche lobe-filling hot subdwarf transferring mass to a white dwarf (WD) companion. This 56 minute binary was discovered using data from the Zwicky Transient Facility. Spectroscopic observations reveal an He-sdOB star with an effective temperature of $T_{\rm eff}=33,700\pm1000$ K and a surface gravity of $log(g)=5.54\pm0.11$. The GTC+HiPERCAM light curve is dominated by the ellipsoidal deformation of the He-sdOB star and shows an eclipse of the He-sdOB by an accretion disk as well as a weak eclipse of the WD. We infer a He-sdOB mass of $M_{\rm sdOB}=0.41\pm0.04$ M$_\odot$ and a WD mass of $M_{\rm WD}=0.68\pm0.05$ M$_\odot$. The weak eclipses imply a WD black-body temperature of $63,000\pm10,000$ K and a radius $R_{\rm WD}=0.0148\pm0.0020$ M$_\odot$ as expected for a WD of such high temperature. The He-sdOB star is likely undergoing hydrogen shell burning and will continue transferring mass for $\approx1$ Myrs at a rate of $10^{-9} M_\odot {\rm yr}^{-1}$ which is consistent with the high WD temperature. The hot subdwarf will then turn into a WD and the system will merge in $\approx30$ Myrs. We suggest that Galactic reddening could bias discoveries towards preferentially finding Roche lobe-filling systems during the short-lived shell burning phase. Studies using reddening corrected samples should reveal a large population of helium core-burning hot subdwarfs with $T_{\rm eff}\approx25,000$ K in binaries of 60-90 minutes with WDs. Though not yet in contact, these binaries would eventually come into contact through gravitational wave emission and explode as a sub-luminous thermonuclear supernova or evolve into a massive single WD.

Early observations of Type Ia supernovae (SNe$\,$Ia) provide essential clues for understanding the progenitor system that gave rise to the terminal thermonuclear explosion. We present exquisite observations of SN$\,$2019yvq, the second observed SN$\,$Ia, after iPTF$\,$14atg, to display an early flash of emission in the ultraviolet (UV) and optical. Our analysis finds that SN$\,$2019yvq was unusual, even when ignoring the initial flash, in that it was moderately underluminous for an SN$\,$Ia ($M_g \approx -18.5\,$mag at peak) yet featured very high absorption velocities ($v \approx 15,000\,\mathrm{km\,s}^{-1}$ for Si II $\lambda$6355 at peak). We find that many of the observational features of SN$\,$2019yvq, aside from the flash, can be explained if the explosive yield of radioactive $^{56}\mathrm{Ni}$ is relatively low (we measure $M_{^{56}\mathrm{Ni}} = 0.31 \pm 0.05\,M_\odot$) and it and other iron-group elements are concentrated in the innermost layers of the ejecta. To explain both the UV/optical flash and peak properties of SN$\,$2019yvq we consider four different models: interaction between the SN ejecta and a nondegenerate companion, extended clumps of $^{56}\mathrm{Ni}$ in the outer ejecta, a double-detonation explosion, and the violent merger of two white dwarfs. Each of these models has shortcomings when compared to the observations; it is clear additional tuning is required to better match SN$\,$2019yvq. In closing, we predict that the nebular spectra of SN$\,$2019yvq will feature either H or He emission, if the ejecta collided with a companion, strong [Ca II] emission, if it was a double detonation, or narrow [O I] emission, if it was due to a violent merger.

We report the first plausible optical electromagnetic (EM) counterpart to a (candidate) binary black hole (BBH) merger. Detected by the Zwicky Transient Facility (ZTF), the EM flare is consistent with expectations for a kicked BBH merger in the accretion disk of an active galactic nucleus (AGN), and is unlikely ($<O(0.01\%$)) due to intrinsic variability of this source. The lack of color evolution implies that it is not a supernovae and instead is strongly suggestive of a constant temperature shock. Other false-positive events, such as microlensing or a tidal disruption event, are ruled out or constrained to be $<O(0.1\%$). If the flare is associated with S190521g, we find plausible values of: total mass $ M_{\rm BBH} \sim 100 M_{\odot}$, kick velocity $v_k \sim 200\, {\rm km}\, {\rm s}^{-1}$ at $\theta \sim 60^{\circ}$ in a disk with aspect ratio $H/a \sim 0.01$ (i.e., disk height $H$ at radius $a$) and gas density $\rho \sim 10^{-10}\, {\rm g}\, {\rm cm}^{-3}$. The merger could have occurred at a disk migration trap ($a \sim 700\, r_{g}$; $r_g \equiv G M_{\rm SMBH} / c^2$, where $M_{\rm SMBH}$ is the mass of the AGN supermassive black hole). The combination of parameters implies a significant spin for at least one of the black holes in S190521g. The timing of our spectroscopy prevents useful constraints on broad-line asymmetry due to an off-center flare. We predict a repeat flare in this source due to a re-encountering with the disk in $\sim 1.6\, {\rm yr}\, (M_{\rm SMBH}/10^{8}M_{\odot})\, (a/10^{3}r_{g})^{3/2}$.

We present a systematic search for optical counterparts to 13 gravitational wave (GW) triggers involving at least one neutron star during LIGO/Virgo's third observing run. We searched binary neutron star (BNS) and neutron star black hole (NSBH) merger localizations with the Zwicky Transient Facility (ZTF) and undertook follow-up with the Global Relay of Observatories Watching Transients Happen (GROWTH) collaboration. The GW triggers had a median localization of 4480 deg^2, median distance of 267 Mpc and false alarm rates ranging from 1.5 to 1e-25 per yr. The ZTF coverage had a median enclosed probability of 39%, median depth of 20.8mag, and median response time of 1.5 hr. The O3 follow-up by the GROWTH team comprised 340 UVOIR photometric points, 64 OIR spectra, and 3 radio. We find no promising kilonova (radioactivity-powered counterpart) and we convert the upper limits to constrain the underlying kilonova luminosity function. Assuming that all kilonovae are at least as luminous as GW170817 at discovery (-16.1mag), we calculate our joint probability of detecting zero kilonovae is only 4.2%. If we assume that all kilonovae are brighter than -16.6mag (extrapolated peak magnitude of GW170817) and fade at 1 mag/day (similar to GW170817), the joint probability of zero detections is 7%. If we separate the NSBH and BNS populations, the joint probability of zero detections, assuming all kilonovae are brighter than -16.6mag, is 9.7% for NSBH and 7.9% for BNS mergers. Moreover, <57% (<89%) of putative kilonovae could be brighter than -16.6mag assuming flat (fading) evolution, at 90% confidence. If we further account for the online terrestrial probability for each GW trigger, we find that <68% of putative kilonovae could be brighter than -16.6mag. Comparing to model grids, we find that some kilonovae must have Mej < 0.03 Msun or Xlan>1e-4 or phi>30deg to be consistent with our limits. (Abridged)

The discovery rate of fast radio bursts (FRBs) is increasing dramatically thanks to new radio facilities. Meanwhile, wide-field instruments such as the 47 deg$^2$ Zwicky Transient Facility (ZTF) survey the optical sky to study transient and variable sources. We present serendipitous ZTF observations of the CHIME repeating source FRB 180916.J0158+65, that was localized to a spiral galaxy 149 Mpc away and is the first FRB suggesting periodic modulation in its activity. While 147 ZTF exposures corresponded to expected high-activity periods of this FRB, no single ZTF exposure was at the same time as a CHIME detection. No $>3\sigma$ optical source was found at the FRB location in 683 ZTF exposures, totalling 5.69 hours of integration time. We combined ZTF upper limits and expected repetitions from FRB 180916.J0158+65 in a statistical framework using a Weibull distribution, agnostic of periodic modulation priors. The analysis yielded a constraint on the ratio between the optical and radio fluences of $\eta \lesssim 200$, corresponding to an optical energy $E_{\rm opt} \lesssim 3 \times 10^{46}$ erg for a fiducial 10 Jy ms FRB (90% confidence). A deeper (but less statistically robust) constraint of $\eta \lesssim 3$ can be placed assuming a rate of $r(>5$ Jy ms)= hr$^{-1}$ and $1.2\pm 1.1$ FRB occurring during exposures taken in high-activity windows. The constraint can be improved with shorter per-image exposures and longer integration time, or observing FRBs at higher Galactic latitudes. This work demonstrated how current surveys can statistically constrain multi-wavelength counterparts to FRBs even without deliberately scheduled simultaneous radio observation.

We present a preliminary analysis of comet P/2019 LM$_4$ (Palomar) as observed by the Zwicky Transient Facility (ZTF) survey in 2019 and 2020. We find that the discovery of the comet in 2019 and the recovery in 2020 is largely attributed to two separate outbursts that are $\gtrsim2$ and $\gtrsim3.9$ mag in strength. The outbursts occurred around the end of April to early May of 2019 as well as between 2020 May 8.31 and 9.52 UTC, respectively.

Recently, Kundu et al (2019) reported that the globular cluster NGC 5024 (M53) possesses five extra-tidal RR Lyrae. In fact, four of them were instead known members of a nearby globular cluster NGC 5053. The status of the remaining extra-tidal RR Lyrae is controversial depending on the adopted tidal radius of NGC 5024. We have also searched for additional extra-tidal RR Lyrae within an area of $\sim8$~deg$^2$ covering both globular clusters. This includes other known RR Lyrae within the search area, as well as stars that fall within the expected range of magnitudes and colors for RR Lyrae (and yet outside the cutoff of 2/3 of the tidal radii of each globular clusters for something to be called "extra-tidal") if they were extra-tidal RR Lyrae candidates for NGC 5024 or NGC 5053. Based on the the proper motion information and their locations on the color-magnitude diagram, none of the known RR Lyrae belong to the extra-tidal RR Lyrae of either globular clusters. In the cases where the stars satisfied the magnitude and color ranges of RR Lyrae, analysis of time series data taken from the Zwicky Transient Facility do not reveal periodicities, suggesting that none of these stars are RR Lyrae. We conclude that there are no extra-tidal RR Lyrae associated with either NGC 5024 or NGC 5053 located within our search area.

We present visible and near-infrared photometric and spectroscopic observations of interstellar object 2I/Borisov taken from 2019 September 10 to 2019 November 29 using the GROWTH, the APO ARC 3.5 m and the NASA/IRTF 3.0 m combined with post and pre-discovery observations of 2I obtained by ZTF from 2019 March 17 to 2019 May 5. Comparison with imaging of distant Solar System comets shows an object very similar to mildly active Solar System comets with an out-gassing rate of $\sim$10$^{27}$ mol/sec. The photometry, taken in filters spanning the visible and NIR range shows a gradual brightening trend of $\sim0.03$ mags/day since 2019 September 10 UTC for a reddish object becoming neutral in the NIR. The lightcurve from recent and pre-discovery data reveals a brightness trend suggesting the recent onset of significant H$_2$O sublimation with the comet being active with super volatiles such as CO at heliocentric distances $>$6 au consistent with its extended morphology. Using the advanced capability to significantly reduce the scattered light from the coma enabled by high-resolution NIR images from Keck adaptive optics taken on 2019 October 04, we estimate a diameter of 2I's nucleus of $\lesssim$1.4 km. We use the size estimates of 1I/'Oumuamua and 2I/Borisov to roughly estimate the slope of the ISO size-distribution resulting in a slope of $\sim$3.4$\pm$1.2, similar to Solar System comets and bodies produced from collisional equilibrium.

Cosmic neutrinos provide a unique window into the otherwise-hidden mechanism of particle acceleration in astrophysical objects. A flux of high-energy neutrinos was discovered in 2013, and the IceCube Collaboration recently associated one high-energy neutrino with a flare from the relativistic jet of an active galaxy pointed towards the Earth. However a combined analysis of many similar active galaxies revealed no excess from the broader population, leaving the vast majority of the cosmic neutrino flux unexplained. Here we present the association of a radio-emitting tidal disruption event (AT2019dsg) with another high-energy neutrino, identified as part of our systematic search for optical counterparts to high-energy neutrinos with the Zwicky Transient Facility (ZTF). The probability of finding any radio-emitting tidal disruption event by chance is 0.5%, while the probability of finding one as bright in bolometric energy flux as AT2019dsg is 0.2%. Our electromagnetic observations can be explained through a multi-zone model, with radio analysis revealing a central engine, embedded in a UV photosphere, that powers an extended synchrotron-emitting outflow. This provides an ideal site for PeV neutrino production. The association suggests that tidal disruption events contribute to the cosmic neutrino flux. Unlike previous work which considered the rare subset of tidal disruption events with relativistic jets, our observations of AT2019dsg suggest an empirical model with a mildly-relativistic outflow.

We present ZTF18aaqjovh (SN 2018bvw), a high-velocity ("broad-lined") stripped-envelope (Type Ic) supernova (Ic-BL SN) discovered in the Zwicky Transient Facility one-day cadence survey. ZTF18aaqjovh shares a number of features in common with engine-driven explosions: the photospheric velocity and the shape of the optical light curve are very similar to that of the Type Ic-BL SN 1998bw, which was associated with a low-luminosity gamma-ray burst (LLGRB) and had relativistic ejecta. However, the radio luminosity of ZTF18aaqjovh is almost two orders of magnitude fainter than that of SN 1998bw at the same velocity phase, and the shock velocity is at most mildly relativistic (v=0.06-0.4c). A search of high-energy catalogs reveals no compelling GRB counterpart to ZTF18aaqjovh, and the limit on the prompt GRB luminosity of $L_{\gamma,\mathrm{iso}} \approx 1.6 \times 10^{48}$ erg/sec excludes a classical GRB but not an LLGRB. Altogether, ZTF18aaqjovh represents another transition event between engine-driven SNe associated with GRBs and "ordinary" Ic-BL SNe.

Quasars have long been known as intrinsically variable sources, but the physical mechanism underlying the temporal optical/UV variability is still not well understood. We propose a novel nonparametric method for modeling and forecasting the optical variability of quasars utilizing an autoencoder neural network to gain insight into the underlying processes. The autoencoder is trained with ~15,000 decade-long quasar light curves obtained by the Catalina Real-time Transient Survey selected with negligible flux contamination from the host galaxy. The autoencoder's performance in forecasting the temporal flux variation of quasars is superior to that of the damped random walk process. We find a temporal asymmetry in the optical variability and a novel relation - the amplitude of the variability asymmetry decreases as luminosity and/or black hole mass increases - is suggested with the help of autoencoded features. The characteristics of the variability asymmetry are in agreement with those from the self-organized disk instability model, which predicts that the magnitude of the variability asymmetry decreases as the ratio of the diffusion mass to inflow mass in the accretion disk increases.

While it is clear that Type Ia supernovae (SNe) are the result of thermonuclear explosions in C/O white dwarfs (WDs), a great deal remains uncertain about the binary companion that facilitates the explosive disruption of the WD. Here, we present a comprehensive analysis of a unique, and large, data set of 127 SNe Ia with exquisite coverage by the Zwicky Transient Facility (ZTF). High-cadence (6 observations per night) ZTF observations allow us to measure the SN rise time and examine its initial evolution. We develop a Bayesian framework to model the early rise as a power-law in time, which enables the inclusion of priors in our model. For a volume-limited subset of normal SNe Ia, we find the mean power-law index is consistent with 2 in the $r_\mathrm{ztf}$-band ($\alpha_r = 2.01\pm0.02$), as expected in the expanding fireball model. There are, however, individual SNe that are clearly inconsistent with $\alpha_r=2$. We estimate a mean rise time of 18.5$\,$d (with a range extending from $\sim$15$-$22$\,$d), though this is subject to the adopted prior. We identify an important, previously unknown, bias whereby the rise times for higher redshift SNe within a flux-limited survey are systematically underestimated. This effect can be partially alleviated if the power-law index is fixed to $\alpha=2$, in which case we estimate a mean rise time of 21.0$\,$d (with a range from $\sim$18$-$23$\,$d). The sample includes a handful or rare and peculiar SNe Ia. Finally, we conclude with a discussion of lessons learned from the ZTF sample that can eventually be applied to Large Synoptic Survey Telescope observations.

While tidal disruption events (TDEs) have long been heralded as laboratories for the study of quiescent black holes, the small number of known TDEs and uncertainties in their emission mechanism have hindered progress towards this promise. Here present 17 new TDEs that have been detected recently by the Zwicky Transient Facility along with Swift UV and X-ray follow-up observations. Our homogeneous analysis of the optical/UV light curves, including 22 previously known TDEs from the literature, reveals a clean separation of light curve properties with spectroscopic class. The TDEs with Bowen fluorescence features in their optical spectra have smaller blackbody radii, as well as longer rise times and higher disruption rates compared to the rest of the sample. The Bowen fluorescence mechanism requires a high density which can be reached at smaller radii, which in turn yields longer diffusion timescales. Thus, the difference in rise times suggests the pre-peak TDE light curves are governed not by the fallback timescale, but instead by the diffusion of photons through the tidal debris. The small subset of TDEs that show only helium emission lines in their spectra have the longest rise times, the highest luminosities and the lowest rates. We also report, for the first time, the detection of soft X-ray flares from a TDE on day timescales. Based on the fact the flares peak at a luminosity similar to the optical/UV blackbody luminosity, we attribute them to brief glimpses through a reprocessing layer that otherwise obscures the inner accretion flow.

Near-Earth Objects (NEOs) that orbit the Sun on or within Earth's orbit are tricky to detect for Earth-based observers due to their proximity to the Sun in the sky. These small bodies hold clues to the dynamical history of the inner solar system as well as the physical evolution of planetesimals in extreme environments. Populations in this region include the Atira and Vatira asteroids, as well as Venus and Earth co-orbital asteroids. Here we present a twilight search for these small bodies, conducted using the 1.2-m Oschin Schmidt and the Zwicky Transient Facility (ZTF) camera at Palomar Observatory. The ZTF twilight survey operates at solar elongations down to $35^\circ$ with limiting magnitude of $r=19.5$. During a total of 40 evening sessions and 62 morning sessions conducted between 2018 November 15 and 2019 June 23, we detected 6 Atiras, including 2 new discoveries 2019 AQ$_3$ and 2019 LF$_6$, but no Vatiras or Earth/Venus co-orbital asteroids. NEO population models show that these new discoveries are likely only the tip of the iceberg, with the bulk of the population yet to be found. The population models also suggest that we have only detected 5--$7\%$ of the $H<20$ Atira population over the 7-month survey. Co-orbital asteroids are smaller in diameters and require deeper surveys. A systematic and efficient survey of the near-Sun region will require deeper searches and/or facilities that can operate at small solar elongations.

Multi-messenger astrophysics is a fast-growing, interdisciplinary field that combines data, which vary in volume and speed of data processing, from many different instruments that probe the Universe using different cosmic messengers: electromagnetic waves, cosmic rays, gravitational waves and neutrinos. In this Expert Recommendation, we review the key challenges of real-time observations of gravitational wave sources and their electromagnetic and astroparticle counterparts, and make a number of recommendations to maximize their potential for scientific discovery. These recommendations refer to the design of scalable and computationally efficient machine learning algorithms; the cyber-infrastructure to numerically simulate astrophysical sources, and to process and interpret multi-messenger astrophysics data; the management of gravitational wave detections to trigger real-time alerts for electromagnetic and astroparticle follow-ups; a vision to harness future developments of machine learning and cyber-infrastructure resources to cope with the big-data requirements; and the need to build a community of experts to realize the goals of multi-messenger astrophysics.

Polarization measurements done using Imaging Polarimeters such as the Robotic Polarimeter are very sensitive to the presence of artefacts in images. Artefacts can range from internal reflections in a telescope to satellite trails that could contaminate an area of interest in the image. With the advent of wide-field polarimetry surveys, it is imperative to develop methods that automatically flag artefacts in images. In this paper, we implement a Convolutional Neural Network to identify the most dominant artefacts in the images. We find that our model can successfully classify sources with 98\% true positive and 97\% true negative rates. Such models, combined with transfer learning, will give us a running start in artefact elimination for near-future surveys like WALOP.

(Abridged) Palomar Gattini-IR is a new wide-field, near-infrared robotic time domain survey operating at Palomar Observatory. Using a 30 cm telescope mounted with a H2RG detector, Gattini-IR achieves a field of view of 25 sq. deg. with a pixel scale of 8.7" in J-band. Here, we describe the system design, survey operations, data processing system and on-sky performance of Palomar Gattini-IR. As a part of the nominal survey, Gattini-IR scans $\approx 7500$ square degrees of the sky every night to a median 5$\sigma$ depth of $15.7$ AB mag outside the Galactic plane. The survey covers $\approx 15000$ square degrees of the sky visible from Palomar with a median cadence of 2 days. A real-time data processing system produces stacked science images from dithered raw images taken on sky, together with PSF-fit source catalogs and transient candidates identified from subtractions within a median delay of $\approx 4$ hours from the time of observation. The calibrated data products achieve an astrometric accuracy (RMS) of $\approx 0.7$" with respect to Gaia DR2 for sources with S/N $> 10$, and better than $\approx 0.35$" for sources brighter than $\approx 12$ Vega mag. The photometric accuracy (RMS) achieved in the PSF-fit source catalogs is better than $\approx 3$% for sources brighter than $\approx 12$ Vega mag, as calibrated against the 2MASS catalog. With a field of view $\approx 40\times$ larger than any other existing near infrared imaging instrument, Gattini-IR is probing the reddest and dustiest transients in the local universe such as dust obscured supernovae in nearby galaxies, novae behind large columns of extinction within the galaxy, reddened micro-lensing events in the Galactic plane and variability from cool and dust obscured stars. We present results from transients and variables identified since the start of the commissioning period.

The Zwicky Transient Facility (ZTF) is performing a three-day cadence survey of the visible Northern sky (~3$\pi$). The transient candidates found in this survey are announced via public alerts. As a supplementary product ZTF is also conducting a large spectroscopic campaign: the ZTF Bright Transient Survey (BTS). The goal of the BTS is to spectroscopically classify all extragalactic transients brighter than 18.5 mag at peak brightness and immediately announce those classifications to the public. Extragalactic discoveries from ZTF are predominantly Supernovae (SNe). The BTS is the largest flux-limited SN survey to date. Here we present a catalog of the761 SNe that were classified during the first nine months of the survey (2018 Apr. 1 to 2018 Dec. 31). The BTS SN catalog contains redshifts based on SN template matching and spectroscopic host galaxy redshifts when available. Based on this data we perform an analysis of the redshift completeness of local galaxy catalogs, dubbed as the Redshift Completeness Fraction (RCF; the number of SN host galaxies with known spectroscopic redshift prior to SN discovery divided by the total number of SN hosts). In total, we identify the host galaxies of 512 Type Ia supernovae, 227 of which have known spectroscopic redshifts, yielding an RCF estimate of $44\% \pm1\%$. We find a steady decrease in the RCF with increasing distance in the local universe. For z<0.05, or ~200 Mpc, we find RCF=0.6, which has important ramifications when searching for multimessenger astronomical events. Prospects for dramatically increasing the RCF are limited to new multi-fiber spectroscopic instruments, or wide-field narrowband surveys. We find that existing galaxy redshift catalogs are only $50\%$ complete at $r\approx16.9$ mag. Pushing this limit several magnitudes deeper will pay huge dividends when searching for electromagnetic counterparts to gravitational wave events.

A network of three or more gravitational wave detectors simultaneously taking data is required to generate a well-localized sky map for gravitational wave sources, such as GW170817. Local seismic disturbances often cause the LIGO and Virgo detectors to lose light resonance in one or more of their component optic cavities, and the affected detector is unable to take data until resonance is recovered. In this paper, we use machine learning techniques to gain insight into the predictive behavior of the LIGO detector optic cavities during the second LIGO-Virgo observing run. We identify a minimal set of optic cavity control signals and data features which capture interferometer behavior leading to a loss of light resonance, or lockloss. We use these channels to accurately distinguish between lockloss events and quiet interferometer operating times via both supervised and unsupervised machine learning methods. This analysis yields new insights into how components of the LIGO detectors contribute to lockloss events, which could inform detector commissioning efforts to mitigate the associated loss of uptime. Particularly, we find that the state of the component optical cavities is a better predictor of loss of lock than ground motion trends. We report prediction accuracies of 98% for times just prior to lock loss, and 90% for times up to 30 seconds prior to lockloss, which shows promise for this method to be applied in near-real time to trigger preventative detector state changes. This method can be extended to target other auxiliary subsystems or times of interest, such as transient noise or loss in detector sensitivity. Application of these techniques during the third LIGO-Virgo observing run and beyond would maximize the potential of the global detector network for multi-messenger astronomy with gravitational waves.

We present DeepStreaks, a convolutional-neural-network, deep-learning system designed to efficiently identify streaking fast-moving near-Earth objects that are detected in the data of the Zwicky Transient Facility (ZTF), a wide-field, time-domain survey using a dedicated 47 sq. deg camera attached to the Samuel Oschin 48-inch Telescope at the Palomar Observatory in California, United States. The system demonstrates a 96-98% true positive rate, depending on the night, while keeping the false positive rate below 1%. The sensitivity of DeepStreaks is quantified by the performance on the test data sets as well as using known near-Earth objects observed by ZTF. The system is deployed and adapted for usage within the ZTF Solar-System framework and has significantly reduced human involvement in the streak identification process, from several hours to typically under 10 minutes per day.

This Astro2020 State of the Profession Consideration White Paper highlights the growth of astrostatistics and astroinformatics in astronomy, identifies key issues hampering the maturation of these new subfields, and makes recommendations for structural improvements at different levels that, if acted upon, will make significant positive impacts across astronomy.

Efficient automated detection of flux-transient, reoccurring flux-variable, and moving objects is increasingly important for large-scale astronomical surveys. We present braai, a convolutional-neural-network, deep-learning real/bogus classifier designed to separate genuine astrophysical events and objects from false positive, or bogus, detections in the data of the Zwicky Transient Facility (ZTF), a new robotic time-domain survey currently in operation at the Palomar Observatory in California, USA. Braai demonstrates a state-of-the-art performance as quantified by its low false negative and false positive rates. We describe the open-source software tools used internally at Caltech to archive and access ZTF's alerts and light curves (Kowalski), and to label the data (Zwickyverse). We also report the initial results of the classifier deployment on the Edge Tensor Processing Units (TPUs) that show comparable performance in terms of accuracy, but in a much more (cost-) efficient manner, which has significant implications for current and future surveys.

General relativity predicts that short orbital period binaries emit significant gravitational radiation, and the upcoming Laser Interferometer Space Antenna (LISA) is expected to detect tens of thousands of such systems; however, few have been identified, and only one is eclipsing--the double white dwarf binary SDSS J065133.338+284423.37, which has an orbital period of 12.75 minutes. Here, we report the discovery of an eclipsing double white dwarf binary system with an orbital period of only 6.91 minutes, ZTF J153932.16+502738.8. This system has an orbital period close to half that of SDSS J065133.338+284423.37 and an orbit so compact that the entire binary could fit within the diameter of the planet Saturn. The system exhibits a deep eclipse, and a double-lined spectroscopic nature. We observe rapid orbital decay, consistent with that expected from general relativity. ZTF J153932.16+502738.8 is a significant source of gravitational radiation close to the peak of LISA's sensitivity, and should be detected within the first week of LISA observations.

The first two months of the third Advanced LIGO and Virgo observing run (2019 April-May) showed that distant gravitational wave (GW) events can now be readily detected. Three candidate mergers containing neutron stars (NS) were reported in a span of 15 days, all likely located more than 100 Mpc away. However, distant events such as the three new NS mergers are likely to be coarsely localized, which highlights the importance of facilities and scheduling systems that enable deep observations over hundreds to thousands of square degrees to detect the electromagnetic counterparts. On 2019-05-10 02:59:39.292 UT the GW candidate S190510g was discovered and initially classified as a BNS merger with 98% probability. The GW event was localized within an area of 3462 deg2, later refined to 1166 deg2 (90%) at a distance of 227 +- 92 Mpc. We triggered Target of Opportunity observations with the Dark Energy Camera (DECam), a wide-field optical imager mounted at the prime focus of the 4m Blanco Telescope at CTIO in Chile. This Letter describes our DECam observations and our real-time analysis results, focusing in particular on the design and implementation of the observing strategy. Within 24 hours of the merger time, we observed 65% of the total enclosed probability of the final skymap with an observing efficiency of 94%. We identified and publicly announced 13 candidate counterparts. S190510g was re-classified 1.7 days after the merger, after our observations were completed, with a "binary neutron star merger" probability reduced from 98% to 42% in favor of a "terrestrial" classification.

Both multi-messenger astronomy and new high-throughput wide-field surveys require flexible tools for the selection and analysis of astrophysical transients. We here introduce the Alert Management, Photometry and Evaluation of Lightcurves (AMPEL) system, an analysis framework designed for high-throughput surveys and suited for streamed data. AMPEL combines the functionality of an alert broker with a generic framework capable of hosting user-contributed code, that encourages provenance and keeps track of the varying information states that a transient displays. The latter concept includes information gathered over time and data policies such as access or calibration levels. We describe a novel ongoing real-time multi-messenger analysis using AMPEL to combine IceCube neutrino data with the alert streams of the Zwicky Transient Facility (ZTF). We also reprocess the first four months of ZTF public alerts, and compare the yields of more than 200 different transient selection functions to quantify efficiencies for selecting Type Ia supernovae that were reported to the Transient Name Server (TNS). We highlight three channels suitable for (1) the collection of a complete sample of extragalactic transients, (2) immediate follow-up of nearby transients and (3) follow-up campaigns targeting young, extragalactic transients. We confirm ZTF completeness in that all TNS supernovae positioned on active CCD regions were detected. AMPEL can assist in filtering transients in real time, running alert reaction simulations, the reprocessing of full datasets as well as in the final scientific analysis of transient data. This text introduces how users can design their own channels for inclusion in the AMPEL live instance that parses the ZTF stream and the real-time submission of high quality extragalactic supernova candidates to the TNS.

We present the results of a systematic search for quasars in the Catalina Real-time Transient Survey exhibiting both strong photometric and spectroscopic variability over a decadal baseline. We identify 73 sources with specific patterns of optical and mid-IR photometric behavior and a defined spectroscopic change. These "Changing-State" quasars (CSQs) form a higher luminosity sample to complement existing sets of "Changing-Look" AGN and quasars in the literature. The CSQs (by selection) exhibit larger photometric variability than the CLQs. The spectroscopic variability is marginally stronger in the CSQs than CLQs as defined by the change in H$\beta$/[OIII] ratio. We find 36 sources with declining H$\beta$ flux, 37 sources with increasing H$\beta$ flux and discover seven sources with $z > 0.8$, further extending the redshift arm. Our CSQ sample compares to the literature CLQ objects in similar distributions of H$\beta$ flux ratios and differential Eddington ratios between high (bright) and low (dim) states. Taken as a whole, we find that this population of extreme varying quasars is associated with changes in the Eddington ratio and the timescales imply cooling/heating fronts propagating through the disk.

We describe ZStreak, a semi-real-time pipeline specialized in detecting small, fast-moving near-Earth asteroids (NEAs) that is currently operating on the data from the newly-commissioned Zwicky Transient Facility (ZTF) survey. Based on a prototype originally developed by Waszczak et al. (2017) for the Palomar Transient Factory (PTF), the predecessor of ZTF, ZStreak features an improved machine-learning model that can cope with the $10\times$ data rate increment between PTF and ZTF. Since its first discovery on 2018 February 5 (2018 CL), ZTF/ZStreak has discovered $45$ confirmed new NEAs over a total of 232 observable nights until 2018 December 31. Most of the discoveries are small NEAs, with diameters less than $\sim100$ m. By analyzing the discovery circumstances, we find that objects having the first to last detection time interval under 2 hr are at risk of being lost. We will further improve real-time follow-up capabilities, and work on suppressing false positives using deep learning.

Over the past century, major advances in astronomy and astrophysics have been largely driven by improvements in instrumentation and data collection. With the amassing of high quality data from new telescopes, and especially with the advent of deep and large astronomical surveys, it is becoming clear that future advances will also rely heavily on how those data are analyzed and interpreted. New methodologies derived from advances in statistics, computer science, and machine learning are beginning to be employed in sophisticated investigations that are not only bringing forth new discoveries, but are placing them on a solid footing. Progress in wide-field sky surveys, interferometric imaging, precision cosmology, exoplanet detection and characterization, and many subfields of stellar, Galactic and extragalactic astronomy, has resulted in complex data analysis challenges that must be solved to perform scientific inference. Research in astrostatistics and astroinformatics will be necessary to develop the state-of-the-art methodology needed in astronomy. Overcoming these challenges requires dedicated, interdisciplinary research. We recommend: (1) increasing funding for interdisciplinary projects in astrostatistics and astroinformatics; (2) dedicating space and time at conferences for interdisciplinary research and promotion; (3) developing sustainable funding for long-term astrostatisics appointments; and (4) funding infrastructure development for data archives and archive support, state-of-the-art algorithms, and efficient computing.

We present the design and performance of RoboPol, a four-channel optical polarimeter operating at the Skinakas Observatory in Crete, Greece. RoboPol is capable of measuring both relative linear Stokes parameters $q$ and $u$ (and the total intensity $I$) in one sky exposure. Though primarily used to measure the polarization of point sources in the R-band, the instrument features additional filters (B, V and I), enabling multi-wavelength imaging polarimetry over a large field of view (13.6' $\times$ 13.6'). We demonstrate the accuracy and stability of the instrument throughout its five years of operation. Best performance is achieved within the central region of the field of view and in the R band. For such measurements the systematic uncertainty is below 0.1% in fractional linear polarization, $p$ (0.05% maximum likelihood). Throughout all observing seasons the instrumental polarization varies within 0.1% in $p$ and within 1$^\circ$ in polarization angle.

We present Zwicky Transient Facility (ZTF) observations of the tidal disruption flare AT2018zr/PS18kh reported by Holoien et al. and detected during ZTF commissioning. The ZTF light curve of the tidal disruption event (TDE) samples the rise-to-peak exceptionally well, with 50 days of g- and r-band detections before the time of maximum light. We also present our multi-wavelength follow-up observations, including the detection of a thermal (kT~100 eV) X-ray source that is two orders of magnitude fainter than the contemporaneous optical/UV blackbody luminosity, and a stringent upper limit to the radio emission. We use observations of 128 known active galactic nuclei (AGN) to assess the quality of the ZTF astrometry, finding a median host-flare distance of 0.2" for genuine nuclear flares. Using ZTF observations of variability from known AGN and supernovae we show how these sources can be separated from TDEs. A combination of light-curve shape, color, and location in the host galaxy can be used to select a clean TDE sample from multi-band optical surveys such as ZTF or LSST.

The Zwicky Transient Facility (ZTF) is a new robotic time-domain survey currently in progress using the Palomar 48-inch Schmidt Telescope. ZTF uses a 47 square degree field with a 600 megapixel camera to scan the entire northern visible sky at rates of ~3760 square degrees/hour to median depths of g ~ 20.8 and r ~ 20.6 mag (AB, 5sigma in 30 sec). We describe the Science Data System that is housed at IPAC, Caltech. This comprises the data-processing pipelines, alert production system, data archive, and user interfaces for accessing and analyzing the products. The realtime pipeline employs a novel image-differencing algorithm, optimized for the detection of point source transient events. These events are vetted for reliability using a machine-learned classifier and combined with contextual information to generate data-rich alert packets. The packets become available for distribution typically within 13 minutes (95th percentile) of observation. Detected events are also linked to generate candidate moving-object tracks using a novel algorithm. Objects that move fast enough to streak in the individual exposures are also extracted and vetted. The reconstructed astrometric accuracy per science image with respect to Gaia is typically 45 to 85 milliarcsec. This is the RMS per axis on the sky for sources extracted with photometric S/N >= 10. The derived photometric precision (repeatability) at bright unsaturated fluxes varies between 8 and 25 millimag. Photometric calibration accuracy with respect to Pan-STARRS1 is generally better than 2%. The products support a broad range of scientific applications: fast and young supernovae, rare flux transients, variable stars, eclipsing binaries, variability from active galactic nuclei, counterparts to gravitational wave sources, a more complete census of Type Ia supernovae, and Solar System objects.

The Zwicky Transient Facility is a large optical survey in multiple filters producing hundreds of thousands of transient alerts per night. We describe here various machine learning (ML) implementations and plans to make the maximal use of the large data set by taking advantage of the temporal nature of the data, and further combining it with other data sets. We start with the initial steps of separating bogus candidates from real ones, separating stars and galaxies, and go on to the classification of real objects into various classes. Besides the usual methods (e.g., based on features extracted from light curves) we also describe early plans for alternate methods including the use of domain adaptation, and deep learning. In a similar fashion we describe efforts to detect fast moving asteroids. We also describe the use of the Zooniverse platform for helping with classifications through the creation of training samples, and active learning. Finally we mention the synergistic aspects of ZTF and LSST from the ML perspective.

The Zwicky Transient Facility (ZTF), a public-private enterprise, is a new time domain survey employing a dedicated camera on the Palomar 48-inch Schmidt telescope with a 47 deg$^2$ field of view and 8 second readout time. It is well positioned in the development of time domain astronomy, offering operations at 10% of the scale and style of the Large Synoptic Survey Telescope (LSST) with a single 1-m class survey telescope. The public surveys will cover the observable northern sky every three nights in g and r filters and the visible Galactic plane every night in g and r. Alerts generated by these surveys are sent in real time to brokers. A consortium of universities which provided funding ("partnership") are undertaking several boutique surveys. The combination of these surveys producing one million alerts per night allows for exploration of transient and variable astrophysical phenomena brighter than r $\sim$ 20.5 on timescales of minutes to years. We describe the primary science objectives driving ZTF including the physics of supernovae and relativistic explosions, multi-messenger astrophysics, supernova cosmology, active galactic nuclei and tidal disruption events, stellar variability, and Solar System objects.

The Zwicky Transient Facility (ZTF) is a new optical time-domain survey that uses the Palomar 48-inch Schmidt telescope. A custom-built wide-field camera provides a 47 deg$^2$ field of view and 8 second readout time, yielding more than an order of magnitude improvement in survey speed relative to its predecessor survey, the Palomar Transient Factory (PTF). We describe the design and implementation of the camera and observing system. The ZTF data system at the Infrared Processing and Analysis Center provides near-real-time reduction to identify moving and varying objects. We outline the analysis pipelines, data products, and associated archive. Finally, we present on-sky performance analysis and first scientific results from commissioning and the early survey. ZTF's public alert stream will serve as a useful precursor for that of the Large Synoptic Survey Telescope.

This report provides an overview of recent work that harnesses the Big Data Revolution and Large Scale Computing to address grand computational challenges in Multi-Messenger Astrophysics, with a particular emphasis on real-time discovery campaigns. Acknowledging the transdisciplinary nature of Multi-Messenger Astrophysics, this document has been prepared by members of the physics, astronomy, computer science, data science, software and cyberinfrastructure communities who attended the NSF-, DOE- and NVIDIA-funded "Deep Learning for Multi-Messenger Astrophysics: Real-time Discovery at Scale" workshop, hosted at the National Center for Supercomputing Applications, October 17-19, 2018. Highlights of this report include unanimous agreement that it is critical to accelerate the development and deployment of novel, signal-processing algorithms that use the synergy between artificial intelligence (AI) and high performance computing to maximize the potential for scientific discovery with Multi-Messenger Astrophysics. We discuss key aspects to realize this endeavor, namely (i) the design and exploitation of scalable and computationally efficient AI algorithms for Multi-Messenger Astrophysics; (ii) cyberinfrastructure requirements to numerically simulate astrophysical sources, and to process and interpret Multi-Messenger Astrophysics data; (iii) management of gravitational wave detections and triggers to enable electromagnetic and astro-particle follow-ups; (iv) a vision to harness future developments of machine and deep learning and cyberinfrastructure resources to cope with the scale of discovery in the Big Data Era; (v) and the need to build a community that brings domain experts together with data scientists on equal footing to maximize and accelerate discovery in the nascent field of Multi-Messenger Astrophysics.

There is significant interest in the models for production of short gamma-ray bursts. Until now, the number of known short gamma-ray bursts with multi-wavelength afterglows has been small. While the {\it Fermi} Gamma-Ray Burst Monitor detects many gamma-ray bursts relative to the Neil Gehrels {\it Swift} Observatory, the large localization regions makes the search for counterparts difficult. With the Zwicky Transient Facility recently achieving first light, it is now fruitful to use its combination of depth ($m_\textrm{AB} \sim 20.6$), field of view ($\approx$ 47 square degrees), and survey cadence (every $\sim 3$ days) to perform Target of Opportunity observations. We demonstrate this capability on GRB 180523B, which was recently announced by the {\it Fermi} Gamma-Ray Burst Monitor as a short gamma-ray burst. ZTF imaged $\approx$ 2900\,square degrees of the localization region, resulting in the coverage of 61.6\,\% of the enclosed probability over 2 nights to a depth of $m_\textrm{AB} \sim 20.5$. We characterized 14 previously unidentified transients, and none were found to be consistent with a short gamma-ray burst counterpart. This search with the Zwicky Transient Facility shows it is an efficient camera for searching for coarsely-localized short gamma-ray burst and gravitational-wave counterparts, allowing for a sensitive search with minimal interruption to its nominal cadence.

We report a framework for spectroscopic follow-up design for optimizing supernova photometric classification. The strategy accounts for the unavoidable mismatch between spectroscopic and photometric samples, and can be used even in the beginning of a new survey -- without any initial training set. The framework falls under the umbrella of active learning (AL), a class of algorithms that aims to minimize labelling costs by identifying a few, carefully chosen, objects which have high potential in improving the classifier predictions. As a proof of concept, we use the simulated data released after the Supernova Photometric Classification Challenge (SNPCC) and a random forest classifier. Our results show that, using only 12\% the number of training objects in the SNPCC spectroscopic sample, this approach is able to double purity results. Moreover, in order to take into account multiple spectroscopic observations in the same night, we propose a semi-supervised batch-mode AL algorithm which selects a set of $N=5$ most informative objects at each night. In comparison with the initial state using the traditional approach, our method achieves 2.3 times higher purity and comparable figure of merit results after only 180 days of observation, or 800 queries (73% of the SNPCC spectroscopic sample size). Such results were obtained using the same amount of spectroscopic time necessary to observe the original SNPCC spectroscopic sample, showing that this type of strategy is feasible with current available spectroscopic resources. The code used in this work is available in the COINtoolbox: https://github.com/COINtoolbox/ActSNClass .

Wide-field optical surveys have begun to uncover large samples of fast (t_rise < 5d), luminous (M_peak < -18), blue transients. While commonly attributed to the breakout of a supernova shock into a dense wind, the great distances to the transients of this class found so far have hampered detailed investigation of their properties. We present photometry and spectroscopy from a comprehensive worldwide campaign to observe AT2018cow (ATLAS18qqn), the first fast-luminous optical transient to be found in real time at low redshift. Our first spectra (<2 days after discovery) are entirely featureless. A very broad absorption feature suggestive of near-relativistic velocities develops between 3-8 days, then disappears. Broad emission features of H and He develop after >10 days. The spectrum remains extremely hot throughout its evolution, and the photospheric radius contracts with time (receding below R<10^14 cm after 1 month). This behaviour does not match that of any known supernova, although a relativistic jet within a fallback supernova could explain some of the observed features. Alternatively, the transient could originate from the disruption of a star by an intermediate-mass black hole, although this would require long-lasting emission of highly super-Eddington thermal radiation. In either case, AT2018cow suggests that the population of fast luminous transients represents a new class of astrophysical event. Intensive follow-up of this event in its late phases, and of any future events found at comparable distance, will be essential to better constrain their origins.

We present an analysis of nine years of Catalina Surveys optical photometry for 1.4 million spectroscopically confirmed SDSS galaxies. We find 717 outburst events that were not reported by ongoing transient surveys. These events have timescales ranging from weeks to years. More than two thirds of these new events are found in starforming galaxies, while such galaxies only constitute ~20% of our sample. Based on the properties of the hosts and events, we find that almost all of the new events are likely to be associated with regular supernovae. However, a small number of long-timescale events are found among the galaxies containing AGN. These events have similar properties to those recently found in the analyses of light curves of large samples of AGN. Given the lack of such events among the more than a million passive galaxies in the sample, we suggest that the long outbursts are associated with super-massive black holes or their environments.

Classification of transient and variable light curves is an essential step in using astronomical observations to develop an understanding of their underlying physical processes. However, upcoming deep photometric surveys, including the Large Synoptic Survey Telescope (LSST), will produce a deluge of low signal-to-noise data for which traditional labeling procedures are inappropriate. Probabilistic classification is more appropriate for the data but are incompatible with the traditional metrics used on deterministic classifications. Furthermore, large survey collaborations intend to use these classification probabilities for diverse science objectives, indicating a need for a metric that balances a variety of goals. We describe the process used to develop an optimal performance metric for an open classification challenge that seeks probabilistic classifications and must serve many scientific interests. The Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC) is an open competition aiming to identify promising techniques for obtaining classification probabilities of transient and variable objects by engaging a broader community both within and outside astronomy. Using mock classification probability submissions emulating archetypes of those anticipated of PLAsTiCC, we compare the sensitivity of metrics of classification probabilities under various weighting schemes, finding that they yield qualitatively consistent results. We choose as a metric for PLAsTiCC a weighted modification of the cross-entropy because it can be meaningfully interpreted. Finally, we propose extensions of our methodology to ever more complex challenge goals and suggest some guiding principles for approaching the choice of a metric of probabilistic classifications.

The Photometric LSST Astronomical Time Series Classification Challenge (PLAsTiCC) is an open data challenge to classify simulated astronomical time-series data in preparation for observations from the Large Synoptic Survey Telescope (LSST), which will achieve first light in 2019 and commence its 10-year main survey in 2022. LSST will revolutionize our understanding of the changing sky, discovering and measuring millions of time-varying objects. In this challenge, we pose the question: how well can we classify objects in the sky that vary in brightness from simulated LSST time-series data, with all its challenges of non-representativity? In this note we explain the need for a data challenge to help classify such astronomical sources and describe the PLAsTiCC data set and Kaggle data challenge, noting that while the references are provided for context, they are not needed to participate in the challenge.

(Abridged) We describe here the most ambitious survey currently planned in the optical, the Large Synoptic Survey Telescope (LSST). A vast array of science will be enabled by a single wide-deep-fast sky survey, and LSST will have unique survey capability in the faint time domain. The LSST design is driven by four main science themes: probing dark energy and dark matter, taking an inventory of the Solar System, exploring the transient optical sky, and mapping the Milky Way. LSST will be a wide-field ground-based system sited at Cerro Pach\'{o}n in northern Chile. The telescope will have an 8.4 m (6.5 m effective) primary mirror, a 9.6 deg$^2$ field of view, and a 3.2 Gigapixel camera. The standard observing sequence will consist of pairs of 15-second exposures in a given field, with two such visits in each pointing in a given night. With these repeats, the LSST system is capable of imaging about 10,000 square degrees of sky in a single filter in three nights. The typical 5$\sigma$ point-source depth in a single visit in $r$ will be $\sim 24.5$ (AB). The project is in the construction phase and will begin regular survey operations by 2022. The survey area will be contained within 30,000 deg$^2$ with $\delta<+34.5^\circ$, and will be imaged multiple times in six bands, $ugrizy$, covering the wavelength range 320--1050 nm. About 90\% of the observing time will be devoted to a deep-wide-fast survey mode which will uniformly observe a 18,000 deg$^2$ region about 800 times (summed over all six bands) during the anticipated 10 years of operations, and yield a coadded map to $r\sim27.5$. The remaining 10\% of the observing time will be allocated to projects such as a Very Deep and Fast time domain survey. The goal is to make LSST data products, including a relational database of about 32 trillion observations of 40 billion objects, available to the public and scientists around the world.

We present a preparatory spectroscopic survey to identify radio-bright, high-redshift quasars for the MeerKAT Absorption Line Survey (MALS). The candidates have been selected on the basis of a single flux density limit at 1.4 GHz (>200 mJy) together with mid-infrared color criteria from the Wide-field Infrared Survey Explorer (WISE). Through spectroscopic observations using the Nordic Optical Telescope, we identify 72 quasars out of 99 candidates targeted. We measure the spectroscopic redshifts based on characteristic, broad emission lines present in the spectra. Of these 72 quasars, 64 and 48 objects are at sufficiently high redshift (z>0.6 and z>1.4) to be used for the L-band and UHF-band spectroscopic follow-up with the Square Kilometre Array (SKA) precursor in South Africa: the MeerKAT.

We use results of our 3 year polarimetric monitoring program to investigate the previously suggested connection between rotations of the polarization plane in the optical emission of blazars and their gamma-ray flares in the GeV band. The homogeneous set of 40 rotation events in 24 sources detected by {\em RoboPol} is analysed together with the gamma-ray data provided by {\em Fermi}-LAT. We confirm that polarization plane rotations are indeed related to the closest gamma-ray flares in blazars and the time lags between these events are consistent with zero. Amplitudes of the rotations are anticorrelated with amplitudes of the gamma-ray flares. This is presumably caused by higher relativistic boosting (higher Doppler factors) in blazars that exhibit smaller amplitude polarization plane rotations. Moreover, the time scales of rotations and flares are marginally correlated.

Large sky surveys are increasingly relying on image subtraction pipelines for real-time (and archival) transient detection. In this process one has to contend with varying PSF, small brightness variations in many sources, as well as artifacts resulting from saturated stars, and, in general, matching errors. Very often the differencing is done with a reference image that is deeper than individual images and the attendant difference in noise characteristics can also lead to artifacts. We present here a deep-learning approach to transient detection that encapsulates all the steps of a traditional image subtraction pipeline -- image registration, background subtraction, noise removal, psf matching, and subtraction -- into a single real-time convolutional network. Once trained the method works lighteningly fast, and given that it does multiple steps at one go, the advantages for multi-CCD, fast surveys like ZTF and LSST are obvious.

Astronomy light curves are sparse, gappy, and heteroscedastic. As a result standard time series methods regularly used for financial and similar datasets are of little help and astronomers are usually left to their own instruments and techniques to classify light curves. A common approach is to derive statistical features from the time series and to use machine learning methods, generally supervised, to separate objects into a few of the standard classes. In this work, we transform the time series to two-dimensional light curve representations in order to classify them using modern deep learning techniques. In particular, we show that convolutional neural networks based classifiers work well for broad characterization and classification. We use labeled datasets of periodic variables from CRTS survey and show how this opens doors for a quick classification of diverse classes with several possible exciting extensions.

Deep galaxy surveys have revealed that the global star formation rate (SFR) density in the Universe peaks at 1 < z < 2 and sharply declines towards z = 0. But a clear picture of the underlying processes, in particular the evolution of cold atomic (~100 K) and molecular gas phases, that drive such a strong evolution is yet to emerge. MALS is designed to use MeerKAT's L- and UHF-band receivers to carry out the most sensitive (N(HI)>10$^{19}$ cm$^{-2}$) dust-unbiased search of intervening HI 21-cm and OH 18-cm absorption lines at 0 < z < 2. This will provide reliable measurements of the evolution of cold atomic and molecular gas cross-sections of galaxies, and unravel the processes driving the steep evolution in the SFR density. The large sample of HI and OH absorbers obtained from the survey will (i) lead to tightest constraints on the fundamental constants of physics, and (ii) be ideally suited to probe the evolution of magnetic fields in disks of galaxies via Zeeman Splitting or Rotation Measure synthesis. The survey will also provide an unbiased census of HI and OH absorbers, i.e. cold gas associated with powerful AGNs (>10$^{24}$ W Hz$^{-1}$) at 0 < z < 2, and will simultaneously deliver a blind HI and OH emission line survey, and radio continuum survey. Here, we describe the MALS survey design, observing plan and the science issues to be addressed under various science themes.

We report the results of our radio, optical and infra-red studies of a peculiar radio source 4C~35.06, an extended radio-loud AGN at the center of galaxy cluster Abell 407 ($z=0.047$). The central region of this cluster hosts a remarkably tight ensemble of nine galaxies, the spectra of which resemble those of passive red ellipticals, embedded within a diffuse stellar halo of $\sim$1~arcmin size. This system (named the `Zwicky's Nonet') provides unique and compelling evidence for a multiple-nucleus cD galaxy precursor. Multifrequency radio observations of 4C~35.06 with the Giant Meterwave Radio Telescope (GMRT) at 610, 235 and 150 MHz reveal a system of 400~kpc scale helically twisted and kinked radio jets and outer diffuse lobes. The outer extremities of jets contain extremely steep spectrum (spectral index -1.7 to -2.5) relic/fossil radio plasma with a spectral age of a few$\,\times (10^7 - 10^8)$ yr. Such ultra-steep spectrum relic radio lobes without definitive hot-spots are rare, and they provide an opportunity to understand the life-cycle of relativistic jets and physics of black hole mergers in dense environments. We interpret our observations of this radio source in the context of the growth of its central black hole, triggering of its AGN activity and jet precession, all possibly caused by galaxy mergers in this dense galactic system. A slow conical precession of the jet axis due to gravitational perturbation between interacting black holes is invoked to explain the unusual jet morphology.

The Large Synoptic Survey Telescope is designed to provide an unprecedented optical imaging dataset that will support investigations of our Solar System, Galaxy and Universe, across half the sky and over ten years of repeated observation. However, exactly how the LSST observations will be taken (the observing strategy or "cadence") is not yet finalized. In this dynamically-evolving community white paper, we explore how the detailed performance of the anticipated science investigations is expected to depend on small changes to the LSST observing strategy. Using realistic simulations of the LSST schedule and observation properties, we design and compute diagnostic metrics and Figures of Merit that provide quantitative evaluations of different observing strategies, analyzing their impact on a wide range of proposed science projects. This is work in progress: we are using this white paper to communicate to each other the relative merits of the observing strategy choices that could be made, in an effort to maximize the scientific value of the survey. The investigation of some science cases leads to suggestions for new strategies that could be simulated and potentially adopted. Notably, we find motivation for exploring departures from a spatially uniform annual tiling of the sky: focusing instead on different parts of the survey area in different years in a "rolling cadence" is likely to have significant benefits for a number of time domain and moving object astronomy projects. The communal assembly of a suite of quantified and homogeneously coded metrics is the vital first step towards an automated, systematic, science-based assessment of any given cadence simulation, that will enable the scheduling of the LSST to be as well-informed as possible.

A systematic study on the long-term periodicities of known Galactic cataclysmic variables (CVs) was conducted. Among 1580 known CVs, 344 sources were matched and extracted from the Palomar Transient Factory (PTF) data repository. The PTF light curves were combined with the Catalina Real-Time Transient Survey (CRTS) light curves and analyzed. Ten targets were found to exhibit long-term periodic variability, which is not frequently observed in the CV systems. These long-term variations are possibly caused by various mechanisms, such as the precession of the accretion disk, hierarchical triple star system, magnetic field change of the companion star, and other possible mechanisms. We discuss the possible mechanisms in this study. If the long-term period is less than several tens of days, the disk precession period scenario is favored. However, the hierarchical triple star system or the variations in magnetic field strengths are most likely the predominant mechanisms for longer periods.

There is a large degree of variety in the optical variability of quasars and it is unclear whether this is all attributable to a single (set of) physical mechanism(s). We present the results of a systematic search for major flares in AGN in the Catalina Real-time Transient Survey as part of a broader study into extreme quasar variability. Such flares are defined in a quantitative manner as being atop of the normal, stochastic variability of quasars. We have identified 51 events from over 900,000 known quasars and high probability quasar candidates, typically lasting 900 days and with a median peak amplitude of $\Delta m = 1.25$ mag. Characterizing the flare profile with a Weibull distribution, we find that nine of the sources are well described by a single-point single-lens model. This supports the proposal by Lawrence et al. (2016) that microlensing is a plausible physical mechanism for extreme variability. However, we attribute the majority of our events to explosive stellar-related activity in the accretion disk: superluminous supernovae, tidal disruption events, and mergers of stellar mass black holes.

CRTS J084133.15+200525.8 is an optically bright quasar at z=2.345 that has shown extreme spectral variability over the past decade. Photometrically, the source had a visual magnitude of V~17.3 between 2002 and 2008. Then, over the following five years, the source slowly brightened by approximately one magnitude, to V~16.2. Only ~1 in 10,000 quasars show such extreme variability, as quantified by the extreme parameters derived for this quasar assuming a damped random walk model. A combination of archival and newly acquired spectra reveal the source to be an iron low-ionization broad absorption line (FeLoBAL) quasar with extreme changes in its absorption spectrum. Some absorption features completely disappear over the 9 years of optical spectra, while other features remain essentially unchanged. We report the first definitive redshift for this source, based on the detection of broad H-alpha in a Keck/MOSFIRE spectrum. Absorption systems separated by several 1000 km/s in velocity show coordinated weakening in the depths of their troughs as the continuum flux increases. We interpret the broad absorption line variability to be due to changes in photoionization, rather than due to motion of material along our line of sight. This source highlights one sort of rare transition object that astronomy will now be finding through dedicated time-domain surveys.

We present the most precise estimate to date of the clustering of quasars on very small scales, based on a sample of 47 binary quasars with magnitudes of $g<20.85$ and proper transverse separations of $\sim 25\,h^{-1}$\,kpc. Our sample of binary quasars, which is about 6 times larger than any previous spectroscopically confirmed sample on these scales, is targeted using a Kernel Density Estimation technique (KDE) applied to Sloan Digital Sky Survey (SDSS) imaging over most of the SDSS area. Our sample is "complete" in that all of the KDE target pairs with $17.0 \lesssim R \lesssim 36.2\,h^{-1}$\,kpc in our area of interest have been spectroscopically confirmed from a combination of previous surveys and our own long-slit observational campaign. We catalogue 230 candidate quasar pairs with angular separations of $<8\arcsec$, from which our binary quasars were identified. We determine the projected correlation function of quasars ($\bar W_{\rm p}$) in four bins of proper transverse scale over the range $17.0 \lesssim R \lesssim 36.2\,h^{-1}$\,kpc. The implied small-scale quasar clustering amplitude from the projected correlation function, integrated across our entire redshift range, is $A=24.1\pm3.6$ at $\sim 26.6 ~h^{-1}$\,kpc. Our sample is the first spectroscopically confirmed sample of quasar pairs that is sufficiently large to study how quasar clustering evolves with redshift at $\sim 25 ~h^{-1}$ kpc. We find that empirical descriptions of how quasar clustering evolves with redshift at $\sim 25 ~h^{-1}$ Mpc also adequately describe the evolution of quasar clustering at $\sim 25 ~h^{-1}$ kpc.

We describe here the parallels in astronomy and earth science datasets, their analyses, and the opportunities for methodology transfer from astroinformatics to geoinformatics. Using example of hydrology, we emphasize how meta-data and ontologies are crucial in such an undertaking. Using the infrastructure being designed for EarthCube - the Virtual Observatory for the earth sciences - we discuss essential steps for better transfer of tools and techniques in the future e.g. domain adaptation. Finally we point out that it is never a one-way process and there is enough for astroinformatics to learn from geoinformatics as well.

The time domain is the emerging forefront of astronomical research with new facilities and instruments providing unprecedented amounts of data on the temporal behavior of astrophysical populations. Dealing with the size and complexity of this requires new techniques and methodologies. Quasars are an ideal work set for developing and applying these: they vary in a detectable but not easily quantifiable manner whose physical origins are poorly understood. In this paper, we will review how quasars are identified by their variability and how these techniques can be improved, what physical insights into their variability can be gained from studying extreme examples of variability, and what approaches can be taken to increase the number of quasars known. These will demonstrate how astroinformatics is essential to discovering and understanding this important population.

We present average R-band optopolarimetric data, as well as variability parameters, from the first and second RoboPol observing season. We investigate whether gamma- ray--loud and gamma-ray--quiet blazars exhibit systematic differences in their optical polarization properties. We find that gamma-ray--loud blazars have a systematically higher polarization fraction (0.092) than gamma-ray--quiet blazars (0.031), with the hypothesis of the two samples being drawn from the same distribution of polarization fractions being rejected at the 3{\sigma} level. We have not found any evidence that this discrepancy is related to differences in the redshift distribution, rest-frame R-band lu- minosity density, or the source classification. The median polarization fraction versus synchrotron-peak-frequency plot shows an envelope implying that high synchrotron- peaked sources have a smaller range of median polarization fractions concentrated around lower values. Our gamma-ray--quiet sources show similar median polarization fractions although they are all low synchrotron-peaked. We also find that the random- ness of the polarization angle depends on the synchrotron peak frequency. For high synchrotron-peaked sources it tends to concentrate around preferred directions while for low synchrotron-peaked sources it is more variable and less likely to have a pre- ferred direction. We propose a scenario which mediates efficient particle acceleration in shocks and increases the helical B-field component immediately downstream of the shock.

We present a new set of optical polarization plane rotations in blazars, observed during the third year of operation of RoboPol. The entire set of rotation events discovered during three years of observations is analysed with the aim of determining whether these events are inherent in all blazars. It is found that the frequency of the polarization plane rotations varies widely among blazars. This variation cannot be explained either by a difference in the relativistic boosting or by selection effects caused by a difference in the average fractional polarization. We conclude that the rotations are characteristic of a subset of blazars and that they occur as a consequence of their intrinsic properties.

The stages before the formation of stars in molecular clouds are poorly understood. Insights can be gained by studying the properties of quiescent clouds, such as their magnetic field structure. The plane-of-the-sky orientation of the field can be traced by polarized starlight. We present the first extended, wide-field ($\sim$10 $\rm deg^2$) map of the Polaris Flare cloud in dust-absorption induced optical polarization of background stars, using the RoboPol polarimeter at the Skinakas Observatory. This is the first application of the wide-field imaging capabilities of RoboPol. The data were taken in the R-band and analysed with the automated reduction pipeline of the instrument. We present in detail optimizations in the reduction pipeline specific to wide-field observations. Our analysis resulted in reliable measurements of 641 stars with median fractional linear polarization 1.3%. The projected magnetic field shows a large scale ordered pattern. At high longitudes it appears to align with faint striations seen in the Herschel-SPIRE map of dust emission (250 $\mu m$), while in the central 4-5 deg$^2$ it shows an eddy-like feature. The overall polarization pattern we obtain is in good agreement with large scale measurements by Planck of the dust emission polarization in the same area of the sky.

The nature of scientific and technological data collection is evolving rapidly: data volumes and rates grow exponentially, with increasing complexity and information content, and there has been a transition from static data sets to data streams that must be analyzed in real time. Interesting or anomalous phenomena must be quickly characterized and followed up with additional measurements via optimal deployment of limited assets. Modern astronomy presents a variety of such phenomena in the form of transient events in digital synoptic sky surveys, including cosmic explosions (supernovae, gamma ray bursts), relativistic phenomena (black hole formation, jets), potentially hazardous asteroids, etc. We have been developing a set of machine learning tools to detect, classify and plan a response to transient events for astronomy applications, using the Catalina Real-time Transient Survey (CRTS) as a scientific and methodological testbed. The ability to respond rapidly to the potentially most interesting events is a key bottleneck that limits the scientific returns from the current and anticipated synoptic sky surveys. Similar challenge arise in other contexts, from environmental monitoring using sensor networks to autonomous spacecraft systems. Given the exponential growth of data rates, and the time-critical response, we need a fully automated and robust approach. We describe the results obtained to date, and the possible future developments.

We present measurements of rotations of the optical polarization of blazars during the second year of operation of RoboPol, a monitoring programme of an unbiased sample of gamma-ray bright blazars specially designed for effective detection of such events, and we analyse the large set of rotation events discovered in two years of observation. We investigate patterns of variability in the polarization parameters and total flux density during the rotation events and compare them to the behaviour in a non-rotating state. We have searched for possible correlations between average parameters of the polarization-plane rotations and average parameters of polarization, with the following results: (1) there is no statistical association of the rotations with contemporaneous optical flares; (2) the average fractional polarization during the rotations tends to be lower than that in a non-rotating state; (3) the average fractional polarization during rotations is correlated with the rotation rate of the polarization plane in the jet rest frame; (4) it is likely that distributions of amplitudes and durations of the rotations have physical upper bounds, so arbitrarily long rotations are not realised in nature.

Big Data are revolutionizing nearly every aspect of the modern society. One area where this can have a profound positive societal impact is the field of Health Care Informatics (HCI), which faces many challenges. The key idea behind this study is: can we use some of the experience and technical and methodological solutions from the fields that have successfully adapted to the Big Data era, namely astronomy and space science, to help accelerate the progress of HCI? We illustrate this with examples from the Virtual Observatory framework, and the NCI EDRN project. An effective sharing and reuse of tools, methods, and experiences from different fields can save a lot of effort, time, and expense. HCI can thus benefit from the proven solutions to big data challenges from other domains.

Outbursts from gamma-ray quasars provide insights on the relativistic jets of active galactic nuclei and constraints on the diffuse radiation fields that fill the Universe. The detection of significant emission above 100 GeV from a distant quasar would show that some of the radiated gamma rays escape pair-production interactions with low-energy photons, be it the extragalactic background light (EBL), or the radiation near the supermassive black hole lying at the jet's base. VERITAS detected gamma-ray emission up to 200 GeV from PKS 1441+25 (z=0.939) during April 2015, a period of high activity across all wavelengths. This observation of PKS 1441+25 suggests that the emission region is located thousands of Schwarzschild radii away from the black hole. The gamma-ray detection also sets a stringent upper limit on the near-ultraviolet to near-infrared EBL intensity, suggesting that galaxy surveys have resolved most, if not all, of the sources of the EBL at these wavelengths.

The optical light curve of the quasar PG 1302-102 at $z = 0.278$ shows a strong, smooth 5.2 yr periodic signal, detectable over a period of $\sim 20$ yr. Although the interpretation of this phenomenon is still uncertain, the most plausible mechanisms involve a binary system of two supermassive black holes with a subparsec separation. At this close separation, the nuclear black holes in PG 1302-102 will likely merge within $\sim 10^{5}$ yr due to gravitational wave emission alone. Here we report the rest-frame near-infrared time lags for PG 1302-102. Compiling data from {\it WISE} and {\it Akari}, we confirm that the periodic behavior reported in the optical light curve from Graham et al. (2015) is reproduced at infrared wavelengths, with best-fit observed-frame 3.4 and $4.6 \mu$m time lags of $(2219 \pm 153, 2408 \pm 148)$ days for a near face-on orientation of the torus, or $(4103\pm 153, 4292 \pm 148)$ days for an inclined system with relativistic Doppler boosting in effect. The periodicity in the infrared light curves and the light-travel time of the accretion disk photons to reach the dust glowing regions support that a source within the accretion disk is responsible for the optical variability of PG 1302-102, echoed at the further out dusty regions. The implied distance of this dusty, assumed toroidal region is $\sim$ 1.5 pc for a near face-on geometry, or $\sim$1.1 pc for the relativistic Doppler boosted case.

PSR J2129-0429 is a "redback" eclipsing millisecond pulsar binary with an unusually long 15.2 hour orbit. It was discovered by the Green Bank Telescope in a targeted search of unidentified Fermi gamma-ray sources. The pulsar companion is optically bright (mean $m_R = 16.6$ mag), allowing us to construct the longest baseline photometric dataset available for such a system. We present ten years of archival and new photometry of the companion from LINEAR, CRTS, PTF, the Palomar 60-inch, and LCOGT. Radial velocity spectroscopy using the Double-Beam Spectrograph on the Palomar 200-inch indicates that the pulsar is massive: $1.74\pm0.18 M_\odot$. The G-type pulsar companion has mass $0.44\pm0.04 M_\odot$, one of the heaviest known redback companions. It is currently 95\% Roche-lobe filling and only mildly irradiated by the pulsar. We identify a clear 13.1 mmag yr$^{-1}$ secular decline in the mean magnitude of the companion as well as smaller-scale variations in the optical lightcurve shape. This behavior may indicate that the companion is cooling. Binary evolution calculations indicate that PSR J2129-0429 has an orbital period almost exactly at the bifurcation period between systems that converge into tighter orbits as black widows and redbacks and those that diverge into wider pulsar--white dwarf binaries. Its eventual fate may depend on whether it undergoes future episodes of mass transfer and increased irradiation.

Hierarchical assembly models predict a population of supermassive black hole (SMBH) binaries. These are not resolvable by direct imaging but may be detectable via periodic variability (or nanohertz frequency gravitational waves). Following our detection of a 5.2 year periodic signal in the quasar PG 1302-102 (Graham et al. 2015), we present a novel analysis of the optical variability of 243,500 known spectroscopically confirmed quasars using data from the Catalina Real-time Transient Survey (CRTS) to look for close (< 0.1 pc) SMBH systems. Looking for a strong Keplerian periodic signal with at least 1.5 cycles over a baseline of nine years, we find a sample of 111 candidate objects. This is in conservative agreement with theoretical predictions from models of binary SMBH populations. Simulated data sets, assuming stochastic variability, also produce no equivalent candidates implying a low likelihood of spurious detections. The periodicity seen is likely attributable to either jet precession, warped accretion disks or periodic accretion associated with a close SMBH binary system. We also consider how other SMBH binary candidates in the literature appear in CRTS data and show that none of these are equivalent to the identified objects. Finally, the distribution of objects found is consistent with that expected from a gravitational wave-driven population. This implies that circumbinary gas is present at small orbital radii and is being perturbed by the black holes. None of the sources is expected to merge within at least the next century. This study opens a new unique window to study a population of close SMBH binaries that must exist according to our current understanding of galaxy and SMBH evolution.

We report the discovery and characterisation of a deeply eclipsing AM CVn-system, Gaia14aae (= ASSASN-14cn). Gaia14aae was identified independently by the All-Sky Automated Survey for Supernovae (ASAS-SN; Shappee et al. 2014) and by the Gaia Science Alerts project, during two separate outbursts. A third outburst is seen in archival Pan-STARRS-1 (PS1; Schlafly et al. 2012; Tonry et al. 2012; Magnier et al. 2013) and ASAS-SN data. Spectroscopy reveals a hot, hydrogen-deficient spectrum with clear double-peaked emission lines, consistent with an accreting double degenerate classification. We use follow-up photometry to constrain the orbital parameters of the system. We find an orbital period of 49.71 min, which places Gaia14aae at the long period extremum of the outbursting AM CVn period distribution. Gaia14aae is dominated by the light from its accreting white dwarf. Assuming an orbital inclination of 90 degrees for the binary system, the contact phases of the white dwarf lead to lower limits of 0.78 M solar and 0.015 M solar on the masses of the accretor and donor respectively and a lower limit on the mass ratio of 0.019. Gaia14aae is only the third eclipsing AM CVn star known, and the first in which the WD is totally eclipsed. Using a helium WD model, we estimate the accretor's effective temperature to be 12900+-200 K. The three out-burst events occurred within 4 months of each other, while no other outburst activity is seen in the previous 8 years of Catalina Real-time Transient Survey (CRTS; Drake et al. 2009), Pan-STARRS-1 and ASAS-SN data. This suggests that these events might be rebrightenings of the first outburst rather than individual events.

AstroStat is an easy-to-use tool for performing statistical analysis on data. It has been designed to be compatible with Virtual Observatory (VO) standards thus enabling it to become an integral part of the currently available collection of VO tools. A user can load data in a variety of formats into AstroStat and perform various statistical tests using a menu driven interface. Behind the scenes, all analysis is done using the public domain statistical software - R and the output returned is presented in a neatly formatted form to the user. The analyses performable include exploratory tests, visualizations, distribution fitting, correlation & causation, hypothesis testing, multivariate analysis and clustering. The tool is available in two versions with identical interface and features - as a web service that can be run using any standard browser and as an offline application. AstroStat will provide an easy-to-use interface which can allow for both fetching data and performing power statistical analysis on them.

Quasars have long been known to be variable sources at all wavelengths. Their optical variability is stochastic, can be due to a variety of physical mechanisms, and is well-described statistically in terms of a damped random walk model. The recent availability of large collections of astronomical time series of flux measurements (light curves) offers new data sets for a systematic exploration of quasar variability. Here we report on the detection of a strong, smooth periodic signal in the optical variability of the quasar PG 1302-102 with a mean observed period of 1,884 $\pm$ 88 days. It was identified in a search for periodic variability in a data set of light curves for 247,000 known, spectroscopically confirmed quasars with a temporal baseline of $\sim9$ years. While the interpretation of this phenomenon is still uncertain, the most plausible mechanisms involve a binary system of two supermassive black holes with a subparsec separation. Such systems are an expected consequence of galaxy mergers and can provide important constraints on models of galaxy formation and evolution.

We use seven year's worth of observations from the Catalina Sky Survey and the Siding Spring Survey covering most of the northern and southern hemisphere at galactic latitudes higher than 20 degrees to search for serendipitously imaged moving objects in the outer solar system. These slowly moving objects would appear as stationary transients in these fast cadence asteroids surveys, so we develop methods to discover objects in the outer solar system using individual observations spaced by months, rather than spaced by hours, as is typically done. While we independently discover 8 known bright objects in the outer solar system, the faintest having $V=19.8\pm0.1$, no new objects are discovered. We find that the survey is nearly 100% efficient at detecting objects beyond 25 AU for $V\lesssim 19.1$ ($V\lesssim18.6$ in the southern hemisphere) and that the probability that there is one or more remaining outer solar system object of this brightness left to be discovered in the unsurveyed regions of the galactic plane is approximately 32%.

Effective data visualization is a key part of the discovery process in the era of big data. It is the bridge between the quantitative content of the data and human intuition, and thus an essential component of the scientific path from data into knowledge and understanding. Visualization is also essential in the data mining process, directing the choice of the applicable algorithms, and in helping to identify and remove bad data from the analysis. However, a high complexity or a high dimensionality of modern data sets represents a critical obstacle. How do we visualize interesting structures and patterns that may exist in hyper-dimensional data spaces? A better understanding of how we can perceive and interact with multi dimensional information poses some deep questions in the field of cognition technology and human computer interaction. To this effect, we are exploring the use of immersive virtual reality platforms for scientific data visualization, both as software and inexpensive commodity hardware. These potentially powerful and innovative tools for multi dimensional data visualization can also provide an easy and natural path to a collaborative data visualization and exploration, where scientists can interact with their data and their colleagues in the same visual space. Immersion provides benefits beyond the traditional desktop visualization tools: it leads to a demonstrably better perception of a datascape geometry, more intuitive data understanding, and a better retention of the perceived relationships in the data.

We present the results of a deep, wide-area variability survey in the Southern hemisphere, the first of its kind. As part of the Catalina Sky Surveys, the Siding Spring Survey (SSS) has covered $14,800$ square degrees in the declination range of $-75^{\circ}\leq\delta\leq-15^{\circ}$. To mine the enormous SSS dataset efficiently we have developed two algorithms: Automatic Period Selection (APS) and Automatic Fourier Decomposition (AFD), which aim to sharpen the period estimation and produce robust lightcurve models. Armed with the APS and AFD outputs we classify $10,540$ ab-type RR Lyrae (RRab) stars ($\sim$90% of which are new) across the Southern sky. As well as the positional information we supply photometric metallicities, and unreddened distances. For the RRab stars in the halo, a study of the photometric metallicity distribution reveals a nearly Gaussian shape with a mean metallicity of ${\rm [Fe/H]}=-1.4$ dex and a dispersion of $0.3$ dex. A spatial study of the RRab metallicities shows no significant radial gradient in the first $\sim7$ kpc from the Galaxy center. However, further out, a small negative gradient is clearly present. This is complemented by a very obvious correlation of the mean RR Lyrae metallicity with distance above the Galactic plane, $z$. We have also carried out an initial substructure search using the discovered RRab, and present the properties of the candidates with significance greater than $2 \sigma$. Most prominent among these is a southern extension of the Sagittarius dwarf galaxy's stream system, reaching down to declinations $\sim -40\deg$.

The nature of scientific and technological data collection is evolving rapidly: data volumes and rates grow exponentially, with increasing complexity and information content, and there has been a transition from static data sets to data streams that must be analyzed in real time. Interesting or anomalous phenomena must be quickly characterized and followed up with additional measurements via optimal deployment of limited assets. Modern astronomy presents a variety of such phenomena in the form of transient events in digital synoptic sky surveys, including cosmic explosions (supernovae, gamma ray bursts), relativistic phenomena (black hole formation, jets), potentially hazardous asteroids, etc. We have been developing a set of machine learning tools to detect, classify and plan a response to transient events for astronomy applications, using the Catalina Real-time Transient Survey (CRTS) as a scientific and methodological testbed. The ability to respond rapidly to the potentially most interesting events is a key bottleneck that limits the scientific returns from the current and anticipated synoptic sky surveys. Similar challenge arise in other contexts, from environmental monitoring using sensor networks to autonomous spacecraft systems. Given the exponential growth of data rates, and the time-critical response, we need a fully automated and robust approach. We describe the results obtained to date, and the possible future developments.

Many synoptic surveys are observing large parts of the sky multiple times. The resulting lightcurves provide a wonderful window to the dynamic nature of the universe. However, there are many significant challenges in analyzing these light curves. These include heterogeneity of the data, irregularly sampled data, missing data, censored data, known but variable measurement errors, and most importantly, the need to classify in astronomical objects in real time using these imperfect light curves. We describe a modeling-based approach using Gaussian process regression for generating critical measures representing features for the classification of such lightcurves. We demonstrate that our approach performs better by comparing it with past methods. Finally, we provide future directions for use in sky-surveys that are getting even bigger by the day.

We investigate the properties of 367 ultra-short period binary candidates selected from 31,000 sources recently identified from Catalina Surveys data. Based on light curve morphology, along with WISE, SDSS and GALEX multi-colour photometry, we identify two distinct groups of binaries with periods below the 0.22 day contact binary minimum. In contrast to most recent work, we spectroscopically confirm the existence of M-dwarf+M-dwarf contact binary systems. By measuring the radial velocity variations for five of the shortest-period systems, we find examples of rare cool-white dwarf+M-dwarf binaries. Only a few such systems are currently known. Unlike warmer white dwarf systems, their UV flux and their optical colours and spectra are dominated by the M-dwarf companion. We contrast our discoveries with previous photometrically-selected ultra-short period contact binary candidates, and highlight the ongoing need for confirmation using spectra and associated radial velocity measurements. Overall, our analysis increases the number of ultra-short period contact binary candidates by more than an order of magnitude.

Astronomy is undergoing through a methodological revolution triggered by an unprecedented wealth of complex and accurate data. The new panchromatic, synoptic sky surveys require advanced tools for discovering patterns and trends hidden behind data which are both complex and of high dimensionality. We present DAMEWARE (DAta Mining & Exploration Web Application REsource): a general purpose, web-based, distributed data mining environment developed for the exploration of large datasets, and finely tuned for astronomical applications. By means of graphical user interfaces, it allows the user to perform classification, regression or clustering tasks with machine learning methods. Salient features of DAMEWARE include its capability to work on large datasets with minimal human intervention, and to deal with a wide variety of real problems such as the classification of globular clusters in the galaxy NGC1399, the evaluation of photometric redshifts and, finally, the identification of candidate Active Galactic Nuclei in multiband photometric surveys. In all these applications, DAMEWARE allowed to achieve better results than those attained with more traditional methods. With the aim of providing potential users with all needed information, in this paper we briefly describe the technological background of DAMEWARE, give a short introduction to some relevant aspects of data mining, followed by a summary of some science cases and, finally, we provide a detailed description of a template use case.

We present ~47,000 periodic variables found during the analysis of 5.4 million variable star candidates within a 20,000 square degree region covered by the Catalina Surveys Data Release-1 (CSDR1). Combining these variables with type-ab RR Lyrae from our previous work, we produce an on-line catalog containing periods, amplitudes, and classifications for ~61,000 periodic variables. By cross-matching these variables with those from prior surveys, we find that > 90% of the ~8,000 known periodic variables in the survey region are recovered. For these sources we find excellent agreement between our catalog and prior values of luminosity, period and amplitude, as well as classification. We investigate the rate of confusion between objects classified as contact binaries and type-c RR Lyrae (RRc's) based on periods, colours, amplitudes, metalicities, radial velocities and surface gravities. We find that no more than few percent of these variables in these classes are misidentified. By deriving distances for this clean sample of ~5,500 RRc's, we trace the path of the Sagittarius tidal streams within the Galactic halo. Selecting 146 outer-halo RRc's with SDSS radial velocities, we confirm the presence of a coherent halo structure that is inconsistent with current N-body simulations of the Sagittarius tidal stream. We also find numerous long-period variables that are very likely associated within the Sagittarius tidal streams system. Based on the examination of 31,000 contact binary light curves we find evidence for two subgroups exhibiting irregular lightcurves. One subgroup presents significant variations in mean brightness that are likely due to chromospheric activity. The other subgroup shows stable modulations over more than a thousand days and thereby provides evidence that the O'Connell effect is not due to stellar spots.

We present 855 cataclysmic variable candidates detected by the Catalina Real-time Transient Survey (CRTS) of which at least 137 have been spectroscopically confirmed and 705 are new discoveries. The sources were identified from the analysis of five years of data, and come from an area covering three quarters of the sky. We study the amplitude distribution of the dwarf novae CVs discovered by CRTS during outburst, and find that in quiescence they are typically two magnitudes fainter compared to the spectroscopic CV sample identified by SDSS. However, almost all CRTS CVs in the SDSS footprint have ugriz photometry. We analyse the spatial distribution of the CVs and find evidence that many of the systems lie at scale heights beyond those expected for a Galactic thin disc population. We compare the outburst rates of newly discovered CRTS CVs with the previously known CV population, and find no evidence for a difference between them. However, we find that significant evidence for a systematic difference in orbital period distribution. We discuss the CVs found below the orbital period minimum and argue that many more are yet to be identified among the full CRTS CV sample. We cross-match the CVs with archival X-ray catalogs and find that most of the systems are dwarf novae rather than magnetic CVs.

We present results of our time variability studies of Mg II and Al III absorption lines in a sample of 22 Low Ionization Broad Absorption Line QSOs (LoBAL QSOs) at 0.2 <= zem <= 2.1 using the 2m telescope at IUCAA Girawali Observatory over a time-scale of 10 days to 7.69 years in the QSO's rest frame. Spectra are analysed in conjunction with photometric light curves from Catalina Real-Time Transient Survey. Long time-scale (i.e >= 1 year) absorption line variability is seen in 8 cases (36% systems) while only 4 of them (i.e 18% systems) show variability over short time-scales (i.e < 1 year). We notice a tendency of highly variable LoBAL QSOs to have high ejection velocity, low equivalent width and low redshift. The detection rate of variability in LoBAL QSOs showing Fe fine-structure lines (FeLoBAL QSOs) is less than that seen in non-Fe LoBAL QSOs. Absorption line variability is more frequently detected in QSOs having continuum dominated by Fe emission lines compared to rest of the QSOs. Confirming these trends with a bigger sample will give vital clues for understanding the physical distinction between different BAL QSO sub-classes. We correlate the absorption line variability with various parameters derived from continuum light curves and find no clear correlation between continuum flux and absorption line variabilities. However, sources with large absorption line variability also show large variability in their light curves. We also see appearance/disappearance of absorption components in 2 cases and clear indications for profile variations in 4 cases. The observed variability can be best explained by a combination of process driven by continuum variations and clouds transiting across the line of sight.

This article offers a short guide to the steps scientists can take to ensure that their data and associated analyses continue to be of value and to be recognized. In just the past few years, hundreds of scholarly papers and reports have been written on questions of data sharing, data provenance, research reproducibility, licensing, attribution, privacy, and more, but our goal here is not to review that literature. Instead, we present a short guide intended for researchers who want to know why it is important to "care for and feed" data, with some practical advice on how to do that.

We use optical data from the Palomar Transient Factory (PTF) and the Catalina Real-Time Transient Survey (CRTS) to study the variability of gamma-ray detected and non-detected objects in a large population of active galactic nuclei (AGN) selected from the Candidate Gamma-Ray Blazar Survey and Fermi Gamma-Ray Space Telescope catalogs. Our samples include 714 sources with PTF data and 1244 sources with CRTS data. We calculate the intrinsic modulation index to quantify the optical variability amplitude in these samples. We find the gamma-ray detected objects to be more variable than the non-detected ones. The flat spectrum radio quasars (FSRQs) are more variable than the BL Lac objects in our sample, but the significance of the difference depends on the sample used. When dividing the objects based on their synchrotron peak frequency, we find the low synchrotron peaked (LSP) objects to be significantly more variable than the high synchrotron peaked (HSP) ones, explaining the difference between the FSRQs and BL Lacs. This could be due to the LSPs being observed near their electron energy peak, while in the HSPs the emission is caused by lower energy electrons, which cool more slowly. We also find a significant correlation between the optical and gamma-ray fluxes that is stronger in the HSP BL Lacs than in the FSRQs. The FSRQs in our sample are also more Compton dominated than the HSP BL Lacs. These findings are consistent with models where the gamma-ray emission of HSP objects is produced by the synchrotron self-Compton mechanism, while the LSP objects need an additional external Compton component that increases the scatter in the flux-flux correlation.

We compare quasar selection techniques based on their optical variability using data from the Catalina Real-time Transient Survey (CRTS). We introduce a new technique based on Slepian wavelet variance (SWV) that shows comparable or better performance to structure functions and damped random walk models but with fewer assumptions. Combining these methods with WISE mid-IR colors produces a highly efficient quasar selection technique which we have validated spectroscopically. The SWV technique also identifies characteristic timescales in a time series and we find a characteristic rest frame timescale of ~54 days, confirmed in the light curves of ~18000 quasars from CRTS, SDSS and MACHO data, and anticorrelated with absolute magnitude. This indicates a transition between a damped random walk and $P(f) \propto f^{-1/3}$ behaviours and is the first strong indication that a damped random walk model may be too simplistic to describe optical quasar variability.

The amount of collected data in many scientific fields is increasing, all of them requiring a common task: extract knowledge from massive, multi parametric data sets, as rapidly and efficiently possible. This is especially true in astronomy where synoptic sky surveys are enabling new research frontiers in the time domain astronomy and posing several new object classification challenges in multi dimensional spaces; given the high number of parameters available for each object, feature selection is quickly becoming a crucial task in analyzing astronomical data sets. Using data sets extracted from the ongoing Catalina Real-Time Transient Surveys (CRTS) and the Kepler Mission we illustrate a variety of feature selection strategies used to identify the subsets that give the most information and the results achieved applying these techniques to three major astronomical problems.

We present the results of a pilot survey to find dust-reddened quasars by matching the FIRST radio catalog to the UKIDSS near-infrared survey, and using optical data from SDSS to select objects with very red colors. The deep K-band limit provided by UKIDSS allows for finding more heavily-reddened quasars at higher redshifts as compared with previous work using FIRST and 2MASS. We selected 87 candidates with K<=17.0 from the UKIDSS Large Area Survey (LAS) First Data Release (DR1) which covers 190 deg2. These candidates reach up to ~1.5 magnitudes below the 2MASS limit and obey the color criteria developed to identify dust-reddened quasars. We have obtained 61 spectroscopic observations in the optical and/or near-infrared as well as classifications in the literature and have identified 14 reddened quasars with E(B-V)>0.1, including three at z>2. We study the infrared properties of the sample using photometry from the WISE Observatory and find that infrared colors improve the efficiency of red quasar selection, removing many contaminants in an infrared-to-optical color-selected sample alone. The highest-redshift quasars (z > 2) are only moderately reddened, with E(B-V) ~ 0.2-0.3. We find that the surface density of red quasars rises sharply with faintness, comprising up to 17% of blue quasars at the same apparent K-band flux limit. We estimate that to reach more heavily reddened quasars (i.e., E(B-V) > 0.5) at z>2 and a depth of K=17 we would need to survey at least ~2.5 times more area.

We present the discovery of a plausible super-luminous supernova (SLSN), found in the archival data of Sloan Digital Sky Survey (SDSS) Stripe 82, called PSN 000123+000504. The supernova peaked at M_g<-21.3 mag in the second half of September 2005, but was missed by the real-time supernova hunt. The observed part of the light curve (17 epochs) showed that the rise to the maximum took over 30 days, while the decline time lasted at least 70 days (observed frame), closely resembling other SLSNe of SN2007bi type. Spectrum of the host galaxy reveals a redshift of z=0.281 and the distance modulus of \mu=40.77 mag. Combining this information with the SDSS photometry, we found the host galaxy to be an LMC-like irregular dwarf galaxy with the absolute magnitude of M_B=-18.2+/-0.2 mag and the oxygen abundance of 12+log[O/H]=8.3+/-0.2. Our SLSN follows the relation for the most energetic/super-luminous SNe exploding in low-metallicity environments, but we found no clear evidence for SLSNe to explode in low-luminosity (dwarf) galaxies only. The available information on the PSN 000123+000504 light curve suggests the magnetar-powered model as a likely scenario of this event. This SLSN is a new addition to a quickly growing family of super-luminous SNe.

This paper presents a comparison of popular period finding algorithms applied to the light curves of variable stars from the Catalina Real-time Transient Survey (CRTS), MACHO and ASAS data sets. We analyze the accuracy of the methods against magnitude, sampling rates, quoted period, quality measures (signal-to-noise and number of observations), variability, and object classes. We find that measure of dispersion-based techniques - analysis-of-variance with harmonics and conditional entropy - consistently give the best results but there are clear dependencies on object class and light curve quality. Period aliasing and identifying a period harmonic also remain significant issues. We consider the performance of the algorithms and show that a new conditional entropy-based algorithm is the most optimal in terms of completeness and speed. We also consider a simple ensemble approach and find that it performs no better than individual algorithms.

This paper presents a new period finding method based on conditional entropy that is both efficient and accurate. We demonstrate its applicability on simulated and real data. We find that it has comparable performance to other information-based techniques with simulated data but is superior with real data, both for finding periods and just identifying periodic behaviour. In particular, it is robust against common aliasing issues found with other period-finding algorithms.

High-volume feature-rich data sets are becoming the bread-and-butter of 21st century astronomy but present significant challenges to scientific discovery. In particular, identifying scientifically significant relationships between sets of parameters is non-trivial. Similar problems in biological and geosciences have led to the development of systems which can explore large parameter spaces and identify potentially interesting sets of associations. In this paper, we describe the application of automated discovery systems of relationships to astronomical data sets, focussing on an evolutionary programming technique and an information-theory technique. We demonstrate their use with classical astronomical relationships - the Hertzsprung-Russell diagram and the fundamental plane of elliptical galaxies. We also show how they work with the issue of binary classification which is relevant to the next generation of large synoptic sky surveys, such as LSST. We find that comparable results to more familiar techniques, such as decision trees, are achievable. Finally, we consider the reality of the relationships discovered and how this can be used for feature selection and extraction.

We describe the work of the Meta-Institute for Computational Astrophysics (MICA), the first professional scientific organization based in virtual worlds. MICA was an experiment in the use of this technology for science and scholarship, lasting from the early 2008 to June 2012, mainly using the Second Life and OpenSimulator as platforms. We describe its goals and activities, and our future plans. We conducted scientific collaboration meetings, professional seminars, a workshop, classroom instruction, public lectures, informal discussions and gatherings, and experiments in immersive, interactive visualization of high-dimensional scientific data. Perhaps the most successful of these was our program of popular science lectures, illustrating yet again the great potential of immersive VR as an educational and outreach platform. While the members of our research groups and some collaborators found the use of immersive VR as a professional telepresence tool to be very effective, we did not convince a broader astrophysics community to adopt it at this time, despite some efforts; we discuss some possible reasons for this non-uptake. On the whole, we conclude that immersive VR has a great potential as a scientific and educational platform, as the technology matures and becomes more broadly available and accepted.

We present the analysis of 1,207 RR Lyrae found in photometry taken by the Catalina Survey's Mount Lemmon telescope. By combining accurate distances for these stars with measurements for ~14,000 type-AB RR Lyrae from the Catalina Schmid telescope, we reveal an extended association that reaches Galactocentric distances beyond 100 kpc and overlaps the Sagittarius streams system. This result confirms earlier evidence for the existence of an outer halo tidal stream resulting from a disrupted stellar system. By comparing the RR Lyrae source density with that expected based on halo models, we find the detection has ~8 sigma significance. We investigate the distances, radial velocities, metallicities, and period-amplitude distribution of the RR Lyrae. We find that both radial velocities and distances are inconsistent with current models of the Sagittarius stream. We also find tentative evidence for a division in source metallicities for the most distant sources. Following prior analyses, we compare the locations and distances of the RR Lyrae with photometrically selected candidate horizontal branch stars and find supporting evidence that this structure spans at least 60 deg of the sky. We investigate the prospects of an association between the stream and unusual globular cluster NGC 2419.

There are many occasions when one does not have complete information in order to classify objects into different classes, and yet it is important to do the best one can since other decisions depend on that. In astronomy, especially time-domain astronomy, this situation is common when a transient is detected and one wishes to determine what it is in order to decide if one must follow it. We propose to use the Difference Boosting Neural Network (DBNN) which can boost differences between feature vectors of different objects in order to differentiate between them. We apply it to the publicly available data of the Catalina Real-Time Transient Survey (CRTS) and present preliminary results. We also describe another use with a stellar spectral library to identify spectra based on a few features. The technique itself is more general and can be applied to a varied class of problems.

We present the analysis of 12227 type-ab RR Lyrae found among the 200 million public lightcurves in the Catalina Surveys Data Release 1 (CSDR1). These stars span the largest volume of the Milky Way ever surveyed with RR Lyrae, covering ~20,000 square degrees of the sky (0 < RA < 360, -22 < Dec < 65 deg) to heliocentric distances of up to 60kpc. Each of the RR Lyrae are observed between 60 and 419 times over a six-year period. Using period finding and Fourier fitting techniques we determine periods and apparent magnitudes for each source. We find that the periods at generally accurate to sigma = 0.002% by comparison with 2842 previously known RR Lyrae and 100 RR Lyrae observed in overlapping survey fields. We photometrically calibrate the light curves using 445 Landolt standard stars and show that the resulting magnitudes are accurate to ~0.05 mags using SDSS data for ~1000 blue horizontal branch stars and 7788 of the RR Lyrae. By combining Catalina photometry with SDSS spectroscopy, we analyze the radial velocity and metallicity distributions for > 1500 of the RR Lyrae. Using the accurate distances derived for the RR Lyrae, we show the paths of the Sagittarius tidal streams crossing the sky at heliocentric distances from 20 to 60 kpc. By selecting samples of Galactic halo RR Lyrae, we compare their velocity, metallicity, and distance with predictions from a recent detailed N-body model of the Sagittarius system. We find that there are some significant differences between the distances and structures predicted and our observations.

An automated, rapid classification of transient events detected in the modern synoptic sky surveys is essential for their scientific utility and effective follow-up using scarce resources. This presents some unusual challenges: the data are sparse, heterogeneous and incomplete; evolving in time; and most of the relevant information comes not from the data stream itself, but from a variety of archival data and contextual information (spatial, temporal, and multi-wavelength). We are exploring a variety of novel techniques, mostly Bayesian, to respond to these challenges, using the ongoing CRTS sky survey as a testbed. The current surveys are already overwhelming our ability to effectively follow all of the potentially interesting events, and these challenges will grow by orders of magnitude over the next decade as the more ambitious sky surveys get under way. While we focus on an application in a specific domain (astrophysics), these challenges are more broadly relevant for event or anomaly detection and knowledge discovery in massive data streams.

Astronomy has been at the forefront of the development of the techniques and methodologies of data intensive science for over a decade with large sky surveys and distributed efforts such as the Virtual Observatory. However, it faces a new data deluge with the next generation of synoptic sky surveys which are opening up the time domain for discovery and exploration. This brings both new scientific opportunities and fresh challenges, in terms of data rates from robotic telescopes and exponential complexity in linked data, but also for data mining algorithms used in classification and decision making. In this paper, we describe how an informatics-based approach-part of the so-called "fourth paradigm" of scientific discovery-is emerging to deal with these. We review our experiences with the Palomar-Quest and Catalina Real-Time Transient Sky Surveys; in particular, addressing the issue of the heterogeneity of data associated with transient astronomical events (and other sensor networks) and how to manage and analyze it.

We present a sample of 120 dust-reddened quasars identified by matching radio sources detected at 1.4 GHz in the FIRST survey with the near-infrared 2MASS catalog and color-selecting red sources. Optical and/or near-infrared spectroscopy provide broad wavelength sampling of their spectral energy distributions that we use to determine their reddening, characterized by E(B-V). We demonstrate that the reddening in these quasars is best-described by SMC-like dust. This sample spans a wide range in redshift and reddening (0.1 < z < 3, 0.1 < E(B-V) < 1.5), which we use to investigate the possible correlation of luminosity with reddening. At every redshift, dust-reddened quasars are intrinsically the most luminous quasars. We interpret this result in the context of merger-driven quasar/galaxy co-evolution where these reddened quasars are revealing an emergent phase during which the heavily obscured quasar is shedding its cocoon of dust prior to becoming a "normal" blue quasar. When correcting for extinction, we find that, depending on how the parent population is defined, these red quasars make up < 15-20% of the luminous quasar population. We estimate, based on the fraction of objects in this phase, that its duration is 15-20% as long as the unobscured, blue quasar phase.

The time domain has been identified as one of the most important areas of astronomical research for the next decade. The Virtual Observatory is in the vanguard with dedicated tools and services that enable and facilitate the discovery, dissemination and analysis of time domain data. These range in scope from rapid notifications of time-critical astronomical transients to annotating long-term variables with the latest modeling results. In this paper, we will review the prior art in these areas and focus on the capabilities that the VAO is bringing to bear in support of time domain science. In particular, we will focus on the issues involved with the heterogeneous collections of (ancillary) data associated with astronomical transients, and the time series characterization and classification tools required by the next generation of sky surveys, such as LSST and SKA.

Sky surveys represent a fundamental data basis for astronomy. We use them to map in a systematic way the universe and its constituents, and to discover new types of objects or phenomena. We review the subject, with an emphasis on the wide-field imaging surveys, placing them in a broader scientific and historical context. Surveys are the largest data generators in astronomy, propelled by the advances in information and computation technology, and have transformed the ways in which astronomy is done. We describe the variety and the general properties of surveys, the ways in which they may be quantified and compared, and offer some figures of merit that can be used to compare their scientific discovery potential. Surveys enable a very wide range of science; that is perhaps their key unifying characteristic. As new domains of the observable parameter space open up thanks to the advances in technology, surveys are often the initial step in their exploration. Science can be done with the survey data alone or a combination of different surveys, or with a targeted follow-up of potentially interesting selected sources. Surveys can be used to generate large, statistical samples of objects that can be studied as populations, or as tracers of larger structures. They can be also used to discover or generate samples of rare or unusual objects, and may lead to discoveries of some previously unknown types. We discuss a general framework of parameter spaces that can be used for an assessment and comparison of different surveys, and the strategies for their scientific exploration. As we move into the Petascale regime, an effective processing and scientific exploitation of such large data sets and data streams poses many challenges, some of which may be addressed in the framework of Virtual Observatory and Astroinformatics, with a broader application of data mining and knowledge discovery technologies.

We study the time variability of five Fe Low ionization Broad Absorption Line (FeLoBAL) QSOs using repeated spectroscopic observations with the 2m telescope at IUCAA Girawali observatory (IGO) spanning an interval of upto 10 years. We report a dramatic variation in Al III and Fe III fine-structure lines in the spectra of SDSS J221511.93-004549.9 (z_em ~ 1.478). However, there is no such strong variability shown by the C IV absorption. This source is known to be unusual with (i) the continuum emission dominated by Fe emission lines, (ii) Fe III absorption being stronger than Fe II and (iii) the apparent ratio of Fe III UV 48 to Fe III UV 34 absorption suggesting an inverted population ratio. This is the first reported detection of time variability in the Fe III fine-structure lines in QSO spectra. There is a strong reduction in the absorption strength of these lines between year 2000 and 2008. Using the template fitting techniques, we show that the apparent inversion of strength of UV lines could be related to the complex spectral energy distribution of this QSO. The observed variability can be related to change in the ionization state of the gas or due to transverse motion of this absorbing gas. The shortest variability timescale of Al III line gives a lower limit on the electron density of the absorbing gas as n_e >= 1.1 x 10^4 cm^-3. The remaining 4 FeLoBALs do not show any changes beyond the measurement uncertainties either in optical depth or in the velocity structure. We present the long-term photometric light curve for all of our sources. Among them only SDSS J221511.93-004549.9 shows significant (>= 0.2 mag) variability.

Astronomy has always been at the forefront of information technology, moving from the era of photographic plates, to digital snapshots and now to digital movies of the sky. This has brought about a data explosion with multi- terabyte surveys already happening and upcoming petabyte scale surveys. By scanning the sky repeatedly and automatically, astronomers find rapidly changing phenomena - transients - of a great variety. Surveys like the Catalina Real-time Transient Survey (CRTS) publish details on the transients right away since many of these fade in a matter of minutes and it is important to get additional observations in order to determine their nature. This involves being able to combine a variety of datasets, small and large, in real-time. With networks like the Asia Pacific Advanced Network (APAN) and India's National Knowledge Network (NKN) we are in the realm where such a data transfer is possible in real time across continents. Here we describe the live demonstration we were able to carry out at data transfer speeds of several hundred megabits per second (Mbps) between California Institute of Technology (Caltech, USA) and the Inter-University Centre for Astronomy and Astrophysics (IUCAA, India). This project illustrates how machines can make rapid decisions in response to complex, heterogeneous data, using sophisticated software and networking. While the broader impact covers all aspects of society (disaster response, power grids, earthquakes, and many more), we have used astronomy to show how the APAN and NKN make this possible.

We report a dynamically evolving low ionization broad absorption line flow in the QSO SDSS J133356.02+001229.1 (at z_em = 0.9197). These observations are part of our ongoing monitoring of low ionization broad absorption line (BAL) QSOs with the 2m telescope at IUCAA Girawali observatory (IGO). The broad Mg II absorption with an ejection velocity of 1.7x10^4 km/s, found in the Sloan Digital Sky Survey (SDSS) spectra, has disappeared completely in our IGO spectra. We found an emerging new component at an ejection velocity of 2.8 x 10^4 km/s. During our monitoring period this component has shown strong evolution both in its velocity width and optical depth and nearly disappeared in our latest observations. Acceleration of a low velocity component seen in SDSS spectrum to a higher velocity is unlikely as the Mg II column densities are always observed to be higher for the new component. We argue that the observed variations may not be related to ionization changes and are consistent with absorption produced by multi-streaming flow transiting across our line of sight. We find a possible connection between flux variation of the QSO and N(Mg II) of the newly emerged component. This could mean the ejection being triggered by changes in the accretion disk or dust reddening due to the outflowing gas.

An automated, rapid classification of transient events detected in the modern synoptic sky surveys is essential for their scientific utility and effective follow-up using scarce resources. This problem will grow by orders of magnitude with the next generation of surveys. We are exploring a variety of novel automated classification techniques, mostly Bayesian, to respond to these challenges, using the ongoing CRTS sky survey as a testbed. We describe briefly some of the methods used.

The Catalina Real-time Transient Survey (CRTS) currently covers 33,000 deg^2 of the sky in search of transient astrophysical events, with time baselines ranging from 10 minutes to ~7 years. Data provided by the Catalina Sky Survey provides an unequaled baseline against which >4,000 unique optical transient events have been discovered and openly published in real-time. Here we highlight some of the discoveries of CRTS.

The time domain community wants robust and reliable tools to enable production of and subscription to community-endorsed event notification packets (VOEvent). The VAO Transient Facility (VTF) is being designed to be the premier brokering service for the community, both collecting and disseminating observations about time-critical astronomical transients but also supporting annotations and the application of intelligent machine-learning to those observations. This distinguishes two types of activity associated with the facility: core infrastructure and user services. In this paper, we will review the prior art in both areas and describe the planned capabilities of the VTF. In particular, we will focus on scalability and quality-of-service issues required by the next generation of sky surveys, such as LSST and SKA.

Synoptic sky surveys are becoming the largest data generators in astronomy, and they are opening a new research frontier, that touches essentially every field of astronomy. Opening of the time domain to a systematic exploration will strengthen our understanding of a number of interesting known phenomena, and may lead to the discoveries of as yet unknown ones. We describe some lessons learned over the past decade, and offer some ideas that may guide strategic considerations in planning and execution of the future synoptic sky surveys.

Exploration of the time domain - variable and transient objects and phenomena - is rapidly becoming a vibrant research frontier, touching on essentially every field of astronomy and astrophysics, from the Solar system to cosmology. Time domain astronomy is being enabled by the advent of the new generation of synoptic sky surveys that cover large areas on the sky repeatedly, and generating massive data streams. Their scientific exploration poses many challenges, driven mainly by the need for a real-time discovery, classification, and follow-up of the interesting events. Here we describe the Catalina Real-Time Transient Survey (CRTS), that discovers and publishes transient events at optical wavelengths in real time, thus benefiting the entire community. We describe some of the scientific results to date, and then focus on the challenges of the automated classification and prioritization of transient events. CRTS represents a scientific and a technological testbed and precursor for the larger surveys in the future, including the Large Synoptic Survey Telescope (LSST) and the Square Kilometer Array (SKA).

We report the discovery of three new cases of QSOs acting as strong gravitational lenses on background emission line galaxies: SDSS J0827+5224 (zQSO = 0.293, zs = 0.412), SDSS J0919+2720 (zQSO = 0.209, zs = 0.558), SDSS J1005+4016 (zQSO = 0.230, zs = 0.441). The selection was carried out using a sample of 22,298 SDSS spectra displaying at least four emission lines at a redshift beyond that of the foreground QSO. The lensing nature is confirmed from Keck imaging and spectroscopy, as well as from HST/WFC3 imaging in the F475W and F814W filters. Two of the QSOs have face-on spiral host galaxies and the third is a QSO+galaxy pair. The velocity dispersion of the host galaxies, inferred from simple lens modeling, is between \sigma_v = 210 and 285 km/s, making these host galaxies comparable in mass with the SLACS sample of early-type strong lenses.

We describe the development of a system for an automated, iterative, real-time classification of transient events discovered in synoptic sky surveys. The system under development incorporates a number of Machine Learning techniques, mostly using Bayesian approaches, due to the sparse nature, heterogeneity, and variable incompleteness of the available data. The classifications are improved iteratively as the new measurements are obtained. One novel feature is the development of an automated follow-up recommendation engine, that suggest those measurements that would be the most advantageous in terms of resolving classification ambiguities and/or characterization of the astrophysically most interesting objects, given a set of available follow-up assets and their cost functions. This illustrates the symbiotic relationship of astronomy and applied computer science through the emerging discipline of AstroInformatics.

We present the results of a gravitational lensing analysis of the bright $\zs=2.957$ sub-millimeter galaxy (SMG), HERMES J105751.1+573027 found in {\it Herschel}/SPIRE Science Demonstration Phase data from the Herschel Multi-tiered Extragalactic Survey (HerMES) project. The high resolution imaging available in optical and Near-IR channels, along with CO emission obtained with the Plateau de Bure Interferometer, allow us to precisely estimate the intrinsic source extension and hence estimate the total lensing magnification to be $\mu=10.9\pm 0.7$. We measure the half-light radius $R_{\rm eff}$ of the source in the rest-frame Near-UV and $V$ bands that characterize the unobscured light coming from stars and find $R_{\rm eff,*}= [2.0 \pm 0.1]$ kpc, in good agreement with recent studies on the Submillimeter Galaxy population. This lens model is also used to estimate the size of the gas distribution ($R_{\rm eff,gas}= [1.1\pm0.5]$) kpc by mapping back in the source plane the CO (J=5-4) transition line emission. The lens modeling yields a relatively large Einstein radius $R_{\rm Ein}= 4\farcs10 \pm 0\farcs02$, corresponding to a deflector velocity dispersion of [$483\pm 16] \,\kms$. This shows that HERMES J105751.1+573027 is lensed by a {\it galaxy group-size} dark matter halo at redshift $\zl\sim 0.6$. The projected dark matter contribution largely dominates the mass budget within the Einstein radius with $f_{\rm dm}(<R_{\rm Ein})\sim 80%$. This fraction reduces to $f_{\rm dm}(<R_{\rm eff,G1}\simeq 4.5\kpc)\sim 47%$ within the effective radius of the main deflecting galaxy of stellar mass $M_{\rm *,G1}=[8.5\pm 1.6] \times 10^{11}\msun$. At this smaller scale the dark matter fraction is consistent with results already found for massive lensing ellipticals at $z\sim0.2$ from the SLACS survey.

We report the discovery of a bright ($f(250\mum) > 400$ mJy), multiply-lensed submillimeter galaxy \obj\ in {\it Herschel}/SPIRE Science Demonstration Phase data from the HerMES project. Interferometric 880\mum\ Submillimeter Array observations resolve at least four images with a large separation of $\sim 9\arcsec$. A high-resolution adaptive optics $K_p$ image with Keck/NIRC2 clearly shows strong lensing arcs. Follow-up spectroscopy gives a redshift of $z=2.9575$, and the lensing model gives a total magnification of $\mu \sim 11 \pm 1$. The large image separation allows us to study the multi-wavelength spectral energy distribution (SED) of the lensed source unobscured by the central lensing mass. The far-IR/millimeter-wave SED is well described by a modified blackbody fit with an unusually warm dust temperature, $88 \pm 3$ K. We derive a lensing-corrected total IR luminosity of $(1.43 \pm 0.09) \times 10^{13}\, \mathrm{L}_{\odot}$, implying a star formation rate of $\sim 2500\, \mathrm{M}_{\odot}\, \mathrm{yr}^{-1}$. However, models primarily developed from brighter galaxies selected at longer wavelengths are a poor fit to the full optical-to-millimeter SED. A number of other strongly lensed systems have already been discovered in early {\it Herschel} data, and many more are expected as additional data are collected.

We report on the discovery and observations of the extremely luminous optical transient CSS100217:102913+404220 (CSS100217 hereafter). Spectroscopic observations show this transient was coincident with a galaxy at redshift z=0.147, and reached an apparent magnitude of V ~ 16.3. After correcting for foreground Galactic extinction we determine the absolute magnitude to be M_V =-22.7 approximately 45 days after maximum light. Based on our unfiltered optical photometry the peak optical emission was L = 1.3 x 10^45 erg s^-1, and over a period of 287 rest-frame days had an integrated bolometric luminosity of 1.2 x 10^52 erg. Analysis of the pre-outburst SDSS spectrum of the source shows features consistent with a Narrow-line Seyfert1 (NLS1) galaxy. High-resolution HST and Keck followup observations show the event occurred within 150pc of nucleus of the galaxy, suggesting a possible link to the active nuclear region. However, the rapid outburst along with photometric and spectroscopic evolution are much more consistent with a luminous supernova. Line diagnostics suggest that the host galaxy is undergoing significant star formation. We use extensive follow-up of the event along with archival CSS and SDSS data to investigate the three most likely sources of such an event; 1) an extremely luminous supernova; 2) the tidal disruption of a star by the massive nuclear black hole; 3) variability of the central AGN. We find that CSS100217 was likely an extremely luminous type IIn supernova that occurred within range of the narrow-line region of an AGN. We discuss how similar events may have been missed in past supernova surveys because of confusion with AGN activity.

Catalina Real-Time Transient Survey (CRTS) is a synoptic sky survey uses data streams from 3 wide-field telescopes in Arizona and Australia, covering the total area of ~30,000 deg2, down to the limiting magnitudes ~ 20 - 21 mag per exposure, with time baselines from 10 min to 6 years (and growing); there are now typically ~ 200 - 300 exposures per pointing, and coadded images reach deeper than 23 mag. The basic goal of CRTS is a systematic exploration and characterization of the faint, variable sky. The survey has detected ~ 3,000 high-amplitude transients to date, including ~ 1,000 supernovae, hundreds of CVs (the majority of them previously uncatalogued), and hundreds of blazars / OVV AGN, highly variable and flare stars, etc. CRTS has a complete open data philosophy: all transients are published immediately electronically, with no proprietary period at all, and all of the data (images, light curves) will be publicly available in the near future, thus benefiting the entire astronomical community. CRTS is a scientific and technological testbed and precursor for the grander synoptic sky surveys to come.

Nowadays, many scientific areas share the same need of being able to deal with massive and distributed datasets and to perform on them complex knowledge extraction tasks. This simple consideration is behind the international efforts to build virtual organizations such as, for instance, the Virtual Observatory (VObs). DAME (DAta Mining & Exploration) is an innovative, general purpose, Web-based, VObs compliant, distributed data mining infrastructure specialized in Massive Data Sets exploration with machine learning methods. Initially fine tuned to deal with astronomical data only, DAME has evolved in a general purpose platform which has found applications also in other domains of human endeavor. We present the products and a short outline of a science case, together with a detailed description of main features available in the beta release of the web application now released.

We report results from the Supernova Photometric Classification Challenge (SNPCC), a publicly released mix of simulated supernovae (SNe), with types (Ia, Ibc, and II) selected in proportion to their expected rate. The simulation was realized in the griz filters of the Dark Energy Survey (DES) with realistic observing conditions (sky noise, point-spread function and atmospheric transparency) based on years of recorded conditions at the DES site. Simulations of non-Ia type SNe are based on spectroscopically confirmed light curves that include unpublished non-Ia samples donated from the Carnegie Supernova Project (CSP), the Supernova Legacy Survey (SNLS), and the Sloan Digital Sky Survey-II (SDSS-II). A spectroscopically confirmed subset was provided for training. We challenged scientists to run their classification algorithms and report a type and photo-z for each SN. Participants from 10 groups contributed 13 entries for the sample that included a host-galaxy photo-z for each SN, and 9 entries for the sample that had no redshift information. Several different classification strategies resulted in similar performance, and for all entries the performance was significantly better for the training subset than for the unconfirmed sample. For the spectroscopically unconfirmed subset, the entry with the highest average figure of merit for classifying SNe~Ia has an efficiency of 0.96 and an SN~Ia purity of 0.79. As a public resource for the future development of photometric SN classification and photo-z estimators, we have released updated simulations with improvements based on our experience from the SNPCC, added samples corresponding to the Large Synoptic Survey Telescope (LSST) and the SDSS, and provided the answer keys so that developers can evaluate their own analysis.

Although white dwarfs are believed to be the end point of most stellar evolution, unlike main sequence stars, they have not yet been the subject of dedicated time-domain surveys for exoplanets. We discuss how their size and distinctive colour make them excellent targets for wide-field searches for exoplanets. In particular, we note that planets of Earth-size can give rise to multi-magnitude eclipses of massive white dwarfs. Such a large signal is almost unmistakable and would be detectable even with very low-precision photometry. For objects of smaller size, the high accuracy photometry currently being used to detect Super-Earth and smaller planets transiting Sun-sized stars, is capable of revealing minor planets down to R~100km as they transit white dwarfs. Such observations can be used to test current evidence for asteroid-size objects being the cause for dust rings which have recently been observed for a number of white dwarfs. No other current exoplanet search method is capable of detecting such exo-asteroids. As an initial test of this search strategy, we combine synoptic data from the Catalina Sky Survey with multi-colour photometry and spectra from the Sloan Digital Sky Survey to search ~12,000 white dwarf lightcurves for eclipsing events. We find 20 new eclipsing white dwarf binary systems with low-mass companions. This doubles the number of known eclipsing white dwarfs and is expected to enable the determination of accurate white dwarf radii. Three of the discoveries have radii consistent with substellar systems and show no evidence of flux from the eclipsing object in their SDSS optical spectra, or near-IR data.

We present the first case of strong gravitational lensing by a QSO : SDSS J0013+1523, at z = 0.120. The discovery is the result of a systematic search for emission lines redshifted behind QSOs, among 22298 spectra of the SDSS data release 7. Apart from the z = 0.120 spectral features of the foreground QSO, the spectrum of SDSS J0013+1523 also displays the OII and Hbeta emission lines and the OIII doublet, all at the same redshift, z = 0.640. Using sharp Keck adaptive optics K-band images obtained using laser guide stars, we unveil two objects within a radius of 2 arcsec from the QSO. Deep Keck optical spectroscopy clearly confirms one of these objects at z = 0.640 and shows traces of the OIII, emission line of the second object, also at z = 0.640. Lens modeling suggests that they represent two images of the same z = 0.640 emission-line galaxy. Our Keck spectra also allow us to measure the redshift of an intervening galaxy at z = 0.394, located 3.2 arcsec away from the line of sight to the QSO. If the z = 0.120 QSO host galaxy is modeled as a singular isothermal sphere, its mass within the Einstein radius is M_E(r < 1 kpc) = 2.16e10 M_Sun and its velocity dispersion is sigma_SIS = 169 km/s. This is about 1 sigma away from the velocity dispersion estimated from the width of the QSO Hbeta emission line, sigma_*(M_BH) = 124 +/- 47 km/s. Deep optical HST imaging will be necessary to constrain the total radial mass profile of the QSO host galaxy using the detailed shape of the lensed source. This first case of a QSO acting as a strong lens on a more distant object opens new directions in the study of QSO host galaxies.

We have conducted a spectroscopic survey to find faint quasars (-26.0 < M_{1450} < -22.0) at redshifts z=3.8-5.2 in order to measure the faint end of the quasar luminosity function at these early times. Using available optical imaging data from portions of the NOAO Deep Wide-Field Survey and the Deep Lens Survey, we have color-selected quasar candidates in a total area of 3.76 deg^2. Thirty candidates have R <= 23 mags. We conducted spectroscopic followup for 28 of our candidates and found 23 QSOs, 21 of which are reported here for the first time, in the 3.74 < z <5.06 redshift range. We estimate our survey completeness through detailed Monte Carlo simulations and derive the first measurement of the density of quasars in this magnitude and redshift interval. We find that the binned luminosity function is somewhat affected by the K-correction used to compute the rest-frame absolute magnitude at 1450A. Considering only our R <= 23 sample, the best-fit single power-law (Phi \propto L^beta) gives a faint-end slope beta = -1.6+/-0.2. If we consider our larger, but highly incomplete sample going one magnitude fainter, we measure a steeper faint-end slope -2 < beta < -2.5. In all cases, we consistently find faint-end slopes that are steeper than expected based on measurements at z ~ 3. We combine our sample with bright quasars from the Sloan Digital Sky Survey to derive parameters for a double-power-law luminosity function. Our best fit finds a bright-end slope, alpha = -2.4+/-0.2, and faint-end slope, beta = -2.3+/-0.2, without a well-constrained break luminosity. This is effectively a single power-law, with beta = -2.7+/-0.1. We use these results to place limits on the amount of ultraviolet radiation produced by quasars and find that quasars are able to ionize the intergalactic medium at these redshifts.

A survey that can cover the sky in optical bands over wide fields to faint magnitudes with a fast cadence will enable many of the exciting science opportunities of the next decade. The Large Synoptic Survey Telescope (LSST) will have an effective aperture of 6.7 meters and an imaging camera with field of view of 9.6 deg^2, and will be devoted to a ten-year imaging survey over 20,000 deg^2 south of +15 deg. Each pointing will be imaged 2000 times with fifteen second exposures in six broad bands from 0.35 to 1.1 microns, to a total point-source depth of r~27.5. The LSST Science Book describes the basic parameters of the LSST hardware, software, and observing plans. The book discusses educational and outreach opportunities, then goes on to describe a broad range of science that LSST will revolutionize: mapping the inner and outer Solar System, stellar populations in the Milky Way and nearby galaxies, the structure of the Milky Way disk and halo and other objects in the Local Volume, transient and variable objects both at low and high redshift, and the properties of normal and active galaxies at low and high redshift. It then turns to far-field cosmological topics, exploring properties of supernovae to z~1, strong and weak lensing, the large-scale distribution of galaxies and baryon oscillations, and how these different probes may be combined to constrain cosmological models and the physics of dark energy.

We report on the discovery and initial observations of the energetic type IIn supernova (SN), 2008fz. The optical energy emitted by SN 2008fz (based on the light curve over a 88 day period), is possibly the most ever observed for a supernova (1.4 x 10^51 erg). The event was more luminous than the type IIn SN 2006gy, but exhibited same smooth, slowly evolving light curve. As is characteristic of type IIn SN, the early spectra of 2008fz initially exhibited narrow Balmer lines which were replaced by a broader component at later times. The spectra also show a blue continuum with no signs of Ca or Na absorption, suggesting that there is little extinction due to intragalatic dust in the host or circumstellar material. No host galaxy is identified in prior coadded images reaching R ~ 22. From the supernova's redshift, z=0.133, we place an upper limit on the host of M_R=-17. The presence of the SN within such a faint host follows the majority of recently discovered highly luminous SN. A possible reason for this occurrence is the very high star formation rate occurring in low-mass galaxies in combination with the low metallicity environment, which makes the production of very massive stars possible. We determine the peak absolute magnitude of the event to be M_V = -22.3 from the initial photometry and the redshift distance, placing it among the most luminous supernovae discovered.

We identify 3,113 highly variable objects in 7,200 square degrees of the Palomar-QUEST Survey, which each varied by more than 0.4 magnitudes simultaneously in two broadband optical filters on timescales from hours to roughly 3.5 years. The primary goal of the selection is to find blazars by their well-known violent optical variability. Because most known blazars have been found in radio and/or X-ray wavelengths, a sample discovered through optical variability may have very different selection effects, elucidating the range of behavior possible in these systems. A set of blazars selected in this unusual manner will improve our understanding of the physics behind this extremely variable and diverse class of AGN. The object positions, variability statistics, and color information are available using the Palomar-QUEST CasJobs server. The time domain is just beginning to be explored over large sky areas; we do not know exactly what a violently variable sample will hold. About 20% of the sample has been classified in the literature; over 70% of those objects are known or likely AGN. The remainder largely consists of a variety of variable stars, including a number of RR Lyrae and cataclysmic variables.

The clustering of quasars on small scales yields fundamental constraints on models of quasar evolution and the buildup of supermassive black holes. This paper describes the first systematic survey to discover high redshift binary quasars. Using color-selection and photometric redshift techniques, we searched 8142 deg^2 of SDSS imaging data for binary quasar candidates, and confirmed them with follow-up spectroscopy. Our sample of 27 high redshift binaries (24 of them new discoveries) at redshifts 2.9 < z < 4.3 with proper transverse separations 10 kpc < R_{\perp} < 650 kpc increases the number of such objects known by an order of magnitude. Eight members of this sample are very close pairs with R_{\perp} < 100 kpc, and of these close systems four are at z > 3.5. The completeness and efficiency of our well-defined selection algorithm are quantified using simulated photometry and we find that our sample is ~ 50% complete. Our companion paper uses this knowledge to make the first measurement of the small scale clustering (R < 1 Mpc/h comoving) of high-redshift quasars. High redshift binaries constitute exponentially rare coincidences of two extreme (M >~ 10^9 Msun) supermassive black holes. At z ~ 4 there is about one close binary per 10 Gpc^3, thus these could be the highest sigma peaks, the analogs of superclusters, in the early Universe.

We present measurements of the small-scale (0.1<~ r <~ 1 Mpc/h) quasar two-point correlation function at z>2.9, for a flux-limited (i<21) sample of 15 binary quasars compiled by Hennawi et al. (2009). The amplitude of the small-scale clustering increases from z ~ 3 to z ~ 4. The small-scale clustering amplitude is comparable to or lower than power-law extrapolations (with slope gamma=2) from the large-scale correlation function of the i<20.2 quasar sample from the Sloan Digital Sky Survey. Using simple prescriptions relating quasars to dark matter halos, we model the observed small-scale clustering with halo occupation models. Reproducing the large-scale clustering amplitude requires that the active fraction of the black holes in the central galaxies of halos is near unity, but the level of small-scale clustering favors an active fraction of black holes in satellite galaxies 0.1 <~ f_s <~ 0.5 at z >~ 3.

Skyalert.org is a web application to collect and disseminate observations about time-critical astronomical transients, and to add annotations and intelligent machine-learning to those observations. The information is "pushed" to subscribers, who may be either humans (email, text message etc) or they may be machines that control telescopes. Subscribers can prepare precise "trigger rules" to decide which events should reach them and their robots, rules that may be based on sky position, or on the specific vocabulary of parameters that define a particular type of observation. Our twin thrusts are automation of process, and discrimination of interesting events.

We present a sample of $i_{775}$-dropout candidates identified in five Hubble Advanced Camera for Surveys fields centered on Sloan Digital Sky Survey QSOs at redshift $z\sim 6$. Our fields are as deep as the Great Observatory Origins Deep Survey (GOODS) ACS images which are used as a reference field sample. We find them to be overdense in two fields, underdense in two fields, and as dense as the average density of GOODS in one field. The two excess fields show significantly different color distributions from that of GOODS at the 99% confidence level, strengthening the idea that the excess objects are indeed associated with the QSO. The distribution of $i_{775}$-dropout counts in the five fields is broader than that derived from GOODS at the 80% to 96% confidence level, depending on which selection criteria were adopted to identify $i_{775}$-dropouts; its width cannot be explained by cosmic variance alone. Thus, QSOs seem to affect their environments in complex ways. We suggest the picture where the highest redshift QSOs are located in very massive overdensities and are therefore surrounded by an overdensity of lower mass halos. Radiative feedback by the QSO can in some cases prevent halos from becoming galaxies, thereby generating in extreme cases an underdensity of galaxies. The presence of both enhancement and suppression is compatible with the expected differences between lines of sight at the end of reionization as the presence of residual diffuse neutral hydrogen would provide young galaxies with shielding from the radiative effects of the QSO.

Digital synoptic sky surveys pose several new object classification challenges. In surveys where real-time detection and classification of transient events is a science driver, there is a need for an effective elimination of instrument-related artifacts which can masquerade as transient sources in the detection pipeline, e.g., unremoved large cosmic rays, saturation trails, reflections, crosstalk artifacts, etc. We have implemented such an Artifact Filter, using a supervised neural network, for the real-time processing pipeline in the Palomar-Quest (PQ) survey. After the training phase, for each object it takes as input a set of measured morphological parameters and returns the probability of it being a real object. Despite the relatively low number of training cases for many kinds of artifacts, the overall artifact classification rate is around 90%, with no genuine transients misclassified during our real-time scans. Another question is how to assign an optimal star-galaxy classification in a multi-pass survey, where seeing and other conditions change between different epochs, potentially producing inconsistent classifications for the same object. We have implemented a star/galaxy multipass classifier that makes use of external and a priori knowledge to find the optimal classification from the individually derived ones. Both these techniques can be applied to other, similar surveys and data sets.

Exploration of time domain is now a vibrant area of research in astronomy, driven by the advent of digital synoptic sky surveys. While panoramic surveys can detect variable or transient events, typically some follow-up observations are needed; for short-lived phenomena, a rapid response is essential. Ability to automatically classify and prioritize transient events for follow-up studies becomes critical as the data rates increase. We have been developing such methods using the data streams from the Palomar-Quest survey, the Catalina Sky Survey and others, using the VOEventNet framework. The goal is to automatically classify transient events, using the new measurements, combined with archival data (previous and multi-wavelength measurements), and contextual information (e.g., Galactic or ecliptic latitude, presence of a possible host galaxy nearby, etc.); and to iterate them dynamically as the follow-up data come in (e.g., light curves or colors). We have been investigating Bayesian methodologies for classification, as well as discriminated follow-up to optimize the use of available resources, including Naive Bayesian approach, and the non-parametric Gaussian process regression. We will also be deploying variants of the traditional machine learning techniques such as Neural Nets and Support Vector Machines on datasets of reliably classified transients as they build up.

We report on the results from the first six months of the Catalina Real-time Transient Survey (CRTS). In order to search for optical transients with timescales of minutes to years, the CRTS analyses data from the Catalina Sky Survey which repeatedly covers twenty six thousand of square degrees on the sky. The CRTS provides a public stream of transients that are bright enough to be followed up using small telescopes. Since the beginning of the survey, all CRTS transients have been made available to astronomers around the world in real-time using HTML tables, RSS feeds and VOEvents. As part of our public outreach program the detections are now also available in KML through Google Sky. The initial discoveries include over 350 unique optical transients rising more than two magnitudes from past measurements. Sixty two of these are classified as supernovae, based on light curves, prior deep imaging and spectroscopic data. Seventy seven are due to cataclysmic variables (only 13 previously known), while an additional 100 transients were too infrequently sampled to distinguish between faint CVs and SNe. The remaining optical transients include AGN, Blazars, high proper motions stars, highly variable stars (such as UV Ceti stars) and transients of an unknown nature. Our results suggest that there is a large population of SNe missed by many current supernova surveys because of selection biases. These objects appear to be associated with faint host galaxies. We also discuss the unexpected discovery of white dwarf binary systems through dramatic eclipses.

We conducted an exploratory search for quasars at z~ 6 - 8, using the Early Data Release from United Kingdom Infrared Deep Sky survey (UKIDSS) cross-matched to panoramic optical imagery. High redshift quasar candidates are chosen using multi-color selection in i,z,Y,J,H and K bands. After removal of apparent instrumental artifacts, our candidate list consisted of 34 objects. We further refined this list with deeper imaging in the optical for ten of our candidates. Twenty-five candidates were followed up spectroscopically in the near-infrared and in the optical. We confirmed twenty-five of our spectra as very low-mass main-sequence stars or brown dwarfs, which were indeed expected as the main contaminants of this exploratory search. The lack of quasar detection is not surprising: the estimated probability of finding a single z>6 quasar down to the limit of UKIDSS in the 27.3 square degrees of the EDR is <5%. We find that the most important limiting factor in this work is the depth of the available optical data. Experience gained in this pilot project can help refine high-redshift quasar selection criteria for subsequent UKIDSS data releases.

There is an increasing number of large, digital, synoptic sky surveys, in which repeated observations are obtained over large areas of the sky in multiple epochs. Likewise, there is a growth in the number of (often automated or robotic) follow-up facilities with varied capabilities in terms of instruments, depth, cadence, wavelengths, etc., most of which are geared toward some specific astrophysical phenomenon. As the number of detected transient events grows, an automated, probabilistic classification of the detected variables and transients becomes increasingly important, so that an optimal use can be made of follow-up facilities, without unnecessary duplication of effort. We describe a methodology now under development for a prototype event classification system; it involves Bayesian and Machine Learning classifiers, automated incorporation of feedback from follow-up observations, and discriminated or directed follow-up requests. This type of methodology may be essential for the massive synoptic sky surveys in the future.

We describe briefly the Palomar-Quest (PQ) digital synoptic sky survey, including its parameters, data processing, status, and plans. Exploration of the time domain is now the central scientific and technological focus of the survey. To this end, we have developed a real-time pipeline for detection of transient sources. We describe some of the early results, and lessons learned which may be useful for other, similar projects, and time-domain astronomy in general. Finally, we discuss some issues and challenges posed by the real-time analysis and scientific exploitation of massive data streams from modern synoptic sky surveys.

We report the discovery of two low-luminosity quasars at z~4, both of which show prominent N IV] 1486A emission. This line is extremely rare in quasar spectra at any redshift; detecting it in two out of a sample of 23 objects (i.e., ~ 9% of the sample) is intriguing and is likely due to the low-luminosity, high-redshift quasar sample we are studying. This is still a poorly explored regime, where contributions from associated, early starbursts may be significant. One interpretation of this line posits photoionization by very massive young stars. Seeing N IV] 1486A emission in a high-redshift quasar may thus be understood in the context of co-formation and early co-evolution of galaxies and their supermassive black holes. Alternatively, we may be seeing a phenomenon related to the early evolution of quasar broad emission line regions. The non-detection (and possibly even broad absorption) of N V 1240A line in the spectrum of one of these quasars may support that interpretation. These two objects may signal a new faint quasar population or an early AGN evolutionary stage at high redshifts.

We report the discovery of the first known probable case of a physical triple quasar (not a gravitational lens). A previously known double system, QQ 1429-008 at z = 2.076, is shown to contain a third, fainter QSO component at the same redshift within the measurement errors. Deep optical and IR imaging at the Keck and VLT telescopes has failed to reveal a plausible lensing galaxy group or a cluster, and moreover, we are unable to construct any viable lensing model which could lead to the observed distribution of source positions and relative intensities of the three QSO image components. Furthermore, there are hints of differences in broad-band spectral energy distributions of different components, which are more naturally understood if they are physically distinct AGN. Therefore, we conclude that this system is most likely a physical triple quasar, the first such close QSO grouping known at any redshift. The projected component separations in the restframe are ~ 30 - 50 kpc for the standard concordance cosmology, typical of interacting galaxy systems. The existence of this highly unusual system supports the standard picture in which galaxy interactions lead to the onset of QSO activity.

In astronomy multiple images are frequently obtained at the same position of the sky for follow-up co-addition as it helps one go deeper and look for fainter objects. With large scale panchromatic synoptic surveys becoming more common, image co-addition has become even more necessary as new observations start to get compared with co-added fiducial sky in real time. The standard co-addition techniques have included straight averages, variance weighted averages, medians etc. A more sophisticated nonlinear response chi-square method is also used when it is known that the data are background noise limited and the point spread function is homogenized in all channels. A more robust object detection technique capable of detecting faint sources, even those not seen at all epochs which will normally be smoothed out in traditional methods, is described. The analysis at each pixel level is based on a formula similar to Mahalanobis distance. The method does not depend on the point spread function.

We review some of the recent developments and challenges posed by the data analysis in modern digital sky surveys, which are representative of the information-rich astronomy in the context of Virtual Observatory. Illustrative examples include the problems of an automated star-galaxy classification in complex and heterogeneous panoramic imaging data sets, and an automated, iterative, dynamical classification of transient events detected in synoptic sky surveys. These problems offer good opportunities for productive collaborations between astronomers and applied computer scientists and statisticians, and are representative of the kind of challenges now present in all data-intensive fields. We discuss briefly some emergent types of scalable scientific data analysis systems with a broad applicability.

We present a comparison of optical and X-ray properties of galaxy clusters in the northern sky. We determine the recovery rate of X-ray detected clusters in the optical as a function of richness, redshift and X-ray luminosity, showing that the missed clusters are typically low contrast systems when observed optically. We employ four different statistical tests to test for the presence of substructure using optical two-dimensional data, finding that approximately 35% of the clusters show strong signs of substructure. However, the results are test-dependent, with variations also due to the magnitude range and radius utilized.We have also performed a comparison of X-ray luminosity and temperature with optical galaxy counts (richness). We find that the slope and scatter of the relations between richness and the X-ray properties are heavily dependent on the density contrast of the clusters. The selection of substructure-free systems does not improve the correlation between X-ray luminosity and richness, but this comparison also shows much larger scatter than one obtained using the X-ray temperature. In the latter case, the sample is significantly reduced because temperature measurements are available only for the most massive (and thus high contrast) systems. However, the comparison between temperature and richness is very sensitive to the exclusion of clusters showing signs of substructure. The correlation of X-ray luminosity and richness is based on the largest sample to date ($\sim$ 750 clusters), while tests involving temperature use a similar number of objects as previous works ($\lsim$100). The results presented here are in good agreement with existing literature.

We present observations of an optically-faint quasar, RD J114816.2+525339, discovered from deep multi-color observations of the field around the z = 6.42 quasar SDSS J1148+5251. The two quasars have a projected separation of 109 arcsec and both are outliers in r-z versus z-J color-color space. Keck spectroscopy reveals RD J114816.2+525339 to be a broad-absorption line quasar at z = 5.70. With z_AB = 23.0, RD J114816.2+525339 is 3.3 mag fainter than SDSS J1148+5251, making it the faintest quasar known at z>5.5. This object was identified in a survey of ~2.5 square degrees. The implied surface density of quasars at these redshifts and luminosities is broadly consistent with previous extrapolations of the faint end of the quasar luminosity function and supports the idea that active galaxies provide only a minor component of the reionizing ultraviolet flux at these redshifts.

Observations of QSOs at z ~ 5.7 - 6.4 show the appearance of Gunn-Peterson troughs around z ~ 6, and a change in the slope of the IGM optical depth tau(z) near z ~ 5.5. These results are interpreted as a signature of the end of the reionization era, which probably started at considerably higher redshifts. However, there also appears to be a substantial cosmic variance in the transmission of the IGM, both along some lines of sight, and among different lines of sight, in this intriguing redshift regime. We suggest that this is indicative of a spatially uneven reionization, possibly caused by the bias-driven primordial clustering of the reionization sources. There is also some independent evidence for a strong clustering of QSOs at z ~ 4 - 5 and galaxies around them, supporting the idea of the strong biasing of the first luminous sources at these redshifts. Larger samples of high-z QSOs are needed in order to provide improved, statistically significant constraints for the models of these phenomena. We expect that the Palomar-Quest (PQ) survey will soon provide a new set of QSOs to be used as cosmological probes in this redshift regime.

We present tentative evidence for primordial clustering, manifested as an excess of color-selected objects in the field of the QSO SDSS J1030+0524 at redshift z=6.28. We have selected objects red in i_{775}-z_{850} on the basis of Hubble Space Telescope Advanced Camera for Surveys imaging of a field centered on the QSO. Compared to data at comparable depth obtained by the GOODS survey, we find an excess of objects with (i_{775}-z_{850}) \geq 1.5 in the QSO field. The significance of the detection is estimated to be ~97% on the basis of the counts alone and increases to 99.4% if one takes into account the color distribution. If confirmed this would represent the highest redshift example of galaxy clustering and would have implications on models for the growth of structure. Bias-driven clustering of first luminous objects forming in the highest peaks of the primordial density field is expected in most models of early structure formation. The redshift of one of the candidates has been found to be z=5.970 by our spectroscopy with Keck I/LRIS, confirming the validity of our color selection.

One of the new frontiers of astronomical research is the exploration of time variability on the sky at different wavelengths and flux levels. We have carried out a pilot project using DPOSS data to study strong variables and transients, and are now extending it to the new Palomar-QUEST synoptic sky survey. We report on our early findings and outline the methodology to be implemented in preparation for a real-time transient detection pipeline. In addition to large numbers of known types of highly variable sources (e.g., SNe, CVs, OVV QSOs, etc.), we expect to find numerous transients whose nature may be established by a rapid follow-up. Whereas we will make all detected variables publicly available through the web, we anticipate that email alerts would be issued in the real time for a subset of events deemed to be the most interesting. This real-time process entails many challenges, in an effort to maintain a high completeness while keeping the contamination low. We will utilize distributed Grid services developed by the GRIST project, and implement a variety of advanced statistical and machine learning techniques.

The Grist project (http://grist.caltech.edu/) is developing a grid-technology based system as a research environment for astronomy with massive and complex datasets. This knowledge extraction system will consist of a library of distributed grid services controlled by a workflow system, compliant with standards emerging from the grid computing, web services, and virtual observatory communities. This new technology is being used to find high redshift quasars, study peculiar variable objects, search for transients in real time, and fit SDSS QSO spectra to measure black hole masses. Grist services are also a component of the ``hyperatlas'' project to serve high-resolution multi-wavelength imagery over the Internet. In support of these science and outreach objectives, the Grist framework will provide the enabling fabric to tie together distributed grid services in the areas of data access, federation, mining, subsetting, source extraction, image mosaicking, statistics, and visualization.

Exploration of the time variability on the sky over a broad range of flux levels and wavelengths is rapidly becoming a new frontier of astronomical research. We describe here briefly the Palomar-QUEST survey being carried out from the Samuel Oschin 48-inch Schmidt telescope at Palomar. The following features make the survey an attractive candidate for studying time variability: anticipated survey area of 12,000 - 15,000 sq. degrees in the drift scan mode, point source depth of 21st mag. in I under good conditions, near simultaneous observations in four filters, and at least four passes per year at each location covered. The survey will yield a large number of transients and highly variable sources in the near future and in that sense is a prototype of LSST and Pan-STARRS. We briefly outline our strategy for searching such objects and the proposed pipeline for detecting transients in real-time.

We present an optically selected galaxy cluster catalog from ~ 2,700 square degrees of the Digitized Second Palomar Observatory Sky Survey (DPOSS), spanning the redshift range 0.1 < z < 0.5, providing an intermediate redshift supplement to the previous DPOSS cluster survey. This new catalog contains 9,956 cluster candidates and is the largest resource of rich clusters in this redshift range to date. The candidates are detected using the best DPOSS plates based on seeing and limiting magnitude. The search is further restricted to high galactic latitude (|b| > 50), where stellar contamination is modest and nearly uniform. We also present a performance comparison of two different detection methods applied to this data, the Adaptive Kernel and Voronoi Tessellation techniques. In the regime where both catalogs are expected to be complete, we find excellent agreement, as well as with the most recent surveys in the literature. Extensive simulations are performed and applied to the two different methods, indicating a contamination rate of ~ 5%. These simulations are also used to optimize the algorithms and evaluate the selection function for the final cluster catalog. Redshift and richness estimates are also provided, making possible the selection of subsamples for future studies.

The advent of wide-area multicolour synoptic sky surveys is leading to data sets unprecedented in size, complexity and data throughput. VO technology offers a way to exploit these to the full but requires changes in design philosophy. The Palomar-QUEST survey is a major new survey being undertaken by Caltech, Yale, JPL and Indiana University to repeatedly observe 1/3 of the sky (~15000 sq. deg. between -27 < Dec <27 in seven passbands. Utilising the 48-inch Oschin Schmidt Telescope at the Palomar Observatory with the 112-CCD QUEST camera covering the full 4 x 4 sq. deg. field of view, it will generate \~1TB of data per month. In this paper, we review the design of QUEST as a VO resource, a federated data set and an exemplar of VO standards.

We report a discovery of a quasar at z = 4.96 +- 0.03 within a few Mpc of the quasar SDSS 0338+0021 at z = 5.02 +- 0.02. The newly found quasar has the SDSS i and z magnitudes of ~ 21.2, and an estimated absolute magnitude M_B ~ -25.2. The projected separation on the sky is 196 arcsec, and the redshift difference Delta z = 0.063 +- 0.008. The probability of finding this quasar pair by chance in the absence of clustering in this particular volume is ~ 10^-4 to 10^-3. We conclude that the two objects probably mark a large-scale structure, possibly a protocluster, at z ~ 5. This is the most distant such structure currently known. Our search in the field of 13 other QSOs at z >~ 4.8 so far has not resulted in any detections of comparable luminous QSO pairs, and it is thus not yet clear how representative is this structure at z ~ 5. However, along with the other evidence for clustering of quasars and young galaxies at somewhat lower redshifts, the observations are at least qualitatively consistent with a strong biasing of the first luminous and massive objects, in agreement with general predictions of theoretical models. More extensive searches for clustered quasars and luminous galaxies at these redshifts will provide valuable empirical constraints for our understanding of early galaxy and structure formation.

With the recent release of large (i.e., > hundred million objects), well-calibrated photometric surveys, such as DPOSS, 2MASS, and SDSS, spectroscopic identification of important targets is no longer a simple issue. In order to enhance the returns from a spectroscopic survey, candidate sources are often preferentially selected to be of interest, such as brown dwarfs or high redshift quasars. This approach, while useful for targeted projects, risks missing new or unusual species. We have, as a result, taken the alternative path of spectroscopically identifying interesting sources with the sole criterion being that they are in low density areas of the g - r and r - i color-space defined by the DPOSS survey. In this paper, we present three peculiar broad absorption line quasars that were discovered during this spectroscopic survey, demonstrating the efficacy of this approach. PSS J0052+2405 is an Iron LoBAL quasar at a redshift z = 2.4512 with very broad absorption from many species. PSS J0141+3334 is a reddened LoBAL quasar at z = 3.005 with no obvious emission lines. PSS J1537+1227 is a Iron LoBAL at a redshift of z = 1.212 with strong narrow Mgii and Feii emission. Follow-up high resolution spectroscopy of these three quasars promises to improve our understanding of BAL quasars. The sensitivity of particular parameter spaces, in this case a two-color space, to the redshift of these three sources is dramatic, raising questions about traditional techniques of defining quasar populations for statistical analysis.

Images of the CO 2-1 line emission, and the radio continuum emission, from the redshift 4.12 gravitationally lensed quasi-stellar object (QSO) PSS J2322+1944 reveal an Einstein ring with a diameter of 1.5". These observations are modeled as a star forming disk surrounding the QSO nucleus with a radius of 2 kpc. The implied massive star formation rate is 900 M_sun/year. At this rate a substantial fraction of the stars in a large elliptical galaxy could form on a dynamical time scale of 10^8 years. The observation of active star formation in the host galaxy of a high-redshift QSO supports the hypothesis of coeval formation of supermassive black holes and stars in spheroidal galaxies.

We have identified eighty-four small, high density groups of galaxies out to z ~ 0.2 in a region of ~ 2000 square degrees around the north galactic pole using DPOSS (the Digitized Second Palomar Observatory Sky Survey). The groups have at least four galaxies satisfying more stringent criteria than those used by Hickson in his pioneering work in 1982: the adopted limiting surface brightness for each group is brighter (24 mag/arcsec^2 instead of 26 mag/arcsec^2), and the spread in magnitude among the member galaxies is narrower (two magnitudes instead of three). We also adopt a slightly modified version of the isolation criterion used by Hickson, in order to avoid rejecting groups with projected nearby faint background galaxies. A 10% contamination rate due to projection effects is expected for this sample based on extensive simulations.

The challenge in searching for non-radio-pulsing isolated neutron stars (INSs) is in excluding association with objects in the very large error boxes (~13", 1 sigma radius) typical of sources from the largest X-ray all-sky survey, the ROSAT All-Sky-Survey/Bright Source Catalog (RASS/BSC). We search for candidate INSs using statistical analysis of optical (USNO-A2), infrared (IRAS), and radio (NVSS) sources near the ROSAT X-ray localization, and show that this selection would find 20% of the INSs in the RASS/BSC. This selection finds 32 candidates at declinations greater than -39 deg, among which are two previously known INSs, seventeen sources which we show are not INSs, and thirteen the classification of which are as yet undetermined. These results require a limit of <67 INSs (90% confidence, full sky, assuming isotropy) in the RASS/BSC. This limit modestly constrains a naive and optimistic model for cooling NSs in the galaxy.

Studies of the cosmic gamma-ray bursts (GRBs) and their host galaxies are starting to provide interesting or even unique new insights in observational cosmology. GRBs represent a new way of identifying a population of star-forming galaxies at cosmological redshifts. GRB hosts are broadly similar to the normal field galaxy populations at comparable redshifts and magnitudes, and indicate at most a mild luminosity evolution out to z ~ 1.5 - 2. GRB optical afterglows seen in absorption provide a powerful new probe of the ISM in dense, central regions of their host galaxies, complementary to the traditional studies using QSO absorbers. Some GRB hosts are heavily obscured, and provide a new way to select a population of cosmological sub-mm sources, and a novel constraint on the total obscured fraction of star formation over the history of the universe. Finally, detection of GRB afterglows at z > 6 may provide a unique way to probe the primordial star formation, massive IMF, early IGM, and chemical enrichment at the end of the cosmic reionization era.

Studies of the cosmic gamma-ray bursts (GRBs) and their host galaxies are now starting to provide interesting or even unique new insights in observational cosmology. Observed GRB host galaxies have a median magnitude R ~ 25 mag, and show a range of luminosities, morphologies, and star formation rates, with a median redshift z ~ 1. They represent a new way of identifying a population of star-forming galaxies at cosmological redshifts, which is mostly independent of the traditional selection methods. They seem to be broadly similar to the normal field galaxy populations at comparable redshifts and magnitudes, and indicate at most a mild luminosity evolution over the redshift range they probe. Studies of GRB optical afterglows seen in absorption provide a powerful new probe of the ISM in dense, central regions of their host galaxies, which is complementary to the traditional studies using QSO absorption line systems. Some GRB hosts are heavily obscured, and provide a new way to select a population of cosmological sub-mm sources. A census of detected optical tranistents may provide an important new way to constrain the total obscured fraction of star formation over the history of the universe. Finally, detection of GRB afterglows at high redshifts (z > 6) may provide a unique way to probe the primordial star formation, massive IMF, early IGM, and chemical enrichment at the end of the cosmic reionization era.

We present a new, objectively defined catalog of candidate galaxy clusters based on the galaxy catalogs from the Digitized Second Palomar Observatory Sky Survey (DPOSS). This cluster catalog, derived from the best calibrated plates in the high latitude (|b|>30) Northern Galactic Cap region, covers 5,800 square degrees, and contains 8,155 candidate clusters. A simple adaptive kernel density mapping technique, combined with the SExtractor object detection algorithm, is used to detect galaxy overdensities, which we identify as clusters. Simulations of the background galaxy distribution and clusters of varying richnesses and redshifts allow us to optimize detection parameters, and measure the completeness and contamination rates for our catalog. Cluster richnesses and photometric redshifts are measured, using integrated colors and magnitudes for each cluster. An extensive spectroscopic survey is used to confirm the photometric results. This catalog, with well-characterized sample properties, provides a sound basis for future studies of cluster physics and large scale structure.

A Topic Map is a structured network of hyperlinks that points into an information pool. Topic Maps have an existence independent of the information pool and hence different Topic Maps can form different layers above the same information pool and provide us with different views of it. We explore the use of Topic Maps with the Unified Column Descriptor (UCD) scheme developed in the frame of the ESO-CDS data mining project. UCD, with its multi-tier hierarchical structure, categorizes parameters reported in tables and catalogs. By using Topic Maps we show how columns from different catalogs with similar but not identical descriptions could be combined. A direct application for the Virtual Observatory community is that of merging catalogs in order to generate customized views of data.

We present the photometric calibration technique for the Digitized Second Palomar Observatory Sky Survey (DPOSS), used to create seamless catalogs of calibrated objects over large sky areas. After applying a correction for telescope vignetting, the extensive plate overlap regions are used to transform sets of plates onto a common instrumental photometric system. Photometric transformations to the Gunn gri system for each plate, for stars and galaxies, are derived using these contiguous stitched areas and an extensive CCD imaging library obtained for this purpose. We discuss the resulting photometric accuracy, survey depth, and possible systematic errors.

There has been an unprecedented and continuing growth in the volume, quality, and complexity of astronomical data sets over the past few years, mainly through large digital sky surveys. Virtual Observatory (VO) concept represents a scientific and technological framework needed to cope with this data flood. We review some of the applied statistics and computing challenges posed by the analysis of large and complex data sets expected in the VO-based research. The challenges are driven both by the size and the complexity of the data sets (billions of data vectors in parameter spaces of tens or hundreds of dimensions), by the heterogeneity of the data and measurement errors, the selection effects and censored data, and by the intrinsic clustering properties (functional form, topology) of the data distribution in the parameter space of observed attributes. Examples of scientific questions one may wish to address include: objective determination of the numbers of object classes present in the data, and the membership probabilities for each source; searches for unusual, rare, or even new types of objects and phenomena; discovery of physically interesting multivariate correlations which may be present in some of the clusters; etc.

We report the discovery of the optical and radio afterglow of GRB 010921, the first gamma-ray burst afterglow to be found from a localization by the High Energy Transient Explorer (HETE) satellite. We present optical spectroscopy of the host galaxy which we find to be a dusty and apparently normal star-forming galaxy at z = 0.451. The unusually steep optical spectral slope of the afterglow can be explained by heavy extinction, A_V > 0.5 mag, along the line of sight to the GRB. Dust with similar A_V for the the host galaxy as a whole appears to be required by the measurement of a Balmer decrement in the spectrum of the host galaxy. Thanks to the low redshift, continued observations of the afterglow will enable the strongest constraints, to date, on the existence of a possible underlying supernova.

Of all the well localized gamma-ray bursts, GRB 000911 has the longest duration (T_90 ~ 500 s), and ranks in the top 1% of BATSE bursts for fluence. Here, we report the discovery of the afterglow of this unique burst. In order to simultaneously fit our radio and optical observations, we are required to invoke a model involving an hard electron distribution, p ~ 1.5 and a jet-break time less than 1.5 day. A spectrum of the host galaxy taken 111 days after the burst reveals a single emission line, interpreted as [OII] at a redshift z = 1.0585, and a continuum break which we interpret as the Balmer limit at this redshift. Despite the long T_90, the afterglow of GRB 000911 is not unusual in any other way when compared to the set of afterglows studied to date. We conclude that the duration of the GRB plays little part in determining the physics of the afterglow.

One major component of the VO will be catalogs measuring gigabytes and terrabytes if not more. Some mechanism like XML will be used for structuring the information. However, such mechanisms are not good for information retrieval on their own. For retrieval we use queries. Topic Maps that have started becoming popular recently are excellent for segregating information that results from a query. A Topic Map is a structured network of hyperlinks above an information pool. Different Topic Maps can form different layers above the same information pool and provide us with different views of it. This facilitates in being able to ask exact questions, aiding us in looking for gold needles in the proverbial haystack. Here we discuss the specifics of what Topic Maps are and how they can be implemented within the VO framework. URL: http://www.astro.caltech.edu/~aam/science/topicmaps/

Discovery of the cosmic reionization epoch would represent a significant milestone in cosmology. We present Keck spectroscopy of the quasar SDSS 1044-0125, at z = 5.73. The spectrum shows a dramatic increase in the optical depth at observed wavelengths lambda >~7550 A, corresponding to z_abs >~ 5.2. Only a few small, narrow transmission regions are present in the spectrum beyond that point, and out to the redshifts where the quasar signal begins. We interpret this result as a signature of the trailing edge of the cosmic reionization epoch, which we estimate to occur around <z> ~ 6 (as indeed confirmed by subsequent observations by Becker et al.), and extending down to z \~ 5.2. This behavior is expected in the modern theoretical models of the reionization era, which predict a patchy and gradual onset of reionization. The remaining transmission windows we see may correspond to the individual reionization bubbles (Stromgren spheres) embedded in a still largely neutral intergalactic medium, intersected by the line of sight to the quasar. Future spectroscopic observations of quasars at comparable or larger redshifts will provide a more detailed insight into the structure and extent of the reionization era.

Like every other field of intellectual endeavor, astronomy is being revolutionised by the advances in information technology. There is an ongoing exponential growth in the volume, quality, and complexity of astronomical data sets, mainly through large digital sky surveys and archives. The Virtual Observatory (VO) concept represents a scientific and technological framework needed to cope with this data flood. Systematic exploration of the observable parameter spaces, covered by large digital sky surveys spanning a range of wavelengths, will be one of the primary modes of research with a VO. This is where the truly new discoveries will be made, and new insights be gained about the already known astronomical objects and phenomena. We review some of the methodological challenges posed by the analysis of large and complex data sets expected in the VO-based research. The challenges are driven both by the size and the complexity of the data sets (billions of data vectors in parameter spaces of tens or hundreds of dimensions), by the heterogeneity of the data and measurement errors, including differences in basic survey parameters for the federated data sets (e.g., in the positional accuracy and resolution, wavelength coverage, time baseline, etc.), various selection effects, as well as the intrinsic clustering properties (functional form, topology) of the data distributions in the parameter spaces of observed attributes. Answering these challenges will require substantial collaborative efforts and partnerships between astronomers, computer scientists, and statisticians.

We review some of the scientific opportunities and technical challenges posed by the exploration of the large digital sky surveys, in the context of a Virtual Observatory (VO). The VO paradigm will profoundly change the way observational astronomy is done. Clustering analysis techniques can be used to discover samples of rare, unusual, or even previously unknown types of astronomical objects and phenomena. Exploration of the previously poorly probed portions of the observable parameter space are especially promising. We illustrate some of the possible types of studies with examples drawn from DPOSS; much more complex and interesting applications are forthcoming. Development of the new tools needed for an efficient exploration of these vast data sets requires a synergy between astronomy and information sciences, with great potential returns for both fields.

Systematic exploration of the observable parameter space, covered by large digital sky surveys spanning a range of wavelengths, will be one of the primary modes of research with a Virtual Observatory (VO). This will include searches for rare, unusual, or even previously unknown types of astronomical objects and phenomena, e.g. as outliers in some parameter space of measured properties, both in the catalog and image domains. Examples from current surveys include high-redshift quasars, type-2 quasars, brown dwarfs, and a small number of objects with puzzling spectra. Opening of the time domain will be especially interesting in this regard. Data-mining tools such as unsupervised clustering techniques will be essential in this task, and should become an important part of the VO toolkit.

Our current understanding of the low surface brightness universe is quite incomplete, not only in the optical, but also in other wavelength regimes. As a demonstration of the type of science which is facilitated by a virtual observatory, we have undertaken a project utilizing both images and catalogs to explore the multi-wavelength, low surface brightness universe. Here, we present some initial results of this project. Our techniques are complimentary to normal data reduction pipeline techniques in that we focus on the diffuse emission that is ignored or removed by more traditional algorithms. This requires a spatial filtering which must account for objects of interest, in addition to observational artifacts (e.g., bright stellar halos). With this work we are exploring the intersection of the catalog and image domains in order to maximize the scientific information we can extract from the federation of large survey data.

We present de Vaucouleurs' effective radii in B and R bands for a sample of Molonglo Reference Catalogue radio galaxies and a control sample of normal galaxies. We use the ratio of the scale lengths in the two bands as an indicator to show that the radio galaxies tend to have excess of blue color in their inner region much more frequently than the control galaxies. We show that the scale length ratio is a useful indicator of radial color variation even when the conventional color gradient is too noisy to serve the purpose.

We present broad band surface photometry of the radio galaxy 3C270 (NGC~4261). We find a distinct dust lane in the $V-R$ image of the galaxy, and determine its orientation and size. We use the major axis profile of the galaxy to estimate the optical depth of the dust lane, and discuss the significance of the lane to the shape of the galaxy.