High resolution galaxy spectra contain much information about galactic physics, but the high dimensionality of these spectra makes it difficult to fully utilize the information they contain. We apply variational autoencoders (VAEs), a non-linear dimensionality reduction technique, to a sample of spectra from the Sloan Digital Sky Survey. In contrast to Principal Component Analysis (PCA), a widely used technique, VAEs can capture non-linear relationships between latent parameters and the data. We find that a VAE can reconstruct the SDSS spectra well with only six latent parameters, outperforming PCA with the same number of components. Different galaxy classes are naturally separated in this latent space, without class labels having been given to the VAE. The VAE latent space is interpretable because the VAE can be used to make synthetic spectra at any point in latent space. For example, making synthetic spectra along tracks in latent space yields sequences of realistic spectra that interpolate between two different types of galaxies. Using the latent space to find outliers may yield interesting spectra: in our small sample, we immediately find unusual data artifacts and stars misclassified as galaxies. In this exploratory work, we show that VAEs create compact, interpretable latent spaces that capture non-linear features of the data. While a VAE takes substantial time to train (~1 day for 48000 spectra), once trained, VAEs can enable the fast exploration of large astronomical data sets.

Evolutionary algorithms borrow from biology the concepts of mutation and selection in order to evolve optimized solutions to known problems. The GENETIS collaboration is developing genetic algorithms for designing antennas that are more sensitive to ultra-high energy neutrino induced radio pulses than current designs. There are three aspects of this investigation. The first is to evolve simple wire antennas to test the concept and different algorithms. Second, optimized antenna response patterns are evolved for a given array geometry. Finally, antennas themselves are evolved using neutrino sensitivity as a measure of fitness. This is achieved by integrating the XFdtd finite-difference time-domain modeling program with simulations of neutrino experiments.

Accurate photometric redshift (photo-$z$) estimates are essential to the cosmological science goals of the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). In this work we use simulated photometry for mock galaxy catalogs to explore how LSST photo-$z$ estimates can be improved by the addition of near-infrared (NIR) and/or ultraviolet (UV) photometry from the Euclid, WFIRST, and/or CASTOR space telescopes. Generally, we find that deeper optical photometry can reduce the standard deviation of the photo-$z$ estimates more than adding NIR or UV filters, but that additional filters are the only way to significantly lower the fraction of galaxies with catastrophically under- or over-estimated photo-$z$. For Euclid, we find that the addition of ${JH}$ $5{\sigma}$ photometric detections can reduce the standard deviation for galaxies with $z>1$ ($z>0.3$) by ${\sim}20\%$ (${\sim}10\%$), and the fraction of outliers by ${\sim}40\%$ (${\sim}25\%$). For WFIRST, we show how the addition of deep ${YJHK}$ photometry could reduce the standard deviation by ${\gtrsim}50\%$ at $z>1.5$ and drastically reduce the fraction of outliers to just ${\sim}2\%$ overall. For CASTOR, we find that the addition of its ${UV}$ and $u$-band photometry could reduce the standard deviation by ${\sim}30\%$ and the fraction of outliers by ${\sim}50\%$ for galaxies with $z<0.5$. We also evaluate the photo-$z$ results within sky areas that overlap with both the NIR and UV surveys, and when spectroscopic training sets built from the surveys' small-area deep fields are used.

NuRadioMC is a Monte Carlo framework designed to simulate ultra-high energy neutrino detectors that rely on the radio detection method. This method exploits the radio emission generated in the electromagnetic component of a particle shower following a neutrino interaction. NuRadioMC simulates everything from the neutrino interaction in a medium, the subsequent Askaryan radio emission, the propagation of the radio signal to the detector and finally the detector response. NuRadioMC is designed as a modern, modular Python-based framework, combining flexibility in detector design with user-friendliness. It includes a state-of-the-art event generator, an improved modelling of the radio emission, a revisited approach to signal propagation and increased flexibility and precision in the detector simulation. This paper focuses on the implemented physics processes and their implications for detector design. A variety of models and parameterizations for the radio emission of neutrino-induced showers are compared and reviewed. Comprehensive examples are used to discuss the capabilities of the code and different aspects of instrumental design decisions.

Many scientific investigations of photometric galaxy surveys require redshift estimates, whose uncertainty properties are best encapsulated by photometric redshift (photo-z) posterior probability density functions (PDFs). A plethora of photo-z PDF estimation methodologies abound, producing discrepant results with no consensus on a preferred approach. We present the results of a comprehensive experiment comparing twelve photo-z algorithms applied to mock data produced for the Large Synoptic Survey Telescope (LSST) Dark Energy Science Collaboration (DESC). By supplying perfect prior information, in the form of the complete template library and a representative training set as inputs to each code, we demonstrate the impact of the assumptions underlying each technique on the output photo-z PDFs. In the absence of a notion of true, unbiased photo-z PDFs, we evaluate and interpret multiple metrics of the ensemble properties of the derived photo-z PDFs as well as traditional reductions to photo-z point estimates. We report systematic biases and overall over/under-breadth of the photo-z PDFs of many popular codes, which may indicate avenues for improvement in the algorithms or implementations. Furthermore, we raise attention to the limitations of established metrics for assessing photo-z PDF accuracy; though we identify the conditional density estimate (CDE) loss as a promising metric of photo-z PDF performance in the case where true redshifts are available but true photo-z PDFs are not, we emphasize the need for science-specific performance metrics.

In this paper we apply ideas from information theory to create a method for the design of optimal filters for photometric redshift estimation. We show the method applied to a series of simple example filters in order to motivate an intuition for how photometric redshift estimators respond to the properties of photometric passbands. We then design a realistic set of six filters covering optical wavelengths that optimize photometric redshifts for $z <= 2.3$ and $i < 25.3$. We create a simulated catalog for these optimal filters and use our filters with a photometric redshift estimation code to show that we can improve the standard deviation of the photometric redshift error by 7.1% overall and improve outliers 9.9% over the standard filters proposed for the Large Synoptic Survey Telescope (LSST). We compare features of our optimal filters to LSST and find that the LSST filters incorporate key features for optimal photometric redshift estimation. Finally, we describe how information theory can be applied to a range of optimization problems in astronomy.

The Askaryan Radio Array is an ultra-high energy (UHE, $>10^{17}$\,eV) neutrino detector designed to observe neutrinos by searching for the radio waves emitted by the relativistic byproducts of neutrino-nucleon interactions in Antarctic ice. In this paper, we present constraints on the diffuse flux of ultra-high energy neutrinos between $10^{16}-10^{21}$\,eV resulting from a search for neutrinos in two complementary analyses, both analyzing four years of data (2013-2016) from the two deep stations (A2, A3) operating at that time. We place a 90\% CL upper limit on the diffuse neutrino flux at $10^{18}$ eV of $EF(E)=3.9\times10^{-16}$~$\textrm{cm}^2$$\textrm{s}^{-1}$$\textrm{sr}^{-1}$. The analysis leverages more than quadruple the livetime of the previous ARA limit, and at this energy is the most sensitive reported by an in-ice radio neutrino detector by more than a factor of four. Looking forward, ARA has yet to analyze more than half of its archived data, and expects that dataset to double in size in the next three years as livetime accumulates in the full five-station array. With this additional livetime, we project ARA will have world-leading sensitivity to neutrinos above $10^{17}$ eV by 2022.

A Kavli foundation sponsored workshop on the theme \emph{Petabytes to Science} was held 12$^{th}$ to 14$^{th}$ of February 2019 in Las Vegas. The aim of the this workshop was to discuss important trends and technologies which may support astronomy. We also tackled how to better shape the workforce for the new trends and how we should approach education and public outreach. This document was coauthored during the workshop and edited in the weeks after. It comprises the discussions and highlights many recommendations which came out of the workshop. We shall distill parts of this document and formulate potential white papers for the decadal survey.

The past decade has welcomed the emergence of cosmic neutrinos as a new messenger to explore the most extreme environments of the universe. The discovery measurement of cosmic neutrinos, announced by IceCube in 2013, has opened a new window of observation that has already resulted in new fundamental information that holds the potential to answer key questions associated with the high-energy universe, including: what are the sources in the PeV sky and how do they drive particle acceleration; where are cosmic rays of extreme energies produced, and on which paths do they propagate through the universe; and are there signatures of new physics at TeV-PeV energies and above? The planned advancements in neutrino telescope arrays in the next decade, in conjunction with continued progress in broad multimessenger astrophysics, promise to elevate the cosmic neutrino field from the discovery to the precision era and to a survey of the sources in the neutrino sky. The planned detector upgrades to the IceCube Neutrino Observatory, culminating in IceCube-Gen2 (an envisaged $400M facility with anticipated operation in the next decade, described in this white paper) are the cornerstone that will drive the evolution of neutrino astrophysics measurements.

The field of astronomy has arrived at a turning point in terms of size and complexity of both datasets and scientific collaboration. Commensurately, algorithms and statistical models have begun to adapt --- e.g., via the onset of artificial intelligence --- which itself presents new challenges and opportunities for growth. This white paper aims to offer guidance and ideas for how we can evolve our technical and collaborative frameworks to promote efficient algorithmic development and take advantage of opportunities for scientific discovery in the petabyte era. We discuss challenges for discovery in large and complex data sets; challenges and requirements for the next stage of development of statistical methodologies and algorithmic tool sets; how we might change our paradigms of collaboration and education; and the ethical implications of scientists' contributions to widely applicable algorithms and computational modeling. We start with six distinct recommendations that are supported by the commentary following them. This white paper is related to a larger corpus of effort that has taken place within and around the Petabytes to Science Workshops (https://petabytestoscience.github.io/).

We report the observation of radar echoes from the ionization trails of high-energy particle cascades. These data were taken at the SLAC National Accelerator Laboratory, where the full electron beam ($\sim$10$^9$ e$^-$ at $\sim$10 GeV/e$^-$) was directed into a plastic target to simulate an ultra high-energy neutrino interaction. This target was interrogated with radio waves, and coherent radio reflections from the cascades were detected, with properties consistent with theoretical expectations. This is the first definitive observation of radar echoes from high-energy particle cascades, which may lead to a viable neutrino detection technology for energies $\gtrsim 10^{16}$ eV.

RNO is the mid-scale discovery instrument designed to make the first observation of neutrinos from the cosmos at extreme energies, with sensitivity well beyond current instrument capabilities. This new observatory will be the largest ground-based neutrino telescope to date, enabling the measurement of neutrinos above $10^{16}$ eV, determining the nature of the astrophysical neutrino flux that has been measured by IceCube at higher energies, similarly extending the reach of multi-messenger astrophysics to the highest energies, and enabling investigations of fundamental physics at energies unreachable by particle accelerators on Earth.

We report on analysis of englacial radio-frequency (RF) pulser data received over horizontal baselines of 1--5 km, based on broadcasts from two sets of transmitters deployed to depths of up to 1500 meters at the South Pole. First, we analyze data collected usingtwo RF bicone transmitters 1400 meters below the ice surface, and frozen into boreholes drilled for the IceCube experiment in 2011. Additionally, in Dec., 2018, a fat-dipole antenna, fed by one of three high-voltage (~1 kV), fast (~(1-5 ns)) signal generators was lowered into the 1700-m deep icehole drilled for the South Pole Ice Core Experiment (SPICE), approximately 3 km from the geographic South Pole. Signals from transmitters were recorded on the five englacial multi-receiver ARA stations, with receiver depths between 60--200 m. We confirm the long, >1 km RF electric field attenuation length, test our observed signal arrival timing distributions against models, and measure birefringent asymmetries at the 0.15% level.

A Monte Carlo simulation program for the radio detection of Ultra High Energy (UHE) neutrino interactions in the Antarctic ice as viewed by the Antarctic Impulsive Transient Antenna (ANITA) is described in this article. The program, icemc, provides an input spectrum of UHE neutrinos, the parametrization of the Askaryan radiation generated by their interaction in the ice, and the propagation of the radiation through ice and air to a simulated model of the third and fourth ANITA flights. This paper provides an overview of the icemc simulation, descriptions of the physics models used and of the ANITA electronics processing chain, data/simulation comparisons to validate the predicted performance, and a summary of the impact of published results.

The Askaryan Radio Array (ARA) is an ultra-high energy (UHE) neutrino telescope at the South Pole consisting of an array of radio antennas aimed at detecting the Askaryan radiation produced by neutrino interactions in the ice. Currently, the experiment has five stations in operation that have been deployed in stages since 2012. This contribution focuses on the development of a search for a diffuse flux of neutrinos in two ARA stations (A2 and A3) from 2013-2016. A background of $\sim 0.01-0.02$ events is expected in one station in each of two search channels in horizontal- and vertical-polarizations. The expected new constraints on the flux of ultra-high energy neutrinos based on four years of analysis with two stations improve on the previous limits set by ARA by a factor of about two. The projected sensitivity of ARA's five-station dataset is beginning to be competitive with other neutrino telescopes at high energies near $10^{10.5}\,$GeV.

In this white paper, we discuss future uses of the LSST facility after the planned 10-year survey is complete. We expect the LSST survey to profoundly affect the scientific landscape over the next ten years, and it is likely that unexpected discoveries may drive its future scientific program. We discuss various operations and instrument options that could be considered for an extended LSST mission beyond ten years.

Commodity cloud computing, as provided by commercial vendors such as Amazon, Google, and Microsoft, has revolutionized computing in many sectors. With the advent of a new class of big data, public access astronomical facility such as LSST, DKIST, and WFIRST, there exists a real opportunity to combine these missions with cloud computing platforms and fundamentally change the way astronomical data is collected, processed, archived, and curated. Making these changes in a cross-mission, coordinated way can provide unprecedented economies of scale in personnel, data collection and management, archiving, algorithm and software development and, most importantly, science.

Software is a critical part of modern research, and yet there are insufficient mechanisms in the scholarly ecosystem to acknowledge, cite, and measure the impact of research software. The majority of academic fields rely on a one-dimensional credit model whereby academic articles (and their associated citations) are the dominant factor in the success of a researcher's career. In the petabyte era of astronomical science, citing software and measuring its impact enables academia to retain and reward researchers that make significant software contributions. These highly skilled researchers must be retained to maximize the scientific return from petabyte-scale datasets. Evolving beyond the one-dimensional credit model requires overcoming several key challenges, including the current scholarly ecosystem and scientific culture issues. This white paper will present these challenges and suggest practical solutions for elevating the role of software as a product of the research enterprise.

We describe the simulated data sample for the "Photometric LSST Astronomical Time Series Classification Challenge" (PLAsTiCC), a publicly available challenge to classify transient and variable events that will be observed by the Large Synoptic Survey Telescope (LSST), a new facility expected to start in the early 2020s. The challenge was hosted by Kaggle, ran from 2018 September 28 to 2018 December 17, and included 1,094 teams competing for prizes. Here we provide details of the 18 transient and variable source models, which were not revealed until after the challenge, and release the model libraries at https://doi.org/10.5281/zenodo.2612896. We describe the LSST Operations Simulator used to predict realistic observing conditions, and we describe the publicly available SNANA simulation code used to transform the models into observed fluxes and uncertainties in the LSST passbands (ugrizy). Although PLAsTiCC has finished, the publicly available models and simulation tools are being used within the astronomy community to further improve classification, and to study contamination in photometrically identified samples of type Ia supernova used to measure properties of dark energy. Our simulation framework will continue serving as a platform to improve the PLAsTiCC models, and to develop new models.

High-energy cosmic neutrinos carry unique information about the most energetic non-thermal sources in the Universe. This white paper describes the outstanding astrophysics questions that neutrino astronomy can address in the coming decade. A companion white paper discusses how the observation of cosmic neutrinos can address open questions in fundamental physics. Detailed measurements of the diffuse neutrino flux, measurements of neutrinos from point sources, and multi-messenger observations with neutrinos will enable the discovery and characterization of the most energetic sources in the Universe.

High-energy cosmic neutrinos can reveal new fundamental particles and interactions, probing energy and distance scales far exceeding those accessible in the laboratory. This white paper describes the outstanding particle physics questions that high-energy cosmic neutrinos can address in the coming decade. A companion white paper discusses how the observation of cosmic neutrinos can address open questions in astrophysics. Tests of fundamental physics using high-energy cosmic neutrinos will be enabled by detailed measurements of their energy spectrum, arrival directions, flavor composition, and timing.

We introduce AXS (Astronomy eXtensions for Spark), a scalable open-source astronomical data analysis framework built on Apache Spark, a widely used industry-standard engine for big data processing. Building on capabilities present in Spark, AXS aims to enable querying and analyzing almost arbitrarily large astronomical catalogs using familiar Python/AstroPy concepts, DataFrame APIs, and SQL statements. We achieve this by i) adding support to Spark for efficient on-line positional cross-matching and ii) supplying a Python library supporting commonly-used operations for astronomical data analysis. To support scalable cross-matching, we developed a variant of the ZONES algorithm (Gray et al. 2004) capable of operating in distributed, shared-nothing architecture. We couple this to a data partitioning scheme that enables fast catalog cross-matching and handles the data skew often present in deep all-sky data sets. The cross-match and other often-used functionalities are exposed to the end users through an easy-to-use Python API. We demonstrate AXS' technical and scientific performance on SDSS, ZTF, Gaia DR2, and AllWise catalogs. Using AXS we were able to perform on-the-fly cross-match of Gaia DR2 (1.8 billion rows) and AllWise (900 million rows) data sets in ~ 30 seconds. We discuss how cloud-ready distributed systems like AXS provide a natural way to enable comprehensive end-user analyses of large datasets such as LSST.

Refraction by the atmosphere causes the positions of sources to depend on the airmass through which an observation was taken. This shift is dependent on the underlying spectral energy of the source and the filter or bandpass through which it is observed. Wavelength-dependent refraction within a single passband is often referred to as differential chromatic refraction (DCR). With a new generation of astronomical surveys undertaking repeated observations of the same part of the sky over a range of different airmasses and parallactic angles, DCR should be a detectable and measurable astrometric signal. In this paper we introduce a novel procedure that takes this astrometric signal and uses it to infer the underlying spectral energy distribution of a source; we solve for multiple latent images at specific wavelengths via a generalized deconvolution procedure built on robust statistics. We demonstrate the utility of such an approach for estimating a partially deconvolved image, at higher spectral resolution than the input images, for surveys such as the Large Synoptic Survey Telescope (LSST).

The ANtarctic Impulsive Transient Antenna (ANITA) NASA long-duration balloon payload completed its fourth flight in December 2016, after 28 days of flight time. ANITA is sensitive to impulsive broadband radio emission from interactions of ultra-high-energy neutrinos in polar ice (Askaryan emission). We present the results of two separate blind analyses searching for signals from Askaryan emission in the data from the fourth flight of ANITA. The more sensitive analysis, with a better expected limit, has a background estimate of $0.64^{+0.69}_{-0.45}$ and an analysis efficiency of $82\pm2\%$. The second analysis has a background estimate of $0.34^{+0.66}_{-0.16}$ and an analysis efficiency of $71\pm6\%$. Each analysis found one event in the signal region, consistent with the background estimate for each analysis. The resulting limit further tightens the constraints on the diffuse flux of ultra-high-energy neutrinos at energies above $10^{19.5}$ eV.

The Zwicky Transient Facility is a large optical survey in multiple filters producing hundreds of thousands of transient alerts per night. We describe here various machine learning (ML) implementations and plans to make the maximal use of the large data set by taking advantage of the temporal nature of the data, and further combining it with other data sets. We start with the initial steps of separating bogus candidates from real ones, separating stars and galaxies, and go on to the classification of real objects into various classes. Besides the usual methods (e.g., based on features extracted from light curves) we also describe early plans for alternate methods including the use of domain adaptation, and deep learning. In a similar fashion we describe efforts to detect fast moving asteroids. We also describe the use of the Zooniverse platform for helping with classifications through the creation of training samples, and active learning. Finally we mention the synergistic aspects of ZTF and LSST from the ML perspective.

The Zwicky Transient Facility (ZTF), a public-private enterprise, is a new time domain survey employing a dedicated camera on the Palomar 48-inch Schmidt telescope with a 47 deg$^2$ field of view and 8 second readout time. It is well positioned in the development of time domain astronomy, offering operations at 10% of the scale and style of the Large Synoptic Survey Telescope (LSST) with a single 1-m class survey telescope. The public surveys will cover the observable northern sky every three nights in g and r filters and the visible Galactic plane every night in g and r. Alerts generated by these surveys are sent in real time to brokers. A consortium of universities which provided funding ("partnership") are undertaking several boutique surveys. The combination of these surveys producing one million alerts per night allows for exploration of transient and variable astrophysical phenomena brighter than r $\sim$ 20.5 on timescales of minutes to years. We describe the primary science objectives driving ZTF including the physics of supernovae and relativistic explosions, multi-messenger astrophysics, supernova cosmology, active galactic nuclei and tidal disruption events, stellar variability, and Solar System objects.

The Zwicky Transient Facility (ZTF) is a new optical time-domain survey that uses the Palomar 48-inch Schmidt telescope. A custom-built wide-field camera provides a 47 deg$^2$ field of view and 8 second readout time, yielding more than an order of magnitude improvement in survey speed relative to its predecessor survey, the Palomar Transient Factory (PTF). We describe the design and implementation of the camera and observing system. The ZTF data system at the Infrared Processing and Analysis Center provides near-real-time reduction to identify moving and varying objects. We outline the analysis pipelines, data products, and associated archive. Finally, we present on-sky performance analysis and first scientific results from commissioning and the early survey. ZTF's public alert stream will serve as a useful precursor for that of the Large Synoptic Survey Telescope.

Recently, the ANITA collaboration reported on two upward-going extensive air shower events consistent with a primary particle that emerges from the surface of the ice. These events may be of $\nu_\tau$ origin, in which the neutrino interacts within the Earth to produce a $\tau$ lepton that emerges from the Earth, decays in the atmosphere, and initiates an extensive air shower. In this paper we estimate an upper bound on the ANITA acceptance to a diffuse $\nu_\tau$ flux detected via $\tau$-lepton-induced air showers within the bounds of Standard Model (SM) uncertainties. By comparing this estimate with the acceptance of Pierre Auger Observatory and IceCube and assuming SM interactions, we conclude that a $\nu_\tau$ origin of these events would imply a neutrino flux at least two orders of magnitude above current bounds.

A foundational goal of the Large Synoptic Survey Telescope (LSST) is to map the Solar System small body populations that provide key windows into understanding of its formation and evolution. This is especially true of the populations of the Outer Solar System -- objects at the orbit of Neptune $r > 30$AU and beyond. In this whitepaper, we propose a minimal change to the LSST cadence that can greatly enhance LSST's ability to discover faint distant Solar System objects across the entire wide-fast-deep (WFD) survey area. Specifically, we propose that the WFD cadence be constrained so as to deliver least one sequence of $\gtrsim 10$ visits per year taken in a $\sim 10$ day period in any combination of $g, r$, and $i$ bands. Combined with advanced shift-and-stack algorithms (Whidden et al. 2019) this modification would enable a nearly complete census of the outer Solar System to $\sim 25.5$ magnitude, yielding $4-8$x more KBO discoveries than with single-epoch baseline, and enabling rapid identification and follow-up of unusual distant Solar System objects in $\gtrsim 5$x greater volume of space. These increases would enhance the science cases discussed in Schwamb et al. (2018) whitepaper, including probing Neptune's past migration history as well as discovering hypothesized planet(s) beyond the orbit of Neptune (or at least placing significant constraints on their existence).

Using data collected by the Askaryan Radio Array (ARA) experiment at the South Pole, we have used long-baseline propagation of radio-frequency signals to extract information on the radio-frequency index-of-refraction in South Polar ice. Owing to the increasing ice density over the upper 150--200 meters, rays are observed along two, nearly parallel paths, one of which is direct and a second which refracts through an inflection point, with differences in both arrival time and arrival angle that can be used to constrain the neutrino properties. We also observe indications, for the first time, of radio-frequency ice birefringence for signals propagating along predominantly horizontal trajectories, corresponding to an asymmetry of order 0.1% between the ordinary and extra-ordinary paths, numerically compatible with previous measurements of birefringent asymmetries for vertically-propagating radio-frequency signals at South Pole. Taken together, these effects offer the possibility of redundantly measuring the range from receiver to a neutrino interaction in Antarctic ice, if receiver antennas are deployed at shallow (25 m<z<100 m) depths. Such range information is essential in determining both the neutrino energy, as well as the incident neutrino direction.

Neutrinos are key to probing the deep structure of matter and the high-energy Universe. Yet, until recently, their interactions had only been measured at laboratory energies up to about 350 GeV. An opportunity to measure their interactions at higher energies opened up with the detection of high-energy neutrinos in IceCube, partially of astrophysical origin. Scattering off matter inside the Earth affects the distribution of their arrival directions --- from this, we extract the neutrino-nucleon cross section at energies from 18 TeV to 2 PeV, in four energy bins, in spite of uncertainties in the neutrino flux. Using six years of public IceCube High-Energy Starting Events, we explicitly show for the first time that the energy dependence of the cross section above 18 TeV agrees with the predicted softer-than-linear dependence, and reaffirm the absence of new physics that would make the cross section rise sharply, up to a center-of-mass energy of ~1 TeV.

We introduce a new computational technique for searching for faint moving sources in astronomical images. Starting from a maximum likelihood estimate for the probability of the detection of a source within a series of images, we develop a massively parallel algorithm for searching through candidate asteroid trajectories that utilizes Graphics Processing Units (GPU). This technique can search over 10^10 possible asteroid trajectories in stacks of the order 10-15 4K x 4K images in under a minute using a single consumer grade GPU. We apply this algorithm to data from the 2015 campaign of the High Cadence Transient Survey (HiTS) obtained with the Dark Energy Camera (DECam). We find 39 previously unknown Kuiper Belt Objects in the 150 square degrees of the survey. Comparing these asteroids to an existing model for the inclination distribution of the Kuiper Belt we demonstrate that we recover a KBO population above our detection limit consistent with previous studies. Software used in this analysis is made available as an open source package.

Testbeam experiment 576 (T576) at the SLAC National Accelerator Laboratory sought to make the first measurement of coherent radio reflections from the ionization produced in the wake of a high-energy particle shower. The >10 GeV electron beam at SLAC End Station A was directed into a large high-density polyethylene target to produce a shower analogous to that produced by an EeV neutrino interaction in ice. Continuous wave (CW) radio was transmitted into the target, and receiving antennas monitored for reflection of the transmitted signal from the ionization left in the wake of the shower. We detail the experiment and report on preliminary hints of a signal consistent with a radio reflection at a significance of 2.36$\sigma$. We recommend another test-beam measurement in order to verify the signal.

Ultra-high energy neutrinos are detectable through impulsive radio signals generated through interactions in dense media, such as ice. Subsurface in-ice radio arrays are a promising way to advance the observation and measurement of astrophysical high-energy neutrinos with energies above those discovered by the IceCube detector ($\geq$1 PeV) as well as cosmogenic neutrinos created in the GZK process ($\geq$100 PeV). Here we describe the $\textit{NuPhase}$ detector, which is a compact receiving array of low-gain antennas deployed 185 m deep in glacial ice near the South Pole. Signals from the antennas are digitized and coherently summed into multiple beams to form a low-threshold interferometric phased array trigger for radio impulses. The NuPhase detector was installed at an Askaryan Radio Array (ARA) station during the 2017/18 Austral summer season. $\textit{In situ}$ measurements with an impulsive, point-source calibration instrument show a 50% trigger efficiency on impulses with voltage signal-to-noise ratios (SNR) of $\le$2.0, a factor of $\sim$1.8 improvement in SNR over the standard ARA combinatoric trigger. Hardware-level simulations, validated with $\textit{in situ}$ measurements, predict a trigger threshold of an SNR as low as 1.6 for neutrino interactions that are in the far field of the array. With the already-achieved NuPhase trigger performance included in ARASim, a detector simulation for the ARA experiment, we find the trigger-level effective detector volume is increased by a factor of 1.8 at neutrino energies between 10 and 100 PeV compared to the currently used ARA combinatoric trigger. We also discuss an achievable near term path toward lowering the trigger threshold further to an SNR of 1.0, which would increase the effective single-station volume by more than a factor of 3 in the same range of neutrino energies.

How ground-based telescopes schedule their observations in response to competing science priorities and constraints, variations in the weather, and the visibility of a particular part of the sky can significantly impact their efficiency. In this paper we introduce the Feature-Based telescope scheduler that is an automated, proposal-free decision making algorithm that offers \textit{controllability} of the behavior, \textit{adjustability} of the mission, and quick \textit{recoverability} from interruptions for large ground-based telescopes. By framing this scheduler in the context of a coherent mathematical model the functionality and performance of the algorithm is simple to interpret and adapt to a broad range of astronomical applications. This paper presents a generic version of the Feature-Based scheduler, with minimal manual tailoring, to demonstrate its potential and flexibility as a foundation for large ground-based telescope schedulers which can later be adjusted for other instruments. In addition, a modified version of the Feature-Based scheduler for the Large Synoptic Survey Telescope (LSST) is introduced and compared to previous LSST scheduler simulations.

These proceedings address a recent publication by the ANITA collaboration of four upward- pointing cosmic-ray-like events observed in the first flight of ANITA. Three of these events were consistent with stratospheric cosmic-ray air showers where the axis of propagation does not inter- sect the surface of the Earth. The fourth event was consistent with a primary particle that emerges from the surface of the ice suggesting a possible {\tau}-lepton decay as the origin of this event. These proceedings follow-up on the modeling and testing of the hypothesis that this event was of {\tau} neutrino origin.

We propose that the Antarctic Impulsive Transient Antenna (ANITA) can serve as a detector for long-lived, charged particles, through its measurement of extensive air showers from secondary leptons. To test this on an example model, we simulate the production of staus inside the earth from interactions between ultra-high energy neutrinos and nuclei. We propose that results of ANITA searches for upgoing air showers can be interpreted in terms of constraints on long-lived, charged massive particles (CHAMPs) and consider a supersymmetric partner of the tau lepton, the stau, as an example of such a particle. Exploring the parameter space in stau mass and lifetimes, we find that the stau properties that lead to an observable signal in ANITA are highly energy dependent. At $10^{18.5}$ eV, we find that the best constraints on the product of the neutrino flux and the stau production cross section would be placed near $m_{\tilde{\tau}}=$1 TeV and $\tau_{\tilde{\tau}}=$10 ns. Thus ANITA could be sensitive to new physics in a region of parameter space that is unconstrained by experiments at the Large Hadron Collider.

The past year has witnessed discovery of the first identified counterparts to a gravitational wave transient (GW 170817A) and a very high-energy neutrino (IceCube-170922A). These source identifications, and ensuing detailed studies, have realized longstanding dreams of astronomers and physicists to routinely carry out observations of cosmic sources by other than electromagnetic means, and inaugurated the era of "multi-messenger" astronomy. While this new era promises extraordinary physical insights into the universe, it brings with it new challenges, including: highly heterogeneous, high-volume, high-velocity datasets; globe-spanning cross-disciplinary teams of researchers, regularly brought together into transient collaborations; an extraordinary breadth and depth of domain-specific knowledge and computing resources required to anticipate, model, and interpret observations; and the routine need for adaptive, distributed, rapid-response observing campaigns to fully exploit the scientific potential of each source. We argue, therefore, that the time is ripe for the community to conceive and propose an Institute for Multi-Messenger Astrophysics that would coordinate its resources in a sustained and strategic fashion to efficiently address these challenges, while simultaneously serving as a center for education and key supporting activities. In this fashion, we can prepare now to realize the bright future that we see, beyond, through these newly opened windows onto the universe.

The Askaryan Radio Array (ARA) reports an observation of radio emission coincident with the "Valentine's Day" solar flare on Feb. 15$^{\rm{th}}$, 2011 in the prototype "Testbed" station. We find $\sim2000$ events that passed our neutrino search criteria during the 70 minute period of the flare, all of which reconstruct to the location of the sun. A signal analysis of the events reveals them to be consistent with that of bright thermal noise correlated across antennas. This is the first natural source of radio emission reported by ARA that is tightly reconstructable on an event-by-event basis. The observation is also the first for ARA to point radio from individual events to an extraterrestrial source on the sky. We comment on how the solar flares, coupled with improved systematic uncertainties in reconstruction algorithms, could aid in a mapping of any above-ice radio emission, such as that from cosmic-ray air showers, to astronomical locations on the sky.

The Antarctic Impulsive Transient Antenna (ANITA), a NASA long-duration balloon payload, searches for radio emission from interactions of ultra-high-energy neutrinos in polar ice. The third flight of ANITA (ANITA-III) was launched in December 2014 and completed a 22-day flight. We present the results of three analyses searching for Askaryan radio emission of neutrino origin. In the most sensitive of the analyses, we find one event in the signal region on an expected a priori background of $0.7^{+0.5}_{-0.3}$. Though consistent with the background estimate, the candidate event remains compatible with a neutrino hypothesis even after additional post-unblinding scrutiny.

(Abridged) We describe here the most ambitious survey currently planned in the optical, the Large Synoptic Survey Telescope (LSST). A vast array of science will be enabled by a single wide-deep-fast sky survey, and LSST will have unique survey capability in the faint time domain. The LSST design is driven by four main science themes: probing dark energy and dark matter, taking an inventory of the Solar System, exploring the transient optical sky, and mapping the Milky Way. LSST will be a wide-field ground-based system sited at Cerro Pach\'{o}n in northern Chile. The telescope will have an 8.4 m (6.5 m effective) primary mirror, a 9.6 deg$^2$ field of view, and a 3.2 Gigapixel camera. The standard observing sequence will consist of pairs of 15-second exposures in a given field, with two such visits in each pointing in a given night. With these repeats, the LSST system is capable of imaging about 10,000 square degrees of sky in a single filter in three nights. The typical 5$\sigma$ point-source depth in a single visit in $r$ will be $\sim 24.5$ (AB). The project is in the construction phase and will begin regular survey operations by 2022. The survey area will be contained within 30,000 deg$^2$ with $\delta<+34.5^\circ$, and will be imaged multiple times in six bands, $ugrizy$, covering the wavelength range 320--1050 nm. About 90\% of the observing time will be devoted to a deep-wide-fast survey mode which will uniformly observe a 18,000 deg$^2$ region about 800 times (summed over all six bands) during the anticipated 10 years of operations, and yield a coadded map to $r\sim27.5$. The remaining 10\% of the observing time will be allocated to projects such as a Very Deep and Fast time domain survey. The goal is to make LSST data products, including a relational database of about 32 trillion observations of 40 billion objects, available to the public and scientists around the world.

We report on an upward traveling, radio-detected cosmic-ray-like impulsive event with characteristics closely matching an extensive air shower. This event, observed in the third flight of the Antarctic Impulsive Transient Antenna (ANITA), a NASA-sponsored long-duration balloon payload, is consistent with a similar event reported in a previous flight. These events may be produced by the atmospheric decay of an upward-propagating $\tau$-lepton produced by a $\nu_{\tau}$ interaction, although their relatively steep arrival angles create tension with the standard model (SM) neutrino cross section. Each of the two events have $a~posteriori$ background estimates of $\lesssim 10^{-2}$ events. If these are generated by $\tau$-lepton decay, then either the charged-current $\nu_{\tau}$ cross section is suppressed at EeV energies, or the events arise at moments when the peak flux of a transient neutrino source was much larger than the typical expected cosmogenic background neutrinos.

We report on $g$, $r$ and $i$ band observations of the Interstellar Object 'Oumuamua (1I) taken on 2017 October 29 from 04:28 to 08:40 UTC by the Apache Point Observatory (APO) 3.5m telescope's ARCTIC camera. We find that 1I's colors are $g-r=0.41\pm0.24$ and $r-i=0.23\pm0.25$, consistent with the visible spectra of Masiero (2017), Ye et al. (2017) and Fitzsimmons et al. (2017), and most comparable to the population of Solar System C/D asteroids, Trojans, or comets. We find no evidence of any cometary activity at a heliocentric distance of 1.46 au, approximately 1.5 months after 1I's closest approach distance to the Sun. Significant brightness variability was seen in the $r$ observations, with the object becoming notably brighter towards the end of the run. By combining our APO photometric time series data with the Discovery Channel Telescope (DCT) data of Knight et al. (2017), taken 20 h later on 2017 October 30, we construct an almost complete light curve with a most probable lightcurve period of $P \simeq 4~{\rm h}$. Our results imply a double peaked rotation period of 8.1 $\pm$ 0.02 h, with a peak-to-peak amplitude of 1.5 - 2.1 mags. Assuming that 1I's shape can be approximated by an ellipsoid, the amplitude constraint implies that 1I has an axial ratio of 3.5 to 10.3, which is strikingly elongated. Assuming that 1I is rotating above its critical break up limit, our results are compatible with 1I having having modest cohesive strength and may have obtained its elongated shape during a tidal disruption event before being ejected from its home system. Astrometry useful for constraining 1I's orbit was also obtained and published in Weaver et al. (2017).

The balloon-borne HiCal radio-frequency (RF) transmitter, in concert with the ANITA radio-frequency receiver array, is designed to measure the Antarctic surface reflectivity in the RF wavelength regime. The amplitude of surface-reflected transmissions from HiCal, registered as triggered events by ANITA, can be compared with the direct transmissions preceding them by O(10) microseconds, to infer the surface power reflection coefficient $\cal{R}$. The first HiCal mission (HiCal-1, Jan. 2015) yielded a sample of 100 such pairs, resulting in estimates of $\cal{R}$ at highly-glancing angles (i.e., zenith angles approaching $90^\circ$), with measured reflectivity for those events which exceeded extant calculations. The HiCal-2 experiment, flying from Dec., 2016-Jan., 2017, provided an improvement by nearly two orders of magnitude in our event statistics, allowing a considerably more precise mapping of the reflectivity over a wider range of incidence angles. We find general agreement between the HiCal-2 reflectivity results and those obtained with the earlier HiCal-1 mission, as well as estimates from Solar reflections in the radio-frequency regime. In parallel, our calculations of expected reflectivity have matured; herein, we use a plane-wave expansion to estimate the reflectivity R from both a flat, smooth surface (and, in so doing, recover the Fresnel reflectivity equations) and also a curved surface. Multiplying our flat-smooth reflectivity by improved Earth curvature and surface roughness corrections now provides significantly better agreement between theory and the HiCal 2a/2b measurements.

In this paper we present and characterize a nearest-neighbors color-matching photometric redshift estimator that features a direct relationship between the precision and accuracy of the input magnitudes and the output photometric redshifts. This aspect makes our estimator an ideal tool for evaluating the impact of changes to LSST survey parameters that affect the measurement errors of the photometry, which is the main motivation of our work (i.e., it is not intended to provide the "best" photometric redshifts for LSST data). We show how the photometric redshifts will improve with time over the 10-year LSST survey and confirm that the nominal distribution of visits per filter provides the most accurate photo-$z$ results. The LSST survey strategy naturally produces observations over a range of airmass, which offers the opportunity of using an SED- and $z$-dependent atmospheric affect on the observed photometry as a color-independent redshift indicator. We show that measuring this airmass effect and including it as a prior has the potential to improve the photometric redshifts and can ameliorate extreme outliers, but that it will only be adequately measured for the brightest galaxies, which limits its overall impact on LSST photometric redshifts. We furthermore demonstrate how this airmass effect can induce a bias in the photo-$z$ results, and caution against survey strategies that prioritize high-airmass observations for the purpose of improving this prior. Ultimately, we intend for this work to serve as a guide for the expectations and preparations of the LSST science community with regards to the minimum quality of photo-$z$ as the survey progresses.

Future weak lensing surveys potentially hold the highest statistical power for constraining cosmological parameters compared to other cosmological probes. The statistical power of a weak lensing survey is determined by the sky coverage, the inverse of the noise in shear measurements, and the galaxy number density. The combination of the latter two factors is often expressed in terms of $n_{\rm eff}$ -- the "effective number density of galaxies used for weak lensing measurements". In this work, we estimate $n_{\rm eff}$ for the Large Synoptic Survey Telescope (LSST) project, the most powerful ground-based lensing survey planned for the next two decades. We investigate how the following factors affect the resulting $n_{\rm eff}$ of the survey with detailed simulations: (1) survey time, (2) shear measurement algorithm, (3) algorithm for combining multiple exposures, (4) inclusion of data from multiple filter bands, (5) redshift distribution of the galaxies, and (6) masking and blending. For the first time, we quantify in a general weak lensing analysis pipeline the sensitivity of $n_{\rm eff}$ to the above factors. We find that with current weak lensing algorithms, expected distributions of observing parameters, and all lensing data ($r$- and $i$-band, covering 18,000 degree$^{2}$ of sky) for LSST, $n_{\rm eff} \approx37$ arcmin$^{-2}$ before considering blending and masking, $n_{\rm eff} \approx31$ arcmin$^{-2}$ when rejecting seriously blended galaxies and $n_{\rm eff} \approx26$ arcmin$^{-2}$ when considering an additional 15% loss of galaxies due to masking. With future improvements in weak lensing algorithms, these values could be expected to increase by up to 20%. Throughout the paper, we also stress the ways in which $n_{\rm eff}$ depends on our ability to understand and control systematic effects in the measurements.

Euclid and the Large Synoptic Survey Telescope (LSST) are poised to dramatically change the astronomy landscape early in the next decade. The combination of high cadence, deep, wide-field optical photometry from LSST with high resolution, wide-field optical photometry and near-infrared photometry and spectroscopy from Euclid will be powerful for addressing a wide range of astrophysical questions. We explore Euclid/LSST synergy, ignoring the political issues associated with data access to focus on the scientific, technical, and financial benefits of coordination. We focus primarily on dark energy cosmology, but also discuss galaxy evolution, transient objects, solar system science, and galaxy cluster studies. We concentrate on synergies that require coordination in cadence or survey overlap, or would benefit from pixel-level co-processing that is beyond the scope of what is currently planned, rather than scientific programs that could be accomplished only at the catalog level without coordination in data processing or survey strategies. We provide two quantitative examples of scientific synergies: the decrease in photo-z errors (benefitting many science cases) when high resolution Euclid data are used for LSST photo-z determination, and the resulting increase in weak lensing signal-to-noise ratio from smaller photo-z errors. We briefly discuss other areas of coordination, including high performance computing resources and calibration data. Finally, we address concerns about the loss of independence and potential cross-checks between the two missions and potential consequences of not collaborating.

Measuring the physical properties of galaxies such as redshift frequently requires the use of Spectral Energy Distributions (SEDs). SED template sets are, however, often small in number and cover limited portions of photometric color space. Here we present a new method to estimate SEDs as a function of color from a small training set of template SEDs. We first cover the mathematical background behind the technique before demonstrating our ability to reconstruct spectra based upon colors and then compare to other common interpolation and extrapolation methods. When the photometric filters and spectra overlap we show reduction of error in the estimated spectra of over 65% compared to the more commonly used techniques. We also show an expansion of the method to wavelengths beyond the range of the photometric filters. Finally, we demonstrate the usefulness of our technique by generating 50 additional SED templates from an original set of 10 and applying the new set to photometric redshift estimation. We are able to reduce the photometric redshifts standard deviation by at least 22.0% and the outlier rejected bias by over 86.2% compared to original set for z $\leq$ 3.

We report the discovery, spectroscopic confirmation, and mass modelling of the gravitationally lensed quasar system PS J0630-1201. The lens was discovered by matching a photometric quasar catalogue compiled from Pan-STARRS and WISE photometry to the Gaia DR1 catalogue, exploiting the high spatial resolution of the latter (FWHM $\sim $0.1") to identify the three brightest components of the lens. Follow-up spectroscopic observations with the WHT confirm the multiple objects are quasars at redshift $z_{q}=3.34$. Further follow-up with Keck AO high-resolution imaging reveals that the system is composed of two lensing galaxies and the quasar is lensed into a $\sim$2.8" separation four-image cusp configuration with a fifth image clearly visible, and a 1.0" arc due to the lensed quasar host galaxy. The system is well-modelled with two singular isothermal ellipsoids, reproducing the position of the fifth image. We discuss future prospects for measuring time delays between the images and constraining any offset between mass and light using the faintly detected Einstein arcs associated with the quasar host galaxy.

Type Ia supernovae (SNe Ia) arise from the thermonuclear explosion of carbon-oxygen white dwarfs. Though the uniformity of their light curves makes them powerful cosmological distance indicators, long-standing issues remain regarding their progenitors and explosion mechanisms. Recent detection of the early ultraviolet pulse of a peculiar subluminous SN Ia has been claimed as new evidence for the companion-ejecta interaction through the single-degenerate channel. Here, we report the discovery of a prominent but red optical flash at $\sim$ 0.5 days after the explosion of a SN Ia which shows hybrid features of different SN Ia sub-classes: a light curve typical of normal-brightness SNe Ia, but with strong titanium absorptions, commonly seen in the spectra of subluminous ones. We argue that the early flash of such a hybrid SN Ia is different from predictions of previously suggested scenarios such as the companion-ejecta interaction. Instead it can be naturally explained by a SN explosion triggered by a detonation of a thin helium shell either on a near-Chandrasekhar-mass white dwarf ($\gtrsim$ 1.3 M$_{\odot}$) with low-yield $^{56}$Ni or on a sub-Chandrasekhar-mass white dwarf ($\sim$ 1.0 M$_{\odot}$) merging with a less massive white dwarf. This finding provides compelling evidence that one branch of the previously proposed explosion models, the helium-ignition scenario, does exist in nature, and such a scenario may account for explosions of white dwarfs in a wider mass range in contrast to what was previously supposed.

The Antarctic Impulsive Transient Antenna (ANITA) is a NASA long-duration balloon experiment with the primary goal of detecting ultra-high-energy ($>10^{18}\,\mbox{eV}$) neutrinos via the Askaryan Effect. The fourth ANITA mission, ANITA-IV, recently flew from Dec 2 to Dec 29, 2016. For the first time, the Tunable Universal Filter Frontend (TUFF) boards were deployed for mitigation of narrow-band, anthropogenic noise with tunable, switchable notch filters. The TUFF boards also performed second-stage amplification by approximately 45 dB to boost the $\sim\,\mu\mbox{V-level}$ radio frequency (RF) signals to $\sim$ mV-level for digitization, and supplied power via bias tees to the first-stage, antenna-mounted amplifiers. The other major change in signal processing in ANITA-IV is the resurrection of the $90^{\circ}$ hybrids deployed previously in ANITA-I, in the trigger system, although in this paper we focus on the TUFF boards. During the ANITA-IV mission, the TUFF boards were successfully operated throughout the flight. They contributed to a factor of 2.8 higher total instrument livetime on average in ANITA-IV compared to ANITA-III due to reduction of narrow-band, anthropogenic noise before a trigger decision is made.

The Large Synoptic Survey Telescope (LSST) will produce an unprecedented amount of light curves using six optical bands. Robust and efficient methods that can aggregate data from multidimensional sparsely-sampled time series are needed. In this paper we present a new method for light curve period estimation based on the quadratic mutual information (QMI). The proposed method does not assume a particular model for the light curve nor its underlying probability density and it is robust to non-Gaussian noise and outliers. By combining the QMI from several bands the true period can be estimated even when no single-band QMI yields the period. Period recovery performance as a function of average magnitude and sample size is measured using 30,000 synthetic multi-band light curves of RR Lyrae and Cepheid variables generated by the LSST Operations and Catalog simulators. The results show that aggregating information from several bands is highly beneficial in LSST sparsely-sampled time series, obtaining an absolute increase in period recovery rate up to 50%. We also show that the QMI is more robust to noise and light curve length (sample size) than the multiband generalizations of the Lomb Scargle and Analysis of Variance periodograms, recovering the true period in 10-30% more cases than its competitors. A python package containing efficient Cython implementations of the QMI and other methods is provided.

The Large Synoptic Survey Telescope is designed to provide an unprecedented optical imaging dataset that will support investigations of our Solar System, Galaxy and Universe, across half the sky and over ten years of repeated observation. However, exactly how the LSST observations will be taken (the observing strategy or "cadence") is not yet finalized. In this dynamically-evolving community white paper, we explore how the detailed performance of the anticipated science investigations is expected to depend on small changes to the LSST observing strategy. Using realistic simulations of the LSST schedule and observation properties, we design and compute diagnostic metrics and Figures of Merit that provide quantitative evaluations of different observing strategies, analyzing their impact on a wide range of proposed science projects. This is work in progress: we are using this white paper to communicate to each other the relative merits of the observing strategy choices that could be made, in an effort to maximize the scientific value of the survey. The investigation of some science cases leads to suggestions for new strategies that could be simulated and potentially adopted. Notably, we find motivation for exploring departures from a spatially uniform annual tiling of the sky: focusing instead on different parts of the survey area in different years in a "rolling cadence" is likely to have significant benefits for a number of time domain and moving object astronomy projects. The communal assembly of a suite of quantified and homogeneously coded metrics is the vital first step towards an automated, systematic, science-based assessment of any given cadence simulation, that will enable the scheduling of the LSST to be as well-informed as possible.

The primary science goal of the NASA-sponsored ANITA project is measurement of ultra-high energy neutrinos and cosmic rays, observed via radio-frequency signals resulting from a neutrino- or cosmic ray- interaction with terrestrial matter (atmospheric or ice molecules, e.g.). Accurate inference of the energies of these cosmic rays requires understanding the transmission/reflection of radio wave signals across the ice-air boundary. Satellite-based measurements of Antarctic surface reflectivity, using a co-located transmitter and receiver, have been performed more-or-less continuously for the last few decades. Satellite-based reflectivity surveys, at frequencies ranging from 2--45 GHz and at near-normal incidence, yield generally consistent reflectivity maps across Antarctica. Using the Sun as an RF source, and the ANITA-3 balloon borne radio-frequency antenna array as the RF receiver, we have also measured the surface reflectivity over the interval 200-1000 MHz, at elevation angles of 12-30 degrees, finding agreement with the Fresnel equations within systematic errors. To probe low incidence angles, inaccessible to the Antarctic Solar technique and not probed by previous satellite surveys, a novel experimental approach ("HiCal-1") was devised. Unlike previous measurements, HiCal-ANITA constitute a bi-static transmitter-receiver pair separated by hundreds of kilometers. Data taken with HiCal, between 200--600 MHz shows a significant departure from the Fresnel equations, constant with frequency over that band, with the deficit increasing with obliquity of incidence, which we attribute to the combined effects of possible surface roughness, surface grain effects, radar clutter and/or shadowing of the reflection zone due to Earth curvature effects.

The Askaryan effect describes coherent electromagnetic radiation from high-energy cascades in dense media with a collective charge. We present an analytic model of Askaryan radiation that accounts simultaneously for the three- dimensional form factor of the cascade, and quantum mechanical cascade elongation via the Landau-Pomeranchuk- Migdal effect. These calculations, and the associated open-source code, allow the user to avoid computationally intensive Monte Carlo cascade simulations. Searches for cosmogenic neutrinos in Askaryan-based detectors benefit from computational speed, because scans of Askaryan parameter-space are required to match neutrino signals. The Askaryan field is derived from cascade equations verified with Geant4 simulations, and compared with prior numerical and semi-analytic calculations. Finally, instructive cases of the model are transformed from the Fourier domain to the time-domain. Next-generation in situ detectors like ARA and ARIANNA can use analytic time- domain signal models to search for correlations with event candidates.

We report on a search for ultra-high-energy (UHE) neutrinos from gamma-ray bursts (GRBs) in the data set collected by the Testbed station of the Askaryan Radio Array (ARA) in 2011 and 2012. From 57 selected GRBs, we observed no events that survive our cuts, which is consistent with 0.12 expected background events. Using NeuCosmA as a numerical GRB reference emission model, we estimate upper limits on the prompt UHE GRB neutrino fluence and quasi-diffuse flux from $10^{7}$ to $10^{10}$ GeV. This is the first limit on the prompt UHE GRB neutrino quasi-diffuse flux above $10^{7}$ GeV.

The Large Synoptic Survey Telescope (LSST), the next-generation optical imaging survey sited at Cerro Pachon in Chile, will provide an unprecedented database of astronomical measurements. The LSST design, with an 8.4m (6.7m effective) primary mirror, a 9.6 sq. deg. field of view, and a 3.2 Gigapixel camera, will allow about 10,000 sq. deg. of sky to be covered twice per night, every three to four nights on average, with typical 5-sigma depth for point sources of $r$=24.5 (AB). With over 800 observations in $ugrizy$ bands over a 10-year period, these data will enable a deep stack reaching $r$=27.5 (about 5 magnitudes deeper than SDSS) and faint time-domain astronomy. The measured properties of newly discovered and known astrometric and photometric transients will be publicly reported within 60 sec after observation. The vast database of about 30 trillion observations of 40 billion objects will be mined for the unexpected and used for precision experiments in astrophysics. In addition to a brief introduction to LSST, we discuss a number of astro-statistical challenges that need to be overcome to extract maximum information and science results from LSST dataset.

We present the discovery and preliminary characterization of a gravitationally lensed quasar with a source redshift $z_{s}=2.74$ and image separation of $2.9"$ lensed by a foreground $z_{l}=0.40$ elliptical galaxy. Since the images of gravitationally lensed quasars are the superposition of multiple point sources and a foreground lensing galaxy, we have developed a morphology independent multi-wavelength approach to the photometric selection of lensed quasar candidates based on Gaussian Mixture Models (GMM) supervised machine learning. Using this technique and $gi$ multicolour photometric observations from the Dark Energy Survey (DES), near IR $JK$ photometry from the VISTA Hemisphere Survey (VHS) and WISE mid IR photometry, we have identified a candidate system with two catalogue components with $i_{AB}=18.61$ and $i_{AB}=20.44$ comprised of an elliptical galaxy and two blue point sources. Spectroscopic follow-up with NTT and the use of an archival AAT spectrum show that the point sources can be identified as a lensed quasar with an emission line redshift of $z=2.739\pm0.003$ and a foreground early type galaxy with $z=0.400\pm0.002$. We model the system as a single isothermal ellipsoid and find the Einstein radius $\theta_E \sim 1.47"$, enclosed mass $M_{enc} \sim 4 \times 10^{11}$M$_{\odot}$ and a time delay of $\sim$52 days. The relatively wide separation, month scale time delay duration and high redshift make this an ideal system for constraining the expansion rate beyond a redshift of 1.

This is a review on radio detection of high energy neutrinos.

We report on four radio-detected cosmic-ray (CR) or CR-like events observed with the Antarctic Impulsive Transient Antenna (ANITA), a NASA-sponsored long-duration balloon payload. Two of the four were previously identified as stratospheric CR air showers during the ANITA-I flight. A third stratospheric CR was detected during the ANITA-II flight. Here we report on characteristics these three unusual CR events, which develop nearly horizontally, 20-30~km above the surface of the Earth. In addition, we report on a fourth steeply upward-pointing ANITA-I CR-like radio event which has characteristics consistent with a primary that emerged from the surface of the ice. This suggests a possible $\tau$-lepton decay as the origin of this event, but such an interpretation would require significant suppression of the Standard Model ${\tau}$-neutrino cross section.

Ultra-high energy neutrinos are interesting messenger particles since, if detected, they can transmit exclusive information about ultra-high energy processes in the Universe. These particles, with energies above $10^{16}\mathrm{eV}$, interact very rarely. Therefore, detectors that instrument several gigatons of matter are needed to discover them. The ARA detector is currently being constructed at South Pole. It is designed to use the Askaryan effect, the emission of radio waves from neutrino-induced cascades in the South Pole ice, to detect neutrino interactions at very high energies. With antennas distributed among 37 widely-separated stations in the ice, such interactions can be observed in a volume of several hundred cubic kilometers. Currently 3 deep ARA stations are deployed in the ice of which two have been taking data since the beginning of the year 2013. In this publication, the ARA detector "as-built" and calibrations are described. Furthermore, the data reduction methods used to distinguish the rare radio signals from overwhelming backgrounds of thermal and anthropogenic origin are presented. Using data from only two stations over a short exposure time of 10 months, a neutrino flux limit of $3 \cdot 10^{-6} \mathrm{GeV} / (\mathrm{cm^2 \ s \ sr})$ is calculated for a particle energy of 10^{18}eV, which offers promise for the full ARA detector.

The first flight of the Antarctic Impulsive Transient Antenna (ANITA) experiment recorded 16 radio signals that were emitted by cosmic-ray induced air showers. For 14 of these events, this radiation was reflected from the ice. The dominant contribution to the radiation from the deflection of positrons and electrons in the geomagnetic field, which is beamed in the direction of motion of the air shower. This radiation is reflected from the ice and subsequently detected by the ANITA experiment at a flight altitude of 36km. In this paper, we estimate the energy of the 14 individual events and find that the mean energy of the cosmic-ray sample is 2.9 EeV. By simulating the ANITA flight, we calculate its exposure for ultra-high energy cosmic rays. We estimate for the first time the cosmic-ray flux derived only from radio observations. In addition, we find that the Monte Carlo simulation of the ANITA data set is in agreement with the total number of observed events and with the properties of those events.

The Large Synoptic Survey Telescope (LSST) is a large-aperture, wide-field, ground-based survey system that will image the sky in six optical bands from 320 to 1050 nm, uniformly covering approximately $18,000$deg$^2$ of the sky over 800 times. The LSST is currently under construction on Cerro Pach\'on in Chile, and expected to enter operations in 2022. Once operational, the LSST will explore a wide range of astrophysical questions, from discovering "killer" asteroids to examining the nature of Dark Energy. The LSST will generate on average 15 TB of data per night, and will require a comprehensive Data Management system to reduce the raw data to scientifically useful catalogs and images with minimum human intervention. These reductions will result in a real-time alert stream, and eleven data releases over the 10-year duration of LSST operations. To enable this processing, the LSST project is developing a new, general-purpose, high-performance, scalable, well documented, open source data processing software stack for O/IR surveys. Prototypes of this stack are already capable of processing data from existing cameras (e.g., SDSS, DECam, MegaCam), and form the basis of the Hyper-Suprime Cam (HSC) Survey data reduction pipeline.

The Askaryan Radio Array (ARA) is an ultra-high energy ($>10^{17}$ eV) cosmic neutrino detector in phased construction near the South Pole. ARA searches for radio Cherenkov emission from particle cascades induced by neutrino interactions in the ice using radio frequency antennas ($\sim150-800$ MHz) deployed at a design depth of 200 m in the Antarctic ice. A prototype ARA Testbed station was deployed at $\sim30$ m depth in the 2010-2011 season and the first three full ARA stations were deployed in the 2011-2012 and 2012-2013 seasons. We present the first neutrino search with ARA using data taken in 2011 and 2012 with the ARA Testbed and the resulting constraints on the neutrino flux from $10^{17}-10^{21}$ eV.

The focus of this report is on the opportunities enabled by the combination of LSST, Euclid and WFIRST, the optical surveys that will be an essential part of the next decade's astronomy. The sum of these surveys has the potential to be significantly greater than the contributions of the individual parts. As is detailed in this report, the combination of these surveys should give us multi-wavelength high-resolution images of galaxies and broadband data covering much of the stellar energy spectrum. These stellar and galactic data have the potential of yielding new insights into topics ranging from the formation history of the Milky Way to the mass of the neutrino. However, enabling the astronomy community to fully exploit this multi-instrument data set is a challenging technical task: for much of the science, we will need to combine the photometry across multiple wavelengths with varying spectral and spatial resolution. We identify some of the key science enabled by the combined surveys and the key technical challenges in achieving the synergies.

Astronomy and astrophysics are witnessing dramatic increases in data volume as detectors, telescopes and computers become ever more powerful. During the last decade, sky surveys across the electromagnetic spectrum have collected hundreds of terabytes of astronomical data for hundreds of millions of sources. Over the next decade, the data volume will enter the petabyte domain, and provide accurate measurements for billions of sources. Astronomy and physics students are not traditionally trained to handle such voluminous and complex data sets. In this paper we describe astroML; an initiative, based on Python and scikit-learn, to develop a compendium of machine learning tools designed to address the statistical needs of the next generation of students and astronomical surveys. We introduce astroML and present a number of example applications that are enabled by this package.

From an elevation of ~38 km, the balloon-borne ANtarctic Impulsive Transient Antenna (ANITA) is designed to detect the up-coming radio frequency (RF) signal resulting from a sub-surface neutrino-nucleon collision. Although no neutrinos have been discovered thus far, ANITA is nevertheless the only experiment to self-trigger on radio frequency emissions from cosmic-ray induced atmospheric air showers. In the majority of those cases, down-coming RF signals are observed via their reflection from the Antarctic ice sheet and back up to the ANITA interferometer. Estimating the energy scale of the incident cosmic rays therefore requires an estimate of the fractional power reflected at the air-ice interface. Similarly, inferring the energy of neutrinos interacting in-ice from observations of the upwards-directed signal refracting out to ANITA also requires consideration of signal coherence across the interface. By comparing the direct Solar RF signal intensity measured with ANITA to the surface-reflected Solar signal intensity, as a function of incident elevation angle relative to the surface {\Theta}, we estimate the power reflection coefficients R({\Theta}). We find general consistency between our average measurements and the values of R({\Theta}) expected from the Fresnel equations, separately for horizontal- vs. vertical-polarizations.

We consider the problem of inferring constraints on a high-dimensional parameter space with a computationally expensive likelihood function. We propose a machine learning algorithm that maps out the Frequentist confidence limit on parameter space by intelligently targeting likelihood evaluations so as to quickly and accurately characterize the likelihood surface in both low- and high-likelihood regions. We compare our algorithm to Bayesian credible limits derived by the well-tested Markov Chain Monte Carlo (MCMC) algorithm using both multi-modal toy likelihood functions and the 7-year WMAP cosmic microwave background likelihood function. We find that our algorithm correctly identifies the location, general size, and general shape of high-likelihood regions in parameter space while being more robust against multi-modality than MCMC.

With upcoming all sky surveys such as LSST poised to generate a deep digital movie of the optical sky, variability-based AGN selection will enable the construction of highly-complete catalogs with minimum contamination. In this study, we generate $g$-band difference images and construct light curves for QSO/AGN candidates listed in SDSS Stripe 82 public catalogs compiled from different methods, including spectroscopy, optical colors, variability, and X-ray detection. Image differencing excels at identifying variable sources embedded in complex or blended emission regions such as Type II AGNs and other low-luminosity AGNs that may be omitted from traditional photometric or spectroscopic catalogs. To separate QSOs/AGNs from other sources using our difference image light curves, we explore several light curve statistics and parameterize optical variability by the characteristic damping timescale ($\tau$) and variability amplitude. By virtue of distinguishable variability parameters of AGNs, we are able to select them with high completeness of 93.4% and efficiency (i.e., purity) of 71.3%. Based on optical variability, we also select highly variable blazar candidates, whose infrared colors are consistent with known blazars. One third of them are also radio detected. With the X-ray selected AGN candidates, we probe the optical variability of X-ray detected optically-extended sources using their difference image light curves for the first time. A combination of optical variability and X-ray detection enables us to select various types of host-dominated AGNs. Contrary to the AGN unification model prediction, two Type II AGN candidates (out of 6) show detectable variability on long-term timescales like typical Type I AGNs. This study will provide a baseline for future optical variability studies of extended sources.

This document presents (off-line) computing requrements and challenges for Cosmic Frontier science, covering the areas of data management, analysis, and simulations. We invite contributions to extend the range of covered topics and to enhance the current descriptions.

Report of the CF6 Working Group at Snowmass 2013. Topics addressed include ultra-high energy cosmic rays, neutrinos, gamma rays, baryogenesis, and experiments probing the fundamental nature of spacetime.

The quantity and quality of cosmic structure observations have greatly accelerated in recent years. Further leaps forward will be facilitated by imminent projects, which will enable us to map the evolution of dark and baryonic matter density fluctuations over cosmic history. The way that these fluctuations vary over space and time is sensitive to the nature of dark matter and dark energy. Dark energy and gravity both affect how rapidly structure grows; the greater the acceleration, the more suppressed the growth of structure, while the greater the gravity, the more enhanced the growth. While distance measurements also constrain dark energy, the comparison of growth and distance data tests whether General Relativity describes the laws of physics accurately on large scales. Modified gravity models are able to reproduce the distance measurements but at the cost of altering the growth of structure (these signatures are described in more detail in the accompanying paper on Novel Probes of Gravity and Dark Energy). Upcoming surveys will exploit these differences to determine whether the acceleration of the Universe is due to dark energy or to modified gravity. To realize this potential, both wide field imaging and spectroscopic redshift surveys play crucial roles. Projects including DES, eBOSS, DESI, PFS, LSST, Euclid, and WFIRST are in line to map more than a 1000 cubic-billion-light-year volume of the Universe. These will map the cosmic structure growth rate to 1% in the redshift range 0<z<2, over the last 3/4 of the age of the Universe.

We present the design and performance of the multi-object fiber spectrographs for the Sloan Digital Sky Survey (SDSS) and their upgrade for the Baryon Oscillation Spectroscopic Survey (BOSS). Originally commissioned in Fall 1999 on the 2.5-m aperture Sloan Telescope at Apache Point Observatory, the spectrographs produced more than 1.5 million spectra for the SDSS and SDSS-II surveys, enabling a wide variety of Galactic and extra-galactic science including the first observation of baryon acoustic oscillations in 2005. The spectrographs were upgraded in 2009 and are currently in use for BOSS, the flagship survey of the third-generation SDSS-III project. BOSS will measure redshifts of 1.35 million massive galaxies to redshift 0.7 and Lyman-alpha absorption of 160,000 high redshift quasars over 10,000 square degrees of sky, making percent level measurements of the absolute cosmic distance scale of the Universe and placing tight constraints on the equation of state of dark energy. The twin multi-object fiber spectrographs utilize a simple optical layout with reflective collimators, gratings, all-refractive cameras, and state-of-the-art CCD detectors to produce hundreds of spectra simultaneously in two channels over a bandpass covering the near ultraviolet to the near infrared, with a resolving power R = \lambda/FWHM ~ 2000. Building on proven heritage, the spectrographs were upgraded for BOSS with volume-phase holographic gratings and modern CCD detectors, improving the peak throughput by nearly a factor of two, extending the bandpass to cover 360 < \lambda < 1000 nm, and increasing the number of fibers from 640 to 1000 per exposure. In this paper we describe the original SDSS spectrograph design and the upgrades implemented for BOSS, and document the predicted and measured performances.

We study the arrival directions of 69 ultra-high energy cosmic rays (UHECRs) observed at the Pierre Auger Observatory (PAO) with energies exceeding 55 EeV. We investigate whether the UHECRs exhibit the anisotropy signal expected if the primary particles are protons that originate in galaxies in the local universe, or in sources correlated with these galaxies. We cross-correlate the UHECR arrival directions with the positions of IRAS-PSCz and 2MASS-6dF galaxies taking into account particle energy losses during propagation. This is the first time that the 6dF survey is used in a search for the sources of UHECRs and the first time that the PSCz survey is used with the full 69 PAO events. The observed cross-correlation signal is larger for the PAO UHECRs than for 94% (98%) of realisations from an isotropic distribution when cross-correlated with the PSCz (6dF). On the other hand the observed cross-correlation signal is lower than that expected from 85% of realisations, had the UHECRs originated in galaxies in either survey. The observed cross-correlation signal does exceed that expected by 50% of the realisations if the UHECRs are randomly deflected by intervening magnetic fields by 5 degrees or more. We propose a new method of analysing the expected anisotropy signal, by dividing the predicted UHECR source distribution into equal predicted flux radial shells, which can help localise and constrain the properties of UHECR sources. We find that the 69 PAO events are consistent with isotropy in the nearest of three shells we define, whereas there is weak evidence for correlation with the predicted source distribution in the two more distant shells in which the galaxy distribution is less anisotropic.

Large neutrino telescopes can measure the neutrino-nucleon cross-section by studying neutrino absorption in the Earth.

The statistics of peak counts in reconstructed shear maps contain information beyond the power spectrum, and can improve cosmological constraints from measurements of the power spectrum alone if systematic errors can be controlled. We study the effect of galaxy shape measurement errors on predicted cosmological constraints from the statistics of shear peak counts with the Large Synoptic Survey Telescope (LSST). We use the LSST image simulator in combination with cosmological N-body simulations to model realistic shear maps for different cosmological models. We include both galaxy shape noise and, for the first time, measurement errors on galaxy shapes. We find that the measurement errors considered have relatively little impact on the constraining power of shear peak counts for LSST.

A main science goal for the Large Synoptic Survey Telescope (LSST) is to measure the cosmic shear signal from weak lensing to extreme accuracy. One difficulty, however, is that with the short exposure time ($\simeq$15 seconds) proposed, the spatial variation of the Point Spread Function (PSF) shapes may be dominated by the atmosphere, in addition to optics errors. While optics errors mainly cause the PSF to vary on angular scales similar or larger than a single CCD sensor, the atmosphere generates stochastic structures on a wide range of angular scales. It thus becomes a challenge to infer the multi-scale, complex atmospheric PSF patterns by interpolating the sparsely sampled stars in the field. In this paper we present a new method, PSFent, for interpolating the PSF shape parameters, based on reconstructing underlying shape parameter maps with a multi-scale maximum entropy algorithm. We demonstrate, using images from the LSST Photon Simulator, the performance of our approach relative to a 5th-order polynomial fit (representing the current standard) and a simple boxcar smoothing technique. Quantitatively, PSFent predicts more accurate PSF models in all scenarios and the residual PSF errors are spatially less correlated. This improvement in PSF interpolation leads to a factor of 3.5 lower systematic errors in the shear power spectrum on scales smaller than $\sim13'$, compared to polynomial fitting. We estimate that with PSFent and for stellar densities greater than $\simeq1/{\rm arcmin}^{2}$, the spurious shear correlation from PSF interpolation, after combining a complete 10-year dataset from LSST, is lower than the corresponding statistical uncertainties on the cosmic shear power spectrum, even under a conservative scenario.

The complete 10-year survey from the Large Synoptic Survey Telescope (LSST) will image $\sim$ 20,000 square degrees of sky in six filter bands every few nights, bringing the final survey depth to $r\sim27.5$, with over 4 billion well measured galaxies. To take full advantage of this unprecedented statistical power, the systematic errors associated with weak lensing measurements need to be controlled to a level similar to the statistical errors. This work is the first attempt to quantitatively estimate the absolute level and statistical properties of the systematic errors on weak lensing shear measurements due to the most important physical effects in the LSST system via high fidelity ray-tracing simulations. We identify and isolate the different sources of algorithm-independent, \textit{additive} systematic errors on shear measurements for LSST and predict their impact on the final cosmic shear measurements using conventional weak lensing analysis techniques. We find that the main source of the errors comes from an inability to adequately characterise the atmospheric point spread function (PSF) due to its high frequency spatial variation on angular scales smaller than $\sim10'$ in the single short exposures, which propagates into a spurious shear correlation function at the $10^{-4}$--$10^{-3}$ level on these scales. With the large multi-epoch dataset that will be acquired by LSST, the stochastic errors average out, bringing the final spurious shear correlation function to a level very close to the statistical errors. Our results imply that the cosmological constraints from LSST will not be severely limited by these algorithm-independent, additive systematic effects.

We consider the implications of Lorentz-invariance violation (LIV) on cosmogenic neutrino observations, with particular focus on the constraints imposed on several well-developed models for ultra-high energy cosmogenic neutrino production by recent results from the Antarctic Impulsive Transient Antenna (ANITA) long-duration balloon payload, and Radio Ice Cherenkov Experiment (RICE) at the South Pole. Under a scenario proposed originally by Coleman and Glashow, each lepton family may attain maximum velocities that can exceed the speed of light, leading to energy-loss through several interaction channels during propagation. We show that future observations of cosmogenic neutrinos will provide by far the most stringent limit on LIV in the neutrino sector. We derive the implied level of LIV required to suppress observation of predicted fluxes from several mainstream cosmogenic neutrino models, and specifically those recently constrained by the ANITA and RICE experiments. We simulate via detailed Monte Carlo code the propagation of cosmogenic neutrino fluxes in the presence of LIV-induced energy losses. We show that this process produces several detectable effects in the resulting attenuated neutrino spectra, even at LIV-induced neutrino superluminality of (u_{\nu}-c)/c ~ 10^{-26}, about 13 orders of magnitude below current bounds.

We describe the design and data sample from the DEEP2 Galaxy Redshift Survey, the densest and largest precision-redshift survey of galaxies at z ~ 1 completed to date. The survey has conducted a comprehensive census of massive galaxies, their properties, environments, and large-scale structure down to absolute magnitude M_B = -20 at z ~ 1 via ~90 nights of observation on the DEIMOS spectrograph at Keck Observatory. DEEP2 covers an area of 2.8 deg^2 divided into four separate fields, observed to a limiting apparent magnitude of R_AB=24.1. Objects with z < 0.7 are rejected based on BRI photometry in three of the four DEEP2 fields, allowing galaxies with z > 0.7 to be targeted ~2.5 times more efficiently than in a purely magnitude-limited sample. Approximately sixty percent of eligible targets are chosen for spectroscopy, yielding nearly 53,000 spectra and more than 38,000 reliable redshift measurements. Most of the targets which fail to yield secure redshifts are blue objects that lie beyond z ~ 1.45. The DEIMOS 1200-line/mm grating used for the survey delivers high spectral resolution (R~6000), accurate and secure redshifts, and unique internal kinematic information. Extensive ancillary data are available in the DEEP2 fields, particularly in the Extended Groth Strip, which has evolved into one of the richest multiwavelength regions on the sky. DEEP2 surpasses other deep precision-redshift surveys at z ~ 1 in terms of galaxy numbers, redshift accuracy, sample number density, and amount of spectral information. We also provide an overview of the scientific highlights of the DEEP2 survey thus far. This paper is intended as a handbook for users of the DEEP2 Data Release 4, which includes all DEEP2 spectra and redshifts, as well as for the publicly-available DEEP2 DEIMOS data reduction pipelines. [Abridged]

We review current methods for building PSF-matching kernels for the purposes of image subtraction or coaddition. Such methods use a linear decomposition of the kernel on a series of basis functions. The correct choice of these basis functions is fundamental to the efficiency and effectiveness of the matching - the chosen bases should represent the underlying signal using a reasonably small number of shapes, and/or have a minimum number of user-adjustable tuning parameters. We examine methods whose bases comprise multiple Gauss-Hermite polynomials, as well as a form free basis composed of delta-functions. Kernels derived from delta-functions are unsurprisingly shown to be more expressive; they are able to take more general shapes and perform better in situations where sum-of-Gaussian methods are known to fail. However, due to its many degrees of freedom (the maximum number allowed by the kernel size) this basis tends to overfit the problem, and yields noisy kernels having large variance. We introduce a new technique to regularize these delta-function kernel solutions, which bridges the gap between the generality of delta-function kernels, and the compactness of sum-of-Gaussian kernels. Through this regularization we are able to create general kernel solutions that represent the intrinsic shape of the PSF-matching kernel with only one degree of freedom, the strength of the regularization lambda. The role of lambda is effectively to exchange variance in the resulting difference image with variance in the kernel itself. We examine considerations in choosing the value of lambda, including statistical risk estimators and the ability of the solution to predict solutions for adjacent areas. Both of these suggest moderate strengths of lambda between 0.1 and 1.0, although this optimization is likely dataset dependent.

We perform a pixel-by-pixel analysis of 467 galaxies in the GOODS-VIMOS survey to study systematic effects in extracting properties of stellar populations (age, dust, metallicity and SFR) from pixel colors using the pixel-z method. The systematics studied include the effect of the input stellar population synthesis model, passband limitations and differences between individual SED fits to pixels and global SED-fitting to a galaxy's colors. We find that with optical-only colors, the systematic errors due to differences among the models are well constrained. The largest impact on the age and SFR e-folding time estimates in the pixels arises from differences between the Maraston models and the Bruzual&Charlot models, when optical colors are used. This results in systematic differences larger than the 2{\sigma} uncertainties in over 10 percent of all pixels in the galaxy sample. The effect of restricting the available passbands is more severe. In 26 percent of pixels in the full sample, passband limitations result in systematic biases in the age estimates which are larger than the 2{\sigma} uncertainties. Systematic effects from model differences are reexamined using Near-IR colors for a subsample of 46 galaxies in the GOODS-NICMOS survey. For z > 1, the observed optical/NIR colors span the rest frame UV-optical SED, and the use of different models does not significantly bias the estimates of the stellar population parameters compared to using optical-only colors. We then illustrate how pixel-z can be applied robustly to make detailed studies of substructure in high redshift galaxies such as (a) radial gradients of age, SFR, sSFR and dust and (b) the distribution of these properties within subcomponents such as spiral arms and clumps. Finally, we show preliminary results from the CANDELS survey illustrating how the new HST/WFC3 data can be exploited to probe substructure in z~1-3 galaxies.

We use SDSS photometry of 73 million stars to simultaneously obtain best-fit main-sequence stellar energy distribution (SED) and amount of dust extinction along the line of sight towards each star. Using a subsample of 23 million stars with 2MASS photometry, whose addition enables more robust results, we show that SDSS photometry alone is sufficient to break degeneracies between intrinsic stellar color and dust amount when the shape of extinction curve is fixed. When using both SDSS and 2MASS photometry, the ratio of the total to selective absorption, $R_V$, can be determined with an uncertainty of about 0.1 for most stars in high-extinction regions. These fits enable detailed studies of the dust properties and its spatial distribution, and of the stellar spatial distribution at low Galactic latitudes. Our results are in good agreement with the extinction normalization given by the Schlegel et al. (1998, SFD) dust maps at high northern Galactic latitudes, but indicate that the SFD extinction map appears to be consistently overestimated by about 20% in the southern sky, in agreement with Schlafly et al. (2010). The constraints on the shape of the dust extinction curve across the SDSS and 2MASS bandpasses support the models by Fitzpatrick (1999) and Cardelli et al. (1989). For the latter, we find an $R_V=3.0\pm0.1$(random) $\pm0.1$(systematic) over most of the high-latitude sky. At low Galactic latitudes (|b|<5), we demonstrate that the SFD map cannot be reliably used to correct for extinction as most stars are embedded in dust, rather than behind it. We introduce a method for efficient selection of candidate red giant stars in the disk, dubbed "dusty parallax relation", which utilizes a correlation between distance and the extinction along the line of sight. We make these best-fit parameters, as well as all the input SDSS and 2MASS data, publicly available in a user-friendly format.

We investigate the use of dimensionality reduction techniques for the classification of stellar spectra selected from the SDSS. Using local linear embedding (LLE), a technique that preserves the local (and possibly non-linear) structure within high dimensional data sets, we show that the majority of stellar spectra can be represented as a one dimensional sequence within a three dimensional space. The position along this sequence is highly correlated with spectral temperature. Deviations from this "stellar locus" are indicative of spectra with strong emission lines (including misclassified galaxies) or broad absorption lines (e.g. Carbon stars). Based on this analysis, we propose a hierarchical classification scheme using LLE that progressively identifies and classifies stellar spectra in a manner that requires no feature extraction and that can reproduce the classic MK classifications to an accuracy of one type.

We explore the utility of Karhunen Loeve (KL) analysis in solving practical problems in the analysis of gravitational shear surveys. Shear catalogs from large-field weak lensing surveys will be subject to many systematic limitations, notably incomplete coverage and pixel-level masking due to foreground sources. We develop a method to use two dimensional KL eigenmodes of shear to interpolate noisy shear measurements across masked regions. We explore the results of this method with simulated shear catalogs, using statistics of high-convergence regions in the resulting map. We find that the KL procedure not only minimizes the bias due to masked regions in the field, it also reduces spurious peak counts from shape noise by a factor of ~ 3 in the cosmologically sensitive regime. This indicates that KL reconstructions of masked shear are not only useful for creating robust convergence maps from masked shear catalogs, but also offer promise of improved parameter constraints within studies of shear peak statistics.

We present a new calculation of the cross sections for charged current (CC) and neutral current (NC) $\nu N$ and $\bar{\nu} N$ interactions in the neutrino energy range $10^{4}<E_{\nu}<10^{12}$ GeV using the most recent MSTW parton distribution functions (PDFs), MSTW 2008. We also present the associated uncertainties propagated from the PDFs, as well as parametrizations of the cross section central values, their uncertainty bounds, and the inelasticity distributions for ease of use in Monte Carlo simulations. For the latter we only provide parametrizations for energies above $10^7$ GeV. Finally, we assess the feasibility of future neutrino experiments to constrain the $\nu N$ cross section in the ultra-high energy (UHE) regime using a technique that is independent of the flux spectrum of incident neutrinos. A significant deviation from the predicted Standard Model cross sections could be an indication of new physics, such as extra space-time dimensions, and we present expected constraints on such models as a function of the number of events observed in a future subterranean neutrino detector.

We report on studies of the viability and sensitivity of the Askaryan Radio Array (ARA), a new initiative to develop a Teraton-scale ultra-high energy neutrino detector in deep, radio-transparent ice near Amundsen-Scott station at the South Pole. An initial prototype ARA detector system was installed in January 2011, and has been operating continuously since then. We report on studies of the background radio noise levels, the radio clarity of the ice, and the estimated sensitivity of the planned ARA array given these results, based on the first five months of operation. Anthropogenic radio interference in the vicinity of the South Pole currently leads to a few-percent loss of data, but no overall effect on the background noise levels, which are dominated by the thermal noise floor of the cold polar ice, and galactic noise at lower frequencies. We have also successfully detected signals originating from a 2.5 km deep impulse generator at a distance of over 3 km from our prototype detector, confirming prior estimates of kilometer-scale attenuation lengths for cold polar ice. These are also the first such measurements for propagation over such large slant distances in ice. Based on these data, ARA-37, the 200 km^2 array now under construction, will achieve the highest sensitivity of any planned or existing neutrino detector in the 10^{16}-10^{19} eV energy range.

We set the first limits on the ultra-high energy (UHE) neutrino fluence at energies greater than 10^9 GeV from gamma-ray bursts (GRBs) based on data from the second flight of the ANtarctic Impulsive Transient Antenna (ANITA). During the 31 day flight of ANITA-II, 26 GRBs were recorded by Swift or Fermi. Of these, we analyzed the 12 GRBs which occurred during quiet periods when the payload was away from anthropogenic activity. In a blind analysis, we observe 0 events on a total background of 0.0044 events in the combined prompt window for all 12 low-background bursts. We also observe 0 events from the remaining 14 bursts. We place a 90% confidence level limit on the E^-4 prompt neutrino fluence of 2.5x10^17 GeV^3/cm^2 between 10^8 and 10^12 GeV from GRB090107A. This is the first reported limit on the UHE neutrino fluence from GRBs above 10^9 GeV, and the strongest limit above 10^8 GeV.

Supernova rates are directly coupled to high mass stellar birth and evolution. As such, they are one of the few direct measures of the history of cosmic stellar evolution. In this paper we describe an probabilistic technique for identifying supernovae within spectroscopic samples of galaxies. We present a study of 52 type Ia supernovae ranging in age from -14 days to +40 days extracted from a parent sample of \simeq 50,000 spectra from the SDSS DR5. We find a Supernova Rate (SNR) of 0.472^{+0.048}_{-0.039}(Systematic)^{+0.081}_{-0.071}(Statistical)SNu at a redshift of <z> = 0.1. This value is higher than other values at low redshift at the 1{\sigma}, but is consistent at the 3{\sigma} level. The 52 supernova candidates used in this study comprise the third largest sample of supernovae used in a type Ia rate determination to date. In this paper we demonstrate the potential for the described approach for detecting supernovae in future spectroscopic surveys.

We have conducted a search for extended energy deposition trails left by ultra-relativistic magnetic monopoles interacting in Antarctic ice. The non-observation of any satisfactory candidates in the 31 days of accumulated ANITA-II flight data results in an upper limit on the diffuse flux of relativistic monopoles. We obtain a 90% C.L. limit of order 10^{-19}/(cm^2-s-sr) for values of Lorentz boost factor 10^{10}<gamma at the anticipated energy E=10^{16} GeV. This bound is stronger than all previously published experimental limits for this kinematic range.

We constrain the linear and quadratic bias parameters from the configuration dependence of the three-point correlation function (3PCF) in both redshift and projected space, utilizing measurements of spectroscopic galaxies in the Sloan Digital Sky Survey (SDSS) Main Galaxy Sample. We show that bright galaxies (M_r < -21.5) are biased tracers of mass, measured at a significance of 4.5 sigma in redshift space and 2.5 sigma in projected space by using a thorough error analysis in the quasi-linear regime (9-27 Mpc/h). Measurements on a fainter galaxy sample are consistent with an unbiased model. We demonstrate that a linear bias model appears sufficient to explain the galaxy-mass bias of our samples, although a model using both linear and quadratic terms results in a better fit. In contrast, the bias values obtained from the linear model appear in better agreement with the data by inspection of the relative bias, and yield implied values of sigma_8 that are more consistent with current constraints. We investigate the covariance of the 3PCF, which itself is a measurement of galaxy clustering. We assess the accuracy of our error estimates by comparing results from mock galaxy catalogs to jackknife re-sampling methods. We identify significant differences in the structure of the covariance. However, the impact of these discrepancies appears to be mitigated by an eigenmode analysis that can account for the noisy, unresolved modes. Our results demonstrate that using this technique is sufficient to remove potential systematics even when using less-than-ideal methods to estimate errors.

The three-point correlation function (3PCF) provides an important view into the clustering of galaxies that is not available to its lower order cousin, the two-point correlation function (2PCF). Higher order statistics, such as the 3PCF, are necessary to probe the non-Gaussian structure and shape information expected in these distributions. We measure the clustering of spectroscopic galaxies in the Main Galaxy Sample of the Sloan Digital Sky Survey (SDSS), focusing on the shape or configuration dependence of the reduced 3PCF in both redshift and projected space. This work constitutes the largest number of galaxies ever used to investigate the reduced 3PCF, using over 220,000 galaxies in three volume-limited samples. We find significant configuration dependence of the reduced 3PCF at 3-27 Mpc/h, in agreement with LCDM predictions and in disagreement with the hierarchical ansatz. Below 6 Mpc/h, the redshift space reduced 3PCF shows a smaller amplitude and weak configuration dependence in comparison with projected measurements suggesting that redshift distortions, and not galaxy bias, can make the reduced 3PCF appear consistent with the hierarchical ansatz. The reduced 3PCF shows a weaker dependence on luminosity than the 2PCF, with no significant dependence on scales above 9 Mpc/h. On scales less than 9 Mpc/h, the reduced 3PCF appears more affected by galaxy color than luminosty. We demonstrate the extreme sensitivity of the 3PCF to systematic effects such as sky completeness and binning scheme, along with the difficulty of resolving the errors. Some comparable analyses make assumptions that do not consistently account for these effects.

This is an erratum to our paper in Physical Review D82:022004,2010, corresponding to preprint: arXiv:1003.2961 .

We present a new method for constructing three-dimensional mass maps from gravitational lensing shear data. We solve the lensing inversion problem using truncation of singular values (within the context of generalized least squares estimation) without a priori assumptions about the statistical nature of the signal. This singular value framework allows a quantitative comparison between different filtering methods: we evaluate our method beside the previously explored Wiener filter approaches. Our method yields near-optimal angular resolution of the lensing reconstruction and allows cluster sized halos to be de-blended robustly. It allows for mass reconstructions which are 2-3 orders-of-magnitude faster than the Wiener filter approach; in particular, we estimate that an all-sky reconstruction with arcminute resolution could be performed on a time-scale of hours. We find however that linear, non-parametric reconstructions have a fundamental limitation in the resolution achieved in the redshift direction.

Large, multi-frequency imaging surveys, such as the Large Synaptic Survey Telescope (LSST), need to do near-real time analysis of very large datasets. This raises a host of statistical and computational problems where standard methods do not work. In this paper, we study a proposed method for combining stacks of images into a single summary image, sometimes referred to as a template. This task is commonly referred to as image coaddition. In part, we focus on a method proposed in previous work, which outlines a procedure for combining stacks of images in an online fashion in the Fourier domain. We evaluate this method by comparing it to two straightforward methods through the use of various criteria and simulations. Note that the goal is not to propose these comparison methods for use in their own right, but to ensure that additional complexity also provides substantially improved performance.

Digital planetariums can provide a broader range of educational experiences than the more classical planetariums that use star-balls. This is because of their ability to project images, content from current research and the 3D distribution of the stars and galaxies. While there are hundreds of planetariums in the country the reason that few of these are full digital is the cost. In collaboration with Microsoft Research (MSR) we have developed a way to digitize existing planetariums for approximately \$40,000 using software freely available. We describe here how off the shelf equipment, together with MSR's WorldWide Telescope client can provide a rich and truly interactive experience. This will enable students and the public to pan though multi-wavelength full-sky scientific data sets, explore 3d visualizations of our Solar System (including trajectories of millions of minor planets), near-by stars, and the SDSS galaxy catalog.

We report on the status of the Salt Sensor Array (SalSA), a proposed experiment for detecting ultra-high energy neutrinos through the radio \v{C}erenkov technique with an array of radio-microwave antennas embedded in a large, naturally occurring salt formation. We review the measurements to date aimed at assessing SalSA's feasibility, including a return visit of the Hockley Salt Mine in Hockley, Texas, and discuss the current status of the project.

The cross-identification of sources in separate catalogs is one of the most basic tasks in observational astronomy. It is, however, surprisingly difficult and generally ill-defined. Recently Budav\'ari & Szalay (2008) formulated the problem in the realm of probability theory, and laid down the statistical foundations of an extensible methodology. In this paper, we apply their Bayesian approach to stars that, we know, can move measurably on the sky, with detectable proper motion, and show how to associate their observations. We study models on a sample of stars in the Sloan Digital Sky Survey, which allow for an unknown proper motion per object, and demonstrate the improvements over the analytic static model. Our models and conclusions are directly applicable to upcoming surveys such as PanSTARRS, the Dark Energy Survey, Sky Mapper, and the LSST, whose data sets will contain hundreds of millions of stars observed multiple times over several years.

The Antarctic Impulsive Transient Antenna (ANITA) completed its second long-duration balloon flight in January 2009, with 31 days aloft (28.5 live days) over Antarctica. ANITA searches for impulsive coherent radio Cherenkov emission from 200 to 1200 MHz, arising from the Askaryan charge excess in ultra-high energy neutrino-induced cascades within Antarctic ice. This flight included significant improvements over the first flight in the payload sensitivity, efficiency, and a flight trajectory over deeper ice. Analysis of in-flight calibration pulses from surface and sub-surface locations verifies the expected sensitivity. In a blind analysis, we find 2 surviving events on a background, mostly anthropogenic, of 0.97+-0.42 events. We set the strongest limit to date for 1-1000 EeV cosmic neutrinos, excluding several current cosmogenic neutrino models.

We report the observation of sixteen cosmic ray events of mean energy of 1.5 x 10^{19} eV, via radio pulses originating from the interaction of the cosmic ray air shower with the Antarctic geomagnetic field, a process known as geosynchrotron emission. We present the first ultra-wideband, far-field measurements of the radio spectral density of geosynchrotron emission in the range from 300-1000 MHz. The emission is 100% linearly polarized in the plane perpendicular to the projected geomagnetic field. Fourteen of our observed events are seen to have a phase-inversion due to reflection of the radio beam off the ice surface, and two additional events are seen directly from above the horizon.

We extend a recently developed galaxy morphology classification method, Quantitative Multiwavelength Morphology (QMM), to connect galaxy morphologies to their underlying physical properties. The traditional classification of galaxies approaches the problem separately through either morphological classification or, in more recent times, through analysis of physical properties. A combined approach has significant potential in producing a consistent and accurate classification scheme as well as shedding light on the origin and evolution of galaxy morphology. Here we present an analysis of a volume limited sample of 31703 galaxies from the fourth data release of the Sloan Digital Sky Survey. We use an image analysis method called Pixel-z to extract the underlying physical properties of the galaxies, which is then quantified using the concentration, asymmetry and clumpiness (CAS) parameters. The galaxies also have their multiwavelength morphologies quantified using QMM, and these results are then related to the distributed physical properties through a regression analysis. We show that this method can be used to relate the spatial distribution of physical properties with the morphological properties of galaxies.

A survey that can cover the sky in optical bands over wide fields to faint magnitudes with a fast cadence will enable many of the exciting science opportunities of the next decade. The Large Synoptic Survey Telescope (LSST) will have an effective aperture of 6.7 meters and an imaging camera with field of view of 9.6 deg^2, and will be devoted to a ten-year imaging survey over 20,000 deg^2 south of +15 deg. Each pointing will be imaged 2000 times with fifteen second exposures in six broad bands from 0.35 to 1.1 microns, to a total point-source depth of r~27.5. The LSST Science Book describes the basic parameters of the LSST hardware, software, and observing plans. The book discusses educational and outreach opportunities, then goes on to describe a broad range of science that LSST will revolutionize: mapping the inner and outer Solar System, stellar populations in the Milky Way and nearby galaxies, the structure of the Milky Way disk and halo and other objects in the Local Volume, transient and variable objects both at low and high redshift, and the properties of normal and active galaxies at low and high redshift. It then turns to far-field cosmological topics, exploring properties of supernovae to z~1, strong and weak lensing, the large-scale distribution of galaxies and baryon oscillations, and how these different probes may be combined to constrain cosmological models and the physics of dark energy.

As our capacity to study ever-expanding domains of our science has increased (including the time domain, non-electromagnetic phenomena, magnetized plasmas, and numerous sky surveys in multiple wavebands with broad spatial coverage and unprecedented depths), so have the horizons of our understanding of the Universe been similarly expanding. This expansion is coupled to the exponential data deluge from multiple sky surveys, which have grown from gigabytes into terabytes during the past decade, and will grow from terabytes into Petabytes (even hundreds of Petabytes) in the next decade. With this increased vastness of information, there is a growing gap between our awareness of that information and our understanding of it. Training the next generation in the fine art of deriving intelligent understanding from data is needed for the success of sciences, communities, projects, agencies, businesses, and economies. This is true for both specialists (scientists) and non-specialists (everyone else: the public, educators and students, workforce). Specialists must learn and apply new data science research techniques in order to advance our understanding of the Universe. Non-specialists require information literacy skills as productive members of the 21st century workforce, integrating foundational skills for lifelong learning in a world increasingly dominated by data. We address the impact of the emerging discipline of data science on astronomy education within two contexts: formal education and lifelong learners.

In this second of a series of papers on spatially resolved star formation, we investigate the impact of the density-morphology relation of galaxies on the spatial variation of star formation (SF) and its dependence on environment. We find that while a density-morphology relation is present for the sample, it cannot solely explain the observed suppression of SF in galaxies in high-density environments. We also find that early-type and late-type galaxies exhibit distinct radial star formation rate (SFR) distributions, with early-types having a SFR distribution that extends further relative to the galaxy scale length, compared to late-types at all densities. We find that a suppression of SF in the highest density environments is found in the highest star forming galaxies for both galaxy types. This suppression occurs in the innermost regions in late-types (r <= 0.125 Petrosian radii), and further out in radius in early-types (0.125< r <= 0.25 Petrosian radii). When the full sample is considered no clear suppression of SF is detected, indicating that the environmental trends are driven only by the highest SF galaxies. We demonstrate that the density-morphology relation alone cannot account for the suppression of SF in the highest density environments. This points to an environmentally-governed evolutionary mechanism that affects the SF in the innermost regions in both early and late-type galaxies. We suggest that this is a natural consequence of the "downsizing" of SF in galaxies.

We introduce Locally Linear Embedding (LLE) to the astronomical community as a new classification technique, using SDSS spectra as an example data set. LLE is a nonlinear dimensionality reduction technique which has been studied in the context of computer perception. We compare the performance of LLE to well-known spectral classification techniques, e.g. principal component analysis and line-ratio diagnostics. We find that LLE combines the strengths of both methods in a single, coherent technique, and leads to improved classification of emission-line spectra at a relatively small computational cost. We also present a data subsampling technique that preserves local information content, and proves effective for creating small, efficient training samples from a large, high-dimensional data sets. Software used in this LLE-based classification is made available.

We discuss design considerations and simulation results for IceRay, a proposed large-scale ultra-high energy (UHE) neutrino detector at the South Pole. The array is designed to detect the coherent Askaryan radio emission from UHE neutrino interactions in the ice, with the goal of detecting the cosmogenic neutrino flux with reasonable event rates. Operating in coincidence with the IceCube neutrino detector would allow complete calorimetry of a subset of the events. We also report on the status of a testbed IceRay station which incorporates both ANITA and IceCube technology and will provide year-round monitoring of the radio environment at the South Pole.

Under the unified model for active galactic nuclei (AGNs), narrow-line (Type 2) AGNs are, in fact, broad-line (Type 1) AGNs but each with a heavily obscured accretion disk. We would therefore expect the optical continuum emission from Type 2 AGN to be composed mainly of stellar light and non-variable on the time-scales of months to years. In this work we probe the spectroscopic variability of galaxies and narrow-line AGNs using the multi-epoch data in the Sloan Digital Sky Survey (SDSS) Data Release 6. The sample contains 18,435 sources for which there exist pairs of spectroscopic observations (with a maximum separation in time of ~700 days) covering a wavelength range of 3900-8900 angstrom. To obtain a reliable repeatability measurement between each spectral pair, we consider a number of techniques for spectrophotometric calibration resulting in an improved spectrophotometric calibration of a factor of two. From these data we find no obvious continuum and emission-line variability in the narrow-line AGNs on average -- the spectroscopic variability of the continuum is 0.07+/-0.26 mag in the g band and, for the emission-line ratios log10([NII]/Halpha) and log10([OIII]/Hbeta), the variability is 0.02+/-0.03 dex and 0.06+/-0.08 dex, respectively. From the continuum variability measurement we set an upper limit on the ratio between the flux of varying spectral component, presumably related to AGN activities, and that of host galaxy to be ~30%. We provide the corresponding upper limits for other spectral classes, including those from the BPT diagram, eClass galaxy classification, stars and quasars.

Wide-angle surveys have been an engine for new discoveries throughout the modern history of astronomy, and have been among the most highly cited and scientifically productive observing facilities in recent years. This trend is likely to continue over the next decade, as many of the most important questions in astrophysics are best tackled with massive surveys, often in synergy with each other and in tandem with the more traditional observatories. We argue that these surveys are most productive and have the greatest impact when the data from the surveys are made public in a timely manner. The rise of the "survey astronomer" is a substantial change in the demographics of our field; one of the most important challenges of the next decade is to find ways to recognize the intellectual contributions of those who work on the infrastructure of surveys (hardware, software, survey planning and operations, and databases/data distribution), and to make career paths to allow them to thrive.

We present measurements of the quasar two-point correlation function, \xi_{Q}, over the redshift range z=0.3-2.2 based upon data from the SDSS. Using a homogeneous sample of 30,239 quasars with spectroscopic redshifts from the DR5 Quasar Catalogue, our study represents the largest sample used for this type of investigation to date. With this redshift range and an areal coverage of approx 4,000 deg^2, we sample over 25 h^-3 Gpc^3 (comoving) assuming the current LCDM cosmology. Over this redshift range, we find that the redshift-space correlation function, xi(s), is adequately fit by a single power-law, with s_{0}=5.95+/-0.45 h^-1 Mpc and \gamma_{s}=1.16+0.11-0.16 when fit over s=1-25 h^-1 Mpc. Using the projected correlation function we calculate the real-space correlation length, r_{0}=5.45+0.35-0.45 h^-1 Mpc and \gamma=1.90+0.04-0.03, over scales of rp=1-130 h^-1 Mpc. Dividing the sample into redshift slices, we find very little, if any, evidence for the evolution of quasar clustering, with the redshift-space correlation length staying roughly constant at s_{0} ~ 6-7 h^-1 Mpc at z<2.2 (and only increasing at redshifts greater than this). Comparing our clustering measurements to those reported for X-ray selected AGN at z=0.5-1, we find reasonable agreement in some cases but significantly lower correlation lengths in others. We find that the linear bias evolves from b~1.4 at z=0.5 to b~3 at z=2.2, with b(z=1.27)=2.06+/-0.03 for the full sample. We compare our data to analytical models and infer that quasars inhabit dark matter haloes of constant mass M ~2 x 10^12 h^-1 M_Sol from redshifts z~2.5 (the peak of quasar activity) to z~0. [ABRIDGED]

We report initial results of the first flight of the Antarctic Impulsive Transient Antenna (ANITA-1) 2006-2007 Long Duration Balloon flight, which searched for evidence of a diffuse flux of cosmic neutrinos above energies of 3 EeV. ANITA-1 flew for 35 days looking for radio impulses due to the Askaryan effect in neutrino-induced electromagnetic showers within the Antarctic ice sheets. We report here on our initial analysis, which was performed as a blind search of the data. No neutrino candidates are seen, with no detected physics background. We set model-independent limits based on this result. Upper limits derived from our analysis rule out the highest cosmogenic neutrino models. In a background horizontal-polarization channel, we also detect six events consistent with radio impulses from ultra-high energy extensive air showers.

Using a homogenous sample of 38,208 quasars with a sky coverage of $4000 {\rm deg^2}$ drawn from the SDSS Data Release Five quasar catalog, we study the dependence of quasar clustering on luminosity, virial black hole mass, quasar color, and radio loudness. At $z<2.5$, quasar clustering depends weakly on luminosity and virial black hole mass, with typical uncertainty levels $\sim 10%$ for the measured correlation lengths. These weak dependences are consistent with models in which substantial scatter between quasar luminosity, virial black hole mass and the host dark matter halo mass has diluted any clustering difference, where halo mass is assumed to be the relevant quantity that best correlates with clustering strength. However, the most luminous and most massive quasars are more strongly clustered (at the $\sim 2\sigma$ level) than the remainder of the sample, which we attribute to the rapid increase of the bias factor at the high-mass end of host halos. We do not observe a strong dependence of clustering strength on quasar colors within our sample. On the other hand, radio-loud quasars are more strongly clustered than are radio-quiet quasars matched in redshift and optical luminosity (or virial black hole mass), consistent with local observations of radio galaxies and radio-loud type 2 AGN. Thus radio-loud quasars reside in more massive and denser environments in the biased halo clustering picture. Using the Sheth et al.(2001) formula for the linear halo bias, the estimated host halo mass for radio-loud quasars is $\sim 10^{13} h^{-1}M_\odot$, compared to $\sim 2\times 10^{12} h^{-1}M_\odot$ for radio-quiet quasar hosts at $z\sim 1.5$.

We present a detailed report on the experimental details of the Antarctic Impulsive Transient Antenna (ANITA) long duration balloon payload, including the design philosophy and realization, physics simulations, performance of the instrument during its first Antarctic flight completed in January of 2007, and expectations for the limiting neutrino detection sensitivity. Neutrino physics results will be reported separately.

Radiowave detection of the Cherenkov radiation produced by neutrino-ice collisions requires an understanding of the radiofrequency (RF) response of cold polar ice. We herein report on a series of radioglaciological measurements performed approximately 10 km north of Taylor Dome Station, Antarctica from Dec. 6, 2006 - Dec. 16, 2006. Using RF signals broadcast from: a) an englacial discone, submerged to a depth of 100 meters and broadcasting to a surface dual polarization horn receiver, and b) a dual-polarization horn antenna on the surface transmitting signals which reflect off the underlying bed and back up to the surface receiver, we have made time-domain estimates of both the real (index-of-refraction) and imaginary (attenuation length) components of the complex ice dielectric constant. We have also measured the uniformity of ice response along two orthogonal axes in the horizontal plane. We observe a wavespeed asymmetry of order 0.1%, projected onto the vertical propagation axis, consistent with some previous measurements, but somewhat lower than others.

I review the status of the Radio Cerenkov detection technique in searches for ultra-high energy (UHE) neutrinos of cosmic origin. After outlining the physics motivations for UHE neutrino searches, I give an overview of the status of current and proposed experiments in the field.

We present the first results of a targeted survey carried out with the 305 m Arecibo telescope to detect HI-line emission from galaxies at redshift z>0.16. The targets, selected from the Sloan Digital Sky Survey database, are non-interacting disk galaxies in relatively isolated fields. We present here the HI spectra and derived HI parameters for ten objects detected in this pilot program. All are massive disk galaxies in the redshift interval 0.17-0.25 (i.e. 2-3 Gyr look-back time), with HI masses M_HI=3-8 x 10^10 Msun and high gas mass fractions (HI - to - stellar mass ratios ~10-30%). Our results demonstrate the efficacy of exploiting Arecibo's large collecting area to measure the HI mass and rotational velocity of galaxies above redshift z=0.2. In particular, this sample includes the highest redshift detections of HI emission from individual galaxies made to date. Extension of this pilot program will allow us to study the HI properties of field galaxies at cosmological distances, thus complementing ongoing radio synthesis observations of cluster samples at z~0.2.

We use galaxy surface brightness as prior information to improve photometric redshift (photo-z) estimation. We apply our template-based photo-z method to imaging data from the ground-based VVDS survey and the space-based GOODS field from HST, and use spectroscopic redshifts to test our photometric redshifts for different galaxy types and redshifts. We find that the surface brightness prior eliminates a large fraction of outliers by lifting the degeneracy between the Lyman and 4000 Angstrom breaks. Bias and scatter are improved by about a factor of 2 with the prior for both the ground and space data. Ongoing and planned surveys from the ground and space will benefit, provided that care is taken in measurements of galaxy sizes and in the application of the prior. We discuss the image quality and signal-to-noise requirements that enable the surface brightness prior to be successfully applied.

We present measurements of the transmission of radio/microwave pulses through salt in the Cote Blanche salt mine operated by the North American Salt Company in St. Mary Parish, Louisiana. These results are from data taken in the southwestern region of the 1500 ft. (457 m) deep level of the mine on our third and most recent visit to the mine. We transmitted and received a fast, high-power, broadband pulse from within three vertical boreholes that were drilled to depths of 100 ft. (30 m) and 200 ft. below the 1500 ft. level using three different pairs of dipole antennas whose bandwidths span 125 to 900 MHz. By measuring the relative strength of the received pulses between boreholes with separations of 50 m and 169 m, we deduce the attenuation of the signal attributed to the salt medium. We fit the frequency dependence of the attenuation to a power law and find the best fit field attenuation lengths to be 93 \pm 7 m at 150 MHz, 63 \pm 3 m at 300 MHz, and 36 \pm 2 m at 800 MHz. This is the most precise measurement of radio attenuation in a natural salt formation to date. We assess the implications of this measurement for a future neutrino detector in salt.

We use the photometric information contained in individual pixels of 44,964 (0.019<z<0.125 and -23.5<M_r<-20.5) galaxies in the Fourth Data Release (DR4) of the Sloan Digital Sky Survey to investigate the effects of environment on galaxy star formation (SF). We use the pixel-z technique, which combines stellar population synthesis models with photometric redshift template fitting on the scale of individual pixels in galaxy images. Spectral energy distributions are constructed, sampling a wide range of properties such as age, star formation rate (SFR), dust obscuration and metallicity. By summing the SFRs in the pixels, we demonstrate that the distribution of total galaxy SFR shifts to lower values as the local density of surrounding galaxies increases, as found in other studies. The effect is most prominent in the galaxies with the highest star formation, and we see the break in the SFR-density relation at a local galaxy density of $\approx 0.05 $(Mpc/h)$^{-3}$. Since our method allows us to spatially resolve the SF distribution within galaxies, we can calculate the mean SFR of each galaxy as a function of radius. We find that on average the mean SFR is dominated by SF in the central regions of galaxies, and that the trend for suppression of SFR in high density environments is driven by a reduction in this nuclear SF. We also find that the mean SFR in the outskirts is largely independent of environmental effects. This trend in the mean SFR is shared by galaxies which are highly star forming, while those which are weakly star forming show no statistically significant correlation between their environment and the mean SFR at any radius.

Virtual observatories will give astronomers easy access to an unprecedented amount of data. Extracting scientific knowledge from these data will increasingly demand both efficient algorithms as well as the power of parallel computers. Nearly all efficient analyses of large astronomical datasets use trees as their fundamental data structure. Writing efficient tree-based techniques, a task that is time-consuming even on single-processor computers, is exceedingly cumbersome on massively parallel platforms (MPPs). Most applications that run on MPPs are simulation codes, since the expense of developing them is offset by the fact that they will be used for many years by many researchers. In contrast, data analysis codes change far more rapidly, are often unique to individual researchers, and therefore accommodate little reuse. Consequently, the economics of the current high-performance computing development paradigm for MPPs does not favor data analysis applications. We have therefore built a library, called Ntropy, that provides a flexible, extensible, and easy-to-use way of developing tree-based data analysis algorithms for both serial and parallel platforms. Our experience has shown that not only does our library save development time, it can also deliver excellent serial performance and parallel scalability. Furthermore, Ntropy makes it easy for an astronomer with little or no parallel programming experience to quickly scale their application to a distributed multiprocessor environment. By minimizing development time for efficient and scalable data analysis, we enable wide-scale knowledge discovery on massive datasets.

Astronomy began as a visual science, first through careful observations of the sky using either an eyepiece or the naked eye, then on to the preservation of those images with photographic media and finally the digital encoding of that information via CCDs. This last step has enabled astronomy to move into a fully automated era -- where data is recorded, analyzed and interpreted often without any direct visual inspection. Sky in Google Earth completes that circle by providing an intuitive visual interface to some of the largest astronomical imaging surveys covering the full sky. By streaming imagery, catalogs, time domain data, and ancillary information directly to a user, Sky can provide the general public as well as professional and amateur astronomers alike with a wealth of information for use in education and research. We provide here a brief introduction to Sky in Google Earth, focusing on its extensible environment, how it may be integrated into the research process and how it can bring astronomical research to a broader community. With an open interface available on Linux, Mac OS X and Windows, applications developed within Sky are accessible not just within the Google framework but through any visual browser that supports the Keyhole Markup Language. We present Sky as the embodiment of a virtual telescope.

We investigate a possible new technique for microwave measurements of ultra-high energy cosmic ray (UHECR) extensive air showers which relies on detection of expected continuum radiation in the microwave range, caused by free-electron collisions with neutrals in the tenuous plasma left after the passage of the shower. We performed an initial experiment at the AWA (Argonne Wakefield Accelerator) laboratory in 2003 and measured broadband microwave emission from air ionized via high energy electrons and photons. A follow-up experiment at SLAC (Stanford Linear Accelerator Center) in summer of 2004 confirmed the major features of the previous AWA observations with better precision and made additional measurements relevant to the calorimetric capabilities of the method. Prompted by these results we built a prototype detector using satellite television technology, and have made measurements indicating possible detection of cosmic ray extensive air showers. The method, if confirmed by experiments now in progress, could provide a high-duty cycle complement to current nitrogen fluorescence observations of UHECR, which are limited to dark, clear nights. By contrast, decimeter microwave observations can be made both night and day, in clear or cloudy weather, or even in the presence of moderate precipitation.

Lensing tomography with multi-color imaging surveys can probe dark energy and the cosmological power spectrum. However accurate photometric redshifts for tomography out to high redshift require imaging in five or more bands, which is expensive to carry out over thousands of square degrees. Since lensing makes coarse, statistical use of redshift information, we explore the prospects for tomography using limited color information from two or three band imaging. With an appropriate calibration sample, we find that it is feasible to create up to four redshift bins using imaging data in just the g, r and i bands. We construct such redshift sub-samples from mock catalogs by clustering galaxies in color space and discarding regions with poorly-defined redshift distributions. The loss of galaxy number density decreases the accuracy of lensing measurements, but even losing half or more of the galaxies is not a severe loss for large area surveys. We estimate the errors on lensing power spectra and dark energy parameters with color tomography and discuss trade-offs in survey area and filter choice. We discuss the systematic errors that may change our conclusions, especially the information needed to tackle intrinsic alignments.

(Abridged) We study the two-point correlation function of a uniformly selected sample of 4,426 luminous optical quasars with redshift $2.9 \le z\le 5.4$ selected over 4041 deg$^2$ from the Fifth Data Release of the Sloan Digital Sky Survey. For a real-space correlation function of the form $\xi(r)=(r/r_0)^{-\gamma}$, the fitted parameters in comoving coordinates are $r_0 = 15.2 \pm 2.7 h^{-1}$ Mpc and $\gamma = 2.0 \pm 0.3$, over a scale range $4\le r_p\le 150 h^{-1}$ Mpc. Thus high-redshift quasars are appreciably more strongly clustered than their $z \approx 1.5$ counterparts, which have a comoving clustering length $r_0 \approx 6.5 h^{-1}$ Mpc. Dividing our sample into two redshift bins: $2.9\le z\le 3.5$ and $z\ge 3.5$, and assuming a power-law index $\gamma=2.0$, we find a correlation length of $r_0 = 16.9 \pm 1.7 h^{-1}$ Mpc for the former, and $r_0 = 24.3 \pm 2.4 h^{-1}$ Mpc for the latter. Following Martini & Weinberg, we relate the clustering strength and quasar number density to the quasar lifetimes and duty cycle. Using the Sheth & Tormen halo mass function, the quasar lifetime is estimated to lie in the range $4\sim 50$ Myr for quasars with $2.9\le z\le 3.5$; and $30\sim 600$ Myr for quasars with $z\ge 3.5$. The corresponding duty cycles are $0.004\sim 0.05$ for the lower redshift bin and $0.03\sim 0.6$ for the higher redshift bin. The minimum mass of halos in which these quasars reside is $2-3\times 10^{12}\ h^{-1}M_\odot$ for quasars with $2.9\le z\le 3.5$ and $4-6\times 10^{12}\ h^{-1}M_\odot$ for quasars with $z\ge 3.5$.

Using subspace methods, we study the distribution of physical components of galaxies in wavelength space. We find that it is valid to assume that the stellar and the gaseous components of galaxies span complementary subspaces. To first order, stellar and gaseous spectral features can be extracted from galaxy spectra through a simple matrix multiplication. By comparing the stellar continua obtained respectively using the model-based and the empirical approach through a commonality measure, we conclude that the latter may lose higher-order spectral features.

(Abridged) The Large Synoptic Survey Telescope (LSST) is currently by far the most ambitious proposed ground-based optical survey. Solar System mapping is one of the four key scientific design drivers, with emphasis on efficient Near-Earth Object (NEO) and Potentially Hazardous Asteroid (PHA) detection, orbit determination, and characterization. In a continuous observing campaign of pairs of 15 second exposures of its 3,200 megapixel camera, LSST will cover the entire available sky every three nights in two photometric bands to a depth of V=25 per visit (two exposures), with exquisitely accurate astrometry and photometry. Over the proposed survey lifetime of 10 years, each sky location would be visited about 1000 times. The baseline design satisfies strong constraints on the cadence of observations mandated by PHAs such as closely spaced pairs of observations to link different detections and short exposures to avoid trailing losses. Equally important, due to frequent repeat visits LSST will effectively provide its own follow-up to derive orbits for detected moving objects. Detailed modeling of LSST operations, incorporating real historical weather and seeing data from LSST site at Cerro Pachon, shows that LSST using its baseline design cadence could find 90% of the PHAs with diameters larger than 250 m, and 75% of those greater than 140 m within ten years. However, by optimizing sky coverage, the ongoing simulations suggest that the LSST system, with its first light in 2013, can reach the Congressional mandate of cataloging 90% of PHAs larger than 140m by 2020.

We report on the first observations of the Askaryan effect in ice: coherent impulsive radio Cherenkov radiation from the charge asymmetry in an electromagnetic (EM) shower. Such radiation has been observed in silica sand and rock salt, but this is the first direct observation from an EM shower in ice. These measurements are important since the majority of experiments to date that rely on the effect for ultra-high energy neutrino detection are being performed using ice as the target medium. As part of the complete validation process for the Antarctic Impulsive Transient Antenna (ANITA) experiment, we performed an experiment at the Stanford Linear Accelerator Center (SLAC) in June 2006 using a 7.5 metric ton ice target, yielding results fully consistent with theoretical expectations.

We measure the cosmological matter density by observing the positions of baryon acoustic oscillations in the clustering of galaxies in the Sloan Digital Sky Survey (SDSS). We jointly analyse the main galaxies and LRGs in the SDSS DR5 sample, using over half a million galaxies in total. The oscillations are detected with 99.74% confidence (3.0sigma assuming Gaussianity) compared to a smooth power spectrum. When combined with the observed scale of the peaks within the CMB, we find a best-fit value of Omega_m=0.256+0.029-0.024 (68% confidence interval), for a flat Lambda cosmology when marginalising over the Hubble parameter and the baryon density. This value of the matter density is derived from the locations of the baryon oscillations in the galaxy power spectrum and in the CMB, and does not include any information from the overall shape of the power spectra. This is an extremely clean cosmological measurement as the physics of the baryon acoustic oscillation production is well understood, and the positions of the oscillations are expected to be independent of systematics such as galaxy bias.

We measure the large-scale real-space power spectrum P(k) using luminous red galaxies (LRGs) in the Sloan Digital Sky Survey (SDSS) and use this measurement to sharpen constraints on cosmological parameters from the Wilkinson Microwave Anisotropy Probe (WMAP). We employ a matrix-based power spectrum estimation method using Pseudo-Karhunen-Loeve eigenmodes, producing uncorrelated minimum-variance measurements in 20 k-bands of both the clustering power and its anisotropy due to redshift-space distortions, with narrow and well-behaved window functions in the range 0.01h/Mpc < k < 0.2h/Mpc. Results from the LRG and main galaxy samples are consistent, with the former providing higher signal-to-noise. Our results are robust to omitting angular and radial density fluctuations and are consistent between different parts of the sky. They provide a striking confirmation of the predicted large-scale LCDM power spectrum. Combining only SDSS LRG and WMAP data places robust constraints on many cosmological parameters that complement prior analyses of multiple data sets. The LRGs provide independent cross-checks on Om and the baryon fraction in good agreement with WMAP. Within the context of flat LCDM models, our LRG measurements complement WMAP by sharpening the constraints on the matter density, the neutrino density and the tensor amplitude by about a factor of two, giving Omega_m=0.24+-0.02 (1 sigma), sum m_nu < 0.9 eV (95%) and r<0.3 (95%). Baryon oscillations are clearly detected and provide a robust measurement of the comoving distance to the median survey redshift z=0.35 independent of curvature and dark energy properties. Within the LCDM framework, our power spectrum measurement improves the evidence for spatial flatness, sharpening the curvature constraint Omega_tot=1.05+-0.05 from WMAP alone to Omega_tot=1.003+-0.010. Assuming Omega_tot=1, the equation of state parameter is constrained to w=-0.94+-0.09, indicating the potential for more ambitious future LRG measurements to provide precision tests of the nature of dark energy. All these constraints are essentially independent of scales k>0.1h/Mpc and associated nonlinear complications, yet agree well with more aggressive published analyses where nonlinear modeling is crucial.

We present a Fourier analysis of the clustering of galaxies in the combined Main galaxy and Luminous Red Galaxy (LRG) Sloan Digital Sky Survey (SDSS) Data Release 5 (DR5) sample. The aim of our analysis is to consider how well we can measure the cosmological matter density using the signature of the horizon at matter-radiation equality embedded in the large-scale power spectrum. The new data constrains the power spectrum on scales 100--600h^-1Mpc with significantly higher precision than previous analyses of just the SDSS Main galaxies, due to our larger sample and the inclusion of the LRGs. This improvement means that we can now reveal a discrepancy between the shape of the measured power and linear CDM models on scales 0.01<k<0.15hMpc^-1, with linear model fits favouring a lower matter density (Omega_m=0.22+/-0.04) on scales 0.01<k<0.06hMpc^-1 and a higher matter density (Omega_m=0.32+/-0.01) when smaller scales are included, assuming a flat LCDM model with h=0.73 and n_s=0.96. This discrepancy could be explained by scale-dependent bias and, by analysing subsamples of galaxies, we find that the ratio of small-scale to large-scale power increases with galaxy luminosity, so all of the SDSS galaxies cannot trace the same power spectrum shape over 0.01<k<0.2hMpc^-1. However, the data are insufficient to clearly show a luminosity-dependent change in the largest scale at which a significant increase in clustering is observed, although they do not rule out such an effect. Significant scale-dependent galaxy bias on large-scales, which changes with the r-band luminosity of the galaxies, could potentially explain differences in our Omega_m estimates and differences previously observed between 2dFGRS and SDSS power spectra and the resulting parameter constraints.

We present evidence of a large angle correlation between the cosmic microwave background measured by WMAP and a catalog of photometrically detected quasars from the SDSS. The observed cross correlation is (0.30 +- 0.14) microK at zero lag, with a shape consistent with that expected for correlations arising from the integrated Sachs-Wolfe effect. The photometric redshifts of the quasars are centered at z ~ 1.5, making this the deepest survey in which such a correlation has been observed. Assuming this correlation is due to the ISW effect, this constitutes the earliest evidence yet for dark energy and it can be used to constrain exotic dark energy models.

We present the first results from the Distant Radio Galaxies Optically Non-detected in the SDSS (DRaGONS) Survey. Using a novel selection technique for identifying high redshift radio galaxy (HzRG) candidates, a large sample of bright (S_{1.4GHz} > 100mJy) radio sources from the FIRST survey having no optical counterpart in the SDSS is compiled. K-band imaging with the FLAMINGOS instrument on the 4-meter telescope at Kitt Peak for 96 such candidates allows preliminary identification of HzRG candidates through the well-known K-z relation. Of the initial candidates, we identify 70 with magnitudes brighter than K \approx 19.5, and compute limiting magnitudes for the remainder. Assigning redshifts based on the K-z Hubble diagram gives a mean redshift for our sample of z=2.5 and a median redshift of z=2.0. This selection is also sensitive to a previously unseen population of anomalously red radio galaxies (r-K > 6.5-7), which may indicate significant obscuration at moderate redshifts. These obscured objects can be used to test the completeness of QSO surveys to the effects of reddenning. More than ten percent of our sample falls into this category, which may represent a sizable radio loud population missing from current optically selected AGN samples. We additionally identify 479 bright Extremely Red Objects (EROs) in the fields surrounding our HzRG candidates, to a magnitude of K=17.5, within a non-contiguous area of 2.38 square degrees. This constitutes a small overdensity of EROs surrounding the radio galaxy candidates over random fields, and we see possible evidence for a physical association of the EROs with the radio galaxies. However, examining the clustering of all K < 19.0 galaxies around the radio targets reveals no evidence of a global galaxy excess.

We investigate how well the redshift distributions of galaxies sorted into photometric redshift bins can be determined from the galaxy angular two-point correlation functions. We find that the uncertainty in the reconstructed redshift distributions depends critically on the number of parameters used in each redshift bin and the range of angular scales used, but not on the number of photometric redshift bins. Using six parameters for each photometric redshift bin, and restricting ourselves to angular scales over which the galaxy number counts are normally distributed, we find that errors in the reconstructed redshift distributions are large; i.e., they would be the dominant source of uncertainty in cosmological parameters estimated from otherwise ideal weak lensing or baryon acoustic oscillation data. However, either by reducing the number of free parameters in each redshift bin, or by (unjustifiably) applying our Gaussian analysis into the non-Gaussian regime, we find that the correlation functions can be used to reconstruct the redshift distributions with moderate precision; e.g., with mean redshifts determined to around 0.01. We also find that dividing the galaxies into two spectral types, and thereby doubling the number of redshift distribution parameters, can result in a reduction in the errors in the combined redshift distributions.

We report new limits on cosmic neutrino fluxes from the test flight of the Antarctic Impulsive Transient Antenna (ANITA) experiment, which completed an 18.4 day flight of a prototype long-duration balloon payload, called ANITA-lite, in early 2004. We search for impulsive events that could be associated with ultra-high energy neutrino interactions in the ice, and derive limits that constrain several models for ultra-high energy neutrino fluxes. We rule out the long-standing Z-burst model as the source for the ultra-high energy cosmic rays.

The evolution of the B-band galaxy luminosity function is measured using a sample of more than 11,000 galaxies with spectroscopic redshifts from the DEEP2 Redshift Survey. The rest-frame M_B versus U-B color-magnitude diagram of DEEP2 galaxies shows that the color-magnitude bi-modality seen in galaxies locally is still present at redshifts z > 1. Dividing the sample at the trough of this color bimodality into predominantly red and blue galaxies, we find that the luminosity function of each galaxy color type evolves differently. Blue counts tend to shift to brighter magnitudes at constant number density, while the red counts remain largely constant at a fixed absolute magnitude. Using Schechter functions with fixed faint-end slopes we find that M*_B for blue galaxies brightens by ~ 1.3 magnitudes per unit redshift, with no significant evolution in number density. For red galaxies M*_B brightens somewhat less with redshift, while the formal value of phi* declines. When the population of blue galaxies is subdivided into two halves using the rest-frame color as the criterion, the measured evolution of both blue subpopulations is very similar.

We present measurements of the normalised redshift-space three-point correlation function (Q_z) of galaxies from the Sloan Digital Sky Survey (SDSS) main galaxy sample. We have applied our "npt" algorithm to both a volume-limited (36738 galaxies) and magnitude-limited sample (134741 galaxies) of SDSS galaxies, and find consistent results between the two samples, thus confirming the weak luminosity dependence of Q_z recently seen by other authors. We compare our results to other Q_z measurements in the literature and find it to be consistent within the full jack-knife error estimates. However, we find these errors are significantly increased by the presence of the ``Sloan Great Wall'' (at z ~ 0.08) within these two SDSS datasets, which changes the 3-point correlation function (3PCF) by 70% on large scales (s>=10h^-1 Mpc). If we exclude this supercluster, our observed Q_z is in better agreement with that obtained from the 2dFGRS by other authors, thus demonstrating the sensitivity of these higher-order correlation functions to large-scale structures in the Universe. This analysis highlights that the SDSS datasets used here are not ``fair samples'' of the Universe for the estimation of higher-order clustering statistics and larger volumes are required. We study the shape-dependence of Q_z(s,q,theta) as one expects this measurement to depend on scale if the large scale structure in the Universe has grown via gravitational instability from Gaussian initial conditions. On small scales (s <= 6h^-1 Mpc), we see some evidence for shape-dependence in Q_z, but at present our measurements are consistent with a constant within the errors (Q_z ~ 0.75 +/- 0.05). On scales >10h^-1 Mpc, we see considerable shape-dependence in Q_z.

We present measurements of the redshift-space luminosity-weighted or `marked' correlation function in the SDSS. These are compared with a model in which the luminosity function and luminosity dependence of clustering are the same as that observed, and in which the form of the luminosity-weighted correlation function is entirely a consequence of the fact that massive halos populate dense regions. We do this by using mock catalogs which are constrained to reproduce the observed luminosity function and the luminosity dependence of clustering, as well as by using the language of the redshift-space halo-model. These analyses show that marked correlations may show a signal on large scales even if there are no large-scale physical effects--the statistical correlation between halos and their environment will produce a measureable signal. Our model is in good agreement with the measurements, indicating that the halo mass function in dense regions is top-heavy; the correlation between halo mass and large scale environment is the primary driver for correlations between galaxy properties and environment; and the luminosity of the central galaxy in a halo is different from (in general, brighter than) that of the other objects in the halo. Thus our measurement provides strong evidence for the accuracy of these three standard assumptions of galaxy formation models. These assumptions also form the basis of current halo-model based interpretations of galaxy clustering.

The two-point correlation function has been the standard statistic for quantifying how galaxies are clustered. The statistic uses the positions of galaxies, but not their properties. Clustering as a function of galaxy property, be it type, luminosity, color, etc., is usually studied by analysing a subset of the full population, the galaxies in the subset chosen because they have a similar range of properties. We explore an alternative technique---marked correlations---in which one weights galaxies by some property or `mark' when measuring clustering statistics. Marked correlations are particularly well-suited to quantifying how the properties of galaxies correlate with their environment. Therefore, measurements of marked statistics, with luminosity, stellar mass, color, star-formation rate, etc. as the mark, permit sensitive tests of galaxy formation models. We make measurements of such marked statistics in semi-analytic galaxy formation models to illustrate their utility. These measurements show that close pairs of galaxies are expected to be red, to have larger stellar masses, and to have smaller star formation rates. We also show that the simplest unbiased estimator of the particular marked statistic we use extensively is very simple to measure---it does not require construction of a random catalog---and provide an estimate of its variance. Large wide-field surveys of the sky are revolutionizing our view of galaxies and how they evolve. Our results indicate that application of marked statistics to this high quantity of high-quality data will provide a wealth of information about galaxy formation.

In this paper we describe a detailed analysis of the photometric uncertainties present within the Sloan Digital Sky Survey (SDSS) imaging survey based on repeat observations of approximately 200 square degrees of the sky. We show that, for the standard SDSS aperture systems (petrocounts, counts_model, psfcounts and cmodel_counts), the errors generated by the SDSS photometric pipeline under-estimate the observed scatter in the individual bands. The degree of disagreement is a strong function of aperture and magnitude (ranging from 20% to more than a factor of 2). We also find that the photometry in the five optical bands can be highly correlated for both point sources and galaxies, although the correlation for point sources is almost entirely due to variable objects. Without correcting for this covariance the SDSS color errors could be in over-estimated by a factor of two to three. Combining these opposing effects, the SDSS errors on the colors differ from the observed color variation by approximately 10-20% for most apertures and magnitudes. We provide a prescription to correct the errors derived from the SDSS photometric pipeline as a function of magnitude and a semi-analytic method for generating the appropriate covariance between the different photometric passbands. Given the intrinsic nature of these correlations, we expect that all current and future multi-band surveys will also observe strongly covariant magnitudes. The ability of these surveys to complete their science goals is largely dependent on color-based target selection and photometric redshifts; these results show the importance of spending a significant fraction of early survey operations on re-imaging to empirically determine the photometric covariance of any observing/reduction pipeline.

Using an eigenspectrum decomposition technique, we separate the host galaxy from the broad line active galactic nucleus (AGN) in a set of 4666 spectra from the Sloan Digital Sky Survey (SDSS), from redshifts near zero up to about 0.75. The decomposition technique uses separate sets of galaxy and quasar eigenspectra to efficiently and reliably separate the AGN and host spectroscopic components. The technique accurately reproduces the host galaxy spectrum, its contributing fraction, and its classification. We show how the accuracy of the decomposition depends upon S/N, host galaxy fraction, and the galaxy class. Based on the eigencoefficients, the sample of SDSS broad-line AGN host galaxies spans a wide range of spectral types, but the distribution differs significantly from inactive galaxies. In particular, post-starburst activity appears to be much more common among AGN host galaxies. The luminosities of the hosts are much higher than expected for normal early-type galaxies, and their colors become increasingly bluer than early-type galaxies with increasing host luminosity. Most of the AGNs with detected hosts are emitting at between 1% and 10% of their estimated Eddington luminosities, but the sensitivity of the technique usually does not extend to the Eddington limit. There are mild correlations among the AGN and host galaxy eigencoefficients, possibly indicating a link between recent star formation and the onset of AGN activity. The catalog of spectral reconstruction parameters is available as an electronic table.

We discuss the construction of a photometric redshift catalogue of Luminous Red Galaxies (LRGs) from the Sloan Digital Sky Survey (SDSS), emphasizing the principal steps necessary for constructing such a catalogue -- (i) photometrically selecting the sample, (ii) measuring photometric redshifts and their error distributions, (iii) and estimating the true redshift distribution. We compare two photometric redshift algorithms for these data and find that they give comparable results. Calibrating against the SDSS and SDSS-2dF spectroscopic surveys, we find that the photometric redshift accuracy is $\sigma \sim 0.03$ for redshifts less than 0.55 and worsens at higher redshift ($\sim 0.06$). These errors are caused by photometric scatter, as well as systematic errors in the templates, filter curves, and photometric zeropoints. We also parametrize the photometric redshift error distribution with a sum of Gaussians, and use this model to deconvolve the errors from the measured photometric redshift distribution to estimate the true redshift distribution. We pay special attention to the stability of this deconvolution, regularizing the method with a prior on the smoothness of the true redshift distribution. The methods we develop are applicable to general photometric redshift surveys.

We report the first result of the clustering analysis of Sloan Digital Sky Survey (SDSS) quasars. We compute the two-point correlation function (2PCF) of SDSS quasars in redshift space at $8h^{-1}{\rm Mpc} < s < 500h^{-1}{\rm Mpc}$, with particular attention to its baryonic signature. Our sample consists of 19986 quasars extracted from the SDSS Data Release 4 (DR4). The redshift range of the sample is $0.72 \le z \le 2.24$ (the mean redshift is $\bar z = 1.46$) and the reddening-corrected $i$-band apparent magnitude range is $15.0 \le m_{i,{\rm rc}} \le 19.1$. Due to the relatively low number density of the quasar sample, the bump in the power spectrum due to the baryon density, $\Omega_{\rm b}$, is not clearly visible. The effect of the baryon density is, however, to distort the overall shape of the 2PCF.The degree of distortion makes it an interesting alternate measure of the baryonic signature. Assuming a scale-independent linear bias and the spatially flat universe, i.e., $\Omega_{\rm b} + \Omega_{\rm d} + \Omega_\Lambda =1$, where $\Omega_{\rm d}$ and $\Omega_\Lambda$ denote the density parameters of dark matter and the cosmological constant, we combine the observed quasar 2PCF and the predicted matter 2PCF to put constraints on $\Omega_{\rm b}$ and $\Omega_\Lambda$. Our result is fitted as $0.80- 2.8\Omega_{\rm b} < \Omega_\Lambda < 0.90 - 1.4\Omega_{\rm b}$ at the 2$\sigma$ confidence level, which is consistent with results from other cosmological observations such as WMAP. (abridged)

We present an 8 sigma detection of cosmic magnification measured by the variation of quasar density due to gravitational lensing by foreground large scale structure. To make this measurement we used 3800 square degrees of photometric observations from the Sloan Digital Sky Survey (SDSS) containing \~200,000 quasars and 13 million galaxies. Our measurement of the galaxy-quasar cross-correlation function exhibits the amplitude, angular dependence and change in sign as a function of the slope of the observed quasar number counts that is expected from magnification bias due to weak gravitational lensing. We show that observational uncertainties (stellar contamination, Galactic dust extinction, seeing variations and errors in the photometric redshifts) are well controlled and do not significantly affect the lensing signal. By weighting the quasars with the number count slope, we combine the cross-correlation of quasars for our full magnitude range and detect the lensing signal at >4 sigma in all five SDSS filters. Our measurements of cosmic magnification probe scales ranging from 60 kpc/h to 10 Mpc/h and are in good agreement with theoretical predictions based on the WMAP concordance cosmology. As with galaxy-galaxy lensing, future measurements of cosmic magnification will provide useful constraints on the galaxy-mass power spectrum.

We present the "C4 Cluster Catalog", a new sample of 748 clusters of galaxies identified in the spectroscopic sample of the Second Data Release (DR2) of the Sloan Digital Sky Survey (SDSS). The C4 cluster--finding algorithm identifies clusters as overdensities in a seven-dimensional position and color space, thus minimizing projection effects which plagued previous optical clusters selection. The present C4 catalog covers ~2600 square degrees of sky with groups containing 10 members to massive clusters having over 200 cluster members with redshifts. We provide cluster properties like sky location, mean redshift, galaxy membership, summed r--band optical luminosity (L_r), velocity dispersion, and measures of substructure. We use new mock galaxy catalogs to investigate the sensitivity to the various algorithm parameters, as well as to quantify purity and completeness. These mock catalogs indicate that the C4 catalog is ~90% complete and 95% pure above M_200 = 1x10^14 solar masses and within 0.03 <=z <= 0.12. The C4 algorithm finds 98% of X-ray identified clusters and 90% of Abell clusters within 0.03 <= z <= 0.12. We show that the L_r of a cluster is a more robust estimator of the halo mass (M_200) than the line-of-sight velocity dispersion or the richness of the cluster. L_r. The final SDSS data will provide ~2500 C4 clusters and will represent one of the largest and most homogeneous samples of local clusters.

The Deep Extragalactic Exploratory Probe (DEEP) is a multi-phase research program dedicated to the study of the formation and evolution of galaxies and of large scale structure in the distant Universe. This paper describes the first five-year phase, denoted DEEP1. A series of ten DEEP1 papers will discuss a range of scientific topics (e.g., the study of photometric and spectral properties of a general distant galaxy survey, the evolution observed in galaxy populations of varied morphologies). The observational basis for these studies is the Groth Survey Strip field, a 127 square arcminute region which has been observed with the Hubble Space Telescope in both broad I-band and V-band optical filters and with the Low Resolution Imaging Spectrograph on the Keck Telescopes. Catalogs of photometric and structural parameters have been constructed for 11,547 galaxies and stars at magnitudes brighter than 29, and spectroscopy has been conducted for a magnitude-color weighted subsample of 818 objects. We evaluate three independent techniques for constructing an imaging catalog for the field from the HST data, and discuss the depth and sampling of the resultant catalogs. The selection of the spectroscopic subsample is discussed, and we describe the multifaceted approach taken to prioritizing objects of interest for a variety of scientific subprograms. A series of Monte Carlo simulations then demonstrates that the spectroscopic subsample can be adequately modeled as a simple function of magnitude and color cuts in the imaging catalog.

The Antarctic Impulsive Transient Antenna (ANITA) experiment is being developed to search for ultra-high-energy (UHE) neutrino interactions ($>3\times10^{18}$ eV) in the Antarctic ice cap. A neutrino interaction in the ice will produce a radio pulse by the means of the Askaryan effect. The large radio transparency of ice allows for such a pulse to be recorded by a cluster of balloon-borne antennas. The details of the ANITA instrument, now in a construction phase, and the science we hope to achieve is discussed. In order to prepare for the main mission, we have flown ANITA-lite during the 2003/04 austral season. ANITA-lite consisted of two quad-ridge horn antennas and a prototype RF (radio frequency) triggering and recording system. Here we present the results of an impulsive RF background survey of Antarctica, as well as proof-of-principle gain, tracking, and timing calibrations conducted by observing solar radio emissions and calibration radio-pulses. A preliminary UHE neutrino flux limit based on ANITA-lite data is also presented.

The large--scale structure (LSS) in the Universe comprises a complicated filamentary network of matter. We study this network using a high--resolution simulation of structure formation of a $\Lambda$ Cold Dark Matter cosmology. We investigate the distribution of matter between neighbouring large haloes whose masses are comparable to massive clusters of galaxies. We identify a total of 228 filaments between neighbouring clusters. Roughly half of the filaments are either warped or lie off the cluster--cluster axis. We find that straight filaments on the average are shorter than warped ones. More massive clusters are connected to more filaments than less massive ones on average. This finding indicates that the most massive clusters form at the intersections of the filamentary backbone of LSS. For straight filaments, we compute mass profiles. Radial profiles show a fairly well--defined radius, $r_s$, beyond which the profiles follow an $r^{-2}$ power law fairly closely. For the majority of filaments, $r_s$ lies between 1.5 $h^{-1}$ Mpc and 2.0 $h^{-1}$ Mpc. The enclosed overdensity inside $r_s$ varies between a few times up to 25 times mean density, independent of the length of the filaments. Along the filaments' axes, material is not distributed uniformly. Towards the clusters, the density rises, indicating the presence of the cluster infall regions. In addition, we also find some sheet--like connections between clusters. In roughly a fifth of all cluster--cluster connections where we could not identify a filament or sheet, projection effects lead to filamentary structures in the projected mass distribution. (abridged)

We present the large-scale correlation function measured from a spectroscopic sample of 46,748 luminous red galaxies from the Sloan Digital Sky Survey. The survey region covers 0.72 h^{-3} Gpc^3 over 3816 square degrees and 0.16<z<0.47, making it the best sample yet for the study of large-scale structure. We find a well-detected peak in the correlation function at 100h^{-1} Mpc separation that is an excellent match to the predicted shape and location of the imprint of the recombination-epoch acoustic oscillations on the low-redshift clustering of matter. This detection demonstrates the linear growth of structure by gravitational instability between z=1000 and the present and confirms a firm prediction of the standard cosmological theory. The acoustic peak provides a standard ruler by which we can measure the ratio of the distances to z=0.35 and z=1089 to 4% fractional accuracy and the absolute distance to z=0.35 to 5% accuracy. From the overall shape of the correlation function, we measure the matter density Omega_mh^2 to 8% and find agreement with the value from cosmic microwave background (CMB) anisotropies. Independent of the constraints provided by the CMB acoustic scale, we find Omega_m = 0.273 +- 0.025 + 0.123 (1+w_0) + 0.137 Omega_K. Including the CMB acoustic scale, we find that the spatial curvature is Omega_K=-0.010+-0.009 if the dark energy is a cosmological constant. More generally, our results provide a measurement of cosmological distance, and hence an argument for dark energy, based on a geometric method with the same simple physics as the microwave background anisotropies. The standard cosmological model convincingly passes these new and robust tests of its fundamental properties.

We describe a new experiment to search for neutrinos with energies above 3 x 10^18 eV based on the observation of short duration radio pulses that are emitted from neutrino-initiated cascades. The primary objective of the ANtarctic Impulse Transient Antenna (ANITA) mission is to measure the flux of Greisen-Zatsepin-Kuzmin (GZK) neutrinos and search for neutrinos from Active Galactic Nuclei (AGN). We present first results obtained from the successful launch of a 2-antenna prototype instrument (called ANITA-lite) that circled Antarctica for 18 days during the 03/04 Antarctic campaign and show preliminary results from attenuation length studies of electromagnetic waves at radio frequencies in Antarctic ice. The ANITA detector is funded by NASA, and the first flight is scheduled for December 2006.

We study 16,707 quasar spectra from the SDSS using the Karhunen-Lo\`eve (KL) transform (or Principal Component Analysis, PCA). The quasar eigenspectra of the full catalog reveal the following: 1st order - the mean spectrum; 2nd order - a host-galaxy component; 3rd order - the UV-optical continuum slope; 4th order - the correlations of Balmer emission lines. We find that the spectral classification of quasars is redshift and luminosity dependent, as such there does not exist a compact set (< 10 modes) of eigenspectra (covering 900 to 8000 angstrom) which can describe most variations (> 95%) of the entire catalog. We therefore construct several sets of eigenspectra in different redshift and luminosity bins. From these eigenspectra we find that quasar spectra can be classified (by the first two eigenspectra) into a sequence that is defined by a simple progression in the steepness of the slope of the continuum. We also find a dependence on redshift and luminosity in the eigencoefficients. The dominant redshift effect is a result of the evolution of the blended FeII emission (optical) and the Balmer continuum (the ``small bump''). A luminosity dependence is also present in the eigencoefficients and is related to the Baldwin effect. The eigenspectra constructed from the wavelength-selected SDSS spectra are found to agree with the principal components by Francis et al. (1992) and the well-known ``Eigenvector-1'' (Boroson and Green 1992). (Abridged)

We present measurements of the redshift--space three-point correlation function of galaxies in the Sloan Digital Sky Survey (SDSS). For the first time, we analyze the dependence of this statistic on galaxy morphology, color and luminosity. In order to control systematics due to selection effects, we used $r$--band, volume-limited samples of galaxies, constructed from the magnitude-limited SDSS data ($14.5<r<17.5$), and further divided the samples into two morphological types (early and late) or two color populations (red and blue). The three-point correlation function of SDSS galaxies follow the hierarchical relation well and the reduced three-point amplitudes in redshift--space are almost scale-independent ($Q_z=0.5\sim1.0$). In addition, their dependence on the morphology, color and luminosity is not statistically significant. Given the robust morphological, color and luminosity dependences of the two-point correlation function, this implies that galaxy biasing is complex on weakly non-linear to non-linear scales. We show that simple deterministic linear relation with the underlying mass could not explain our measurements on these scales.

We perform an objective classification of 170,000 galaxy spectra in the Sloan Digital Sky Survey (SDSS) using the Karhunen-Lo\`eve (KL) transform. With about one-sixth of the total set of galaxy spectra which will be obtained by the survey, we are able to carry out the most extensive analysis of its kind to date. The formalism proposed by Connolly and Szalay is adopted to correct for gappy regions in the spectra, and to derive eigenspectra and eigencoefficients. From this analysis, we show that this gap-correction formalism leads to a converging set of eigenspectra and KL-repaired spectra. Furthermore, KL eigenspectra of galaxies are found to be convergent not only as a function of iteration, but also as a function of the number of randomly selected galaxy spectra used in the analysis. From these data a set of ten eigenspectra of galaxy spectra are constructed, with rest-wavelength coverage 3450-8350 angstrom. The eigencoefficients describing these galaxies naturally place the spectra into several classes defined by the plane formed by the first three eigencoefficients of each spectrum. Spectral types, corresponding to different Hubble-types and galaxies with extreme emission lines, are identified for the 170,000 spectra and are shown to be complementary to existing spectral classifications. From a non-parametric classification technique, we find that the population of galaxies can be divided into three classes which correspond to early late- through to intermediate late-types galaxies. (Abridged)

Galaxy-galaxy lensing has emerged as a powerful probe of the dark matter halos of galaxies, but is subject to contamination if intrinsically aligned satellites of the lens galaxy are used as part of the source sample. We present a measurement of this intrinsic shear using 200,747 lens galaxies from the Sloan Digital Sky Survey (SDSS) spectroscopic sample and a sample of satellites selected using photometric redshifts. The mean intrinsic shear at transverse separations of 30--446$h^{-1}$ kpc is constrained to be $-0.0062<\Delta\gamma<+0.0066$ (99.9 per cent confidence, including identified systematics), which limits contamination of the galaxy-galaxy lensing signal to at most $\sim 15$ per cent on these scales. We present these limits as a function of transverse separation and lens luminosity. We furthermore investigate shear calibration biases in the SDSS, which can also affect galaxy-galaxy lensing, and conclude that the shear amplitude is calibrated to better than 18 per cent. This includes noise-induced calibration biases in the ellipticity, which are small for the sample considered here, but which can be more important if low signal-to-noise or poorly resolved source galaxies are used.

We construct eigenspectra from the DR1 quasars in the SDSS using the Karhunen-Lo\`eve (KL) transform (or Principal Component Analysis, PCA) in different redshift and luminosity bins. We find that the quasar spectra can be classified, by the first two eigenspectra, into a continuous sequence in the variation of the spectral slope. We also find a dependence on redshift and luminosity in the eigencoefficients. The dominant redshift effect is the evolution of the blended Fe~II emission (optical) and the Balmer continuum (the ``small-bump'', $\lambda_{rest} \approx 2000-4000$\AA), while the luminosity effect is related to the Baldwin effect. Correlations among several major broad emission lines are found, including the well-known ``Eigenvector-1''.

We present estimates of cosmological parameters from the application of the Karhunen-Loeve transform to the analysis of the 3D power spectrum of density fluctuations using Sloan Digital Sky Survey galaxy redshifts. We use Omega_m*h and f_b = Omega_b/Omega_m to describe the shape of the power spectrum, sigma8 for the (linearly extrapolated) normalization, and beta to parametrize linear theory redshift space distortions. On scales k < 0.16 h/Mpc, our maximum likelihood values are Omega_m*h = 0.264 +/-0.043, f_b = 0.286 +/- 0.065, sigma8 = 0.966 +/- 0.048, and beta = 0.45 +/- 0.12. When we take a prior on Omega_b from WMAP, we find Omega_m*h = 0.207 +/- 0.030, which is in excellent agreement with WMAP and 2dF. This indicates that we have reasonably measured the gross shape of the power spectrum but we have difficulty breaking the degeneracy between Omega_m*h and f_b because the baryon oscillations are not resolved in the current spectroscopic survey window function.

We present galaxy-galaxy lensing measurements over scales 0.025 to 10 Mpc/h in the Sloan Digital Sky Survey. Using a flux-limited sample of 127,001 lens galaxies with spectroscopic redshifts and mean luminosity <L> = L_* and 9,020,388 source galaxies with photometric redshifts, we invert the lensing signal to obtain the galaxy-mass correlation function xi_{gm}. We find xi_{gm} is consistent with a power-law, xi_{gm} = (r/r_0)^{-gamma}, with best-fit parameters gamma = 1.79 +/- 0.06 and r_0 = (5.4+/-0.7)(0.27/Omega_m)^{1/gamma} Mpc/h. At fixed separation, the ratio xi_{gg}/xi_{gm} = b/r where b is the bias and r is the correlation coefficient. Comparing to the galaxy auto-correlation function for a similarly selected sample of SDSS galaxies, we find that b/r is approximately scale independent over scales 0.2-6.7 Mpc/h, with mean <b/r> = (1.3+/-0.2)(Omega_m/0.27). We also find no scale dependence in b/r for a volume limited sample of luminous galaxies (-23.0 < M_r < -21.5). The mean b/r for this sample is <b/r>_{Vlim} = (2.0+/-0.7)(Omega_m/0.27). We split the lens galaxy sample into subsets based on luminosity, color, spectral type, and velocity dispersion, and see clear trends of the lensing signal with each of these parameters. The amplitude and logarithmic slope of xi_{gm} increases with galaxy luminosity. For high luminosities (L ~5 L_*), xi_{gm} deviates significantly from a power law. These trends with luminosity also appear in the subsample of red galaxies, which are more strongly clustered than blue galaxies.

We measure cosmological parameters using the three-dimensional power spectrum P(k) from over 200,000 galaxies in the Sloan Digital Sky Survey (SDSS) in combination with WMAP and other data. Our results are consistent with a ``vanilla'' flat adiabatic Lambda-CDM model without tilt (n=1), running tilt, tensor modes or massive neutrinos. Adding SDSS information more than halves the WMAP-only error bars on some parameters, tightening 1 sigma constraints on the Hubble parameter from h~0.74+0.18-0.07 to h~0.70+0.04-0.03, on the matter density from Omega_m~0.25+/-0.10 to Omega_m~0.30+/-0.04 (1 sigma) and on neutrino masses from <11 eV to <0.6 eV (95%). SDSS helps even more when dropping prior assumptions about curvature, neutrinos, tensor modes and the equation of state. Our results are in substantial agreement with the joint analysis of WMAP and the 2dF Galaxy Redshift Survey, which is an impressive consistency check with independent redshift survey data and analysis techniques. In this paper, we place particular emphasis on clarifying the physical origin of the constraints, i.e., what we do and do not know when using different data sets and prior assumptions. For instance, dropping the assumption that space is perfectly flat, the WMAP-only constraint on the measured age of the Universe tightens from t0~16.3+2.3-1.8 Gyr to t0~14.1+1.0-0.9 Gyr by adding SDSS and SN Ia data. Including tensors, running tilt, neutrino mass and equation of state in the list of free parameters, many constraints are still quite weak, but future cosmological measurements from SDSS and other sources should allow these to be substantially tightened.

Many fundamental statistical methods have become critical tools for scientific data analysis yet do not scale tractably to modern large datasets. This paper will describe very recent algorithms based on computational geometry which have dramatically reduced the computational complexity of 1) kernel density estimation (which also extends to nonparametric regression, classification, and clustering), and 2) the n-point correlation function for arbitrary n. These new multi-tree methods typically yield orders of magnitude in speedup over the previous state of the art for similar accuracy, making millions of data points tractable on desktop workstations for the first time.

We measure the large-scale real-space power spectrum P(k) using a sample of 205,443 galaxies from the Sloan Digital Sky Survey, covering 2417 square degrees with mean redshift z~0.1. We employ a matrix-based method using pseudo-Karhunen-Loeve eigenmodes, producing uncorrelated minimum-variance measurements in 22 k-bands of both the clustering power and its anisotropy due to redshift-space distortions, with narrow and well-behaved window functions in the range 0.02 h/Mpc < k < 0.3h/Mpc. We pay particular attention to modeling, quantifying and correcting for potential systematic errors, nonlinear redshift distortions and the artificial red-tilt caused by luminosity-dependent bias. Our final result is a measurement of the real-space matter power spectrum P(k) up to an unknown overall multiplicative bias factor. Our calculations suggest that this bias factor is independent of scale to better than a few percent for k<0.1h/Mpc, thereby making our results useful for precision measurements of cosmological parameters in conjunction with data from other experiments such as the WMAP satellite. As a simple characterization of the data, our measurements are well fit by a flat scale-invariant adiabatic cosmological model with h Omega_m =0.201+/- 0.017 and L* galaxy sigma_8=0.89 +/- 0.02 when fixing the baryon fraction Omega_b/Omega_m=0.17 and the Hubble parameter h=0.72; cosmological interpretation is given in a companion paper.

Using a large sample of quasar spectra from the SDSS, we examine the composite spectral trends of quasars as functions of both redshift and luminosity, independently of one another. Aside from the well known Baldwin effect (BE) -- the decrease of line equivalent width with luminosity -- the average spectral properties are remarkably similar. Host galaxy contamination and the BE are the primary causes for apparent changes in the average spectral slope of the quasars. The BE is detected for most emission lines, including the Balmer lines, but with several exceptions including NV1240A. Emission line shifts of several lines are associated with the BE. The BE is mainly a function of luminosity, but also partly a function of redshift in that line equivalent widths become stronger with redshift. Some of the complex iron features change with redshift, particularly near the small blue bump region.

The Sloan Digital Sky Survey (SDSS) first data release provides a database of 106000 unique galaxies in the main galaxy sample with measured spectra. A sample of star-forming (SF) galaxies are identified from among the 3079 of these having 1.4 GHz luminosities from FIRST, by using optical spectral diagnostics. Using 1.4 GHz luminosities as a reference star formation rate (SFR) estimator insensitive to obscuration effects, the SFRs derived from the measured SDSS Halpha, [OII] and u-band luminosities, as well as far-infrared luminosities from IRAS, are compared. It is established that straightforward corrections for obscuration and aperture effects reliably bring the SDSS emission line and photometric SFR estimates into agreement with those at 1.4 GHz, although considerable scatter (~60%) remains in the relations. It thus appears feasible to perform detailed investigations of star formation for large and varied samples of SF galaxies through the available spectroscopic and photometric measurements from the SDSS. We provide herein exact prescriptions for determining the SFR for SDSS galaxies. The expected strong correlation between [OII] and Halpha line fluxes for SF galaxies is seen, but with a median line flux ratio F_[OII]/F_Halpha=0.23, about a factor of two smaller than that found in the sample of Kennicutt (1992). This correlation, used in deriving the [OII] SFRs, is consistent with the luminosity-dependent relation found by Jansen et al. (2001). The median obscuration for the SDSS SF systems is found to be A_Halpha=1.2 mag, while for the radio detected sample the median obscuration is notably higher, 1.6 mag, and with a broader distribution.

We analyze the photometric information contained in individual pixels of galaxies in the Hubble Deep Field North (HDFN) using a new technique, _pixel-z_, that combines predictions of evolutionary synthesis models with photometric redshift template fitting. Each spectral energy distribution template is a result of modeling of the detailed physical processes affecting gas properties and star formation efficiency. The criteria chosen to generate the SED templates is that of sampling a wide range of physical characteristics such as age, star formation rate, obscuration and metallicity. A key feature of our method is the sophisticated use of error analysis to generate error maps that define the reliability of the template fitting on pixel scales and allow for the separation of the interplay among dust, metallicity and star formation histories. This technique offers a number of advantages over traditional integrated color studies. As a first application, we derive the star formation and metallicity histories of galaxies in the HDFN. Our results show that the comoving density of star formation rate, determined from the UV luminosity density of sources in the HDFN, increases monotonically with redshift out to at least redshift of 5. This behavior can plausibly be explained by a smooth increase of the UV luminosity density with redshift coupled with an increase in the number of star forming regions as a function of redshift. We also find that the information contained in individual pixels in a galaxy can be linked to its morphological history. Finally, we derive the metal enrichment rate history of the universe and find it in good agreement with predictions based on the evolving HI content of Lyman-alpha QSO absorption line systems.

We present measurements of the angular cross-correlation between luminous red galaxies from the Sloan Digital Sky Survey and the cosmic microwave background temperature maps from the Wilkinson Microwave Anisotropy Probe. We find a statistically significant achromatic positive correlation between these two data sets, which is consistent with the expected signal from the late Integrated Sachs-Wolfe (ISW) effect. We do not detect any anti-correlation on small angular scales as would be produced from a large Sunyaev-Zel'dovich (SZ) effect, although we do see evidence for some SZ effect for our highest redshift samples. Assuming a flat universe, our preliminary detection of the ISW effect provides independent physical evidence for the existence of dark energy.

Understanding the clustering of galaxies has long been a goal of modern observational cosmology. Utilizing our photometric redshift technique a volume limited sample containing more than 2 million galaxies is constructed from the SDSS galaxy catalog. In the largest such analysis to date, we study the angular clustering as a function of luminosity and spectral type. Using Limber's equation we calculate the clustering length for the full data set as r0=5.77+/-0.10 Mpc/h. We find that r0 increases with luminosity by a factor of 1.6 over the sampled luminosity range, in agreement with previous redshift surveys. We also find that both the clustering length and the slope of the correlation function depend on the galaxy type. In particular, by splitting the galaxies in four groups by their rest-frame type we find a bimodal behavior in their clustering properties. Galaxies with spectral types similar to elliptical galaxies have a correlation length of 6.59 +/- 0.17 Mpc/h and a slope of the angular correlation function of 0.96 +/- 0.05 while blue galaxies have a clustering length of 4.51 +/- 0.19 Mpc/h and a slope of 0.68 +/- 0.09. The two intermediate color groups behave like their more extreme 'siblings', rather than showing a gradual transition in slope. We discuss these correlations in the context of current cosmological models for structure formation.

[Abridged] We present here a new and homogeneous sample of 3340 galaxies selected from the Sloan Digital Sky Survey (SDSS) based solely on the observed strength of their Hdelta absorption line. These galaxies are commonly known as ``post-starburst'' or ``E+A'' galaxies, and the study of these galaxies has been severely hampered by the lack of a large, statistical sample of such galaxies. In this paper, we rectify this problem by selecting a sample of galaxies which possess an absorption Hdelta equivalent width of EW(Hdelta_max) - Delta EW(Hdelta_max) > 4A from 106682 galaxies in the SDSS. We have performed extensive tests on our catalog including comparing different methodologies of measuring the Hdelta absorption and studying the effects of stellar absorption, dust extinction, emission-filling and measurement error. The measured abundance of our Hdelta-selected (HDS) galaxies is 2.6 +/- 0.1% of all galaxies within a volume-limited sample of 0.05<z<0.1 and M(r*)<-20.5, which is consistent with previous studies of such galaxies in the literature. We find that only 25 of our HDS galaxies in this volume-limited sample (3.5+/-0.7%) show no evidence for OII and Halpha emission, thus indicating that true E+A (or k+a) galaxies are extremely rare objects at low redshift, i.e., only 0.09+/-0.02% of all galaxies in this volume-limited sample are true E+A galaxies. In contrast, 89+/-5% of our HDS galaxies in the volume-limited sample have significant detections of the OII and Halpha emission lines. We find 27 galaxies in our volume-limited HDS sample that possess no detectable OII emission, but do however possess detectable Halpha emission. These galaxies may be dusty star-forming galaxies. We provide the community with this new catalog of Hdelta-selected galaxies to aid in the understanding of these galaxies.

We present a determination of the `Cosmic Optical Spectrum' of the Universe, i.e. the ensemble emission from galaxies, as determined from the red-selected Sloan Digital Sky Survey main galaxy sample and compare with previous results of the blue-selected 2dF Galaxy Redshift Survey. Broadly we find good agreement in both the spectrum and the derived star-formation histories. If we use a power-law star-formation history model where star-formation rate $\propto (1+z)^\beta$ out to z=1, then we find that $\beta$ of 2 to 3 is still the most likely model and there is no evidence for current surveys missing large amounts of star formation at high redshift. In particular `Fossil Cosmology' of the local universe gives measures of star-formation history which are consistent with direct observations at high redshift. Using the photometry of SDSS we are able to derive the cosmic spectrum in absolute units (i.e.$ W \AA$^{-1}$ Mpc$^{-3}$) at 2--5\AA resolution and find good agreement with published broad-band luminosity densities. For a Salpeter IMF the best fit stellar mass/light ratio is 3.7--7.5 $\Msun/\Lsun$ in the r-band (corresponding to $\omstars h = 0.0025$--0.0055) and from both the stellar emission history and the H$\alpha$ luminosity density independently we find a cosmological star-formation rate of 0.03--0.04 h $\Msun$ yr$^{-1}$ Mpc$^{-3}$ today.

We combine Sloan Digital Sky Survey spectra of 22,000 luminous, red, bulge-dominated galaxies to get high S/N average spectra in the rest-frame optical and ultraviolet (2600A to 7000A). The average spectra of these massive, quiescent galaxies are early-type with weak emission lines and with absorption lines indicating an apparent excess of alpha elements over solar abundance ratios. We make average spectra of subsamples selected by luminosity, environment and redshift. The average spectra are remarkable in their similarity. What variations do exist in the average spectra as a function of luminosity and environment are found to form a nearly one-parameter family in spectrum space. We present a high signal-to-noise ratio spectrum of the variation. We measure the properties of the variation with a modified version of the Lick index system and compare to model spectra from stellar population syntheses. The variation may be a combination of age and chemical abundance differences, but the conservative conclusion is that the quality of the data considerably exceeds the current state of the models.

The Early Data Release from the Sloan Digital Sky survey provides one of the largest multicolor photometric catalogs currently available to the astronomical community. In this paper we present the first application of photometric redshifts to the $\sim 6$ million extended sources within these data (with 1.8 million sources having $r' < 21$). Utilizing a range of photometric redshift techniques, from empirical to template and hybrid techniques, we investigate the statistical and systematic uncertainties present within the redshift estimates for the EDR data. For $r'<21$ we find that the redshift estimates provide realistic redshift histograms with an rms uncertainty in the photometric redshift relation of 0.035 at $r'<18$ and rising to 0.1 at $r'<21$. We conclude by describing how these photometric redshifts and derived quantities, such as spectral type, restframe colors and absolute magnitudes, are stored within the SDSS database. We provide sample queries for searching on photometric redshifts and list the current caveats and issues that should be understood before using these photometric redshifts in statistical analyses of the SDSS galaxies.

Using a catalog of 147,986 galaxy redshifts and fluxes from the Sloan Digital Sky Survey (SDSS) we measure the galaxy luminosity density at z=0.1 in five optical bandpasses corresponding to the SDSS bandpasses shifted to match their restframe shape at z=0.1. We denote the bands {0.1}{u}, {0.1}{g}, {0.1}{r}, {0.1}{i}, {0.1}{z}, with \lambda_{eff} = [3216, 4240, 5595, 6792, 8111] Angstroms respectively. We use a maximum likelihood method which allows for a general form for the shape of the luminosity function, simple luminosity and number evolution, incorporates flux uncertainties, and accounts for the flux limits of the survey. We find luminosity densities at z=0.1 in absolute AB magnitudes in a Mpc^3 of [-14.10 \pm 0.15, -15.18 \pm 0.03, -15.90 \pm 0.03, -16.24 \pm 0.03, -16.56 \pm 0.02] in [{0.1}{u}, {0.1}{g}, {0.1}{r}, {0.1}{i}, {0.1}{z}], respectively, using \Omega_0 =0.3, \Omega_\Lambda=0.7, and h=1, and using Petrosian magnitudes. Similar results are obtained using Sersic model magnitudes, suggesting that flux from outside the Petrosian apertures is not a major correction. In the {0.1}{r} band, the best fit Schechter function to our results has \phi_\ast = (1.49 \pm 0.04) \times 10^{-2} h^3 Mpc^{-3}, M_\ast - 5\log_{10} h = -20.44 \pm 0.01, and \alpha = -1.05\pm 0.01. In solar luminosities, the luminosity density in {0.1}{r} is (1.84 \pm 0.04) h 10^8 L_{{0.1}{r},\odot} Mpc^{-3}. Our results are consistent with other estimates of the luminosity density, from the Two-degree Field Galaxy Redshift Survey and the Millenium Galaxy Catalog. They represent a substantial change (\sim 0.5 mag) from earlier SDSS luminosity density results based on commissioning data, almost entirely because of the inclusion of evolution in the luminosity function model.

(Abridged) We present in this paper a detailed analysis of the effect of environment on the star-formation activity of galaxies within the EDR of the SDSS. We have used the Halpha emission line to derive the star-formation rate (SFR) for each galaxy within a volume-limited sample of 8598 galaxies with 0.05 < z < 0.095 and M(r)<= -20.45. We find that the SFR of galaxies is strongly correlated with the local (projected) galaxy density and thus we present here the density-SFR relation that is analogous to the density-morphology relation. The effect of density on the SFR of galaxies is seen in three ways. First, the overall distribution of SFRs is shifted to lower values in dense environments compared with the field population. Second, the effect is most noticeable for the strongly star-forming galaxies in the 75th percentile of the SFR distribution. Third, there is a ``break'' (or characteristic density) in the density-SFR relation at a local galaxy density of 1h-2 Mpc-2. To understand this break further, we have studied the SFR of galaxies as a function of clustercentric radius from 17 clusters and groups objectively selected from the SDSS EDR data. The distribution of SFRs of cluster galaxies begins to change, compared with the field population, at a clustercentric radius of 3-4 virial radii, which is consistent with the characteristic break in density that we observe in the density-SFR relation. Our tests suggest that the density-morphology relation alone is unlikely to explain the density-SFR relation we observe. Taken all together, these works demonstrate that the decrease in SFR of galaxies in dense environments is a universal phenomenon over a wide range in density (from 0.08 to 10h-2 Mpc-2) and redshift (out to z = 0.5).

The effective optical depth in the Ly-alpha forest region of 1061 low-resolution QSO spectra drawn from the SDSS database decreases with decreasing redshift over the range 2.5 < z < 4. Although the evolution is relatively smooth, tau_eff ~ (1+z)^{3.8 pm 0.2}, at z ~ 3.2 the effective optical depth decreases suddenly, by about ten percent with respect to this smoother evolution. It climbs back to the original smooth scaling again by z ~ 2.9. We describe two techniques, one of which is new, for quantifying this evolution which give consistent results. A variety of tests show that the feature is not likely to be a consequence of how the QSO sample was selected, nor the result of flux calibration or other systematic effects. Other authors have argued that, at this same epoch, the temperature of the IGM also shows a departure from an otherwise smooth decrease with time. These features in the evolution of the temperature and the optical depth are signatures of the reionization of He II.

The DEIMOS spectrograph has now been installed on the Keck-II telescope and commissioning is nearly complete. The DEEP2 Redshift Survey, which will take approximately 120 nights at the Keck Observatory over a three year period and has been designed to utilize the power of DEIMOS, began in the summer of 2002. The multiplexing power and high efficiency of DEIMOS enables us to target 1000 faint galaxies per clear night. Our goal is to gather high-quality spectra of \~60,000 galaxies with z>0.75 in order to study the properties and large scale clustering of galaxies at z ~ 1. The survey will be executed at high spectral resolution, $R=\lambda/\Delta \lambda \approx 5000$, allowing us to work between the bright OH sky emission lines and to infer linewidths for many of the target galaxies (for several thousand objects, we will obtain rotation curves as well). The linewidth data will facilitate the execution of the classical redshift-volume cosmological test, which can provide a precision measurement of the equation of state of the Universe. This talk reviews the project, summarizes our science goals and presents some early DEIMOS data.

The angular distribution of galaxies encodes a wealth of information about large scale structure. Ultimately, the Sloan Digital Sky Survey (SDSS) will record the angular positions of order 10^8 galaxies in five bands, adding significantly to the cosmological constraints. This is the first in a series of papers analyzing a rectangular stripe 2.5x90 degrees from early SDSS data. We present the angular correlation function for galaxies in four separate magnitude bins on angular scales ranging from 0.003 degrees to 15 degrees. Much of the focus of this paper is on potential systematic effects. We show that the final galaxy catalog -- with the mask accounting for regions of poor seeing, reddening, bright stars, etc. -- is free from external and internal systematic effects for galaxies brighter than r* = 22. Our estimator of the angular correlation function includes the effects of the integral constraint and the mask. The full covariance matrix of errors in these estimates is derived using mock catalogs with further estimates using a number of other methods.

We present our first results on field X-ray sources detected in a deep, 184.7 ks observation with the ACIS-I camera on Chandra. The observations target the Lynx field of SPICES, and contains three known X-ray-emitting clusters out to z=1.27. Not including the known clusters, in the 17'x17' ACIS-I field we detect 132 sources in the 0.5-2 keV (soft) X-ray band down to a limiting flux of \~1.7e-16 erg/cm2/s and 111 sources in the 2-10 keV (hard) X-ray band down to a limiting flux of ~1.3e-15 erg/cm2/s. The combined catalog contains a total of 153 sources, of which 42 are detected only in the soft band and 21 are detected only in the hard band. Confirming previous Chandra results, we find that the fainter sources have harder X-ray spectra, providing a consistent solution to the long-standing `spectral paradox'. From deep optical and near-infrared follow-up data, 77% of the X-ray sources have optical counterparts to I=24 and 71% of the X-ray sources have near-infrared counterparts to K=20. Four of the 24 sources in the near-IR field are associated with extremely red objects (EROs; I-K>4). We have obtained spectroscopic redshifts with the Keck telescopes of 18 of the Lynx Chandra sources. These sources comprise a mix of broad-lined active galaxies, apparently normal galaxies, and two late-type Galactic dwarfs. Intriguingly, one Galactic source is identified with an M7 dwarf exhibiting non-transient, hard X-ray emission. We review non-AGN mechanisms to produce X-ray emission and discuss properties of the Lynx Chandra sample in relation to other samples of X-ray and non-X-ray sources.

We compute the angular power spectrum C_l from 1.5 million galaxies in early SDSS data on large angular scales, l<600. The data set covers about 160 square degrees, with a characteristic depth of order 1 Gpc/h in the faintest (21<r<22) of our four magnitude bins. Cosmological interpretations of these results are presented in a companion paper by Dodelson et al (2001). The data in all four magnitude bins are consistent with a simple flat ``concordance'' model with nonlinear evolution and linear bias factors of order unity. Nonlinear evolution is particularly evident for the brightest galaxies. A series of tests suggest that systematic errors related to seeing, reddening, etc., are negligible, which bodes well for the sixtyfold larger sample that the SDSS is currently collecting. Uncorrelated error bars and well-behaved window functions make our measurements a convenient starting point for cosmological model fitting.

We discuss non-parametric density estimation and regression for astrophysics problems. In particular, we show how to compute non-parametric confidence intervals for the location and size of peaks of a function. We illustrate these ideas with recent data on the Cosmic Microwave Background. We also briefly discuss non-parametric Bayesian inference.

We report on observations of a TypeII quasar at redshift z=3.288, identified as a hard X-ray source in a 185 ks observation with the Chandra X-ray Observatory and as a high-redshift photometric candidate from deep, multiband optical imaging. CXOJ084837.9+445352 (hereinafter CXO52) shows an unusually hard X-ray spectrum from which we infer an absorbing column density N(H) = (4.8+/-2.1)e23 / cm2 (90% confidence) and an implied unabsorbed 2-10 keV rest-frame luminosity of L(2-10) = 3.3e44 ergs/s, well within the quasar regime. Hubble Space Telescope imaging shows CXO52 to be elongated with slight morphological differences between the WFPC2 F814W and NICMOS F160W bands. Optical and near-infrared spectroscopy of CXO52 show high-ionization emission lines with velocity widths ~1000 km/s and flux ratios similar to a Seyfert2 galaxy or radio galaxy. The latter are the only class of high-redshift TypeII luminous AGN which have been extensively studied to date. Unlike radio galaxies, however, CXO52 is radio quiet, remaining undetected at radio wavelengths to fairly deep limits, f(4.8GHz) < 40 microJy. High-redshift TypeII quasars, expected from unification models of active galaxies and long-thought necessary to explain the X-ray background, are poorly constrained observationally with few such systems known. We discuss recent observations of similar TypeII quasars and detail search techniques for such systems: namely (1) X-ray selection, (2) radio selection, (3) multi-color imaging selection, and (4) narrow-band imaging selection. Such studies are likely to begin identifying luminous, high-redshift TypeII systems in large numbers. We discuss the prospects for these studies and their implications to our understanding of the X-ray background.

We present initial results for counts in cells statistics of the angular distribution of galaxies in early data from the Sloan Digital Sky Survey (SDSS). We analyze a rectangular stripe $2.5^\circ$ wide, covering approximately 160 sq. degrees, containing over $10^6$ galaxies in the apparent magnitude range $18 < r^\prime < 22$, with areas of bad seeing, contamination from bright stars, ghosts, and high galactic extinction masked out. This survey region, which forms part of the SDSS Early Data Release, is the same as that for which two-point angular clustering statistics have recently been computed. The third and fourth moments of the cell counts, $s_3$ (skewness) and $s_4$ (kurtosis), constitute the most accurate measurements to date of these quantities (for $r^\prime < 21$) over angular scales $0.015^\circ-0.3^\circ$. They display the approximate hierarchical scaling expected from non-linear structure formation models and are in reasonable agreement with the predictions of $\Lambda$-dominated cold dark matter models with galaxy biasing that suppresses higher order correlations at small scales. The results are in general consistent with previous measurements in the APM, EDSGC, and Deeprange surveys. These results suggest that the SDSS imaging data are free of systematics to a high degree and will therefore enable determination of the skewness and kurtosis to 1% and less then 10%, as predicted by Colombi, Szapudi, & Szalay (1998).

The False Discovery Rate (FDR) method has recently been described by Miller et al (2001), along with several examples of astrophysical applications. FDR is a new statistical procedure due to Benjamini and Hochberg (1995) for controlling the fraction of false positives when performing multiple hypothesis testing. The importance of this method to source detection algorithms is immediately clear. To explore the possibilities offered we have developed a new task for performing source detection in radio-telescope images, Sfind 2.0, which implements FDR. We compare Sfind 2.0 with two other source detection and measurement tasks, Imsad and SExtractor, and comment on several issues arising from the nature of the correlation between nearby pixels and the necessary assumption of the null hypothesis. The strong suggestion is made that implementing FDR as a threshold defining method in other existing source-detection tasks is easy and worthwhile. We show that the constraint on the fraction of false detections as specified by FDR holds true even for highly correlated and realistic images. For the detection of true sources, which are complex combinations of source-pixels, this constraint appears to be somewhat less strict. It is still reliable enough, however, for a priori estimates of the fraction of false source detections to be robust and realistic.

A sample of nearly 9000 early-type galaxies, in the redshift range 0.01<z<0.3, was selected from the Sloan Digital Sky Survey using morphological and spectral criteria. The sample was used to study how early-type galaxy observables, including luminosity L, effective radius R, surface brightness I, color, and velocity dispersion V, are correlated with one another. Measurement biases are understood with mock catalogs which reproduce all of the observed scaling relations. At any given redshift, the intrinsic distribution of luminosities, sizes and velocity dispersions in our sample are all approximately Gaussian. In the r* band L ~ V^3.91, L ~ R^1.58, R ~ I^(-0.75), and the Fundamental Plane relation is R ~ V^(1.49) I^(-0.75). These relations are approximately the same in the g*, i* and z* bands. At fixed luminosity, the mass-to-light ratio scales as M/L ~ L^0.14. The g*-r* color scales as V^0.25. Color also correlates with magnitude and size, but these correlations are entirely due to the L-V and R-V relations. Chemical evolution and star formation histories are investigated using co-added spectra of similar objects in our sample. Chemical abundances correlate primarily with velocity dispersion. At fixed V, the higher redshift population is bluer, is weaker in Mg2, and is stronger in Hbeta than the population nearby. In addition, the population at higher redshifts is slightly more luminous. These differences are consistent with that of a passively evolving population which formed the bulk of its stars about 9 Gyrs ago. The Fundamental Plane suggests that galaxies in dense regions are slightly different from those in less dense regions, but the co-added spectra and color--magnitude relations show no statistically significant dependence on environment.

We present a comparison of three cluster finding algorithms from imaging data using Monte Carlo simulations of clusters embedded in a 25 deg^2 region of Sloan Digital Sky Survey (SDSS) imaging data: the Matched Filter (MF; Postman et al. 1996), the Adaptive Matched Filter (AMF; Kepner et al. 1999) and a color-magnitude filtered Voronoi Tessellation Technique (VTT). Among the two matched filters, we find that the MF is more efficient in detecting faint clusters, whereas the AMF evaluates the redshifts and richnesses more accurately, therefore suggesting a hybrid method (HMF) that combines the two. The HMF outperforms the VTT when using a background that is uniform, but it is more sensitive to the presence of a non-uniform galaxy background than is the VTT; this is due to the assumption of a uniform background in the HMF model. We thus find that for the detection thresholds we determine to be appropriate for the SDSS data, the performance of both algorithms are similar; we present the selection function for each method evaluated with these thresholds as a function of redshift and richness. For simulated clusters generated with a Schechter luminosity function (M_r^* = -21.5 and alpha = -1.1) both algorithms are complete for Abell richness >= 1 clusters up to z ~ 0.4 for a sample magnitude limited to r = 21. While the cluster parameter evaluation shows a mild correlation with the local background density, the detection efficiency is not significantly affected by the background fluctuations, unlike previous shallower surveys.

I present here a review of past and present multi-disciplinary research of the Pittsburgh Computational AstroStatistics (PiCA) group. This group is dedicated to developing fast and efficient statistical algorithms for analysing huge astronomical data sources. I begin with a short review of multi-resolutional kd-trees which are the building blocks for many of our algorithms. For example, quick range queries and fast n-point correlation functions. I will present new results from the use of Mixture Models (Connolly et al. 2000) in density estimation of multi-color data from the Sloan Digital Sky Survey (SDSS). Specifically, the selection of quasars and the automated identification of X-ray sources. I will also present a brief overview of the False Discovery Rate (FDR) procedure (Miller et al. 2001a) and show how it has been used in the detection of ``Baryon Wiggles'' in the local galaxy power spectrum and source identification in radio data. Finally, I will look forward to new research on an automated Bayes Network anomaly detector and the possible use of the Locally Linear Embedding algorithm (LLE; Roweis & Saul 2000) for spectral classification of SDSS spectra.

We present moderate resolution Keck spectroscopy of quasars at z=5.82, 5.99 and 6.28, discovered by the Sloan Digital Sky Survey (SDSS). We find that the Ly Alpha absorption in the spectra of these quasars evolves strongly with redshift. To z~5.7, the Ly Alpha absorption evolves as expected from an extrapolation from lower redshifts. However, in the highest redshift object, SDSSp J103027.10+052455.0 (z=6.28), the average transmitted flux is 0.0038+-0.0026 times that of the continuum level over 8450 A < lambda < 8710 A (5.95<z(abs)<6.16), consistent with zero flux. Thus the flux level drops by a factor of >150, and is consistent with zero flux in the Ly Alpha forest region immediately blueward of the Ly Alpha emission line, compared with a drop by a factor of ~10 at z(abs)~5.3. A similar break is seen at Ly Beta; because of the decreased oscillator strength of this transition, this allows us to put a considerably stronger limit, tau(eff) > 20, on the optical depth to Ly Alpha absorption at z=6. This is a clear detection of a complete Gunn-Peterson trough, caused by neutral hydrogen in the intergalactic medium. Even a small neutral hydrogen fraction in the intergalactic medium would result in an undetectable flux in the Ly Alpha forest region. Therefore, the existence of the Gunn-Peterson trough by itself does not indicate that the quasar is observed prior to the reionization epoch. However, the fast evolution of the mean absorption in these high-redshift quasars suggests that the mean ionizing background along the line of sight to this quasar has declined significantly from z~5 to 6, and the universe is approaching the reionization epoch at z~6.

We describe the target selection and resulting properties of a spectroscopic sample of luminous, red galaxies (LRG) from the imaging data of the Sloan Digital Sky Survey (SDSS). These galaxies are selected on the basis of color and magnitude to yield a sample of luminous, intrinsically red galaxies that extends fainter and further than the main flux-limited portion of the SDSS galaxy spectroscopic sample. The sample is designed to impose a passively-evolving luminosity and rest-frame color cut to a redshift of 0.38. Additional, yet more luminous, red galaxies are included to a redshift of 0.5. Approximately 12 of these galaxies per square degree are targeted for spectroscopy, so the sample will number over 100,000 with the full survey. SDSS commissioning data indicate that the algorithm efficiently selects luminous (M_g=-21.4), red galaxies, that the spectroscopic success rate is very high, and that the resulting set of galaxies is approximately volume-limited out to z=0.38. When the SDSS is complete, the LRG spectroscopic sample will fill over 1h^-3 Gpc^3 with an approximately homogeneous population of galaxies and will therefore be well suited to studies of large-scale structure and clusters out to z=0.5.

We present measurements of parameters of the 3-dimensional power spectrum of galaxy clustering from 222 square degrees of early imaging data in the Sloan Digital Sky Survey. The projected galaxy distribution on the sky is expanded over a set of Karhunen-Loeve eigenfunctions, which optimize the signal-to-noise ratio in our analysis. A maximum likelihood analysis is used to estimate parameters that set the shape and amplitude of the 3-dimensional power spectrum. Our best estimates are Gamma=0.188 +/- 0.04 and sigma_8L = 0.915 +/- 0.06 (statistical errors only), for a flat Universe with a cosmological constant. We demonstrate that our measurements contain signal from scales at or beyond the peak of the 3D power spectrum. We discuss how the results scale with systematic uncertainties, like the radial selection function. We find that the central values satisfy the analytically estimated scaling relation. We have also explored the effects of evolutionary corrections, various truncations of the KL basis, seeing, sample size and limiting magnitude. We find that the impact of most of these uncertainties stay within the 2-sigma uncertainties of our fiducial result.

The Sloan Digital Sky Survey is one of the first multicolor photometric and spectroscopic surveys designed to measure the statistical properties of galaxies within the local Universe. In this Letter we present some of the initial results on the angular 2-point correlation function measured from the early SDSS galaxy data. The form of the correlation function, over the magnitude interval 18<r*<22, is shown to be consistent with results from existing wide-field, photographic-based surveys and narrower CCD galaxy surveys. On scales between 1 arcminute and 1 degree the correlation function is well described by a power-law with an exponent of ~ -0.7. The amplitude of the correlation function, within this angular interval, decreases with fainter magnitudes in good agreement with analyses from existing galaxy surveys. There is a characteristic break in the correlation function on scales of approximately 1-2 degrees. On small scales, < 1', the SDSS correlation function does not appear to be consistent with the power-law form fitted to the 1'< theta <0.5 deg data. With a data set that is less than 2% of the full SDSS survey area, we have obtained high precision measurements of the power-law angular correlation function on angular scales 1' < theta < 1 deg, which are robust to systematic uncertainties. Because of the limited area and the highly correlated nature of the error covariance matrix, these initial results do not yet provide a definitive characterization of departures from the power-law form at smaller and larger angles. In the near future, however, the area of the SDSS imaging survey will be sufficient to allow detailed analysis of the small and large scale regimes, measurements of higher-order correlations, and studies of angular clustering as a function of redshift and galaxy type.

Early photometric data from the Sloan Digital Sky Survey (SDSS) contain angular positions for 1.5 million galaxies. In companion papers, the angular correlation function $w(\theta)$ and 2D power spectrum $C_l$ of these galaxies are presented. Here we invert Limber's equation to extract the 3D power spectrum from the angular results. We accomplish this using an estimate of $dn/dz$, the redshift distribution of galaxies in four different magnitude slices in the SDSS photometric catalog. The resulting 3D power spectrum estimates from $w(\theta)$ and $C_l$ agree with each other and with previous estimates over a range in wavenumbers $0.03 < k/{\rm h Mpc}^{-1} < 1$. The galaxies in the faintest magnitude bin ($21 < \rstar < 22$, which have median redshift $z_m=0.43$) are less clustered than the galaxies in the brightest magnitude bin ($18 < \rstar < 19$ with $z_m=0.17$), especially on scales where nonlinearities are important. The derived power spectrum agrees with that of Szalay et al. (2001) who go directly from the raw data to a parametric estimate of the power spectrum. The strongest constraints on the shape parameter $\Gamma$ come from the faintest galaxies (in the magnitude bin $21 < \rstar < 22$), from which we infer $\Gamma = 0.14^{+0.11}_{-0.06}$ (95% C.L.).

The global star formation rate (SFR) density is estimated from the star formation histories (SFHs) of Local Group galaxies. This is found to be broadly consistent with estimates of the global SFH from existing redshift surveys for two favoured cosmologies. It also provides additional evidence for a relatively constant global SFR density at high redshift (z>1).

The False Discovery Rate (FDR) is a new statistical procedure to control the number of mistakes made when performing multiple hypothesis tests, i.e. when comparing many data against a given model hypothesis. The key advantage of FDR is that it allows one to a priori control the average fraction of false rejections made (when comparing to the null hypothesis) over the total number of rejections performed. We compare FDR to the standard procedure of rejecting all tests that do not match the null hypothesis above some arbitrarily chosen confidence limit, e.g. 2 sigma, or at the 95% confidence level. When using FDR, we find a similar rate of correct detections, but with significantly fewer false detections. Moreover, the FDR procedure is quick and easy to compute and can be trivially adapted to work with correlated data. The purpose of this paper is to introduce the FDR procedure to the astrophysics community. We illustrate the power of FDR through several astronomical examples, including the detection of features against a smooth one-dimensional function, e.g. seeing the ``baryon wiggles'' in a power spectrum of matter fluctuations, and source pixel detection in imaging data. In this era of large datasets and high precision measurements, FDR provides the means to adaptively control a scientifically meaningful quantity -- the number of false discoveries made when conducting multiple hypothesis tests.

We propose a novel type filter for multicolor imaging to improve on the photometric redshift estimation of galaxies. An extra filter - specific to a certain photometric system - may be utilized with high efficiency. We present a case study of the Hubble Space Telescope's Advanced Camera for Surveys and show that one extra exposure could cut down the mean square error on photometric redshifts by 34% over the z<1.3 redshift range.

From SDSS commissioning photometric and spectroscopic data, we investigate the utility of photometric redshift techniques to the task of estimating QSO redshifts. We consider empirical methods (e.g. nearest-neighbor searches and polynomial fitting), standard spectral template fitting and hybrid approaches (i.e. training spectral templates from spectroscopic and photometric observations of QSOs). We find that in all cases, due to the presence of strong emission-lines within the QSO spectra, the nearest-neighbor and template fitting methods are superior to the polynomial fitting approach. Applying a novel reconstruction technique, we can, from the SDSS multicolor photometry, reconstruct a statistical representation of the underlying SEDs of the SDSS QSOs. Although, the reconstructed templates are based on only broadband photometry the common emission lines present within the QSO spectra can be recovered in the resulting spectral energy distributions. The technique should be useful in searching for spectral differences among QSOs at a given redshift, in searching for spectral evolution of QSOs, in comparing photometric redshifts for objects beyond the SDSS spectroscopic sample with those in the well calibrated photometric redshifts for objects brighter than 20th magnitude and in searching for systematic and time variable effects in the SDSS broad band photometric and spectral photometric calibrations.

Different wavelength regimes and methods for estimating the space density of the star-formation rate (SFR) result in discrepant values. While it is recognised that ultra-violet (UV) and H-alpha emission line data must be corrected for the effects of extinction, the magnitude of the required correction is uncertain. Even when these corrections are made there remains a significant discrepancy between SFRs derived from UV and H-alpha measurements compared with those derived from far-infrared (FIR) and radio luminosities. Since the FIR/radio derived SFRs are not affected by extinction, and simple corrections to reconcile the UV and H-alpha measurement with these do not fully account for the discrepancies, a more sophisticated correction may be required. Recent results suggest that at least part of the solution may be a form of extinction which increases with increasing SFR (or luminosity, given the common assumption that SFR is proportional to luminosity). We present an analysis of the effects of a dust reddening dependent on star formation rate applied to estimators of SFR. We show (1) that the discrepancies between H-alpha and FIR/radio SFR estimates may be explained by such an effect, and we present an iterative method for applying the correction; and (2) UV-based estimates of SFR are harder to reconcile with FIR/radio estimates using this method, although the extent of the remaining discrepancy is less than for a non-SFR-dependent correction. Particularly at high redshift, our understanding of extinction at UV wavelengths may require a still more complex explanation.

On 26 May 1999, one of the Sloan Digital Sky Survey (SDSS) fiber-fed spectrographs saw astronomical first light. This was followed by the first spectroscopic commissioning run during the dark period of June 1999. We present here the first hour of extra-galactic spectroscopy taken during these early commissioning stages: an observation of the Coma cluster of galaxies. Our data samples the Southern part of this cluster, out to a radius of 1.5degrees and thus fully covers the NGC 4839 group. We outline in this paper the main characteristics of the SDSS spectroscopic systems and provide redshifts and spectral classifications for 196 Coma galaxies, of which 45 redshifts are new. For the 151 galaxies in common with the literature, we find excellent agreement between our redshift determinations and the published values. As part of our analysis, we have investigated four different spectral classification algorithms: spectral line strengths, a principal component decomposition, a wavelet analysis and the fitting of spectral synthesis models to the data. We find that a significant fraction (25%) of our observed Coma galaxies show signs of recent star-formation activity and that the velocity dispersion of these active galaxies (emission-line and post-starburst galaxies) is 30% larger than the absorption-line galaxies. We also find no active galaxies within the central (projected) 200 h-1 Kpc of the cluster. The spatial distribution of our Coma active galaxies is consistent with that found at higher redshift for the CNOC1 cluster survey. Beyond the core region, the fraction of bright active galaxies appears to rise slowly out to the virial radius and are randomly distributed within the cluster with no apparent correlation with the potential merger of the NGC 4839 group. [ABRIDGED]

Early data taken during commissioning of the SDSS have resulted in the discovery of a very cool white dwarf. It appears to have stronger collision induced absorption from molecular hydrogen than any other known white dwarf, suggesting it has a cooler temperature than any other. While its distance is presently unknown, it has a surprisingly small proper motion, making it unlikely to be a halo star. An analysis of white dwarf cooling times suggests that this object may be a low-mass star with a helium core. The SDSS imaging and spectroscopy also recovered LHS 3250, the coolest previously known white dwarf, indicating that the SDSS will be an effective tool for identifying these extreme objects.

We present here a new algorithm for the fast computation of N-point correlation functions in large astronomical data sets. The algorithm is based on kdtrees which are decorated with cached sufficient statistics thus allowing for orders of magnitude speed-ups over the naive non-tree-based implementation of correlation functions. We further discuss the use of controlled approximations within the computation which allows for further acceleration. In summary, our algorithm now makes it possible to compute exact, all-pairs, measurements of the 2, 3 and 4-point correlation functions for cosmological data sets like the Sloan Digital Sky Survey (SDSS; York et al. 2000) and the next generation of Cosmic Microwave Background experiments (see Szapudi et al. 2000).

We present first results from SPICES, the Spectroscopic, Photometric, Infrared-Chosen Extragalactic Survey. SPICES is comprised of four ~30 square arcminute high Galactic latitude fields with deep BRIzJK imaging reaching depths of ~25th magnitude (AB) in the optical and ~23rd magnitude (AB) in the near-infrared. To date we have 626 spectroscopic redshifts for infrared-selected SPICES sources with K<20 (Vega). The project is poised to address galaxy formation and evolution to redshift z~2. We discuss initial results from the survey, including the surface density of extremely red objects and the fraction of infrared sources at z>1. One of the SPICES fields has been the target of a deep 190 ksec Chandra exposure; we discuss initial results from analysis of that data set. Finally, we briefly discuss a successful campaign to identify high-redshift sources in the SPICES fields.

We outline here the next generation of cluster-finding algorithms. We show how advances in Computer Science and Statistics have helped develop robust, fast algorithms for finding clusters of galaxies in large multi-dimensional astronomical databases like the Sloan Digital Sky Survey (SDSS). Specifically, this paper presents four new advances: (1) A new semi-parametric algorithm - nicknamed ``C4'' - for jointly finding clusters of galaxies in the SDSS and ROSAT All-Sky Survey databases; (2) The introduction of the False Discovery Rate into Astronomy; (3) The role of kernel shape in optimizing cluster detection; (4) A new determination of the X-ray Cluster Luminosity Function which has bearing on the existence of a ``deficit'' of high redshift, high luminosity clusters. This research is part of our ``Computational AstroStatistics'' collaboration (see Nichol et al. 2000) and the algorithms and techniques discussed herein will form part of the ``Virtual Observatory'' analysis toolkit.