The compact configuration of Phase II of the Murchison Widefield Array (MWA) consists of both a redundant subarray and pseudo-random baselines, offering unique opportunities to perform sky-model and redundant interferometric calibration. The highly redundant hexagonal cores give improved power spectrum sensitivity. In this paper, we present the analysis of nearly 40 hours of data targeting one of the MWA's EoR fields observed in 2016. We use both improved analysis techniques presented in Barry et al. (2019) as well as several additional techniques developed for this work, including data quality control methods and interferometric calibration approaches. We show the EoR power spectrum limits at redshift 6.5, 6.8 and 7.1 based on our deep analysis on this 40-hour data set. These limits span a range in $k$ space of $0.18$ $h$ $\mathrm{Mpc^{-1}}$ $<k<1.6$ $h$ $\mathrm{Mpc^{-1}}$, with a lowest measurement of $\Delta^2\leqslant2.39\times 10^3$ $\mathrm{mK}^2$ at $k=0.59$ $h$ $\mathrm{Mpc^{-1}}$ and $z=6.5$.

Measurements of 21 cm Epoch of Reionization (EoR) structure are subject to systematics originating from both the analysis and the observation conditions. Using 2013 data from the Murchison Widefield Array (MWA), we show the importance of mitigating both sources of contamination. A direct comparison between results from Beardsley et al. 2016 and our updated analysis demonstrates new precision techniques, lowering analysis systematics by a factor of 2.8 in power. We then further lower systematics by excising observations contaminated by ultra-faint RFI, reducing by an additional factor of 3.8 in power for the zenith pointing. With this enhanced analysis precision and newly developed RFI mitigation, we calculate a noise-dominated upper limit on the EoR structure of $\Delta^2 \leq 3.9 \times 10^3$ mK$^2$ at $k=0.20$ $\textit{h}$ Mpc$^{-1}$ and $z=7$ using 21 hr of data, improving previous MWA limits by almost an order of magnitude.

Epoch of Reionization data analysis requires unprecedented levels of accuracy in radio interferometer pipelines. We have developed an imaging power spectrum analysis to meet these requirements and generate robust 21 cm EoR measurements. In this work, we build a signal path framework to mathematically describe each step in the analysis, from data reduction in the FHD package to power spectrum generation in the $\varepsilon$ppsilon package. In particular, we focus on the distinguishing characteristics of FHD/$\varepsilon$ppsilon: highly accurate spectral calibration, extensive data verification products, and end-to-end error propagation. We present our key data analysis products in detail to facilitate understanding of the prominent systematics in image-based power spectrum analyses. As a verification to our analysis, we also highlight a full-pipeline analysis simulation to demonstrate signal preservation and lack of signal loss. This careful treatment ensures that the FHD/$\varepsilon$ppsilon power spectrum pipeline can reduce radio interferometric data to produce credible 21 cm EoR measurements.

Refraction by the atmosphere causes the positions of sources to depend on the airmass through which an observation was taken. This shift is dependent on the underlying spectral energy of the source and the filter or bandpass through which it is observed. Wavelength-dependent refraction within a single passband is often referred to as differential chromatic refraction (DCR). With a new generation of astronomical surveys undertaking repeated observations of the same part of the sky over a range of different airmasses and parallactic angles, DCR should be a detectable and measurable astrometric signal. In this paper we introduce a novel procedure that takes this astrometric signal and uses it to infer the underlying spectral energy distribution of a source; we solve for multiple latent images at specific wavelengths via a generalized deconvolution procedure built on robust statistics. We demonstrate the utility of such an approach for estimating a partially deconvolved image, at higher spectral resolution than the input images, for surveys such as the Large Synoptic Survey Telescope (LSST).

Precise instrument calibration is critical to the success of 21 cm Cosmology experiments. Unmitigated errors in calibration contaminate the Epoch of Reionization (EoR) signal, precluding a detection. Barry et al. 2016 characterizes one class of inherent errors that emerge from calibrating to an incomplete sky model, however it has been unclear if errors in the sky model affect the calibration of redundant arrays. In this paper, we show that redundant calibration is vulnerable to errors from sky model incompleteness even in the limit of perfect antenna positioning and identical beams. These errors are at a level that can overwhelm the EoR signal and prevent a detection. Finally, we suggest error mitigation strategies with implications for the Hydrogen Epoch of Reionization Array (HERA) and the Square Kilometre Array (SKA).

Observations of the 21cm Epoch of Reionization (EoR) signal are dominated by Galactic and extragalactic foregrounds. The need for foreground removal has led to the development of two main techniques, often referred to as "foreground avoidance" and "foreground subtraction." Avoidance is associated with filtering foregrounds in Fourier space, while subtraction uses an explicit foreground model that is removed. Using 1088 hours of data from the 64-element PAPER array, we demonstrate that subtraction of a foreground model prior to delay-space foreground filtering results in a modest but measurable improvement of the performance of the filter. This proof-of-concept result shows that improvement stems from the reduced dynamic range requirements needed for the foreground filter: subtraction of a foreground model reduces the total foreground power, so for a fixed dynamic range, the filter can push towards fainter limits. We also find that the choice of window function used in the foreground filter can have an appreciable affect on the performance near the edges of the observing band. We demonstrate these effects using a smaller 3 hour sampling of data from the MWA, and find that the hybrid filtering and subtraction removal approach provides similar improvements across the band as seen in the case with PAPER-64.

The Large Synoptic Survey Telescope (LSST) is an ambitious astronomical survey with a similarly ambitious Data Management component. Data Management for LSST includes processing on both nightly and yearly cadences to generate transient alerts, deep catalogs of the static sky, and forced photometry light-curves for billions of objects at hundreds of epochs, spanning at least a decade. The algorithms running in these pipelines are individually sophisticated and interact in subtle ways. This paper provides an overview of those pipelines, focusing more on those interactions than the details of any individual algorithm.

21 cm power spectrum observations have the potential to revolutionize our understanding of the Epoch of Reionization and Dark Energy, but require extraordinarily precise data analysis methods to separate the cosmological signal from the astrophysical and instrumental contaminants. This analysis challenge has led to a diversity of proposed analyses, including delay spectra, imaging power spectra, m-mode analysis, and numerous others. This diversity of approach is a strength, but has also led to confusion within the community about whether insights gleaned by one group are applicable to teams working in different analysis frameworks. In this paper we show that all existing analysis proposals can be classified into two distinct families based on whether they estimate the power spectrum of the measured or reconstructed sky. This subtle difference in the statistical question posed largely determines the susceptibility of the analyses to foreground emission and calibration errors, and ultimately the science different analyses can pursue. In this paper we detail the origin of the two analysis families, categorize the analyses being actively developed, and explore their relative sensitivities to foreground contamination and calibration errors.

Interferometric arrays seeking to measure the 21 cm signal from the Epoch of Reionization must contend with overwhelmingly bright emission from foreground sources. Accurate recovery of the 21 cm signal will require precise calibration of the array, and several new avenues for calibration have been pursued in recent years, including methods using redundancy in the antenna configuration. The newly upgraded Phase II of Murchison Widefield Array (MWA) is the first interferometer that has large numbers of redundant baselines while retaining good instantaneous UV-coverage. This array therefore provides a unique opportunity to compare redundant calibration with sky-model based algorithms. In this paper, we present the first results from comparing both calibration approaches with MWA Phase II observations. For redundant calibration, we use the package OMNICAL, and produce sky-based calibration solutions with the analysis package Fast Holographic Deconvolution (FHD). There are three principal results. (1) We report the success of OMNICAL on observations of ORBComm satellites, showing substantial agreement between redundant visibility measurements after calibration. (2) We directly compare OMNICAL calibration solutions with those from FHD, and demonstrate these two different calibration schemes give extremely similar results. (3) We explore improved calibration by combining OMNICAL and FHD. We evaluate these combined methods using power spectrum techniques developed for EoR analysis and find evidence for marginal improvements mitigating artifacts in the power spectrum. These results are likely limited by signal-to-noise in the six hours of data used, but suggest future directions for combining these two calibration schemes.

(Abridged) We describe here the most ambitious survey currently planned in the optical, the Large Synoptic Survey Telescope (LSST). A vast array of science will be enabled by a single wide-deep-fast sky survey, and LSST will have unique survey capability in the faint time domain. The LSST design is driven by four main science themes: probing dark energy and dark matter, taking an inventory of the Solar System, exploring the transient optical sky, and mapping the Milky Way. LSST will be a wide-field ground-based system sited at Cerro Pach\'{o}n in northern Chile. The telescope will have an 8.4 m (6.5 m effective) primary mirror, a 9.6 deg$^2$ field of view, and a 3.2 Gigapixel camera. The standard observing sequence will consist of pairs of 15-second exposures in a given field, with two such visits in each pointing in a given night. With these repeats, the LSST system is capable of imaging about 10,000 square degrees of sky in a single filter in three nights. The typical 5$\sigma$ point-source depth in a single visit in $r$ will be $\sim 24.5$ (AB). The project is in the construction phase and will begin regular survey operations by 2022. The survey area will be contained within 30,000 deg$^2$ with $\delta<+34.5^\circ$, and will be imaged multiple times in six bands, $ugrizy$, covering the wavelength range 320--1050 nm. About 90\% of the observing time will be devoted to a deep-wide-fast survey mode which will uniformly observe a 18,000 deg$^2$ region about 800 times (summed over all six bands) during the anticipated 10 years of operations, and yield a coadded map to $r\sim27.5$. The remaining 10\% of the observing time will be allocated to projects such as a Very Deep and Fast time domain survey. The goal is to make LSST data products, including a relational database of about 32 trillion observations of 40 billion objects, available to the public and scientists around the world.

We present techniques developed to calibrate and correct Murchison Widefield Array (MWA) low frequency (72-300 MHz) radio observations for polarimetry. The extremely wide field-of-view, excellent instantaneous (u, v)-coverage and sensitivity to degree-scale structure that the MWA provides enable instrumental calibration, removal of instrumental artefacts, and correction for ionospheric Faraday rotation through imaging techniques. With the demonstrated polarimetric capabilities of the MWA, we discuss future directions for polarimetric science at low frequencies to answer outstanding questions relating to polarised source counts, source depolarisation, pulsar science, low-mass stars, exoplanets, the nature of the interstellar and intergalactic media, and the solar environment.

We present new radio continuum observations of NGC253 from the Murchison Widefield Array at frequencies between 76 and 227 MHz. We model the broadband radio spectral energy distribution for the total flux density of NGC253 between 76 MHz and 11 GHz. The spectrum is best described as a sum of central starburst and extended emission. The central component, corresponding to the inner 500pc of the starburst region of the galaxy, is best modelled as an internally free-free absorbed synchrotron plasma, with a turnover frequency around 230 MHz. The extended emission component of the NGC253 spectrum is best described as a synchrotron emission flattening at low radio frequencies. We find that 34% of the extended emission (outside the central starburst region) at 1 GHz becomes partially absorbed at low radio frequencies. Most of this flattening occurs in the western region of the SE halo, and may be indicative of synchrotron self-absorption of shock re-accelerated electrons or an intrinsic low-energy cut off of the electron distribution. Furthermore, we detect the large-scale synchrotron radio halo of NGC253 in our radio images. At 154 - 231 MHz the halo displays the well known X-shaped/horn-like structure, and extends out to ~8kpc in z-direction (from major axis).

The Detection of redshifted 21 cm emission from the epoch of reionization (EoR) is a challenging task owing to strong foregrounds that dominate the signal. In this paper, we propose a general method, based on the delay spectrum approach, to extract HI power spectra that is applicable to tracking observations using an imaging radio interferometer (Delay Spectrum with Imaging Arrays (DSIA)). Our method is based on modelling the HI signal taking into account the impact of wide field effects such as the $w$-term which are then used as appropriate weights in cross-correlating the measured visibilities. Our method is applicable to any radio interferometer that tracks a phase center and could be utilized for arrays such as MWA, LOFAR, GMRT, PAPER and HERA. In the literature the delay spectrum approach has been implemented for near-redundant baselines using drift scan observations. In this paper we explore the scheme for non-redundant tracking arrays, and this is the first application of delay spectrum methodology to such data to extract the HI signal. We analyze 3 hours of MWA tracking data on the EoR1 field. We present both 2-dimensional ($k_\parallel,k_\perp$) and 1-dimensional (k) power spectra from the analysis. Our results are in agreement with the findings of other pipelines developed to analyse the MWA EoR data.

The Murchison Widefield Array (MWA) has collected hundreds of hours of Epoch of Reionization (EoR) data and now faces the challenge of overcoming foreground and systematic contamination to reduce the data to a cosmological measurement. We introduce several novel analysis techniques such as cable reflection calibration, hyper-resolution gridding kernels, diffuse foreground model subtraction, and quality control methods. Each change to the analysis pipeline is tested against a two dimensional power spectrum figure of merit to demonstrate improvement. We incorporate the new techniques into a deep integration of 32 hours of MWA data. This data set is used to place a systematic-limited upper limit on the cosmological power spectrum of $\Delta^2 \leq 2.7 \times 10^4$ mK$^2$ at $k=0.27$ h~Mpc$^{-1}$ and $z=7.1$, consistent with other published limits, and a modest improvement (factor of 1.4) over previous MWA results. From this deep analysis we have identified a list of improvements to be made to our EoR data analysis strategies. These improvements will be implemented in the future and detailed in upcoming publications.

We present deep polarimetric observations at 154 MHz with the Murchison Widefield Array (MWA), covering 625 deg^2 centered on RA=0 h, Dec=-27 deg. The sensitivity available in our deep observations allows an in-band, frequency-dependent analysis of polarized structure for the first time at long wavelengths. Our analysis suggests that the polarized structures are dominated by intrinsic emission but may also have a foreground Faraday screen component. At these wavelengths, the compactness of the MWA baseline distribution provides excellent snapshot sensitivity to large-scale structure. The observations are sensitive to diffuse polarized emission at ~54' resolution with a sensitivity of 5.9 mJy beam^-1 and compact polarized sources at ~2.4' resolution with a sensitivity of 2.3 mJy beam^-1 for a subset (400 deg^2) of this field. The sensitivity allows the effect of ionospheric Faraday rotation to be spatially and temporally measured directly from the diffuse polarized background. Our observations reveal large-scale structures (~1 deg - 8 deg in extent) in linear polarization clearly detectable in ~2 minute snapshots, which would remain undetectable by interferometers with minimum baseline lengths >110 m at 154 MHz. The brightness temperature of these structures is on average 4 K in polarized intensity, peaking at 11 K. Rotation measure synthesis reveals that the structures have Faraday depths ranging from -2 rad m^-2 to 10 rad m^-2 with a large fraction peaking at ~+1 rad m^-2. We estimate a distance of 51+/-20 pc to the polarized emission based on measurements of the in-field pulsar J2330-2005. We detect four extragalactic linearly polarized point sources within the field in our compact source survey. Based on the known polarized source population at 1.4 GHz and non-detections at 154 MHz, we estimate an upper limit on the depolarization ratio of 0.08 from 1.4 GHz to 154 MHz.

Detection of the Epoch of Reionization HI signal requires a precise understanding of the intervening galaxies and AGN, both for instrumental calibration and foreground removal. We present a catalogue of 7394 extragalactic sources at 182 MHz detected in the RA=0 field of the Murchison Widefield Array Epoch of Reionization observation programme. Motivated by unprecedented requirements for precision and reliability we develop new methods for source finding and selection. We apply machine learning methods to self-consistently classify the relative reliability of 9490 source candidates. A subset of 7466 are selected based on reliability class and signal-to-noise ratio criteria. These are statistically cross-matched to four other radio surveys using both position and flux density information. We find 7369 sources to have confident matches, including 90 partially resolved sources that split into a total of 192 sub-components. An additional 25 unmatched sources are included as new radio detections. The catalogue sources have a median spectral index of -0.85. Spectral flattening is seen toward lower frequencies with a median of -0.71 predicted at 182 MHz. The astrometric error is 7 arcsec. compared to a 2.3 arcmin. beam FWHM. The resulting catalogue covers approximately 1400 sq. deg. and is complete to approximately 80 mJy within half beam power. This provides the most reliable discrete source sky model available to date in the MWA EoR0 field for precision foreground subtraction.

21 cm Epoch of Reionization observations promise to transform our understanding of galaxy formation, but these observations are impossible without unprecedented levels of instrument calibration. We present end-to-end simulations of a full EoR power spectrum analysis including all of the major components of a real data processing pipeline: models of astrophysical foregrounds and EoR signal, frequency-dependent instrument effects, sky-based antenna calibration, and the full PS analysis. This study reveals that traditional sky-based per-frequency antenna calibration can only be implemented in EoR measurement analyses if the calibration model is unrealistically accurate. For reasonable levels of catalog completeness, the calibration introduces contamination in otherwise foreground-free power spectrum modes, precluding a PS measurement. We explore the origin of this contamination and potential mitigation techniques. We show that there is a strong joint constraint on the precision of the calibration catalog and the inherent spectral smoothness of antennae, and that this has significant implications for the instrumental design of the SKA and other future EoR observatories.

We present the 21 cm power spectrum analysis approach of the Murchison Widefield Array Epoch of Reionization project. In this paper, we compare the outputs of multiple pipelines for the purpose of validating statistical limits cosmological hydrogen at redshifts between 6 and 12. Multiple, independent, data calibration and reduction pipelines are used to make power spectrum limits on a fiducial night of data. Comparing the outputs of imaging and power spectrum stages highlights differences in calibration, foreground subtraction and power spectrum calculation. The power spectra found using these different methods span a space defined by the various tradeoffs between speed, accuracy, and systematic control. Lessons learned from comparing the pipelines range from the algorithmic to the prosaically mundane; all demonstrate the many pitfalls of neglecting reproducibility. We briefly discuss the way these different methods attempt to handle the question of evaluating a significant detection in the presence of foregrounds.

We present first results from radio observations with the Murchison Widefield Array seeking to constrain the power spectrum of 21 cm brightness temperature fluctuations between the redshifts of 11.6 and 17.9 (113 and 75 MHz). Three hours of observations were conducted over two nights with significantly different levels of ionospheric activity. We use these data to assess the impact of systematic errors at low frequency, including the ionosphere and radio-frequency interference, on a power spectrum measurement. We find that after the 1-3 hours of integration presented here, our measurements at the Murchison Radio Observatory are not limited by RFI, even within the FM band, and that the ionosphere does not appear to affect the level of power in the modes that we expect to be sensitive to cosmology. Power spectrum detections, inconsistent with noise, due to fine spectral structure imprinted on the foregrounds by reflections in the signal-chain, occupy the spatial Fourier modes where we would otherwise be most sensitive to the cosmological signal. We are able to reduce this contamination using calibration solutions derived from autocorrelations so that we achieve an sensitivity of $10^4$ mK on comoving scales $k\lesssim 0.5 h$Mpc$^{-1}$. This represents the first upper limits on the $21$ cm power spectrum fluctuations at redshifts $12\lesssim z \lesssim 18$ but is still limited by calibration systematics. While calibration improvements may allow us to further remove this contamination, our results emphasize that future experiments should consider carefully the existence of and their ability to calibrate out any spectral structure within the EoR window.

Experiments that pursue detection of signals from the Epoch of Reionization (EoR) are relying on spectral smoothness of source spectra at low frequencies. This article empirically explores the effect of foreground spectra on EoR experiments by measuring high-resolution full-polarization spectra for the 586 brightest unresolved sources in one of the MWA EoR fields using 45 h of observation. A novel peeling scheme is used to subtract 2500 sources from the visibilities with ionospheric and beam corrections, resulting in the deepest, confusion-limited MWA image so far. The resulting spectra are found to be affected by instrumental effects, which limit the constraints that can be set on source-intrinsic spectral structure. The sensitivity and power-spectrum of the spectra are analysed, and it is found that the spectra of residuals are dominated by PSF sidelobes from nearby undeconvolved sources. We release a catalogue describing the spectral parameters for each measured source.

In this paper we present observations, simulations, and analysis demonstrating the direct connection between the location of foreground emission on the sky and its location in cosmological power spectra from interferometric redshifted 21 cm experiments. We begin with a heuristic formalism for understanding the mapping of sky coordinates into the cylindrically averaged power spectra measurements used by 21 cm experiments, with a focus on the effects of the instrument beam response and the associated sidelobes. We then demonstrate this mapping by analyzing power spectra with both simulated and observed data from the Murchison Widefield Array. We find that removing a foreground model which includes sources in both the main field-of-view and the first sidelobes reduces the contamination in high k_parallel modes by several percent relative to a model which only includes sources in the main field-of-view, with the completeness of the foreground model setting the principal limitation on the amount of power removed. While small, a percent-level amount of foreground power is in itself more than enough to prevent recovery of any EoR signal from these modes. This result demonstrates that foreground subtraction for redshifted 21 cm experiments is truly a wide-field problem, and algorithms and simulations must extend beyond the main instrument field-of-view to potentially recover the full 21 cm power spectrum.

Detection of the cosmological neutral hydrogen signal from the Epoch of Reionization, and estimation of its basic physical parameters, is the principal scientific aim of many current low-frequency radio telescopes. Here we describe the Cosmological HI Power Spectrum Estimator (CHIPS), an algorithm developed and implemented with data from the Murchison Widefield Array (MWA), to compute the two-dimensional and spherically-averaged power spectrum of brightness temperature fluctuations. The principal motivations for CHIPS are the application of realistic instrumental and foreground models to form the optimal estimator, thereby maximising the likelihood of unbiased signal estimation, and allowing a full covariant understanding of the outputs. CHIPS employs an inverse-covariance weighting of the data through the maximum likelihood estimator, thereby allowing use of the full parameter space for signal estimation ("foreground suppression"). We describe the motivation for the algorithm, implementation, application to real and simulated data, and early outputs. Upon application to a set of 3 hours of data, we set a 2$\sigma$ upper limit on the EoR dimensionless power at $k=0.05$~h.Mpc$^{-1}$ of $\Delta_k^2<7.6\times{10^4}$~mK$^2$ in the redshift range $z=[6.2-6.6]$, consistent with previous estimates.

The Large Synoptic Survey Telescope (LSST) is a large-aperture, wide-field, ground-based survey system that will image the sky in six optical bands from 320 to 1050 nm, uniformly covering approximately $18,000$deg$^2$ of the sky over 800 times. The LSST is currently under construction on Cerro Pach\'on in Chile, and expected to enter operations in 2022. Once operational, the LSST will explore a wide range of astrophysical questions, from discovering "killer" asteroids to examining the nature of Dark Energy. The LSST will generate on average 15 TB of data per night, and will require a comprehensive Data Management system to reduce the raw data to scientifically useful catalogs and images with minimum human intervention. These reductions will result in a real-time alert stream, and eleven data releases over the 10-year duration of LSST operations. To enable this processing, the LSST project is developing a new, general-purpose, high-performance, scalable, well documented, open source data processing software stack for O/IR surveys. Prototypes of this stack are already capable of processing data from existing cameras (e.g., SDSS, DECam, MegaCam), and form the basis of the Hyper-Suprime Cam (HSC) Survey data reduction pipeline.

We confirm our recent prediction of the "pitchfork" foreground signature in power spectra of high-redshift 21 cm measurements where the interferometer is sensitive to large-scale structure on all baselines. This is due to the inherent response of a wide-field instrument and is characterized by enhanced power from foreground emission in Fourier modes adjacent to those considered to be the most sensitive to the cosmological H I signal. In our recent paper, many signatures from the simulation that predicted this feature were validated against Murchison Widefield Array (MWA) data, but this key pitchfork signature was close to the noise level. In this paper, we improve the data sensitivity through the coherent averaging of 12 independent snapshots with identical instrument settings and provide the first confirmation of the prediction with a signal-to-noise ratio > 10. This wide-field effect can be mitigated by careful antenna designs that suppress sensitivity near the horizon. Simple models for antenna apertures that have been proposed for future instruments such as the Hydrogen Epoch of Reionization Array and the Square Kilometre Array indicate they should suppress foreground leakage from the pitchfork by ~40 dB relative to the MWA and significantly increase the likelihood of cosmological signal detection in these critical Fourier modes in the three-dimensional power spectrum.

The separation of the faint cosmological background signal from bright astrophysical foregrounds remains one of the most daunting challenges of mapping the high-redshift intergalactic medium with the redshifted 21 cm line of neutral hydrogen. Advances in mapping and modeling of diffuse and point source foregrounds have improved subtraction accuracy, but no subtraction scheme is perfect. Precisely quantifying the errors and error correlations due to missubtracted foregrounds allows for both the rigorous analysis of the 21 cm power spectrum and for the maximal isolation of the "EoR window" from foreground contamination. We present a method to infer the covariance of foreground residuals from the data itself in contrast to previous attempts at a priori modeling. We demonstrate our method by setting limits on the power spectrum using a 3 h integration from the 128-tile Murchison Widefield Array. Observing between 167 and 198 MHz, we find at 95% confidence a best limit of Delta^2(k) < 3.7 x 10^4 mK^2 at comoving scale k = 0.18 hMpc^-1 and at z = 6.8, consistent with existing limits.

Detection of 21~cm emission of HI from the epoch of reionization, at redshifts z>6, is limited primarily by foreground emission. We investigate the signatures of wide-field measurements and an all-sky foreground model using the delay spectrum technique that maps the measurements to foreground object locations through signal delays between antenna pairs. We demonstrate interferometric measurements are inherently sensitive to all scales, including the largest angular scales, owing to the nature of wide-field measurements. These wide-field effects are generic to all observations but antenna shapes impact their amplitudes substantially. A dish-shaped antenna yields the most desirable features from a foreground contamination viewpoint, relative to a dipole or a phased array. Comparing data from recent Murchison Widefield Array observations, we demonstrate that the foreground signatures that have the largest impact on the HI signal arise from power received far away from the primary field of view. We identify diffuse emission near the horizon as a significant contributing factor, even on wide antenna spacings that usually represent structures on small scales. For signals entering through the primary field of view, compact emission dominates the foreground contamination. These two mechanisms imprint a characteristic "pitchfork" signature on the "foreground wedge" in Fourier delay space. Based on these results, we propose that selective down-weighting of data based on antenna spacing and time can mitigate foreground contamination substantially by a factor ~100 with negligible loss of sensitivity.

The Murchison Widefield Array (MWA) is a new low-frequency interferometric radio telescope built in Western Australia at one of the locations of the future Square Kilometre Array (SKA). We describe the automated radio-frequency interference (RFI) detection strategy implemented for the MWA, which is based on the AOFlagger platform, and present 72-231-MHz RFI statistics from 10 observing nights. RFI detection removes 1.1% of the data. RFI from digital TV (DTV) is observed 3% of the time due to occasional ionospheric or atmospheric propagation. After RFI detection and excision, almost all data can be calibrated and imaged without further RFI mitigation efforts, including observations within the FM and DTV bands. The results are compared to a previously published Low-Frequency Array (LOFAR) RFI survey. The remote location of the MWA results in a substantially cleaner RFI environment compared to LOFAR's radio environment, but adequate detection of RFI is still required before data can be analysed. We include specific recommendations designed to make the SKA more robust to RFI, including: the availability of sufficient computing power for RFI detection; accounting for RFI in the receiver design; a smooth band-pass response; and the capability of RFI detection at high time and frequency resolution (second and kHz-scale respectively).

We have developed a near-infrared spectrometer designed to measure the absolute intensity of the Solar 854.2 nm CaII Fraunhofer line, scattered by interplanetary dust, in the Zodiacal light spectrum. Based on the known equivalent line width in the Solar spectrum, this measurement can derive the Zodiacal brightness, testing models of the Zodiacal light based on morphology that are used to determine the extragalactic background light in absolute photometry measurements. The spectrometer is based on a simple high-resolution tipped filter placed in front of a compact camera with wide-field refractive optics to provide the large optical throughput and high sensitivity required for rocket-borne observations. We discuss the instrument requirements for an accurate measurement of the absolute Zodiacal light brightness, the measured laboratory characterization, and the instrument performance in flight.

The primary challenge for experiments measuring the neutral hydrogen power spectrum from the Epoch of Reionization (EoR) are mode-mixing effects where foregrounds from very bright astrophysical sources interact with the instrument to contaminate the EoR signal. In this paper we identify a new type of mode-mixing that occurs when measurements from non-identical baselines are combined for increased power spectrum sensitivity. This multi-baseline effect dominates the mode-mixing power in our simulations and can contaminate the EoR window, an area in Fourier space previously identified to be relatively free of foreground power.

We introduce the Fast Holographic Deconvolution method for analyzing interferometric radio data. Our new method is an extension of A-projection/software-holography/forward modeling analysis techniques and shares their precision deconvolution and widefield polarimetry, while being significantly faster than current implementations that use full direction-dependent antenna gains. Using data from the MWA 32 antenna prototype, we demonstrate the effectiveness and precision of our new algorithm. Fast Holographic Deconvolution may be particularly important for upcoming 21 cm cosmology observations of the Epoch of Reionization and Dark Energy where foreground subtraction is intimately related to the precision of the data reduction.

We have developed and characterized an imaging instrument to measure the spatial properties of the diffuse near-infrared extragalactic background light in a search for fluctuations from z > 6 galaxies during the epoch of reionization. The instrument is part of the Cosmic Infrared Background Experiment (CIBER), designed to observe the extragalactic background light above the Earth's atmosphere during a suborbital sounding rocket flight. The imaging instrument incorporates a 2x2 degree field of view, to measure fluctuations over the predicted peak of the spatial power spectrum at 10 arcminutes, and 7"x7" pixels, to remove lower redshift galaxies to a depth sufficient to reduce the low-redshift galaxy clustering foreground below instrumental sensitivity. The imaging instrument employs two cameras with \Delta \lambda / \lambda ~0.5 bandpasses centered at 1.1 and 1.6 microns to spectrally discriminate reionization extragalactic background fluctuations from local foreground fluctuations. CIBER operates at wavelengths where the electromagnetic spectrum of the reionization extragalactic background is thought to peak, and complements fluctuations measurements by AKARI and Spitzer at longer wavelengths. We have characterized the instrument in the laboratory, including measurements of the sensitivity, flat-field response, stray light performance, and noise properties. Several modifications were made to the instrument following a first flight in 2009 February. The instrument performed to specifications in subsequent flights in 2010 July and 2012 March, and the scientific data are now being analyzed.

Contamination from instrumental effects interacting with bright astrophysical sources is the primary impediment to measuring Epoch of Reionization and BAO 21 cm power spectra---an effect called mode-mixing. In this paper we identify four fundamental power spectrum shapes produced by mode-mixing that will affect all upcoming observations. We are able, for the first time, to explain the wedge-like structure seen in advanced simulations and to forecast the shape of an 'EoR window' that is mostly free of contamination. Understanding the origins of these contaminations also enables us to identify calibration and foreground subtraction errors below the imaging limit, providing a powerful new tool for precision observations.

Absolute spectrophotometric measurements of diffuse radiation at 1 \mu m to 2 \mu m are crucial to our understanding of the radiative content of the Universe from nucleosynthesis since the epoch of reionization, the composition and structure of the Zodiacal dust cloud in our solar system, and the diffuse galactic light arising from starlight scattered by interstellar dust. The Low Resolution Spectrometer (LRS) on the rocket-borne Cosmic Infrared Background Experiment (CIBER) is a \lambda / \Delta \lambda \sim 15-30 absolute spectrophotometer designed to make precision measurements of the absolute near-infrared sky brightness between 0.75 \mu m < \lambda < 2.1 \mu m. This paper presents the optical, mechanical and electronic design of the LRS, as well as the ground testing, characterization and calibration measurements undertaken before flight to verify its performance. The LRS is shown to work to specifications, achieving the necessary optical and sensitivity performance. We describe our understanding and control of sources of systematic error for absolute photometry of the near-infrared extragalactic background light.

The Cosmic Infrared Background Experiment (CIBER) is a suite of four instruments designed to study the near infrared (IR) background light from above the Earth's atmosphere. The instrument package comprises two imaging telescopes designed to characterize spatial anisotropy in the extragalactic IR background caused by cosmological structure during the epoch of reionization, a low resolution spectrometer to measure the absolute spectrum of the extragalactic IR background, and a narrow band spectrometer optimized to measure the absolute brightness of the Zodiacal light foreground. In this paper we describe the design and characterization of the CIBER payload. The detailed mechanical, cryogenic, and electrical design of the system are presented, including all system components common to the four instruments. We present the methods and equipment used to characterize the instruments before and after flight, and give a detailed description of CIBER's flight profile and configurations. CIBER is designed to be recoverable and has flown twice, with modifications to the payload having been informed by analysis of the first flight data. All four instruments performed to specifications during the second flight, and the scientific data from this flight are currently being analyzed.

Ultraviolet emission from the first generation of stars in the Universe ionized the intergalactic medium in a process which was completed by z~6; the wavelength of these photons has been redshifted by (1+z) into the near infrared today and can be measured using instruments situated above the Earth's atmosphere. First flying in February 2009, the Cosmic Infrared Background Experiment (CIBER) comprises four instruments housed in a single reusable sounding rocket borne payload. CIBER will measure spatial anisotropies in the extragalactic IR background caused by cosmological structure from the epoch of reionization using two broadband imaging instruments, make a detailed characterization of the spectral shape of the IR background using a low resolution spectrometer, and measure the absolute brightness of the Zodical light foreground with a high resolution spectrometer in each of our six science fields. This paper presents the scientific motivation for CIBER and details of its first two flights, including a review of the published scientific results from the first flight and an outlook for future reionization science with CIBER data.

Interplanetary dust (IPD) scatters solar radiation which results in the zodiacal light that dominates the celestial diffuse brightness at optical and near-infrared wavelengths. Both asteroid collisions and cometary ejections produce the IPD, but the relative contribution from these two sources is still unknown. The Low Resolution Spectrometer (LRS) onboard the Cosmic Infrared Background Experiment (CIBER) observed the astrophysical sky spectrum between 750 and 2100 nm over a wide range of ecliptic latitude. The resulting zodiacal light spectrum is redder than the solar spectrum, and shows a broad absorption feature, previously unreported, at approximately 900 nm, suggesting the existence of silicates in the IPD material. The spectral shape of the zodiacal light is isotropic at all ecliptic latitudes within the measurement error. The zodiacal light spectrum, including the extended wavelength range to 2500 nm using IRTS data, is qualitatively similar to the reflectance of S-type asteroids. This result can be explained by the proximity of S-type asteroidal dust to Earth's orbit, and the relativily high albedo of asteridal dust compared with cometary dust.

We use the multi-epoch, mid-infrared Spitzer Deep, Wide-Field Survey to investigate the variability of 474,179 objects in 8.1 deg^2 of the NDWFS Bootes field. We perform a Difference Image Analysis of the four available epochs between 2004 and 2008, focusing on the deeper 3.6 and 4.5 micron bands. We find that 1.1% of the studied sample meet our standard selection criteria for being classed as a variable source. We require that the 3.6 and 4.5 micron light-curves are strongly correlated (r>0.8) and that their joint variance exceeds that for all sources with the same magnitude by 2 sigma. We then examine the mid-IR colors of the variable sources and match them with X-ray sources from the XBootes survey, radio catalogs, 24 micron-selected AGN candidates, and spectroscopically identified AGNs from the AGN and Galaxy Evolution Survey (AGES). Based on their mid-IR colors, most of the variable sources are AGNs (76%), with smaller contributions from stars (11%), galaxies (6%), and unclassified objects. Most of the stellar, galaxy and unclassified sources are false positives. For our standard selection criteria, 11-12% of the mid-IR counterparts to X-ray sources, 24 micron-selected AGN candidates and spectroscopically identified AGNs show variability. Mid-IR AGN variability can be well described by a single power-law structure function with a power-law index of 0.5 at both 3.6 and 4.5 microns, and an amplitude of 0.1 mag on rest-frame time scales of 2 years. The variability amplitude is higher for shorter rest-frame wavelengths and lower luminosities. (Abridged)

The Spitzer Deep, Wide-Field Survey (SDWFS) is a four-epoch infrared survey of ten square degrees in the Bootes field of the NOAO Deep Wide-Field Survey using the IRAC instrument on the Spitzer Space Telescope. SDWFS, a Cycle four Spitzer Legacy project, occupies a unique position in the area-depth survey space defined by other Spitzer surveys. The four epochs that make up SDWFS permit -- for the first time -- the selection of infrared-variable and high proper motion objects over a wide field on timescales of years. Because of its large survey volume, SDWFS is sensitive to galaxies out to z~3 with relatively little impact from cosmic variance for all but the richest systems. The SDWFS datasets will thus be especially useful for characterizing galaxy evolution beyond z~1.5. This paper explains the SDWFS observing strategy and data processing, presents the SDWFS mosaics and source catalogs, and discusses some early scientific findings. The publicly-released, full-depth catalogs contain 6.78, 5.23, 1.20, and 0.96 x 10e5 distinct sources detected to the average 5-sigma, 4" diameter, aperture-corrected limits of 19.77, 18.83, 16.50, and 15.82 Vega mag at 3.6, 4.5, 5.8, and 8.0 micron, respectively. The SDWFS number counts and color-color distribution are consistent with other, earlier Spitzer surveys. At the 6 min integration time of the SDWFS IRAC imaging, more than 50% of isolated FIRST radio sources and more than 80% of on-axis XBootes sources are detected out to 8.0 micron. Finally, we present the four highest proper motion IRAC-selected sources identified from the multi-epoch imaging, two of which are likely field brown dwarfs of mid-T spectral class.

The Cosmic Infrared Background ExpeRiment (CIBER) is a rocket-borne absolute photometry imaging and spectroscopy experiment optimized to detect signatures of first-light galaxies present during reionization in the unresolved IR background. CIBER-I consists of a wide-field two-color camera for fluctuation measurements, a low-resolution absolute spectrometer for absolute EBL measurements, and a narrow-band imaging spectrometer to measure and correct scattered emission from the foreground zodiacal cloud. CIBER-I was successfully flown on February 25th, 2009 and has one more planned flight in early 2010. We propose, after several additional flights of CIBER-I, an improved CIBER-II camera consisting of a wide-field 30 cm imager operating in 4 bands between 0.5 and 2.1 microns. It is designed for a high significance detection of unresolved IR background fluctuations at the minimum level necessary for reionization. With a FOV 50 to 2000 times largerthan existing IR instruments on satellites, CIBER-II will carry out the definitive study to establish the surface density of sources responsible for reionization.

(Brief Summary) What is the total radiative content of the Universe since the epoch of recombination? The extragalactic background light (EBL) spectrum captures the redshifted energy released from the first stellar objects, protogalaxies, and galaxies throughout cosmic history. Yet, we have not determined the brightness of the extragalactic sky from UV/optical to far-infrared wavelengths with sufficient accuracy to establish the radiative content of the Universe to better than an order of magnitude. Among many science topics, an accurate measurement of the EBL spectrum from optical to far-IR wavelengths, will address: What is the total energy released by stellar nucleosynthesis over cosmic history? Was significant energy released by non-stellar processes? Is there a diffuse component to the EBL anywhere from optical to sub-millimeter? When did first stars appear and how luminous was the reionization epoch? Absolute optical to mid-IR EBL spectrum to an astrophysically interesting accuracy can be established by wide field imagingat a distance of 5 AU or above the ecliptic plane where the zodiacal foreground is reduced by more than two orders of magnitude.

In order to understand the origin of clustered anisotropies detected in Spitzer images between 3.6 and 8 microns, we stack the Spitzer IRAC/Great Observatories Origins Deep Survey (GOODS) images at pixel locations corresponding to faint, z_{AB}~27 mag, optical sources with no obvious IR counterparts. We obtain a strong detection of the sources with a stacked median flux at 3.6 microns of 130+/-5 nJy above the background. The wealth of multi-wavelength imaging data in GOODS enables a similar stacking analysis to be undertaken at various wavelengths between the ultraviolet and near-infrared bands. We obtain strong stacked detections of these optically faint sources over the entire wavelength range which places constraints on the average properties of these sources. We find that the flux spectrum of the median, stacked source is consistent with a L<0.03 L_{*,UV} galaxy with a 90% confidence interval for the redshift of 1.9-2.7. These sources produce a 3.6 micron absolute background intensity between 0.1 and 0.35 nW/m^2/sr and the clustered IR light could account for ~30-50% of fluctuation power in the IR background at 4 arcminute angular scales. Although the exact redshift distribution of these sources is unknown, these galaxies appear to contain 5-20% of the co-moving stellar mass density at z~2.5.

We describe the angular power spectrum of unresolved 3.6 micron IR light in Spitzer GOODS fields. The amplitude of the anisotropy spectrum decreases with decreasing flux threshold to which resolved sources are removed from images. When all pixels brighter than a Vega magnitude of 24.6 are removed, the amplitude of the power spectrum at arcminute angular scales can be described with an extra component of z>8 sources with a IRB contribution around 0.4 nW m^-2 sr-1. The shape of the power spectrum, however, is more consistent with that expected for unresolved, faint galaxies at lower redshifts with Vega magnitudes fainter than 23 with a total 3.6 micron intensity between 0.1 to 0.8 nW m^-2 sr^-1. We confirm this assumption by showing that large-scale power decreases rapidly when the unresolved clustering spectrum is measured from a processed HDF-N IRAC image where locations of faint ACS sources with no IR counterparts were also masked. Based on resolved counts and unresolved fluctuations, we find that, at most, about 7.0 nW m^-2 sr^-1 can be ascribed to galaxies.

We describe the angular power spectrum of resolved sources at 3.6 microns (L-band) in Spitzer imaging data of the GOODS HDF-N, the GOODS CDF-S, and the NDWFS Bootes field in several source magnitude bins. We also measure angular power spectra of resolved sources in the Bootes field at K_S and J-bands using ground-based IR imaging data. In the three bands, J, K_S, and L, we detect the clustering of galaxies on top of the shot-noise power spectrum at multipoles between ell ~ 10^2 and 10^5. The angular power spectra range from the large, linear scales to small, non-linear scales of galaxy clustering, and in some magnitude ranges, show departure from a power-law clustering spectrum. We consider a halo model to describe clustering measurements and to establish the halo occup ation number parameters of IR bright galaxies at redshifts around one. We also extend our clustering results and completeness-corrected faint source number counts in GOODS fields to understand the underlying nature of unresolved sources responsible for IR background (IRB) anisotropies that were detected in deep Spitzer images. While these unresolved fluctuations were measured at sub-arcminute angular scales, if a high-redshift diffuse component associated with first galaxies exists in the IRB, then it's clustering properties are best studied with shallow, wide-field images that allow a measurement of the clustering spectrum from a few degrees to arcminute angular scales.

We are developing a rocket-borne instrument (the Cosmic Infrared Background ExpeRiment, or CIBER) to search for signatures of primordial galaxy formation in the cosmic near-infrared extra-galactic background. CIBER consists of a wide-field two-color camera, a low-resolution absolute spectrometer, and a high-resolution narrow-band imaging spectrometer. The cameras will search for spatial fluctuations in the background on angular scales from 7 arcseconds to 2 degrees over a range of angular scales poorly covered by previous experiments. CIBER will determine if the fluctuations reported by the IRTS arise from first-light galaxies or have a local origin. In a short rocket flight CIBER has sensitivity to probe fluctuations 100 times fainter than IRTS/DIRBE. By jointly observing regions of the sky studied by Spitzer and ASTRO-F, CIBER will build a multi-color view of the near-infrared background, accurately assessing the contribution of local (z = 1-3) galaxies to the observed background fluctuations, allowing a deep and comprehensive survey for first-light galaxy background fluctuations. The low-resolution spectrometer will search for a redshifted Lyman cutoff feature between 0.8 - 2.0 microns. The high-resolution spectrometer will trace zodiacal light using the intensity of scattered Fraunhofer lines, providing an independent measurement of the zodiacal emission and a new check of DIRBE zodiacal dust models. The combination will systematically search for the infrared excess background light reported in near-infrared DIRBE/IRTS data, compared with the small excess reported at optical wavelengths.