Fast radio bursts (FRBs) are bright, millisecond-duration radio transients originating from extragalactic distances. Their origin is unknown. Some FRB sources emit repeat bursts, ruling out cataclysmic origins for those events. Despite searches for periodicity in repeat burst arrival times on time scales from milliseconds to many days, these bursts have hitherto been observed to appear sporadically, and though clustered, without a regular pattern. Here we report the detection of a $16.35\pm0.15$ day periodicity (or possibly a higher-frequency alias of that periodicity) from a repeating FRB 180916.J0158+65 detected by the Canadian Hydrogen Intensity Mapping Experiment Fast Radio Burst Project (CHIME/FRB). In 38 bursts recorded from September 16th, 2018 through February 4th, 2020, we find that all bursts arrive in a 5-day phase window, and 50% of the bursts arrive in a 0.6-day phase window. Our results suggest a mechanism for periodic modulation either of the burst emission itself, or through external amplification or absorption, and disfavour models invoking purely sporadic processes.

Magnetars are highly magnetized young neutron stars that occasionally produce enormous bursts and flares of X-rays and gamma-rays. Of the approximately thirty magnetars currently known in our Galaxy and Magellanic Clouds, five have exhibited transient radio pulsations. Fast radio bursts (FRBs) are millisecond-duration bursts of radio waves arriving from cosmological distances. Some have been seen to repeat. A leading model for repeating FRBs is that they are extragalactic magnetars, powered by their intense magnetic fields. However, a challenge to this model has been that FRBs must have radio luminosities many orders of magnitude larger than those seen from known Galactic magnetars. Here we report the detection of an extremely intense radio burst from the Galactic magnetar SGR 1935+2154 using the Canadian Hydrogen Intensity Mapping Experiment (CHIME) FRB project. The fluence of this two-component bright radio burst and the estimated distance to SGR 1935+2154 together imply a 400-800 MHz burst energy of $\sim 3 \times 10^{34}$ erg, which is three orders of magnitude brighter than those of any radio-emitting magnetar detected thus far. Such a burst coming from a nearby galaxy would be indistinguishable from a typical FRB. This event thus bridges a large fraction of the radio energy gap between the population of Galactic magnetars and FRBs, strongly supporting the notion that magnetars are the origin of at least some FRBs.

The Tianlai Cylinder Pathfinder is a radio interferometer array designed to test techniques for 21 cm intensity mapping in the post-reionization Universe, with the ultimate aim of mapping the large scale structure and measuring cosmological parameters such as the dark energy equation of state. Each of its three parallel cylinder reflectors is oriented in the north-south direction, and the array has a large field of view. As the Earth rotates, the northern sky is observed by drift scanning. The array is located in Hongliuxia, a radio-quiet site in Xinjiang, and saw its first light in September 2016. In this first data analysis paper for the Tianlai cylinder array, we discuss the sub-system qualification tests, and present basic system performance obtained from preliminary analysis of the commissioning observations during 2016-2018. We show typical interferometric visibility data, from which we derive the actual beam profile in the east-west direction and the frequency band-pass response. We describe also the calibration process to determine the complex gains for the array elements, either using bright astronomical point sources, or an artificial on site calibrator source, and discuss the instrument response stability, crucial for transit interferometry. Based on this analysis, we find a system temperature of about 90 K, and we also estimate the sensitivity of the array.

Fast radio bursts offer the opportunity to place new constraints on the mass and density profile of hot and ionized gas in galactic haloes. We test here the X-ray emission and dispersion measure predicted by different gas profiles for the halo of the Milky Way. We examine a range of models, including entropy stability conditions and external pressure continuity. We find that incorporating constraints from X-ray observations leads to favouring dispersion measures on the lower end of the range given by these models. We show that the dispersion measure of the Milky Way halo could be less than 10 cm$^{-3}$ pc in the most extreme model we consider, which is based on constraints from O VII absorption lines. However, the models allowed by the soft X-ray constraints span more than an order of magnitude in dispersion measures. Additional information on the distribution of gas in the Milky Way halo could be obtained from the signature of a dipole in the dispersion measure of fast radio bursts across the sky, but this will be a small effect for most cases.

The Crab pulsar has striking radio emission properties, with the two dominant pulse components -- the main pulse and the interpulse -- consisting entirely of giant pulses. The emission is scattered in both the Crab nebula and the interstellar medium, causing multi-path propagation and thus scintillation. We study the scintillation of the Crab's giant pulses using phased Westerbork data at 1668\,MHz. We find that giant pulse spectra correlate at only $\sim 2 \%$, much lower than the $1/3$ correlation expected from a randomized signal imparted with the same impulse response function. In addition, we find that the main pulse and the interpulse appear to scintillate differently, with the scintillation of the interpulse correlating to the main pulse at a lower amplitude over a longer time and frequency range. These lines of evidence suggest that the giant pulse emission regions are extended, and that the main pulse and interpulse arise in physically distinct regions which are resolved by the scattering screen. Assuming the scattering takes place in the nebular filaments, the emission regions are of order a light cylinder radius, as projected on the sky. With further VLBI and multi-frequency data, it may be possible to measure the distance to the scattering screens, the size of giant pulse emission regions, and the physical separation between the pulse components.

High-precision cosmological probes have revealed a small but significant tension between the parameters measured with different techniques, one of which is based on time delays in gravitational lenses. We discuss a new way of using time delays for cosmology, taking advantage of the extreme precision expected for lensed Fast Radio Bursts, short flashes of radio emission originating at cosmological distances. With coherent methods the achievable precision is sufficient to even measure how time delays change over the months and years, which can also be interpreted as differential redshifts between the images. It turns out that uncertainties arising from the unknown mass distribution of gravitational lenses can be eliminated by combining time delays with their time derivatives. Other effects, most importantly relative proper motion, can be measured accurately and separated from the cosmological effects. With a mock sample of simulated lenses we show that strong constraints on cosmological parameters are potentially possible. Finally the lensed images can be used as galactic interferometer to resolve structures and motions of the burst sources with insanely high resolution and help revealing their currently unknown physical nature.

Realistic synthetic observations of theoretical source models are essential for our understanding of real observational data. In using synthetic data, one can verify the extent to which source parameters can be recovered and evaluate how various data corruption effects can be calibrated. These studies are important when proposing observations of new sources, in the characterization of the capabilities of new or upgraded instruments, and when verifying model-based theoretical predictions in a comparison with observational data. We present the SYnthetic Measurement creator for long Baseline Arrays (SYMBA), a novel synthetic data generation pipeline for Very Long Baseline Interferometry (VLBI) observations. SYMBA takes into account several realistic atmospheric, instrumental, and calibration effects. We used SYMBA to create synthetic observations for the Event Horizon Telescope (EHT), a mm VLBI array, which has recently captured the first image of a black hole shadow. After testing SYMBA with simple source and corruption models, we study the importance of including all corruption and calibration effects. Based on two example general relativistic magnetohydrodynamics (GRMHD) model images of M87, we performed case studies to assess the attainable image quality with the current and future EHT array for different weather conditions. The results show that the effects of atmospheric and instrumental corruptions on the measured visibilities are significant. Despite these effects, we demonstrate how the overall structure of the input models can be recovered robustly after performing calibration steps. With the planned addition of new stations to the EHT array, images could be reconstructed with higher angular resolution and dynamic range. In our case study, these improvements allowed for a distinction between a thermal and a non-thermal GRMHD model based on salient features in reconstructed images.

Galaxy spins can be predicted from the initial conditions in the early Universe through the tidal tensor twist. In simulations, their directions are well preserved through cosmic time, consistent with expectations of angular momentum conservation. We report a $\sim 3 \sigma$ detection of correlation between observed oriented directions of galaxy angular momenta and their predictions based on the initial density field reconstructed from the positions of SDSS galaxies. The detection is driven by a group of spiral galaxies classified by the Galaxy Zoo as (anti-)clockwise, with a modest improvement from adding galaxies from MaNGA and SAMI surveys. This is the first such detection of the oriented galaxy spin direction, which opens a way to use measurements of galaxy spins to probe fundamental physics in the early Universe.

Chiral symmetry is maximally violated in weak interactions, and such microscopic asymmetries in the early Universe might leave observable imprints on astrophysical scales without violating the cosmological principle. In this Letter, we propose a helicity measurement to detect primordial chiral violation. We point out that observations of halo-galaxy angular momentum directions (spins), which are frozen in during the galaxy formation process, provide a fossil chiral observable. From the clustering mode of large scale structure of the Universe, we construct a spin mode in Lagrangian space and show in simulations that it is a good probe of halo-galaxy spins. In standard model, a strong symmetric correlation between the left and right helical components of this spin mode and galaxy spins is expected. Measurements of these correlations will be sensitive to chiral breaking, providing a direct test of chiral symmetry breaking in the early Universe.

Wave effects are often neglected in microlensing studies; however, for coherent point-like sources, such as pulsars and fast radio bursts (FRBs), wave effects will become important in their gravitational lensing. In this paper, we describe the wave optics formalism, its various limits, and the conditions for which these limits hold. Using the simple point lens as an example, we will show that the frequency dependence of wave effects breaks degeneracies that are present in the usual geometric optics limit, and constructive interference results in larger magnifications further from the lens. This latter fact leads to a generic increase in cross section for microlensing events in the wave-optics regime compared to the geometric optics regime. For realistic percent-level spectral sensitivities, this leads to a relative boost in lensing cross section of more than an order of magnitude. We apply the point-lens model to the lensing of FRBs and pulsars and find that these radio sources will be lensed in the full wave-optics regime by isolated masses in the range of $0.1-100\,M_\oplus$, which includes free-floating planets (FFPs), whose Einstein radius is smaller than the Fresnel scale. More generally, the interference pattern allows an instantaneous determination of lens masses, unlike traditional microlensing techniques which only yield a mass inference from the event timescale.

We report on the discovery and analysis of bursts from nine new repeating fast radio burst (FRB) sources found using the Canadian Hydrogen Intensity Mapping Experiment (CHIME) telescope. These sources span a dispersion measure (DM) range of 195 to 1380 pc cm$^{-3}$. We detect two bursts from three of the new sources, three bursts from four of the new sources, four bursts from one new source, and five bursts from one new source. We determine sky coordinates of all sources with uncertainties of $\sim$10$^\prime$. We detect Faraday rotation measures for two sources, with values $-20(1)$ and $-499.8(7)$ rad m$^{-2}$, that are substantially lower than the RM derived from bursts emitted by FRB 121102. We find that the DM distribution of our events, combined with the nine other repeaters discovered by CHIME/FRB, is indistinguishable from that of thus far non-repeating CHIME/FRB events. However, as previously reported, the burst widths appear statistically significantly larger than the thus far non-repeating CHIME/FRB events, further supporting the notion of inherently different emission mechanisms and/or local environments. These results are consistent with previous work, though are now derived from 18 repeating sources discovered by CHIME/FRB during its first year of operation. We identify candidate galaxies that may contain FRB 190303.J1353+48 (DM = 222.4 pc cm$^{-3}$).

Fast radio bursts (FRBs) are brief, bright, extragalactic radio flashes. Their physical origin remains unknown, but dozens of possible models have been postulated. Some FRB sources exhibit repeat bursts. Though over a hundred FRB sources have been discovered to date, only four have been localised and associated with a host galaxy, with just one of the four known to repeat. The properties of the host galaxies, and the local environments of FRBs, provide important clues about their physical origins. However, the first known repeating FRB has been localised to a low-metallicity, irregular dwarf galaxy, and the apparently non-repeating sources to higher-metallicity, massive elliptical or star-forming galaxies, suggesting that perhaps the repeating and apparently non-repeating sources could have distinct physical origins. Here we report the precise localisation of a second repeating FRB source, FRB 180916.J0158+65, to a star-forming region in a nearby (redshift $z = 0.0337 \pm 0.0002$) massive spiral galaxy, whose properties and proximity distinguish it from all known hosts. The lack of both a comparably luminous persistent radio counterpart and a high Faraday rotation measure further distinguish the local environment of FRB 180916.J0158+65 from that of the one previously localised repeating FRB source, FRB 121102. This demonstrates that repeating FRBs have a wide range of luminosities, and originate from diverse host galaxies and local environments.

The EXperiment for Cryogenic Large-Aperture Intensity Mapping (EXCLAIM) is a cryogenic balloon-borne instrument that will survey galaxy and star formation history over cosmological time scales. Rather than identifying individual objects, EXCLAIM will be a pathfinder to demonstrate an intensity mapping approach, which measures the cumulative redshifted line emission. EXCLAIM will operate at 420-540 GHz with a spectral resolution R=512 to measure the integrated CO and [CII] in redshift windows spanning 0 < z < 3.5. CO and [CII] line emissions are key tracers of the gas phases in the interstellar medium involved in star-formation processes. EXCLAIM will shed light on questions such as why the star formation rate declines at z < 2, despite continued clustering of the dark matter. The instrument will employ an array of six superconducting integrated grating-analog spectrometers (micro-spec) coupled to microwave kinetic inductance detectors (MKIDs). Here we present an overview of the EXCLAIM instrument design and status.

This white paper submitted for the 2020 Canadian Long-Range Planning process (LRP2020) presents the prospects for Canada and the Square Kilometre Array (SKA) from 2020-2030, focussing on the first phase of the project (SKA1) scheduled to begin construction early in the next decade. SKA1 will make transformational advances in our understanding of the Universe across a wide range of fields, and Canadians are poised to play leadership roles in several. Canadian key SKA technologies will ensure a good return on capital investment in addition to strong scientific returns, positioning Canadian astronomy for future opportunities well beyond 2030. We therefore advocate for Canada's continued scientific and technological engagement in the SKA from 2020-2030 through participation in the construction and operations phases of SKA1.

The Canadian Hydrogen Observatory and Radio-transient Detector (CHORD) is a next-generation radio telescope, proposed for construction to start immediately. CHORD is a pan-Canadian project, designed to work with and build on the success of the Canadian Hydrogen Intensity Mapping Experiment (CHIME). It is an ultra-wideband, "large-N, small-D" telescope, consisting of a central array of 512x6-m dishes, supported by a pair of distant outrigger stations, each equipped with CHIME-like cylinders and a 64-dish array. CHORD will measure the distribution of matter over a huge swath of the Universe, detect and localize tens of thousands of Fast RadioBursts (FRBs), and undertake cutting-edge measurements of fundamental physics.

In the standard big bang model the universe starts in a radiation dominated era, where the gravitational perturbations are described by second order differential equations, which will generally have two orthogonal set of solutions. One is the so called {\it growing(cosine)} mode and the other is the {\it decaying(sine)} mode, where the nomenclature is derived from their behaviour on super-horizon(sub-horizon) scales. The decaying mode is qualitatively different to the growing mode of adiabatic perturbations as it evolves with time on \emph{super-horizon} scales. The time dependence of this mode on super-horizon scales is analysed in both the synchronous gauge and the Newtonian gauge to understand the true gauge invariant behaviour of these modes. We then explore constraints on the amplitude of this mode on scales between $k \sim 10^{-5}$ Mpc$^{-1}$ and $k \sim 10^{-1}$ Mpc$^{-1}$ using the temperature and polarization anisotropies from the cosmic microwave background, by computing the Fisher information. Binning the primordial power non-parametrically into 100 bins, we find that the decaying modes are constrained at comparable variance as the growing modes on scales smaller than the horizon today using temperature anisotropies. Adding polrisation data makes the decaying mode more constrained. The decaying mode amplitude is thus constrained by $\sim 1/l$ of the growing mode. On super-horizon scales, the growing mode is poorly constrained, while the decaying mode cannot substantially exceed the scale-invariant amplitude. This interpretation differs substantially from the past literature, where the constraints were quoted in gauge-dependent variables, and resulted in illusionary tight super-horizon decaying mode constraints. The results presented here can generally be used to non-parametrically constrain any model of the early universe.

We report on the discovery of eight repeating fast radio burst (FRB) sources found using the Canadian Hydrogen Intensity Mapping Experiment (CHIME) telescope. These sources span a dispersion measure (DM) range of 103.5 to 1281 pc cm$^{-3}$. They display varying degrees of activity: six sources were detected twice, another three times, and one ten times. These eight repeating FRBs likely represent the bright and/or high-rate end of a distribution of infrequently repeating sources. For all sources, we determine sky coordinates with uncertainties of $\sim$10$^\prime$. FRB 180916.J0158+65 has a burst-averaged DM = $349.2 \pm 0.3$ pc cm$^{-3}$ and a low DM excess over the modelled Galactic maximum (as low as $\sim$20 pc cm$^{-3}$); this source also has a Faraday rotation measure (RM) of $-114.6 \pm 0.6$ rad m$^{-2}$, much lower than the RM measured for FRB 121102. FRB 181030.J1054+73 has the lowest DM for a repeater, $103.5 \pm 0.3$ pc cm$^{-3}$, with a DM excess of $\sim$ 70 pc cm$^{-3}$. Both sources are interesting targets for multi-wavelength follow-up due to their apparent proximity. The DM distribution of our repeater sample is statistically indistinguishable from that of the first 12 CHIME/FRB sources that have not repeated. We find, with 4$\sigma$ significance, that repeater bursts are generally wider than those of CHIME/FRB bursts that have not repeated, suggesting different emission mechanisms. Our repeater events show complex morphologies that are reminiscent of the first two discovered repeating FRBs. The repetitive behavior of these sources will enable interferometric localizations and subsequent host galaxy identifications.

Many models of the early universe predict that there should be primordial tensor perturbations. These leave an imprint into the temperature and polarisation anisotropies of the cosmic microwave background (CMB). The differential equation describing the primordial tensor perturbations is a second order differential equation and thus has two solutions. Canonically, the decaying solution of this equation in radiation domination is dropped as it diverges at early times and on superhorizon scales while it is then suppressed at late times. Furthermore, if there is an inflationary phase prior to the radiation domination phase, the amplitude of the decaying mode will also be highly suppressed as it enters the radiation phase, thus its effect will be negligible. In this study we remain agnostic to the early universe models describing pre-radiation domination physics and allow this mode to be present and see what effect it has on the CMB anisotropies. We find that the decaying mode, if normalised at the same time on subhorizon scales as the growing mode leaves an imprint on the CMB anisotropies that is identical to the growing mode. Contrary to expectation, on large scales both modes are poorly constrained for a scale invariant spectrum, and the apparent divergence of the decaying mode does not lead to a divergent physical observable. Quantitatively, the decaying mode can be more constrained both from temperature and polarisation anisotropies. We use a model independent, non-parametric, approach to constrain both of these primordial tensor perturbations using the temperature and polarisation anisotropies. We find that both modes are best constrained at the reionisation and recombination bumps and crucially, at the reionisation bump the decaying mode can be distinguished from the growing mode.

We introduce a new method for evaluating the oscillatory integrals which describe natural interference patterns. As an illustrative example of contemporary interest, we consider astrophysical plasma lensing of coherent sources like pulsars and fast radio bursts in radioastronomy. Plasma lenses are known to occur near the source, in the interstellar medium, as well as in the solar wind and the earth's ionosphere. Such lensing is strongest at long wavelengths hence it is generally important to go beyond geometric optics and into the full wave optics regime. Our computational method is a spinoff of new techniques two of us, and our collaborators, have developed for defining and performing Lorentzian path integrals. Cauchy's theorem allows one to transform a computationally fragile and expensive, highly oscillatory integral into an exactly equivalent sum of absolutely and rapidly convergent integrals which can be evaluated in polynomial time. We require only that it is possible to analytically continue the lensing phase, expressed in the integrated coordinates, into the complex domain. We give a first-principles derivation of the Fresnel-Kirchhoff integral, starting from Feynman's path integral for a massless particle in a refractive medium. We then demonstrate the effectiveness of our method by computing the interference patterns of Thom's caustic catastrophes, both in their "normal forms" and within a variety of more realistic, local lens models, over all wavelengths. Our numerical method, implemented in a freely downloadable code, provides a fast, accurate tool for modeling interference patterns in radioastronomy and other fields of physics.

Cosmological observations are promising ways to improve our understanding of neutrino mass properties. The upper bound on the sum of masses is given by the cosmic microwave background and large scale structure. These measurements are all parity-even, and potentially contaminated by unmodeled baryonic effects. In this paper we propose a novel parity-odd gravitational effect of neutrinos: A unique contribution to the directions of the angular momentum field of galaxies and halos. This observable is free of contamination in linear perturbation theory, and thus likely more cleanly separated from other nongravitational effects. A deep 21-cm survey to redshift 1 can potentially yield a $5\sigma$ significance on neutrino mass detection for a fiducial sum of neutrino masses of 0.05 eV.

We report the detection of a single burst from the first-discovered repeating Fast Radio Burst source, FRB 121102, with CHIME/FRB, which operates in the frequency band 400-800 MHz. The detected burst occurred on 2018 November 19 and its emission extends down to at least 600 MHz, the lowest frequency detection of this source yet. The burst, detected with a significance of 23.7$\sigma$, has fluence 12$\pm$3 Jy ms and shows complex time and frequency morphology. The 34 ms width of the burst is the largest seen for this object at any frequency. We find evidence of sub-burst structure that drifts downward in frequency at a rate of -3.9$\pm$0.2 MHz ms$^{-1}$. Our best fit tentatively suggests a dispersion measure of 563.6$\pm$0.5 pc cm$^{-3}$, which is ${\approx}$1% higher than previously measured values. We set an upper limit on the scattering time at 500 MHz of 9.6 ms, which is consistent with expectations from the extrapolation from higher frequency data. We have exposure to the position of FRB 121102 for a total of 11.3 hrs within the FWHM of the synthesized beams at 600 MHz from 2018 July 25 to 2019 February 25. We estimate on the basis of this single event an average burst rate for FRB 121102 of 0.1-10 per day in the 400-800 MHz band for a median fluence threshold of 7 Jy ms in the stated time interval.

The discovery of a repeating Fast Radio Burst (FRB) source, FRB 121102, eliminated models involving cataclysmic events for this source. No other repeating FRB has yet been detected in spite of many recent FRB discoveries and follow-ups, suggesting repeaters may be rare in the FRB population. Here we report the detection of six repeat bursts from FRB 180814.J0422+73, one of the 13 FRBs detected by the Canadian Hydrogen Intensity Mapping Experiment (CHIME) FRB project during its pre-commissioning phase in July and August 2018. These repeat bursts are consistent with originating from a single position on the sky, with the same dispersion measure (DM), ~189 pc cm-3. This DM is approximately twice the expected Milky Way column density, and implies an upper limit on the source redshift of 0.1, at least a factor of ~2 closer than FRB 121102. In some of the repeat bursts, we observe sub-pulse frequency structure, drifting, and spectral variation reminiscent of that seen in FRB 121102, suggesting similar emission mechanisms and/or propagation effects. This second repeater, found among the first few CHIME/FRB discoveries, suggests that there exists -- and that CHIME/FRB and other wide-field, sensitive radio telescopes will find -- a substantial population of repeating FRBs.

Fast radio bursts (FRBs) are highly dispersed millisecond-duration radio flashes likely arriving from far outside the Milky Way galaxy. This phenomenon was discovered at radio frequencies near 1.4 GHz and to date has been observed in one case at as high as 8 GHz, but not below 700 MHz in spite of significant searches at low frequencies. Here we report detections of FRBs at radio frequencies as low as 400 MHz, on the Canadian Hydrogen Intensity Mapping Experiment (CHIME) using the CHIME/FRB instrument. We present 13 FRBs detected during a telescope pre-commissioning phase, when our sensitivity and field-of-view were not yet at design specifications. Emission in multiple events is seen down to 400 MHz, the lowest radio frequency to which we are sensitive. The FRBs show a variety of temporal scattering behaviours, with the majority significantly scattered, and some apparently unscattered to within measurement uncertainty even at our lowest frequencies. Of the 13 reported here, one event has the lowest dispersion measure yet reported, implying it is among the closest yet known, and another has shown multiple repeat bursts, as described in a companion paper. Our low-scattering events suggest that efforts to detect FRBs at radio frequencies below 400 MHz will eventually be successful. The overall scattering properties of our sample suggest that FRBs as a class are preferentially located in environments that scatter radio waves more strongly than the diffuse interstellar medium (ISM) in the Milky Way.

Baryonic feedback can significantly modify the spatial distribution of matter on small scales and create a bulk relative velocity between the dominant cold dark matter and the hot gas. We study the consequences of such bulk motions using two high resolution hydrodynamic simulations, one with no feedback and one with very strong feedback. We find that relative velocities of order $100\ \kms$ are produced in the strong feedback simulation whereas it is much smaller when there is no feedback. Such relative motions induce dipole distortions to the gas, which we quantify by computing the dipole correlation function. We find halo coordinates and velocities are systematically changed in the direction of the relative velocity. Finally, we discuss potential to observe the relative velocity via large scale structure, Sunyaev-Zel'dovich and line emission measurements. Given the nonlinear nature of this effect, it should next be studied in simulations with different feedback implementations/strengths to determine the available model space.

21 cm intensity mapping has emerged as a promising technique to map the large-scale structure of the Universe, at redshifts $z$ from 1 to 10. Unfortunately, many of the key cross-correlations with the cosmic microwave background and photo-$z$ galaxies have been thought to be impossible due to the foreground contamination for radial modes with small wave numbers. In this paper, we apply tidal reconstruction to the simulated 21 cm fields and recover the lost large-scale radial modes successfully. We estimate the detectability of the cross-correlation signals and find they can be detected at high significance with current 21 cm experiments. The tidal field reconstruction method opens up a new set of possibilities to probe the Universe and is extremely valuable not only for 21 cm surveys but also for cosmic microwave background and photometric-redshift observations.

We discuss the possibility of studying diffuse baryon distributions with kinematic Sunyaev-Zel'dovich (kSZ) effect by correlating cosmic microwave background (CMB) temperature fluctuations with density fluctuations from 21\,cm intensity mapping (IM). The biggest challenge for the cross-correlation is the loss of large-scale information in IM, due to foregrounds and the zero spacing problem of interferometers. We apply the tidal reconstruction algorithm to restore the lost large-scale modes, which increases the correlation by more than a factor of three. With the predicted foreground level, we expect a $\sim20\,\sigma$ detection of kSZ signal for $0.8\lesssim z\lesssim2.5$ with CHIME and Planck, and a $\sim40\, \sigma$ detection with HIRAX and Planck. The significance can be greatly increased with next-generation facilities of higher spatial resolutions.

Physical constraints on the sources of fast radio bursts are few, and therefore viable theoretical models are many. However, no one model can match all the available observational characteristics, meaning that these radio bursts remain one of the most mysterious phenomena in astrophysics.

Pulsar scintillation allows a glimpse into small-scale plasma structures in the interstellar medium, if we can infer their properties from the scintillation pattern. With Very Long Baseline Interferometry and working in delay-delay rate space, where the contributions of pairs of images to the interference pattern become localized, the scattering geometry and distribution of scattered images on the sky can be determined if a single, highly-anisotropic scattering screen is responsible for the scintillation. However, many pulsars are subject to much more complex scattering environments where this method cannot be used. We present a novel technique to reconstruct the scattered flux of the pulsar and solve for the scattering geometry in these cases by combining interferometric visibilities with cross-correlations of single-station intensities. This takes advantage of the fact that, considering a single image pair in delay-delay rate space, the visibilities are sensitive to the sum of the image angular displacements, while the cross-correlated intensities are sensitive to the difference, so that their combination can be used to localize both images of the pair. We show that this technique is able to reconstruct the published scattering geometry of PSR B0834+06, then apply it to simulations of more complicated scattering systems, where we find that it can distinguish features from different scattering screens even when the presence of multiple screens is not obvious in the Fourier transform of the dynamic spectrum. This technique will allow us to both better understand the distribution of scattering within the interstellar medium and to apply current scintillometry techniques, such as modelling scintillation and constraining the location of pulsar emission, to sources for which a current lack of understanding of the scattering environment precludes the use of these techniques. (abridged)

Many radio pulsars have stable pulse profiles, but some exhibit mode changing where the profile switches between two or more quasi-stable modes of emission. So far, these effects had only been seen in relatively slow pulsars, but we show here that the pulse profile of PSR B1957+20, a millisecond pulsar, switches between two modes, with a typical time between mode changes of only $1.7$ s (or $\sim\!1000$ rotations), the shortest observed so far. The two modes differ in both intensity and polarization, with relatively large differences in the interpulse and much more modest ones in the main pulse. We find that the changes in the interpulse precede those in the main pulse by $\sim\!25$ ms, placing an empirical constraint on the timescale over which mode changes occurs. We also find that the properties of the giant pulses emitted by PSR B1957+20 are correlated with the mode of the regular emission: their rate and the rotational phase at which they are emitted both depend on mode. Furthermore, the energy distribution of the giant pulses emitted near the main pulse depends on mode as well. We discuss the ramifications for our understanding of the radio emission mechanisms as well as for pulsar timing experiments.

In regions with strongly varying electron density, radio emission can be magnified significantly by plasma lensing. In the presence of magnetic fields, magnification in time and frequency will be different for two circular polarizations. We show how these effects can be used to measure or constrain the magnetic field parallel to the line of sight, $B_\parallel$, as well as its spatial structure, $\sigma_{B_\parallel}$, in the lensing region. In addition, we discuss how generalized Faraday rotation can constrain the strength of the perpendicular field, $B_\perp$. We attempt to make such measurements for the Black Widow pulsar, PSR~B1957+20, in which plasma lensing was recently discovered. For this system, pressure equilibrium suggests $B\gtrsim 20\,$G at the interface between the pulsar and companion winds, where the radio eclipse starts and ends, and where most lensing occurs. We find no evidence for large-scale magnetic fields, with, on average, $B_\parallel=0.02\pm0.09\,$G over the egress lensing region. From individual lensing events, we strongly constrain small scale magnetic structure to $\sigma_B<10\,$mG, thus excluding scenarios with a strong but rapidly varying field. Finally, from the lack of reduction of average circular polarization in the same region, we rule out a strong, quasi-transverse field. We cannot identify any plausible scenario in which a large magnetic field in this system is concealed, leaving the nature of the interface between the pulsar and companion winds an enigma. Our method can be applied to other sources showing plasma lensing, including other eclipsing pulsars and fast radio bursts, to study the local properties of the magnetic field.

We present a detailed analysis of post-correlation beamforming (i.e. beamforming which involves only phased sums of the correlation of the voltages of different antennas in an array), and compare it with the traditionally used incoherent and phased beamforming techniques. Using data from the GMRT we show that post-correlation beamformation results in a many-folds increase in the signal-to-noise for periodic signals from pulsars and several order of magnitude reduction in the number of false triggers from single pulse events like fast radio bursts (FRBs). This difference arises primarily because the post-correlation beam contains less red-noise, as well as less radio frequency interference. The post-correlation beam can also be more easily calibrated than the incoherent or phased array beams. We also discuss two different modes of post-correlation beamformation, viz. (1) by subtracting the incoherent beam from the coherent beam and (2) by phased addition of the visibilities. The computational costs for both these beamformation techniques as well as their suitability for studies of pulsars and FRBs are discussed. Techniques discussed here would be of interest for all upcoming surveys with interferometric arrays. Finally, we describe a time-domain survey with the GMRT using the post-correlation beamformation as a case study. We find that post-correlation beamforming will improve the current GMRT time-domain survey sensitivity by ~ 2 times for pulsars with periods of few 100s of millisecond and by many-folds for even slower pulsars, making it one of the most sensitive surveys for pulsars and FRBs at low and mid radio frequencies.

Cosmological large scale structure $N$-body simulations are computation-light, memory-heavy problems in supercomputing. The considerable amount of memory is usually dominated by an inefficient way of storing more than sufficient phase space information of particles. We present a new parallel, information-optimized, particle-mesh-based $N$-body code CUBE, in which information-efficiency and memory-efficiency are increased by nearly an order of magnitude. This is accomplished by storing particle's relative phase space coordinates instead of global values, and in the format of fixed point as light as 1 byte. The remaining information is given by complementary density and velocity fields (negligible in memory space) and proper ordering of particles (no extra memory). Our numerical experiments show that this information-optimized $N$-body algorithm provides accurate results within the error of the particle-mesh algorithm. This significant lowering of the memory-to-computation ratio breaks the bottleneck of scaling up and speeding up large cosmological $N$-body simulations on multi-core and heterogeneous computing systems.

Recent development in the reconstruction of the large-scale structure (LSS) has seen significant improvement in restoring the linear baryonic acoustic oscillation (BAO) from at least the non-linear matter field. This outstanding performance is achieved by iteratively solving the Monge-Ampere equation of the mass conservation. However, this technique also relies on several assumptions that are not valid in reality, namely the longitudinal displacement, the absence of shell-crossing and homogeneous initial condition. In particular, the conservation equation of the tracers comprises the biasing information that breaks down the last assumption. Consequently, direct reconstruction would entangle the non-linear displacement with complicated bias parameters and further affect the BAO. In this paper, we formulate a theoretical model describing the reconstructed biased map by matching the tracer overdensity with an auxiliary fluid with vanishing initial perturbation. Regarding the performance of the reconstruction algorithm, we show that even though the shot noise is still the most significant limiting factors in a realistic survey, inappropriate treatment of the bias could also shift the reconstructed frame and therefore broaden the BAO peak. We suggest that, in principle, this bias-related BAO smearing effect could be used to independently self-calibrate the bias parameters.

We propose an eigenvector-based formalism for the calibration of radio interferometer arrays. In the presence of a strong dominant point source, the complex gains of the array can be obtained by taking the first eigenvector of the visibility matrix. We use the stable principle component analysis (SPCA) method to help separate outliers and noise from the calibrator signal to improve the performance of the method. This method can be applied with poorly known beam model of the antenna, and is insensitive to outliers or imperfections in the data, and has low computational complexity. It thus is particularly suitable for the initial calibration of the array, which can serve as the initial point for more accurate calibrations. We demonstrate this method by applying it to the cylinder pathfinder of the Tianlai experiment, which aims to measure the dark energy equation of state using the baryon acoustic oscillation (BAO) features in the large scale structure by making intensity mapping observation of the redshifted 21~cm emission of the neutral hydrogen (HI). The complex gain of the array elements and the beam profile in the East-West direction (short axis of the cylinder) are successfully obtained by applying this method to the transit data of bright radio sources.

The Tianlai Pathfinder is designed to demonstrate the feasibility of using a wide field of view radio interferometers to map the density of neutral hydrogen in the Universe after the Epoch of Reionizaton. This approach, called 21~cm intensity-mapping, promises an inexpensive means for surveying the large-scale structure of the cosmos. The Tianlai Pathfinder presently consists of an array of three, 15~m $\times$ 40~m cylinder telescopes and an array of sixteen, 6~m diameter dish antennas located in a radio-quiet part of western China. The two types of arrays were chosen to determine the advantages and disadvantages of each approach. The primary goal of the Pathfinder is to make 3D maps by surveying neutral hydrogen over large areas of the sky %$20,000 {\rm deg}^2$ in two different redshift ranges: first at $1.03 > z > 0.78$ ($700 - 800$~MHz) and later at $0.21 > z > 0.12$ ($1170 - 1270$~MHz). The most significant challenge to $21$~cm intensity-mapping is the removal of strong foreground radiation that dwarfs the cosmological signal. It requires exquisite knowledge of the instrumental response, i.e. calibration. In this paper, we provide an overview of the status of the Pathfinder and discuss the details of some of the analysis that we have carried out to measure the beam function of both arrays. We compare electromagnetic simulations of the arrays to measurements, discuss measurements of the gain and phase stability of the instrument, and provide a brief overview of the data processing pipeline.

Radio pulsars scintillate because their emission travels through the ionized interstellar medium via multiple paths, which interfere with each other. It has long been realized that the scattering screens responsible for the scintillation could be used as `interstellar lenses' to localize pulsar emission regions. Most scattering screens, however, only marginally resolve emission components, limiting results to statistical inferences and detections of small positional shifts. Since screens situated close to the source have better resolution, it should be easier to resolve emission regions of pulsars located in high density environments such as supernova remnants or binaries in which the pulsar's companion has an ionized outflow. Here, we report events of extreme plasma lensing in the `Black Widow' pulsar, PSR~B1957+20, near the phase in its 9.2 hour orbit in which its emission is eclipsed by its companion's outflow. During the lensing events, the flux is enhanced by factors of up to 70--80 at specific frequencies. The strongest events clearly resolve the emission regions: they affect the narrow main pulse and parts of the wider interpulse differently. We show that the events arise naturally from density fluctuations in the outer regions of the outflow, and infer a resolution of our lenses comparable to the pulsar's radius, about 10\,km. Furthermore, the distinct frequency structures imparted by the lensing are reminiscent of what is observed for the repeating fast radio burst FRB 121102, providing observational support for the idea that this source is observed through, and thus at times strongly magnified by, plasma lenses.

Rhe Fast Radio Burst FRB121102 has been observed to repeat in an irregular fashion. Using published timing data of the observed bursts, we show that Poissonian statistics are not a good description of this random process. As an alternative we suggest to describe the intervals between bursts with a Weibull distribution with a shape parameter smaller than one, which allows for the clustered nature of the bursts. We quantify the amount of clustering using the parameters of the Weibull distribution and discuss the consequences that it has for the detection probabilities of future observations and for the optimization of observing strategies. \new{Allowing for this generalization, we find a mean repetition rate of r=5.7^{+3.0}_{-2.0} per day and index k=0.34^{+0.06}_{-0.05} for a correlation function \xi(t)=(t/t_0)^{k-1}.

The dynamic and secondary spectra of many pulsars show evidence for long-lived, aligned images of the pulsar that are stationary on a thin scattering sheet. One explanation for this phenomenon considers the effects of wave crests along sheets in the ionized interstellar medium, such as those due to Alfv\'en waves propagating along current sheets. If these sheets are closely aligned to our line-of-sight to the pulsar, high bending angles arise at the wave crests and a selection effect causes alignment of images produced at different crests, similar to grazing reflection off of a lake. Using geometric optics, we develop a simple parameterized model of these corrugated sheets that can be constrained with a single observation and that makes observable predictions for variations in the scintillation of the pulsar over time and frequency. This model reveals qualitative differences between lensing from overdense and underdense corrugated sheets: Only if the sheet is overdense compared to the surrounding interstellar medium can the lensed images be brighter than the line-of-sight image to the pulsar, and the faint lensed images are closer to the pulsar at higher frequencies if the sheet is underdense, but at lower frequencies if the sheet is overdense.

The Canadian Hydrogen Intensity Mapping Experiment (CHIME) is a novel transit radio telescope operating across the 400-800-MHz band. CHIME is comprised of four 20-m x 100-m semi-cylindrical paraboloid reflectors, each of which has 256 dual-polarization feeds suspended along its axis, giving it a >200 square degree field-of-view. This, combined with wide bandwidth, high sensitivity, and a powerful correlator makes CHIME an excellent instrument for the detection of Fast Radio Bursts (FRBs). The CHIME Fast Radio Burst Project (CHIME/FRB) will search beam-formed, high time-and frequency-resolution data in real time for FRBs in the CHIME field-of-view. Here we describe the CHIME/FRB backend, including the real-time FRB search and detection software pipeline as well as the planned offline analyses. We estimate a CHIME/FRB detection rate of 2-42 FRBs/sky/day normalizing to the rate estimated at 1.4-GHz by Vander Wiel et al. (2016). Likely science outcomes of CHIME/FRB are also discussed. CHIME/FRB is currently operational in a commissioning phase, with science operations expected to commence in the latter half of 2018.

We apply nonlinear reconstruction to the dark matter density field in redshift space and solve for the nonlinear mapping from the initial Lagrangian position to the final redshift space position. The reconstructed anisotropic field inferred from the nonlinear displacement correlates with the linear initial conditions to much smaller scales than the redshift space density field. The number of linear modes in the density field is improved by a factor of 30-40 after reconstruction. We thus expect this reconstruction approach to substantially expand the cosmological information including baryon acoustic oscillations and redshift space distortions for dense low-redshift large scale structure surveys including for example SDSS main sample, DESI BGS, and 21 cm intensity mapping surveys.

The gravitational coupling of a long-wavelength tidal field with small-scale density fluctuations leads to anisotropic distortions of the locally measured small-scale matter correlation function. Since the local correlation function is known to be statistically isotropic in the absence of such tidal interactions, the tidal distortions can be used to reconstruct the long-wavelength tidal field and large-scale density field in analogy with the cosmic microwave background lensing reconstruction. In this paper we present the theoretical framework of cosmic tidal reconstruction and test the reconstruction in numerical simulations. We find that the density field on large scales can be reconstructed with good accuracy and the cross-correlation coefficient between the reconstructed density field and the original density field is greater than 0.9 on large scales $(k\lesssim0.1\ h/\mathrm{Mpc})$, with the filter scale $\sim1.25\ \mathrm{Mpc}/h$. This is useful in the 21cm intensity mapping survey, where the long-wavelength radial modes are lost due to a foreground subtraction process.

We present a direct approach to nonparametrically reconstruct the linear density field from an observed nonlinear map. We solve for the unique displacement potential consistent with the nonlinear density and positive definite coordinate transformation using a multigrid algorithm. We show that we recover the linear initial conditions up to the nonlinear scale ($r_{\delta_r\delta_L}>0.5$ for $k\lesssim1\ h/\mathrm{Mpc}$) with minimal computational cost. This reconstruction approach generalizes the linear displacement theory to fully nonlinear fields, potentially substantially expanding the baryon acoustic oscillations and redshift space distortions information content of dense large scale structure surveys, including for example SDSS main sample and 21cm intensity mapping initiatives.

We present a principal component analysis method which tracks and compensates for short-timescale variability in pulsar profiles, with a goal of improving pulsar timing precision. We couple this with a fast likelihood technique for determining pulse time of arrival, marginalizing over the principal component amplitudes. This allows accurate estimation of timing errors in the presence of pulsar variability. We apply the algorithm to the slow pulsar PSR J2139+0040 using an archived set of untargeted raster-scan observations at arbitrary epochs across four years, obtaining an improved timing solution. The method permits accurate pulsar timing in data sets with short contiguous on-source observations, opening opportunities for commensality between pulsar timing and mapping surveys.

Polarised radio emission from PSR J1745-2900 has already been used to investigate the strength of the magnetic field in the Galactic Centre, close to Sagittarius A*. Here we report how persistent radio emission from this magnetar, for over four years since its discovery, has revealed large changes in the observed Faraday rotation measure, by up to 3500 rad m$^{-2}$ (a five per cent fractional change). From simultaneous analysis of the dispersion measure, we determine that these fluctuations are dominated by variations in the projected magnetic field, rather than the integrated free electron density, along the changing line of sight to the rapidly moving magnetar. From a structure function analysis of rotation measure variations, and a recent epoch of rapid change of rotation measure, we determine a minimum scale of magnetic fluctuations of size ~ 2 au at the Galactic Centre distance, inferring PSR J1745-2900 is just ~ 0.1 pc behind an additional scattering screen.

We report results from 21-cm intensity maps acquired from the Parkes radio telescope and cross-correlated with galaxy maps from the 2dF galaxy survey. The data span the redshift range $0.057<z<0.098$ and cover approximately 1,300 square degrees over two long fields. Cross correlation is detected at a significance of $5.18\sigma$. The amplitude of the cross-power spectrum is low relative to the expected dark matter power spectrum, assuming a neutral hydrogen (HI) bias and mass density equal to measurements from the ALFALFA survey. The decrement is pronounced and statistically significant at small scales. At $k\sim1.5$ $ h \mathrm{Mpc^{-1}}$, the cross power spectrum is more than a factor of 6 lower than expected, with a significance of $14.8\,\sigma$. This decrement indicates either a lack of clustering of neutral hydrogen (HI), a small correlation coefficient between optical galaxies and HI, or some combination of the two. Separating 2dF into red and blue galaxies, we find that red galaxies are much more weakly correlated with HI on $k\sim1.5$ $h \mathrm{Mpc^{-1}}$ scales, suggesting that HI is more associated with blue star-forming galaxies and tends to avoid red galaxies.

We apply the nonlinear reconstruction method to simulated halo fields. For halo number density $2.77\times 10^{-2}$ $(h^{-1} {\rm Mpc})^{-3}$ at $z=0$, corresponding to the SDSS main sample density, we find the scale where the noise saturates the linear signal is improved to $k\gtrsim0.36\ h {\rm Mpc}^{-1}$, a factor of $2.29$ improvement in scale, or $12$ in number of linear modes. The improvement is less for higher redshift or lower halo density. We expect this to substantially improve the BAO accuracy of dense, low redshift surveys, including the SDSS main sample, 6dFGS and 21cm intensity mapping initiatives.

When a supernova explodes, most of its energy is released in a shell of relativistic neutirnos which changes the surrounding geometry. We calculate the potentially observable responses to such a change in both pulsar scintillation and conventional interferometers. In both cases, the responses are permanent changes due to such a transient event. This is by-definition a memory effect. In addition to the transverse component in the usual gravitational memory (Christodolou effect) effect, it also has a longitudinal component. Furthermore it is different from the Christodolou effect as the transverse component of this memory effect also has a term that grows with time.

A new generation of wide-field radio interferometers designed for 21-cm surveys is being built as drift scan instruments allowing them to observe large fractions of the sky. With large numbers of antennas and frequency channels the enormous instantaneous data rates of these telescopes require novel, efficient, data management and analysis techniques. The $m$-mode formalism exploits the periodicity of such data with the sidereal day, combined with the assumption of statistical isotropy of the sky, to achieve large computational savings and render optimal analysis methods computationally tractable. We present an extension to that work that allows us to adopt a more realistic sky model and treat objects such as bright point sources. We develop a linear procedure for deconvolving maps, using a Wiener filter reconstruction technique, which simultaneously allows filtering of these unwanted components. We construct an algorithm, based on the Sherman-Morrison-Woodbury formula, to efficiently invert the data covariance matrix, as required for any optimal signal-to-noise weighting. The performance of our algorithm is demonstrated using simulations of a cylindrical transit telescope.

Constraining neutrino mass remains an elusive challenge in modern physics. Precision measurements are expected from several upcoming cosmological probes of large-scale structure. Achieving this goal relies on an equal level of precision from theoretical predictions of neutrino clustering. Numerical simulations of the non-linear evolution of cold dark matter and neutrinos play a pivotal role in this process. We incorporate neutrinos into the cosmological N-body code CUBEP3M and discuss the challenges associated with pushing to the extreme scales demanded by the neutrino problem. We highlight code optimizations made to exploit modern high performance computing architectures and present a novel method of data compression that reduces the phase-space particle footprint from 24 bytes in single precision to roughly 9 bytes. We scale the neutrino problem to the Tianhe-2 supercomputer and provide details of our production run, named TianNu, which uses 86% of the machine (13,824 compute nodes). With a total of 2.97 trillion particles, TianNu is currently the world's largest cosmological N-body simulation and improves upon previous neutrino simulations by two orders of magnitude in scale. We finish with a discussion of the unanticipated computational challenges that were encountered during the TianNu runtime.

We show that three-dimensional information is critical to discerning the effects of parity violation in the primordial gravity-wave background. If present, helical gravity waves induce parity-violating correlations in the cosmic microwave background (CMB) between parity-odd polarization $B$-modes and parity-even temperature anisotropies ($T$) or polarization $E$-modes. Unfortunately, $EB$ correlations are much weaker than would be naively expected, which we show is due to an approximate symmetry resulting from the two-dimensional nature of the CMB. The detectability of parity-violating correlations is exacerbated by the fact that the handedness of individual modes cannot be discerned in the two-dimensional CMB, leading to a noise contribution from scalar matter perturbations. In contrast, the tidal imprints of primordial gravity waves fossilized into the large-scale structure of the Universe are a three-dimensional probe of parity violation. Using such fossils the handedness of gravity waves may be determined on a mode-by-mode basis, permitting future surveys to probe helicity at the percent level if the amplitude of primordial gravity waves is near current observational upper limits.

In this paper, we report a significant recovery of the linear baryonic acoustic oscillation (BAO) signature by applying the isobaric reconstruction algorithm to the non-linear matter density field. Assuming only the longitudinal component of the displacement being cosmologically relevant, this algorithm iteratively solves the coordinate transform between the Lagrangian and Eulerian frames without requiring any specific knowledge of the dynamics. For dark matter field, it produces the non-linear displacement potential with very high fidelity. The reconstruction error at the pixel level is within a few percent, and is caused only by the emergence of the transverse component after the shell-crossing. As it circumvents the strongest non-linearity of the density evolution, the reconstructed field is well-described by linear theory and immune from the bulk-flow smearing of the BAO signature. Therefore this algorithm could significantly improve the measurement accuracy of the sound horizon scale. For a perfect large-scale structure survey at redshift zero without Poisson or instrumental noise, the fractional error is reduced by a factor of 2.7, very close to the ideal limit with linear power spectrum and Gaussian covariance matrix.

We propose to use pulsar scintillation measurements to test predictions of alternative theories of gravity. Comparing to single-path pulsar timing measurements, the scintillation measurements can achieve a factor of 10^5 improvement in timing accuracy, due to the effect of multi-path interference. Previous scintillation measurements of PSR B0834+06 have data acquisition for hours, making this approach sensitive to mHz gravitational waves. Therefore it has unique advantages in measuring gravitational effect or other mechanisms (at mHz and above frequencies) on light propagation. We illustrate its application in constraining scalar gravitational-wave background, in which case the sensitivities can be greatly improved with respect to previous limits. We expect much broader applications in testing gravity with existing and future pulsar scintillation observations.

We present results from a new incoherent-beam Fast Radio Burst (FRB) search on the Canadian Hydrogen Intensity Mapping Experiment (CHIME) Pathfinder. Its large instantaneous field of view (FoV) and relative thermal insensitivity allow us to probe the ultra-bright tail of the FRB distribution, and to test a recent claim that this distribution's slope, $\alpha\equiv-\frac{\partial \log N}{\partial \log S}$, is quite small. A 256-input incoherent beamformer was deployed on the CHIME Pathfinder for this purpose. If the FRB distribution were described by a single power-law with $\alpha=0.7$, we would expect an FRB detection every few days, making this the fastest survey on sky at present. We collected 1268 hours of data, amounting to one of the largest exposures of any FRB survey, with over 2.4\,$\times$\,10$^5$\,deg$^2$\,hrs. Having seen no bursts, we have constrained the rate of extremely bright events to $<\!13$\,sky$^{-1}$\,day$^{-1}$ above $\sim$\,220$\sqrt{(\tau/\rm ms)}$ Jy\,ms for $\tau$ between 1.3 and 100\,ms, at 400--800\,MHz. The non-detection also allows us to rule out $\alpha\lesssim0.9$ with 95$\%$ confidence, after marginalizing over uncertainties in the GBT rate at 700--900\,MHz, though we show that for a cosmological population and a large dynamic range in flux density, $\alpha$ is brightness-dependent. Since FRBs now extend to large enough distances that non-Euclidean effects are significant, there is still expected to be a dearth of faint events and relative excess of bright events. Nevertheless we have constrained the allowed number of ultra-intense FRBs. While this does not have significant implications for deeper, large-FoV surveys like full CHIME and APERTIF, it does have important consequences for other wide-field, small dish experiments.

Neutral hydrogen clouds are known to exist in the Universe, however their spatial distributions and physical properties are poorly understood. Such missing information can be studied by the new generation Chinese radio telescopes through a blind searching of 21-cm absorption systems. We forecast the capabilities of surveys of 21-cm absorption systems by two representative radio telescopes in China -- Five-hundred-meter Aperture Spherical radio Telescope (FAST) and Tianlai 21-cm cosmology experiment (Tianlai). Facilitated by either the high sensitivity (FAST) or the wide field of view (Tianlai) of these telescopes, more than a thousand 21-cm absorption systems can be discovered in a few years, representing orders of magnitude improvement over the cumulative discoveries in the past half a century.

The interstellar medium scatters radio waves which causes pulsars to scintillate. For intrinsically short bursts of emission, the observed signal should be a direct measurement of the impulse response function. We show that this is indeed the case for giant pulses from PSR B1957+20: from baseband observations at 327 MHz, we demonstrate that the observed voltages of a bright pulse allow one to coherently descatter nearby ones. We find that while the scattering timescale is $12.3\,\mu$s, the power in the descattered pulses is concentrated within a span almost two orders of magnitude shorter, of $\lesssim\!200\,$ns. This sets an upper limit to the intrinsic duration of the giant pulses. We verify that the response inferred from the giant pulses is consistent with the scintillation pattern obtained by folding the regular pulsed emission, and that it decorrelates on the same timescale, of~$84\,$s. In principle, with large sets of giant pulses, it should be possible to constrain the structure of the scattering screen much more directly than with other current techniques, such as holography on the dynamic spectrum and cyclic spectroscopy.

We study the nonlinear $E$-mode clustering in Lagrangian space by using large scale structure $N$-body simulations and use the displacement field information in Lagrangian space to recover the primordial linear density field. We find that, compared to Eulerian nonlinear density fields, the $E$-mode displacement fields in Lagrangian space improves the cross-correlation scale $k$ with initial density field by a factor of 6-7, containing two orders of magnitude more primordial information. This illustrates ability of potential density reconstruction algorithms, to improve the baryonic acoustic oscillation measurements from current and future large scale structure surveys.

From the basic concepts of general relativity, we investigate the rotation of the polarization angle by a moving gravitational lens. Particularly, we clarify the existing confusion in the literature by showing and explaining why such rotation must explicitly depend on the relative motion between the observer and the lens. We update the prediction of such effect on the double pulsar PSR J0737-3039 and estimate a rotation angle of $\sim 10^{-7}rad$. Despite its tiny signal, this is $10$ orders of magnitude larger than the previous prediction by Ruggiero and Tartaglia, which apparently was misguided by the confusion in the literature.

Reconstruction techniques are commonly used in cosmology to reduce complicated nonlinear behaviours to a more tractable linearized system. We study a new reconstruction technique that uses the Moving-Mesh algorithm to estimate the displacement field from nonlinear matter distribution. We show the performance of this new technique by quantifying its ability to reconstruct linear modes. We study the cumulative Fisher information $I(<k_n)$ about the initial matter power spectrum in the matter power spectra in 130 $N$-body simulations before and after reconstruction, and find that the nonlinear plateau of $I(<k_n)$ is increased by a factor of $\sim 50$ after reconstruction, from $I \simeq 2.5 \times 10^{-5} /({\rm Mpc}/h)^3$ to $I \simeq 1.3 \times 10^{-3}/({\rm Mpc}/h)^3$ at large $k$. This result includes the decorrelation between initial and final fields, which has been neglected in some previous studies. We expect this technique to be beneficial to problems such as baryonic acoustic oscillations, redshift space distortions and cosmic neutrinos that rely on accurately disentangling nonlinear evolution from underlying linear effects.

Measurements of neutrino mass in cosmological observations rely on two point statistics that are hindered by significant degeneracies with the optical depth and galaxy bias. The relative velocity effect between cold dark matter and neutrinos induces a large scale dipole into the matter density field and may be able to provide orthogonal constraints to standard techniques. We numerically investigate this dipole in the TianNu Simulation, which contains cold dark matter and 50 meV neutrinos. We first compute the dipole using a new linear response technique where we treat the displacement caused by the relative velocity as a phase in Fourier space and then integrate the matter power spectrum over redshift. Then, we compute the dipole numerically in real space using the simulation density and velocity fields. We find excellent agreement between the linear response and N-body methods. Utilizing the dipole as an observational tool will require two tracers of the matter distribution that are differently biased with respect to the neutrino density.

We present the first application of a new foreground removal pipeline to the current leading HI intensity mapping dataset, obtained by the Green Bank Telescope (GBT). We study the 15hr and 1hr field data of the GBT observations previously presented in Masui et al (2013) and Switzer et al (2013), covering about 41 square degrees at 0.6<z<1.0, for which cross-correlations may be measured with the galaxy distribution of the WiggleZ Dark Energy Survey. In the presented pipeline, we subtract the Galactic foreground continuum and the point source contamination using an independent component analysis technique (fastica), and develop a Fourier-based optimal estimator to compute the temperature power spectrum of the intensity maps and cross-correlation with the galaxy survey data. We show that fastica is a reliable tool to subtract diffuse and point-source emission through the non-Gaussian nature of their probability distributions. The temperature power spectra of the intensity maps is dominated by instrumental noise on small scales which fastica, as a conservative subtraction technique of non-Gaussian signals, can not mitigate. However, we determine similar GBT-WiggleZ cross-correlation measurements to those obtained by the Singular Value Decomposition (SVD) method, and confirm that foreground subtraction with fastica is robust against 21cm signal loss, as seen by the converged amplitude of these cross-correlation measurements. We conclude that SVD and fastica are complementary methods to investigate the foregrounds and noise systematics present in intensity mapping datasets.

Polarization leakage of foreground synchrotron emission is a critical issue in HI intensity mapping experiments. While the sought-after HI emission is unpolarized, polarized foregrounds such as Galactic and extragalactic synchrotron radiation, if coupled with instrumental impurity, can mimic or overwhelm the HI signals. In this paper we present the methodology for polarization calibration at 700-900 MHz, applied on data obtained from the Green Bank Telescope (GBT). We use astrophysical sources, both polarized and unpolarized sources including quasars and pulsars, as calibrators to characterize the polarization leakage and control systematic effects in our GBT HI intensity mapping project. The resulting fractional errors on polarization measurements on boresight are well controlled to within 0.6%-0.8% of their total intensity. The polarized beam patterns are measured by performing spider scans across both polarized quasars and pulsars. A dominant Stokes I to V leakage feature and secondary features of Stokes I to Q and I to U leakages in the 700-900 MHz frequency range are identified. These characterizations are important for separating foreground polarization leakage from the HI 21 cm signal.

We present a description of cosmic neutrinos as a dispersive fluid. In this approach, the neutrino phase space is reduced to density and velocity fields alongside a scale-dependent sound speed. This sound speed depends on redshift, the initial neutrino phase space density and the cold dark matter gravitational potential. The latter is a new coupling between neutrinos and large scale structure not described by previous fluid approaches. We compute the sound speed in linear theory and find that it asymptotes to constants at small and large scales regardless of the gravitational potential. By comparing with neutrino N-body simulations, we measure the small scale sound speed and find it to be lower than linear theory predictions. This allows for an explanation of the discrepency between N-body and linear response predictions for the neutrino power spectrum: neutrinos are still driven predominantly by the cold dark matter, but the sound speed on small scales is not stable to perturbations and decreases. Finally, we present a calibrated model for the neutrino power spectrum that requires no additional integrations outside of standard Boltzmann codes.

Astrophysical techniques have pioneered the discovery of neutrino mass properties. Current cosmological observations give an upper bound on neutrino masses by attempting to disentangle the small neutrino contribution from the sum of all matter using precise theoretical models. We discover the differential neutrino condensation effect in our TianNu N-body simulation. Neutrino masses can be inferred using this effect by comparing galaxy properties in regions of the universe with different neutrino relative abundance (i.e. the local neutrino to cold dark matter density ratio). In "neutrino-rich"' regions, more neutrinos can be captured by massive halos compared to "neutrino-poor" regions. This effect differentially skews the halo mass function and opens up the path to independent neutrino mass measurements in current or future galaxy surveys.

We present a new method to reconstruct the primordial (linear) density field using the estimated nonlinear displacement field. The divergence of the displacement field gives the reconstructed density field. We solve the nonlinear displacement field in the 1D cosmology and show the reconstruction results. The new reconstruction algorithm recovers a lot of linear modes and reduces the nonlinear damping scale significantly. The successful 1D reconstruction results imply the new algorithm should also be a promising technique in the 3D case.

We point out a surprising consequence of the usually assumed initial conditions for cosmological perturbations. Namely, a spectrum of Gaussian, linear, adiabatic, scalar, growing mode perturbations not only creates acoustic oscillations of the kind observed on very large scales today, it also leads to the production of shocks in the radiation fluid of the very early universe. Shocks cause departures from local thermal equilibrium as well as creating vorticity and gravitational waves. For a scale-invariant spectrum and standard model physics, shocks form for temperatures $1$ GeV$<T<10^{7}$ GeV. For more general power spectra, such as have been invoked to form primordial black holes, shock formation and the consequent gravitational wave emission provides a signal detectable by current and planned gravitational wave experiments, allowing them to strongly constrain conditions present in the primordial universe as early as $10^{-30}$ seconds after the big bang.

The Canadian Hydrogen Intensity Mapping Experiment (CHIME) Pathfinder radio telescope is currently surveying the northern hemisphere between 400 and 800 MHz. By mapping the large scale structure of neutral hydrogen through its redshifted 21 cm line emission between $z \sim 0.8-2.5$ CHIME will contribute to our understanding of Dark Energy. Bright astrophysical foregrounds must be separated from the neutral hydrogen signal, a task which requires precise characterization of the polarized telescope beams. Using the DRAO John A. Galt 26 m telescope, we have developed a holography instrument and technique for mapping the CHIME Pathfinder beams. We report the status of the instrument and initial results of this effort.

We investigate whether current data on the distribution of observed flux densities of Fast Radio Bursts (FRBs) are consistent with a constant source density in Euclidean space. We use the number of FRBs detected in two surveys with different characteristics along with the observed signal-to-noise ratios of the detected FRBs in a formalism similar to a V/V_max-test to constrain the distribution of flux densities. We find consistency between the data and a Euclidean distribution. Any extension of this model is therefore not data-driven and needs to be motivated separately. As a byproduct we also obtain new improved limits for the FRB rate at 1.4 GHz, which had not been constrained in this way before.

Estimating the all-sky rate of fast radio bursts (FRBs) has been difficult due to small-number statistics and the fact that they are seen by disparate surveys in different regions of the sky. In this paper we provide limits for the FRB rate at 800 MHz based on the only burst detected at frequencies below 1.4 GHz, FRB 110523. We discuss the difficulties in rate estimation, particularly in providing an all-sky rate above a single fluence threshold. We find an implied rate between 700-900 MHz that is consistent with the rate at 1.4 GHz, scaling to $6.4^{+29.5}_{-5.0} \times 10^3$\,sky$^{-1}$\,day$^{-1}$ for an HTRU-like survey. This is promising for upcoming experiments below a GHz like CHIME and UTMOST, for which we forecast detection rates. Given 110523's discovery at 32$\sigma$ with nothing weaker detected, down to the threshold of 8$\sigma$, we find consistency with a Euclidean flux distribution but disfavour steep distributions, ruling out $\gamma > 2.2$.

The relic neutrinos are expected to acquire a bulk relative velocity with respect to the dark matter at low redshifts, and neutrino wakes are expected to develop downstream of the dark matter halos. We propose a method of measuring the neutrino mass based on this mechanism. This neutrino wake will cause a dipole distortion of the galaxy-galaxy lensing pattern. This effect could be detected by combining upcoming lensing surveys with a low redshift galaxy survey or a 21 cm intensity mapping survey, which can map the neutrino flow field. The data obtained with LSST and Euclid should enable us to make a positive detection if the three neutrino masses are quasidegenerate with each neutrino mass of $\sim$0.1 eV, and a future high precision 21 cm lensing survey would allow the normal hierarchy and inverted hierarchy cases to be distinguished, and even the right-handed Dirac neutrinos may be detectable.

We present a new technique to measure neutrino masses using their flow field relative to dark matter. Present day streaming motions of neutrinos relative to dark matter and baryons are several hundred km/s, comparable with their thermal velocity dispersion. This results in a unique dipole anisotropic distortion of the matter-neutrino cross power spectrum, which is observable through the dipole distortion in the cross correlation of different galaxy populations. Such a dipole vanishes if not for this relative velocity and so it is a clean signature for neutrino mass. We estimate the size of this effect and find that current and future galaxy surveys may be sensitive to these signature distortions.

Intensity mapping experiments survey the spectrum of diffuse line radiation rather than detect individual objects at high signal-to-noise. Spectral maps of unresolved atomic and molecular line radiation contain three-dimensional information about the density and environments of emitting gas, and efficiently probe cosmological volumes out to high redshift. Intensity mapping survey volumes also contain all other sources of radiation at the frequencies of interest. Continuum foregrounds are typically ~10^2-10^3 times brighter than the cosmological signal. The instrumental response to bright foregrounds will produce new spectral degrees of freedom that are not known in advance, nor necessarily spectrally smooth. The intrinsic spectra of foregrounds may also not be well-known in advance. We describe a general class of quadratic estimators to analyze data from single-dish intensity mapping experiments, and determine contaminated spectral modes from the data itself. The key attribute of foregrounds is not that they are spectrally smooth, but instead that they have fewer bright spectral degrees of freedom than the cosmological signal. Spurious correlations between the signal and foregrounds produce additional bias. Compensation for signal attenuation must estimate and correct this bias. A successful intensity mapping experiment will control instrumental systematics that spread variance into new modes, and it must observe a large enough volume that contaminant modes can be determined independently from the signal on scales of interest.

We show that when a supernova explodes, a nearby pulsar signal goes through a very specific change. The observed period first changes smoothly, then is followed by a sudden change in the time derivative. A stable millisecond pulsar can allow us to measure such an effect. This may improve our measurement of the total energy released in neutrinos and also the orientation of the supernova-pulsar system.

We discuss some of the claims that have been made regarding the statistics of fast radio bursts (FRBs). In an earlier paper \citep{2015arXiv150505535C} we conjectured that flicker noise associated with FRB repetition could show up in non-cataclysmic neutron star emission models, like supergiant pulses. We show how the current limits of repetition would be significantly weakened if their repeat rate really were non-Poissonian and had a pink or red spectrum. Repetition and its statistics have implications for observing strategy, generally favouring shallow wide-field surveys, since in the non-repeating scenario survey depth is unimportant. We also discuss the statistics of the apparent latitudinal dependence of FRBs, and offer a simple method for calculating the significance of this effect. We provide a generalized Bayesian framework for addressing this problem, which allows for direct model comparison. It is shown how the evidence for a steep latitudinal gradient of the FRB rate is less strong than initially suggested and simple explanations like increased scattering and sky temperature in the plane are sufficient to decrease the low-latitude burst rate, given current data. The reported dearth of bursts near the plane is further complicated if FRBs have non-Poissonian repetition, since in that case the event rate inferred from observation depends on observing strategy.

Fast Radio Bursts are bright, unresolved, non-repeating, broadband, millisecond flashes, found primarily at high Galactic latitudes, with dispersion measures much larger than expected for a Galactic source. The inferred all-sky burst rate is comparable to the core-collapse supernova rate out to redshift 0.5. If the observed dispersion measures are assumed to be dominated by the intergalactic medium, the sources are at cosmological distances with redshifts of 0.2 to 1. These parameters are consistent with a wide range of source models. One fast radio burst showed circular polarization [21(7)%] of the radio emission, but no linear polarization was detected, and hence no Faraday rotation measure could be determined. Here we report the examination of archival data revealing Faraday rotation in a newly detected burst - FRB 110523. It has radio flux at least 0.6 Jy and dispersion measure 623.30(5) pc cm$^{-3}$. Using Galactic contribution 45 pc cm$^{-3}$ and a model of intergalactic electron density, we place the source at a maximum redshift of 0.5. The burst has rotation measure -186.1(1.4) rad m$^{-2}$, much higher than expected for this line of sight through the Milky Way and the intergalactic medium, indicating magnetization in the vicinity of the source itself or within a host galaxy. The pulse was scattered by two distinct plasma screens during propagation, which requires either a dense nebula associated with the source or a location within the central region of its host galaxy. Keeping in mind that there may be more than one type of fast radio burst source, the detection in this instance of source-local magnetization and scattering favours models involving young stellar populations such as magnetars over models involving the mergers of older neutron stars, which are more likely to be located in low density regions of the host galaxy.

We propose a new extragalactic but non-cosmological explanation for fast radio bursts (FRBs) based on very young pulsars in supernova remnants. Within a few hundred years of a core-collapse supernova the ejecta is confined within $\sim$1 pc, providing a high enough column density of free electrons for the observed 375-1600 pc cm$^{-3}$ of dispersion measure (DM). By extrapolating a Crab-like pulsar to its infancy in an environment like that of SN 1987A, we hypothesize such an object could emit supergiant pulses sporadically which would be bright enough to be seen at a few hundred megaparsecs. We hypothesize that such supergiant pulses would preferentially occur early in the pulsar's life when the free electron density is still high, which is why we do not see large numbers of moderate DM FRBs ($\lesssim300$ pc cm$^{-3}$). In this scenario Faraday rotation at the source gives rotation measures (RMs) much larger than the expected cosmological contribution. If the emission were pulsar-like, then the polarization vector could swing over the duration of the burst, which is not expected from non-rotating objects. In this model, the scattering, large DM, and commensurate RM all come from one place which is not the case for the cosmological interpretation. The model also provides testable predictions of the flux distribution and repeat rate of FRBs, and could be further verified by spatial coincidence with optical supernovae of the past several decades and cross-correlation with nearby galaxy maps.

Our analysis of archival VLBI data of PSR 0834+06 revealed that its scintillation properties can be precisely modelled using the inclined sheet model (Pen & Levin 2014), resulting in two distinct lens planes. These data strongly favour the grazing sheet model over turbulence as the primary source of pulsar scattering. This model can reproduce the parameters of the observed diffractive scintillation with an accuracy at the percent level. Comparison with new VLBI proper motion results in a direct measure of the ionized ISM screen transverse velocity. The results are consistent with ISM velocities local to the PSR 0834+06 sight-line (through the Galaxy). The simple 1D structure of the lenses opens up the possibility of using interstellar lenses as precision probes for pulsar lens mapping, precision transverse motions in the ISM, and new opportunities for removing scattering to improve pulsar timing. We describe the parameters and observables of this double screen system. While relative screen distances can in principle be accurately determined, a global conformal distance degeneracy exists that allows a rescaling of the absolute distance scale. For PSR B0834+06, we present VLBI astrometry results that provide (for the fist time) a direct measurement of the distance of the pulsar. For targets where independent distance measurements are not available, which are the cases for most of the recycled millisecond pulsars that are the targets of precision timing observations, the degeneracy presented in the lens modelling could be broken if the pulsar resides in a binary system.

The CHIME Pathfinder is a new interferometric radio telescope that uses a hybrid FPGA/GPU FX correlator. The GPU-based X-engine of this correlator processes over 819 Gb/s of 4+4-bit complex astronomical data from N=256 inputs across a 400 MHz radio band. A software framework is presented to manage this real-time data flow, which allows each of 16 processing servers to handle 51.2 Gb/s of astronomical data, plus 8 Gb/s of ancillary data. Each server receives data in the form of UDP packets from an FPGA F-engine over the eight 10 GbE links, combines data from these packets into large (32MB-256MB) buffered frames, and transfers them to multiple GPU co-processors for correlation. The results from the GPUs are combined and normalized, then transmitted to a collection server, where they are merged into a single file. Aggressive optimizations enable each server to handle this high rate of data; allowing the efficient correlation of 25 MHz of radio bandwidth per server. The solution scales well to larger values of N by adding additional servers.

Concerted effort is currently ongoing to open up the Epoch of Reionization (EoR) ($z\sim$15-6) for studies with IR and radio telescopes. Whereas IR detections have been made of sources (Lyman-$\alpha$ emitters, quasars and drop-outs) in this redshift regime in relatively small fields of view, no direct detection of neutral hydrogen, via the redshifted 21-cm line, has yet been established. Such a direct detection is expected in the coming years, with ongoing surveys, and could open up the entire universe from $z\sim$6-200 for astrophysical and cosmological studies, opening not only the EoR, but also its preceding Cosmic Dawn ($z\sim$30-15) and possibly even the later phases of the Dark Ages ($z\sim$200-30). All currently ongoing experiments attempt statistical detections of the 21-cm signal during the EoR, with limited signal-to-noise. Direct imaging, except maybe on the largest (degree) scales at lower redshifts, as well as higher redshifts will remain out of reach. The Square Kilometre Array(SKA) will revolutionize the field, allowing direct imaging of neutral hydrogen from scales of arc-minutes to degrees over most of the redshift range $z\sim$6-28 with SKA1-LOW, and possibly even higher redshifts with the SKA2-LOW. In this SKA will be unique, and in parallel provide enormous potential of synergy with other upcoming facilities (e.g. JWST). In this chapter we summarize the physics of 21-cm emission, the different phases the universe is thought to go through, and the observables that the SKA can probe, referring where needed to detailed chapters in this volume (Abridged).

We synthesize the known information about Fast Radio Bursts and radio magnetars, and describe an allowed origin near nuclei of external, but non-cosmological, galaxies. This places them at $z\ll1$, within a few hundred megaparsecs. In this scenario, the high DM is dominated by the environment of the FRB, modelled on the known properties of the Milky Way Center, whose innermost 100pc provides 1000 pc/cm$^3$. A radio loud magnetar is known to exist in our galactic center, within $\sim$2 arc seconds of Sgr A*. Based on the polarization, DM, and scattering properties of this known magnetar, we extrapolate its properties to those of Crab-like giant pulses and SGR flares and point out their consistency with observed Fast Radio Bursts. We conclude galactic center magnetars could be the source of FRB's. This scenario is readily testable with VLBI measurements as well as with flux count statistics from large surveys such as CHIME or UTMOST.

Discovering the mass of neutrinos is a principle goal in high energy physics and cosmology. In addition to cosmological measurements based on two-point statistics, the neutrino mass can also be estimated by observations of neutrino wakes resulting from the relative motion between dark matter and neutrinos. Such a detection relies on an accurate reconstruction of the dark matter-neutrino relative velocity which is affected by non-linear structure growth and galaxy bias. We investigate our ability to reconstruct this relative velocity using large N-body simulations where we evolve neutrinos as distinct particles alongside the dark matter. We find that the dark matter velocity power spectrum is overpredicted by linear theory whereas the neutrino velocity power spectrum is underpredicted. The magnitude of the relative velocity observed in the simulations is found to be lower than what is predicted in linear theory. Since neither the dark matter nor the neutrino velocity fields are directly observable from galaxy or 21 cm surveys, we test the accuracy of a reconstruction algorithm based on halo density fields and linear theory. Assuming prior knowledge of the halo bias, we find that the reconstructed relative velocities are highly correlated with the simulated ones with correlation coefficients of 0.94, 0.93, 0.91 and 0.88 for neutrinos of mass 0.05, 0.1, 0.2 and 0.4 eV. We confirm that the relative velocity field reconstructed from large scale structure observations such as galaxy or 21 cm surveys can be accurate in direction and, with appropriate scaling, magnitude.

We propose a possibility to improve the current precision measurements on compact binaries. When the orbital axis is almost perpendicular to our line of sight, a pulsar behind its companion can form two strong-lensing images. These images cannot be resolved, but we can use multi-wavelength interferometry to accurately determine the passage through superior conjunction. This method does not depend strongly on the stability of the pulse profile, and applies equally well to both slow and fast pulsars. We discuss the possible improvement this can bring to the bound on stochastic gravitational wave background and to determine black hole spin. We also discuss the possibility of discovering a suitable binary system by the Square Kilometer Array that our method can apply to.

So far there is only indirect evidence that the Universe is undergoing an accelerated expansion. The evidence for cosmic acceleration is based on the observation of different objects at different distances, and requires invoking the Copernican cosmological principle, and Einstein's equations of motion. We examine the direct observability using recession velocity drifts (Sandage-Loeb effect) of 21cm hydrogen absorption systems in upcoming radio surveys. This measures the change in velocity of the {\it same} objects separate by a time interval and is a model-independent measure of acceleration. We forecast that for a CHIME-like survey with a decade time span, we can detect the acceleration of a $\Lambda$CDM Universe with $5\sigma$ confidence. This acceleration test requires modest data analysis and storage changes from the normal processing, and cannot be recovered retroactively.

The Canadian Hydrogen Intensity Mapping Experiment (CHIME) is a transit interferometer currently being built at the Dominion Radio Astrophysical Observatory (DRAO) in Penticton, BC, Canada. We will use CHIME to map neutral hydrogen in the frequency range 400 -- 800\,MHz over half of the sky, producing a measurement of baryon acoustic oscillations (BAO) at redshifts between 0.8 -- 2.5 to probe dark energy. We have deployed a pathfinder version of CHIME that will yield constraints on the BAO power spectrum and provide a test-bed for our calibration scheme. I will discuss the CHIME calibration requirements and describe instrumentation we are developing to meet these requirements.

A pathfinder version of CHIME (the Canadian Hydrogen Intensity Mapping Experiment) is currently being commissioned at the Dominion Radio Astrophysical Observatory (DRAO) in Penticton, BC. The instrument is a hybrid cylindrical interferometer designed to measure the large scale neutral hydrogen power spectrum across the redshift range 0.8 to 2.5. The power spectrum will be used to measure the baryon acoustic oscillation (BAO) scale across this poorly probed redshift range where dark energy becomes a significant contributor to the evolution of the Universe. The instrument revives the cylinder design in radio astronomy with a wide field survey as a primary goal. Modern low-noise amplifiers and digital processing remove the necessity for the analog beamforming that characterized previous designs. The Pathfinder consists of two cylinders 37\,m long by 20\,m wide oriented north-south for a total collecting area of 1,500 square meters. The cylinders are stationary with no moving parts, and form a transit instrument with an instantaneous field of view of $\sim$100\,degrees by 1-2\,degrees. Each CHIME Pathfinder cylinder has a feedline with 64 dual polarization feeds placed every $\sim$30\,cm which Nyquist sample the north-south sky over much of the frequency band. The signals from each dual-polarization feed are independently amplified, filtered to 400-800\,MHz, and directly sampled at 800\,MSps using 8 bits. The correlator is an FX design, where the Fourier transform channelization is performed in FPGAs, which are interfaced to a set of GPUs that compute the correlation matrix. The CHIME Pathfinder is a 1/10th scale prototype version of CHIME and is designed to detect the BAO feature and constrain the distance-redshift relation.

We show that surface waves along interstellar current sheets closely aligned with the line of sight lead to pulsar scintillation properties consistent with those observed. This mechanism naturally produces the length and density scales of the ISM scattering lenses that are required to explain the magnitude and dynamical spectrum of the scintillations. In this picture, the parts of warm ionized interstellar medium that are responsible for the scintillations are relatively quiescent, with scintillation and scattering resulting from weak waves propagating along magnetic domain boundary current sheets, which are both expected from helicity conservation and have been observed in numerical simulations. The model statistically predicts the spacing and amplitudes of inverted parabolic arcs seen in Fourier-transformed dynamical spectra of strongly scintillating pulsars with only 3 parameters. Multi-frequency, multi-epoch low frequency VLBI observations can quantitatively test this picture. If successful, in addition to mapping the ISM, this may open the door to precise nanoarcsecond pulsar astrometry, distance measurements, and emission studies using these 10AU interferometers in the sky.

In this paper we continue to develop the m-mode formalism, a technique for efficient and optimal analysis of wide-field transit radio telescopes, targeted at 21 cm cosmology. We extend this formalism to give an accurate treatment of the polarised sky, fully accounting for the effects of polarisation leakage and cross-polarisation. We use the geometry of the measured set of visibilities to project down to pure temperature modes on the sky, serving as a significant compression, and an effective first filter of polarised contaminants. We use the m-mode formalism with the Karhunen-Loeve transform to give a highly efficient method for foreground cleaning, and demonstrate its success in cleaning realistic polarised skies observed with an instrument suffering from substantial off axis polarisation leakage. We develop an optimal quadratic estimator in the m-mode formalism, which can be efficiently calculated using a Monte-Carlo technique. This is used to assess the implications of foreground removal for power spectrum constraints where we find that our method can clean foregrounds well below the foreground wedge, rendering only scales $k_\parallel < 0.02 h \,\mathrm{Mpc}^{-1}$ inaccessible. As this approach assumes perfect knowledge of the telescope, we perform a conservative test of how essential this is by simulating and analysing datasets with deviations about our assumed telescope. Assuming no other techniques to mitigate bias are applied, we recover unbiased power spectra when the per-feed beam width to be measured to 0.1%, and amplifier gains to be known to 1% within each minute. Finally, as an example application, we extend our forecasts to a wideband 400-800 MHz cosmological observation and consider the implications for probing dark energy, finding a medium-sized cylinder telescope improves the DETF Figure of Merit by around 70% over Planck and Stage II experiments alone.

Recent implications of results from quantum information theory applied to black holes has led to the confusing conclusions that requires either abandoning the equivalence principle (e.g. the firewall picture), or the no-hair theorem (e.g. the fuzzball picture), or even more unpalatable options. The recent discovery of a pulsar orbiting a black hole opens up new possibilities for tests of theories of gravity. We examine possible observational effects of semiclassical quantum gravity in the vicinity of black holes, as probed by pulsars and event horizon telescope imaging of flares. Pulsar radiation is observable at wavelengths only two orders of magnitude shorter than the Hawking radiation, so precision interferometry of lensed pulsar images may shed light on the quantum gravitational processes and interaction of Hawking radiation with the spacetime near the black hole. This paper discusses the impact on the pulsar radiation interference pattern, which is observable through the modulation index in the foreseeable future, and discusses a possible classical limit of BHC.

We present the largest-volume (425 Mpc/h=607 Mpc on a side) full radiative transfer simulation of cosmic reionization to date. We show that there is significant additional power in density fluctuations at very large scales. We systematically investigate the effects this additional power has on the progress, duration and features of reionization, as well as on selected reionization observables. We find that comoving simulation volume of ~100 Mpc/h per side is sufficient for deriving a convergent mean reionization history, but that the reionization patchiness is significantly underestimated. We use jackknife splitting to quantify the convergence of reionization properties with simulation volume for both mean-density and variable-density sub-regions. We find that sub-volumes of ~100 Mpc/h per side or larger yield convergent reionization histories, except for the earliest times, but smaller volumes of ~50 Mpc/h or less are not well converged at any redshift. Reionization history milestones show significant scatter between the sub-volumes, of Delta z=0.6-1 for ~50 Mpc/h volumes, decreasing to Delta z=0.3-0.5 for ~100 Mpc/h volumes, and $\Delta z$~0.1 for ~200 Mpc/h volumes. If we only consider mean-density sub-regions the scatter decreases, but remains at Delta z~0.1-0.2 for the different size sub-volumes. Consequently, many potential reionization observables like 21-cm rms, 21-cm PDF skewness and kurtosis all show good convergence for volumes of ~200 Mpc/h, but retain considerable scatter for smaller volumes. In contrast, the three-dimensional 21-cm power spectra at large scales (k<0.25 h/Mpc) do not fully converge for any sub-volume size. These additional large-scale fluctuations significantly enhance the 21-cm fluctuations, which should improve the prospects of detection considerably, given the lower foregrounds and greater interferometer sensitivity at higher frequencies. (abridged)

We investigate the effect of patchy reionization on the cosmic microwave background temperature. An anisotropic optical depth tau (theta) alters the TT power spectrum on small scales l > 2000. We make use of the correlation between the matter density and the reionization redshift fields to construct full sky maps of tau(theta). Patchy reionization transfers CMB power from large scales to small scales, resulting in a non-zero cross correlation between large and small angular scales. We show that the patchy tau correlator is sensitive to small root mean square values tau_rms ~ 0.003 seen in our maps. We include other secondary anisotropies such as CMB lensing, kinetic and thermal Sunyaev-Zel'dovich terms, as well as the infrared and point source background, and show that patchy reionization may be detected in the low frequency channels ~ 90 GHz, particularly for extended reionization histories. If frequency dependent secondaries can be minimized by a multi-frequency analysis, we show that even small degrees of patchiness can be detected at high significance. In this case, we show that models with different values of tau_rms are distinguishable, even for the same mean value <tau>. The patchy tau correlator thus provides information that is complementary to what may be obtained from the polarization and the kinetic Sunyaev-Zel'dovich power spectra.

We propose that interstellar extreme scattering events, usually observed as pulsar scintillations, may be caused by a coherent agent rather than the usually assumed turbulence of $\rm H_2$ clouds. We find that the penetration of a flux of ionizing, positively charged strangelets or quark nuggets into a dense interstellar hydrogen cloud may produce ionization trails. Depending on the specific nature and energy of the incoming droplets, diffusive propagation or even capture in the cloud are possible. As a result, enhanced electron densities may form and constitute a lens-like scattering screen for radio pulsars and possibly for quasars.

This paper presents CUBEP3M, a publicly-available high performance cosmological N-body code and describes many utilities and extensions that have been added to the standard package. These include a memory-light runtime SO halo finder, a non-Gaussian initial conditions generator, and a system of unique particle identification. CUBEP3M is fast, its accuracy is tuneable to optimize speed or memory, and has been run on more than 27,000 cores, achieving within a factor of two of ideal weak scaling even at this problem size. The code can be run in an extra-lean mode where the peak memory imprint for large runs is as low as 37 bytes per particles, which is almost two times leaner than other widely used N-body codes. However, load imbalances can increase this requirement by a factor of two, such that fast configurations with all the utilities enabled and load imbalances factored in require between 70 and 120 bytes per particles. CUBEP3M is well designed to study large scales cosmological systems, where imbalances are not too large and adaptive time-stepping not essential. It has already been used for a broad number of science applications that require either large samples of non-linear realizations or very large dark matter N-body simulations, including cosmological reionization, halo formation, baryonic acoustic oscillations, weak lensing or non-Gaussian statistics. We discuss the structure, the accuracy, known systematic effects and the scaling performance of the code and its utilities, when applicable.

The large-scale distribution of neutral hydrogen in the Universe will be luminous through its 21 cm emission. Here, for the first time, we use the auto-power spectrum of 21 cm intensity fluctuations to constrain neutral hydrogen fluctuations at z~0.8. Our data were acquired with the Green Bank Telescope and span the redshift range 0.6 < z < 1 over two fields totalling ~41 deg. sq. and 190 h of radio integration time. The dominant synchrotron foregrounds exceed the signal by ~10^3, but have fewer degrees of freedom and can be removed efficiently. Even in the presence of residual foregrounds, the auto-power can still be interpreted as an upper bound on the 21 cm signal. Our previous measurements of the cross-correlation of 21 cm intensity and the WiggleZ galaxy survey provide a lower bound. Through a Bayesian treatment of signal and foregrounds, we can combine both fields in auto- and cross-power into a measurement of Omega_HI b_HI = [0.62^{+0.23}_{-0.15}] * 10^{-3} at 68% confidence with 9% systematic calibration uncertainty, where Omega_HI is the neutral hydrogen (HI) fraction and b_HI is the HI bias parameter. We describe observational challenges with the present data set and plans to overcome them.

The GMRT Epoch of Reionization (EoR) experiment is an ongoing effort to measure the power spectrum from neutral hydrogen at high redshift. We have previously reported an upper limit of (70 mK)^2 at wavenumbers of k=0.65 h/Mpc using a basic piecewise-linear foreground subtraction. In this paper we explore the use of a singular value decomposition to remove foregrounds with fewer assumptions about the foreground structure. Using this method we also quantify, for the first time, the signal loss due to the foreground filter and present new power spectra adjusted for this loss, providing a revised measurement of a 2-sigma upper limit at (248 mK)^2 for k=0.50 h/Mpc. While this revised limit is larger than previously reported, we believe it to be more robust and still represents the best current constraints on reionization at z=8.6.

Pulsar timing arrays (PTAs) will be sensitive to a finite number of gravitational wave (GW) "point" sources (e.g. supermassive black hole binaries). N quiet pulsars with accurately known distances d_{pulsar} can characterize up to 2N/7 distant chirping sources per frequency bin \Delta f_{gw}=1/T, and localize them with "diffraction limited" precision \delta\theta \gtrsim (1/SNR)(\lambda_{gw}/d_{pulsar}). Even if the pulsar distances are poorly known, a PTA with F frequency bins can still characterize up to (2N/7)[1-(1/2F)] sources per bin, and the quasi-singular pattern of timing residuals in the vicinity of a GW source still allows the source to be localized quasi-topologically within roughly the smallest quadrilateral of quiet pulsars that encircles it on the sky, down to a limiting resolution \delta\theta \gtrsim (1/SNR) \sqrt{\lambda_{gw}/d_{pulsar}}. PTAs may be unconfused, even at the lowest frequencies, with matched filtering always appropriate.

(Abridged) Estimating the uncertainty on the matter power spectrum internally (i.e. directly from the data) is made challenging by the simple fact that galaxy surveys offer at most a few independent samples. In addition, surveys have non-trivial geometries, which make the interpretation of the observations even trickier, but the uncertainty can nevertheless be worked out within the Gaussian approximation. With the recent realization that Gaussian treatments of the power spectrum lead to biased error bars about the dilation of the baryonic acoustic oscillation scale, efforts are being directed towards developing non-Gaussian analyses, mainly from N-body simulations so far. Unfortunately, there is currently no way to tell how the non-Gaussian features observed in the simulations compare to those of the real Universe, and it is generally hard to tell at what level of accuracy the N-body simulations can model complicated non-linear effects such as mode coupling and galaxy bias. We propose in this paper a novel method that aims at measuring non-Gaussian error bars on the matter power spectrum directly from galaxy survey data. We utilize known symmetries of the 4-point function, Wiener filtering and principal component analysis to estimate the full covariance matrix from only four independent fields with minimal prior assumptions. With the noise filtering techniques and only four fields, we are able to recover the Fisher information obtained from a large N=200 sample to within 20 per cent, for k < 1.0 h/Mpc. Finally, we provide a prescription to extract a noise-filtered, non-Gaussian, covariance matrix from a handful of fields in the presence of a survey selection function.

We use VLBI imaging of the interstellar scattering speckle pattern associated with the pulsar PSR 0834+06 to measure the astrometric motion of its emission. The ~ 5AU interstellar baselines, provided by interference between speckles spanning the scattering disk, enable us to detect motions with sub nanoarcsecond accuracy. We measure a small pulse deflection of ~18+/-2 km (not including geometric uncertainties), which is 100 times smaller than the native resolution of this interstellar interferometer. This implies that the emission region is small, and at an altitude of a few hundred km, with the exact value depending on field geometry. This is substantially closer to the star than to the light cylinder. Future VLBI measurements can improve on this finding. This new regime of ultra-precise astrometry may enable precision parallax distance determination of pulsar binary displacements.

In this paper we describe the spherical harmonic transit telescope, a novel formalism for the analysis of transit radio telescopes. This all-sky approach bypasses the curved sky complications of traditional interferometry and so is particularly well suited to the analysis of wide-field radio interferometers. It enables compact and computationally efficient representations of the data and its statistics that allow new ways of approaching important problems like map-making and foreground removal. In particular, we show how it enables the use of the Karhunen-Loeve transform as a highly effective foreground filter, suppressing realistic foreground residuals for our fiducial example by at least a factor twenty below the 21cm signal even in highly contaminated regions of the sky. This is despite the presence of the angle-frequency mode mixing inherent in real-world instruments with frequency-dependent beams. We show, using Fisher forecasting, that foreground cleaning has little effect on power spectrum constraints compared to hypothetical foreground-free measurements. Beyond providing a natural real-world data analysis framework for 21cm telescopes now under construction and future experiments, this formalism allows accurate power spectrum forecasts to be made that include the interplay of design constraints and realistic experimental systematics with twenty-first century 21cm science.

In this letter, 21 cm intensity maps acquired at the Green Bank Telescope are cross-correlated with large-scale structure traced by galaxies in the WiggleZ Dark Energy Survey. The data span the redshift range 0.6 < z < 1 over two fields totaling ~41 deg. sq. and 190 hours of radio integration time. The cross-correlation constrains Omega_HI b_HI r = [0.43 \pm 0.07 (stat.) \pm 0.04(sys.)] x 10^-3, where Omega_HI is the neutral hydrogen HI fraction, r is the galaxy-hydrogen correlation coefficient, and b_HI is the HI bias parameter. This is the most precise constraint on neutral hydrogen density fluctuations in a challenging redshift range. Our measurement improves the previous 21 cm cross-correlation at z ~ 0.8 both in its precision and in the range of scales probed.

Large-scale reionization simulations are described which combine the results of cosmological N-body simulations that model the evolving density and velocity fields and identify the galactic halo sources, with ray-tracing radiative transfer calculations which model the nonequilibrium ionization of the intergalactic medium. These simulations have been used to predict some of the signature effects of reionization on cosmic radiation backgrounds, including the CMB, near-IR, and redshifted 21cm backgrounds. We summarize some of our recent progress in this work, and address the question of whether observations of such signature effects can be used to distinguish the relative contributions of galaxies of different masses to reionization.

We combine two Gaussianization techniques - Wavelet Non-Linear Wiener Filter (WNLWF) and density reconstruction - to quantify the recovery of Fisher information that is lost in the gravitational collapse. We compute a displacement fields, in analogy with the Zel'dovich approximation, and apply a Wavelet Non-Linear Wiener Filter that decomposes the reconstructed density fields into a Gaussian and a non-Gaussian component. From a series of 200 realizations of N-body simulations, we compute the recovery performance for density fields obtained with both dark matter particles and haloes. We find that the height of the Fisher information trans-linear plateau is increased by more than an order of magnitude at k > 1.0h/Mpc for particles, whereas either technique alone offers an individual recovery boost of only a factor of three to five. We conclude that these two techniques work in a symbiosis, as their combined performance is stronger than the sum of their individual contribution. When applied to the halo catalogues, we find that the reconstruction has only a weak effect on the recovery of Fisher Information, while the non-linear wavelet filter boosts the information by about a factor offive. We also observe that non-Gaussian Poisson noise saturates the Fisher information, and that shot noise subtracted measurements exhibit a milder information recovery.

We apply CMB lensing techniques to large scale structure and solve for the 3-D cosmic tidal field. We use small scale filamentary structures to solve for the large scale tidal shear and gravitational potential. By comparing this to the redshift space density field, one can measure the gravitational growth factor on large scales without cosmic variance. This potentially enables accurate measurements of neutrino masses and reconstruction of radial modes lost in 21 cm intensity mapping, which are essential for CMB and other cross correlations. We relate the tidal fields to the squeezed limit bispectrum, and present initial results from simulations and data from the SDSS.

We consider the generic scenario of dark energy which arises through the latent heat of a hidden sector first order cosmological phase transition. This field could account for the extra radiation degree of freedom suggested by the CMB. We present the bubble nucleation solution for the viscous limit. The decay rate of the field is constrained by published KSZ data, and may be an explanation of current excess ISW correlations. Cross correlation of current and future surveys can further constrain or test the parameter space. The decay model is plausibly in the observable range, and avoids anthropic problems. This class of models is not well constrained by the popular dark energy figure of merit.

We revisit the uncertainty in baryon acoustic oscillation (BAO) forecasts and data analyses. In particular, we study how much the uncertainties on both the measured mean dilation scale and the associated error bar are affected by the non-Gaussianity of the non-linear density field. We examine two possible impacts of non-Gaussian analysis: (1) we derive the distance estimators from Gaussian theory, but use 1000 N-Body simulations to measure the actual errors, and compare this to the Gaussian prediction, and (2) we compute new optimal estimators, which requires the inverse of the non-Gaussian covariance matrix of the matter power spectrum. Obtaining an accurate and precise inversion is challenging, and we opted for a noise reduction technique applied on the covariance matrices. By measuring the bootstrap error on the inverted matrix, this work quantifies for the first time the significance of the non-Gaussian error corrections on the BAO dilation scale. We find that the variance (error squared) on distance measurements can deviate by up to 12% between both estimators, an effect that requires a large number of simulations to be resolved. We next apply a reconstruction algorithm to recover some of the BAO signal that had been smeared by non-linear evolution, and we rerun the analysis. We find that after reconstruction, the rms error on the distance measurement improves by a factor of ~1.7 at low redshift (consistent with previous results), and the variance ({\sigma}^2) shows a change of up to 18% between optimal and sub-optimal cases (note, however, that these discrepancies may depend in detail on the procedure used to isolate the BAO signal). We finally discuss the impact of this work on current data analyses.

We quantify the performance of a non-linear Wiener filter, constructed in wavelet space, at recovering some of the Fisher information that was lost in the weak lensing convergence field. The proposed method consists in a separation of the original field into the sum of a Gaussian and a non-Gaussian contribution. After filtering an ensemble of such fields, which are obtained from $N$-body simulations, we find that we can recapture about four times more Fisher information, an effect that can potentially improve by a significant amount the constraining power of weak lensing surveys on cosmological parameters, including the dark energy equation of state $\omega$. We compare this performance with that of the logarithmic mapping and find that the wavelet method can recover up to three times more information.

We propose convergent plasma lenses, possibly from current sheets, as a generic solution to strong interstellar scattering. These lenses resolve the overpressure problem by geometric alignment as noted by Goldreich and Shridhar (2006). They further quantitatively explain properties of extreme scattering events, and pulsar parabolic arcs. This model makes quantitative predictions testable by VLBI on scattering events. It differs conceptually from previous models by occurring through rare, localized underdense sheets. Such sheets are thermally and kinematically stable, and could be consequences of reconnection. The apparent diffractive effects are a result of coherent interference of refractive images. We propose that these lenses can be used for precision distance determination to pulsars, enabling accurate gravity source localization.

We propose a method to estimate non-Gaussian error bars on the matter power spectrum from galaxy surveys in the presence of non-trivial survey selection functions. The estimators are often obtained from formalisms like FKP and PKL, which rely on the assumption that the underlying field is Gaussian. The Monte Carlo method is more accurate but involves the tedious process of running and cross-correlating a large number of N-body simulations, in which the survey volume is embedded. From 200 N-body simulations, we extract a non-linear covariance matrix as a function of two scales and of the angle between two Fourier modes. All the non-Gaussian features of that matrix are then simply parametrized in terms of a few fitting functions and Eigenvectors. We furthermore develop a fast and accurate strategy that combines our parameterization with a general galaxy survey selection function, and incor- porate non-Gaussian Poisson uncertainty. We describe how to incorporate these two distinct non-Gaussian contributions into a typical analysis pipeline, and apply our method with the se- lection function from the 2dFGRS. We find that the observed Fourier modes correlate at much larger scales than that predicted by both FKP formalism or by pure N-body simulation in a "top hat" selection function. In particular, the observed Fourier modes are already 50 per cent correlated at k\sim0.1hMpc^(-1), and the non-Gaussian fractional variance on the power spectrum ({\sigma} /P(k))^2 is about a factor of 3.0 larger than the FKP prescription. At k~0.4hMpc^(-1), the deviations are an order of magnitude.

The prospect of detecting the first galaxies by observing their impact on the intergalactic medium as they reionized it during the first billion years leads us to ask whether such indirect observations are capable of diagnosing which types of galaxies were most responsible for reionization. We attempt to answer this by considering a set of large-scale radiative transfer simulations of reionization in sufficiently large volumes to make statistically meaningful predictions of observable signatures, while also directly resolving all atomically-cooling halos down to 10^8 M_solar. We focus here on predictions of the 21-cm background, to see if upcoming observations are capable of distinguishing a universe ionized primarily by high-mass halos from one in which both high-mass and low-mass halos are responsible, and to see how these results depend upon the uncertain source efficiencies. We find that 21-cm fluctuation power spectra observed by the first generation EoR/21-cm radio interferometer arrays should be able to distinguish the case of reionization by high-mass halos alone from that by both high- and low-mass halos, together. Some reionization scenarios yield very similar power spectra and rms evolution and thus can only be discriminated by their different mean reionization history and 21-cm PDF distributions. We find that the skewness of the 21-cm PDF distribution smoothed over LOFAR-like window shows a clear feature correlated with the rise of the rms due to patchiness. Measurements of the mean photoionization rates are sensitive to the average density of the regions being studied and therefore could be strongly skewed in certain cases. (abridged)

We present a new upper limit to the 21cm power spectrum during the Epoch of Reionization (EoR) which constrains reionization models with an unheated IGM. The GMRT-EoR experiment is an ongoing effort to make a statistical detection of the power spectrum of 21cm neutral hydrogen emission at redshift z~9. Data from this redshift constrain models of the EoR, the end of the Dark Ages arising from the formation of the first bright UV sources, probably stars or mini-quasars. We present results from approximately 50 hours of observations at the Giant Metrewave Radio Telescope in India from December 2007. We describe radio frequency interference (RFI) localisation schemes which allow bright sources on the ground to be identified and physically removed in addition to automated flagging. Singular-value decomposition is used to remove remaining broadband RFI by identifying ground sources with large eigenvalues. Foregrounds are modelled using a piecewise linear filter and the power spectrum is measured using cross-correlations of foreground subtracted images.

We develop a purely mathematical tool to recover some of the information lost in the non-linear collapse of large-scale structure. From a set of 141 simulations of dark matter density fields, we construct a non-linear Weiner filter in order to separate Gaussian and non-Gaussian structure in wavelet space. We find that the non-Gaussian power is dominant at smaller scales, as expected from the theory of structure formation, while the Gaussian counterpart is damped by an order of magnitude on small scales. We find that it is possible to increase the Fisher information by a factor of three before reaching the translinear plateau, an effect comparable to other techniques like the linear reconstruction of the density field.

We conduct a survey of numerical simulations to probe the structure and appearance of non-radiative black hole accretion flows like the supermassive black hole at the Galactic centre. We find a generic set of solutions, and make specific predictions for currently feasible rotation measure (RM) observations, which are accessible to current instruments including the EVLA, GMRT and ALMA. The slow time variability of the RM is a key quantitative signature of this accretion flow. The time variability of RM can be used to quantitatively measure the nature of the accretion flow, and to differentiate models. Sensitive measurements of RM can be achieved using RM synthesis or using pulsars. Our energy conserving ideal magneto-hydrodynamical simulations, which achieve high dynamical range by means of a deformed-mesh algorithm, stretch from several Bondi radii to about one thousandth of that radius, and continue for tens of Bondi times. Magnetized flows which lack outward convection possess density slopes around -1, almost independent of physical parameters, and are more consistent with observational constraints than are strongly convective flows We observe no tendency for the flows to become rotationally supported in their centres, or to develop steady outflow. We support these conclusions with formulae which encapsulate our findings in terms of physical and numerical parameters. We discuss the relation of these solutions to other approaches. The main potential uncertainties are the validity of ideal MHD and the absence of a fully relativistic inner boundary condition. The RM variability predictions are testable with current and future telescopes.

Integrated Sachs-Wolfe (ISW) effect can be estimated by cross-correlating Cosmic Microwave Background (CMB) sky with tracers of the local matter distribution. At late cosmic time, the dark energy induced decay of gravitation potential generates a cross-correlation signal on large angular scales. The dominant noise are the intrinsic CMB anisotropies from the inflationary epoch. In this Letter we use CMB polarization to reduce this intrinsic noise. We cross-correlate the microwave sky observed by Wilkinson Microwave Anisotropy Probe (WMAP) with the radio source catalog compiled by NRAO VLA Sky Survey (NVSS) to study the efficiency of the noise suppression . We find that the error bars are reduced about 5-12 %, improving the statistical power.

Recent work has shown that at high redshift, the relative velocity between dark matter and baryonic gas is typically supersonic. This relative velocity suppresses the formation of the earliest baryonic structures like minihalos, and the suppression is modulated on large scales. This effect imprints a characteristic shape in the clustering power spectrum of the earliest structures, with significant power on 100 Mpc scales featuring highly pronounced baryon acoustic oscillations. The amplitude of these oscillations is orders of magnitude larger at z=20 than previously expected. This characteristic signature can allow us to distinguish the effects of minihalos on intergalactic gas at times preceding and during reionization. We illustrate this effect with the example of 21 cm emission and absorption from redshifts during and before reionization. This effect can potentially allow us to probe physics on kpc scales using observations on 100 Mpc scales. We present sensitivity forecasts for FAST and Arecibo. Depending on parameters, this enhanced structure may be detectable by Arecibo at redshifts near z=15-20, and with appropriate instrumentation FAST could measure the BAO power spectrum with high precision. In principle, this effect could also pose a serious challenge for efforts to constrain dark energy using observations of the BAO feature at low redshift.

A new effect is described by which primordial gravity waves leave a permanent signature in the large scale structure of the Universe. The effect occurs at second order in perturbation theory and is sensitive to the order in which perturbations on different scales are generated. We derive general forecasts for the detectability of the effect with future experiments, and consider observations of the pre-reionization gas through the 21 cm line. It is found that the Square Kilometre Array will not be competitive with current cosmic microwave background constraints on primordial gravity waves from inflation. However, a more futuristic experiment could, through this effect, provide the highest ultimate sensitivity to tensor modes and possibly even measure the tensor spectral index. It is thus a potentially quantitative probe of the inflationary paradigm.

Observations of 21-cm radio emission by neutral hydrogen at redshifts z ~ 0.5 to ~ 2.5 are expected to provide a sensitive probe of cosmic dark energy. This is particularly true around the onset of acceleration at z ~ 1, where traditional optical cosmology becomes very difficult because of the infrared opacity of the atmosphere. Hitherto, 21-cm emission has been detected only to z=0.24. More distant galaxies generally are too faint for individual detections but it is possible to measure the aggregate emission from many unresolved galaxies in the 'cosmic web'. Here we report a three dimensional 21-cm intensity field at z=0.53 to 1.12. We then co-add HI emission from the volumes surrounding about ten thousand galaxies (from the DEEP2 optical galaxy redshift survey. We detect the aggregate 21-cm glow at a significance of ~ 4 sigma.

Observational evidence for the existence of cosmic magnetic fields in intergalactic space coherent over Mpc scales is presented. Using an unprecedentedly large sample of Faraday rotation measures of radio sources from the NRAO VLA Sky Survey data and the photometric redshift galaxy catalog from the sixth Data Release of the Sloan Digital Sky Survey (SDSS), we measure the cross-correlations between the rotation measures and the galaxy density field distributed along the source sightlines. It is shown that the rotation measures for sightlines passing through high density regions at separation r >= 1 Mpc/h from the locations of background radio sources are significantly enhanced. We discuss possible generators of this enhancement and interpret it to be intergalactic magnetic fields coherent over 1 Mpc/h with mean field strength B~30 nG.

Before the universe was reionized, it was likely that the spin temperature of intergalactic hydrogen was decoupled from the CMB by UV radiation from the first stars through the Wouthuysen-Field effect. If the IGM had not yet been heated above the CMB temperature by that time, then the gas would appear in absorption relative to the CMB. Large, rare sources of X-rays could inject sufficient heat into the neutral IGM, so that the differential brightness temperature was greater than zero at comoving distances of tens to hundreds of Mpc, resulting in large 21-cm fluctuations with amplitudes of about 250 mK on arcminute to degree angular scales, an order of magnitude larger in amplitude than that caused by ionized bubbles during reionization, about 25 mK. This signal could therefore be easier to detect and probe higher redshifts than that due to patchy reionization. For the case in which the first objects to heat the IGM are QSOs hosting 10^7-solar mass black holes with an abundance exceeding about 1 per Gpc^3 at z~15, observations with either the Arecibo Observatory or the Five Hundred Meter Aperture Spherical Telescope (FAST) could detect and image their fluctuations at greater than 5-sigma significance in about a month of dedicated survey time. Additionally, existing facilities such as MWA and LOFAR could detect the statistical fluctuations arising from a population of 10^5-solar mass black holes with an abundance of about 10^4 per Gpc^3 at z~10-12.

The new era of software signal processing has a large impact on radio astronomy instrumentation. Our design and implementation of a 32 antennae, 33 MHz, dual polarization, fully real-time software backend for the GMRT, using only off-the-shelf components, is an example of this. We have built a correlator and a beamformer, using PCI-based ADC cards and a Linux cluster of 48 nodes with dual gigabit inter-node connectivity for real-time data transfer requirements. The highly optimized compute pipeline uses cache efficient, multi-threaded parallel code, with the aid of vectorized processing. This backend allows flexibility in final time and frequency resolutions, and the ability to implement algorithms for radio frequency interference rejection. Our approach has allowed relatively rapid development of a fairly sophisticated and flexible backend receiver system for the GMRT, which will greatly enhance the productivity of the telescope. In this paper we describe some of the first lights using this software processing pipeline. We believe this is the first instance of such a real-time observatory backend for an intermediate sized array like the GMRT.

We present some preliminary results from a series of extremely large, high-resolution N-body simulations of the formation of early nonlinear structures. We find that the high-z halo mass function is inconsistent with the Sheth-Tormen mass function, which tends to over-estimate the abundance of rare halos. This discrepancy is in rough agreement with previous results based on smaller simulations. We also show that the number density of minihaloes is correlated with local matter density, albeit with a significant scatter that increases with redshift, as minihaloes become increasingly rare. The average correlation is in rough agreement with a simple analytical extended Press-Schechter model, but can differ by up to factor of 2 in some regimes.

It is shown that 21 cm intensity mapping could be used in the near term to make cosmologically useful measurements. Large scale structure could be detected using existing radio telescopes, or using prototypes for dedicated redshift survey telescopes. This would provide a measure of the mean neutral hydrogen density, using redshift space distortions to break the degeneracy with the linear bias. We find that with only 200 hours of observing time on the Green Bank Telescope, the neutral hydrogen density could be measured to 25% precision at redshift 0.54<z<1.09. This compares favourably to current measurements, uses independent techniques, and would settle the controversy over an important parameter which impacts galaxy formation studies. In addition, a 4000 hour survey would allow for the detection of baryon acoustic oscillations, giving a cosmological distance measure at 3.5% precision. These observation time requirements could be greatly reduced with the construction of multiple pixel receivers. Similar results are possible using prototypes for dedicated cylindrical telescopes on month time scales, or SKA pathfinder aperture arrays on day time scales. Such measurements promise to improve our understanding of these quantities while beating a path for future generations of hydrogen surveys.

We present magneto-hydrodynamic simulation results for heterogeneous systems. Heterogeneous architectures combine high floating point performance many-core units hosted in conventional server nodes. Examples include Graphics Processing Units (GPU's) and Cell. They have potentially large gains in performance, at modest power and monetary cost. We implemented a magneto-hydrodynamic (MHD) simulation code on a variety of heterogeneous and multi-core architectures --- multi-core x86, Cell, Nvidia and ATI GPU --- in different languages, FORTRAN, C, Cell, CUDA and OpenCL. We present initial performance results for these systems. To our knowledge, this is the widest comparison of heterogeneous systems for MHD simulations. We review the different challenges faced in each architecture, and potential bottlenecks. We conclude that substantial gains in performance over traditional systems are possible, and in particular that is possible to extract a greater percentage of peak theoretical performance from some systems when compared to x86 architectures.

We present a constructive numerical example of fast magnetic reconnection in a three dimensional periodic box. Reconnection is initiated by a strong, localized perturbation to the field lines. The solution is intrinsically three dimensional, and its gross properties do not depend on the details of the simulations. $\sim 50%$ of the magnetic energy is released in an event which lasts about one Alfven time, but only after a delay during which the field lines evolve into a critical configuration. We present a physical picture of the process. The reconnection regions are dynamical and mutually interacting. In the comoving frame of these regions, reconnection occurs through an X-like point, analogous to Petschek reconnection. The dynamics appear to be driven by global flows, not local processes.

We present projected constraints on modified gravity models from the observational technique known as 21 cm intensity mapping, where cosmic structure is detected without resolving individual galaxies. The resulting map is sensitive to both BAO and weak lensing, two of the most powerful cosmological probes. It is found that a 200 m x 200 m cylindrical telescope, sensitive out to z=2.5, would be able to distinguish DGP from most dark energy models, and constrain the Hu & Sawicki f(R) model to |f_{R0}| < 9*10^(-6) at 95% confidence. The latter constraint makes extensive use of the lensing spectrum in the nonlinear regime. These results show that 21 cm intensity mapping is not only sensitive to modifications of the standard model's expansion history, but also to structure growth. This makes intensity mapping a powerful and economical technique, achievable on much shorter time scales than optical experiments that would probe the same era.

Photo-z errors, especially catastrophic errors, are a major uncertainty for precision weak lensing cosmology. We find that the shear-(galaxy number) density and density-density cross correlation measurements between photo-z bins, available from the same lensing surveys, contain valuable information for self-calibration of the scattering probabilities between the true-z and photo-z bins. The self-calibration technique we propose does not rely on cosmological priors nor parameterization of the photo-z probability distribution function, and preserves all of the cosmological information available from shear-shear measurement. We estimate the calibration accuracy through the Fisher matrix formalism. We find that, for advanced lensing surveys such as the planned stage IV surveys, the rate of photo-z outliers can be determined with statistical uncertainties of 0.01-1% for $z<2$ galaxies. Among the several sources of calibration error that we identify and investigate, the {\it galaxy distribution bias} is likely the most dominant systematic error, whereby photo-z outliers have different redshift distributions and/or bias than non-outliers from the same bin. This bias affects all photo-z calibration techniques based on correlation measurements. Galaxy bias variations of $O(0.1)$ produce biases in photo-z outlier rates similar to the statistical errors of our method, so this galaxy distribution bias may bias the reconstructed scatters at several-$\sigma$ level, but is unlikely to completely invalidate the self-calibration technique.

We study the optimal use of third order statistics in the analysis of weak lensing by large-scale structure. These higher order statistics have long been advocated as a powerful tool to break measured degeneracies between cosmological parameters. Using ray-tracing simulations, incorporating important survey features such as a realistic depth-dependent redshift distribution, we find that a joint two- and three-point correlation function analysis is a much stronger probe of cosmology than the skewness statistic. We compare different observing strategies, showing that for a limited survey time there is an optimal depth for the measurement of third-order statistics, which balances statistical noise and cosmic variance against signal amplitude. We find that the chosen CFHTLS observing strategy was optimal and forecast that a joint two- and three-point analysis of the completed CFHTLS-Wide will constrain the amplitude of the matter power spectrum $\sigma_8$ to 10% and the matter density parameter $\Omega_m$ to 17%, a factor of ~2.5 improvement on the two-point analysis alone. Our error analysis includes all non-Gaussian terms, finding that the coupling between cosmic variance and shot noise is a non-negligible contribution which should be included in any future analytical error calculations.

FISH is a fast and simple ideal magneto-hydrodynamics code that scales to ~10 000 processes for a Cartesian computational domain of ~1000^3 cells. The simplicity of FISH has been achieved by the rigorous application of the operator splitting technique, while second order accuracy is maintained by the symmetric ordering of the operators. Between directional sweeps, the three-dimensional data is rotated in memory so that the sweep is always performed in a cache-efficient way along the direction of contiguous memory. Hence, the code only requires a one-dimensional description of the conservation equations to be solved. This approach also enable an elegant novel parallelisation of the code that is based on persistent communications with MPI for cubic domain decomposition on machines with distributed memory. This scheme is then combined with an additional OpenMP parallelisation of different sweeps that can take advantage of clusters of shared memory. We document the detailed implementation of a second order TVD advection scheme based on flux reconstruction. The magnetic fields are evolved by a constrained transport scheme. We show that the subtraction of a simple estimate of the hydrostatic gradient from the total gradients can significantly reduce the dissipation of the advection scheme in simulations of gravitationally bound hydrostatic objects. Through its simplicity and efficiency, FISH is as well-suited for hydrodynamics classes as for large-scale astrophysical simulations on high-performance computer clusters. In preparation for the release of a public version, we demonstrate the performance of FISH in a suite of astrophysically orientated test cases.

We have carried out semianalytic simulations to build redshifted 21-cm maps in the dark ages. An entropy-floor model is adopted for planting protogalaxies in simulated minihaloes. The model allocates gas quantities such as baryonic mass and temperature to every $N$-body particle and extensively exploits the particle nature of the data in the subsequent analysis. We have found that the number density of simulated minihaloes in the early universe is well described by the Sheth & Tormen function and consequently the signal powers of simulated minihaloes are far greater than the Press & Schechter prediction presented by Furlanetto (2006b). Even though the matter power spectrum measured in the halo particles at $z=15$ is about an order of magnitude smaller than the intergalactic medium (IGM), the 21-cm signal fluctuations of haloes are, to the contrary, one order of magnitude higher than the embedding adiabatic IGM on scales, $k\lesssim 10 h{\rm Mpc}^{-1}$. But their spectral shapes are almost same to each other. We have found that the adiabatic signal power on large scales lies between the linear predictions of the infinite spin-temperature model ($T_s\gg T_{\rm cmb}$) and the model with the uniform spin temperature equal to background value ($T_s = T_s^{bg}$). Higher preheating temperature (or higher background entropy) makes the power spectrum of signals more flattened because the hotter IGM signals are more thermally broadened and minihalo fluctuations dominating on small scales are more severely suppressed by the higher background entropy. Therefore, this model-dependent power spectrum slope measured on the scale of $100\le k \le 1000 ~h{\rm Mpc}^{-1}$ will enable us to easily determine a best-matching halo + IGM model in future observations.

We quantify the Fisher information content of the cosmic shear survey two-point function as a function of noise and resolution. The two point information of dark matter saturates at the trans-linear scale. We investigate the impact of non-linear non-Gaussianity on the information content for lensing, which probes the same dark matter. To do so we heavily utilize N-body simulations in order to probe accurately the non-linear regime. While we find that even in a perfect survey, there is no clear saturation scale, we observe that non-linear growth induced non-Gaussianity could lead to a factor of ~4 reduction for the common Dark Energy figure of merit. This effect is however mitigated by realistic levels of shot noise and we find that for future surveys, the effect is closer to a factor of 1.5. To do so, we develop a new scheme to compute the relevant covariant matrix. It leads us to claim an unbiased estimator with an order of magnitude improvement in accuracy with only twice more simulations than previously used. Finally, we evaluate the error on the errors using bootstrap methods.

The GMRT reionization effort aims to map out the large scale structure of the Universe during the epoch of reionization (EoR). Removal of polarized Galactic emission is a difficult part of any 21 cm EoR program, and we present new upper limits to diffuse polarized foregrounds at 150 MHz. We find no high significance evidence of polarized emission in our observed field at mid galactic latitude (J2000 08h26m+26). We find an upper limit on the 2-dimensional angular power spectrum of diffuse polarized foregrounds of [l^2 C_l/(2 PI)]^{1/2}< 3K in frequency bins of width 1 MHz at 300<l<1000. The 3-dimensional power spectrum of polarized emission, which is most directly relevant to EoR observations, is [k^3 P_p(k)/(2 PI^2)]^{1/2}< 2K at k_perp > 0.03 h/Mpc, k < 0.1 h/Mpc. This can be compared to the expected EoR signal in total intensity of [k^3 P(k)/ (2 PI^2) ]^{1/2} ~ 10 mK. We find polarized structure is substantially weaker than suggested by extrapolation from higher frequency observations, so the new low upper limits reported here reduce the anticipated impact of these foregrounds on EoR experiments. We discuss Faraday beam and depth depolarization models and compare predictions of these models to our data. We report on a new technique for polarization calibration using pulsars, as well as a new technique to remove broadband radio frequency interference. Our data indicate that, on the edges of the main beam at GMRT, polarization squint creates ~ 3% leakage of unpolarized power into polarized maps at zero rotation measure. Ionospheric rotation was largely stable during these solar minimum night time observations.

Wide area Large-Scale Structure (LSS) surveys are planning to map a substantial fraction of the visible universe to quantify dark energy through Baryon Acoustic Oscillations (BAO). At increasing redshift, for example that probed by proposed 21-cm intensity mapping surveys, gravitational lensing potentially limits the fidelity (Hui et al., 2007) because it distorts the apparent matter distribution. In this paper we show that these distortions can be reconstructed, and actually used to map the distribution of intervening dark matter. The lensing information for sources at z=1-3 allows accurate reconstruction of the gravitational potential on large scales, l <~ 100, which is well matched for Integrated Sachs-Wolfe (ISW) effect measurements of dark energy and its sound speed, and a strong constraint for modified gravity models of dark energy. We built an optimal quadratic lensing estimator for non-Gaussian sources, which is necessary for LSS. The phenomenon of "information saturation" (Rimes & Hamilton, 2005) saturates reconstruction at mildly non-linear scales, where the linear source power spectrum Delta^2 ~ 0.2-0.5. We find that steeper power spectra, saturate more quickly. We compute the effective number densities of independent lensing sources for LSS lensing, and find that they increase rapidly with redshifts. For LSS/21-cm sources at z ~ 2-4, the lensing reconstruction is limited by cosmic variance at l<~ 100.

Using the 21 cm line, observed all-sky and across the redshift range from 0 to 5, the large scale structure of the Universe can be mapped in three dimensions. This can be accomplished by studying specific intensity with resolution ~ 10 Mpc, rather than via the usual galaxy redshift survey. The data set can be analyzed to determine Baryon Acoustic Oscillation wavelengths, in order to address the question: 'What is the nature of Dark Energy?' In addition, the study of Large Scale Structure across this range addresses the questions: 'How does Gravity effect very large objects?' and 'What is the composition our Universe?' The same data set can be used to search for and catalog time variable and transient radio sources.

The first, self-consistent calculations are presented of the cosmological, H2-dissociating UV background produced during the epoch of reionization by the sources of reionization. Large-scale radiative transfer simulations of reionization trace the impact of all the ionizing starlight on the IGM from all the sources in our simulation volume down to dwarf galaxies of mass ~10^8 Msun, identified by very high-resolution N-body simulations, including the self-regulating effect of IGM photoheating on dwarf galaxy formation. The UV continuum emitted below 13.6 eV by each source is then transferred through the same IGM, attenuated by atomic H Lyman series resonance lines, to predict the evolution of the inhomogeneous radiation background in the Lyman-Werner bands of H2 between 11 and 13.6 eV. On average, the intensity of this Lyman-Werner background is found to rise to the threshold level at which dissociation suppresses H2 cooling and star formation inside minihalos, long before reionization is complete. Spatial variations in the Lyman-Werner background are found which result from the clustering of sources associated with large-scale structure formation, such that intensity fluctuations correlate with matter density fluctuations. As a result, the Lyman-Werner background rises to the threshold level for H2 suppression earlier in the vicinity of the reionization sources and their H II regions.

The Yuan-Tseh Lee Array for Microwave Background Anisotropy (AMiBA) is the first interferometer dedicated to studying the cosmic microwave background (CMB) radiation at 3mm wavelength. The choice of 3mm was made to minimize the contributions from foreground synchrotron radiation and Galactic dust emission. The initial configuration of seven 0.6m telescopes mounted on a 6-m hexapod platform was dedicated in October 2006 on Mauna Loa, Hawaii. Scientific operations began with the detection of a number of clusters of galaxies via the thermal Sunyaev-Zel'dovich effect. We compare our data with Subaru weak lensing data in order to study the structure of dark matter. We also compare our data with X-ray data in order to derive the Hubble constant.

[ABRIDGED VERSION] The future of cm and m-wave astronomy lies with the Square Kilometre Array (SKA), a telescope under development by a consortium of 17 countries. The SKA will be 50 times more sensitive than any existing radio facility. A majority of the key science for the SKA will be addressed through large-area imaging of the Universe at frequencies from 300 MHz to a few GHz. The Australian SKA Pathfinder (ASKAP) is aimed squarely in this frequency range, and achieves instantaneous wide-area imaging through the development and deployment of phase-array feed systems on parabolic reflectors. This large field-of-view makes ASKAP an unprecedented synoptic telescope poised to achieve substantial advances in SKA key science. The central core of ASKAP will be located at the Murchison Radio Observatory in inland Western Australia, one of the most radio-quiet locations on the Earth and one of the sites selected by the international community as a potential location for the SKA. Following an introductory description of ASKAP, this document contains 7 chapters describing specific science programmes for ASKAP. The combination of location, technological innovation and scientific program will ensure that ASKAP will be a world-leading radio astronomy facility, closely aligned with the scientific and technical direction of the SKA. A brief summary chapter emphasizes the point, and considers discovery space.

In the present work we study the statistics of haloes, which in the halo model determines the distribution of galaxies. Haloes are known to be biased tracer of dark matter, and at large scales it is usually assumed there is no intrinsic stochasticity between the two fields. Following the work of Seljak & Warren (2004), we explore how correct this assumption is and, moving a step further, we try to qualify the nature of stochasticity. We use Principal Component Analysis applied to the outputs of a cosmological N-body simulation to: (1) explore the behaviour of stochasticity in the correlation between haloes of different masses; (2) explore the behaviour of stochasticity in the correlation between haloes and dark matter. We show results obtained using a catalogue with 2.1 million haloes, from a PMFAST simulation with box size of 1000h^{-1}Mpc. In the relation between different populations of haloes we find that stochasticity is not-negligible even at large scales. In agreement with the conclusions of Tegmark & Bromley (1999) who studied the correlations of different galaxy populations, we found that the shot-noise subtracted stochasticity is qualitatively different from `enhanced' shot noise and, specifically, it is dominated by a single stochastic eigenvalue. We call this the `minimally stochastic' scenario, as opposed to shot noise which is `maximally stochastic'. In the correlation between haloes and dark matter, we find that stochasticity is minimized, as expected, near the dark matter peak (k ~ 0.02 h Mpc^{-1} for a LambdaCDM cosmology) and, even at large scales, it is of the order of 15 per cent above the shot noise. Moreover, we find that the reconstruction of the dark matter distribution is improved when we use eigenvectors as tracers of the bias. [Abridged]

Observations of high-redshift Ly-alpha sources are a major tool for studying the high-redshift Universe. We discuss the effect of the reionizing intergalactic medium on the observability of Ly-alpha sources based on large simulations of early structure formation with radiative transfer. This takes into account self-consistently the reionization history, density, velocity and ionization structures and nonlinear source clustering. We find that all fields are highly anisotropic and as a consequence there are very large variations in opacity among the different lines-of-sight. The velocity effects, from both infall and source peculiar velocity are most important for the luminous sources, affecting the line profile and depressing the bright end of the luminosity function. The line profiles are generally asymmetric and the line centers of the luminous sources are always absorbed due to the high density of the local IGM. For both luminous and average sources the damping wing effects are of similar magnitude and remain significant until fairly late. The ionizing flux in the ionized patch surrounding a high density peak is generally strongly dominated, particularly at late times, by the cluster of faint sources, rather than the central massive galaxy. The IGM absorption does not change appreciably the correlation function of sources at high redshift. Our derived luminosity function assuming constant mass-to-light ratio provides an excellent match to the shape of the observed luminosity function at z=6.6 with faint-end slope of alpha=-1.5. The resulting mass-to-light ratio implies that the majority of sources responsible for reionization are too faint to be observed by the current surveys. (abridged)

We analyze the photometric redshift catalog of the Sloan Digital Sky Survey Data Release 5 (SDSS DR5) to estimate the Fisher information in the galaxy angular power spectrum with the help of the Rimes-Hamilton technique. It is found that the amount of Fisher information contained in the galaxy angular power spectrum is saturated at lensing multipole scale 300<= l <= 2000 in the redshift range 0.1<= photo-z <0.5. At l=2000, the observed information is two orders of magnitude lower than the case of Gaussian fluctuations. This supports observationally that the translinear regime of the density power spectrum contains little independent information about the initial cosmological conditions, which is consistent with the numerical trend shown by Rimes-Hamilton. Our results also suggest that the Gaussian-noise description may not be valid in weak lensing measurements.

The first, self-consistent calculations of the cosmological H_2 dissociating UV background produced during the epoch of reionization (EOR) by the sources of reionization are presented. Large-scale radiative transfer simulations of reionization trace the impact of all the ionizing starlight on the IGM from all the sources in our simulation volume down to dwarf galaxies of mass ~ 10^8 solar mass, identified by very high-resolution N-body simulations, including the self-regulating effect of IGM photoheating on dwarf galaxy formation. The UV continuum emitted below 13.6 eV by each source is then transferred through the same IGM, attenuated by atomic H Lyman series resonance lines, to predict the evolution of the inhomogeneous background in the Lyman-Werner band of H_2 between 11 and 13.6 eV.

The formation of dark matter halos tends to occur anisotropically along the filaments of the Cosmic Web, which induces both ellipticity-ellipticity (EE) correlations between the shapes of halos, as well as ellipticity-direction (ED) cross-correlations between halo shapes and the directions to neighboring halos. We analyze the halo catalogue and the semi-analytic galaxy catalogue of the recent Millennium Run Simulation to measure the EE and ED correlations numerically at four different redshifts (z=0, 0.5, 1 and 2). For the EE correlations, we find that (i) the major-axis correlation is strongest while the intermediate-axis correlation is weakest; (ii) the signal is significant at distances out to 10 Mpc/h; (iii) the signal decreases as z decreases; (iv) and its behavior depends strongly on the halo mass scale, with larger masses showing stronger correlations at large distances. For the ED correlations, we find that (i) the correlations are much stronger than the EE correlations, and are significant even out to distances of 50 Mpc/h; (ii) the signal also decreases as z decreases; (iii) and it increases with halo mass at all distances. We also provide empirical fitting functions for the EE and ED correlations. The EE correlations are found to scale linearly with the linear density correlation function, xi(r). While the ED cross-correlation is found to scale as xi^{1/2}(r) at large distances beyond 10 Mpc/h. The best-fit values of the fitting parameters for the EE and the ED correlations are all determined through chi^{2}-statistics. Our results may be useful for quantifying the filamentary distribution of dark matter halos over a wide range of scales.

The redshifted 21-cm line of distant neutral H atoms provides a probe of the cosmic ``dark ages'' and the epoch of reionization (``EOR'') which ended them. The radio continuum produced by this redshifted line can be seen in absorption or emission against the CMB at meterwaves, yielding information about the thermal and ionization history of the universe and the primordial density perturbation spectrum that led to galaxy and large-scale structure formation. Observing this 21-cm background is a great challenge. A new generation of low-frequency radio arrays is currently under development to search for this background. Accurate theoretical predictions of the spectrum and anisotropy of this background, necessary to guide and interpret future observations, are also quite challenging. It is necessary to model the inhomogeneous reionization of the intergalactic medium and determine the spin temperature of the 21-cm transition and its variations in time and space as it decouples from the temperature of the CMB. Here, we focus on just a few of the predictions for the 21-cm background from the EOR, based on our newest, large-scale simulations of patchy reionization. These simulations are the first with enough N-body particles (from 5 to 29 billion) and radiative transfer rays to resolve the formation of and trace the ionizing radiation from each of the millions of dwarf galaxies believed responsible for reionization, down to 10^8 M_solar, in a cubic volume large enough (90 and 163 comoving Mpc on a side) to make meaningful statistical predictions of the fluctuating 21-cm background. (abridged)

The Cosmic Dark Ages and the Epoch of Reionization constitute a crucial missing link in our understanding of the evolution of the intergalactic medium and the formation and evolution of galaxies. Due to the complex nature of this global process it is best studied through large-scale numerical simulations. This presents considerable computational challenges. The dominant contributors of ionizing radiation were dwarf galaxies. These tiny galaxies must be resolved in very large cosmological volumes in order to derive their clustering properties and the corresponding observational signatures correctly, which makes this one of the most challenging problems of numerical cosmology. We have recently performed the largest and most detailed simulations of the formation of early cosmological large-scale structures and their radiative feedback leading to cosmic reionization. This was achieved by running extremely large (up to 29 billion-particle) N-body simulations of the formation of the Cosmic Web, with enough particles and sufficient force resolution to resolve all the galactic halos with total masses larger than 10^8 Solar masses in computational volumes of up to (163 Mpc)^3. These results were then post-processed by propagating the ionizing radiation from all sources by using fast and accurate ray-tracing radiative transfer method. Both of our codes are parallelized using a combination of MPI and OpenMP and to this date have been run efficiently on up to 2048 cores (N-body) and up to 10000 cores (radiative transfer) on the newly-deployed Sun Constellation Linux Cluster at the Texas Advanced Computing Center. In this paper we describe our codes, parallelization strategies, scaling and some preliminary scientific results. (abridged)

We present an overview for the reionization search at GMRT. The forecast sensitivities are promising for an early detection. RFI mitigation has been successful. Several hundred hours of telescope time have already been invested in this ongoing effort, and analysis of the data is in progress.

The non-Gaussian contribution to the intrinsic halo spin alignments is analytically modeled and numerically detected. Assuming that the growth of non-Gaussianity in the density fluctuations caused the tidal field to have nonlinear-order effect on the orientations of the halo angular momentum, we model the intrinsic halo spin alignments as a linear scaling of the density correlations on large scales, which is different from the previous quadratic-scaling model based on the linear tidal torque theory. Then, we analyze the halo catalogs from the recent high-resolution Millennium Run simulation at four different redshifts (z=0,0.5,1 and 2) and measure quantitatively the degree of the nonlinear effect on the halo spin alignments and its changes with redshifts. A clear signal of spin correlations is found on scales as large as 10 Mpc/h at z=0, which marks a detection of the nonlinear tidal effect on the intrinsic halo alignments. We also investigate how the nonlinear effect depends on the intrinsic properties of the halos. It is found that the degree of the nonlinear tidal effect increases as the halo mass scale decreases, the halo specific angular momentum increases, and the halo peculiar velocity decreases. We discuss implication of our result on the weak gravitational lensing.

We present the first statistically significant detection of cosmic structure using broadly distributed hydrogen radio emission. This is accomplished using a cross correlation with optical galaxies. Statistical noise levels of $20 \mu $K are achieved, unprecedented in this frequency band. This lends support to the idea that large volumes of the universe can be rapidly mapped without the need to resolve individual faint galaxies, enabling precise constraints to dark energy models. We discuss strategies for improved intensity mapping.

The expansion of the universe appears to be accelerating, and the mysterious anti-gravity agent of this acceleration has been called ``dark energy''. To measure the dynamics of dark energy, Baryon Acoustic Oscillations (BAO) can be used. Previous discussions of the BAO dark energy test have focused on direct measurements of redshifts of as many as $10^9$ individual galaxies, by observing the 21cm line or by detecting optical emission. Here we show how the study of acoustic oscillation in the 21 cm brightness can be accomplished by economical three dimensional intensity mapping. If our estimates gain acceptance they may be the starting point for a new class of dark energy experiments dedicated to large angular scale mapping of the radio sky, shedding light on dark energy.

Direct detection of the Dark Ages and the Epoch of Reionization (EOR) is among the main scientific objectives of all current and future low-frequency radio facilities. In this paper we summarize and discuss recent results, based on state-of-the-art numerical simulations, regarding the fundamental EOR properties and its observability with current and future radio arrays, like the Giant Metrewave Radio Telescope (GMRT), the Low Frequency Array (LOFAR), the 21-CM Array (21CMA), the Murchison Widefield Array (MWA) and the Square Kilometre Array (SKA). Results show that the optimal observational frequencies for statistical detection are 140-160 MHz. The signals are strongly non-Gaussian at late times. The correlation widths between 21-cm maps at neighbouring frequencies are short, of order 300-800 kHz, which should help with the cleaning of the strong foregrounds. Direct comparison of the resolutions and expected sensitivities of GMRT and MWA indicate that their optimal sensitivity ranges are similar, at scales k~0.2-0.4 h/Mpc, however, all else being equal the former should require shorter integration times due to its significantly larger collecting area.

Recently, we have presented the first large-scale radiative transfer simulations of reionization. Here we present new simulations which extend the source halo mass range downward to 10^8M_solar, to capture the full range of halo masses thought to be primarily responsible for reionization by their star formation following atomic hydrogen radiative cooling and gravitational collapse. Haloes below about 10^9M_solar, however, are subject to Jeans-mass filtering in the ionized regions, which suppresses their baryonic content and their ability to release ionizing radiation. By including these smaller-mass haloes but accounting for their suppression, too, we find that reionization is ``self-regulating,'' as follows. As the mean ionized fraction rises, so does the fraction of the volume within which suppression occurs. Hence, the degree of suppression is related to the mean ionized fraction. Since low-mass haloes with high emissivity achieve a given mean ionized fraction earlier than do those with low efficiency, Jeans-mass filtering compensates for the difference in the emissivity of the suppressible haloes in these two cases. As a result, in the presence of lower-mass source haloes, reionization begins earlier, but the later stages of reionization and the time of overlap are dictated by the efficiency of the higher-mass haloes, independent of the efficiency of the suppressible, lower-mass haloes. Reionization histories consistent with current observational constraints are shown to be achievable with standard stellar sources in haloes above 10^8M_solar. Neither minihalos nor exotic sources are required, and the phenomenon of ``double reionization'' previously suggested does not occur. (abridged)

A number of large current experiments aim to detect the signatures of the Cosmic Reionization at redshifts z>6. Their success depends crucially on understanding the character of the reionization process and its observable consequences and designing the best strategies to use. We use large-scale simulations of cosmic reionization to evaluate the reionization signatures at redshifted 21-cm and small-scale CMB anisotropies in the best current model for the background universe, with fundamental cosmological parameters given by WMAP 3-year results (WMAP3). We find that the optimal frequency range for observing the ``global step'' of the 21-cm emission is 120-150 MHz, while statistical studies should aim at 140-160 MHz, observable by GMRT. Some strongly-nongaussian brightness features should be detectable at frequencies up to ~190 MHz. In terms of sensitivity-signal trade-off relatively low resolutions, corresponding to beams of at least a few arcminutes, are preferable. The CMB anisotropy signal from the kinetic Sunyaev-Zel'dovich effect from reionized patches peaks at tens of muK at arcminute scales and has an rms of ~1 muK, and should be observable by the Atacama Cosmology Telescope and the South Pole Telescope. We discuss the various observational issues and the uncertainties involved, mostly related to the poorly-known reionization parameters and, to a lesser extend, to the uncertainties in the background cosmology.

Recently the numerical simulations of the process of reionization of the universe at z>6 have made a qualitative leap forward, reaching sufficient sizes and dynamic range to determine the characteristic scales of this process. This allowed making the first realistic predictions for a variety of observational signatures. We discuss recent results from large-scale radiative transfer and structure formation simulations on the observability of high-redshift Ly-alpha sources. We also briefly discuss the dependence of the characteristic scales and topology of the ionized and neutral patches on the reionization parameters.

We study the limits of accuracy for weak lensing maps of dark matter using diffuse 21-cm radiation from the pre-reionization epoch using simulations. We improve on previous "optimal" quadratic lensing estimators by using shear and convergence instead of deflection angles. We find that non-Gaussianity provides a limit to the accuracy of weak lensing reconstruction, even if instrumental noise is reduced to zero. The best reconstruction result is equivalent to Gaussian sources with effectively independent cell of side length 2.0/h Mpc. Using a source full map from z=10-20, this limiting sensitivity allows mapping of dark matter at a Signal-to-Noise ratio (S/N) greater than 1 out to l < 6000, which is better than any other proposed technique for large area weak lensing mapping.

We measure the intrinsic alignments of the blue and the red galaxies separately by analyzing the spectroscopic data of the Sloan Digital Sky Survey Data Release 6 (SDSS DR6). For both samples of the red and the blue galaxies with axial ratios of b/a <= 0.8, we detect a 3 sigma signal of the ellipticity correlation in the redshift range of 0 <= z <= 0.4 for r-band absolute (model) magnitude cut of M_r <= -19.2 (no K correction). We note a difference in the strength and the distance scale for the red and the blue galaxy correlation eta_{2D}(r): For the bright blue galaxies, it behaves as a quadratic scaling of the linear density correlation of xi(r) as eta_{2D}(r) proportional to xi^{2}(r) with strong signal detected only at small distance bin of r <= 3 Mpc/h. While for the bright red galaxies it follows a linear scaling as eta_{2D}(r) proportional to xi(r) with signals detected at larger distance out to r~6 Mpc/h. We also test whether the detected correlation signal is intrinsic or spurious by quantifying the systematic error and find that the effect of the systematic error on the ellipticity correlation is negligible. It is finally concluded that our results will be useful for the weak lensing measurements as well as the understanding of the large scale structure formation.

In recent years there has been considerable progress in our understanding of the nature and properties of the reionization process. In particular, the numerical simulations of this epoch have made a qualitative leap forward, reaching sufficiently large scales to derive the characteristic scales of the reionization process and thus allowing for realistic observational predictions. Our group has recently performed the first such large-scale radiative transfer simulations of reionization, run on top of state-of-the-art simulations of early structure formation. This allowed us to make the first realistic observational predictions about the Epoch of Reionization based on detailed radiative transfer and structure formation simulations. We discuss the basic features of reionization derived from our simulations and some recent results on the observational implications for the high-redshift Ly-alpha sources.

An Eulerian TVD code and a Lagrangian SPH code are used to simulate the off-axis collision of equal-mass main sequence stars in order to address the question of whether stellar mergers can produce a remnant star where the interior has been replenished with hydrogen due to significant mixing. Each parent main sequence star is chosen to be found near the turnoff, with hydrogen depleted in the core, and is modelled with a M=0.8 solar mass realistic stellar model and as a n=3 polytrope. An ideal fluid description with adiabatic index gamma=5/3 is used for all hydrodynamic calculations. We found good agreement between the simulations for the polytropic case, with the remnant showing strong, non-local mixing throughout. In the interior quarter of the mass, ~35% is mixed in from larger radii and on average the remnant is ~50% fully mixed. For the realistic model, we found less mixing, particularly in the interior and in the SPH simulation. In the inner quarter, ~20% of the contained mass in the TVD case, but only ~3% in the SPH one is mixed in from outside. The simulations give consistent results for the overall profile of the merger remnant and the amount of mass loss, but the differences in mixing suggests that the intrinsic difference between grid and particle based schemes remains a possible artifact. We conclude that both the TVD and SPH schemes can be used equally well for problems that are best suited to their strengths and that care should be taken in interpreting results about fluid mixing.

The inhomogeneous ionization state of the universe when the first sources of ionizing radiation appeared should lead to anisotropies in the polarization of the cosmic microwave background. We use cosmological simulations of the process by which the first sources ionized the intergalactic medium to study the induced polarization anisotropies. We find that the polarization anisotropies have rms of order ~0.01 \mu K, and local peak values of ~0.1 \mu K, smaller than those due to gravitational lensing on small scales. The polarization direction is highly coherent over degree scales. This directional coherence is not expected from either primary anisotropy or gravitational lensing effects, making the largest signals due to inhomogeneous ionization relatively easy to isolate, should experiments achieve the necessary very low noise levels.

Neutrino transport in spherically symmetric models of stellar core collapse and bounce has achieved a technically complete level, rewarded by the agreement among independent groups that a multi-dimensional treatment of the fluid-instabilities in the post-bounce phase is indispensable to model supernova explosions. While much effort is required to develop a reliable neutrino transport technique in axisymmetry, we explore neutrino physics approximations and parameterizations for an efficient three-dimensional simulation of the fluid-instabilities in the shock-heated matter that accumulates between the accretion shock and the protoneutron star. We demonstrate the reliability of a simple parameterization scheme in the collapse phase and extend our 3D magneto-hydrodynamical collapse simulations to a preliminary postbounce evolution. The growth of magnetic fields is investigated.

We present the first calculation of the kinetic Sunyaev-Zel'dovich (kSZ) effect due to the inhomogeneous reionization of the universe based on detailed large-scale radiative transfer simulations of reionization. The resulting sky power spectra peak at l=2000-8000 with maximum values of l^2C_l~1\times10^{-12}. The peak scale is determined by the typical size of the ionized regions and roughly corresponds to the ionized bubble sizes observed in our simulations, ~5-20 Mpc. The kSZ anisotropy signal from reionization dominates the primary CMB signal above l=3000. This predicted kSZ signal at arcminute scales is sufficiently strong to be detectable by upcoming experiments, like the Atacama Cosmology Telescope and South Pole Telescope which are expected to have ~1' resolution and ~muK sensitivity. The extended and patchy nature of the reionization process results in a boost of the peak signal in power by approximately one order of magnitude compared to a uniform reionization scenario, while roughly tripling the signal compared with that based upon the assumption of gradual but spatially uniform reionization. At large scales the patchy kSZ signal depends largely on the ionizing source efficiencies and the large-scale velocity fields: sources which produce photons more efficiently yield correspondingly higher signals. The introduction of sub-grid gas clumping in the radiative transfer simulations produces significantly more power at small scales, and more non-Gaussian features, but has little effect at large scales. The patchy nature of the reionization process roughly doubles the total observed kSZ signal for l~3000-10^4 compared to non-patchy scenarios with the same total electron-scattering optical depth.

We present detailed predictions for the redshifted 21cm signal from the epoch of reionization. These predictions are obtained from radiative transfer calculations on the results of large scale (100/h Mpc), high dynamic range, cosmological simulations. We consider several scenarios for the reionization history, of both early and extended reionization. From the simulations we construct and analyze a range of observational characteristics, from the global signal, via detailed images and spectra, to statistical representations of rms fluctuations, angular power spectra, and probability distribution functions to characterize the non-gaussianity of the 21cm signal. (abbreviated abstract)

We present the first calculation of the kinetic Sunyaev-Zel'dovich (kSZ) effect due to the inhomogeneus reionization of the universe based on detailed large-scale radiative transfer simulations of reionization. The resulting sky power spectra peak at l=2000-8000 with maximum values of l(l+1)C_l/(2pi)_{max}~4-7x10^{-13}. The scale roughly corresponds to the typical ionized bubble sizes observed in our simulations, of ~5-20 Mpc. The kSZ anisotropy signal from reionization dominates the primary CMB signal above l=3000. At large scales the patchy kSZ signal depends only on the source efficiencies. It is higher when sources are more efficient at producing ionizing photons, since such sources produce larger ionized regions, on average, than less efficient sources. The introduction of sub-grid gas clumping in the radiative transfer simulations produce significantly more power at small scales, but has little effect at large scales. The patchy reionization kSZ signal is dominated by the post-reionization signal from fully-ionized gas, but the two contributions are of similar order at scales l~3000-10^4, indicating that the kSZ anisotropies from reionization are an important component of the total kSZ signal at these scales.

An all sky redshift survey, using hydrogen 21 cm emission to locate galaxies, can be used to track the wavelength of baryon acoustic oscillations imprints from z ~ 1.5 to z = 0. This will allow precise determination of the evolution of dark energy. A telescope made of fixed parabolic cylindrical reflectors offers substantial benefit for such a redshift survey. Fixed cylinders can be built for low cost, and long cylinders also allow low cost fast fourier transform techniques to be used to define thousands of simultaneous beams. A survey made with fixed reflectors naturally covers all of the sky available from it's site with good uniformity, minimizing sample variance in the measurement of the acoustic peak wavelength. Such a survey will produce about a billion redshifts, nearly a thousand times the number available today. The survey will provide a three dimensional mapping of a substantial fraction of the Hubble Sphere.

We present the first large-scale radiative transfer simulations of cosmic reionization, in a simulation volume of (100/h Mpc)^3, while at the same time capturing the dwarf galaxies which are primarily responsible for reionization. We achieve this by combining the results from extremely large, cosmological, N-body simulations with a new, fast and efficient code for 3D radiative transfer, C^2-Ray. The resulting electron-scattering optical depth is in good agreement with the first-year WMAP polarization data. We show that reionization clearly proceeded in an inside-out fashion, with the high-density regions being ionized earlier, on average, than the voids. Ionization histories of smaller-size (5 to 10 comoving Mpc) subregions exibit a large scatter about the mean and do not describe the global reionization history well. The minimum reliable volume size for such predictions is ~30 Mpc. We derive the power-spectra of the neutral, ionized and total gas density fields and show that there is a significant boost of the density fluctuations in both the neutral and the ionized components relative to the total at arcminute and larger scales. We find two populations of HII regions according to their size, numerous, mid-sized (~10 Mpc) regions and a few, rare, very large regions tens of Mpc in size. We derive the statistical distributions of the ionized fraction and ionized gas density at various scales and for the first time show that both distributions are clearly non-Gaussian. (abridged)

We present an out-of-core hydrodynamic code for high resolution cosmological simulations that require terabytes of memory. Out-of-core computation refers to the technique of using disk space as virtual memory and transferring data in and out of main memory at high I/O bandwidth. The code is based on a two-level mesh scheme where short-range physics is solved on a high-resolution, localized mesh while long-range physics is captured on a lower resolution, global mesh. The two-level mesh gravity solver allows FFTs to operate on data stored entirely in memory, which is much faster than the alternative of computing the transforms out-of-core through non-sequential disk accesses. We also describe an out-of-core initial conditions generator that is used to prepare large data sets for cosmological simulations. The out-of-core code is accurate, cost-effective, and memory-efficient and the current version is implemented to run in parallel on shared-memory machines. I/O overhead is significantly reduced down to less than 10% by performing disk operations concurrently with numerical calculations. The current computational setup, which includes a 32 processor Alpha server and a 3 TB striped SCSI disk array, allows us to run cosmological simulations with up to 4000^3 grid cells and 2000^3 dark matter particles.

We show how precision lensing measurements can be obtained through the lensing magnification effect in high redshift 21cm emission from galaxies. Normally, cosmic magnification measurements have been seriously complicated by galaxy clustering. With precise redshifts obtained from 21cm emission line wavelength, one can correlate galaxies at different source planes, or exclude close pairs to eliminate such contaminations. We provide forecasts for future surveys, specifically the SKA and CLAR. SKA can achieve percent precision on the dark matter power spectrum and the galaxy dark matter cross correlation power spectrum, while CLAR can measure an accurate cross correlation power spectrum. The neutral hydrogen fraction was most likely significantly higher at high redshifts, which improves the number of observed galaxies significantly, such that also CLAR can measure the dark matter lensing power spectrum. SKA can also allow precise measurement of lensing bispectrum.

We develop a new tool to generate statistically precise dark matter maps from the cosmic magnification of galaxies with distance estimates. We show how to overcome the intrinsic clustering problem using the slope of the luminosity function, because magnificability changes strongly over the luminosity function, while intrinsic clustering only changes weakly. This may allow precision cosmology beyond most current systematic limitations. SKA is able to reconstruct projected matter density map at smoothing scale $\sim 10^{'}$ with S/N$\geq 1$, at the rate of 200-4000 deg$^2$ per year, depending on the abundance and evolution of 21cm emitting galaxies. This power of mapping dark matter is comparable to, or even better than that of cosmic shear from deep optical surveys or 21cm surveys.

Weak lensing measurements are starting to provide statistical maps of the distribution of matter in the universe that are increasingly precise and complementary to cosmic microwave background maps. The probability distribution (PDF) provides a powerful tool to test non-Gausian features in the convergence field and to discriminate the different cosmological models. In this letter, we present a new PDF space Wiener filter approach to reconstruct the probability density function of the convergence from the noisy convergence field. We find that for parameters comparable to the CFHT legacy survey, the averaged PDF of the convergence in a 3 degree field can be reconstructed with an uncertainty of about 10%, even though the pointwise PDF is noise dominated.

Recent astronomical observations of systems of dark matter, which have been cited as providing possible support for self-interacting cold dark matter, may provide evidence for the extra dimensions predicted by superstring scenarios. We find that the properties of the required dark matter self-interaction are precisely the consequences of a world with 3 large extra dimensions of size \~1nm, where gravity follows the r^{-5} law at scales below ~1nm. From the cross sections measured for various dark matter systems, we also constrain the mass of dark matter particles to be m_x ~ 3*10^{-16} proton mass, consistent with the mass of axions.

Gravitational lensing deflects light. A single lens deflector can only shear images, but cannot induce rotations. Multiple lens planes can induce rotations. Such rotations can be observed in quadruply imaged sources, and can be used to distinguish between two proposed solutions of the flux anomaly problem: substructures in lensing galaxies vs large scale structure. We predict the expected amount of rotation due to large scale structure in strong lensing systems, and show how this effect can be measured using ~ mas VLBI astrometry of quadruple lenses with extended source structures. The magnitude of rotation is around one degree. The biggest theoretical uncertainty is the power spectrum of dark matter on very small scales. This procedure can potentially be turned around to measure the dark matter power spectrum on very small scales. We list the predicted RMS rotation angles for several quadruple lenses with known lens and source redshifts.

We present a new parallel PM N-body code named PMFAST that is freely available to the public. PMFAST is based on a two-level mesh gravity solver where the gravitational forces are separated into long and short range components. The decomposition scheme minimizes communication costs and allows tolerance for slow networks. The code approaches optimality in several dimensions. The force computations are local and exploit highly optimized vendor FFT libraries. It features minimal memory overhead, with the particle positions and velocities being the main cost. The code features support for distributed and shared memory parallelization through the use of MPI and OpenMP, respectively. The current release version uses two grid levels on a slab decomposition, with periodic boundary conditions for cosmological applications. Open boundary conditions could be added with little computational overhead. We present timing information and results from a recent cosmological production run of the code using a 3712^3 mesh with 6.4 x 10^9 particles. PMFAST is cost-effective, memory-efficient, and is publicly available.

The propagation of cosmological ionization fronts (I-fronts) during reionization is strongly influenced by small-scale structure. Here we summarize our recent attemps to understand the effect of this small-scale structure. We present high resolution cosmological N-body simulations at high-z (z>6) which resolve a wide range of halo mass, from minihalos to clusters of large, rare halos. We also study how minihalos affect I-fronts, through simulations of minihalo photoevaporation. Furthermore, we modify the I-front propagation equations to account for evolving small-scale structure, and incorporate these results into a semi-analytical reionization model. When intergalactic medium clumping and minihalo clustering around sources are included, small-scale structure affects reionization by slowing it down and extending it in time. This helps to explain observations by the Wilkinson Microwave Anisotropy Probe, which imply an early and extended reionization epoch. We also study how source clustering affects the evolution and size of H II regions, finding, in agreement with simulations, that H II regions usually expand, rarely shrinking. Hence, "relic H II regions'' are an exception, rather than the rule. When the suppression of small-mass sources in already-ionized regions by Jeans-mass filtering is accounted for, H II regions are smaller, delaying overlap. We also present a new numerical method for radiative transfer which is fast, efficient, and easily coupled to hydrodynamics and N-body codes, along with sample tests and applications.

We present a new algorithm to rapidly compute the two-point (2PCF), three-point (3PCF) and n-point (n-PCF) correlation functions in roughly O(N log N) time for N particles, instead of O(N^n) as required by brute force approaches. The algorithm enables an estimate of the full 3PCF for as many as 10^6 galaxies. This technique exploits node-to-node correlations of a recursive bisectional binary tree. A balanced tree construction minimizes the depth of the tree and the worst case error at each node. The algorithm presented in this paper can be applied to problems with arbitrary geometry. We describe the detailed implementation to compute the two point function and all eight components of the 3PCF for a two-component field, with attention to shear fields generated by gravitational lensing. We also generalize the algorithm to compute the n-point correlation function for a scalar field in k dimensions where n and k are arbitrary positive integers.

We discuss the nature of the possible high-l excess in the Cosmic Microwave Background (CMB) anisotropy power spectrum observed by the Cosmic Background Imager (CBI). We probe the angular structure of the excess in the CBI deep fields and investigate whether it could be due to the scattering of CMB photons by hot electrons within clusters, the Sunyaev-Zeldovich (SZ) effect. We estimate the density fluctuation parameters for amplitude, sigma_8, and shape, Gamma, from CMB primary anisotropy data and other cosmological data. We use the results of two separate hydrodynamical codes for Lambda-CDM cosmologies, consistent with the allowed sigma_8 and Gamma values, to quantify the expected contribution from the SZ effect to the bandpowers of the CBI experiment and pass simulated SZ effect maps through our CBI analysis pipeline. The result is very sensitive to the value of sigma_8, and is roughly consistent with the observed power if sigma_8 ~ 1. We conclude that the CBI anomaly could be a result of the SZ effect for the class of Lambda-CDM concordance models if sigma_8 is in the upper range of values allowed by current CMB and Large Scale Structure (LSS) data.

The Primeval Structure Telescope (PaST), will be used search for and study the era the of the first luminous objects, the epoch of reionization. The first stars ionized the gas around them producing a pattern of ionization that reflects the large scale density structure present at the time. The PaST array will be used in an attempt to sense and study this ionization, by mapping the brightness of 21-cm neutral hydrogen emission at redshifts from 6 to 25. This emission disappears on ionization, allowing the study of large scale structure and of star formation at this very early epoch. The 10,000 antenna PaST array will be used to image ionized structures by creating 1 million pixel images of the sky. The angular scales of the images to be produced span from 5 arc-minutes to 10 degrees. The array is currently under construction and over 2000 antennas have been installed.

(Abridged) The precision modeling of the thermal Sunyaev Zeldovich (SZ) effect and future high accuracy measurements will provide a powerful way to constrain the thermal history of the universe. In this paper, we combine high resolution adiabatic hydro simulations and analytical models to provide a precision modeling of the gas density weighted temperature $\bar{T}_g$ and the mean SZ Compton $y$ parameter. Simulation artifacts are quantified and corrected and our analytical model passes tests of various simulations and is able to predict $\bar{T}_g$ and $\bar{y}$ to several percent accuracy. For low matter density $\Lambda$CDM cosmology, the present $\bar{T}_g$ is $0.32 (\sigma_8/0.84)^{3.05-0.15\Omega_m}(\Omega_m/0.268)^{1.28-0.2\sigma_8} {\rm keV}$. The mean $y$ parameter is $2.6\times 10^{-6} (\sigma_8/0.84)^{4.1-2\Omega_m}(\Omega_m/0.268)^{1.28-0.2\sigma_8}$. The current upper limit of $y<1.5\times 10^{-5}$ measured by FIRAS has already ruled out combinations of high $\sigma_8\ga 1.1$ and high $\Omega_m\ga 0.5$.

All recent numerical simulations agree that stars in the main sequence mass range of 9-40 solar masses do not produce a prompt hydrodynamic ejection of the outer layers after core collapse and bounce. Rather they suggest that stellar core collapse and supernova explosion are dynamically distinct astrophysical events, separated by an unspectacular accretion phase of at least ~40 ms duration. As long as the neutrinospheres remain convectively stable, the explosion dynamics is determined by the neutrons, protons, electrons and neutrinos in the layer of impact-heated matter piling up on the protoneutron star. The crucial role of neutrino transport in this regime has been emphasized in many previous investigations. Here, we search for efficient means to address the role of magnetic fields and fluid instabilities in stellar core collapse and the postbounce phase.

Two years of microwave background observations with the Cosmic Background Imager (CBI) have been combined to give a sensitive, high resolution angular power spectrum over the range 400 < l < 3500. This power spectrum has been referenced to a more accurate overall calibration derived from WMAP. The data cover 90 deg^2 including three pointings targeted for deep observations. The uncertainty on the l > 2000 power previously seen with the CBI is reduced. Under the assumption that any signal in excess of the primary anisotropy is due to a secondary Sunyaev-Zeldovich anisotropy in distant galaxy clusters we use CBI, ACBAR, and BIMA data to place a constraint on the present-day rms mass fluctuation sigma_8. We present the results of a cosmological parameter analysis on the l < 2000 primary anisotropy data which show significant improvements in the parameters as compared to WMAP alone, and we explore the role of the small-scale cosmic microwave background data in breaking parameter degeneracies.

I discuss the use of cross correlations between galaxies with distance information and projected weak lensing dark matter maps to obtain a fully three dimensional dark matter map and power spectrum. On large scales l<100 one expects the galaxies to be biased, but not stochastic. I show that this allows a simultaneous solution of the full 3-D evolving galaxy bias and the dark matter power spectrum simultaneously. Within the photo-z information of the CFH lensing legacy survey, this allows a threefold reduction of statistical error, while a cross correlation with CLAR or other deep spectroscopic surveys allows a tenfold improvement in dark matter power accuracy on linear scales. This makes lensing surveys more sensitive to the cosmic equation of state and the neutrino masses.

I present a weak lensing sensitivity estimate for upcoming high redshift (epoch of reionization and beyond) 21cm surveys. Instruments such as PAST, LOFAR and SKA should be able to measure the weak lensing power spectrum to precisions far exceeding conceivable optical surveys. Three types of sources are detectable, which include the re-ionization stromgren spheres, large scale structure, and minihalos. Tomography allows the measurement of the time evolution of the dark matter power spectrum. Raw sensitivities allow measurement of many cosmological parameters, including dark energy, neutrino mass and cosmic equations of state, to percent accuracy. It also has the potential for inflationary gravity wave measurements. Ultimate limits may be achievable through radio observations of 10^18 minihalos. Inflationary Hubble parameters H_I down to 10^-9 M_Planck can be detected through this effect. Second order effects may also be observable, allowing tests for backreaction and the quantum mechanical origin of perturbations.

The kinetic SZ effect, which is the dominant CMB source at arc-minute scales and $\nu \sim 217$ Ghz, probes the ionized gas peculiar momentum up to the epoch of reionization and is a sensitive measure of the reionization history. We ran high resolution self-similar and $\Lambda$CDM hydro simulations and built an analytical model to study this effect. Our model reproduces the $\Lambda$CDM simulation results to several percent accuracy, passes various tests against self-similar simulations, and shows a wider range of applicability than previous analytical models. Our model in its continuous version is free of simulation limitations such as finite simulation box and finite resolution and allows an accurate prediction of the kinetic SZ power spectrum $C_l$. For the WMAP cosmology, we find $l^2C_l/(2\pi)\simeq 0.91 \times 10^{-12} [(1+z_{\rm reion})/10]^{0.34}(l/5000)^{0.23-0.015(z_{\rm reion}-9)}$ for the reionization redshift $6<z_{\rm reion}<20$ and $3000<l<9000$. The corresponding temperature fluctuation is several $\mu$K at these ranges. The dependence of $C_l$ on the reionization history allows an accurate measurement of the reionization epoch. For the Atacama cosmology telescope experiment, $C_l$ can be measured with $\sim 1%$ accuracy. $C_l$ scales as $(\Omega_b h)^2 \sigma_8^{4\sim 6}$. Given cosmological parameters, ACT would be able to constrain $z_{\rm reion}$ with several percent accuracy. Some multi-reionization scenarios degenerate in the primary CMB temperature and TE measurement can be distinguished with $\sim 10 \sigma$ confidence.

We present a new approach to Eulerian computational fluid dynamics that is designed to work at high Mach numbers encountered in astrophysical hydrodynamic simulations. The Eulerian fluid conservation equations are solved in an adaptive frame moving with the fluid where Mach numbers are minimized. The moving frame approach uses a velocity decomposition technique to define local kinetic variables while storing the bulk kinetic components in a smoothed background velocity field that is associated with the grid velocity. Gravitationally induced accelerations are added to the grid, thereby minimizing the spurious heating problem encountered in cold gas flows. Separately tracking local and bulk flow components allows thermodynamic variables to be accurately calculated in both subsonic and supersonic regions. A main feature of the algorithm, that is not possible in previous Eulerian implementations, is the ability to resolve shocks and prevent spurious heating where both the preshock and postshock Mach numbers are high. The hybrid algorithm combines the high resolution shock capturing ability of the second-order accurate Eulerian TVD scheme with a low-diffusion Lagrangian advection scheme. We have implemented a cosmological code where the hydrodynamic evolution of the baryons is captured using the moving frame algorithm while the gravitational evolution of the collisionless dark matter is tracked using a particle-mesh N-body algorithm. The MACH code is highly suited for simulating the evolution of the IGM where accurate thermodynamic evolution is needed for studies of the Lyman alpha forest, the Sunyaev-Zeldovich effect, and the X-ray background. Hydrodynamic and cosmological tests are described and results presented. The current code is fast, memory-friendly, and parallelized for shared-memory machines.

We present the first optimal power spectrum estimation and three dimensional deprojections for the dark and luminous matter and their cross correlations. The results are obtained using a new optimal fast estimator (Pen 2003) deprojected using minimum variance and SVD techniques. We show the resulting 3-D power spectra for dark matter and galaxies, and their covariance for the VIRMOS-DESCART weak lensing shear and galaxy data. The survey is most sensitive to nonlinear scales k_NL ~ 1 h Mpc^-1. On these scales, our 3-D power spectrum of dark matter is in good agreement with the RCS 3-D power spectrum found by (Hoekstra et al 2002). Our galaxy power is similar to that found by the 2MASS survey, and larger than that of SDSS, APM and RCS, consistent with the expected difference in galaxy population. We find an average bias b=1.24+/-0.18 for the I selected galaxies, and a cross correlation coefficient r=0.75+/-0.23. Together with the power spectra, these results optimally encode the entire two point information about dark matter and galaxies, including galaxy-galaxy lensing. We address some of the implications regarding galaxy halos and mass-to-light ratios. The best fit ``halo'' parameter h=r/b=0.57+/-0.16, suggesting that dynamical masses estimated using galaxies systematically underestimate total mass. Ongoing surveys, such as the Canada-France-Hawaii-Telescope-Legacy survey will significantly improve on the dynamic range, and future photometric redshift catalogs will allow tomography along the same principles.

Weak lensing measurements are entering a precision era to statistically map the distribution of matter in the universe. The most common measurement has been of the variance of the projected surface density of matter, which corresponds to the induced correlation in alignments of background galaxies. This measurement of the fluctuations is insensitive to the total mass content, like using waves on the ocean to measure its depths. But when the depth is shallow as happens near a beach, waves become skewed. Similarly, a measurement of skewness in the projected matter distribution directly measures the total matter content of the universe. While skewness has already been convincingly detected, its constraint on cosmology is still weak. We address optimal analyses for the CFHT Legacy Survey in the presence of noise. We show that a compensated Gaussian filter with a width of 2.5 arc minutes optimizes the cosmological constraint, yielding $\Delta \Omega_m/\Omega_m\sim 10%$. This is significantly better than other filters which have been considered in the literature. This can be further improved with tomography and other sophisticated analyses.

We examine the global structure of scalar field critical collapse spacetimes using a characteristic double-null code. It can integrate past the horizon without any coordinate problems, due to the careful choice of constraint equations used in the evolution. The limiting sequence of sub- and supercritical spacetimes presents an apparent paradox in the expected Penrose diagrams, which we address in this paper. We argue that the limiting spacetime converges pointwise to a unique limit for all r>0, but not uniformly. The r=0 line is different in the two limits. We interpret that the two different Penrose diagrams differ by a discontinuous gauge transformation. We conclude that the limiting spacetime possesses a singular event, with a future removable naked singularity.

We present a scenario for non-radiative accretion onto the supermassive black hole at the galactic center. Conducting MHD simulations with 1400^3 grid zones that break the axial and reflection symmetries of earlier investigations and extend inward from the Bondi radius, we find a quasi-hydrostatic radial density profile rho propto r^{-0.72} with superadiabatic gradient corresponding to an n~0.72 polytrope. Buoyancy generated by magnetic dissipation is resisted by the same fields so effectively that energy is advected inward: a state of magnetically-frustrated convection. This scenario is consistent with observational constraints on energetics andouter boundary conditions.

We describe a new 512-CPU Beowulf cluster with Teraflop performance dedicated to problems in computational astrophysics. The cluster incorporates a cubic network topology based on inexpensive commodity 24-port gigabit switches and point to point connections through the second gigabit port on each Linux server. This configuration has network performance competitive with more expensive cluster configurations and is scaleable to much larger systems using other network topologies. Networking represents only about 9% of our total system cost of USD$561K. The standard Top 500 HPL Linpack benchmark rating is 1.202 Teraflops on 512 CPUs so computing costs by this measure are $0.47/Megaflop. We also describe 4 different astrophysical applications using complex parallel algorithms for studying large-scale structure formation, galaxy dynamics, magnetohydrodynamic flows onto blackholes and planet formation currently running on the cluster and achieving high parallel performance. The MHD code achieved a sustained speed of 2.2 teraflops in single precision or 44% of the theoretical peak.

We describe a numerical method to solve the magnetohydrodynamic (MHD) equations. The fluid variables are updated along each direction using the flux conservative, 2nd order, total variation diminishing (TVD), upwind scheme of Jin and Xin. The magnetic field is updated separately in two-dimensional advection-constraint steps. The electromotive force (EMF) is computed in the advection step using the TVD scheme, and this same EMF is used immediately in the constraint step in order to preserve \grad.B=0 without the need to store intermediate fluxes. Operator splitting is used to extend the code to three dimensions, and Runge-Kutta is used to get second order accuracy in time. The advantages of this code are high resolution per grid cell, second order accuracy in space and time, enforcement of the \grad.B=0 constraint to machine precision, no memory overhead, speed, and simplicity. A 3-D Fortran implementation less than 400 lines long is made freely available. We also implemented a fully scalable message-passing parallel MPI version. We present tests of the code on MHD waves and shocks.

We present a new algorithm to rapidly and optimally compute power spectra. This new algorithm is based on a generalization of iterative multigrid, and has computational cost O(N log N), compared to the standard brute force approach which costs O(N^3). The procedure retains this speed on the full sky and for ill-conditioned matrices. It is applicable to galaxy power spectra, CMB, polarization and weak lensing data. We present a mathematical convergence analysis, and performance results.

Weak gravitational lensing provides a direct statistical measure of the dark matter distribution. The variance is easiest to measure, which constrains the degenerate product \sigma_8\Omega^0.6. The degeneracy is broken by measuring the skewness arising from the fact that densities must remain positive, which is not possible when the initially symmetric perturbations become non-linear. Skewness measures the non-linear mass scale, which in combination with the variance measures \Omega directly. We present the first detection of dark matter skewness from the Virmos-Decart survey. We have measured the full three point function, and its projections onto windowed skewness. We separate the lensing mode and the B mode. The lensing skewness is detected for a compensated Gaussian on scales of 5.37 arc minutes to be \kappa^3=1.06+/-0.06x10^-6. The B-modes are consistent with zero at this scale. The variance for the same window function is \kappa^2= 5.32+/-0.62+/-0.98x10^-5, resulting in S_3=375^{+342}_{-124}. Comparing to N-body simulations, we find \Omega_0<0.5 at 90% confidence. The Canada-France-Hawaii-Telescope legacy survey and newer simulations should be able to improve significantly on the constraint.

We report on the cosmological parameters derived from observations with the Cosmic Background Imager (CBI), covering 40 square degrees and the multipole range 300 < l < 3500. The angular scales probed by the CBI correspond to structures which cover the mass range from 10^14 to 10^17 M_sun, and the observations reveal, for the first time, the seeds that gave rise to clusters of galaxies. These unique, high-resolution observations also show damping in the power spectrum to l ~ 2000, which we interpret as due to the finite width of the photon-baryon decoupling region and the viscosity operating at decoupling. Because the observations extend to much higher l the CBI results provide information complementary to that probed by the Boomerang, DASI, Maxima, and VSA experiments. As the observations are pushed to higher multipoles no anomalies relative to standard models appear, and extremely good consistency is found between the cosmological parameters derived for the CBI observations over the range 610 < l < 2000 and observations at lower l [abridged].

We report measurements of anisotropy in the cosmic microwave background radiation over the multipole range l ~ 200 - 3500 with the Cosmic Background Imager based on deep observations of three fields. These results confirm the drop in power with increasing l first reported in earlier measurements with this instrument, and extend the observations of this decline in power out to l \~ 2000. The decline in power is consistent with the predicted damping of primary anisotropies. At larger multipoles, l = 2000 - 3500, the power is 3.1 sigma greater than standard models for intrinsic microwave background anisotropy in this multipole range, and 3.5 sigma greater than zero. This excess power is not consistent with expected levels of residual radio source contamination but, for sigma_8 >~ 1, is consistent with predicted levels due to a secondary Sunyaev-Zeldovich anisotropy. Further observations are necessary to confirm the level of this excess and, if confirmed, determine its origin.

Using the Cosmic Background Imager, a 13-element interferometer array operating in the 26-36 GHz frequency band, we have observed 40 sq deg of sky in three pairs of fields, each ~ 145 x 165 arcmin, using overlapping pointings (mosaicing). We present images and power spectra of the cosmic microwave background radiation in these mosaic fields. We remove ground radiation and other low-level contaminating signals by differencing matched observations of the fields in each pair. The primary foreground contamination is due to point sources (radio galaxies and quasars). We have subtracted the strongest sources from the data using higher-resolution measurements, and we have projected out the response to other sources of known position in the power-spectrum analysis. The images show features on scales ~ 6 - 15 arcmin, corresponding to masses ~ (5 - 80)*10^{14} Msun at the surface of last scattering, which are likely to be the seeds of clusters of galaxies. The power spectrum estimates have a resolution Delta-l = 200 and are consistent with earlier results in the multipole range l <~ 1000. The power spectrum is detected with high signal-to-noise ratio in the range 300 <~ l <~ 1700. For 1700 <~ l <~ 3000 the observations are consistent with the results from more sensitive CBI deep-field observations. The results agree with the extrapolation of cosmological models fitted to observations at lower l, and show the predicted drop at high l (the "damping tail").

We explore the intergalactic medium (IGM) as a potential source of the unresolved soft X-ray background (XRB) and the feasibility to extract the IGM state and evolution from XRB observations. We build two analytical models, the continuum field model and the halo model, to calculate the IGM XRB mean flux, angular auto correlation and cross correlation with galaxies. Our results suggest that the IGM may contribute a significant fraction to the unresolved soft XRB flux and correlations. We calibrated non-Gaussian errors estimated against our $512^3$ moving mesh hydro simulation and estimate that the ROSAT all sky survey plus Sloan galaxy photometric redshift survey would allow a $\sim 10%$ accuracy in the IGM XRB-galaxy cross correlation power spectrum measurement for $800<l<5000$ and a $\sim 20%$ accuracy in the redshift resolved X-ray emissivity-galaxy cross correlation power spectrum measurement for $z\lesssim 0.5$. At small scales, non-gravitational heating, e.g. feedback, dominates over gravity and leaves unique signatures in the IGM XRB, which allows a comparable accuracy in the measurement of the amount of non-gravitational heating and the length scales where non-gravitational energy balances gravity.

We present a pedagogical review of some of the methods employed in Eulerian computational fluid dynamics (CFD). Fluid mechanics is governed by the Euler equations, which are conservation laws for mass, momentum, and energy. The standard approach to Eulerian CFD is to divide space into finite volumes or cells and store the cell-averaged values of conserved hydro quantities. The integral Euler equations are then solved by computing the flux of the mass, momentum, and energy across cell boundaries. We review both first-order and second-order flux assignment schemes. All linear schemes are either dispersive or diffusive. The nonlinear, second-order accurate total variation diminishing (TVD) approach provides high resolution capturing of shocks and prevents unphysical oscillations. We review the relaxing TVD scheme, a simple and robust method to solve systems of conservation laws like the Euler equations. A 3-D relaxing TVD code is applied to the Sedov-Taylor blast wave test. The propagation of the blast wave is accurately captured and the shock front is sharply resolved. We apply a 3-D self-gravitating hydro code to simulating the formation of blue straggler stars through stellar mergers and present some numerical results. A sample 3-D relaxing TVD code is provided in the appendix.

We present a survey of the cosmological applications of the next generation of weak lensing surveys, paying special attention to the computational challenges presented by the number of galaxies, $N_{gal} ~$ 10$^{5}$. We focus on optimal methods with no pixelization and derive a multigrid $P^3M$ algorithm that performs the relevant computations in $O(N_{gal} \log N_{gal})$ time. We test the algorithm by studying three applications of weak lensing surveys - convergence map reconstruction, cluster detection and $E$ and $B$ power spectrum estimation using realistic 1 deg^{2} simulations derived from N-body simulations. The map reconstruction is able to reconstruct large scale features without artifacts. Detecting clusters using only weak lensing is difficult because of line of sight contamination and noise, with low completeness if one desires low contamination of the sample. A power spectrum analysis of the convergence field is more promising and we are able to reconstruct the convergence spectrum with no loss of information down to the smallest scales. The numerical methods used here can be applied to other data sets with same $O(N\log N)$ scaling and can be generalised to a sphere.

We review the recently published results from the CBI's first season of observations. Angular power spectra of the CMB were obtained from deep integrations of 3 single fields covering a total of 3 deg^2 and 3 shallower surveys of overlapping (mosaiced) fields covering a total of 40 deg^2. The observations show a damping of the anisotropies at high-l as expected from the standard scenarios of recombination. We present parameter estimates obtained from the data and discuss the significance of an excess at l>2000 observed in the deep fields.

We present a new approach to doing Eulerian computational fluid dynamics that is designed to work at high Mach numbers encountered in hydrodynamical simulations of the IGM. In conventional Eulerian CFD, the thermal energy is poorly tracked in supersonic bulk flows where local fluid variables cannot be accurately separated from the much larger bulk flow components. We described a method in which local fluid quantities can be directly tracked and the Eulerian fluid equations solved in a local frame moving with the flow. The new algorithm has been used to run large hydrodynamical simulations on a 1024^3 grid to study the kinetic SZ effect. The KSZ power spectrum is broadly peaked at l~10^4 with temperature fluctuations on micro Kelvin levels.

Boomerang, Maxima, DASI, CBI and VSA significantly increase the case for accelerated expansion in the early universe (the inflationary paradigm) and at the current epoch (dark energy dominance), especially when combined with data on high redshift supernovae (SN1) and large scale structure (LSS). There are ``7 pillars of Inflation'' that can be shown with the CMB probe, and at least 5, and possibly 6, of these have already been demonstrated in the CMB data: (1) a large scale gravitational potential; (2) acoustic peaks/dips; (3) damping due to shear viscosity; (4) a Gaussian (maximally random) distribution; (5) secondary anisotropies; (6) polarization. A 7th pillar, anisotropies induced by gravity wave quantum noise, could be too small. A minimal inflation parameter set, \omega_b,\omega_{cdm}, \Omega_{tot}, \Omega_Q,w_Q,n_s,\tau_C, \sigma_8}, is used to illustrate the power of the current data. We find the CMB+LSS+SN1 data give \Omega_{tot} =1.00^{+.07}_{-.03}, consistent with (non-baroque) inflation theory. Restricting to \Omega_{tot}=1, we find a nearly scale invariant spectrum, n_s =0.97^{+.08}_{-.05}. The CDM density, \Omega_{cdm}{\rm h}^2 =.12^{+.01}_{-.01}, and baryon density, \Omega_b {\rm h}^2 = >.022^{+.003}_{-.002}, are in the expected range. (The Big Bang nucleosynthesis estimate is 0.019\pm 0.002.) Substantial dark (unclustered) energy is inferred, \Omega_Q \approx 0.68 \pm 0.05, and CMB+LSS \Omega_Q values are compatible with the independent SN1 estimates. The dark energy equation of state, crudely parameterized by a quintessence-field pressure-to-density ratio w_Q, is not well determined by CMB+LSS (w_Q < -0.4 at 95% CL), but when combined with SN1 the resulting w_Q < -0.7 limit is quite consistent with the w_Q=-1 cosmological constant case.

We derive cosmological parameters from the CBI measurements of the Cosmic Microwave Background (CMB) angular power spectrum. Our results provide an independent confirmation of the standard $\Omega_{\rm tot}=1$ $\Lambda$CDM model within the adiabatic, inflationary paradigm. Above $\ell=2000$ the observations show evidence of power in excess of that expected in the standard models. We use hydrodynamical simulations to show how Sunyaev-Zeldovich Effect (SZE) may account for the excess power for models with fluctuation amplitude $\sigma_8\sim 1$ which is in the high end of the range allowed by the primary CMB observations.

We present a data set of images of the gravitationally lensed quasar Q2237+0305, that was obtained at the Apache Point Observatory (APO) between June 1995 and January 1998. Although the images were taken under variable, often poor seeing conditions and with coarse pixel sampling, photometry is possible for the two brighter quasar images A and B with the help of exact quasar image positions from HST observations. We obtain a light curve with 73 data points for each of the images A and B. There is evidence for a long (>~ 100 day) brightness peak in image A in 1996 with an amplitude of about 0.4 to 0.5 mag (relative to 1995), which indicates that microlensing has been taking place in the lensing galaxy. Image B does not vary much over the course of the observation period. The long, smooth variation of the light curve is similar to the results from the OGLE monitoring of the system (Wozniak et al. 2000a).

We describe an algorithm for the extraction of the angular power spectrum of an intensity field, such as the cosmic microwave background (CMB), from interferometer data. This new method, based on the gridding of interferometer visibilities in the aperture plane followed by a maximum likelihood solution for bandpowers, is much faster than direct likelihood analysis of the visibilities, and deals with foreground radio sources, multiple pointings, and differencing. The gridded aperture-plane estimators are also used to construct Wiener-filtered images using the signal and noise covariance matrices used in the likelihood analysis. Results are shown for simulated data. The method has been used to determine the power spectrum of the cosmic microwave background from observations with the Cosmic Background Imager, and the results are given in companion papers.

The Sunyaev Zel'dovich effect (SZ effect) is a complete probe of ionized baryons, the majority of which are likely hiding in the intergalactic medium. We ran a $512^3$ $\Lambda$CDM simulation using a moving mesh hydro code to compute the statistics of the thermal and kinetic SZ effect such as the power spectra and measures of non-Gaussianity. The thermal SZ power spectrum has a very broad peak at multipole $l\sim 2000-10^4$ with temperature fluctuations $\Delta T \sim 15\mu$K. The power spectrum is consistent with available observations and suggests a high $\sigma_8\simeq 1.0$ and a possible role of non-gravitational heating. The non-Gaussianity is significant and increases the cosmic variance of the power spectrum by a factor of $\sim 5$ for $l<6000$. We explore optimal driftscan survey strategies for the AMIBA CMB interferometer and their dependence on cosmology. For SZ power spectrum estimation, we find that the optimal sky coverage for a 1000 hours of integration time is several hundred square degrees. One achieves an accuracy better than 40% in the SZ measurement of power spectrum and an accuracy better than 20% in the cross correlation with Sloan galaxies for $2000<l<5000$. For cluster searches, the optimal scan rate is around 280 hours per square degree with a cluster detection rate 1 every 7 hours, allowing for a false positive rate of 20% and better than 30% accuracy in the cluster SZ distribution function measurement.

We present a maximum likelihood analysis of cosmological parameters from measurements of the aperture mass up to 35 arcmin, using simulated and real cosmic shear data. A four-dimensional parameter space is explored which examines the mean density \Omega_M, the mass power spectrum normalization \sigma_8, the shape parameter \Gamma and the redshift of the sources z_s. Constraints on \Omega_M and \sigma_8 (resp. \Gamma and z_s) are then given by marginalizing over \Gamma and z_s (resp. \Omega_M and \sigma_8). For a flat LCDM cosmologies, using a photometric redshift prior for the sources and \Gamma \in [0.1,0.4], we find \sigma_8=(0.57\pm0.04) \Omega_M^{(0.24\mp 0.18) \Omega_M-0.49} at the 68% confidence level (the error budget includes statistical noise, full cosmic variance and residual systematic). The estimate of \Gamma, marginalized over \Omega_M \in [0.1,0.4], \sigma_8 \in [0.7,1.3] and z_s constrained by photometric redshifts, gives \Gamma=0.25\pm 0.13 at 68% confidence. Adopting h=0.7, a flat universe, \Gamma=0.2 and \Omega_m=0.3 we find \sigma_8=0.98 \pm0.06 . Combined with CMB, our results suggest a non-zero cosmological constant and provide tight constraints on \Omega_M and \sigma_8. We finaly compare our results to the cluster abundance ones, and discuss the possible discrepancy with the latest determinations of the cluster method. In particular we point out the actual limitations of the mass power spectrum prediction in the non-linear regime, and the importance for its improvement.

X-ray and Sunyaev-Zeldovich effect observations can be combined to measure the distance to clusters of galaxies. If the intracluster gas distribution is not spherical, but elongated by a factor of Z along the line of sight, the inferred distance is increased by Z, and H0 is decreased by the same factor. Averaging the inferred value of H0 over a sufficiently large sample of clusters can reduce any systematic bias due to cluster shapes, provided the clusters are selected without any preferred orientation. Even so, elongation contributes significantly to the variance in the measured distances and in the inferred value of H0. With the addition of gravitational lensing observations, it is possible to infer the three-dimensional shape of clusters, provided the gas is in hydrostatic equilibrium. We demonstrate a specific method for finding the shape and correcting the measured distances to individual clusters. To test this method, we apply it to artificial observations of simple model clusters. We recover the true distances to each of our clusters without detectable bias, and with statistical errors due to measurement uncertainties of 4 to 6%.

We report the first direct observational evidence for alignment of galaxy spin axes with the local tidal shear field. We measure quantitatively the strength of this directional correlation of disk galaxies from the Tully catalog with the local shear field reconstructed from PSCz galaxies. We demonstrate that the null hypothesis of random galaxy alignments relative to the shear frame can be ruled out more than 99.98 % confidence. The observed intrinsic correlation averaged over the censored samples that have detected non-zero signals is measured in terms of the alignment parameter 'a=0.17 +/- 0.04', which includes only statistical errors of the censored data, but not the cosmic variance error. The reconstruction procedure is likely to underestimates 'a' systematically. Our result is consistent with the linear tidal torque model, and supports the idea that the present galaxy spins may be used as a probe of primordial tidal shear and mass density fields. The intrinsic alignments of galaxy spins dominate over weak gravitational lensing for shallow surveys such like SDSS, while it should be negligible for deeper surveys at z ~ 1.

About 90% of baryons in the universe have thus far escaped direct observation. This is known as the {\it missing baryon problem}. The Sunyaev Zel'dovich effect (SZ effect) has the potential to directly measure the state of the majority of these missing baryons. The next generation CMB experiments such as AMIBA will provide an unbiased sample of the intergalactic medium through the SZ effect. The existing and upcoming simulations and analytical studies provide a quantitative understanding of the SZ effect. All these make the SZ effect a powerful baryon probe. We present an overview of this probe from both phenomelogical and theoretical aspects.

We analyze the weak lensing data of the VIRMOS imaging survey using projections (called E and B-modes) of the two independents observed correlation functions. The E-mode contains all the lensing signal, while noise and systematics contribute equally to the E and B modes provided that intrinsic alignment is negligible. The mode separation allows a measurement of the signal with a \sqrt{2} smaller error bars, and a separate channel to test for systematic errors. We apply various transformations, including a spherical harmonic space power spectrum C^E_l and C^B_l, which provides a direct measurement of the projected dark matter distribution for 500<l<10^4.

We present a theoretical study of galaxy spin correlation statistics, with detailed technical derivations. We also find an expression for the spin-density cross-correlation, and apply that to the Tully galaxy catalog. The observational results appear qualitatively consistent with the theoretical predictions, yet the error bars are still large. However, we expect that currently ongoing large surveys such as the Sloan Digital Sky survey (SDSS) will enable us to make a precision measurement of these correlation statistics in the near future. These intrinsic galaxy alignments are expected to dominate over the weak lensing signal in SDSS, and we present the detailed algorithms for the density reconstruction for this case. These observables are tracers of the galaxy-gravity interaction, which may provide us deeper insights into the galaxy formation and large scale matter distribution as well.

Alignments in the angular momentum vectors of galaxies can induce large scale correlations in their projected orientations. Such alignments arise from the tidal torques exerted on neighboring proto-galaxies by the smoothly varying shear field. Weak gravitational lensing can also induce ellipticity correlations since the images of neighboring galaxies will be distorted coherently by the intervening mass distribution. Comparing these two sources of shape correlations, it is found that for current weak lensing surveys with a median redshift of 1, the intrinsic signal is a contaminant on the order of 1-10% of the measured signal. However, for shallower surveys, the intrinsic correlations dominate over the lensing signal. The distortions induced by lensing are curl-free, whereas those resulting from intrinsic alignments are not. This difference can be used to disentangle these two sources of ellipticity correlations. When the distortions are dominated by lensing, as occurs at high redshifts, the decomposition provides a valuable tool for understanding properties of the noise and systematic errors.

As part of a 4-year Cosmology and Particle Astrophysics (CosPA) Research Excellence Initiative in Taiwan, AMiBA $-$ a 19-element dual-channel 85-105 GHz interferometer array is being specifically built to search for high redshift clusters of galaxies via the Sunyaev-Zeldovich Effect (SZE). In addition, AMiBA will have full polarization capabilities, in order to probe the polarization properties of the Cosmic Microwave Background. AMiBA, to be sited on Mauna Kea in Hawaii or in Chile, will reach a sensitivity of $\sim 1$ mJy or 7$\mu$K in 1 hour. The project involves extensive international scientific and technical collaborations. The construction of AMiBA is scheduled to starting operating in early 2004.

The distortion field defined by the ellipticities of galaxy shapes projected on the sky can be uniquely decomposed into a gradient and a curl component. If the observed ellipticities are induced by weak gravitational lensing, then the distortion field is curl free. Here we show that, in contrast, the distortion field resulting from intrinsic spin alignments is not curl free. This provides a powerful discriminant between lensing and intrinsic contributions to observed ellipticity correlations. We also show how these contributions can be disentangled statistically from the ellipticity correlations or computed locally from circular integrals of the ellipticity field. This allows for an unambiguous detection of intrinsic galaxy alignments in the data. When the distortions are dominated by lensing, as occurs at high redshifts, the decomposition provides a valuable tool for understanding properties of the noise and systematic errors. These techniques can be applied equally well to the polarization of the microwave background, where it can be used to separate curl-free scalar perturbations from those produced by gravity waves or defects.

The SZ effect from clusters of galaxies is a dominant source of secondary CMB anisotropy in the low-redshift universe. We present analytic predictions for the CMB power spectrum from massive halos arising from the SZ effect. Since halos are discrete, the power spectrum consists of a Poisson and a correlation term. The latter is always smaller than the former, which is dominated by nearby bright rich clusters. In practice however, those bright clusters are easy to indentify and can thus be subtracted from the map. After this subtraction, the correlation term dominates degree-scale fluctuations over the Poisson term, as the main contribution to the correlation term comes from distant clusters. We find that the correlation term is detectable by Planck experiment. Since the degree scale spectrum is quite insensitive to the highly uncertain core structures of halos, our predictions are robust on these scales. Measuring the correlation term on degree scales thus cleanly probes the clustering of distant halos. This has not been measured yet, mainly because optical and X-ray surveys are not sufficiently sensitive to include such distant clusters and groups. Our analytic predictions are also compared to adiabatic hydrodynamic simulations. The agreement is remarkably good, down to ten arcminutes scales, indicating that our predictions are robust for the Planck experiment. Below ten arcminute scales, where the details of the core structure dominates the power spectrum, our analytic and simulated predictions might fail. In the near future, interferometer and bolometer array experiments will measure the SZ power spectrum down to arcminutes scales, and yield new insight into the physics of the intrahalo medium.

We apply the hierarchical clustering model and non-linear perturbation theory to the cosmological density and temperature fields. This allows us to calculate the intergalactic gas pressure power spectrum, SZ anisotropy power spectrum, skewness and related statistics. Then we show the effect of the non-gravitational heating. Our model confirms recent simulations yielding mass weighted gas temperature \bar{T}_g \sim 0.35 keV and reproduces the power spectra found in these simulations. While the SZ effect contains only angular information, we show that it is possible to extract the full time resolved gas pressure power spectrum when combined with galaxy photometric redshift surveys by using a variation on the cross-correlation. This method further allows the disentanglement of the gravitational and the non-gravitational heating.

We report a tentative detection of spin correlations in the Tully catalogue of nearby galaxies. We define a simple but nontrivial spin correlation function, and find an analytic estimate of it in the frame of the linear perturbation theory. Then, we present the observed spin correlation signal from the Tully galaxies with error bars. The three dimensional spin correlation turns out to be significant at the 97% confidence level, detected out to a few $h^{-1}$ Mpc. This observed correlation is consistent with the theoretical prediction based on the gravitational instability picture of galaxy formation. An analysis of systematic errors is also presented. The observed strength of correlation may be sufficient to significantly affect blank field of weak lensing searches.

We investigate strong lensing of galaxies in the Hubble Deep Field by foreground groups and clusters of galaxies with masses from $10^{13}$ to $10^{15} \MSun$. Over this mass range, groups with the profile of Navarro, Frenk, & White (1995) are less efficient than singular isothermal spheres at producing multiple images of galaxies, by factors of $5 \times 10^{- 2}$ to $10^{- 3}$. This difference highlights the sensitivity of the lensing cross section to the central density profile. Nonetheless, with either profile we find that the expected number of galaxies lensed by groups in the Hubble Deep Field is at most $\lesssim 1$, consistent with the lack of clearly identified group lens systems.

Large scale correlations in the orientations of galaxies can result from alignments in their angular momentum vectors. These alignments arise from the tidal torques exerted on neighboring proto-galaxies by the smoothly varying shear field. We compute the predicted amplitude of such ellipticity correlations using the Zel'dovich approximation for a realistic distribution of galaxy shapes. Weak gravitational lensing can also induce ellipticity correlations since the images of neighboring galaxies will be distorted coherently. On comparing these two effects that induce shape correlations, we find that for current weak lensing surveys with a median redshift of z_m = 1, the intrinsic signal is of order 1 - 10 percent of the measured signal. However, for shallower surveys with z_m < 0.3, the intrinsic correlations dominate over the lensing signal. The distortions induced by lensing are curl-free, whereas those resulting from intrinsic alignments are not. This difference can be used to disentangle these two sources of ellipticity correlations.

(Abridged) The hot gas in the IGM produces anisotropies in the Cosmic Microwave Background (CMB) through the thermal Sunyaev-Zel'dovich (SZ) effect. The SZ effect is a powerful probe of large-scale structure in the universe and must be carefully subtracted from measurements of the primary CMB anisotropies. We use moving-mesh hydrodynamical simulations to study the 3-dimensional statistics of the gas, and compute the mean comptonization parameter and the angular power spectrum of the SZ fluctuations, for different cosmologies. We compare these results with predictions using the Press-Schechter formalism. We find that the two methods agree approximately, but differ in details. We discuss this discrepancy, and show that resolution limits the reliability of our results to the 200<l<2000 range. For cluster- normalized CDM models, the SZ power spectrum is comparable to the primordial power spectrum around l=2000. We show that groups and filaments (kT<5 keV) contribute about 50% of the SZ power spectrum at l=500. About half of the SZ power spectrum on these scales is produced at redshifts z<0.1, and can thus be detected and removed using existing catalogs of galaxies and X-ray clusters. We discuss the implications of these results for the future MAP and Planck Surveyor missions.

We present a general linear algorithm for measuring the surface mass density 1-\kappa from the observable reduced shear g=\gamma/(1-\kappa) in the strong lensing regime. We show that in general, the observed polarization field can be decomposed into ``electric'' and ``magnetic'' components, which have independent and redundant solutions, but perfectly orthogonal noise properties. By combining these solutions, one can increase the signal-to-noise ratio by \sqrt{2}. The solutions allow dynamic optimization of signal and noise, both in real and Fourier space (using arbitrary smoothing windows). Boundary conditions have no effect on the reconstructions, apart from its effect on the signal-to-noise. Many existing reconstruction techniques are recovered as special cases of this framework. The magnetic solution has the added benefit of yielding the global and local parity of the reconstruction in a single step.

We discuss the origin of galactic angular momentum, and the statistics of the present day spin distribution. It is expected that the galaxy spin axes are correlated with the intermediate principal axis of the gravitational shear tensor. This allows one to reconstruct the shear field and thereby the full gravitational potential from the observed galaxy spin fields. We use the direction of the angular momentum vector without any information of its magnitude, which requires a measurement of the position angle and inclination on the sky of each disk galaxy. We present the maximum likelihood shear inversion procedure, which involves a constrained linear minimization. The theory is tested against numerical simulations. We find the correlation strength of nonlinear structures with the initial shear field, and show that accurate large scale density reconstructions are possible at the expected noise level.

We use moving mesh hydrodynamical simulations to make maps of Sunyaev-Zeldovich effect. We present these maps for several cosmological models and explore their lowest moments. We find that the first moment, the mean Compton $y$ parameter, is typically between $1-2\times 10^{-6}$ for cluster abundance normalized models, the lower value corresponding to the high density models, and scales as $\sigma_8^{3-4}$. Rms fluctuations at 10' scale have an amplitude $ \Delta T/T \sim 1-3 \times 10^{-6}$ in the Rayleigh-Jeans regime. The amplitude of the power spectrum strongly depends on the power spectrum normalization and scales as $\sigma_8^{6-9}$. On smaller scales ($l>1000$) the spectrum is dominated by halos below $10^{13}M_{\sun}$ and so is sensitive to the thermal history of galactic halo gas. On larger scales ($l<1000$) the power spectrum is less sensitive to nongravitational energy injection, but becomes very noisy, with large field to field variations in the power spectrum caused by rare bright sources in the maps, which dominate in the spectrum over the large scale structure correlations. Cross-correlation power spectrum with weak lensing or projected galaxy distribution is significant and the cross-correlation coefficient is around 0.5 over a wide range of scales. Comparison with Press-Schechter predictions gives very good agreement for all the statistics, indicating that there is no significant contribution to SZ from non-virialized structures. The one point distribution function shows clear deviations from gaussianity and can be well-approximated as log-normal on small scales.

We have simulated the formation of an X-ray cluster in a cold dark matter universe using 12 different codes. The codes span the range of numerical techniques and implementations currently in use, including SPH and grid methods with fixed, deformable or multilevel meshes. The goal of this comparison is to assess the reliability of cosmological gas dynamical simulations of clusters in the simplest astrophysically relevant case, that in which the gas is assumed to be non-radiative. We compare images of the cluster at different epochs, global properties such as mass, temperature and X-ray luminosity, and radial profiles of various dynamical and thermodynamical quantities. On the whole, the agreement among the various simulations is gratifying although a number of discrepancies exist. Agreement is best for properties of the dark matter and worst for the total X-ray luminosity. Even in this case, simulations that adequately resolve the core radius of the gas distribution predict total X-ray luminosities that agree to within a factor of two. Other quantities are reproduced to much higher accuracy. For example, the temperature and gas mass fraction within the virial radius agree to about 10%, and the ratio of specific kinetic to thermal energies of the gas agree to about 5%. Various factors contribute to the spread in calculated cluster properties, including differences in the internal timing of the simulations. Based on the overall consistency of results, we discuss a number of general properties of the cluster we have modelled.

We present a fitting formula for the luminosity and angular diameter distances in cosmological models with pressureless matter, a cosmological constant and zero spatial curvature. The formula has a relative error of less than 0.4% for 0.2<\Omega_0<1 for any redshift, and a global relative error of less than 4% for any choice of parameters.

I discuss approaches to optimally remove noise from images. A generalization of Wiener filtering to Non-Gaussian distributions and wavelets is described, as well as an approach to measure the errors in the reconstructed images. We argue that the wavelet basis is highly advantageous over either Fourier or real space analysis if the data is intermittent in nature, i.e. if the filling factor of objects is small.

Recent indications of a neutrino mass raise the possibility that the dark matter may be hot, which would be a severe challenge for structure formation theory. We argue that generic defect theories fare very well in hot dark matter cosmologies, and also work in the presence of curvature or a cosmological constant. If this model is correct, then the MAP and PLANCK missions will not measure what people expect them to (oscillations); rather, they will measure a broad hump.

Using the cosmic virial theorem, Press-Schechter analysis and numerical simulations, we compute the expected X-ray background (XRB) from the diffuse IGM with the clumping factor expected from gravitational shock heating. The predicted fluxes and temperatures are excluded from the observed XRB. The predicted clumping can be reduced by entropy injection. The required energy is computed from the two-point correlation function, as well as from Press-Schechter formalisms. The minimal energy injection of 1 keV/nucleon excludes radiative or gravitational heating as a primary energy source. We argue that the intergalactic medium (IGM) must have been heated through violent processes such as massive supernova bursts. If the heating proceeded through supernova explosions, it likely proceeded in bursts which may be observable in high redshift supernova searches. Within our model we reproduce the observed cluster luminosity-temperature relation with energy injection of 1 keV/nucleon if this injection is assumed to be uncorrelated with the local density. These parameters predict that the diffuse IGM soft XRB has a temperature of ~1 keV with a flux near 10 keV/cm^2 s str keV, which may be detectable in the near future.

As the largest gravitationally bound objects in the universe, clusters of galaxies may contain a fair sample of the baryonic mass fraction of the universe. Since the gas mass fraction from the hot ICM is believed to be constant in time, the value of the cosmological deceleration parameter $q_0$ can be determined by comparing the calculated gas mass fraction in nearby and distant clusters (Pen 1997). To test the potential of this method, we compare the gas fractions derived for a sample of luminous ($L_X > 10^{45} $erg s$^{-1}$), nearby clusters with those calculated for eight luminous, distant ($0.3 < z < 0.6$) clusters using ASCA and ROSAT observations. For consistency, we evaluate the gas mass fraction at a fixed physical radius of 1 $h_{50}^{-1}$ Mpc (assuming $q_0=0.0$). We find a best fit value of $q_0 = 0.07$ with -0.47 < q_0 < 0.67 at 95% confidence. We also determine the gas fraction using the method of Evrard, Metzler, & Navarro (1997) to find the total mass within $r_{500}$, the radius where the mean overdensity of matter is 500 times the critical density. In simulations, this method reduces the scatter in the determination of gravitational mass without biasing the mean. We find that it also reduces the scatter in actual observations for nearby clusters, but not as much as simulations suggest. Using this method, the best fit value is $q_0 = 0.04$ with -0.50 < q_0 < 0.64. The excellent agreement between these two methods suggests that this may be a useful technique for determining $q_0$. The constraints on $q_0$ should improve as more distant clusters are studied and precise temperature profiles are measured to large radii.

Defect models have recently been declared dead (Watson 1997), because they predict microwave background and matter fluctuations grossly out of line with what we see. In this talk we apply the fact that many defects are automatically destroyed at the time of radiation-matter transition, thus resurrecting the defects model. Moreover, the resurrected version predicts a cosmological constant, explains the apparent excess of hot clusters and the non-Gaussianity observed in galaxy surveys. If this model is correct, then the MAP and PLANCK missions will not measure what people expect them to (oscillations); rather, they will measure a broad hump.

We apply a unique gas fraction estimator to published X-ray cluster properties and we compare the derived gas fractions of observed clusters to simulated ones. The observations are consistent with a universal gas fraction of 0.15+/-0.01h_{50}^{-3/2} for the low redshift clusters that meet our selection criteria. The fair sampling hypothesis states that all clusters should have a universal constant gas fraction for all times. Consequently, any apparent evolution would most likely be explained by an incorrect assumption for the angular-diameter distance relation. We show that the high redshift cluster data is consistent with this hypothesis for \Omega_0<0.63 (95% formal confidence, flat $\Lambda$ model) or \Omega_0<0.60 (95% formal confidence, hyperbolic open model). The maximum likelihood occurs at \Omega_0=0.2 for a spatially flat cosmological constant model.

The standard unbroken electroweak theory is known to erase baryon number. The baryon number symmetry can be restored in the core of a neutron star as its density diverges via gravitational instability due to a binary merger event. We argue that for certain double Higgs models with discrete symmetries, this process may result in an expanding self-sustained burning front which would convert the entire neutron matter into radiation. This process would release ~10^{54} ergs in electromagnetic radiation over ~10^{-4} sec, with negligible baryonic contamination. The resulting fireball would have all the properties necessary to produce a gamma-ray burst as a result of its interaction with ambient interstellar gas. The subsequent Higgs decay would produce a millisecond burst of ~10^{52} ergs in ~100 GeV neutrinos which might be observable. The above mechanism may have also caused electroweak baryogenesis in the early universe, giving rise to the observed matter-antimatter asymmetry today.

We re-examine the constraints which can be robustly obtained from the observed temperature function of X-ray cluster of galaxies. The cluster mass function has been thoroughly studied in simulations and analytically, but a direct simulation of the temperature function is presented here for the first time. Adaptive hydrodynamic simulations using the cosmological Moving Mesh Hydro code of Pen (1997a) are used to calibrate the temperature function for different popular cosmologies. Applying the new normalizations to the present-day cluster abundances, we find $\sigma_8=0.53\pm 0.05 \Omega_0^{-0.45}$ for a hyperbolic universe, and $\sigma_8=0.53\pm 0.05 \Omega_0^{-0.53}$ for a spatially flat universe with a cosmological constant. The simulations followed the gravitational shock heating of the gas and dark matter, and used a crude model for potential energy injection by supernova heating. The error bars are dominated by uncertainties in the heating/cooling models. We present fitting formulae for the mass-temperature conversions and cluster abundances based on these simulations.

We propose a strategy to measure the dark matter power spectrum using minimal assumptions about the galaxy distribution and the galaxy-dark matter cross-correlations. We argue that on large scales the central limit theorem generically assures Gaussianity of each smoothed density field, but not coherence. Asymptotically, the only surviving parameters on a given scale are galaxy variance $\sigma$, bias $b=\Omega^{.6}/\beta$ and the galaxy-dark matter correlation coefficient $r$. These can all be determined by measuring the quadrupole and octupole velocity distortions in the power spectrum. Measuring them simultaneously may restore consistency between all $\beta$ determinations independent of galaxy type. The leading deviations from Gaussianity are conveniently parameterized by an Edgeworth expansion. In the mildly non-linear regime, two additional parameters describe the full picture: the skewness parameter $s$ and non-linear bias $b_2$. They can both be determined from the measured skewness combined with second order perturbation theory or from an N-body simulation. By measuring the redshift distortion of the skewness, one can measure the density parameter $\Omega$ with minimal assumptions about the galaxy formation process. This formalism also provides a convenient parametrization to quantify statistical galaxy formation properties.

We present a generic algorithm for generating Gaussian random initial conditions for cosmological simulations on periodic rectangular lattices. We show that imposing periodic boundary conditions on the real-space correlator and choosing initial conditions by convolving a white noise random field results in a significantly smaller error than the traditional procedure of using the power spectrum. This convolution picture produces exact correlation functions out to separations of L/2, where L is the box size, which is the maximum theoretically allowed. This method also produces tophat sphere fluctuations which are exact at radii $ R \le L/4 $. It is equivalent to windowing the power spectrum with the simulation volume before discretizing, thus bypassing sparse sampling problems. The mean density perturbation in the volume is no longer constrained to be zero, allowing one to assemble a large simulation using a series of smaller ones. This is especially important for simulations of Lyman-$\alpha$ systems where small boxes with steep power spectra are routinely used. We also present an extension of this procedure which generates exact initial conditions for hierarchical grids at negligible cost.

Recent work has emphasised the importance of vector and tensor contributions to the large scale microwave anisotropy fluctuations produced by cosmic defects. In this paper we provide a general discussion of these contributions, and how their magnitude is constrained by the fundamental assumptions of causality, scaling, and statistical isotropy. We discuss an analytic model which illustrates and explains how the ratios of isotropic and anisotropic scalar, vector and tensor microwave anisotropies are determined. This provides a check of the results from large scale numerical simulations, confirming the numerical finding that vector and tensor modes provide substantial contributions to the large angle anisotropies. This leads to a suppression of the scalar normalisation and consequently of the Doppler peaks.

An algorithm for simulating self-gravitating cosmological astrophysical fluids is presented. The advantages include a large dynamic range, parallelizability, high resolution per grid element and fast execution speed. The code is based on a finite volume flux conservative Total-Variation-Diminishing (TVD) scheme for the shock capturing hydro, and an iterative multigrid solver for the gravity. The grid is a time dependent field, whose motion is described by a generalized potential flow. Approximately constant mass per cell can be obtained, providing all the advantages of a Lagrangian scheme. The grid deformation combined with appropriate limiting and smoothing schemes guarantees a regular and well behaved grid geometry, where nearest neighbor relationships remain constant. The full hydrodynamic fluid equations are implemented in the curvilinear moving grid, allowing for arbitrary fluid flow relative to the grid geometry. This combination retains all the advantages of the grid based schemes including high speed per fluid element and a rapid gravity solver. The current implementation is described, and empirical simulation results are presented. Accurate execution speed calculations are given in terms of floating point operations per time step per grid cell. This code is freely available to the community.

We compute the polarization power spectra for global strings, monopoles, textures and nontopological textures, and compare them to inflationary models. We find that topological defect models predict a significant (1 microK) contribution to magnetic type polarization on degree angular scales, which is produced by the large vector component of the defect source. We also investigate the effect of decoherence on polarization. It leads to a smoothing of acoustic oscillations both in temperature and polarization power spectra and strongly suppresses the cross-correlation between temperature and polarization relative to inflationary models. Presence or absence of magnetic polarization or cross-correlation would be a strong discriminator between the two theories of structure formation and will be testable with the next generation of CMB satellites.

An efficient technique for computing perturbation power spectra in field ordering theories of cosmic structure formation is introduced, enabling computations to be carried out with unprecedented precision. Large scale simulations are used to measure unequal time correlators of the source stress energy, taking advantage of scaling during matter and radiation domination, and causality, to make optimal use of the available dynamic range. The correlators are then re-expressed in terms of a sum of eigenvector products, a representation which we argue is optimal, enabling the computation of the final power spectra to be performed at high accuracy. Microwave anisotropy and matter perturbation power spectra for global strings, monopoles, textures and non-topological textures are presented and compared with recent observations.

The string-dominated universe locally resembles an open universe, and fits dynamical measures of power spectra, cluster abundances, redshift distortions, lensing constraints, luminosity and angular diameter distance relations and microwave background observations. We show examples of networks which might give rise to recent string-domination without requiring any fine-tuned parameters. We discuss how future observations can distinguish this model from other cosmologies.

We show how the virial theorem can be applied to the hot gas in clusters of galaxies to obtain a yardstick, which could then be used to determine cosmological parameters. This yardstick relies on the assumptions of hydrostatic equilibrium and that the gas fraction is approximately constant. The constancy is checked empirically from a local population of clusters. By using the observed parameters consisting of temperature, surface brightness and radial profile $\beta$, one can calculate the expected core radius. Comparing it to the observed angular size, one can in principle calibrate the cosmological deceleration parameter $q_0$. We test this method on a small sample of 6 clusters, and show its promise and accuracy. The preliminary implications would be to suggest $q_0 \approx 0.85\pm 0.29$ with $1-\sigma$ statistical error bars, with several systematic uncertainties remaining. Taken at face value, this would argue against a cosmological constant. The method is robust to errors in the measurement of the core radius as long as the product of the central density and the core radius squared $\rho_0 r_c^2$ are well determined. New lensing and X-ray data can dramatically improve on the statistics.

CCD photometry of the gravitational lens system 0957+561A,B in the g and r bands was obtained on alternate nights, weather permitting, from December 1994 through May 1995 using the Double Imaging Spectrograph (DIS) on the Apache Point Observatory (APO) 3.5-meter telescope. The remote observing and fast instrument change capabilities of this facility allowed accumulation of light curves sampled frequently and consistently. The Honeycutt ensemble photometry algorithm was applied to the data set and yielded typical relative photometric errors of approximately 0.01 magnitudes. Image A exhibited a sharp drop of about 0.1 magnitudes in late December 1994; no other strong features were recorded in either image. This event displays none of the expected generic features of a microlensing-induced flux variation and is likely to be intrinsic to the quasar; if so, it should also be seen in the B image with the lensing differential time delay. We give the expected 1996 image B light curves based on two values of the time delay and brightness ratio which have been proposed and debated in the literature. Continued monitoring of the system in the first half of 1996 should easily detect the image B event and thus resolve the time-delay controversy.

We present a general formalism for computing Cosmic Background Radiation (CBR) and density fluctuations in open models with stiff sources. We find analytic Green's functions for the linearized Einstein equations in the presence of stiff sources and use this formalism to estimate the amplitude and harmonic spectrum of microwave background fluctuations produced by topological defects in an open universe. Unlike inflationary models that predict a flat universe and a spectrum of CBR fluctuations that is enhanced at large angular scales, defect models predict that CBR fluctuations are suppressed on angular scales larger than that subtended by the curvature scale. In an $\Omega = 0.2 - 0.4$ universe, these models, when normalized to the amplitude of CBR fluctuations observed by COBE, require a moderate bias factor, $2-3$, to be compatible with the observed fluctuations in galaxy counts. In these models, accurate predictions can be made which are testable through CBR experiments in the near future. A CBR measurement of $\Omega$ would then be possible, up to the limit imposed by cosmic variance. We discuss some of the philosophical implications of an open model and propose a solution to the flatness problem.

( to appear in: Proceedings of the Nishonomiya Yukawa Memorial Symposium Edited by M. Sasaki) There are several models for generating fluctuations in an open universe that are compatible with the microwave background fluctuations detected by COBE {\it and} observations of large scale structure. Topological defects, such as strings and textures, appear to be more successful in a low-$\Omega$ model than in an $\Omega = 1$ model. These models predict that the cosmic microwave background (CMB) fluctuations are non-Gaussian with distinctive signatures that may lead to their confirmation. If there exists a mechanism for generating scale invariant mass fluctuations, $(\delta M/M)^2 \propto M^{-4/3}$, then these models are also compatible with COBE. Both models predict mass fluctuations on the 8/h Mpc scale, $\sigma_8$, $\sim 0.5 - 1$ for $\Omega h \sim 0.2 - 0.3$. A variety of observations of large-scale structure, clusters and galaxies, as well as the age problem, suggest that the low-$\Omega$ models are attractive.

(To appear in Nuclear Physics B Supplements Proceedings section) This talk will explore the evolution of topological defects in an open universe. The rapid expansion of the universe in an open model slows defects and suppresses the generation of CBR fluctuations at large angular scale as does the altered relationship between angle and length in an open universe. Defect models, when normalized to COBE in an open universe, predict a galaxy power spectrum consistent with the galaxy power spectrum inferred from the galaxy surveys and do not require an extreme bias. Neither defect models in a flat universe nor standard inflationary models can fit either the multipole spectrum or the power spectrum inferred from galaxy surveys.

(accepted for publication in the Ap.J.) I present a general classification of self-similar solutions to the equations of gravitational hydrodynamics that contain many previous results as special cases. For cold flows with spherical symmetry, the solution space can be classified into several regions of behavior similar to the Bondi solutions for steady flow. A full description of these solution is possible, which serves as the asymptotic limit for the general problem. By applying a shock jump condition, exact general solutions can be constructed. The isothermal case allows an extra exact integral, and can be asymptotically analyzed in the presence of finite pressure. These solutions serve as analytic models for problems such as spherical accretion for star formation, infall or outflow of gas into galaxies, Lyman alpha cloud dynamics, etc. Most previous self-similar results are obtained as special cases. The critical values for a cosmological flow with $\Omega=1$ and $\gamma=4/3$ turn out to play a special role.

Long lived modes of elliptical galaxies can exist {\it \`a la} van Kampen. Specific systems may possess long lived oscillations which Landau damp on time scales longer than a Hubble time. Some physical processes such as a close encounter, tidal forces from a cluster or an orbiting satellite could preferentially excite a coherent mode. These may relate to the observed faint structure in elliptical galaxies such as shells and ripples. Their detection in projected phase space would ultimately provide a detailed probe of the underlying potential. I give an overview of linear perturbations to stationary solutions of the Vlasov equation, including a discretized Hermite polynomial expansion which explicitly demonstrates completeness and orthogonality of solutions. Some exact solutions are shown, which implies the feasibility of such a procedure and suggest future fully numerical studies.

The COBE satellite's maps of the cosmic microwave background (CMB) anisotropy do not have the resolution to discriminate between theories of cosmic structure formation based on inflation, and those based on field ordering following a symmetry breaking phase transition. For this purpose it is critical to resolve the CMB anisotropy on degree scales. In this paper we report on detailed calculations of the degree scale anisotropies predicted in the global string, monopole, texture and nontopological texture scenarios of structure formation, emphasising their distinct character from those predicted by inflation, and commenting on the prospects of their detection in the near future.