The origin of the diverse population of galaxy clusters remains an unexplained aspect of large-scale structure formation and cluster evolution. We present a novel method of using X-ray images to identify cool core (CC), weak cool core (WCC), and non cool core (NCC) clusters of galaxies, that are defined by their central cooling times. We employ a convolutional neural network, ResNet-18, which is commonly used for image analysis, to classify clusters. We produce mock Chandra X-ray observations for a sample of 318 massive clusters drawn from the IllustrisTNG simulations. The network is trained and tested with low resolution mock Chandra images covering a central 1 Mpc square for the clusters in our sample. Without any spectral information, the deep learning algorithm is able to identify CC, WCC, and NCC clusters, achieving balanced accuracies (BAcc) of 92%, 81%, and 83%, respectively. The performance is superior to classification by conventional methods using central gas densities, with an average BAcc = 81%, or surface brightness concentrations, giving BAcc = 73%. We use Class Activation Mapping to localize discriminative regions for the classification decision. From this analysis, we observe that the network has utilized regions from cluster centers out to r~300 kpc and r~500 kpc to identify CC and NCC clusters, respectively. It may have recognized features in the intracluster medium that are associated with AGN feedback and disruptive major mergers.

We present an analysis of coronal mass ejections (CMEs) observed by the Heliospheric Imagers (HIs) on board NASA's Solar Terrestrial Relations Observatory (STEREO) spacecraft. Between August 2008 and April 2014 we identify 273 CMEs that are observed simultaneously, by the HIs on both spacecraft. For each CME, we track the observed leading edge, as a function of time, from both vantage points, and apply the Stereoscopic Self-Similar Expansion (SSSE) technique to infer their propagation throughout the inner heliosphere. The technique is unable to accurately locate CMEs when their observed leading edge passes between the spacecraft, however, we are able to successfully apply the technique to 151, most of which occur once the spacecraft separation angle exceeds 180 degrees, during solar maximum. We find that using a small half-width to fit the CME can result in observed acceleration to unphysically high velocities and that using a larger half-width can fail to accurately locate the CMEs close to the Sun because the method does not account for CME over-expansion in this region. Observed velocities from SSSE are found to agree well with single-spacecraft (SSEF) analysis techniques applied to the same events. CME propagation directions derived from SSSE and SSEF analysis agree poorly because of known limitations present in the latter. This work was carried out as part of the EU FP7 HELCATS (Heliospheric Cataloguing, Analysis and Techniques Service) project (http://www.helcats-fp7.eu/).

We determine the inner density profiles of massive galaxy clusters (M$_{200}$ > $5 \times 10^{14}$ M$_{\odot}$) in the Cluster-EAGLE (C-EAGLE) hydrodynamic simulations, and investigate whether the dark matter density profiles can be correctly estimated from a combination of mock stellar kinematical and gravitational lensing data. From fitting mock stellar kinematics and lensing data generated from the simulations, we find that the inner density slopes of both the total and the dark matter mass distributions can be inferred reasonably well. We compare the density slopes of C-EAGLE clusters with those derived by Newman et al. for 7 massive galaxy clusters in the local Universe. We find that the asymptotic best-fit inner slopes of "generalized" NFW (gNFW) profiles, ${\gamma}_{\rm gNFW}$, of the dark matter haloes of the C-EAGLE clusters are significantly steeper than those inferred by Newman et al. However, the mean mass-weighted dark matter density slopes of the simulated clusters are in good agreement with the Newman et al. estimates. We also find that the estimate of ${\gamma}_{\rm gNFW}$ is very sensitive to the constraints from weak lensing measurements in the outer parts of the cluster and a bias can lead to an underestimate of ${\gamma}_{\rm gNFW}$.

Dynamically relaxed galaxy clusters have long played a role in galaxy cluster studies because it is thought their properties can be reconstructed more precisely and with less systematics. As relaxed clusters are desirable, there exist a plethora of criteria for classifying a galaxy cluster as relaxed. In this work, we examine $9$ commonly used observational and theoretical morphological metrics extracted from $54,000$ Mock-X synthetic X-ray images of galaxy clusters taken from the IllustrisTNG, BAHAMAS and MACSIS simulation suites. We find that the simulated criteria distributions are in reasonable agreement with the observed distributions. Many criteria distributions evolve as a function of redshift, cluster mass, numerical resolution and subgrid physics, limiting the effectiveness of a single relaxation threshold value. All criteria are positively correlated with each other, however, the strength of the correlation is sensitive to redshift, mass and numerical choices. Driven by the intrinsic scatter inherent to all morphological metrics and the arbitrary nature of relaxation threshold values, we find the consistency of relaxed subsets defined by the different metrics to be relatively poor. Therefore, the use of relaxed cluster subsets introduces significant selection effects that are non-trivial to resolve.

The abundance and distribution of metals in galaxy clusters contains valuable information about their chemical history and evolution. By looking at how metallicity evolves with redshift, it is possible to constrain the different metal production channels. We use the C-EAGLE clusters, a sample of 30 high resolution ($m_{gas} \simeq 1.8\times 10^{6}$ M$_{\odot}$) cluster zoom simulations, to investigate the redshift evolution of metallicity, with particular focus on the cluster outskirts. The early enrichment model, in which the majority of metals are produced in the core of cluster progenitors at high redshift, suggests that metals in cluster outskirts have not significantly evolved since $z=2$. With the C-EAGLE sample, we find reasonable agreement with the early enrichment model as there is very little scatter in the metallicity abundance at large radius across the whole sample, out to at least $z=2$. The exception is Fe for which the radial dependence of metallicity was found to evolve at low redshift as a result of being mainly produced by Type Ia supernovae, which are more likely to be formed at later times than core-collapse supernovae. We also found considerable redshift evolution of metal abundances in the cores of the C-EAGLE clusters which has not been seen in other simulations or observation based metallicity studies. Since we find this evolution to be driven by accretion of low metallicity gas, it suggests that the interaction between outflowing, AGN heated material and the surrounding gas is important for determining the core abundances in clusters.

We introduce the First Light And Reionisation Epoch Simulations (FLARES), a suite of zoom simulations using the EAGLE model. We resimulate a range of overdensities during the Epoch of Reionisation (EoR) in order to build composite distribution functions, as well as explore the environmental dependence of galaxy formation and evolution during this critical period of galaxy assembly. The regions are selected from a large $(3.2 \;\mathrm{cGpc})^{3}$ parent volume, based on their overdensity within a sphere of radius $14\,h^{-1}\;\mathrm{cMpc}$. We then resimulate with full hydrodynamics, and employ a novel weighting scheme that allows the construction of composite distribution functions that are representative of the full parent volume. This significantly extends the dynamic range compared to smaller volume periodic simulations. We present an analysis of the galaxy stellar mass function (GSMF), the star formation rate distribution function (SFRF) and the star forming sequence (SFS) predicted by \flares, and compare to a number of observational and model constraints. We also analyse the environmental dependence over an unprecedented range of overdensity. Both the GSMF and the SFRF exhibit a clear double-Schechter form, up to the highest redshifts ($z = 10$). We also find no environmental dependence of the SFS normalisation. The increased dynamic range probed by FLARES will allow us to make predictions for a number of large area surveys that will probe the EoR in coming years, such as WFIRST and Euclid.

By using deep observations of clusters of galaxies, it has been recently found that the projected stellar mass density closely follows the projected total (dark and baryonic) mass density within the innermost ~140 kpc. In this work, we aim to test these observations using the Cluster-EAGLE simulations, comparing the projected densities inferred directly from the simulations. We compare the iso-density contours using the procedure of Montes \& Trujillo (2019), and find that the shape of the stellar mass distribution follows that of the total matter even more closely than observed, although their radial profiles differ substantially. The ratio between stellar and total matter density profiles in circular apertures, shows a slope close to -1, with a small dependence on the cluster's total mass. We propose an indirect method to calculate the halo mass and mass density profile from the radial profile of the intra-cluster stellar mass density.

The Sunyaev-Zeldovich (SZ) effect has long been recognized as a powerful cosmological probe. Using the BAHAMAS and MACSIS simulations to obtain $>10,000$ simulated galaxy groups and clusters, we compute three temperature measures and quantify the differences between them. The first measure is related to the X-ray emission of the cluster, while the second describes the non-relativistic thermal SZ (tSZ) effect. The third measure determines the lowest order relativistic correction to the tSZ signal, which is seeing increased observational relevance. Our procedure allows us to accurately model the relativistic SZ (rSZ) contribution and we show that a $\gtrsim 10\%-40\%$ underestimation of this rSZ cluster temperature is expected when applying standard X-ray relations. The correction also exhibits significant mass and redshift evolution, as we demonstrate here. We present the mass dependence of each temperature measure alongside their profiles and a short analysis of the temperature dispersion as derived from the aforementioned simulations. We also discuss a new relation connecting the temperature and Compton-$y$ parameter, which can be directly used for rSZ modelling. Simple fits to the obtained scaling relations and profiles are provided. These should be useful for future studies of the rSZ effect and its relevance to cluster cosmology.

Surveys in the next decade will deliver large samples of galaxy clusters that transform our understanding of their formation. Cluster astrophysics and cosmology studies will become systematics limited with samples of this magnitude. With known properties, hydrodynamical simulations of clusters provide a vital resource for investigating potential systematics. However, this is only realized if we compare simulations to observations in the correct way. Here we introduce the \textsc{Mock-X} analysis framework, a multiwavelength tool that generates synthetic images from cosmological simulations and derives halo properties via observational methods. We detail our methods for generating optical, Compton-$y$ and X-ray images. Outlining our synthetic X-ray image analysis method, we demonstrate the capabilities of the framework by exploring hydrostatic mass bias for the IllustrisTNG, BAHAMAS and MACSIS simulations. Using simulation derived profiles we find an approximately constant bias $b\approx0.13$ with cluster mass, independent of hydrodynamical method or subgrid physics. However, the hydrostatic bias derived from synthetic observations is mass-dependent, increasing to $b=0.3$ for the most massive clusters. This result is driven by a single temperature fit to a spectrum produced by gas with a wide temperature distribution in quasi-pressure equilibrium. The spectroscopic temperature and mass estimate are biased low by cooler gas dominating the emission, due to its quadratic density dependence. The bias and the scatter in estimated mass remain independent of the numerical method and subgrid physics. Our results are consistent with current observations and future surveys will contain sufficient samples of massive clusters to confirm the mass dependence of the hydrostatic bias.

We explore the isothermal total density profiles of early-type galaxies (ETGs) in the IllustrisTNG simulation. For the selected 559 ETGs at $z = 0$ with stellar mass $10^{10.7}\mathrm{M}_{\odot} \leqslant M_{\ast} \leqslant 10^{11.9}\mathrm{M}_{\odot}$, the total power-law slope has a mean of $\langle\gamma^{\prime}\rangle = 2.011 \pm 0.007$ and a scatter of $\sigma_{\gamma^{\prime}} = 0.171$ over the radial range 0.4 to 4 times the stellar half mass radius. Several correlations between $\gamma^{\prime}$ and galactic properties including stellar mass, effective radius, stellar surface density, central velocity dispersion, central dark matter fraction and in-situ-formed stellar mass ratio are compared to observations and other simulations, revealing that IllustrisTNG reproduces many correlation trends, and in particular, $\gamma^{\prime}$ is almost constant with redshift below $z = 2$. Through analyzing IllustrisTNG model variations we show that black hole kinetic winds are crucial to lowering $\gamma^{\prime}$ and matching observed galaxy correlations. The effects of stellar winds on $\gamma^{\prime}$ are subdominant compared to AGN feedback, and differ due to the presence of AGN feedback from previous works. The density profiles of the ETG dark matter halos are well-described by steeper-than-NFW profiles, and they are steeper in the full physics (FP) run than their counterparts in the dark matter only (DMO) run. Their inner density slopes anti-correlates (remain constant) with the halo mass in the FP (DMO) run, and anti-correlates with the halo concentration parameter $c_{200}$ in both types of runs. The dark matter halos of low-mass ETGs are contracted whereas high-mass ETGs are expanded, suggesting that variations in the total density profile occur through the different halo responses to baryons.

We study stellar property statistics, including satellite galaxy occupation, of massive halo populations realized by three cosmological hydrodynamics simulations: BAHAMAS + MACSIS, TNG300 of the IllustrisTNG suite, and Magneticum Pathfinder. The simulations incorporate independent sub-grid methods for astrophysical processes with spatial resolutions ranging from $1.5$ to $6$ kpc, and each generates samples of $1000$ or more halos with $M_{\rm halo}> 10^{13.5} M_{\odot}$ at redshift $z=0$. Applying localized, linear regression (LLR), we extract halo mass-conditioned statistics (normalizations, slopes, and intrinsic covariance) for a three-element stellar property vector consisting of: i) $N_{sat}$, the number of satellite galaxies with stellar mass, $M_{\star, \rm sat} > 10^{10} M_{\odot}$ within radius $R_{200c}$ of the halo; ii) $M_{\star,\rm tot}$, the total stellar mass within that radius, and; iii) $M_{\star,\rm BCG}$, the gravitationally-bound stellar mass of the central galaxy within a $100 \, \rm kpc$ radius. Scaling parameters for the three properties with halo mass show mild differences among the simulations, in part due to numerical resolution, but there is qualitative agreement on property correlations, with halos having smaller than average central galaxies tending to also have smaller total stellar mass and a larger number of satellite galaxies. Marginalizing over total halo mass, we find the satellite galaxy kernel, $p(\ln N_{sat}\,|\,M_{\rm halo},z)$ to be consistently skewed left, with skewness parameter $\gamma = -0.91 \pm 0.02$, while that of $\ln M_{\star,\rm tot}$ is closer to log-normal, in all three simulations. The highest resolution simulations find $\gamma \simeq -0.8$ for the $z=0$ shape of $p(\ln M_{\star,\rm BCG}\,|\,M_{\rm halo},z)$ and also that the fractional scatter in total stellar mass is below $10\%$ in halos more massive than $10^{14.3} M_{\odot}$.

In the context of the BUFFALO (Beyond Ultra-deep Frontier Fields And Legacy Observations) survey, we present a new analysis of the merging galaxy cluster MACS\,J0416.1-2403 ($z = 0.397$) and its parallel field using the data collected by the Hubble Frontier Fields (HFF) campaign. In this work, we measure the surface mass density from a weak-lensing analysis, and characterise the overall matter distribution in both the cluster and parallel fields. The surface mass distribution derived for the parallel field shows clumpy overdensities connected by filament-like structures elongated in the direction of the cluster core. We also characterise the X-ray emission of the cluster, and compare it with the lensing mass distribution. We identify five substructures at the $>5\sigma$ level over the two fields, four of them being in the cluster one. Furthermore, three of them are located close to the edges of the field of view, and border issues can significantly hamper the determination of their physical parameters. Finally, we compare our results with the predicted subhalo distribution of one of the Hydrangea/C-EAGLE simulated cluster. Significant differences are obtained suggesting the simulated cluster is at a more advanced evolutionary state than MACS\,J0416.1-2403. Our results anticipate the upcoming BUFFALO observations that will link the two HFF fields, extending further the \emph{HST} coverage, and thus allowing a better characterisation of the reported substructures.

Large area surveys have detected significant samples of galaxy clusters that can be used to constrain cosmological parameters, provided that the masses of the clusters are measured robustly. To improve the calibration of cluster masses using weak gravitational lensing we present new results for 48 clusters at $0.05<z<0.15$, observed as part of the Multi Epoch Nearby Cluster Survey (MENeaCS), and reevaluate the mass estimates for 52 clusters from the Canadian Cluster Comparison Project (CCCP). Updated high-fidelity photometric redshift catalogues of reference deep fields are used in combination with advances in shape measurements and state-of-the-art cluster simulations, yielding an average systematic uncertainty in the lensing signal below 5%, similar to the statistical uncertainty for our cluster sample. We derive a scaling relation with Planck measurements for the full sample and find a bias in the Planck masses of $1-b=0.84 \pm 0.04$. We find no statistically significant trend of the mass bias with redshift or cluster mass, but find that different selections could change the bias by up to 1.5$\sigma$. We find a gas fraction of $0.139 \pm 0.014$ for 8 relaxed clusters in our sample, which can also be used to infer cosmological parameters.

We study the evolutionary trend of the total density profile of early-type galaxies (ETGs) in IllustrisTNG. To this end, we trace ETGs from $z=0$ to $z=4$ and measure the power-law slope $\gamma^{\prime}$ of the total density profile for their main progenitors. We find that their $\gamma^{\prime}$ steepen on average during $z\sim4-2$, then becoming shallower until $z=1$, after which they remain almost constant, aside from a residual trend of becoming shallower towards $z=0$. We also compare to a statistical sample of ETGs at different redshifts, selected based on their luminosity profiles and stellar masses. Due to different selection effects, the average slopes of the statistical samples follow a modified evolutionary trend. They monotonically decrease since $z=3$, and after $z\approx 1$, they remain nearly invariant with a mild increase towards $z=0$. These evolutionary trends are mass-dependent for both samples, with low-mass galaxies having in general steeper slopes than their more massive counterparts. Galaxies that transitioned to ETGs more recently have steeper mean slopes as they tend to be smaller and more compact at any given redshift. By analyzing the impact of mergers and AGN feedback on the progenitors' evolution, we conjecture a multi-phase path leading to isothermality in ETGs: dissipation associated with rapid wet mergers tends to steepen $\gamma^{\prime}$ from $z=4$ to $z=2$, whereas subsequent AGN feedback (especially in the kinetic mode) makes $\gamma^{\prime}$ shallower again from $z=2$ to $z=1$. Afterwards, passive evolution from $z=1$ to $z=0$, mainly through gas-poor mergers, mildly decreases $\gamma^{\prime}$ and maintains the overall mass distribution close to isothermal.

We use a set of 45 simulated clusters with a wide mass range ($8\times 10^{13} < M_{500}~[$M$_{\odot}]~< 2\times 10^{15}$) to investigate the effect of varying hydrodynamics flavours on cluster mass estimates. The cluster zooms were simulated using the same cosmological models as the BAHAMAS and C-EAGLE projects, leading to differences in both the hydrodynamic solvers and the subgrid physics but still producing clusters which broadly match observations. At the same mass resolution as BAHAMAS, for the most massive clusters ($M_{500} > 10^{15}$ M$_{\odot}$), we find changes in the SPH method produce the greatest differences in the final halo, while the subgrid models dominate at lower mass. By calculating the mass of all of the clusters using different permutations of the pressure, temperature and density profiles, created with either the true simulated data or mock spectroscopic data, we find that the spectroscopic temperature causes a bias in the hydrostatic mass estimates which increases with the mass of the cluster, regardless of the SPH flavour used. For the most massive clusters, the estimated mass of the cluster using spectroscopic density and temperature profiles is found to be as low as 50 per cent of the true mass compared to $\sim$ 90 per cent for low mass clusters. When including a correction for non-thermal pressure, the spectroscopic hydrostatic mass estimates are less biased on average and the mass dependence of the bias is reduced, although the scatter in the measurements does increase.

We analyse in this work the propagation and geoeffectiveness of four successive coronal mass ejections (CMEs) that erupted from the Sun during 21--23 May 2013 and that were detected in interplanetary space by the Wind and/or STEREO-A spacecraft. All these CMEs featured critical aspects for understanding so-called "problem space weather storms" at Earth. In the first three events a limb CMEs resulted in moderately geoeffective in-situ structures at their target location in terms of the disturbance storm time (Dst) index (either measured or estimated). The fourth CME, which also caused a moderate geomagnetic response, erupted from close to the disc centre as seen from Earth, but it was not visible in coronagraph images from the spacecraft along the Sun--Earth line and appeared narrow and faint from off-angle viewpoints. Making the correct connection between CMEs at the Sun and their in-situ counterparts is often difficult for problem storms. We investigate these four CMEs using multiwavelength and multipoint remote-sensing observations (extreme ultraviolet, white light, and radio), aided by 3D heliospheric modelling, in order to follow their propagation in the corona and in interplanetary space and to assess their impact at 1 AU. Finally, we emphasise the difficulties in forecasting moderate space weather effects provoked by problematic and ambiguous events and the importance of multispacecraft data for observing and modelling problem storms.

The nearby Perseus galaxy cluster is a key target for indirect detection searches for decaying dark matter. We use the C-EAGLE simulations of galaxy clusters to predict the flux, width and shape of a dark matter decay line, paying particular attention to the unexplained 3.55keV line detected in the spectra of some galaxies and clusters, and the upcoming XRISM X-ray observatory mission. We show that the line width in C-EAGLE clusters similar to Perseus is typically [600-800]$\mathrm{kms^{-1}}$, and therefore narrower than the amplitude of the velocity dispersion of galaxies in the cluster. Haloes that are significantly disturbed can, however, exhibit galaxy velocity dispersions higher than $1000\mathrm{kms^{-1}}$, and in this case will show a large difference between the line profiles of on- and off-center observations. We show that the line profile is likely to be slightly asymmetric, but still well approximated by a Gaussian at the 10% level, and that the halo asymmetry can lead to fluxes that vary by a factor of two. In summary, we predict that, if the previously reported 3.55keV line detections do originate from dark matter decay, the XRISM mission will detect a line with a roughly Gaussian profile at a rest frame energy of 3.55keV, with a width $>600\mathrm{kms^{-1}}$ and flux approximately in the range $[4-9]\times10^{-8}\mathrm{counts/sec/cm^{2}}$.

We investigate the disruption of group and cluster satellite galaxies with total mass (dark matter plus baryons) above 10^10 M_sun in the Hydrangea simulations, a suite of 24 high-resolution cosmological hydrodynamical zoom-in simulations based on the EAGLE model. The simulations predict that ~50 per cent of satellites survive to redshift z = 0, with higher survival fractions in massive clusters than in groups and only small differences between baryonic and pure N-body simulations. For clusters, up to 90 per cent of galaxy disruption occurs in lower-mass sub-groups (i.e., during pre-processing); 96 per cent of satellites in massive clusters that were accreted at z < 2 and have not been pre-processed survive. Of those satellites that are disrupted, only a few per cent merge with other satellites, even in low-mass groups. The survival fraction changes rapidly from less than 10 per cent of those accreted at high z to more than 90 per cent at low z. This shift, which reflects faster disruption of satellites accreted at higher z, happens at lower z for more massive galaxies and those accreted onto less massive haloes. The disruption of satellite galaxies is found to correlate only weakly with their pre-accretion baryon content, star formation rate, and size, so that surviving galaxies are nearly unbiased in these properties. These results suggest that satellite disruption in massive haloes is uncommon, and that it is predominantly the result of gravitational rather than baryonic processes.

Polarization of radiation is a powerful tool to study cosmic magnetism and analysis of polarization can be used as a diagnostic tool for large-scale structures. In this paper, we present a solid theoretical foundation for using polarized light to investigate large-scale magnetic field structures: the cosmological polarized radiative transfer (CPRT) formulation. The CPRT formulation is fully covariant. It accounts for cosmological and relativistic effects in a self-consistent manner and explicitly treats Faraday rotation, as well as Faraday conversion, emission, and absorption processes. The formulation is derived from the first principles of conservation of phase-space volume and photon number. Without loss of generality, we consider a flat Friedmann-Robertson-Walker (FRW) space-time metric and construct the corresponding polarized radiative transfer equations. We propose an all-sky CPRT calculation algorithm, based on a ray-tracing method, which allows cosmological simulation results to be incorporated and, thereby, model templates of polarization maps to be constructed. Such maps will be crucial in our interpretation of polarized data, such as those to be collected by the Square Kilometer Array (SKA). We describe several tests which are used for verifying the code and demonstrate applications in the study of the polarization signatures in different distributions of electron number density and magnetic fields. We present a pencil-beam CPRT calculation and an all-sky calculation, using a simulated galaxy cluster or a model magnetized universe obtained from GCMHD+ simulations as the respective input structures. The implications on large-scale magnetic field studies are discussed; remarks on the standard methods using rotation measure are highlighted.

Massive early-type galaxies follow a tight relation between the mass of their central supermassive black hole ($\rm M_{BH}$) and their stellar mass ($\rm M_{\star}$). The origin of observed positive outliers from this relation with extremely high $\rm M_{BH}$ ($> 10^{9} M_{\odot}$) remains unclear. We present a study of such outliers in the Hydrangea/C-EAGLE cosmological hydrodynamical simulations, designed to enable the study of high-mass galaxy formation and evolution in cluster environments. We find 69 $M_{\rm BH}(M_{\star})$ outliers at $z=0$, defined as those with $ \rm M_{BH} >10^{7} M_{\odot}$ and $\rm M_{BH}/\rm M_{\star}> 0.01$. This paper focusses on a sample of 5 extreme outliers, that have been selected based on their $\rm M_{BH}$ and $\rm M_{\star}$ values, which are comparable to the most recent estimates of observed positive outliers. This sample of 5 outliers, classified as `Black hole monster galaxies' (BMGs), was traced back in time to study their origin and evolution. In agreement with the results of previous simulations for lower-mass $\rm M_{BH}(\rm M_{\star})$ outliers, we find that these galaxies became outliers due to a combination of their early formation times and tidal stripping. For BMGs with $\rm M_{BH} > 10^9 M_{\odot}$, major mergers (with a stellar mass ratio of $\mu > 0.25$) at early times ($z>2$) precede the rapid growth of their supermassive BHs. Furthermore, the scatter in the relation between $\rm M_{BH}$ and stellar velocity dispersion, $\sigma$, correlates positively with the scatter in [Mg/Fe]($\sigma$). This indicates that the alpha enhancement of these galaxies, which is closely related to their star formation history, is related to the growth of their central BHs.

Feedback from accreting supermassive black holes, active galactic nuclei (AGN), is now a cornerstone of galaxy formation models. In this work, we present radiation-hydrodynamic simulations of radiative AGN feedback using the novel Arepo-RT. A central black hole emits radiation at a constant luminosity and drives an outflow via radiation pressure on dust grains. Utilising an isolated NFW halo we validate our setup in the single and multi-scattering regimes, with the simulated shock front propagation in excellent agreement with the expected analytic result. For a spherically symmetric NFW halo, an examination of the simulated outflow properties generated by radiative feedback demonstrates that they are lower than typically observed at a fixed AGN luminosity, regardless of the collimation of the radiation. We then explore the impact of a central disc galaxy and the assumed dust model on the outflow properties. The contraction of the halo during the galaxy's formation and modelling the production of dust grains results in a factor $100$ increase in the halo's optical depth. Radiation is then able to couple momentum more efficiently to the gas, driving a stronger shock and producing a mass-loaded $\sim10^{3}\,\mathrm{M}_{\odot}\,\mathrm{yr}^{-1}$ outflow with a velocity of $\sim2000\,\mathrm{km}\,\mathrm{s}^{-1}$, in agreement with observations. However, the inclusion of dust destruction mechanisms, like thermal sputtering, leads to the rapid destruction of dust grains within the outflow, reducing its properties below typically observed values. We conclude that radiative AGN feedback can drive outflows, but a thorough numerical and physical treatment is required to assess its true impact.

The thermodynamic structure of hot gas in galaxy clusters is sensitive to astrophysical processes and typically difficult to model with galaxy formation simulations. We explore the fraction of cool-core (CC) clusters in a large sample of $370$ clusters from IllustrisTNG, examining six common CC definitions. IllustrisTNG produces continuous CC criteria distributions, the extremes of which are classified as CC and non-cool-core (NCC), and the criteria are increasingly correlated for more massive clusters. At $z=0$, the CC fractions for $2$ criteria are in reasonable agreement with the observed fractions but the other $4$ CC fractions are lower than observed. This result is partly driven by systematic differences between the simulated and observed gas fraction profiles. The simulated CC fractions with redshift show tentative agreement with the observed fractions, but linear fits demonstrate that the simulated evolution is steeper than observed. The conversion of CCs to NCCs appears to begin later and act more rapidly in the simulations. Examining the fraction of CCs and NCCs defined as relaxed we find no evidence that CCs are more relaxed, suggesting that mergers are not solely responsible for disrupting CCs. A comparison of the median thermodynamic profiles defined by different CC criteria shows that the extent to which they evolve in the cluster core is dependent on the CC criteria. We conclude that the thermodynamic structure of galaxy clusters in IllustrisTNG shares many similarities with observations, but achieving better agreement most likely requires modifications of the underlying galaxy formation model.

The intracluster medium of galaxy clusters is permeated by {\mu}G magnetic fields. Observations with current and future facilities have the potential to illuminate the role of these magnetic fields play in the astrophysical processes of galaxy clusters. To obtain a greater understanding of how the initial seed fields evolve to the magnetic fields in the intracluster medium requires magnetohydrodynamic simulations. We critically assess the current Smoothed Particle Magneto-Hydrodynamics (SPMHD) schemes, especially highlighting the impact of a hyperbolic divergence cleaning scheme and artificial resistivity switch on the magnetic field evolution in cosmological simulations of the formation of a galaxy cluster using the N-body/SPMHD code gcmhd++. The impact and performance of the cleaning scheme and two different schemes for the artificial resistivity switch is demonstrated via idealized test cases and cosmological simulations. We demonstrate that the hyperbolic divergence cleaning scheme is effective at suppressing the growth of the numerical divergence error of the magnetic field and should be applied to any SPMHD simulation. Although the artificial resistivity is important in the strong field regime, it can suppress the growth of the magnetic field in the weak field regime, such as galaxy clusters. With sufficient resolution, simulations with divergence cleaning can reproduce observed magnetic fields. We conclude that the cleaning scheme alone is sufficient for galaxy cluster simulations, but our results indicate that the SPMHD scheme must be carefully chosen depending on the regime of the magnetic field.

Forthcoming large-scale spectroscopic surveys will soon provide data on thousands of galaxy clusters. It is important that the systematics of the various mass estimation techniques are well understood and calibrated. We compare three different dynamical mass estimators using the C-EAGLE galaxy clusters, a set of high resolution simulations with resolved galaxies a median total mass, $M_{200c} = 10^{14.7} \, \mathrm{M_\odot}$. We quantify the bias and scatter of the Jeans, virial, and caustic mass estimators using all galaxies with a stellar mass $M_*> 10^9 \, \mathrm{M_\odot}$, both in the ideal 3D case and in the more realistic projected case. On average we find our mass estimates are unbiased, though relative to the true mass within $r_{200c}$ the scatter is large with a range of $0.09$ - $0.15$ dex. We see a slight increase in the scatter when projecting the clusters. Selecting galaxies using the same criteria, we find no significant difference in the mass bias or scatter when comparing results from hydrodynamical and dark matter only simulations. However, selecting galaxies by stellar mass reduces the bias compared to selecting by total mass. Comparing X-ray derived hydrostatic and dynamical masses, the former are ${\sim} 30$ per cent lower. We find a slight dependence between substructure, measured using two different metrics, and mass bias. In conclusion, we find that dynamical mass estimators, when averaged together, are unbiased with a scatter of $0.11 \pm 0.02$ dex when including interloper galaxies and with no prior knowledge of $r_{200c}$.

Machine learning (ML) techniques, in particular supervised regression algorithms, are a promising new way to use multiple observables to predict a cluster's mass or other key features. To investigate this approach we use the \textsc{MACSIS} sample of simulated hydrodynamical galaxy clusters to train a variety of ML models, mimicking different datasets. We find that compared to predicting the cluster mass from the $\sigma -M$ relation, the scatter in the predicted-to-true mass ratio is reduced by a factor of 4, from $0.130\pm0.004$ dex (${\simeq} 35$ per cent) to $0.031 \pm 0.001$ dex (${\simeq} 7$ per cent) when using the same, interloper contaminated, spectroscopic galaxy sample. Interestingly, omitting line-of-sight galaxy velocities from the training set has no effect on the scatter when the galaxies are taken from within $r_{200c}$. We also train ML models to reproduce estimated masses derived from mock X-ray and weak lensing analyses. While the weak lensing masses can be recovered with a similar scatter to that when training on the true mass, the hydrostatic mass suffers from significantly higher scatter of ${\simeq} 0.13$ dex (${\simeq} 35$ per cent). Training models using dark matter only simulations does not significantly increase the scatter in predicted cluster mass compared to training on simulated clusters with hydrodynamics. In summary, we find ML techniques to offer a powerful method to predict masses for large samples of clusters, a vital requirement for cosmological analysis with future surveys.

Dark matter particles may decay, emitting photons. Drawing on the EAGLE family of hydrodynamic simulations of galaxy formation -- including the APOSTLE and C-EAGLE simulations -- we assess the systematic uncertainties and scatter on the decay flux from different galaxy classes, from Milky Way satellites to galaxy clusters, and compare our results to studies of the 3.55~keV line. We demonstrate that previous detections and non-detections of this line are consistent with a dark matter interpretation. For example, in our simulations the width of the the dark matter decay line for Perseus-analogue galaxy clusters lies in the range 1300-1700~\kms. Therefore, the non-detection of the 3.55~keV line in the centre of the Perseus cluster by the {\it Hitomi} collaboration is consistent with detections by other instruments. We also consider trends with stellar and halo mass and evaluate the scatter in the expected fluxes arising from the anisotropic halo mass distribution and from object-to-object variations. We provide specific predictions for observations with {\it XMM-Newton} and with the planned X-ray telescopes {\it XRISM} and {\it ATHENA}. If future detections of unexplained X-ray lines match our predictions, including line widths, we will have strong evidence that we have discovered the dark matter.

We present a gravitational lensing and X-ray analysis of a massive galaxy cluster and its surroundings. The core of MACS\,J0717.5+3745 ($M(R<1\,{\rm Mpc})\sim$\,$2$$\times$$10^{15}\,\msun$, $z$=$0.54$) is already known to contain four merging components. We show that this is surrounded by at least seven additional substructures with masses ranging from $3.8-6.5\times10^{13}\,\msun$, at projected radii $1.6$ to $4.9$\,Mpc. We compare MACS\,J0717 to mock lensing and X-ray observations of similarly rich clusters in cosmological simulations. The low gas fraction of substructures predicted by simulations turns out to match our observed values of $1$--$4\%$. Comparing our data to three similar simulated halos, we infer a typical growth rate and substructure infall velocity. That suggests MACS\,J0717 could evolve into a system similar to, but more massive than, Abell\,2744 by $z=0.31$, and into a $\sim$\,$10^{16}\,\msun$ supercluster by $z=0$. The radial distribution of infalling substructure suggests that merger events are strongly episodic; however we find that the smooth accretion of surrounding material remains the main source of mass growth even for such massive clusters.

Coronagraphs on future space telescopes will require precise wavefront correction to detect Earth-like exoplanets near their host stars. High-actuator count microelectromechanical system (MEMS) deformable mirrors provide wavefront control with low size, weight, and power. The Deformable Mirror Demonstration Mission (DeMi) payload will demonstrate a 140 actuator MEMS deformable mirror (DM) with \SI{5.5}{\micro\meter} maximum stroke. We present the flight optomechanical design, lab tests of the flight wavefront sensor and wavefront reconstructor, and simulations of closed-loop control of wavefront aberrations. We also present the compact flight DM controller, capable of driving up to 192 actuator channels at 0-250V with 14-bit resolution. Two embedded Raspberry Pi 3 compute modules are used for task management and wavefront reconstruction. The spacecraft is a 6U CubeSat (30 cm x 20 cm x 10 cm) and launch is planned for 2019.

Understanding how baryonic processes shape the intracluster medium (ICM) is of critical importance to the next generation of galaxy cluster surveys. However, most models of structure formation neglect potentially important physical processes, like anisotropic thermal conduction (ATC). In this letter, we explore the impact of ATC on the prevalence of cool-cores (CCs) using 12 pairs of magnetohydrodynamical galaxy cluster simulations, simulated using the IllustrisTNG model with and without ATC. Although the impact of ATC varies from cluster to cluster and with CC criterion, its inclusion produces a systematic shift to larger CC fractions at z = 0 for all CC criteria considered. Additionally, the inclusion of ATC yields a flatter CC fraction redshift evolution, easing the tension with the observed evolution. With ATC included, the energy required for the central black hole to achieve self-regulation is reduced and the gas fraction in the cluster core increases, resulting in larger CC fractions. ATC makes the ICM unstable to perturbations and the increased efficiency of AGN feedback suggests that its inclusion results in a greater level of mixing in the ICM. Therefore, ATC is potentially an important physical process in reproducing the thermal structure of the ICM.

Spherical coordinate systems, which are ubiquitous in astronomy, cannot be shown without distortion on flat, two-dimensional surfaces. This poses challenges for the two complementary phases of visual exploration -- making discoveries in data by looking for relationships, patterns or anomalies -- and publication -- where the results of an exploration are made available for scientific scrutiny or communication. This is a long-standing problem, and many practical solutions have been developed. Our allskyVR approach provides a workflow for experimentation with commodity virtual reality head-mounted displays. Using the free, open source S2PLOT programming library, and the A-Frame WebVR browser-based framework, we provide a straightforward way to visualise all-sky catalogues on a user-centred, virtual celestial sphere. The allskyVR distribution contains both a quickstart option, complete with a gaze-based menu system, and a fully customisable mode for those who need more control of the immersive experience. The software is available for download from: https://github.com/cfluke/allskyVR

We present a statistical analysis of coronal mass ejections (CMEs) imaged by the Heliospheric Imager (HI) instruments aboard NASAs twin-spacecraft STEREO mission between April 2007 and August 2017 for STEREO-A and between April 2007 and September 2014 for STEREO-B. The analysis exploits a catalogue that was generated within the FP7 HELCATS project. Here, we focus on the observational characteristics of CMEs imaged in the heliosphere by the inner (HI-1) cameras. More specifically, in this paper we present distributions of the basic observational parameters - namely occurrence frequency, central position angle (PA) and PA span - derived from nearly 2000 detections of CMEs in the heliosphere by HI-1 on STEREO-A or STEREO-B from the minimum between Solar Cycles 23 and 24 to the maximum of Cycle 24; STEREO-A analysis includes a further 158 CME detections from the descending phase of Cycle 24, by which time communication with STEREO-B had been lost. We compare heliospheric CME characteristics with properties of CMEs observed at coronal altitudes, and with sunspot number. As expected, heliospheric CME rates correlate with sunspot number, and are not inconsistent with coronal rates once instrumental factors/differences in cataloguing philosophy are considered. As well as being more abundant, heliospheric CMEs, like their coronal counterparts, tend to be wider during solar maximum. Our results confirm previous coronagraph analyses suggesting that CME launch sites don't simply migrate to higher latitudes with increasing solar activity. At solar minimum, CMEs tend to be launched from equatorial latitudes while, at maximum, CMEs appear to be launched over a much wider latitude range; this has implications for understanding the CME/solar source association. Our analysis provides some supporting evidence for the systematic dragging of CMEs to lower latitude as they propagate outwards.

We present the first simulated galaxy clusters (M_200 > 10^14 Msun) with both self-interacting dark matter (SIDM) and baryonic physics. They exhibit a greater diversity in both dark matter and stellar density profiles than their counterparts in simulations with collisionless dark matter (CDM), which is generated by the complex interplay between dark matter self-interactions and baryonic physics. Despite variations in formation history, we demonstrate that analytical Jeans modelling predicts the SIDM density profiles remarkably well, and the diverse properties of the haloes can be understood in terms of their different final baryon distributions.

Recent observations from integral field spectroscopy (IFS) indicate that the fraction of galaxies that are slow rotators, $F_{\rm SR}$, depends primarily on stellar mass, with no significant dependence on environment. We investigate these trends and the formation paths of slow rotators (SRs) using the EAGLE and Hydrangea hydro-dynamical simulations. EAGLE consists of several cosmological boxes of volumes up to $(100\,\rm Mpc)^3$, while Hydrangea consists of $24$ cosmological simulations of galaxy clusters and their environment. Together they provide a statistically significant sample in the stellar mass range $10^{9.5}\,\rm M_{\odot}-10^{12.3}\,\rm M_{\odot}$, of $16,358$ galaxies. We construct IFS-like cubes and measure stellar spin parameters, $\lambda_{\rm R}$, and ellipticities, allowing us to classify galaxies into slow/fast rotators as in observations. The simulations display a primary dependence of $F_{\rm SR}$ on stellar mass, with a weak dependence on environment. At fixed stellar mass, satellite galaxies are more likely to be SRs than centrals. $F_{\rm SR}$ shows a dependence on halo mass at fixed stellar mass for central galaxies, while no such trend is seen for satellites. We find that $\approx 70$% of SRs at $z=0$ have experienced at least one merger with mass ratio $\ge 0.1$, with dry mergers being at least twice more common than wet mergers. Individual dry mergers tend to decrease $\lambda_{\rm R}$, while wet mergers mostly increase it. However, $30$% of SRs at $z=0$ have not experienced mergers, and those inhabit halos with median spins twice smaller than the halos hosting the rest of the SRs. Thus, although the formation paths of SRs can be varied, dry mergers and/or halos with small spins dominate.

We use the Cluster-EAGLE simulations to explore the velocity bias introduced when using galaxies, rather than dark matter particles, to estimate the velocity dispersion of a galaxy cluster, a property known to be tightly correlated with cluster mass. The simulations consist of 30 clusters spanning a mass range $14.0 \le \log_{10}(M_{\rm 200c}/\mathrm{M_\odot}) \le 15.4$, with their sophisticated sub-grid physics modelling and high numerical resolution (sub-kpc gravitational softening) making them ideal for this purpose. We find that selecting galaxies by their total mass results in a velocity dispersion that is 5-10 per cent higher than the dark matter particles. However, selecting galaxies by their stellar mass results in an almost unbiased ($<5$ per cent) estimator of the velocity dispersion. This result holds out to $z=1.5$ and is relatively insensitive to the choice of cluster aperture, varying by less than 5 per cent between $r_{\rm 500c}$ and $r_{\rm 200m}$. We show that the velocity bias is a function of the time spent by a galaxy inside the cluster environment. Selecting galaxies by their total mass results in a larger bias because a larger fraction of objects have only recently entered the cluster and these have a velocity bias above unity. Galaxies that entered more than $4 \, \mathrm{Gyr}$ ago become progressively colder with time, as expected from dynamical friction. We conclude that velocity bias should not be a major issue when estimating cluster masses from kinematic methods.

Using tens of thousands of halos realized in the BAHAMAS and MACSIS simulations produced with a consistent astrophysics treatment that includes AGN feedback, we validate a multi-property statistical model for the stellar and hot gas mass behavior in halos hosting groups and clusters of galaxies. The large sample size allows us to extract fine-scale mass--property relations (MPRs) by performing local linear regression (LLR) on individual halo stellar mass (${\rm M}_{\rm star}$) and hot gas mass (${\rm M}_{\rm gas}$) as a function of total halo mass (${\rm M}_{\rm halo}$). We find that: 1) both the local slope and variance of the MPRs run with mass (primarily) and redshift (secondarily); 2) the conditional likelihood, $p({\rm M}_{\rm star},\ {\rm M}_{\rm gas} | \ {\rm M}_{\rm halo}, z)$ is accurately described by a multivariate, log-normal distribution, and; 3) the covariance of ${\rm M}_{\rm star}$ and ${\rm M}_{\rm gas}$ at fixed ${\rm M}_{\rm halo}$ is generally negative, reflecting a partially closed baryon box model for high mass halos. We validate the analytical population model of Evrard et al. (2014), finding sub-percent accuracy in the log-mean halo mass selected at fixed property, $\langle \ln {\rm M}_{\rm halo} | {\rm M}_{\rm gas} \rangle$ or $\langle \ln {\rm M}_{\rm halo} | {\rm M}_{\rm star} \rangle$, when scale-dependent MPR parameters are employed. This work highlights the potential importance of allowing for running in the slope and scatter of MPRs when modeling cluster counts for cosmological studies. We tabulate LLR fit parameters as a function of halo mass at $z=0$, $0.5$ and 1 for two popular mass conventions.

We use a combination of full hydrodynamic and dark matter only simulations to investigate the effect that baryonic physics and selecting super-cluster regions have on the matter power spectrum, by re-simulating a sample of super-cluster sub-volumes. On large scales we find that the matter power spectrum measured from our super-cluster sample has at least twice as much power as that measured from our random sample. Our investigation of the effect of baryonic physics on the matter power spectrum is found to be in agreement with previous studies and is weaker than the selection effect over the majority of scales. In addition, we investigate the effect of targeting a cosmologically non-representative, super-cluster region of the sky on the weak lensing shear power spectrum. We do this by generating shear and convergence maps using a line of sight integration technique, which intercepts our random and super-cluster sub-volumes. We find the convergence power spectrum measured from our super-cluster sample has a larger amplitude than that measured from the random sample at all scales. We frame our results within the context of the Super-CLuster Assisted Shear Survey (Super-CLASS), which aims to measure the cosmic shear signal in the radio band by targeting a region of the sky that contains five Abell clusters. Assuming the Super-CLASS survey will have a source density of 1.5 galaxies/arcmin$^2$, we forecast a detection significance of $2.7^{+1.5}_{-1.2}$, which indicates that in the absence of systematics the Super-CLASS project could make a cosmic shear detection with radio data alone.

The XXL survey currently covers two 25 sq. deg. patches with XMM observations of ~10ks. We summarise the scientific results associated with the first release of the XXL data set, that occurred mid 2016. We review several arguments for increasing the survey depth to 40 ks during the next decade of XMM operations. X-ray (z<2) cluster, (z<4) AGN and cosmic background survey science will then benefit from an extraordinary data reservoir. This, combined with deep multi-$\lambda$ observations, will lead to solid standalone cosmological constraints and provide a wealth of information on the formation and evolution of AGN, clusters and the X-ray background. In particular, it will offer a unique opportunity to pinpoint the z>1 cluster density. It will eventually constitute a reference study and an ideal calibration field for the upcoming eROSITA and Euclid missions.

We present an advance towards accurately predicting the arrivals of coronal mass ejections (CMEs) at the terrestrial planets, including Earth. For the first time, we are able to assess a CME prediction model using data over 2/3 of a solar cycle of observations with the Heliophysics System Observatory. We validate modeling results of 1337 CMEs observed with the Solar Terrestrial Relations Observatory (STEREO) heliospheric imagers (HI) (science data) from 8 years of observations by 5 in situ observing spacecraft. We use the self-similar expansion model for CME fronts assuming 60 degree longitudinal width, constant speed and constant propagation direction. With these assumptions we find that 23%-35% of all CMEs that were predicted to hit a certain spacecraft lead to clear in situ signatures, so that for 1 correct prediction, 2 to 3 false alarms would have been issued. In addition, we find that the prediction accuracy does not degrade with the HI longitudinal separation from Earth. Predicted arrival times are on average within 2.6 +/- 16.6 hours difference of the in situ arrival time, similar to analytical and numerical modeling, and a true skill statistic of 0.21. We also discuss various factors that may improve the accuracy of space weather forecasting using wide-angle heliospheric imager observations. These results form a first order approximated baseline of the prediction accuracy that is possible with HI and other methods used for data by an operational space weather mission at the Sun-Earth L5 point.

We introduce the Cluster-EAGLE (C-EAGLE) simulation project, a set of cosmological hydrodynamical zoom simulations of the formation of $30$ galaxy clusters in the mass range $10^{14}<M_{200}/\mathrm{M}_{\odot}<10^{15.4}$ that incorporates the Hydrangea sample of Bah\'e et al. (2017). The simulations adopt the state-of-the-art EAGLE galaxy formation model, with a gas particle mass of $1.8\times10^{6}\,\mathrm{M}_{\odot}$ and physical softening length of $0.7\,\mathrm{kpc}$. In this paper, we introduce the sample and present the low-redshift global properties of the clusters. We calculate the X-ray properties in a manner consistent with observational techniques, demonstrating the bias and scatter introduced by using estimated masses. We find the total stellar content and black hole masses of the clusters to be in good agreement with the observed relations. However, the clusters are too gas rich, suggesting that the AGN feedback model is not efficient enough at expelling gas from the high-redshift progenitors of the clusters. The X-ray properties, such as the spectroscopic temperature and the soft-band luminosity, and the Sunyaev-Zel'dovich properties are in reasonable agreement with the observed relations. However, the clusters have too high central temperatures and larger-than-observed entropy cores, which is likely driven by the AGN feedback after the cluster core has formed. The total metal content and its distribution throughout the ICM are a good match to the observations.

Despite the popularity of the Graphics Processing Unit (GPU) for general purpose computing, one should not forget about the practicality of the GPU for fast scientific visualisation. As astronomers have increasing access to three dimensional (3D) data from instruments and facilities like integral field units and radio interferometers, visualisation techniques such as volume rendering offer means to quickly explore spectral cubes as a whole. As most 3D visualisation techniques have been developed in fields of research like medical imaging and fluid dynamics, many transfer functions are not optimal for astronomical data. We demonstrate how transfer functions and graphics shaders can be exploited to provide new astronomy-specific explorative colouring methods. We present 12 shaders, including four novel transfer functions specifically designed to produce intuitive and informative 3D visualisations of spectral cube data. We compare their utility to classic colour mapping. The remaining shaders highlight how common computation like filtering, smoothing and line ratio algorithms can be integrated as part of the graphics pipeline. We discuss how this can be achieved by utilising the parallelism of modern GPUs along with a shading language, letting astronomers apply these new techniques at interactive frame rates. All shaders investigated in this work are included in the open source software shwirl (Vohl, 2017).

Cosmological parameter constraints from observations of time-delay lenses are becoming increasingly precise. However, there may be significant bias and scatter in these measurements due to, among other things, the so-called mass-sheet degeneracy. To estimate these uncertainties, we analyze strong lenses from the largest EAGLE hydrodynamical simulation. We apply a mass-sheet transformation to the radial density profiles of lenses, and by selecting lenses near isothermality, we find that the bias on H0 can be reduced to 5% with an intrinsic scatter of 10%, confirming previous results performed on a different simulation data set. We further investigate whether combining lensing observables with kinematic constraints helps to minimize this bias. We do not detect any significant dependence of the bias on lens model parameters or observational properties of the galaxy, but depending on the source--lens configuration, a bias may still exist. Cross lenses provide an accurate estimate of the Hubble constant, while fold (double) lenses tend to be biased low (high). With kinematic constraints, double lenses show bias and intrinsic scatter of 6% and 10%, respectively, while quad lenses show bias and intrinsic scatter of 0.5% and 10%, respectively. For lenses with a reduced $\chi^2 > 1$, a power-law dependence of the $\chi^2$ on the lens environment (number of nearby galaxies) is seen. Lastly, we model, in greater detail, the cases of two double lenses that are significantly biased. We are able to remove the bias, suggesting that the remaining biases could also be reduced by carefully taking into account additional sources of systematic uncertainty.

We introduce the Hydrangea simulations, a suite of 24 cosmological hydrodynamic zoom-in simulations of massive galaxy clusters (M_200c = 10^14-10^15 M_Sun) with baryon particle masses of ~10^6 M_Sun. Designed to study the impact of the cluster environment on galaxy formation, they are a key part of the `Cluster-EAGLE' project (Barnes et al. 2017). They use a galaxy formation model developed for the EAGLE project, which has been shown to yield both realistic field galaxies and hot gas fractions of galaxy groups consistent with observations. The total stellar mass content of the simulated clusters agrees with observations, but central cluster galaxies are too massive, by up to 0.6 dex. Passive satellite fractions are higher than in the field, and at stellar masses Mstar > 10^10 M_Sun this environmental effect is quantitatively consistent with observations. The predicted satellite stellar mass function matches data from local cluster surveys. Normalized to total mass, there are fewer low-mass (Mstar < 10^10 M_Sun) galaxies within the virial radius of clusters than in the field, primarily due to star formation quenching. Conversely, the simulations predict an overabundance of massive galaxies in clusters compared to the field that persists to their far outskirts (> 5r_200c). This is caused by a significantly increased stellar mass fraction of (sub-)haloes in the cluster environment, by up to ~0.3 dex even well beyond r_200c. Haloes near clusters are also more concentrated than equally massive field haloes, but these two effects are largely uncorrelated.

Radio survey datasets comprise an increasing number of individual observations stored as sets of multidimensional data. In large survey projects, astronomers commonly face limitations regarding: 1) interactive visual analytics of sufficiently large subsets of data; 2) synchronous and asynchronous collaboration; and 3) documentation of the discovery workflow. To support collaborative data inquiry, we present encube, a large-scale comparative visual analytics framework. Encube can utilise advanced visualization environments such as the CAVE2 (a hybrid 2D and 3D virtual reality environment powered with a 100 Tflop/s GPU-based supercomputer and 84 million pixels) for collaborative analysis of large subsets of data from radio surveys. It can also run on standard desktops, providing a capable visual analytics experience across the display ecology. Encube is composed of four primary units enabling compute-intensive processing, advanced visualisation, dynamic interaction, parallel data query, along with data management. Its modularity will make it simple to incorporate astronomical analysis packages and Virtual Observatory capabilities developed within our community. We discuss how encube builds a bridge between high-end display systems (such as CAVE2) and the classical desktop, preserving all traces of the work completed on either platform -- allowing the research process to continue wherever you are.

We present the MAssive ClusterS and Intercluster Structures (MACSIS) project, a suite of 390 clusters simulated with baryonic physics that yields realistic massive galaxy clusters capable of matching a wide range of observed properties. MACSIS extends the recent BAHAMAS simulation to higher masses, enabling robust predictions for the redshift evolution of cluster properties and an assessment of the effect of selecting only the hottest systems. We study the observable-mass scaling relations and the X-ray luminosity-temperature relation over the complete observed cluster mass range. As expected, we find the slope of these scaling relations and the evolution of their normalization with redshift departs significantly from the self-similar predictions. However, for a sample of hot clusters with core-excised temperatures $k_{\rm{B}}T\geq5\,\rm{keV}$ the normalization and slope of the observable-mass relations and their evolution are significantly closer to self-similar. The exception is the temperature-mass relation, for which the increased importance of non-thermal pressure support and biased X-ray temperatures leads to a greater departure from self-similarity in the hottest systems. As a consequence, these also affect the slope and evolution of the normalization in the luminosity-temperature relation. The median hot gas profiles show good agreement with observational data at $z=0$ and $z=1$, with their evolution again departing significantly from the self-similar prediction. However, selecting a hot sample of clusters yields profiles that evolve significantly closer to the self-similar prediction. In conclusion, our results show that understanding the selection function is vital for robust calibration of cluster properties with mass and redshift.

We use the BAHAMAS and MACSIS hydrodynamic simulations to quantify the impact of baryons on the mass distribution and dynamics of massive galaxy clusters, as well as the bias in X-ray and weak lensing mass estimates. These simulations use the sub-grid physics models calibrated in the BAHAMAS project, which include feedback from both supernovae and active galactic nuclei. They form a cluster population covering almost two orders of magnitude in mass, with more than 3,500 clusters with masses greater than $10^{14}\,\mathrm{M}_\odot$ at $z=0$. We start by characterising the clusters in terms of their spin, shape and density profile, before considering the bias in both weak lensing and hydrostatic mass estimates. Whilst including baryonic effects leads to more spherical, centrally concentrated clusters, the median weak lensing mass bias is unaffected by the presence of baryons. In both the dark matter only and hydrodynamic simulations, the weak lensing measurements underestimate cluster masses by ${\approx}10\%$ for clusters with $M_{200}{\leq}10^{15}\mathrm{M}_\odot$ and this bias tends to zero at higher masses. We also consider the hydrostatic bias when using both the true density and temperature profiles, and those derived from X-ray spectroscopy. When using spectroscopic temperatures and densities, the hydrostatic bias decreases as a function of mass, leading to a bias of ${\approx}40\%$ for clusters with $M_{500}{\geq}10^{15}\,\mathrm{M}_\odot$. This is due to the presence of cooler gas in the cluster outskirts. Using mass weighted temperatures and the true density profile reduces this bias to $5{-}15\%$.

As the quantity and resolution of spectral-cubes from optical/infrared and radio surveys increase, desktop-based visualization and analysis solutions must adapt and evolve. Novel immersive 3D environments such as the CAVE2 at Monash University can overcome personal computer's visualization limitations. CAVE2 is part advanced 2D/3D visualization space (80 stereo-capable screens providing a total of 84 million pixels) and part supercomputer ($\sim100$ TFLOPS of integrated GPU-based processing power). We present a novel visualization system enabling simultaneous 3D comparative visualization of $\sim100$ spectral-cubes. With CAVE2 augmented by our newly developed web-based controller interface, astronomers can easily organise spectral-cubes on the different display panels, apply real-time transforms to one or many spectral cubes, and request quantitative information about the displayed data. We also discuss how such a solution can help accelerate the discovery rate in varied research scenarios.

We present encube $-$ a qualitative, quantitative and comparative visualisation and analysis system, with application to high-resolution, immersive three-dimensional environments and desktop displays. encube extends previous comparative visualisation systems by considering: 1) the integration of comparative visualisation and analysis into a unified system; 2) the documentation of the discovery process; and 3) an approach that enables scientists to continue the research process once back at their desktop. Our solution enables tablets, smartphones or laptops to be used as interaction units for manipulating, organising, and querying data. We highlight the modularity of encube, allowing additional functionalities to be included as required. Additionally, our approach supports a high level of collaboration within the physical environment. We show how our implementation of encube operates in a large-scale, hybrid visualisation and supercomputing environment using the CAVE2 at Monash University, and on a local desktop, making it a versatile solution. We discuss how our approach can help accelerate the discovery rate in a variety of research scenarios.

Coronal mass ejections (CMEs) are large-scale eruptions of magnetized plasma that may cause severe geomagnetic storms if Earth-directed. Here we report a rare instance with comprehensive in situ and remote sensing observa- tions of a CME combining white-light, radio, and plasma measurements from four different vantage points. For the first time, we have successfully applied a radio direction-finding technique to an interplanetary type II burst detected by two identical widely separated radio receivers. The derived locations of the type II and type III bursts are in general agreement with the white light CME recon- struction. We find that the radio emission arises from the flanks of the CME, and are most likely associated with the CME-driven shock. Our work demon- strates the complementarity between radio triangulation and 3D reconstruction techniques for space weather applications.

Astronomical images and datasets are increasingly high-resolution and multi-dimensional. The vast majority of astronomers perform all of their visualisation and analysis tasks on low-resolution, two-dimensional desktop monitors. If there were no technological barriers to designing the ultimate stereoscopic display for astronomy, what would it look like? What capabilities would we require of our compute hardware to drive it? And are existing technologies even close to providing a true 3D experience that is compatible with the depth resolution of human stereoscopic vision? We consider the CAVE2 (an 80 Megapixel, hybrid 2D and 3D virtual reality environment directly integrated with a 100 Tflop/s GPU-powered supercomputer) and the Oculus Rift (a low- cost, head-mounted display) as examples at opposite financial ends of the immersive display spectrum.

An FPGA-based digital-receiver has been developed for a low-frequency imaging radio interferometer, the Murchison Widefield Array (MWA). The MWA, located at the Murchison Radio-astronomy Observatory (MRO) in Western Australia, consists of 128 dual-polarized aperture-array elements (tiles) operating between 80 and 300\,MHz, with a total processed bandwidth of 30.72 MHz for each polarization. Radio-frequency signals from the tiles are amplified and band limited using analog signal conditioning units; sampled and channelized by digital-receivers. The signals from eight tiles are processed by a single digital-receiver, thus requiring 16 digital-receivers for the MWA. The main function of the digital-receivers is to digitize the broad-band signals from each tile, channelize them to form the sky-band, and transport it through optical fibers to a centrally located correlator for further processing. The digital-receiver firmware also implements functions to measure the signal power, perform power equalization across the band, detect interference-like events, and invoke diagnostic modes. The digital-receiver is controlled by high-level programs running on a single-board-computer. This paper presents the digital-receiver design, implementation, current status, and plans for future enhancements.

The Murchison Widefield Array (MWA) is a Square Kilometre Array (SKA) Precursor. The telescope is located at the Murchison Radio--astronomy Observatory (MRO) in Western Australia (WA). The MWA consists of 4096 dipoles arranged into 128 dual polarisation aperture arrays forming a connected element interferometer that cross-correlates signals from all 256 inputs. A hybrid approach to the correlation task is employed, with some processing stages being performed by bespoke hardware, based on Field Programmable Gate Arrays (FPGAs), and others by Graphics Processing Units (GPUs) housed in general purpose rack mounted servers. The correlation capability required is approximately 8 TFLOPS (Tera FLoating point Operations Per Second). The MWA has commenced operations and the correlator is generating 8.3 TB/day of correlation products, that are subsequently transferred 700 km from the MRO to Perth (WA) in real-time for storage and offline processing. In this paper we outline the correlator design, signal path, and processing elements and present the data format for the internal and external interfaces.

To study the star formation and feedback mechanism, we simulate the evolution of an isolated dwarf irregular galaxy (dIrr) in a fixed dark matter halo, similar in size to WLM, using a new stellar feedback scheme. We use the new version of our original N-body/smoothed particle chemodynamics code, GCD+, which adopts improved hydrodynamics, metal diffusion between the gas particles and new modelling of star formation and stellar wind and supernovae (SNe) feedback. Comparing the simulations with and without stellar feedback effects, we demonstrate that the collisions of bubbles produced by strong feedback can induce star formation in a more widely spread area. We also demonstrate that the metallicity in star forming regions is kept low due to the mixing of the metal-rich bubbles and the metal-poor inter-stellar medium. Our simulations also suggest that the bubble-induced star formation leads to many counter-rotating stars. The bubble-induced star formation could be a dominant mechanism to maintain star formation in dIrrs, which is different from larger spiral galaxies where the non-axisymmetric structures, such as spiral arms, are a main driver of star formation.

We present a search for transient and variable radio sources at 154 MHz with the Murchison Widefield Array 32-tile prototype. Fifty-one images were obtained that cover a field of view of 1430 deg^2 centred on Hydra A. The observations were obtained over three days in 2010 March and three days in 2011 April and May. The mean cadence of the observations was 26 minutes and there was additional temporal information on day and year timescales. We explore the variability of a sample of 105 low frequency radio sources within the field. Four bright (S > 6 Jy) candidate variable radio sources were identified that displayed low levels of short timescale variability (26 minutes). We conclude that this variability is likely caused by simplifications in the calibration strategy or ionospheric effects. On the timescale of one year we find two sources that show significant variability. We attribute this variability to either refractive scintillation or intrinsic variability. No radio transients were identified and we place an upper limit on the surface density of sources rho < 7.5 x 10^-5 deg^-2 with flux densities > 5.5 Jy, and characteristic timescales of both 26 minutes and one year.

Archival data from the HI Parkes All-Sky Survey (HIPASS) and the HI Zone of Avoidance (HIZOA) survey have been carefully reprocessed into a new 1.4GHz continuum map of the sky south of declination +25 deg. The wide sky coverage, high sensitivity of 40mK (limited by confusion), resolution of 14'.4 (compared to 51' for the Haslam et al. 408MHz and 35' for the Reich et al. 1.4GHz surveys), and low level of artefacts makes this map ideal for numerous studies, including: merging into interferometer maps to complete large-scale structures; decomposition of thermal and non-thermal emission components from Galactic and extragalactic sources; and comparison of emission regions with other frequencies. The new map is available for download.

We present new wide-field observations of Centaurus A (Cen A) and the surrounding region at 118 MHz with the Murchison Widefield Array (MWA) 32-tile prototype, with which we investigate the spectral-index distribution of Cen A's giant radio lobes. We compare our images to 1.4 GHz maps of Cen A and compute spectral indices using temperature-temperature plots and spectral tomography. We find that the morphologies at 118 MHz and 1.4 GHz match very closely apart from an extra peak in the southern lobe at 118 MHz, which provides tentative evidence for the existence of a southern counterpart to the northern middle lobe of Cen A. Our spatially-averaged spectral indices for both the northern and southern lobes are consistent with previous analyses, however we find significant spatial variation of the spectra across the extent of each lobe. Both the spectral-index distribution and the morphology at low radio frequencies support a scenario of multiple outbursts of activity from the central engine. Our results are consistent with inverse-Compton modelling of radio and gamma-ray data that supports a value for the lobe age of between 10 and 80 Myr.

The Murchison Widefield Array (MWA) is a new low frequency interferomeric radio telescope. The MWA is the low frequency precursor to the Square Kilometre Array (SKA) and is the first of three SKA precursors to be operational, supporting a varied science mission ranging from the attempted detection of the Epoch of Reionisation to the monitoring of solar flares and space weather. We explore the possibility that the MWA can be used for the purposes of Space Situational Awareness (SSA). In particular we propose that the MWA can be used as an element of a passive radar facility operating in the frequency range 87.5 - 108 MHz (the commercial FM broadcast band). In this scenario the MWA can be considered the receiving element in a bi-static radar configuration, with FM broadcast stations serving as non-cooperative transmitters. The FM broadcasts propagate into space, are reflected off debris in Earth orbit, and are received at the MWA. The imaging capabilities of the MWA can be used to simultaneously detect multiple pieces of space debris, image their positions on the sky as a function of time, and provide tracking data that can be used to determine orbital parameters. Such a capability would be a valuable addition to Australian and global SSA assets, in terms of southern and eastern hemispheric coverage. We provide a feasibility assessment of this proposal, based on simple calculations and electromagnetic simulations that shows the detection of sub-metre size debris should be possible (debris radius of >0.5 m to ~1000 km altitude). We also present a proof-of-concept set of observations that demonstrate the feasibility of the proposal, based on the detection and tracking of the International Space Station via reflected FM broadcast signals originating in south-west Western Australia. These observations broadly validate our calculations and simulations.

We present a Stokes I, Q and U survey at 189 MHz with the Murchison Widefield Array 32-element prototype covering 2400 square degrees. The survey has a 15.6 arcmin angular resolution and achieves a noise level of 15 mJy/beam. We demonstrate a novel interferometric data analysis that involves calibration of drift scan data, integration through the co-addition of warped snapshot images and deconvolution of the point spread function through forward modeling. We present a point source catalogue down to a flux limit of 4 Jy. We detect polarization from only one of the sources, PMN J0351-2744, at a level of 1.8 \pm 0.4%, whereas the remaining sources have a polarization fraction below 2%. Compared to a reported average value of 7% at 1.4 GHz, the polarization fraction of compact sources significantly decreases at low frequencies. We find a wealth of diffuse polarized emission across a large area of the survey with a maximum peak of ~13 K, primarily with positive rotation measure values smaller than +10 rad/m^2. The small values observed indicate that the emission is likely to have a local origin (closer than a few hundred parsecs). There is a large sky area at 2^h30^m where the diffuse polarized emission rms is fainter than 1 K. Within this area of low Galactic polarization we characterize the foreground properties in a cold sky patch at $(\alpha,\delta) = (4^h,-27^\circ.6)$ in terms of three dimensional power spectra

Significant new opportunities for astrophysics and cosmology have been identified at low radio frequencies. The Murchison Widefield Array is the first telescope in the Southern Hemisphere designed specifically to explore the low-frequency astronomical sky between 80 and 300 MHz with arcminute angular resolution and high survey efficiency. The telescope will enable new advances along four key science themes, including searching for redshifted 21 cm emission from the epoch of reionisation in the early Universe; Galactic and extragalactic all-sky southern hemisphere surveys; time-domain astrophysics; and solar, heliospheric, and ionospheric science and space weather. The Murchison Widefield Array is located in Western Australia at the site of the planned Square Kilometre Array (SKA) low-band telescope and is the only low-frequency SKA precursor facility. In this paper, we review the performance properties of the Murchison Widefield Array and describe its primary scientific objectives.

The Murchison Widefield Array is a low frequency (80 - 300 MHz) SKA Precursor, comprising 128 aperture array elements distributed over an area of 3 km diameter. The MWA is located at the extraordinarily radio quiet Murchison Radioastronomy Observatory in the mid-west of Western Australia, the selected home for the Phase 1 and Phase 2 SKA low frequency arrays. The MWA science goals include: 1) detection of fluctuations in the brightness temperature of the diffuse redshifted 21 cm line of neutral hydrogen from the epoch of reionisation; 2) studies of Galactic and extragalactic processes based on deep, confusion-limited surveys of the full sky visible to the array; 3) time domain astrophysics through exploration of the variable radio sky; and 4) solar imaging and characterisation of the heliosphere and ionosphere via propagation effects on background radio source emission. This paper will focus on a brief discussion of the as-built MWA system, highlighting several novel characteristics of the instrument, and a brief progress report (as of June 2012) on the final construction phase. Practical completion of the MWA is expected in November 2012, with commissioning commencing from approximately August 2012 and operations commencing near mid 2013. A brief description of recent science results from the MWA prototype instrument is given.

We present a high-performance, graphics processing unit (GPU)-based framework for the efficient analysis and visualization of (nearly) terabyte (TB)-sized 3-dimensional images. Using a cluster of 96 GPUs, we demonstrate for a 0.5 TB image: (1) volume rendering using an arbitrary transfer function at 7--10 frames per second; (2) computation of basic global image statistics such as the mean intensity and standard deviation in 1.7 s; (3) evaluation of the image histogram in 4 s; and (4) evaluation of the global image median intensity in just 45 s. Our measured results correspond to a raw computational throughput approaching one teravoxel per second, and are 10--100 times faster than the best possible performance with traditional single-node, multi-core CPU implementations. A scalability analysis shows the framework will scale well to images sized 1 TB and beyond. Other parallel data analysis algorithms can be added to the framework with relative ease, and accordingly, we present our framework as a possible solution to the image analysis and visualization requirements of next-generation telescopes, including the forthcoming Square Kilometre Array pathfinder radiotelescopes.

A new generation of low frequency radio telescopes is seeking to observe the redshifted 21 cm signal from the Epoch of Reionization (EoR), requiring innovative methods of calibration and imaging to overcome the difficulties of widefield low frequency radio interferometry. Precise calibration will be required to separate the small expected EoR signal from the strong foreground emission at the frequencies of interest between 80 and 300 MHz. The Moon may be useful as a calibration source for detection of the EoR signature, as it should have a smooth and predictable thermal spectrum across the frequency band of interest. Initial observations of the Moon with the Murchison Widefield Array 32 tile prototype show that the Moon does exhibit a similar trend to that expected for a cool thermally emitting body in the observed frequency range, but that the spectrum is corrupted by reflected radio emission from Earth. In particular, there is an abrupt increase in the observed flux density of the Moon within the internationally recognised Frequency Modulated (FM) radio band. The observations have implications for future low frequency surveys and EoR detection experiments that will need to take this reflected emission from the Moon into account. The results also allow us to estimate the equivalent isotropic power emitted by the Earth in the FM band and to determine how bright the Earth might appear at metre wavelengths to an observer beyond our own solar system.

Using the final 128 antenna locations of the Murchison Widefield Array (MWA), we calculate its sensitivity to the Epoch of Reionization (EoR) power spectrum of red- shifted 21 cm emission for a fiducial model and provide the tools to calculate the sensitivity for any model. Our calculation takes into account synthesis rotation, chro- matic and asymmetrical baseline effects, and excludes modes that will be contaminated by foreground subtraction. For the fiducial model, the MWA will be capable of a 14{\sigma} detection of the EoR signal with one full season of observation on two fields (900 and 700 hours).

We adapt a modern scheme of smoothed particle hydrodynamics (SPH) to our tree N-body/SPH galactic chemodynamics code GCD+. The applied scheme includes imple- mentations of the artificial viscosity switch and artificial thermal conductivity pro- posed by Morris & Monaghan (1997), Rosswog & Price (2007) and Price (2008), to model discontinuities and Kelvin-Helmholtz instabilities more accurately. We first present hydrodynamics test simulations and contrast the results to runs undertaken without artificial viscosity switch or thermal conduction. In addition, we also explore the different levels of smoothing by adopting larger or smaller smoothing lengths, i.e. a larger or smaller number of neighbour particles, Nnb. We demonstrate that the new version of GCD+ is capable of modelling Kelvin-Helmholtz instabilities to a simi- lar level as the mesh code, Athena. From the Gresho vortex, point-like explosion and self-similar collapse tests, we conclude that setting the smoothing length to keep the number of neighbour particles as high as Nnb~58 is preferable to adopting smaller smoothing lengths. We present our optimised parameter sets from the hydrodynamics tests.

We introduce the Fast Holographic Deconvolution method for analyzing interferometric radio data. Our new method is an extension of A-projection/software-holography/forward modeling analysis techniques and shares their precision deconvolution and widefield polarimetry, while being significantly faster than current implementations that use full direction-dependent antenna gains. Using data from the MWA 32 antenna prototype, we demonstrate the effectiveness and precision of our new algorithm. Fast Holographic Deconvolution may be particularly important for upcoming 21 cm cosmology observations of the Epoch of Reionization and Dark Energy where foreground subtraction is intimately related to the precision of the data reduction.

The Murchison Widefield Array (MWA) is one of three Square Kilometre Array Precursor telescopes and is located at the Murchison Radio-astronomy Observatory in the Murchison Shire of the mid-west of Western Australia, a location chosen for its extremely low levels of radio frequency interference. The MWA operates at low radio frequencies, 80-300 MHz, with a processed bandwidth of 30.72 MHz for both linear polarisations, and consists of 128 aperture arrays (known as tiles) distributed over a ~3 km diameter area. Novel hybrid hardware/software correlation and a real-time imaging and calibration systems comprise the MWA signal processing backend. In this paper the as-built MWA is described both at a system and sub-system level, the expected performance of the array is presented, and the science goals of the instrument are summarised.

We present a framework to interactively volume-render three-dimensional data cubes using distributed ray-casting and volume bricking over a cluster of workstations powered by one or more graphics processing units (GPUs) and a multi-core CPU. The main design target for this framework is to provide an in-core visualization solution able to provide three-dimensional interactive views of terabyte-sized data cubes. We tested the presented framework using a computing cluster comprising 64 nodes with a total of 128 GPUs. The framework proved to be scalable to render a 204 GB data cube with an average of 30 frames per second. Our performance analyses also compare between using NVIDIA Tesla 1060 and 2050 GPU architectures and the effect of increasing the visualization output resolution on the rendering performance. Although our initial focus, and the examples presented in this work, is volume rendering of spectral data cubes from radio astronomy, we contend that our approach has applicability to other disciplines where close to real-time volume rendering of terabyte-order 3D data sets is a requirement.

The Murchison Widefield Array (MWA) is a new low-frequency, wide field-of-view radio interferometer under development at the Murchison Radio-astronomy Observatory (MRO) in Western Australia. We have used a 32-element MWA prototype interferometer (MWA-32T) to observe two 50-degree diameter fields in the southern sky in the 110 MHz to 200 MHz band in order to evaluate the performance of the MWA-32T, to develop techniques for epoch of reionization experiments, and to make measurements of astronomical foregrounds. We developed a calibration and imaging pipeline for the MWA-32T, and used it to produce ~15' angular resolution maps of the two fields. We perform a blind source extraction using these confusion-limited images, and detect 655 sources at high significance with an additional 871 lower significance source candidates. We compare these sources with existing low-frequency radio surveys in order to assess the MWA-32T system performance, wide field analysis algorithms, and catalog quality. Our source catalog is found to agree well with existing low-frequency surveys in these regions of the sky and with statistical distributions of point sources derived from Northern Hemisphere surveys; it represents one of the deepest surveys to date of this sky field in the 110 MHz to 200 MHz band.

Antenna layout is an important design consideration for radio interferometers because it determines the quality of the snapshot point spread function (PSF, or array beam). This is particularly true for experiments targeting the 21 cm Epoch of Reionization signal as the quality of the foreground subtraction depends directly on the spatial dynamic range and thus the smoothness of the baseline distribution. Nearly all sites have constraints on where antennas can be placed---even at the remote Australian location of the MWA (Murchison Widefield Array) there are rock outcrops, flood zones, heritages areas, emergency runways and trees. These exclusion areas can introduce spatial structure into the baseline distribution that enhance the PSF sidelobes and reduce the angular dynamic range. In this paper we present a new method of constrained antenna placement that reduces the spatial structure in the baseline distribution. This method not only outperforms random placement algorithms that avoid exclusion zones, but surprisingly outperforms random placement algorithms without constraints to provide what we believe are the smoothest constrained baseline distributions developed to date. We use our new algorithm to determine antenna placements for the originally planned MWA, and present the antenna locations, baseline distribution, and snapshot PSF for this array choice.

Incoherent dedispersion is a computationally intensive problem that appears frequently in pulsar and transient astronomy. For current and future transient pipelines, dedispersion can dominate the total execution time, meaning its computational speed acts as a constraint on the quality and quantity of science results. It is thus critical that the algorithm be able to take advantage of trends in commodity computing hardware. With this goal in mind, we present analysis of the 'direct', 'tree' and 'sub-band' dedispersion algorithms with respect to their potential for efficient execution on modern graphics processing units (GPUs). We find all three to be excellent candidates, and proceed to describe implementations in C for CUDA using insight gained from the analysis. Using recent CPU and GPU hardware, the transition to the GPU provides a speed-up of 9x for the direct algorithm when compared to an optimised quad-core CPU code. For realistic recent survey parameters, these speeds are high enough that further optimisation is unnecessary to achieve real-time processing. Where further speed-ups are desirable, we find that the tree and sub-band algorithms are able to provide 3-7x better performance at the cost of certain smearing, memory consumption and development time trade-offs. We finish with a discussion of the implications of these results for future transient surveys. Our GPU dedispersion code is publicly available as a C library at: http://dedisp.googlecode.com/

Radio observations of galaxy clusters show that the intra cluster medium is permeated by \mu G magnetic fields. The origin and evolution of these cosmological magnetic fields is currently not well understood and so their impact on the dynamics of structure formation is not known. Numerical simulations are required to gain a greater understanding and produce predictions for the next generation of radio telescopes. We present the galactic chemodynamics smoothed particle magnetohydrodynamic (SPMHD) code (GCMHD+), which is an MHD implementation for the cosmological smoothed particle hydrodynamic code GCD+. The results of 1, 2 and 3 dimensional tests are presented and the performance of the code is shown relative to the ATHENA grid code. GCMHD+ shows good agreement with the reference solutions produced by ATHENA. The code is then used to simulate the formation of a galaxy cluster with a simple primordial magnetic field embedded in the gas. A homogeneous seed field of 10^-11 G is amplified by a factor of 10^3 during the formation of the cluster. The results show good agreement with the profiles found in other magnetic cluster simulations of similar resolution.

Exploration of the time-domain radio sky has huge potential for advancing our knowledge of the dynamic universe. Past surveys have discovered large numbers of pulsars, rotating radio transients and other transient radio phenomena; however, they have typically relied upon off-line processing to cope with the high data and processing rate. This paradigm rules out the possibility of obtaining high-resolution base-band dumps of significant events or of performing immediate follow-up observations, limiting analysis power to what can be gleaned from detection data alone. To overcome this limitation, real-time processing and detection of transient radio events is required. By exploiting the significant computing power of modern graphics processing units (GPUs), we are developing a transient-detection pipeline that runs in real-time on data from the Parkes radio telescope. In this paper we discuss the algorithms used in our pipeline, the details of their implementation on the GPU and the challenges posed by the presence of radio frequency interference.

Upcoming and future astronomy research facilities will systematically generate terabyte-sized data sets moving astronomy into the Petascale data era. While such facilities will provide astronomers with unprecedented levels of accuracy and coverage, the increases in dataset size and dimensionality will pose serious computational challenges for many current astronomy data analysis and visualization tools. With such data sizes, even simple data analysis tasks (e.g. calculating a histogram or computing data minimum/maximum) may not be achievable without access to a supercomputing facility. To effectively handle such dataset sizes, which exceed today's single machine memory and processing limits, we present a framework that exploits the distributed power of GPUs and many-core CPUs, with a goal of providing data analysis and visualizing tasks as a service for astronomers. By mixing shared and distributed memory architectures, our framework effectively utilizes the underlying hardware infrastructure handling both batched and real-time data analysis and visualization tasks. Offering such functionality as a service in a "software as a service" manner will reduce the total cost of ownership, provide an easy to use tool to the wider astronomical community, and enable a more optimized utilization of the underlying hardware infrastructure.

We have conducted an HI 21 cm emission-line survey of six loose groups of galaxies chosen to be analogs to the Local Group. The survey was conducted using the Parkes Multibeam instrument and the Australia Telescope Compact Array (ATCA) over a ~1 Mpc^2 area and covering the full depth of each group, with a M(HI) sensitivity of ~7x10^5 M(sun). Our survey detected 110 sources, 61 of which are associated with the six groups. All of these sources were confirmed with ATCA observations or were previously cataloged by HIPASS. The sources all have optical counterparts and properties consistent with dwarf irregular or late-type spiral galaxies. We present here the HI properties of the groups and their galaxies. We derive an HI mass function for the groups that is consistent with being flatter than the equivalent field HIMF. We also derive a circular velocity distribution function, tracing the luminous dark matter halos in the groups, that is consistent with those of the Local Group and HIPASS galaxies, both of which are shallower than that of clusters or predictions from CDM models of galaxy formation.

Structural parameters are normally extracted from observed galaxies by fitting analytic light profiles to the observations. Obtaining accurate fits to high-resolution images is a computationally expensive task, requiring many model evaluations and convolutions with the imaging point spread function. While these algorithms contain high degrees of parallelism, current implementations do not exploit this property. With evergrowing volumes of observational data, an inability to make use of advances in computing power can act as a constraint on scientific outcomes. This is the motivation behind our work, which aims to implement the model-fitting procedure on a graphics processing unit (GPU). We begin by analysing the algorithms involved in model evaluation with respect to their suitability for modern many-core computing architectures like GPUs, finding them to be well-placed to take advantage of the high memory bandwidth offered by this hardware. Following our analysis, we briefly describe a preliminary implementation of the model fitting procedure using freely-available GPU libraries. Early results suggest a speed-up of around 10x over a CPU implementation. We discuss the opportunities such a speed-up could provide, including the ability to use more computationally expensive but better-performing fitting routines to increase the quality and robustness of fits.

We present the first spectroscopic images of solar radio transients from the prototype for the Murchison Widefield Array (MWA), observed on 2010 March 27. Our observations span the instantaneous frequency band 170.9-201.6 MHz. Though our observing period is characterized as a period of `low' to `medium' activity, one broadband emission feature and numerous short-lived, narrowband, non-thermal emission features are evident. Our data represent a significant advance in low radio frequency solar imaging, enabling us to follow the spatial, spectral, and temporal evolution of events simultaneously and in unprecedented detail. The rich variety of features seen here reaffirms the coronal diagnostic capability of low radio frequency emission and provides an early glimpse of the nature of radio observations that will become available as the next generation of low frequency radio interferometers come on-line over the next few years.

The Australian SKA Pathfinder (ASKAP) will be producing 2.2 terabyte HI spectral-line cubes for each 8 hours of observation by 2013. Global views of spectral data cubes are vital for the detection of instrumentation errors, the identification of data artefacts and noise characteristics, and the discovery of strange phenomena, unexpected relations, or unknown patterns. We have previously presented the first framework that can render ASKAP-sized cubes at interactive frame rates. The framework provides the user with a real-time interactive volume rendering by combining shared and distributed memory architectures, distributed CPUs and graphics processing units (GPUs), using the ray-casting algorithm. In this paper we present two main extensions of this framework which are: using a multi-panel display system to provide a high resolution rendering output, and the ability to integrate automated data analysis tools into the visualization output and to interact with its output in place.

Visualisation and analysis of terabyte-scale datacubes, as will be produced with the Australian Square Kilometre Array Pathfinder (ASKAP), will pose challenges for existing astronomy software and the work practices of astronomers. Focusing on the proposed outcomes of WALLABY (Widefield ASKAP L-Band Legacy All-Sky Blind Survey), and using lessons learnt from HIPASS (HI Parkes All Sky Survey), we identify issues that astronomers will face with WALLABY data cubes. We comment on potential research directions and possible solutions to these challenges.

Using data from our Parkes & ATCA HI survey of six groups analogous to the Local Group, we find that the HI mass function and velocity distribution function for loose groups are the same as those for the Local Group. Both mass functions confirm that the "missing satellite" problem exists in other galaxy groups.

General purpose computing on graphics processing units (GPGPU) is dramatically changing the landscape of high performance computing in astronomy. In this paper, we identify and investigate several key decision areas, with a goal of simplyfing the early adoption of GPGPU in astronomy. We consider the merits of OpenCL as an open standard in order to reduce risks associated with coding in a native, vendor-specific programming environment, and present a GPU programming philosophy based on using brute force solutions. We assert that effective use of new GPU-based supercomputing facilities will require a change in approach from astronomers. This will likely include improved programming training, an increased need for software development best-practice through the use of profiling and related optimisation tools, and a greater reliance on third-party code libraries. As with any new technology, those willing to take the risks, and make the investment of time and effort to become early adopters of GPGPU in astronomy, stand to reap great benefits.

3D visualization is an important data analysis and knowledge discovery tool, however, interactive visualization of large 3D astronomical datasets poses a challenge for many existing data visualization packages. We present a solution to interactively visualize larger-than-memory 3D astronomical data cubes by utilizing a heterogeneous cluster of CPUs and GPUs. The system partitions the data volume into smaller sub-volumes that are distributed over the rendering workstations. A GPU-based ray casting volume rendering is performed to generate images for each sub-volume, which are composited to generate the whole volume output, and returned to the user. Datasets including the HI Parkes All Sky Survey (HIPASS - 12 GB) southern sky and the Galactic All Sky Survey (GASS - 26 GB) data cubes were used to demonstrate our framework's performance. The framework can render the GASS data cube with a maximum render time < 0.3 second with 1024 x 1024 pixels output resolution using 3 rendering workstations and 8 GPUs. Our framework will scale to visualize larger datasets, even of Terabyte order, if proper hardware infrastructure is available.

Astronomy depends on ever increasing computing power. Processor clock-rates have plateaued, and increased performance is now appearing in the form of additional processor cores on a single chip. This poses significant challenges to the astronomy software community. Graphics Processing Units (GPUs), now capable of general-purpose computation, exemplify both the difficult learning-curve and the significant speedups exhibited by massively-parallel hardware architectures. We present a generalised approach to tackling this paradigm shift, based on the analysis of algorithms. We describe a small collection of foundation algorithms relevant to astronomy and explain how they may be used to ease the transition to massively-parallel computing architectures. We demonstrate the effectiveness of our approach by applying it to four well-known astronomy problems: Hogbom CLEAN, inverse ray-shooting for gravitational lensing, pulsar dedispersion and volume rendering. Algorithms with well-defined memory access patterns and high arithmetic intensity stand to receive the greatest performance boost from massively-parallel architectures, while those that involve a significant amount of decision-making may struggle to take advantage of the available processing power.

Traditional analysis techniques may not be sufficient for astronomers to make the best use of the data sets that current and future instruments, such as the Square Kilometre Array and its Pathfinders, will produce. By utilizing the incredible pattern-recognition ability of the human mind, scientific visualization provides an excellent opportunity for astronomers to gain valuable new insight and understanding of their data, particularly when used interactively in 3D. The goal of our work is to establish the feasibility of a real-time 3D monitoring system for data going into the Australian SKA Pathfinder archive. Based on CUDA, an increasingly popular development tool, our work utilizes the massively parallel architecture of modern graphics processing units (GPUs) to provide astronomers with an interactive 3D volume rendering for multi-spectral data sets. Unlike other approaches, we are targeting real time interactive visualization of datasets larger than GPU memory while giving special attention to data with low signal to noise ratio - two critical aspects for astronomy that are missing from most existing scientific visualization software packages. Our framework enables the astronomer to interact with the geometrical representation of the data, and to control the volume rendering process to generate a better representation of their datasets.

Spectral datasets obtained at radio frequencies and optical/IR wavelengths are increasing in complexity as new facilities and instruments come online, resulting in an increased need to visualize and quantitatively analyze the velocity structures. As the visible structure in spectral data cubes is not purely spatial, additional insight is required to relate structures in 2D space plus line-of-sight velocity to their true three-dimensional (3D) structures. This can be achieved through the use of models that are converted to velocity-space representations. We have used the S2PLOT programming library to enable intuitive, interactive comparison between 3D models and spectral data, with potential for improved understanding of the spatial configurations. We also report on the use of 3D Cartesian shapelets to support quantitative analysis.

Astronomers have come to rely on the increasing performance of computers to reduce, analyze, simulate and visualize their data. In this environment, faster computation can mean more science outcomes or the opening up of new parameter spaces for investigation. If we are to avoid major issues when implementing codes on advanced architectures, it is important that we have a solid understanding of our algorithms. A recent addition to the high-performance computing scene that highlights this point is the graphics processing unit (GPU). The hardware originally designed for speeding-up graphics rendering in video games is now achieving speed-ups of $O(100\times)$ in general-purpose computation -- performance that cannot be ignored. We are using a generalized approach, based on the analysis of astronomy algorithms, to identify the optimal problem-types and techniques for taking advantage of both current GPU hardware and future developments in computing architectures.

We investigate the neutral hydrogen (HI) content of sixteen groups for which we have multi-wavelength data including X-ray observations. Wide-field imaging of the groups was obtained with the 20-cm multibeam system on the 64-m Parkes telescope. We have detected ten previously uncatalogued HI sources, one of which has no visible optical counterpart. We examine the HI properties of the groups, compared to their X-ray characteristics, finding that those groups with a higher X-ray temperature and luminosity contain less HI per galaxy. The HI content of a group depends on its morphological make-up, with those groups dominated by early-type galaxies containing the least total HI. We determined the expected HI for the spiral galaxies in the groups, and found that a number of the galaxies were HI deficient. The HI deficient spirals were found both in groups with and without a hot intra-group medium. The HI deficient galaxies were not necessarily found at the centre of the groups, however, we did find that two thirds of HI deficient galaxies were found within about 1 Mpc from the group centre, indicating that the group environment is affecting the gas-loss from these galaxies. We determined the HI mass function for a composite sample of 15 groups, and found that it is significantly flatter than the field HI mass function. We also find a lack of high HI-mass galaxies in groups. One possible cause of this effect is the tidal stripping of HI gas from spiral galaxies as they are pre-processed in groups.

Gravitational lensing calculation using a direct inverse ray-shooting approach is a computationally expensive way to determine magnification maps, caustic patterns, and light-curves (e.g. as a function of source profile and size). However, as an easily parallelisable calculation, gravitational ray-shooting can be accelerated using programmable graphics processing units (GPUs). We present our implementation of inverse ray-shooting for the NVIDIA G80 generation of graphics processors using the NVIDIA Compute Unified Device Architecture (CUDA) software development kit. We also extend our code to multiple-GPU systems, including a 4-GPU NVIDIA S1070 Tesla unit. We achieve sustained processing performance of 182 Gflop/s on a single GPU, and 1.28 Tflop/s using the Tesla unit. We demonstrate that billion-lens microlensing simulations can be run on a single computer with a Tesla unit in timescales of order a day without the use of a hierarchical tree code.

We demonstrate how interactive, three-dimensional (3-d) scientific visualizations can be efficiently interchanged between a variety of mediums. Through the use of an appropriate interchange format, and a unified interaction interface, we minimize the effort to produce visualizations appropriate for undertaking knowledge discovery at the astronomer's desktop, as part of conference presentations, in digital publications or as Web content. We use examples from cosmological visualization to address some of the issues of interchange, and to describe our approach to adapting S2PLOT desktop visualizations to the Web. Supporting demonstrations are available at http://astronomy.swin.edu.au/s2plot/interchange/

The forthcoming generation of radiotelescopes pose new and substantial challenges in terms of system monitoring. Information regarding environmental conditions, signal connectivity and level, processor utilisation, memory use, network traffic and even power consumption needs to be collected, displayed in realtime, and preserved in a permanent database. In this paper, we put forward the Ganglia monitoring system as a scalable, robust and efficient architecture that appears well-suited to the data collection aspect of radiotelescope monitoring, and we discuss approaches to the visual display of the streaming metric data produced by Ganglia. In particular, we present initial work in the use of 3-dimensional (3-d) multiplayer game technology for instantaneous status monitoring and enquiry, and we describe the extensions to this work required for radiotelescope monitoring.

Most research data collections created or used by astronomers are intrinsically multi-dimensional. In contrast, all visual representations of data presented within research papers are exclusively 2-dimensional. We present a resolution of this dichotomy that uses a novel technique for embedding 3-dimensional (3-d) visualisations of astronomy data sets in electronic-format research papers. Our technique uses the latest Adobe Portable Document Format extensions together with a new version of the S2PLOT programming library. The 3-d models can be easily rotated and explored by the reader and, in some cases, modified. We demonstrate example applications of this technique including: 3-d figures exhibiting subtle structure in redshift catalogues, colour-magnitude diagrams and halo merger trees; 3-d isosurface and volume renderings of cosmological simulations; and 3-d models of instructional diagrams and instrument designs.

We report on the detection of giant pulses from the Crab Nebula pulsar at a frequency of 200 MHz using the field deployment system designed for the Mileura Widefield Array's Low Frequency Demonstrator (MWA-LFD). Our observations are among the first high-quality detections at such low frequencies. The measured pulse shapes are deconvolved for interstellar pulse broadening, yielding a pulse-broadening time of 670$\pm$100 $\mu$s, and the implied strength of scattering (scattering measure) is the lowest that is estimated towards the Crab nebula from observations made so far. The sensitivity of the system is largely dictated by the sky background, and our simple equipment is capable of detecting pulses that are brighter than $\sim$9 kJy in amplitude. The brightest giant pulse detected in our data has a peak amplitude of $\sim$50 kJy, and the implied brightness temperature is $10^{31.6}$ K. We discuss the giant pulse detection prospects with the full MWA-LFD system. With a sensitivity over two orders of magnitude larger than the prototype equipment, the full system will be capable of detecting such bright giant pulses out to a wide range of Galactic distances; from $\sim$8 to $\sim$30 kpc depending on the frequency. The MWA-LFD will thus be a highly promising instrument for the studies of giant pulses and other fast radio transients at low frequencies.

We have conducted an HI 21 cm emission-line survey using the Parkes 20cm multibeam instrument and the Australia Telescope Compact Array (ATCA) of six loose groups of galaxies chosen to be analogs to the Local Group. The goal of this survey is to make a census of the HI-rich galaxies and high-velocity clouds (HVCs) within these groups and compare these populations with those in the Local Group. The Parkes observations covered the entire volume of each group with a rms M(HI) sensitivity of 4-10x10^5 M(sun) per 3.3 km/s channel. All potential sources detected in the Parkes data were confirmed with ATCA observations at ~2' resolution and the same M(sun) sensitivity. All the confirmed sources have associated stellar counterparts; no starless HI clouds--HVC analogs--were found in the six groups. In this paper, we present a description of the survey parameters, its sensitivity and completeness. Using the population of compact HVCs (CHVCs) around the Milky Way as a template coupled with the detailed knowledge of our survey parameters, we infer that our non-detection of CHVC analogs implies that, if similar populations exist in the six groups studied, the CHVCs must be clustered within 90 kpc of group galaxies, with average M(HI) < 4x10^5 M(sun) at the 95% confidence level. The corollary is that the same must apply to Milky Way CHVCs. This is consistent with our previous results from a smaller sample of groups, and in accordance with recent observational and theoretical constraints from other authors. These results confirm that there is very little neutral matter around galaxies, and that any substantial reservoir of baryons must be in other phases.

Experiments were performed with prototype antenna tiles for the Mileura Widefield Array--Low Frequency Demonstrator (MWA-LFD) to better understand the widefield, wideband properties of their design and to characterize the radio frequency interference (RFI) between 80 and 300 MHz at the site in Western Australia. Observations acquired during the six month deployment confirmed the predicted sensitivity of the antennas, sky-noise dominated system temperatures, and phase-coherent interferometric measurements. The radio spectrum is remarkably free of strong terrestrial signals, with the exception of two narrow frequency bands allocated to satellite downlinks and rare bursts due to ground-based transmissions being scattered from aircraft and meteor trails. Results indicate the potential of the MWA-LFD to make significant achievements in its three key science objectives: epoch of reionziation science, heliospheric science, and radio transient detection.

We present a new, three-dimensional (3D) plotting library with advanced features, and support for standard and enhanced display devices. The library - S2PLOT - is written in C and can be used by C, C++ and FORTRAN programs on GNU/Linux and Apple/OSX systems. S2PLOT draws objects in a 3D (x,y,z) Cartesian space and the user interactively controls how this space is rendered at run time. With a PGPLOT inspired interface, S2PLOT provides astronomers with elegant techniques for displaying and exploring 3D data sets directly from their program code, and the potential to use stereoscopic and dome display devices. The S2PLOT architecture supports dynamic geometry and can be used to plot time-evolving data sets, such as might be produced by simulation codes. In this paper, we introduce S2PLOT to the astronomical community, describe its potential applications, and present some example uses of the library.

The Northern HIPASS catalogue (NHICAT) is the northern extension of the HIPASS catalogue, HICAT (Meyer et al. 2004). This extension adds the sky area between the declination range of +2 deg < dec. < +25.5 deg to HICAT's declination range of -90 deg < dec. < +2 deg. HIPASS is a blind HI survey using the Parkes Radio Telescope covering 71% of the sky (including this northern extension) and a heliocentric velocity range of -1,280 km/s to 12,700 km/s . The entire Virgo Cluster region has been observed in the Northern HIPASS. The galaxy catalogue, NHICAT, contains 1002 sources with v_hel > 300 km/s . Sources with -300 km/s < v_hel < 300 km/s were excluded to avoid contamination by Galactic emission. In total, the entire HIPASS survey has found 5317 galaxies identified purely by their HI content. The full galaxy catalogue is publicly-available at <http://hipass.aus-vo.org>.

We present the results of our HI survey of six loose groups of galaxies analogous to the Local Group. The survey was conducted using the Parkes telescope and the Australia Telescope Compact Array to produce a census of all the gas-rich galaxies and potential analogs to the high-velocity clouds (HVCs) within these groups down to M(HI)<10^7 M(sun) as a test of models of galaxy formation. We present the HI mass function and halo mass function for these analogous groups and compare them with the Local Group and other environments. We also demonstrate that our non-detection of HVC analogs in these groups implies that they must have low HI masses and be clustered tightly around galaxies, including around our own Milky Way, and are not distributed throughout the Local Group.

The Westerbork Synthesis Radio Telescope finds a weak 21cm line emission feature at the coordinates (RA-Dec-velocity) of the sub-Damped Lyman-alpha absorber observed at z_abs=0.00632 in the spectrum of PG1216+069. The emission feature, WSRT-J121921+0639, lies within 30" of the quasar sightline, is detected at 99.8% (3 sigma) confidence level, has M_HI between 5 and 15x10^6 M_solar, and has velocity spread between 20 and 60 km/s. Other HI emitters in the field include VCC297 at a projected distance of 86/h_75 kpc and a previously unreported HI cloud, WSRT-J121919+0624 at 112/h_75 kpc with M_HI ~ 3x10^8 M_solar. The optically identified, foreground galaxy that is closest to the quasar sightline appears to be VCC339 (~L*/25) at 29/h_75 kpc and velocity offset 292 km/s . A low surface brightness galaxy with the HI mass of the sub-DLA absorber WSRT-J121921+0639 would likely have m_B ~ 17, and its diffuse optical emission would need to compete with the light of both the background QSO and a brighter foreground star ~10" from the QSO sight line.

We present the results of our HI survey of six loose groups of galaxies analogous to the Local Group. The survey was conducted using the Parkes telescope and the Australia Telescope Compact Array to produce a census of all the gas-rich galaxies and analogs to the high-velocity clouds (HVCs) within these groups down to M(HI) < 10^7 M(sun) as a test of models of galaxy formation. We present the HI mass function and halo mass function of the loose groups and show that they are consistent with those of the Local Group. We discuss the possible role of HVCs in solving the ``missing satellite'' problem and discuss the implications of our observations for models of galaxy formation.

The introduction of low-frequency radio arrays over the coming decade is expected to revolutionize the study of the reionization epoch. Observation of the contrast in redshifted 21cm emission between a large HII region and the surrounding neutral IGM will be the simplest and most easily interpreted signature. We find that an instrument like the planned Mileura Widefield Array Low-Frequency Demonstrator (LFD) will be able to obtain good signal to noise on HII regions around the most luminous quasars, and determine some gross geometric properties, e.g. whether the HII region is spherical or conical. A hypothetical follow-up instrument with 10 times the collecting area of the LFD (MWA-5000) will be capable of mapping the detailed geometry of HII regions, while SKA will be capable of detecting very narrow spectral features as well as the sharpness of the HII region boundary. The MWA-5000 will discover serendipitous HII regions in widefield observations. We estimate the number of HII regions which are expected to be generated by quasars. Assuming a late reionization at z~6 we find that there should be several tens of quasar HII regions larger than 4Mpc at z~6-8 per field of view. Identification of HII regions in forthcoming 21cm surveys can guide a search for bright galaxies in the middle of these regions. Most of the discovered galaxies would be the massive hosts of dormant quasars that left behind fossil HII cavities that persisted long after the quasar emission ended, owing to the long recombination time of intergalactic hydrogen. A snap-shot survey of candidate HII regions selected in redshifted 21cm image cubes may prove to be the most efficient method for finding very high redshift quasars and galaxies.

We present the largest catalogue to date of optical counterparts for HI radio-selected galaxies, Hopcat. Of the 4315 HI radio-detected sources from the HI Parkes All Sky Survey (Hipass) catalogue, we find optical counterparts for 3618 (84%) galaxies. Of these, 1798 (42%) have confirmed optical velocities and 848 (20%) are single matches without confirmed velocities. Some galaxy matches are members of galaxy groups. From these multiple galaxy matches, 714 (16%) have confirmed optical velocities and a further 258 (6%) galaxies are without confirmed velocities. For 481 (11%), multiple galaxies are present but no single optical counterpart can be chosen and 216 (5%) have no obvious optical galaxy present. Most of these 'blank fields' are in crowded fields along the Galactic plane or have high extinctions. Isolated 'Dark galaxy' candidates are investigated using an extinction cut of ABj < 1 mag and the blank fields category. Of the 3692 galaxies with an ABj extinction < 1 mag, only 13 are also blank fields. Of these, 12 are eliminated either with follow-up Parkes observations or are in crowded fields. The remaining one has a low surface brightness optical counterpart. Hence, no isolated optically dark galaxies have been found within the limits of the Hipass survey.

We present the results of a Parkes Multibeam HI survey of six loose groups of galaxies analogous to the Local Group. This survey was sensitive to HI-rich objects in these groups to below 10^7 M(sun) of HI, and was designed to search for low mass, gas-rich satellite galaxies and potential analogs to the high-velocity clouds seen around the Milky Way. This survey detected a total of 79 HI-rich objects associated with the six groups, half of which were new detections. While the survey identified a small number of dwarf galaxies, no star-free HI clouds were discovered. The HI mass function of the six groups appears to be roughly flat as is that of the Local Group. The cumulative velocity distribution function (CVDF) of the HI-rich halos in the six groups is identical to that of the Local Group. Both of these facts imply that these groups are true analogs to the Local Group and that the Local Group is not unique in its lack of low-mass dwarf galaxies as compared to the predictions of cold dark matter models of galaxy formation. This survey also constrains the distance to and HI masses of the compact high-velocity clouds (CHVCs) around the Milky Way. The lack of CHVC analog detections implies that they are distributed within <160 kpc of the Milky Way and have average HI masses of <4x10^5 M(sun). The spatial distribution of CHVCs is consistent with the predictions of simulations for dark matter halos. Furthermore the CVDF of Local Group galaxies plus CHVCs matches the predicted CVDF of cold dark matter simulations of galaxy formation. This provides circumstantial evidence that CHVCs may be associated with low-mass dark matter halos.

We report on neutral hydrogen observations of a ~ 5.5 x 5.5 degree field around the NGC 1566 galaxy group with the multibeam narrow-band system on the 64-m Parkes telescope. We detected thirteen HI sources in the field, including two galaxies not previously known to be members of the group, bringing the total number of confirmed galaxies in this group to 26. Each of the HI galaxies can be associated with an optically catalogued galaxy. No 'intergalactic HI clouds' were found to an HI mass limit of ~ 3.5 x 10^8 Msun. We have estimated the expected HI content of the late-type galaxies in this group and find the total detected HI is consistent with our expectations. However, while no global HI deficiency is inferred for this group, two galaxies exhibit individual HI deficiencies. Further observations are needed to determine the gas removal mechanisms in these galaxies.

The HI Parkes All Sky Survey (HIPASS) is a blind extragalactic HI 21-cm emission line survey covering the whole southern sky from declination -90 to +25. The HIPASS catalogue (HICAT), containing 4315 HI-selected galaxies from the region south of declination +2, is presented in Meyer et al. (2004a, Paper I). This paper describes in detail the completeness and reliability of HICAT, which are calculated from the recovery rate of synthetic sources and follow-up observations, respectively. HICAT is found to be 99 per cent complete at a peak flux of 84 mJy and an integrated flux of 9.4 Jy km/s. The overall reliability is 95 per cent, but rises to 99 per cent for sources with peak fluxes >58 mJy or integrated flux > 8.2 Jy km/s. Expressions are derived for the uncertainties on the most important HICAT parameters: peak flux, integrated flux, velocity width, and recessional velocity. The errors on HICAT parameters are dominated by the noise in the HIPASS data, rather than by the parametrization procedure.

The HI Parkes All-Sky Survey (HIPASS) Catalogue forms the largest uniform catalogue of HI sources compiled to date, with 4,315 sources identified purely by their HI content. The catalogue data comprise the southern region declination <+2 deg of HIPASS, the first blind HI survey to cover the entire southern sky. RMS noise for this survey is 13 mJy/beam and the velocity range is -1,280 to 12,700 km/s. Data search, verification and parametrization methods are discussed along with a description of measured quantities. Full catalogue data are made available to the astronomical community including positions, velocities, velocity widths, integrated fluxes and peak flux densities. Also available are on-sky moment maps, position-velocity moment maps and spectra of catalogue sources. A number of local large-scale features are observed in the space distribution of sources including the Super-Galactic plane and the Local Void. Notably, large-scale structure is seen at low Galactic latitudes, a region normally obscured at optical wavelengths.

High-velocity clouds (HVCs) are clouds of HI seen around the Milky Way with velocities inconsistent with Galactic rotation, have unknown distances and masses and controversial origins. One possibility is that HVCs are associated with the small dark matter halos seen in models of galaxy formation and distributed at distances of 150 kpc - 1 Mpc. We report on our attempts to detect the analogs to such putative extragalactic clouds in three groups of galaxies similar to our own Local Group using the ATNF Parkes telescope and Compact Array. Eleven dwarf galaxies were found, but no HI clouds lacking stars were detected. Using the population of compact HVCs around the Milky Way as a template, we find that our non-detection of analogs implies that they must be clustered within 160 kpc of the Milky Way (and other galaxies) with an average HI mass <4x10^5 M(sun) at the 95% confidence level. This is in accordance with recent limits derived by other authors. If our groups are true analogs to the Local Group, then this makes the original Blitz et al. and Braun & Burton picture of HVCs residing out to 1 Mpc from the Milky Way extremely unlikely. The total HI mass in HVCs, < 10^8 M(sun), implies that there is not a large reservoir of neutral hydrogen waiting to be accreted onto the Milky Way. Any substantial reservoir of baryonic matter must be mostly ionized or condensed enough as to be undetectable.

The HI content of Hickson Compact Groups in the southern hemisphere is measured using data from the HI Parkes All Sky Survey (HIPASS), and dedicated observations using the narrowband filter on the Multibeam instrument on the Parkes telescope. The expected HI mass of these groups was estimated using the luminosity, diameter and morphological types of the member galaxies, calibrated from published data. Taking careful account of non-detection limits, the results show that the compact group population that has been detected by these observations has an HI content similar to that of galaxies in the reference field sample. The upper limits for the undetected groups lie within the normal range; improvement of these limits will require a large increase in sensitivity.

We present the results of neutral hydrogen (HI) observations of the NGC 5044 and NGC 1052 groups, as part of a GEMS (Group Evolution Multiwavelength Study) investigation into the formation and evolution of galaxies in nearby groups. Two new group members have been discovered during a wide-field HI imaging survey conducted using the ATNF Parkes telescope. These results, as well as those from followup HI synthesis and optical imaging, are presented here. J1320-1427, a new member of the NGC 5044 Group, has an HI mass of M_HI=1.05e9Msun and M_HI/L_B=1.65 Msun/Lsun, with a radial velocity of v=2750km/s. The optical galaxy is characterised by two regions of star formation, surrounded by an extended, diffuse halo. J0249-0806, the new member of the NGC 1052 Group, has M_HI=5.4e8Msun, M_HI/L_R=1.13 Msun/Lsun and v=1450km/s. The optical image reveals a low surface brightness galaxy. We interpret both of these galaxies as irregular type, with J0249-0806 possibly undergoing first infall into the NGC 1052 group.

Many signal processing problems can be solved by maximizing the fitness of a segmented model over all possible partitions of the data interval. This letter describes a simple but powerful algorithm that searches the exponentially large space of partitions of $N$ data points in time $O(N^2)$. The algorithm is guaranteed to find the exact global optimum, automatically determines the model order (the number of segments), has a convenient real-time mode, can be extended to higher dimensional data spaces, and solves a surprising variety of problems in signal detection and characterization, density estimation, cluster analysis and classification.

We present results from our Parkes Multibeam HI survey of 3 loose groups of galaxies that are analogous to the Local Group. This is a survey of groups containing only spiral galaxies with mean separations of a few hundred kpc, and total areas of approximately 1 sq. Mpc; groups similar to our own Local Group. We present a census of the HI-rich objects in these groups down to an M(HI), 1-sigma sensitivity ~7x10^5 M(sun), as well as the detailed properties of these detections from follow-up Compact Array observations. We found 7 new HI-rich members in the 3 groups, all of which have stellar counterparts and are, therefore, typical dwarf galaxies. The ratio of low-mass to high-mass gas-rich galaxies in these groups is less than in the Local Group meaning that the ``missing satellite'' problem is not unique. No high-velocity cloud analogs were found in any of the groups. If HVCs in these groups are the same as in the Local Group, this implies that HVCs must be located within ~300-400 kpc of the Milky Way.

Radio maps at 21 cm of foreground neutral hydrogen over three cooling flow clusters of galaxies show that the foreground gas is uniform on scales from about 1 -- 10 arcmin. Five sigma limits on fluctuations in the foreground column density for Abell 3581, Sersic 159-03 and Abell 2597 are 6.2e19, 7.8e19 and 4.3e19 per sq cm, or 14, 43 and 17 per cent of the mean foreground column density in the region of the system, respectively. Fluctuations in the column density of neutral gas in the Galaxy are unlikely to account for any excesses of photoelectric absorption in these or other cooling flow clusters. Fluctuations in the foreground neutral gas on arcminute scales are also unlikely to be the cause of excess EUV and soft X-ray emission from clusters.

We present a new accurate measurement of the HI mass function of galaxies from the HIPASS Bright Galaxy Catalog, a sample of 1000 galaxies with the highest HI peak flux densities in the southern hemisphere (Koribalski et al. 2003). This sample spans nearly four orders of magnitude in HI mass (from log M_HI/M_sun=6.8 to 10.6, H0=75) and is the largest sample of HI selected galaxies to date. We develop a bivariate maximum likelihood technique to measure the space density of galaxies, and show that this is a robust method, insensitive to the effects of large scale structure. The resulting HI mass function can be fitted satisfactorily with a Schechter function with faint-end slope alpha=-1.30. This slope is found to be dependent on morphological type, with later type galaxies giving steeper slopes. We extensively test various effects that potentially bias the determination of the HI mass function, including peculiar motions of galaxies, large scale structure, selection bias, and inclination effects, and quantify these biases. The large sample of galaxies enables an accurate measurement of the cosmological mass density of neutral gas: Omega_HI=(3.8 +/- 0.6) x 10^{-4}. Low surface brightness galaxies contribute only 15% to this value, consistent with previous findings.

We present preliminary results from a study of the neutral hydrogen (HI) properties of an X-ray selected sample of nearby loose galaxy groups. This forms part of a multi-wavelength investigation (X-ray, optical and radio) of the formation and evolution of galaxies within a group environment. Some initial findings of an ATNF Parkes Multibeam wide-area neutral hydrogen imaging survey of 17 nearby galaxy groups include two new, potentially isolated clouds of HI in the NGC 1052 and NGC 5044 groups and significant amounts of HI within the group virial radii of groups NGC 3557 and IC 1459 - two groups with complex X-ray structures that suggest they may still be in the act of virialisation. Here we present ATCA high-resolution synthesis-imaging follow-up observations of the distribution and kinematics of HI in these four groups.

Using HIPASS data, we have searched for HI in a ~25x25 sq.deg. region centred on the Fornax cluster. Within a velocity search range of 300 - 3700 km/s and a lower flux limit of ~40 mJy, 110 galaxies with HI emission were detected, one of which is previously uncatalogued. None of the detections has early-type morphology. Previously unknown velocities for 14 galaxies have been determined, with a further 4 velocity measurements being significantly dissimilar to published values. Identification of an optical counterpart is relatively unambiguous for more than ~90% of our HI galaxies. The galaxies appear to be embedded in a sheet at the cluster velocity which extends for more than 30 deg across the search area. At the nominal cluster distance of ~20 Mpc, this corresponds to an elongated structure more than 10 Mpc in extent. A velocity gradient across the structure is detected, with radial velocities increasing by \~500 km/s from SE to NW. The clustering of galaxies evident in optical surveys is only weakly suggested in the spatial distribution of our HI detections. Our results suggest a considerable deficit of HI-rich galaxies in the centre of the cluster. However, relative to the field, there is a 3(+/-1)-fold excess of HI-rich galaxies in the outer parts of the cluster where galaxies may be infalling towards the cluster for the first time.

The Magellanic Stream is a 100\deg x 10\deg filament of gas which lies within the Galactic halo and contains ~ 2 x 10^8 \Msun of neutral hydrogen. We present data from the HI Parkes All Sky Survey (HIPASS) in the first complete survey of the entire Magellanic Stream and its surroundings. We also present a summary of the reprocessing techniques used to recover large-scale structure in the Stream. The Stream properties revealed include: bifurcation along the main Stream filament; dense, isolated clouds which follow the entire length of the Stream; head-tail structures; and a complex filamentary web at the head where gas is being freshly stripped away from the Small Magellanic Cloud and the Bridge. Debris which appears to be of Magellanic origin extends out to 20\deg from the main Stream filaments. The large number of elongated Stream clouds suggests the presence of shearing motions within the Stream, arising from tidal forces or interaction with the tenuous Galactic halo. Clouds along the sightline to the less distant half of the Sculptor Group, show anomalous properties. We argue that these clouds represent halo material, and are not distant Sculptor Group clouds. This result has significant implications for the hypothesis that there might exist distant, massive HVCs within the Local Group. (abridged)

The HI Parkes All-Sky Survey (HIPASS) is a blind 21-cm survey for extragalactic neutral hydrogen, covering the whole southern sky. The HIPASS Bright Galaxy Catalog (BGC; Koribalski et al. 2002) is a subset of HIPASS and contains the 1000 HI-brightest (peak flux density) galaxies. Here we present the 138 HIPASS BGC galaxies, which had no redshift measured prior to the Parkes multibeam HI surveys. Of the 138 galaxies, 87 are newly cataloged. Newly cataloged is defined as no optical (or infrared) counterpart in the NASA/IPAC Extragalactic Database. Using the Digitized Sky Survey we identify optical counterparts for almost half of the newly cataloged galaxies, which are typically of irregular or magellanic morphological type. Several HI sources appear to be associated with compact groups or pairs of galaxies rather than an individual galaxy. The majority (57) of the newly cataloged galaxies lie within ten degrees of the Galactic Plane and are missing from optical surveys due to confusion with stars or dust extinction. This sample also includes newly cataloged galaxies first discovered in the HI shallow survey of the Zone-of-Avoidance (Henning et al. 2000). The other 30 newly cataloged galaxies escaped detection due to their low surface brightness or optical compactness. Only one of these, HIPASS J0546-68, has no obvious optical counterpart as it is obscured by the Large Magellanic Cloud. We find that the newly cataloged galaxies with |b| > 10 are generally lower in HI mass and narrower in velocity width compared with the total HIPASS BGC. In contrast, newly cataloged galaxies behind the Milky Way are found to be statistically similar to the entire HIPASS BGC. In addition to these galaxies, the HIPASS BGC contains four previously unknown HI clouds.

A new kind of dynamo utilizing flowing laboratory plasmas has been identified. Conversion of plasma kinetic energy to magnetic energy is verified numerically by kinematic dynamo simulations for magnetic Reynolds numbers above 210. As opposed to intrinsically-turbulent liquid-sodium dynamos, the proposed plasma dynamos correspond to laminar flow topology. Modest plasma parameters, 1-20 eV temperatures, 10^{19}-10^{20} m^{-3} densities in 0.3-1.0 m scale-lengths driven by velocities on the order of the Alfven Critical Ionization Velocity (CIV), self-consistently satisfy the conditions needed for the magnetic field amplication. Growth rates for the plasma dynamos are obtained numerically with different geometry and magnetic Reynolds numbers. Magnetic-field-free coaxial plasma guns can be used to sustain the plasma flow and the dynamo.

A catalog of Southern anomalous-velocity HI clouds at Decl. < +2 deg is presented, based on data from the HI Parkes All-Sky Survey (HIPASS). The improved sensitivity (5sigma: T_B = 0.04 K) and resolution (15.5') of the HIPASS data results in a substantial increase in the number of individual clouds (1956, as well as 41 galaxies) compared to previous surveys. Most high-velocity emission features, HVCs, have a filamentary morphology and are loosely organized into large complexes extending over tens of degrees. In addition, 179 compact and isolated anomalous-velocity objects, CHVCs, are identified based on their size and degree of isolation. 25% of the CHVCs originally classified by Braun & Burton (1999) are reclassified. Both the entire population of high-velocity emission features and the CHVCs alone have typical HI masses of ~ 4.5 D(kpc)^2 solar masses and have similar slopes for their column density and flux distributions. On the other hand, the CHVCs appear to be clustered and the population can be broken up into three spatially distinct groups, while the entire population of clouds is more uniformly distributed with a significant percentage aligned with the Magellanic Stream. The median velocities are V_GSR = -38 km/s for the CHVCs and -30 km/s for all of the anomalous-velocity clouds. Based on the catalog sizes, high-velocity features cover 19% of the southern sky and CHVCs cover 1%. (abridged)

As part of a continuing survey of nearby galaxies, we have mapped the neutral gas content of the low surface brightness, Magellanic-type galaxy NGC 3109 --- and its environment, including the Antlia dwarf galaxy --- at unprecedented velocity resolution and brightness sensitivity. The HI mass of NGC 3109 is measured to be (3.8 +/- 0.5) x 10^8 Msun. A substantial warp in the disk of NGC 3109 is detected in the HI emission image in the form of an extended low surface brightness feature. We report a positive detection in HI of the nearby Antlia dwarf galaxy, and measure its total neutral gas mass to be (6.8 +/- 1.4) x 10^5 Msun. We show the warp in NGC 3109 to lie at exactly the same radial velocity as the gas in the Antlia dwarf galaxy and speculate that Antlia disturbed the disk of NGC 3109 during a mild encounter ~1 Gyr in the past. HI data for a further eight galaxies detected in the background are presented.

We report the discovery, from the HI Parkes All-Sky Survey (HIPASS), of a gas cloud associated with the asymmetric spiral galaxy NGC 2442. This object, designated HIPASS J0731-69, contains ~10^9 M_sun of HI, or nearly one-third as much atomic gas as NGC 2442 itself. No optical counterpart to any part of HIPASS J0731-69 has yet been identified, consistent with the gas being diffuse, and with its stream-like kinematics. If the gas in HIPASS J0731-69 was once part of NGC 2442, then it was most likely a fairly recent tidal encounter with a moderately massive companion which tore it loose, although the possibility of ram-pressure stripping cannot be ruled out. This discovery highlights the potential of the HIPASS data for yielding new clues to the nature of some of the best-known galaxies in the local universe.

We are using the Multibeam 21cm receiver on the Parkes Telescope combined with the optical Two degree Field spectrograph (2dF) of the Anglo-Australian Telescope to obtain the first complete spectroscopic sample of the Fornax cluster. In the optical the survey is unique in that all objects (both ``stars'' and ``galaxies'') within our magnitude limits (Bj=16.5 to 19.7) are measured, producing the most complete survey of cluster members irrespective of surface brightness. We have detected two new classes of high surface brightness dwarf galaxy in the cluster. With 2dF we have discovered a population of very low luminosity (Mb approx -12) objects which are unresolved from the ground and may be the stripped nuclei of dwarf galaxies; they are unlike any known galaxies. In a survey of the brighter (Bj=16.5 to 18) galaxies with the FLAIR-II spectrograph we have found a number of new high surface brightness dwarf galaxies and show that the fraction of star-forming dwarf galaxies in the cluster is about 30 per cent, about twice that implied by earlier morphological classifications. Our radio observations have greatly improved upon the sensitivity of the standard Multibeam survey by using a new ``basket weave'' scanning pattern. Our initial analysis shows that we are detecting new cluster members with HI masses of order 10-to-the-8 Msun and HI mass-to-light ratios of 1-2 Msun/Lsun.

We have commenced a 21-cm survey of the entire southern sky (\delta < 0 degrees, -1200 km/s < v < 12700 km/s) which is ''blind'', i.e. unbiased by previous optical information. In the present paper we report on the results of a pilot project which is based on data from this all-sky survey. The project was carried out on an area of 600 square degrees centred on the nearby Centaurus A (Cen A) group of galaxies at a mean velocity of v ~ 500 km/s. This was recently the subject of a separate and thorough optical survey. We found 10 new group members to add to the 21 galaxies already known in the Cen A group: five of these are previously uncatalogued galaxies, while five were previously catalogued but not known to be associated with the group. We found optical counterparts for all the HI detections, most of them intrinsically very faint low surface brightness dwarfs. The new group members add approximately 6% to the HI mass of the group and 4% to its light. The HI mass function, derived from all the known group galaxies in the interval 10^7 \Msun of HI to 10^9 \Msun of HI, has a faint-end slope of 1.30 +/- 0.15, allowing us to rule out a slope of 1.7 at 95% confidence. Even if the number in the lowest mass bin is increased by 50%, the slope only increases to 1.45 +/- 0.15.

Interactions between galaxies are common and are an important factor in determining their physical properties such as position along the Hubble sequence and star-formation rate. There are many possible galaxy interaction mechanisms, including merging, ram-pressure stripping, gas compression, gravitational interaction and cluster tides. The relative importance of these mechanisms is often not clear, as their strength depends on poorly known parameters such as the density, extent and nature of the massive dark halos that surround galaxies. A nearby example of a galaxy interaction where the mechanism is controversial is that between our own Galaxy and two of its neighbours -- the Large and Small Magellanic Clouds. Here we present the first results of a new HI survey which provides a spectacular view of this interaction. In addition to the previously known Magellanic Stream, which trails 100 degrees behind the Clouds, the new data reveal a counter-stream which lies in the opposite direction and leads the motion of the Clouds. This result supports the gravitational model in which leading and trailing streams are tidally torn from the body of the Magellanic Clouds.