We demonstrate the effectiveness of a relatively straightforward analysis of the complex 3D Fourier transform of galaxy coordinates derived from redshift surveys. Numerical demonstrations of this approach are carried out on a volume-limited sample of the Sloan Digital Sky Survey redshift survey. The direct unbinned transform yields a complex 3D data cube quite similar to that from the Fast Fourier Transform (FFT) of finely binned galaxy positions. In both cases deconvolution of the sampling window function yields estimates of the true transform. Simple power spectrum estimates from these transforms are roughly consistent with those using more elaborate methods. However we concentrate on the less often studied Fourier phase spectrum, a simple and general framework for characterizing non-Gaussianity, more easily interpretable than the tangled, incomplete multi-point methods conventionally used. No significant signature of non-Gaussianity has been found in the relatively small data set analyzed, but we identify some threads of modern large scale inference methodology that will presumably yield detections in new wider and deeper surveys.

The major uncertainties in studies of the multi-scale structure of the Universe arise not from observational errors but from the variety of legitimate definitions and detection methods for individual structures. To facilitate the study of these methodological dependencies we have carried out 12 different analyses defining structures in various ways. This has been done in a purely geometrical way by utilizing the HOP algorithm as a unique parameter-free method of assigning groups of galaxies to local density maxima or minima. From three density estimation techniques (smoothing kernels, Bayesian Blocks and self organizing maps) applied to three data sets (the Sloan Digital Sky Survey Data Release 7, the Millennium Simulation and randomly distributed points) we tabulate information that can be used to construct catalogs of structures connected to local density maxima and minima. The resulting sizes follow continuous multi-scale distributions with no indication of the presence of a discrete hierarchy. We also introduce a novel void finder that utilizes a method to assemble Delaunay tetrahedra into connected structures and characterizes regions very nearly empty of galaxies in the source catalog.

Three methods for detecting and characterizing structure in point data, such as that generated by redshift surveys, are described: classification using self-organizing maps, segmentation using Bayesian blocks, and density estimation using adaptive kernels. The first two methods are new, and allow detection and characterization of structures of arbitrary shape and at a wide range of spatial scales. These methods should elucidate not only clusters, but also the more distributed, wide-ranging filaments and sheets, and further allow the possibility of detecting and characterizing an even broader class of shapes. The methods are demonstrated and compared in application to three data sets: a carefully selected volume-limited sample from the Sloan Digital Sky Survey redshift data, a similarly selected sample from the Millennium Simulation, and a set of points independently drawn from a uniform probability distribution -- a so-called Poisson distribution. We demonstrate a few of the many ways in which these methods elucidate large scale structure in the distribution of galaxies in the nearby Universe.

Scientific data sets continue to increase in both size and complexity. In the past, dedicated graphics systems at supercomputing centers were required to visualize large data sets, but as the price of commodity graphics hardware has dropped and its capability has increased, it is now possible, in principle, to view large complex data sets on a single workstation. To do this in practice, an investigator will need software that is written to take advantage of the relevant graphics hardware. The Viewpoints visualization package described herein is an example of such software. Viewpoints is an interactive tool for exploratory visual analysis of large, high-dimensional (multivariate) data. It leverages the capabilities of modern graphics boards (GPUs) to run on a single workstation or laptop. Viewpoints is minimalist: it attempts to do a small set of useful things very well (or at least very quickly) in comparison with similar packages today. Its basic feature set includes linked scatter plots with brushing, dynamic histograms, normalization and outlier detection/removal. Viewpoints was originally designed for astrophysicists, but it has since been used in a variety of fields that range from astronomy, quantum chemistry, fluid dynamics, machine learning, bioinformatics, and finance to information technology server log mining. In this article, we describe the Viewpoints package and show examples of its usage.

The Kepler Mission, launched on Mar 6, 2009 was designed with the explicit capability to detect Earth-size planets in the habitable zone of solar-like stars using the transit photometry method. Results from just forty-three days of data along with ground-based follow-up observations have identified five new transiting planets with measurements of their masses, radii, and orbital periods. Many aspects of stellar astrophysics also benefit from the unique, precise, extended and nearly continuous data set for a large number and variety of stars. Early results for classical variables and eclipsing stars show great promise. To fully understand the methodology, processes and eventually the results from the mission, we present the underlying rationale that ultimately led to the flight and ground system designs used to achieve the exquisite photometric performance. As an example of the initial photometric results, we present variability measurements that can be used to distinguish dwarf stars from red giants.

The Kepler Mission relies on precise differential photometry to detect the 80 parts per million (ppm) signal from an Earth-Sun equivalent transit. Such precision requires superb instrument stability on time scales up to ~2 days and systematic error removal to better than 20 ppm. To this end, the spacecraft and photometer underwent 67 days of commissioning, which included several data sets taken to characterize the photometer performance. Because Kepler has no shutter, we took a series of dark images prior to the dust cover ejection, from which we measured the bias levels, dark current, and read noise. These basic detector properties are essentially unchanged from ground-based tests, indicating that the photometer is working as expected. Several image artifacts have proven more complex than when observed during ground testing, as a result of their interactions with starlight and the greater thermal stability in flight, which causes the temperature-dependent artifact variations to be on the timescales of transits. Because of Kepler's unprecedented sensitivity and stability, we have also seen several unexpected systematics that affect photometric precision. We are using the first 43 days of science data to characterize these effects and to develop detection and mitigation methods that will be implemented in the calibration pipeline. Based on early testing, we expect to attain Kepler's planned photometric precision over 80%-90% of the field of view.

Expanding upon the work of Way and Srivastava 2006 we demonstrate how the use of training sets of comparable size continue to make Gaussian process regression (GPR) a competitive approach to that of neural networks and other least-squares fitting methods. This is possible via new large size matrix inversion techniques developed for Gaussian processes (GPs) that do not require that the kernel matrix be sparse. This development, combined with a neural-network kernel function appears to give superior results for this problem. Our best fit results for the Sloan Digital Sky Survey (SDSS) Main Galaxy Sample using u,g,r,i,z filters gives an rms error of 0.0201 while our results for the same filters in the luminous red galaxy sample yield 0.0220. We also demonstrate that there appears to be a minimum number of training-set galaxies needed to obtain the optimal fit when using our GPR rank-reduction methods. We find that morphological information included with many photometric surveys appears, for the most part, to make the photometric redshift evaluation slightly worse rather than better. This would indicate that most morphological information simply adds noise from the GP point of view in the data used herein. In addition, we show that cross-match catalog results involving combinations of the Two Micron All Sky Survey, SDSS, and Galaxy Evolution Explorer have to be evaluated in the context of the resulting cross-match magnitude and redshift distribution. Otherwise one may be misled into overly optimistic conclusions.