We model the long-term XUV luminosity of TRAPPIST-1 to constrain the evolving high-energy radiation environment experienced by its planetary system. Using Markov Chain Monte Carlo (MCMC), we derive probabilistic constraints for TRAPPIST-1's stellar and XUV evolution that account for observational uncertainties, degeneracies between model parameters, and empirical data of low-mass stars. We constrain TRAPPIST-1's mass to $m_{\star} = 0.089 \pm{0.001}$ M$_{\odot}$ and find that its early XUV luminosity likely saturated at $\log_{10}(L_{XUV}/L_{bol}) = -3.03^{+0.23}_{-0.12}$. From the posterior distribution, we infer that there is a ${\sim}40\%$ chance that TRAPPIST-1 is still in the saturated phase today, suggesting that TRAPPIST-1 has maintained high activity and $L_{XUV}/L_{bol} \approx 10^{-3}$ for several Gyrs. TRAPPIST-1's planetary system therefore likely experienced a persistent and extreme XUV flux environment, potentially driving significant atmospheric erosion and volatile loss. The inner planets likely received XUV fluxes ${\sim}10^3 - 10^4\times$ that of the modern Earth during TRAPPIST-1's ${\sim}1$ Gyr-long pre-main sequence phase. Deriving these constraints via MCMC is computationally non-trivial, so scaling our methods to constrain the XUV evolution of a larger number of M dwarfs that harbor terrestrial exoplanets would incur significant computational expenses. We demonstrate that approxposterior, an open source Python machine learning package for approximate Bayesian inference using Gaussian processes, accurately and efficiently replicates our analysis using $980\times$ less computational time and $1330\times$ fewer simulations than MCMC sampling using emcee. We find that approxposterior derives constraints with mean errors on the best fit values and $1\sigma$ uncertainties of $0.61\%$ and $5.5\%$, respectively, relative to emcee.

In this paper we apply ideas from information theory to create a method for the design of optimal filters for photometric redshift estimation. We show the method applied to a series of simple example filters in order to motivate an intuition for how photometric redshift estimators respond to the properties of photometric passbands. We then design a realistic set of six filters covering optical wavelengths that optimize photometric redshifts for $z <= 2.3$ and $i < 25.3$. We create a simulated catalog for these optimal filters and use our filters with a photometric redshift estimation code to show that we can improve the standard deviation of the photometric redshift error by 7.1% overall and improve outliers 9.9% over the standard filters proposed for the Large Synoptic Survey Telescope (LSST). We compare features of our optimal filters to LSST and find that the LSST filters incorporate key features for optimal photometric redshift estimation. Finally, we describe how information theory can be applied to a range of optimization problems in astronomy.

Machine learning algorithms are highly useful for the classification of time series data in astronomy in this era of peta-scale public survey data releases. These methods can facilitate the discovery of new unknown events in most astrophysical areas, as well as improving the analysis of samples of known phenomena. Machine learning algorithms use features extracted from collected data as input predictive variables. A public tool called Feature Analysis for Time Series (FATS) has proved an excellent workhorse for feature extraction, particularly light curve classification for variable objects. In this study, we present a major improvement to FATS, which corrects inconvenient design choices, minor details, and documentation for the re-engineering process. This improvement comprises a new Python package called "feets", which is important for future code-refactoring for astronomical software tools.

The Astropy project supports and fosters the development of open-source and openly-developed Python packages that provide commonly-needed functionality to the astronomical community. A key element of the Astropy project is the core package Astropy, which serves as the foundation for more specialized projects and packages. In this article, we provide an overview of the organization of the Astropy project and summarize key features in the core package as of the recent major release, version 2.0. We then describe the project infrastructure designed to facilitate and support development for a broader ecosystem of inter-operable packages. We conclude with a future outlook of planned new features and directions for the broader Astropy project.

Across almost all scientific disciplines, the instruments that record our experimental data and the methods required for storage and data analysis are rapidly increasing in complexity. This gives rise to the need for scientific communities to adapt on shorter time scales than traditional university curricula allow for, and therefore requires new modes of knowledge transfer. The universal applicability of data science tools to a broad range of problems has generated new opportunities to foster exchange of ideas and computational workflows across disciplines. In recent years, hack weeks have emerged as an effective tool for fostering these exchanges by providing training in modern data analysis workflows. While there are variations in hack week implementation, all events consist of a common core of three components: tutorials in state-of-the-art methodology, peer-learning and project work in a collaborative environment. In this paper, we present the concept of a hack week in the larger context of scientific meetings and point out similarities and differences to traditional conferences. We motivate the need for such an event and present in detail its strengths and challenges. We find that hack weeks are successful at cultivating collaboration and the exchange of knowledge. Participants self-report that these events help them both in their day-to-day research as well as their careers. Based on our results, we conclude that hack weeks present an effective, easy-to-implement, fairly low-cost tool to positively impact data analysis literacy in academic disciplines, foster collaboration and cultivate best practices.

The Lomb-Scargle periodogram is a well-known algorithm for detecting and characterizing periodic signals in unevenly-sampled data. This paper presents a conceptual introduction to the Lomb-Scargle periodogram and important practical considerations for its use. Rather than a rigorous mathematical treatment, the goal of this paper is to build intuition about what assumptions are implicit in the use of the Lomb-Scargle periodogram and related estimators of periodicity, so as to motivate important practical considerations required in its proper application and interpretation.

We describe a new open source package for calculating properties of galaxy clusters, including NFW halo profiles with and without the effects of cluster miscentering. This pure-Python package, cluster-lensing, provides well-documented and easy-to-use classes and functions for calculating cluster scaling relations, including mass-richness and mass-concentration relations from the literature, as well as the surface mass density $\Sigma(R)$ and differential surface mass density $\Delta\Sigma(R)$ profiles, probed by weak lensing magnification and shear. Galaxy cluster miscentering is especially a concern for stacked weak lensing shear studies of galaxy clusters, where offsets between the assumed and the true underlying matter distribution can lead to a significant bias in the mass estimates if not accounted for. This software has been developed and released in a public GitHub repository, and is licensed under the permissive MIT license. The cluster-lensing package is archived on Zenodo (Ford 2016). Full documentation, source code, and installation instructions are available at http://jesford.github.io/cluster-lensing/.

This paper introduces the multiband periodogram, a general extension of the well-known Lomb-Scargle approach for detecting periodic signals in time-domain data. In addition to advantages of the Lomb-Scargle method such as treatment of non-uniform sampling and heteroscedastic errors, the multiband periodogram significantly improves period finding for randomly sampled multiband light curves (e.g., Pan-STARRS, DES and LSST). The light curves in each band are modeled as arbitrary truncated Fourier series, with the period and phase shared across all bands. The key aspect is the use of Tikhonov regularization which drives most of the variability into the so-called base model common to all bands, while fits for individual bands describe residuals relative to the base model and typically require lower-order Fourier series. This decrease in the effective model complexity is the main reason for improved performance. We use simulated light curves and randomly subsampled SDSS Stripe 82 data to demonstrate the superiority of this method compared to other methods from the literature, and find that this method will be able to efficiently determine the correct period in the majority of LSST's bright RR Lyrae stars with as little as six months of LSST data. A Python implementation of this method, along with code to fully reproduce the results reported here, is available on GitHub.

Astronomy and astrophysics are witnessing dramatic increases in data volume as detectors, telescopes and computers become ever more powerful. During the last decade, sky surveys across the electromagnetic spectrum have collected hundreds of terabytes of astronomical data for hundreds of millions of sources. Over the next decade, the data volume will enter the petabyte domain, and provide accurate measurements for billions of sources. Astronomy and physics students are not traditionally trained to handle such voluminous and complex data sets. In this paper we describe astroML; an initiative, based on Python and scikit-learn, to develop a compendium of machine learning tools designed to address the statistical needs of the next generation of students and astronomical surveys. We introduce astroML and present a number of example applications that are enabled by this package.

This paper presents a brief, semi-technical comparison of the essential features of the frequentist and Bayesian approaches to statistical inference, with several illustrative examples implemented in Python. The differences between frequentism and Bayesianism fundamentally stem from differing definitions of probability, a philosophical divide which leads to distinct approaches to the solution of statistical problems as well as contrasting ways of asking and answering questions about unknown parameters. After an example-driven discussion of these differences, we briefly compare several leading Python statistical packages which implement frequentist inference using classical methods and Bayesian inference using Markov Chain Monte Carlo.

We describe the construction of a highly reliable sample of approximately 7,000 optically faint periodic variable stars with light curves obtained by the asteroid survey LINEAR across 10,000 sq.deg of northern sky. Majority of these variables have not been cataloged yet. The sample flux limit is several magnitudes fainter than for most other wide-angle surveys; the photometric errors range from ~0.03 mag at $r=15$ to ~0.20 mag at r=18. Light curves include on average 250 data points, collected over about a decade. Using SDSS-based photometric recalibration of the LINEAR data for about 25 million objects, we selected ~200,000 most probable candidate variables and visually confirmed and classified approximately 7,000 periodic variables using phased light curves. The reliability and uniformity of visual classification across eight human classifiers was calibrated and tested using a SDSS Stripe 82 region variable star catalog, and verified using an unsupervised machine learning approach. The resulting sample of periodic LINEAR variables is dominated by 3,900 RR Lyrae stars and 2,700 eclipsing binary stars of all subtypes, and includes small fractions of relatively rare populations such as asymptotic giant branch stars and SX Phoenicis stars. We discuss the distribution of these mostly uncataloged variables in various diagrams constructed with optical-to-infrared SDSS, 2MASS and WISE photometry, and with LINEAR light curve features. An interesting side result is a robust and precise quantitative description of a strong correlation between the light-curve period and color/spectral type for close and contact eclipsing binary stars. These large samples of robustly classified variable stars will enable detailed statistical studies of the Galactic structure and physics of binary and other stars, and we make them publicly available.

This paper is the third in a series on tests of gravity using observations of stars and nearby dwarf galaxies. We carry out four distinct tests using published data on the kinematics and morphology of dwarf galaxies, motivated by the theoretical work of Hui et al. (2009) and Jain and Vanderplas (2011). In a wide class of gravity theories a scalar field couples to matter and provides an attractive fifth force. Due to their different self-gravity, stars and gas may respond differently to the scalar force leading to several observable deviations from standard gravity. HI gas, red giant stars and main sequence stars can be displaced relative to each other, and the stellar disk can display warps or asymmetric rotation curves aligned with external potential gradients. To distinguish the effects of modified gravity from standard astrophysical phenomena, we use a control sample of galaxies that are expected to be screened from the fifth force. In all cases we find no significant deviation from the null hypothesis of general relativity. The limits obtained from dwarf galaxies are not yet competitive with the limits from cepheids obtained in our first paper, but can be improved to probe regions of parameter space that are inaccessible using other tests. We discuss how our methodology can be applied to new radio and optical observations of nearby galaxies.

In the past decade, weak gravitational lensing has become an important tool in the study of the universe at the largest scale, giving insights into the distribution of dark matter, the expansion of the universe, and the nature of dark energy. This thesis research explores several applications of Karhunen-Loeve (KL) analysis to speed and improve the comparison of weak lensing shear catalogs to theory in order to constrain cosmological parameters in current and future lensing surveys. After providing a brief introduction to cosmology and to KL analysis, this work addresses three related aspects of weak lensing analysis: (1) Three-dimensional tomographic mapping (based on work published in Vanderplas et al. 2011); (2) Shear peak statistics with incomplete/gappy data (based on work published in Vanderplas et al. 2012); and (3) two-point parameter estimation from gappy data using KL modes (previously unpublished)... [this abstract has been abbreviated; please see the thesis for the full abstract].

We investigate the use of dimensionality reduction techniques for the classification of stellar spectra selected from the SDSS. Using local linear embedding (LLE), a technique that preserves the local (and possibly non-linear) structure within high dimensional data sets, we show that the majority of stellar spectra can be represented as a one dimensional sequence within a three dimensional space. The position along this sequence is highly correlated with spectral temperature. Deviations from this "stellar locus" are indicative of spectra with strong emission lines (including misclassified galaxies) or broad absorption lines (e.g. Carbon stars). Based on this analysis, we propose a hierarchical classification scheme using LLE that progressively identifies and classifies stellar spectra in a manner that requires no feature extraction and that can reproduce the classic MK classifications to an accuracy of one type.

We explore the utility of Karhunen Loeve (KL) analysis in solving practical problems in the analysis of gravitational shear surveys. Shear catalogs from large-field weak lensing surveys will be subject to many systematic limitations, notably incomplete coverage and pixel-level masking due to foreground sources. We develop a method to use two dimensional KL eigenmodes of shear to interpolate noisy shear measurements across masked regions. We explore the results of this method with simulated shear catalogs, using statistics of high-convergence regions in the resulting map. We find that the KL procedure not only minimizes the bias due to masked regions in the field, it also reduces spurious peak counts from shape noise by a factor of ~ 3 in the cosmologically sensitive regime. This indicates that KL reconstructions of masked shear are not only useful for creating robust convergence maps from masked shear catalogs, but also offer promise of improved parameter constraints within studies of shear peak statistics.

In modified gravity theories that seek to explain cosmic acceleration, dwarf galaxies in low density environments can be subject to enhanced forces. The class of scalar-tensor theories, which includes f(R) gravity, predict such a force enhancement (massive galaxies like the Milky Way can evade it through a screening mechanism that protects the interior of the galaxy from this "fifth" force). We study observable deviations from GR in the disks of late-type dwarf galaxies moving under gravity. The fifth-force acts on the dark matter and HI gas disk, but not on the stellar disk owing to the self-screening of main sequence stars. We find four distinct observable effects in such disk galaxies: 1. A displacement of the stellar disk from the HI disk. 2. Warping of the stellar disk along the direction of the external force. 3. Enhancement of the rotation curve measured from the HI gas compared to that of the stellar disk. 4. Asymmetry in the rotation curve of the stellar disk. We estimate that the spatial effects can be up to 1 kpc and the rotation velocity effects about 10 km/s in infalling dwarf galaxies. Such deviations are measurable: we expect that with a careful analysis of a sample of nearby dwarf galaxies one can improve astrophysical constraints on gravity theories by over three orders of magnitude, and even solar system constraints by one order of magnitude. Thus effective tests of gravity along the lines suggested by Hui et al (2009) and Jain (2011) can be carried out with low-redshift galaxies, though care must be exercised in understanding possible complications from astrophysical effects.

We present a new method for constructing three-dimensional mass maps from gravitational lensing shear data. We solve the lensing inversion problem using truncation of singular values (within the context of generalized least squares estimation) without a priori assumptions about the statistical nature of the signal. This singular value framework allows a quantitative comparison between different filtering methods: we evaluate our method beside the previously explored Wiener filter approaches. Our method yields near-optimal angular resolution of the lensing reconstruction and allows cluster sized halos to be de-blended robustly. It allows for mass reconstructions which are 2-3 orders-of-magnitude faster than the Wiener filter approach; in particular, we estimate that an all-sky reconstruction with arcminute resolution could be performed on a time-scale of hours. We find however that linear, non-parametric reconstructions have a fundamental limitation in the resolution achieved in the redshift direction.

A survey that can cover the sky in optical bands over wide fields to faint magnitudes with a fast cadence will enable many of the exciting science opportunities of the next decade. The Large Synoptic Survey Telescope (LSST) will have an effective aperture of 6.7 meters and an imaging camera with field of view of 9.6 deg^2, and will be devoted to a ten-year imaging survey over 20,000 deg^2 south of +15 deg. Each pointing will be imaged 2000 times with fifteen second exposures in six broad bands from 0.35 to 1.1 microns, to a total point-source depth of r~27.5. The LSST Science Book describes the basic parameters of the LSST hardware, software, and observing plans. The book discusses educational and outreach opportunities, then goes on to describe a broad range of science that LSST will revolutionize: mapping the inner and outer Solar System, stellar populations in the Milky Way and nearby galaxies, the structure of the Milky Way disk and halo and other objects in the Local Volume, transient and variable objects both at low and high redshift, and the properties of normal and active galaxies at low and high redshift. It then turns to far-field cosmological topics, exploring properties of supernovae to z~1, strong and weak lensing, the large-scale distribution of galaxies and baryon oscillations, and how these different probes may be combined to constrain cosmological models and the physics of dark energy.

We present an analysis of the luminosity distances of Type Ia Supernovae from the Sloan Digital Sky Survey-II (SDSS-II) Supernova Survey in conjunction with other intermediate redshift (z<0.4) cosmological measurements including redshift-space distortions from the Two-degree Field Galaxy Redshift Survey (2dFGRS), the Integrated Sachs-Wolfe (ISW) effect seen by the SDSS, and the latest Baryon Acoustic Oscillation (BAO) distance scale from both the SDSS and 2dFGRS. We have analysed the SDSS-II SN data alone using a variety of "model-independent" methods and find evidence for an accelerating universe at >97% level from this single dataset. We find good agreement between the supernova and BAO distance measurements, both consistent with a Lambda-dominated CDM cosmology, as demonstrated through an analysis of the distance duality relationship between the luminosity (d_L) and angular diameter (d_A) distance measures. We then use these data to estimate w within this restricted redshift range (z<0.4). Our most stringent result comes from the combination of all our intermediate-redshift data (SDSS-II SNe, BAO, ISW and redshift-space distortions), giving w = -0.81 +0.16 -0.18(stat) +/- 0.15(sys) and Omega_M=0.22 +0.09 -0.08 assuming a flat universe. This value of w, and associated errors, only change slightly if curvature is allowed to vary, consistent with constraints from the Cosmic Microwave Background. We also consider more limited combinations of the geometrical (SN, BAO) and dynamical (ISW, redshift-space distortions) probes.

We use the new SNe Ia discovered by the SDSS-II Supernova Survey together with additional supernova datasets as well as observations of the cosmic microwave background and baryon acoustic oscillations to constrain cosmological models. This complements the analysis presented by Kessler et al. in that we discuss and rank a number of the most popular non-standard cosmology scenarios. When this combined data-set is analyzed using the MLCS2k2 light-curve fitter, we find that more exotic models for cosmic acceleration provide a better fit to the data than the Lambda-CDM model. For example, the flat DGP model is ranked higher by our information criteria tests than the standard model. When the dataset is instead analyzed using the SALT-II light-curve fitter, the standard cosmological constant model fares best. Our investigation also includes inhomogeneous Lemaitre-Tolman-Bondi (LTB) models. While our LTB models can be made to fit the supernova data as well as any other model, the extra parameters they require are not supported by our information criteria analysis.

We present measurements of the Hubble diagram for 103 Type Ia supernovae (SNe) with redshifts 0.04 < z < 0.42, discovered during the first season (Fall 2005) of the Sloan Digital Sky Survey-II (SDSS-II) Supernova Survey. These data fill in the redshift "desert" between low- and high-redshift SN Ia surveys. We combine the SDSS-II measurements with new distance estimates for published SN data from the ESSENCE survey, the Supernova Legacy Survey, the Hubble Space Telescope, and a compilation of nearby SN Ia measurements. Combining the SN Hubble diagram with measurements of Baryon Acoustic Oscillations from the SDSS Luminous Red Galaxy sample and with CMB temperature anisotropy measurements from WMAP, we estimate the cosmological parameters w and Omega_M, assuming a spatially flat cosmological model (FwCDM) with constant dark energy equation of state parameter, w. For the FwCDM model and the combined sample of 288 SNe Ia, we find w = -0.76 +- 0.07(stat) +- 0.11(syst), Omega_M = 0.306 +- 0.019(stat) +- 0.023(syst) using MLCS2k2 and w = -0.96 +- 0.06(stat) +- 0.12(syst), Omega_M = 0.265 +- 0.016(stat) +- 0.025(syst) using the SALT-II fitter. We trace the discrepancy between these results to a difference in the rest-frame UV model combined with a different luminosity correction from color variations; these differences mostly affect the distance estimates for the SNLS and HST supernovae. We present detailed discussions of systematic errors for both light-curve methods and find that they both show data-model discrepancies in rest-frame $U$-band. For the SALT-II approach, we also see strong evidence for redshift-dependence of the color-luminosity parameter (beta). Restricting the analysis to the 136 SNe Ia in the Nearby+SDSS-II samples, we find much better agreement between the two analysis methods but with larger uncertainties.

We describe a general analysis package for supernova (SN) light curves, called SNANA, that contains a simulation, light curve fitter, and cosmology fitter. The software is designed with the primary goal of using SNe Ia as distance indicators for the determination of cosmological parameters, but it can also be used to study efficiencies for analyses of SN rates, estimate contamination from non-Ia SNe, and optimize future surveys. Several SN models are available within the same software architecture, allowing technical features such as K-corrections to be consistently used among multiple models, and thus making it easier to make detailed comparisons between models. New and improved light-curve models can be easily added. The software works with arbitrary surveys and telescopes and has already been used by several collaborations, leading to more robust and easy-to-use code. This software is not intended as a final product release, but rather it is designed to undergo continual improvements from the community as more is learned about SNe. Below we give an overview of the SNANA capabilities, as well as some of its limitations. Interested users can find software downloads and more detailed information from the manuals at http://www.sdss.org/supernova/SNANA.html .

We introduce Locally Linear Embedding (LLE) to the astronomical community as a new classification technique, using SDSS spectra as an example data set. LLE is a nonlinear dimensionality reduction technique which has been studied in the context of computer perception. We compare the performance of LLE to well-known spectral classification techniques, e.g. principal component analysis and line-ratio diagnostics. We find that LLE combines the strengths of both methods in a single, coherent technique, and leads to improved classification of emission-line spectra at a relatively small computational cost. We also present a data subsampling technique that preserves local information content, and proves effective for creating small, efficient training samples from a large, high-dimensional data sets. Software used in this LLE-based classification is made available.