This white paper is the result of the Tri-Agency Working Group (TAG) appointed to develop synergies between missions and is intended to clarify what LSST observations are needed in order to maximally enhance the combined science output of LSST and Euclid. To facilitate LSST planning we provide a range of possible LSST surveys with clear metrics based on the improvement in the Dark Energy figure of merit (FOM). To provide a quantifiable metric we present five survey options using only between 0.3 and 3.8% of the LSST 10 year survey. We also provide information so that the LSST DDF cadence can possibly be matched to those of \emph{Euclid} in common deep fields, SXDS, COSMOS, CDFS, and a proposed new LSST deep field (near the Akari Deep Field South). Co-coordination of observations from the Large Synoptic Survey Telescope (LSST) and Euclid will lead to a significant number of synergies. The combination of optical multi-band imaging from LSST with high resolution optical and near-infrared photometry and spectroscopy from \emph{Euclid} will not only improve constraints on Dark Energy, but provide a wealth of science on the Milky Way, local group, local large scale structure, and even on first galaxies during the epoch of reionization. A detailed paper has been published on the Dark Energy science case (Rhodes et al.) by a joint LSST/Euclid working group as well as a white paper describing LSST/Euclid/WFIRST synergies (Jain et al.), and we will briefly describe other science cases here. A companion white paper argues the general science case for an extension of the LSST footprint to the north at airmass < 1.8, and we support the white papers for southern extensions of the LSST survey.

We propose an extension of the LSST survey to cover the northern sky to DEC < +30 (accessible at airmass <1.8). This survey will increase the LSST sky coverage by ~9,600 square degrees from 18,900 to 28,500 square degrees (a 50% increase) but use only 0.6-2.5% of the time depending on the synergies with other surveys. This increased area addresses a wide range of science cases that enhance all of the primary LSST science goals by significant amounts. The science enabled includes: increasing the area of the sky accessible for follow-up of multi-messenger transients including gravitational waves, mapping the milky way halo and halo dwarfs including discovery of RR Lyrae stars in the outer galactic halo, discovery of z>7 quasars in combination Euclid, enabling a second generation DESI and other spectroscopic surveys, and enhancing all areas of science by improving synergies with Euclid, WFIRST, and unique northern survey facilities. This white paper is the result of the Tri-Agency Working Group (TAG) appointed to develop synergies between missions and presents a unified plan for northern coverage. The range of time estimates reflects synergies with other surveys. If the modified DESC WFD survey, the ecliptic plane mini survey, and the north galactic spur mini survey are executed this plan would only need 0.6% of the LSST time, however if none of these are included the overall request is 2.5% of the 10 year survey life. In other words, the majority of these observations are already suggested as part of these other surveys and the intent of this white paper is to propose a unified baseline plan to carry out a broad range of objectives to facilitate a combination of multiple science objectives. A companion white paper gives Euclid specific science goals, and we support the white papers for southern extensions of the LSST survey.

Community access to deep (i ~ 25), highly-multiplexed optical and near-infrared multi-object spectroscopy (MOS) on 8-40m telescopes would greatly improve measurements of cosmological parameters from LSST. The largest gain would come from improvements to LSST photometric redshifts, which are employed directly or indirectly for every major LSST cosmological probe; deep spectroscopic datasets will enable reduced uncertainties in the redshifts of individual objects via optimized training. Such spectroscopy will also determine the relationship of galaxy SEDs to their environments, key observables for studies of galaxy evolution. The resulting data will also constrain the impact of blending on photo-z's. Focused spectroscopic campaigns can also improve weak lensing cosmology by constraining the intrinsic alignments between the orientations of galaxies. Galaxy cluster studies can be enhanced by measuring motions of galaxies in and around clusters and by testing photo-z performance in regions of high density. Photometric redshift and intrinsic alignment studies are best-suited to instruments on large-aperture telescopes with wider fields of view (e.g., Subaru/PFS, MSE, or GMT/MANIFEST) but cluster investigations can be pursued with smaller-field instruments (e.g., Gemini/GMOS, Keck/DEIMOS, or TMT/WFOS), so deep MOS work can be distributed amongst a variety of telescopes. However, community access to large amounts of nights for surveys will still be needed to accomplish this work. In two companion white papers we present gains from shallower, wide-area MOS and from single-target imaging and spectroscopy.

LSST will open new vistas for cosmology in the next decade, but it cannot reach its full potential without data from other telescopes. Cosmological constraints can be greatly enhanced using wide-field ($>20$ deg$^2$ total survey area), highly-multiplexed optical and near-infrared multi-object spectroscopy (MOS) on 4-15m telescopes. This could come in the form of suitably-designed large surveys and/or community access to add new targets to existing projects. First, photometric redshifts can be calibrated with high precision using cross-correlations of photometric samples against spectroscopic samples at $0 < z < 3$ that span thousands of sq. deg. Cross-correlations of faint LSST objects and lensing maps with these spectroscopic samples can also improve weak lensing cosmology by constraining intrinsic alignment systematics, and will also provide new tests of modified gravity theories. Large samples of LSST strong lens systems and supernovae can be studied most efficiently by piggybacking on spectroscopic surveys covering as much of the LSST extragalactic footprint as possible (up to $\sim20,000$ square degrees). Finally, redshifts can be measured efficiently for a high fraction of the supernovae in the LSST Deep Drilling Fields (DDFs) by targeting their hosts with wide-field spectrographs. Targeting distant galaxies, supernovae, and strong lens systems over wide areas in extended surveys with (e.g.) DESI or MSE in the northern portion of the LSST footprint or 4MOST in the south could realize many of these gains; DESI, 4MOST, Subaru/PFS, or MSE would all be well-suited for DDF surveys. The most efficient solution would be a new wide-field, highly-multiplexed spectroscopic instrument in the southern hemisphere with $>6$m aperture. In two companion white papers we present gains from deep, small-area MOS and from single-target imaging and spectroscopy.

In recent years, machine learning (ML) methods have remarkably improved how cosmologists can interpret data. The next decade will bring new opportunities for data-driven cosmological discovery, but will also present new challenges for adopting ML methodologies and understanding the results. ML could transform our field, but this transformation will require the astronomy community to both foster and promote interdisciplinary research endeavors.

Cosmology is one of the four science pillars of LSST, which promises to be transformative for our understanding of dark energy and dark matter. The LSST Dark Energy Science Collaboration (DESC) has been tasked with deriving constraints on cosmological parameters from LSST data. Each of the cosmological probes for LSST is heavily impacted by the choice of observing strategy. This white paper is written by the LSST DESC Observing Strategy Task Force (OSTF), which represents the entire collaboration, and aims to make recommendations on observing strategy that will benefit all cosmological analyses with LSST. It is accompanied by the DESC DDF (Deep Drilling Fields) white paper (Scolnic et al.). We use a variety of metrics to understand the effects of the observing strategy on measurements of weak lensing, large-scale structure, clusters, photometric redshifts, supernovae, strong lensing and kilonovae. In order to reduce systematic uncertainties, we conclude that the current baseline observing strategy needs to be significantly modified to result in the best possible cosmological constraints. We provide some key recommendations: moving the WFD (Wide-Fast-Deep) footprint to avoid regions of high extinction, taking visit pairs in different filters, changing the 2x15s snaps to a single exposure to improve efficiency, focusing on strategies that reduce long gaps (>15 days) between observations, and prioritizing spatial uniformity at several intervals during the 10-year survey.

We review the measurements of dark energy enabled by observations of the Deep Drilling Fields and the optimization of survey design for cosmological measurements. This white paper is the result of efforts by the LSST DESC Observing Strategy Task Force (OSTF), which represents the entire collaboration, and aims to make recommendations on observing strategy for the DDFs that will benefit all cosmological analyses with LSST. It is accompanied by the DESC-WFD white paper (Lochner et al.). We argue for altering the nominal deep drilling plan to have $>6$ month seasons, interweaving $gri$ and $zy$ observations every 3 days with 2, 4, 8, 25, 4 visits in $grizy$, respectively. These recommendations are guided by metrics optimizing constraints on dark energy and mitigation of systematic uncertainties, including specific requirements on total number of visits after Y1 and Y10 for photometric redshifts (photo-$z$) and weak lensing systematics. We specify the precise locations for the previously-chosen LSST deep fields (ELAIS-S1, XMM-LSS, CDF-S, and COSMOS) and recommend Akari Deep Field South as the planned fifth deep field in order to synergize with Euclid and WFIRST. Our recommended DDF strategy uses $6.2\%$ of the LSST survey time. We briefly discuss synergy with white papers from other collaborations, as well as additional mini-surveys and Target-of-Opportunity programs that lead to better measurements of dark energy.

With the advent of powerful telescopes such as the SKA and LSST, we are entering a golden era of multiwavelength transient astronomy. In order to cope with the dramatic increase in data volume as well as successfully prioritise spectroscopic follow-up resources, we propose a new machine learning approach for the classification of radio and multiwavelength transients. The algorithm consists of three steps: (1) augmentation and interpolation of the data using Gaussian processes; (2) feature extraction using a wavelet decomposition; (3) classification with the robust machine learning algorithm known as random forests. We apply this algorithm to existing radio transient data, illustrating its ability to accurately classify most of the eleven classes of radio variables and transients after just eight hours of observations, achieving an overall accuracy of $73.5\%$. We show how performance is expected to increase as more training data are acquired, by training the classifier on a simulated representative training set, achieving an overall accuracy of $97.4\%$. Finally, we outline a general approach for including multiwavelength data for general transient classification, and demonstrate its effectiveness by incorporating a single optical data point into the analysis, which improves the overall accuracy by $\approx 22\%$.

Radio weak lensing, while a highly promising complementary probe to optical weak lensing, will require incredible precision in the measurement of galaxy shape parameters. In this paper, we extend the Bayesian Inference for Radio Observations model fitting approach to measure galaxy shapes directly from visibility data of radio continuum surveys, instead of from image data. We apply a Hamiltonian Monte Carlo (HMC) technique for sampling the posterior, which is more efficient than the standard Monte Carlo Markov Chain method when dealing with a large dimensional parameter space. Adopting the exponential profile for galaxy model fitting allows us to analytically calculate the likelihood gradient required by HMC, allowing a faster and more accurate sampling. The method is tested on SKA1-MID simulated observations at 1.4 GHz of a field containing up to 1000 star-forming galaxies. It is also applied to a simulated observation of the weak lensing precursor survey SuperCLASS. In both cases we obtain reliable measurements of the galaxies' ellipticity and size for all sources with SNR $\ge 10$, and we also find relationships between the convergence properties of the HMC technique and some source parameters. Direct shape measurement in the visibility domain achieves high accuracy at the expected source number densities of the current and next SKA precursor continuum surveys. The proposed method can be easily extended for the fitting of other galaxy and scientific parameters, as well as simultaneously marginalising over systematic and instrumental effects.

Classification of transient and variable light curves is an essential step in using astronomical observations to develop an understanding of their underlying physical processes. However, upcoming deep photometric surveys, including the Large Synoptic Survey Telescope (LSST), will produce a deluge of low signal-to-noise data for which traditional labeling procedures are inappropriate. Probabilistic classification is more appropriate for the data but are incompatible with the traditional metrics used on deterministic classifications. Furthermore, large survey collaborations intend to use these classification probabilities for diverse science objectives, indicating a need for a metric that balances a variety of goals. We describe the process used to develop an optimal performance metric for an open classification challenge that seeks probabilistic classifications and must serve many scientific interests. The Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC) is an open competition aiming to identify promising techniques for obtaining classification probabilities of transient and variable objects by engaging a broader community both within and outside astronomy. Using mock classification probability submissions emulating archetypes of those anticipated of PLAsTiCC, we compare the sensitivity of metrics of classification probabilities under various weighting schemes, finding that they yield qualitatively consistent results. We choose as a metric for PLAsTiCC a weighted modification of the cross-entropy because it can be meaningfully interpreted. Finally, we propose extensions of our methodology to ever more complex challenge goals and suggest some guiding principles for approaching the choice of a metric of probabilistic classifications.

The Photometric LSST Astronomical Time Series Classification Challenge (PLAsTiCC) is an open data challenge to classify simulated astronomical time-series data in preparation for observations from the Large Synoptic Survey Telescope (LSST), which will achieve first light in 2019 and commence its 10-year main survey in 2022. LSST will revolutionize our understanding of the changing sky, discovering and measuring millions of time-varying objects. In this challenge, we pose the question: how well can we classify objects in the sky that vary in brightness from simulated LSST time-series data, with all its challenges of non-representativity? In this note we explain the need for a data challenge to help classify such astronomical sources and describe the PLAsTiCC data set and Kaggle data challenge, noting that while the references are provided for context, they are not needed to participate in the challenge.

Point source detection at low signal-to-noise is challenging for astronomical surveys, particularly in radio interferometry images where the noise is correlated. Machine learning is a promising solution, allowing the development of algorithms tailored to specific telescope arrays and science cases. We present DeepSource - a deep learning solution - that uses convolutional neural networks to achieve these goals. DeepSource enhances the Signal-to-Noise Ratio (SNR) of the original map and then uses dynamic blob detection to detect sources. Trained and tested on two sets of 500 simulated 1 deg x 1 deg MeerKAT images with a total of 300,000 sources, DeepSource is essentially perfect in both purity and completeness down to SNR = 4 and outperforms PyBDSF in all metrics. For uniformly-weighted images it achieves a Purity x Completeness (PC) score at SNR = 3 of 0.73, compared to 0.31 for the best PyBDSF model. For natural-weighting we find a smaller improvement of ~40% in the PC score at SNR = 3. If instead we ask where either of the purity or completeness first drop to 90%, we find that DeepSource reaches this value at SNR = 3.6 compared to the 4.3 of PyBDSF (natural-weighting). A key advantage of DeepSource is that it can learn to optimally trade off purity and completeness for any science case under consideration. Our results show that deep learning is a promising approach to point source detection in astronomical images.

We train a machine learning algorithm to learn cosmological structure formation from N-body simulations. The algorithm infers the relationship between the initial conditions and the final dark matter haloes, without the need to introduce approximate halo collapse models. We gain insights into the physics driving halo formation by evaluating the predictive performance of the algorithm when provided with different types of information about the local environment around dark matter particles. The algorithm learns to predict whether or not dark matter particles will end up in haloes of a given mass range, based on spherical overdensities. We show that the resulting predictions match those of spherical collapse approximations such as extended Press-Schechter theory. Additional information on the shape of the local gravitational potential is not able to improve halo collapse predictions; the linear density field contains sufficient information for the algorithm to also reproduce ellipsoidal collapse predictions based on the Sheth-Tormen model. We investigate the algorithm's performance in terms of halo mass and radial position and perform blind analyses on independent initial conditions realisations to demonstrate the generality of our results.

The unprecedented volume and rate of transient events that will be discovered by the Large Synoptic Survey Telescope (LSST) demands that the astronomical community update its followup paradigm. Alert-brokers -- automated software system to sift through, characterize, annotate and prioritize events for followup -- will be critical tools for managing alert streams in the LSST era. The Arizona-NOAO Temporal Analysis and Response to Events System (ANTARES) is one such broker. In this work, we develop a machine learning pipeline to characterize and classify variable and transient sources only using the available multiband optical photometry. We describe three illustrative stages of the pipeline, serving the three goals of early, intermediate and retrospective classification of alerts. The first takes the form of variable vs transient categorization, the second, a multi-class typing of the combined variable and transient dataset, and the third, a purity-driven subtyping of a transient class. While several similar algorithms have proven themselves in simulations, we validate their performance on real observations for the first time. We quantitatively evaluate our pipeline on sparse, unevenly sampled, heteroskedastic data from various existing observational campaigns, and demonstrate very competitive classification performance. We describe our progress towards adapting the pipeline developed in this work into a real-time broker working on live alert streams from time-domain surveys.

Supernova cosmology without spectra will be an important component of future surveys such as LSST. This lack of supernova spectra results in uncertainty in the redshifts which, if ignored, leads to significantly biased estimates of cosmological parameters. Here we present a hierarchical Bayesian formalism -- zBEAMS -- that addresses this problem by marginalising over the unknown or uncertain supernova redshifts to produce unbiased cosmological estimates that are competitive with supernova data with spectroscopically confirmed redshifts. zBEAMS provides a unified treatment of both photometric redshifts and host galaxy misidentification (occurring due to chance galaxy alignments or faint hosts), effectively correcting the inevitable contamination in the Hubble diagram. Like its predecessor BEAMS, our formalism also takes care of non-Ia supernova contamination by marginalising over the unknown supernova type. We illustrate this technique with simulations of supernovae with photometric redshifts and host galaxy misidentification. A novel feature of the photometric redshift case is the important role played by the redshift distribution of the supernovae.

We discuss the ground-breaking science that will be possible with a wide area survey, using the MeerKAT telescope, known as MeerKLASS (MeerKAT Large Area Synoptic Survey). The current specifications of MeerKAT make it a great fit for science applications that require large survey speeds but not necessarily high angular resolutions. In particular, for cosmology, a large survey over $\sim 4,000 \, {\rm deg}^2$ for $\sim 4,000$ hours will potentially provide the first ever measurements of the baryon acoustic oscillations using the 21cm intensity mapping technique, with enough accuracy to impose constraints on the nature of dark energy. The combination with multi-wavelength data will give unique additional information, such as exquisite constraints on primordial non-Gaussianity using the multi-tracer technique, as well as a better handle on foregrounds and systematics. Such a wide survey with MeerKAT is also a great match for HI galaxy studies, providing unrivalled statistics in the pre-SKA era for galaxies resolved in the HI emission line beyond local structures at z > 0.01. It will also produce a large continuum galaxy sample down to a depth of about 5\,$\mu$Jy in L-band, which is quite unique over such large areas and will allow studies of the large-scale structure of the Universe out to high redshifts, complementing the galaxy HI survey to form a transformational multi-wavelength approach to study galaxy dynamics and evolution. Finally, the same survey will supply unique information for a range of other science applications, including a large statistical investigation of galaxy clusters as well as produce a rotation measure map across a huge swathe of the sky. The MeerKLASS survey will be a crucial step on the road to using SKA1-MID for cosmological applications and other commensal surveys, as described in the top priority SKA key science projects (abridged).

The Large Synoptic Survey Telescope is designed to provide an unprecedented optical imaging dataset that will support investigations of our Solar System, Galaxy and Universe, across half the sky and over ten years of repeated observation. However, exactly how the LSST observations will be taken (the observing strategy or "cadence") is not yet finalized. In this dynamically-evolving community white paper, we explore how the detailed performance of the anticipated science investigations is expected to depend on small changes to the LSST observing strategy. Using realistic simulations of the LSST schedule and observation properties, we design and compute diagnostic metrics and Figures of Merit that provide quantitative evaluations of different observing strategies, analyzing their impact on a wide range of proposed science projects. This is work in progress: we are using this white paper to communicate to each other the relative merits of the observing strategy choices that could be made, in an effort to maximize the scientific value of the survey. The investigation of some science cases leads to suggestions for new strategies that could be simulated and potentially adopted. Notably, we find motivation for exploring departures from a spatially uniform annual tiling of the sky: focusing instead on different parts of the survey area in different years in a "rolling cadence" is likely to have significant benefits for a number of time domain and moving object astronomy projects. The communal assembly of a suite of quantified and homogeneously coded metrics is the vital first step towards an automated, systematic, science-based assessment of any given cadence simulation, that will enable the scheduling of the LSST to be as well-informed as possible.

We introduce a new Bayesian HI spectral line fitting technique capable of obtaining spectroscopic redshifts for millions of galaxies in radio surveys with the Square Kilometere Array (SKA). This technique is especially well-suited to the low signal-to-noise regime that the redshifted 21-cm HI emission line is expected to be observed in, especially with SKA Phase 1, allowing for robust source detection. After selecting a set of continuum objects relevant to large, cosmological-scale surveys with the first phase of the SKA dish array (SKA1-MID), we simulate data corresponding to their HI line emission as observed by the same telescope. We then use the MultiNest nested sampling code to find the best-fitting parametrised line profile, providing us with a full joint posterior probability distribution for the galaxy properties, including redshift. This provides high quality redshifts, with redshift errors $\Delta z / z <10^{-5}$, from radio data alone for some 1.8 million galaxies in a representative 5000 square degree survey with the SKA1-MID instrument with up-to-date sensitivity profiles. Interestingly, we find that the SNR definition commonly used in forecast papers does not correlate well with the actual detectability of an HI line using our method. We further detail how our method could be improved with per-object priors and how it may be also used to give robust constraints on other observables such as the HI mass function. We also make our line fitting code publicly available for application to other data sets.

Automated photometric supernova classification has become an active area of research in recent years in light of current and upcoming imaging surveys such as the Dark Energy Survey (DES) and the Large Synoptic Survey Telescope, given that spectroscopic confirmation of type for all supernovae discovered will be impossible. Here, we develop a multi-faceted classification pipeline, combining existing and new approaches. Our pipeline consists of two stages: extracting descriptive features from the light curves and classification using a machine learning algorithm. Our feature extraction methods vary from model-dependent techniques, namely SALT2 fits, to more independent techniques fitting parametric models to curves, to a completely model-independent wavelet approach. We cover a range of representative machine learning algorithms, including naive Bayes, k-nearest neighbors, support vector machines, artificial neural networks and boosted decision trees (BDTs). We test the pipeline on simulated multi-band DES light curves from the Supernova Photometric Classification Challenge. Using the commonly used area under the curve (AUC) of the Receiver Operating Characteristic as a metric, we find that the SALT2 fits and the wavelet approach, with the BDTs algorithm, each achieves an AUC of 0.98, where 1 represents perfect classification. We find that a representative training set is essential for good classification, whatever the feature set or algorithm, with implications for spectroscopic follow-up. Importantly, we find that by using either the SALT2 or the wavelet feature sets with a BDT algorithm, accurate classification is possible purely from light curve data, without the need for any redshift information.

Radio interferometers suffer from the problem of missing information in their data, due to the gaps between the antennas. This results in artifacts, such as bright rings around sources, in the images obtained. Multiple deconvolution algorithms have been proposed to solve this problem and produce cleaner radio images. However, these algorithms are unable to correctly estimate uncertainties in derived scientific parameters or to always include the effects of instrumental errors. We propose an alternative technique called Bayesian Inference for Radio Observations (BIRO) which uses a Bayesian statistical framework to determine the scientific parameters and instrumental errors simultaneously directly from the raw data, without making an image. We use a simple simulation of Westerbork Synthesis Radio Telescope data including pointing errors and beam parameters as instrumental effects, to demonstrate the use of BIRO.

New telescopes like the Square Kilometre Array (SKA) will push into a new sensitivity regime and expose systematics, such as direction-dependent effects, that could previously be ignored. Current methods for handling such systematics rely on alternating best estimates of instrumental calibration and models of the underlying sky, which can lead to inadequate uncertainty estimates and biased results because any correlations between parameters are ignored. These deconvolution algorithms produce a single image that is assumed to be a true representation of the sky, when in fact it is just one realization of an infinite ensemble of images compatible with the noise in the data. In contrast, here we report a Bayesian formalism that simultaneously infers both systematics and science. Our technique, Bayesian Inference for Radio Observations (BIRO), determines all parameters directly from the raw data, bypassing image-making entirely, by sampling from the joint posterior probability distribution. This enables it to derive both correlations and accurate uncertainties, making use of the flexible software MEQTREES to model the sky and telescope simultaneously. We demonstrate BIRO with two simulated sets of Westerbork Synthesis Radio Telescope data sets. In the first, we perform joint estimates of 103 scientific (flux densities of sources) and instrumental (pointing errors, beamwidth and noise) parameters. In the second example, we perform source separation with BIRO. Using the Bayesian evidence, we can accurately select between a single point source, two point sources and an extended Gaussian source, allowing for 'super-resolution' on scales much smaller than the synthesized beam.

For future surveys, spectroscopic follow-up for all supernovae will be extremely difficult. However, one can use light curve fitters, to obtain the probability that an object is a Type Ia. One may consider applying a probability cut to the data, but we show that the resulting non-Ia contamination can lead to biases in the estimation of cosmological parameters. A different method, which allows the use of the full dataset and results in unbiased cosmological parameter estimation, is Bayesian Estimation Applied to Multiple Species (BEAMS). BEAMS is a Bayesian approach to the problem which includes the uncertainty in the types in the evaluation of the posterior. Here we outline the theory of BEAMS and demonstrate its effectiveness using both simulated datasets and SDSS-II data. We also show that it is possible to use BEAMS if the data are correlated, by introducing a numerical marginalisation over the types of the objects. This is largely a pedagogical introduction to BEAMS with references to the main BEAMS papers.

New supernova surveys such as the Dark Energy Survey, Pan-STARRS and the LSST will produce an unprecedented number of photometric supernova candidates, most with no spectroscopic data. Avoiding biases in cosmological parameters due to the resulting inevitable contamination from non-Ia supernovae can be achieved with the BEAMS formalism, allowing for fully photometric supernova cosmology studies. Here we extend BEAMS to deal with the case in which the supernovae are correlated by systematic uncertainties. The analytical form of the full BEAMS posterior requires evaluating 2^N terms, where N is the number of supernova candidates. This `exponential catastrophe' is computationally unfeasible even for N of order 100. We circumvent the exponential catastrophe by marginalising numerically instead of analytically over the possible supernova types: we augment the cosmological parameters with nuisance parameters describing the covariance matrix and the types of all the supernovae, \tau_i, that we include in our MCMC analysis. We show that this method deals well even with large, unknown systematic uncertainties without a major increase in computational time, whereas ignoring the correlations can lead to significant biases and incorrect credible contours. We then compare the numerical marginalisation technique with a perturbative expansion of the posterior based on the insight that future surveys will have exquisite light curves and hence the probability that a given candidate is a Type Ia will be close to unity or zero, for most objects. Although this perturbative approach changes computation of the posterior from a 2^N problem into an N^2 or N^3 one, we show that it leads to biases in general through a small number of misclassifications, implying that numerical marginalisation is superior.