We present the methodology for a joint cosmological analysis of weak gravitational lensing from the fourth data release of the ESO Kilo-Degree Survey (KiDS-1000) and galaxy clustering from the partially overlapping BOSS and 2dFLenS surveys. Cross-correlations between galaxy positions and ellipticities are incorporated into the analysis, developing a hybrid model of non-linear scales that blends perturbative and non-perturbative approaches, and assessing signal contributions by astrophysical effects. All weak lensing signals are measured consistently via Fourier-space statistics that are insensitive to the survey mask and display low levels of mode mixing. The calibration of photometric redshift distributions and multiplicative gravitational shear bias is updated, and a more complete tally of residual calibration uncertainties is propagated into the likelihood. A dedicated suite of more than 20000 mocks is used to assess the performance of covariance models and to quantify the impact of survey geometry and spatial variations of survey depth on signals and their errors. The sampling distributions for the likelihood and the $\chi^2$ goodness-of-fit statistic are validated, with proposed changes to calculating the effective number of degrees of freedom. Standard weak lensing point estimates on $S_8=\sigma_8\,(\Omega_{\rm m}/0.3)^{1/2}$ derived from its marginal posterior are easily misinterpreted to be biased low, and an alternative estimator and associated credible interval are proposed. Known systematic effects pertaining to weak lensing modelling and inference are shown to bias $S_8$ by no more than 0.1 standard deviations, with the caveat that no conclusive validation data exist for models of intrinsic galaxy alignments. Compared to the previous KiDS analyses, $S_8$ constraints are expected to improve by 20% for weak lensing alone and by 29% for the joint analysis. [abridged]

We present a tomographic cosmic shear analysis of the Kilo-Degree Survey (KiDS) combined with the VISTA Kilo-Degree Infrared Galaxy Survey (VIKING). This is the first time that a full optical to near-infrared data set has been used for a wide-field cosmological weak lensing experiment. This unprecedented data, spanning $450~$deg$^2$, allows us to improve significantly the estimation of photometric redshifts, such that we are able to include robustly higher-redshift sources for the lensing measurement, and - most importantly - solidify our knowledge of the redshift distributions of the sources. Based on a flat $\Lambda$CDM model we find $S_8\equiv\sigma_8\sqrt{\Omega_{\rm m}/0.3}=0.737_{-0.036}^{+0.040}$ in a blind analysis from cosmic shear alone. The tension between KiDS cosmic shear and the Planck-Legacy CMB measurements remains in this systematically more robust analysis, with $S_8$ differing by $2.3\sigma$. This result is insensitive to changes in the priors on nuisance parameters for intrinsic alignment, baryon feedback, and neutrino mass. KiDS shear measurements are calibrated with a new, more realistic set of image simulations and no significant B-modes are detected in the survey, indicating that systematic errors are under control. When calibrating our redshift distributions by assuming the 30-band COSMOS-2015 photometric redshifts are correct (following the Dark Energy Survey and the Hyper Suprime-Cam Survey), we find the tension with Planck is alleviated. The robust determination of source redshift distributions remains one of the most challenging aspects for future cosmic shear surveys.

We present constraints on Horndeski gravity from a combined analysis of cosmic shear, galaxy-galaxy lensing and galaxy clustering from $450\,\mathrm{deg}^2$ of the Kilo-Degree Survey (KiDS) and the Galaxy And Mass Assembly (GAMA) survey. The Horndeski class of dark energy/modified gravity models includes the majority of universally coupled extensions to $\Lambda$CDM with one scalar field in addition to the metric. We study the functions of time that fully describe the evolution of linear perturbations in Horndeski gravity. Our results are compatible throughout with a $\Lambda$CDM model. By imposing gravitational wave constraints, we fix the tensor speed excess to zero and consider a subset of models including e.g. quintessence and $f(R)$ theories. Assuming proportionality of the Horndeski functions $\alpha_B$ and $\alpha_M$ (kinetic braiding and the Planck mass run rate, respectively) to the dark energy density fraction $\Omega_{\mathrm{DE}}(a) = 1 - \Omega_{\mathrm{m}}(a)$, we find for the proportionality coefficients $\hat{\alpha}_B = 0.20_{-0.33}^{+0.20} \,$ and $\, \hat{\alpha}_M = 0.25_{-0.29}^{+0.19}$. Our value of $S_8 \equiv \sigma_8 \sqrt{\Omega_{\mathrm{m}}/0.3}$ is in better agreement with the $Planck$ estimate when measured in the enlarged Horndeski parameter space than in a pure $\Lambda$CDM scenario. In our joint three-probe analysis we report a downward shift of the $S_8$ best fit value from the $Planck$ measurement of $\Delta S_8 = 0.016_{-0.046}^{+0.048}$ in Horndeski gravity, compared to $\Delta S_8 = 0.059_{-0.039}^{+0.040}$ in $\Lambda$CDM. Our constraints are robust to the modelling uncertainty of the non-linear matter power spectrum in Horndeski gravity. Our likelihood code for multi-probe analysis in both $\Lambda$CDM and Horndeski gravity is publicly available at http://github.com/alessiospuriomancini/KiDSHorndeski .

We propose a principled Bayesian method for quantifying tension between correlated datasets with wide uninformative parameter priors. This is achieved by extending the Suspiciousness statistic, which is insensitive to priors. Our method uses global summary statistics, and as such it can be used as a diagnostic for internal consistency. We show how our approach can be combined with methods that use parameter space and data space to identify the existing internal discrepancies. As an example, we use it to test the internal consistency of the KiDS-450 data in 4 photometric redshift bins, and to recover controlled internal discrepancies in simulated KiDS data. We propose this as a diagnostic of internal consistency for present and future cosmological surveys, and as a tension metric for data sets that have non-negligible correlation, such as LSST and Euclid.

We measure cosmic weak lensing shear power spectra with the Subaru Hyper Suprime-Cam (HSC) survey first-year shear catalog covering 137deg$^2$ of the sky. Thanks to the high effective galaxy number density of $\sim$17 arcmin$^{-2}$ even after conservative cuts such as magnitude cut of $i<24.5$ and photometric redshift cut of $0.3\leq z \leq 1.5$, we obtain a high significance measurement of the cosmic shear power spectra in 4 tomographic redshift bins, achieving a total signal-to-noise ratio of 16 in the multipole range $300 \leq \ell \leq 1900$. We carefully account for various uncertainties in our analysis including the intrinsic alignment of galaxies, scatters and biases in photometric redshifts, residual uncertainties in the shear measurement, and modeling of the matter power spectrum. The accuracy of our power spectrum measurement method as well as our analytic model of the covariance matrix are tested against realistic mock shear catalogs. For a flat $\Lambda$ cold dark matter ($\Lambda$CDM) model, we find $S_8\equiv \sigma_8(\Omega_{\rm m}/0.3)^\alpha=0.800^{+0.029}_{-0.028}$ for $\alpha=0.45$ ($S_8=0.780^{+0.030}_{-0.033}$ for $\alpha=0.5$) from our HSC tomographic cosmic shear analysis alone. In comparison with Planck cosmic microwave background constraints, our results prefer slightly lower values of $S_8$, although metrics such as the Bayesian evidence ratio test do not show significant evidence for discordance between these results. We study the effect of possible additional systematic errors that are unaccounted in our fiducial cosmic shear analysis, and find that they can shift the best-fit values of $S_8$ by up to $\sim 0.6\sigma$ in both directions. The full HSC survey data will contain several times more area, and will lead to significantly improved cosmological constraints.

We present three tiers of Bayesian consistency tests for the general case of $correlated$ datasets. Building on duplicates of the model parameters assigned to each dataset, these tests range from Bayesian evidence ratios as a global summary statistic, to posterior distributions of model parameter differences, to consistency tests in the data domain derived from posterior predictive distributions. For each test we motivate meaningful threshold criteria for the internal consistency of datasets. Without loss of generality we focus on mutually exclusive, correlated subsets of the same dataset in this work. As an application, we revisit the consistency analysis of the two-point weak lensing shear correlation functions measured from KiDS-450 data. We split this dataset according to large vs. small angular scales, tomographic redshift bin combinations, and estimator type. We do not find any evidence for significant internal tension in the KiDS-450 data, with significances below $3\, \sigma$ in all cases. Software and data used in this analysis can be found at http://kids.strw.leidenuniv.nl/sciencedata.php

We present cosmological parameter constraints from a joint analysis of three cosmological probes: the tomographic cosmic shear signal in $\sim$450 deg$^2$ of data from the Kilo Degree Survey (KiDS), the galaxy-matter cross-correlation signal of galaxies from the Galaxies And Mass Assembly (GAMA) survey determined with KiDS weak lensing, and the angular correlation function of the same GAMA galaxies. We use fast power spectrum estimators that are based on simple integrals over the real-space correlation functions, and show that they are practically unbiased over relevant angular frequency ranges. We test our full pipeline on numerical simulations that are tailored to KiDS and retrieve the input cosmology. By fitting different combinations of power spectra, we demonstrate that the three probes are internally consistent. For all probes combined, we obtain $S_8\equiv \sigma_8 \sqrt{\Omega_{\rm m}/0.3}=0.800_{-0.027}^{+0.029}$, consistent with Planck and the fiducial KiDS-450 cosmic shear correlation function results. Marginalising over wide priors on the mean of the tomographic redshift distributions yields consistent results for $S_8$ with an increase of $28\%$ in the error. The combination of probes results in a $26\%$ reduction in uncertainties of $S_8$ over using the cosmic shear power spectra alone. The main gain from these additional probes comes through their constraining power on nuisance parameters, such as the galaxy intrinsic alignment amplitude or potential shifts in the redshift distributions, which are up to a factor of two better constrained compared to using cosmic shear alone, demonstrating the value of large-scale structure probe combination.

We compute the spherical-sky weak-lensing power spectrum of the shear and convergence. We discuss various approximations, such as flat-sky, and first- and second- order Limber equations for the projection. We find that the impact of adopting these approximations is negligible when constraining cosmological parameters from current weak lensing surveys. This is demonstrated using data from the Canada-France-Hawaii Telescope Lensing Survey (CFHTLenS). We find that the reported tension with Planck Cosmic Microwave Background (CMB) temperature anisotropy results cannot be alleviated. For future large-scale surveys with unprecedented precision, we show that the spherical second-order Limber approximation will provide sufficient accuracy. In this case, the cosmic-shear power spectrum is shown to be in agreement with the full projection at the sub-percent level for l > 3, with the corresponding errors an order of magnitude below cosmic variance for all l. When computing the two-point shear correlation function, we show that the flat-sky fast Hankel transformation results in errors below two percent compared to the full spherical transformation. In the spirit of reproducible research, our numerical implementation of all approximations and the full projection are publicly available within the package nicaea at http://www.cosmostat.org/software/nicaea.

We present measurements of the weak gravitational lensing shear power spectrum based on $450$ sq. deg. of imaging data from the Kilo Degree Survey. We employ a quadratic estimator in two and three redshift bins and extract band powers of redshift auto-correlation and cross-correlation spectra in the multipole range $76 \leq \ell \leq 1310$. The cosmological interpretation of the measured shear power spectra is performed in a Bayesian framework assuming a $\Lambda$CDM model with spatially flat geometry, while accounting for small residual uncertainties in the shear calibration and redshift distributions as well as marginalising over intrinsic alignments, baryon feedback and an excess-noise power model. Moreover, massive neutrinos are included in the modelling. The cosmological main result is expressed in terms of the parameter combination $S_8 \equiv \sigma_8 \sqrt{\Omega_{\rm m}/0.3}$ yielding $S_8 = \ 0.651 \pm 0.058$ (3 z-bins), confirming the recently reported tension in this parameter with constraints from Planck at $3.2\sigma$ (3 z-bins). We cross-check the results of the 3 z-bin analysis with the weaker constraints from the 2 z-bin analysis and find them to be consistent. The high-level data products of this analysis, such as the band power measurements, covariance matrices, redshift distributions, and likelihood evaluation chains are available at http://kids.strw.leidenuniv.nl/

We test extensions to the standard cosmological model with weak gravitational lensing tomography using 450 deg$^2$ of imaging data from the Kilo Degree Survey (KiDS). In these extended cosmologies, which include massive neutrinos, nonzero curvature, evolving dark energy, modified gravity, and running of the scalar spectral index, we also examine the discordance between KiDS and cosmic microwave background measurements from Planck. The discordance between the two datasets is largely unaffected by a more conservative treatment of the lensing systematics and the removal of angular scales most sensitive to nonlinear physics. The only extended cosmology that simultaneously alleviates the discordance with Planck and is at least moderately favored by the data includes evolving dark energy with a time-dependent equation of state (in the form of the $w_0-w_a$ parameterization). In this model, the respective $S_8 = \sigma_8 \sqrt{\Omega_{\rm m}/0.3}$ constraints agree at the $1\sigma$ level, and there is `substantial concordance' between the KiDS and Planck datasets when accounting for the full parameter space. Moreover, the Planck constraint on the Hubble constant is wider than in LCDM and in agreement with the Riess et al. (2016) direct measurement of $H_0$. The dark energy model is moderately favored as compared to LCDM when combining the KiDS and Planck measurements, and remains moderately favored after including an informative prior on the Hubble constant. In both of these scenarios, marginalized constraints in the $w_0-w_a$ plane are discrepant with a cosmological constant at the $3\sigma$ level. Moreover, KiDS constrains the sum of neutrino masses to 4.0 eV (95% CL), finds no preference for time or scale dependent modifications to the metric potentials, and is consistent with flatness and no running of the spectral index. The analysis code is public at https://github.com/sjoudaki/kids450

We present cosmological parameter constraints from a tomographic weak gravitational lensing analysis of ~450deg$^2$ of imaging data from the Kilo Degree Survey (KiDS). For a flat $\Lambda$CDM cosmology with a prior on $H_0$ that encompasses the most recent direct measurements, we find $S_8\equiv\sigma_8\sqrt{\Omega_{\rm m}/0.3}=0.745\pm0.039$. This result is in good agreement with other low redshift probes of large scale structure, including recent cosmic shear results, along with pre-Planck cosmic microwave background constraints. A $2.3$-$\sigma$ tension in $S_8$ and `substantial discordance' in the full parameter space is found with respect to the Planck 2015 results. We use shear measurements for nearly 15 million galaxies, determined with a new improved `self-calibrating' version of $lens$fit validated using an extensive suite of image simulations. Four-band $ugri$ photometric redshifts are calibrated directly with deep spectroscopic surveys. The redshift calibration is confirmed using two independent techniques based on angular cross-correlations and the properties of the photometric redshift probability distributions. Our covariance matrix is determined using an analytical approach, verified numerically with large mock galaxy catalogues. We account for uncertainties in the modelling of intrinsic galaxy alignments and the impact of baryon feedback on the shape of the non-linear matter power spectrum, in addition to the small residual uncertainties in the shear and redshift calibration. The cosmology analysis was performed blind. Our high-level data products, including shear correlation functions, covariance matrices, redshift distributions, and Monte Carlo Markov Chains are available at http://kids.strw.leidenuniv.nl.

We measure the weak gravitational lensing shear power spectra and their cross-power in two photometric redshift bins from the Canada-France-Hawaii Telescope Lensing Survey (CFHTLenS). The measurements are performed directly in multipole space in terms of adjustable band powers. For the extraction of the band powers from the data we have implemented and extended a quadratic estimator, a maximum likelihood method that allows us to readily take into account irregular survey geometries, masks, and varying sampling densities. We find the 68 per cent credible intervals in the $\sigma_8$-$\Omega_{\rm m}$-plane to be marginally consistent with results from $Planck$ for a simple five parameter $\Lambda$CDM model. For the projected parameter $S_8 \equiv \sigma_8(\Omega_{\rm m}/0.3)^{0.5}$ we obtain a best-fitting value of $S_8 = 0.768_{-0.039}^{+0.045}$. This constraint is consistent with results from other CFHTLenS studies as well as the Dark Energy Survey. Our most conservative model, including modifications to the power spectrum due to baryon feedback and marginalization over photometric redshift errors, yields an upper limit on the total mass of three degenerate massive neutrinos of $\Sigma m_\nu < 4.53 \, {\rm eV}$ at 95 per cent credibility, while a Bayesian model comparison does not favour any model extension beyond a simple five parameter $\Lambda$CDM model. Combining the shear likelihood with $Planck$ breaks the $\sigma_8$-$\Omega_{\rm m}$-degeneracy and yields $\sigma_8=0.818 \pm 0.013$ and $\Omega_{\rm m} = 0.300 \pm 0.011$ which is fully consistent with results from $Planck$ alone.

Upcoming and ongoing large area weak lensing surveys will also discover large samples of galaxy clusters. Accurate and precise masses of galaxy clusters are of major importance for cosmology, for example, in establishing well calibrated observational halo mass functions for comparison with cosmological predictions. We investigate the level of statistical uncertainties and sources of systematic errors expected for weak lensing mass estimates. Future surveys that will cover large areas on the sky, such as Euclid or LSST and to lesser extent DES, will provide the largest weak lensing cluster samples with the lowest level of statistical noise regarding ensembles of galaxy clusters. However, the expected low level of statistical uncertainties requires us to scrutinize various sources of systematic errors. In particular, we investigate the bias due to cluster member galaxies which are erroneously treated as background source galaxies due to wrongly assigned photometric redshifts. We find that this effect is significant when referring to stacks of galaxy clusters. Finally, we study the bias due to miscentring, i.e., the displacement between any observationally defined cluster centre and the true minimum of its gravitational potential. The impact of this bias might be significant with respect to the statistical uncertainties. However, complementary future missions such as eROSITA will allow us to define stringent priors on miscentring parameters which will mitigate this bias significantly.

The Kilo-Degree Survey (KiDS) is an optical wide-field imaging survey carried out with the VLT Survey Telescope and the OmegaCAM camera. KiDS will image 1500 square degrees in four filters (ugri), and together with its near-infrared counterpart VIKING will produce deep photometry in nine bands. Designed for weak lensing shape and photometric redshift measurements, the core science driver of the survey is mapping the large-scale matter distribution in the Universe back to a redshift of ~0.5. Secondary science cases are manifold, covering topics such as galaxy evolution, Milky Way structure, and the detection of high-redshift clusters and quasars. KiDS is an ESO Public Survey and dedicated to serving the astronomical community with high-quality data products derived from the survey data, as well as with calibration data. Public data releases will be made on a yearly basis, the first two of which are presented here. For a total of 148 survey tiles (~160 sq.deg.) astrometrically and photometrically calibrated, coadded ugri images have been released, accompanied by weight maps, masks, source lists, and a multi-band source catalog. A dedicated pipeline and data management system based on the Astro-WISE software system, combined with newly developed masking and source classification software, is used for the data production of the data products described here. The achieved data quality and early science projects based on the data products in the first two data releases are reviewed in order to validate the survey data. Early scientific results include the detection of nine high-z QSOs, fifteen candidate strong gravitational lenses, high-quality photometric redshifts and galaxy structural parameters for hundreds of thousands of galaxies. (Abridged)

Torques acting on galaxies lead to physical alignments, but the resulting ellipticity correlations are difficult to predict. As they constitute a major contaminant for cosmic shear studies, it is important to constrain the intrinsic alignment signal observationally. We measured the alignments of satellite galaxies within 90 massive galaxy clusters in the redshift range 0.05<z<0.55 and quantified their impact on the cosmic shear signal. We combined a sample of 38,104 galaxies with spectroscopic redshifts with high-quality data from the Canada-France-Hawaii Telescope. We used phase-space information to select 14,576 cluster members, 14,250 of which have shape measurements and measured three different types of alignment: the radial alignment of satellite galaxies toward the brightest cluster galaxies (BCGs), the common orientations of satellite galaxies and BCGs, and the radial alignments of satellites with each other. Residual systematic effects are much smaller than the statistical uncertainties. We detect no galaxy alignment of any kind out to at least 3 r200. The signal is consistent with zero for both blue and red galaxies, bright and faint ones, and also for subsamples of clusters based on redshift, dynamical mass, and dynamical state. These conclusions are unchanged if we expand the sample with bright cluster members from the red sequence. We augment our constraints with those from the literature to estimate the importance of the intrinsic alignments of satellites compared to those of central galaxies, for which the alignments are described by the linear alignment model. Comparison of the alignment signals to the expected uncertainties of current surveys such as the Kilo-Degree Survey suggests that the linear alignment model is an adequate treatment of intrinsic alignments, but it is not clear whether this will be the case for larger surveys.

We present a revised strong lensing mass reconstruction of the galaxy cluster RX J1347.5-1145. The X-ray luminous cluster at redshift z=0.451 has already been studied intensively in the past. Based on information of two such previous (strong-)lensing studies by Halkola et al. (2008) and Bradac et al. (2008), as well as by incorporating newly available data from the Cluster Lensing And Supernovae survey with Hubble (CLASH, Postman et al. 2012), we identified four systems of multiply lensed images (anew) in the redshift range 1.75 <= z <= 4.19. One multiple image system consists of in total eight multiply lensed images of the same source. The analysis based on a parametric mass model derived with the software glafic (Oguri 2010) suggests that the high image multiplicity is due to the source (z_phot = 4.19) being located on a so-called "swallowtail" caustic. In addition to the parametric mass model, we also employed a non-parametric approach using the software PixeLens (Saha and Williams 1997, 2004) in order to reconstruct the projected mass of the cluster using the same strong lensing data input. Both reconstructed mass models agree in revealing several mass components and a highly elliptic shape of the mass distribution. Furthermore, the projected mass inside, for example, a radius R ~35 arcsec ~200 kpc of the cluster for a source at redshift z=1.75 obtained with PixeLens exceeds the glafic estimate within the same radius by about 13 per cent. The difference could be related to the fundamental degeneracy involved when constraining dark matter substructures with gravitationally lensed arcs.

We present results of our study of the infrared properties of massive stars in the Large and Small Magellanic Clouds, which are based on the Spitzer SAGE surveys of these galaxies. We have compiled catalogs of spectroscopically confirmed massive stars in each galaxy, as well as photometric catalogs for a subset of these stars that have infrared counterparts in the SAGE database, with uniform photometry from 0.3 to 24 microns in the UBVIJHKs+IRAC+MIPS24 bands. These catalogs enable a comparative study of infrared excesses of OB stars, classical Be stars, yellow and red supergiants, Wolf-Rayet stars, Luminous Blue Variables and supergiant B[e] stars, as a function of metallicity, and provide the first roadmaps for interpreting luminous, massive, resolved stellar populations in nearby galaxies at infrared wavelengths.

We present a study of the infrared properties of 4922 spectroscopically confirmed massive stars in the Large and Small Magellanic Clouds, focusing on the active OB star population. Besides OB stars, our sample includes yellow and red supergiants, Wolf-Rayet stars, Luminous Blue Variables (LBVs) and supergiant B[e] stars. We detect a distinct Be star sequence, displaced to the red, and find a higher fraction of Oe and Be stars among O and early-B stars in the SMC, respectively, when compared to the LMC, and that the SMC Be stars occur at higher luminosities. We also find photometric variability among the active OB population and evidence for transitions of Be stars to B stars and vice versa. We furthermore confirm the presence of dust around all the supergiant B[e] stars in our sample, finding the shape of their spectral energy distributions (SEDs) to be very similar, in contrast to the variety of SED shapes among the spectrally variable LBVs.

We present a catalog of 5324 massive stars in the Small Magellanic Cloud (SMC), with accurate spectral types compiled from the literature, and a photometric catalog for a subset of 3654 of these stars, with the goal of exploring their infrared properties. The photometric catalog consists of stars with infrared counterparts in the Spitzer, SAGE-SMC survey database, for which we present uniform photometry from 0.3-24 um in the UBVIJHKs+IRAC+MIPS24 bands. We compare the color magnitude diagrams and color-color diagrams to those of the Large Magellanic Cloud (LMC), finding that the brightest infrared sources in the SMC are also the red supergiants, supergiant B[e] (sgB[e]) stars, luminous blue variables, and Wolf-Rayet stars, with the latter exhibiting less infrared excess, the red supergiants being less dusty and the sgB[e] stars being on average less luminous. Among the objects detected at 24 um are a few very luminous hypergiants, 4 B-type stars with peculiar, flat spectral energy distributions, and all 3 known luminous blue variables. We detect a distinct Be star sequence, displaced to the red, and suggest a novel method of confirming Be star candidates photometrically. We find a higher fraction of Oe and Be stars among O and early-B stars in the SMC, respectively, when compared to the LMC, and that the SMC Be stars occur at higher luminosities. We estimate mass-loss rates for the red supergiants, confirming the correlation with luminosity even at the metallicity of the SMC. Finally, we confirm the new class of stars displaying composite A & F type spectra, the sgB[e] nature of 2dFS1804 and find the F0 supergiant 2dFS3528 to be a candidate luminous blue variable with cold dust.