We present a weak gravitational lensing analysis of 815 square degree of $i$-band imaging from the Kilo-Degree Survey (KiDS-$i$-800). In contrast to the deep $r$-band observations, which take priority during excellent seeing conditions and form the primary KiDS dataset (KiDS-$r$-450), the complementary yet shallower KiDS-$i$-800 spans a wide range of observing conditions. The overlapping KiDS-$i$-800 and KiDS-$r$-450 imaging therefore provides a unique opportunity to assess the robustness of weak lensing measurements. In our analysis, we introduce two new `null' tests. The `nulled' two-point shear correlation function uses a matched catalogue to show that the calibrated KiDS-$i$-800 and KiDS-$r$-450 shear measurements agree at the level of $1 \pm 4$\%. We use five galaxy lens samples to determine a `nulled' galaxy-galaxy lensing signal from the full KiDS-$i$-800 and KiDS-$r$-450 surveys and find that the measurements agree to $7 \pm 5$\% when the KiDS-$i$-800 source redshift distribution is calibrated using either spectroscopic redshifts, or the 30-band photometric redshifts from the COSMOS survey.

We present cosmological parameter constraints from a joint analysis of three cosmological probes: the tomographic cosmic shear signal in $\sim$450 deg$^2$ of data from the Kilo Degree Survey (KiDS), the galaxy-matter cross-correlation signal of galaxies from the Galaxies And Mass Assembly (GAMA) survey determined with KiDS weak lensing, and the angular correlation function of the same GAMA galaxies. We use fast power spectrum estimators that are based on simple integrals over the real-space correlation functions, and show that they are practically unbiased over relevant angular frequency ranges. We test our full pipeline on numerical simulations that are tailored to KiDS and retrieve the input cosmology. By fitting different combinations of power spectra, we demonstrate that the three probes are internally consistent. For all probes combined, we obtain $S_8\equiv \sigma_8 \sqrt{\Omega_{\rm m}/0.3}=0.800_{-0.027}^{+0.029}$, consistent with Planck and the fiducial KiDS-450 cosmic shear correlation function results. Marginalising over wide priors on the mean of the tomographic redshift distributions yields consistent results for $S_8$ with an increase of $28\%$ in the error. The combination of probes results in a $26\%$ reduction in uncertainties of $S_8$ over using the cosmic shear power spectra alone. The main gain from these additional probes comes through their constraining power on nuisance parameters, such as the galaxy intrinsic alignment amplitude or potential shifts in the redshift distributions, which are up to a factor of two better constrained compared to using cosmic shear alone, demonstrating the value of large-scale structure probe combination.

We demonstrate that deep good-seeing VLT/HAWK-I $K_\mathrm{s}$ images complemented with $g$+$z$-band photometry can yield a sensitivity for weak lensing studies of massive galaxy clusters at redshifts \mbox{$0.7\lesssim z \lesssim 1.1$}, which is almost identical to the sensitivity of HST/ACS mosaics of single-orbit depth. Key reasons for this good performance are the excellent image quality frequently achievable for $K_\mathrm{s}$ imaging from the ground, a highly effective photometric selection of background galaxies, and a galaxy ellipticity dispersion that is noticeably lower than for optically observed high-redshift galaxy samples. Incorporating results from the 3D-HST and UltraVISTA surveys we also obtained a more accurate calibration of the source redshift distribution than previously achieved for similar optical weak lensing data sets. Here we studied the extremely massive galaxy cluster RCS2$J$232727.7$-$020437 (\mbox{$z=0.699$}), combining deep VLT/\mbox{HAWK-I} $K_\mathrm{s}$ images (point spread function with a 0\farcs35 full width at half maximum) with LBT/LBC photometry. The resulting weak lensing mass reconstruction suggests that the cluster consists of a single overdensity, which is detected with a peak significance of $10.1\sigma$. We constrained the cluster mass to \mbox{$M_\mathrm{200c}/(10^{15} \mathrm{M}_\odot) =2.06^{+0.28}_{-0.26}(\mathrm{stat.})\pm 0.12 (\mathrm{sys.})$} assuming a spherical Navarro, Frenk \& White model and simulation-based priors on the concentration, making it one of the most massive galaxy clusters known in the \mbox{$z\gtrsim 0.7$} Universe. We also cross-checked the HAWK-I measurements through an analysis of overlapping HST/ACS images, yielding fully consistent estimates of the lensing signal.

We perform a combined analysis of cosmic shear tomography, galaxy-galaxy lensing tomography, and redshift-space multipole power spectra (monopole and quadrupole) using 450 deg$^2$ of imaging data by the Kilo Degree Survey (KiDS) overlapping with two spectroscopic surveys: the 2-degree Field Lensing Survey (2dFLenS) and the Baryon Oscillation Spectroscopic Survey (BOSS). We restrict the galaxy-galaxy lensing and multipole power spectrum measurements to the overlapping regions with KiDS, and self-consistently compute the full covariance between the different observables using a large suite of $N$-body simulations. We methodically analyze different combinations of the observables, finding that galaxy-galaxy lensing measurements are particularly useful in improving the constraint on the intrinsic alignment amplitude (by 30%, positive at $3.5\sigma$ in the fiducial data analysis), while the multipole power spectra are useful in tightening the constraints along the lensing degeneracy direction (e.g. factor of two stronger matter density constraint in the fiducial analysis). The fully combined constraint on $S_8 \equiv \sigma_8 \sqrt{\Omega_{\rm m}/0.3} = 0.742 \pm 0.035$, which is an improvement by 20% compared to KiDS alone, corresponds to a $2.6\sigma$ discordance with Planck, and is not significantly affected by fitting to a more conservative set of scales. Given the tightening of the parameter space, we are unable to resolve the discordance with an extended cosmology that is simultaneously favored in a model selection sense, including the sum of neutrino masses, curvature, evolving dark energy, and modified gravity. The complementarity of our observables allows for constraints on modified gravity degrees of freedom that are not simultaneously bounded with either probe alone, and up to a factor of three improvement in the $S_8$ constraint in the extended cosmology compared to KiDS alone.

This paper is the first of a series of papers constraining cosmological parameters with weak lensing peak statistics using $\sim 450~\rm deg^2$ of imaging data from the Kilo Degree Survey (KiDS-450). We measure high signal-to-noise ratio (SNR: $\nu$) weak lensing convergence peaks in the range of $3<\nu<5$, and employ theoretical models to derive expected values. These models are validated using a suite of simulations. We take into account two major systematic effects, the boost factor and the effect of baryons on the mass-concentration relation of dark matter haloes. In addition, we investigate the impacts of other potential astrophysical systematics including the projection effects of large scale structures, intrinsic galaxy alignments, as well as residual measurement uncertainties in the shear and redshift calibration. Assuming a flat $\Lambda$CDM model, we find constraints for $S_{\rm 8}=\sigma_{\rm 8}(\Omega_{\rm m}/0.3)^{0.5}=0.746^{+0.046}_{-0.107}$ according to the degeneracy direction of the cosmic shear analysis and $\Sigma_{\rm 8}=\sigma_{\rm 8}(\Omega_{\rm m}/0.3)^{0.38}=0.696^{+0.048}_{-0.050}$ based on the derived degeneracy direction of our high-SNR peak statistics. The difference between the power index of $S_{\rm 8}$ and in $\Sigma_{\rm 8}$ indicates that combining the two probes has the potential to break the degeneracy in $\sigma_{\rm 8}$ and $\Omega_{\rm m}$. Our results are consistent with the cosmic shear tomographic correlation analysis of the same dataset and $\sim 2\sigma$ lower than the Planck 2016 results.

We study the statistics of peaks in a weak lensing reconstructed mass map of the first 450 square degrees of the Kilo Degree Survey. The map is computed with aperture masses directly applied to the shear field with an NFW-like compensated filter. We compare the peak statistics in the observations with that of simulations for various cosmologies to constrain the cosmological parameter $S_8 = \sigma_8 \sqrt{\Omega_{\rm m}/0.3}$, which probes the ($\Omega_{\rm m}, \sigma_8$) plane perpendicularly to its main degeneracy. We estimate $S_8=0.750\pm0.059$, using peaks in the signal-to-noise range $0 \leq {\rm S/N} \leq 4$, and accounting for various systematics, such as multiplicative shear bias, mean redshift bias, baryon feedback, intrinsic alignment, and shear-position coupling. These constraints are $\sim25\%$ tighter than the constraints from the high significance peaks alone ($3 \leq {\rm S/N} \leq 4$) which typically trace single-massive halos. This demonstrates the gain of information from low-S/N peaks. However we find that including ${\rm S/N} < 0$ peaks does not add further information. Our results are in good agreement with the tomographic shear two-point correlation function measurement in KiDS-450. Combining shear peaks with non-tomographic measurements of the shear two-point correlation functions yields a $\sim20\%$ improvement in the uncertainty on $S_8$ compared to the shear two-point correlation functions alone, highlighting the great potential of peaks as a cosmological probe.

In recent years, multiple studies have reported substantial populations of large, low-surface-brightness galaxies in local galaxy clusters. Various theories that aim to explain the presence of such ultra-diffuse galaxies (UDGs) have since been proposed. A key question that will help to differentiate between models is whether UDGs have counterparts in lower-mass host haloes, and what their abundance as a function of halo mass is. In this study we extend our previous study of UDGs in galaxy clusters to galaxy groups. We measure the abundance of UDGs in 325 spectroscopically-selected groups from the Galaxy And Mass Assembly (GAMA) survey. We make use of the overlapping imaging from the ESO Kilo-Degree Survey (KiDS), from which we can identify galaxies with mean surface brightnesses within their effective radii down to ~25.5 mag arcsec$^{-2}$ in the r-band. We are able to measure a significant overdensity of UDGs (with sizes r_eff > 1.5 kpc) in galaxy groups down to M200=10^12 Msun, a regime where approximately only 1 in 10 groups contains a UDG that we can detect. We combine measurements of the abundance of UDGs in haloes that cover three orders of magnitude in halo mass, finding that their numbers scale quite steeply with halo mass; N_UDG (R<R200) $\propto$ M200^(1.11+/-0.07). To better interpret this, we also measure the mass-richness relation for brighter galaxies down to $M^*_r$+2.5 in the same GAMA groups, and find a much shallower relation of N_Bright (R<R200) $\propto$ M200^(0.78+/-0.05). This shows that UDGs are relatively more abundant, compared to bright galaxies, in massive clusters than in groups. We discuss implications, but whether this difference is related to a higher destruction rate of UDGs in groups, or whether massive haloes have a positive effect on their formation, is not yet clear.

We present measurements of the weak gravitational lensing shear power spectrum based on $450$ sq. deg. of imaging data from the Kilo Degree Survey. We employ a quadratic estimator in two and three redshift bins and extract band powers of redshift auto-correlation and cross-correlation spectra in the multipole range $76 \leq \ell \leq 1310$. The cosmological interpretation of the measured shear power spectra is performed in a Bayesian framework assuming a $\Lambda$CDM model with spatially flat geometry, while accounting for small residual uncertainties in the shear calibration and redshift distributions as well as marginalising over intrinsic alignments, baryon feedback and an excess-noise power model. Moreover, massive neutrinos are included in the modelling. The cosmological main result is expressed in terms of the parameter combination $S_8 \equiv \sigma_8 \sqrt{\Omega_{\rm m}/0.3}$ yielding $S_8 = \ 0.651 \pm 0.058$ (3 z-bins), confirming the recently reported tension in this parameter with constraints from Planck at $3.2\sigma$ (3 z-bins). We cross-check the results of the 3 z-bin analysis with the weaker constraints from the 2 z-bin analysis and find them to be consistent. The high-level data products of this analysis, such as the band power measurements, covariance matrices, redshift distributions, and likelihood evaluation chains are available at http://kids.strw.leidenuniv.nl/

The Kilo-Degree Survey (KiDS) is an ongoing optical wide-field imaging survey with the OmegaCAM camera at the VLT Survey Telescope. It aims to image 1500 square degrees in four filters (ugri). The core science driver is mapping the large-scale matter distribution in the Universe, using weak lensing shear and photometric redshift measurements. Further science cases include galaxy evolution, Milky Way structure, detection of high-redshift clusters, and finding rare sources such as strong lenses and quasars. Here we present the third public data release (DR3) and several associated data products, adding further area, homogenized photometric calibration, photometric redshifts and weak lensing shear measurements to the first two releases. A dedicated pipeline embedded in the Astro-WISE information system is used for the production of the main release. Modifications with respect to earlier releases are described in detail. Photometric redshifts have been derived using both Bayesian template fitting, and machine-learning techniques. For the weak lensing measurements, optimized procedures based on the THELI data reduction and lensfit shear measurement packages are used. In DR3 stacked ugri images, weight maps, masks, and source lists for 292 new survey tiles (~300 sq.deg) are made available. The multi-band catalogue, including homogenized photometry and photometric redshifts, covers the combined DR1, DR2 and DR3 footprint of 440 survey tiles (447 sq.deg). Limiting magnitudes are typically 24.3, 25.1, 24.9, 23.8 (5 sigma in a 2 arcsec aperture) in ugri, respectively, and the typical r-band PSF size is less than 0.7 arcsec. The photometric homogenization scheme ensures accurate colors and an absolute calibration stable to ~2% for gri and ~3% in u. Separately released are a weak lensing shear catalogue and photometric redshifts based on two different machine-learning techniques.

We test extensions to the standard cosmological model with weak gravitational lensing tomography using 450 deg$^2$ of imaging data from the Kilo Degree Survey (KiDS). In these extended cosmologies, which include massive neutrinos, nonzero curvature, evolving dark energy, modified gravity, and running of the scalar spectral index, we also examine the discordance between KiDS and cosmic microwave background measurements from Planck. The discordance between the two datasets is largely unaffected by a more conservative treatment of the lensing systematics and the removal of angular scales most sensitive to nonlinear physics. The only extended cosmology that simultaneously alleviates the discordance with Planck and is at least moderately favored by the data includes evolving dark energy with a time-dependent equation of state (in the form of the $w_0-w_a$ parameterization). In this model, the respective $S_8 = \sigma_8 \sqrt{\Omega_{\rm m}/0.3}$ constraints agree at the $1\sigma$ level, and there is `substantial concordance' between the KiDS and Planck datasets when accounting for the full parameter space. Moreover, the Planck constraint on the Hubble constant is wider than in LCDM and in agreement with the Riess et al. (2016) direct measurement of $H_0$. The dark energy model is moderately favored as compared to LCDM when combining the KiDS and Planck measurements, and remains moderately favored after including an informative prior on the Hubble constant. In both of these scenarios, marginalized constraints in the $w_0-w_a$ plane are discrepant with a cosmological constant at the $3\sigma$ level. Moreover, KiDS constrains the sum of neutrino masses to 4.0 eV (95% CL), finds no preference for time or scale dependent modifications to the metric potentials, and is consistent with flatness and no running of the spectral index. The analysis code is public at https://github.com/sjoudaki/kids450

We constrain the average halo ellipticity of ~2 600 galaxy groups from the Galaxy And Mass Assembly (GAMA) survey, using the weak gravitational lensing signal measured from the overlapping Kilo Degree Survey (KiDS). To do so, we quantify the azimuthal dependence of the stacked lensing signal around seven different proxies for the orientation of the dark matter distribution, as it is a priori unknown which one traces the orientation best. On small scales, the major axis of the brightest group/cluster member (BCG) provides the best proxy, leading to a clear detection of an anisotropic signal. In order to relate that to a halo ellipticity, we have to adopt a model density profile. We derive new expressions for the quadrupole moments of the shear field given an elliptical model surface mass density profile. Modeling the signal with an elliptical Navarro-Frenk-White (NFW) profile on scales < 250 kpc, which roughly corresponds to half the virial radius, and assuming that the BCG is perfectly aligned with the dark matter, we find an average halo ellipticity of e_h=0.38 +/- 0.12. This agrees well with results from cold-dark-matter-only simulations, which typically report values of e_h ~ 0.3. On larger scales, the lensing signal around the BCGs does not trace the dark matter distribution well, and the distribution of group satellites provides a better proxy for the halo's orientation instead, leading to a 3--4 sigma detection of a non-zero halo ellipticity at scales between 250 kpc and 750 kpc. Our results suggest that the distribution of stars enclosed within a certain radius forms a good proxy for the orientation of the dark matter within that radius, which has also been observed in hydrodynamical simulations.

Verlinde (2016) proposed that the observed excess gravity in galaxies and clusters is the consequence of Emergent Gravity (EG). In this theory the standard gravitational laws are modified on galactic and larger scales due to the displacement of dark energy by baryonic matter. EG gives an estimate of the excess gravity (described as an apparent dark matter density) in terms of the baryonic mass distribution and the Hubble parameter. In this work we present the first test of EG using weak gravitational lensing, within the regime of validity of the current model. Although there is no direct description of lensing and cosmology in EG yet, we can make a reasonable estimate of the expected lensing signal of low redshift galaxies by assuming a background LambdaCDM cosmology. We measure the (apparent) average surface mass density profiles of 33,613 isolated central galaxies, and compare them to those predicted by EG based on the galaxies' baryonic masses. To this end we employ the ~180 square degrees overlap of the Kilo-Degree Survey (KiDS) with the spectroscopic Galaxy And Mass Assembly (GAMA) survey. We find that the prediction from EG, despite requiring no free parameters, is in good agreement with the observed galaxy-galaxy lensing profiles in four different stellar mass bins. Although this performance is remarkable, this study is only a first step. Further advancements on both the theoretical framework and observational tests of EG are needed before it can be considered a fully developed and solidly tested theory.

We present a new training set for estimating empirical photometric redshifts of galaxies, which was created as part of the 2dFLenS project. This training set is located in a 700 sq deg area of the KiDS South field and is randomly selected and nearly complete at r<19.5. We investigate the photometric redshift performance obtained with ugriz photometry from VST-ATLAS and W1/W2 from WISE, based on several empirical and template methods. The best redshift errors are obtained with kernel-density estimation, as are the lowest biases, which are consistent with zero within statistical noise. The 68th percentiles of the redshift scatter for magnitude-limited samples at r<(15.5, 17.5, 19.5) are (0.014, 0.017, 0.028). In this magnitude range, there are no known ambiguities in the colour-redshift map, consistent with a small rate of redshift outliers. In the fainter regime, the KDE method produces p(z) estimates per galaxy that represent unbiased and accurate redshift frequency expectations. The p(z) sum over any subsample is consistent with the true redshift frequency plus Poisson noise. Further improvements in redshift precision at r<20 would mostly be expected from filter sets with narrower passbands to increase the sensitivity of colours to small changes in redshift.

We develop a statistical estimator to infer the redshift probability distribution of a photometric sample of galaxies from its angular cross-correlation in redshift bins with an overlapping spectroscopic sample. This estimator is a minimum variance weighted quadratic function of the data: a quadratic estimator. This extends and modifies the methodology presented by McQuinn & White (2013). The derived source redshift distribution is degenerate with the source galaxy bias, which must be constrained via additional assumptions. We apply this estimator to constrain source galaxy redshift distributions in the Kilo-Degree imaging survey through cross-correlation with the spectroscopic 2-degree Field Lensing Survey, presenting results first as a binned step-wise distribution in the range z < 0.8, and then building a continuous distribution using a Gaussian process model. We demonstrate the robustness of our methodology using mock catalogues constructed from N-body simulations, and comparisons with other techniques for inferring the redshift distribution.

We present cosmological parameter constraints from a tomographic weak gravitational lensing analysis of ~450deg$^2$ of imaging data from the Kilo Degree Survey (KiDS). For a flat $\Lambda$CDM cosmology with a prior on $H_0$ that encompasses the most recent direct measurements, we find $S_8\equiv\sigma_8\sqrt{\Omega_{\rm m}/0.3}=0.745\pm0.039$. This result is in good agreement with other low redshift probes of large scale structure, including recent cosmic shear results, along with pre-Planck cosmic microwave background constraints. A $2.3$-$\sigma$ tension in $S_8$ and `substantial discordance' in the full parameter space is found with respect to the Planck 2015 results. We use shear measurements for nearly 15 million galaxies, determined with a new improved `self-calibrating' version of $lens$fit validated using an extensive suite of image simulations. Four-band $ugri$ photometric redshifts are calibrated directly with deep spectroscopic surveys. The redshift calibration is confirmed using two independent techniques based on angular cross-correlations and the properties of the photometric redshift probability distributions. Our covariance matrix is determined using an analytical approach, verified numerically with large mock galaxy catalogues. We account for uncertainties in the modelling of intrinsic galaxy alignments and the impact of baryon feedback on the shape of the non-linear matter power spectrum, in addition to the small residual uncertainties in the shear and redshift calibration. The cosmology analysis was performed blind. Our high-level data products, including shear correlation functions, covariance matrices, redshift distributions, and Monte Carlo Markov Chains are available at http://kids.strw.leidenuniv.nl.

The Astropy Project (http://astropy.org) is, in its own words, "a community effort to develop a single core package for Astronomy in Python and foster interoperability between Python astronomy packages." For five years this project has been managed, written, and operated as a grassroots, self-organized, almost entirely volunteer effort while the software is used by the majority of the astronomical community. Despite this, the project has always been and remains to this day effectively unfunded. Further, contributors receive little or no formal recognition for creating and supporting what is now critical software. This paper explores the problem in detail, outlines possible solutions to correct this, and presents a few suggestions on how to address the sustainability of general purpose astronomical software.

We present the 2-degree Field Lensing Survey (2dFLenS), a new galaxy redshift survey performed at the Anglo-Australian Telescope. 2dFLenS is the first wide-area spectroscopic survey specifically targeting the area mapped by deep-imaging gravitational lensing fields, in this case the Kilo-Degree Survey. 2dFLenS obtained 70,079 redshifts in the range z < 0.9 over an area of 731 sq deg, and is designed to extend the datasets available for testing gravitational physics and promote the development of relevant algorithms for joint imaging and spectroscopic analysis. The redshift sample consists first of 40,531 Luminous Red Galaxies (LRGs), which enable analyses of galaxy-galaxy lensing, redshift-space distortion, and the overlapping source redshift distribution by cross-correlation. An additional 28,269 redshifts form a magnitude-limited (r < 19.5) nearly-complete sub-sample, allowing direct source classification and photometric-redshift calibration. In this paper, we describe the motivation, target selection, spectroscopic observations, and clustering analysis of 2dFLenS. We use power spectrum multipole measurements to fit the redshift-space distortion parameter of the LRG sample in two redshift ranges 0.15 < z < 0.43 and 0.43 < z < 0.7 as beta = 0.49 +/- 0.15 and beta = 0.26 +/- 0.09, respectively. These values are consistent with those obtained from LRGs in the Baryon Oscillation Spectroscopic Survey. 2dFLenS data products will be released via our website http://2dflens.swin.edu.au.

The Kilo-Degree Survey (KiDS) is a multi-band imaging survey designed for cosmological studies from weak lensing and photometric redshifts. It uses the ESO VLT Survey Telescope with its wide-field camera OmegaCAM. KiDS images are taken in four filters similar to the SDSS ugri bands. The best-seeing time is reserved for deep r-band observations that reach a median 5-sigma limiting AB magnitude of 24.9 with a median seeing that is better than 0.7arcsec. Initial KiDS observations have concentrated on the GAMA regions near the celestial equator, where extensive, highly complete redshift catalogues are available. A total of 109 survey tiles, one square degree each, form the basis of the first set of lensing analyses, which focus on measurements of halo properties of GAMA galaxies. 9 galaxies per square arcminute enter the lensing analysis, for an effective inverse shear variance of 69 per square arcminute. Accounting for the shape measurement weight, the median redshift of the sources is 0.53. KiDS data processing follows two parallel tracks, one optimized for galaxy shape measurement (for weak lensing), and one for accurate matched-aperture photometry in four bands (for photometric redshifts). This technical paper describes how the lensing and photometric redshift catalogues have been produced (including an extensive description of the Gaussian Aperture and Photometry pipeline), summarizes the data quality, and presents extensive tests for systematic errors that might affect the lensing analyses. We also provide first demonstrations of the suitability of the data for cosmological measurements, and explain how the shear catalogues were blinded to prevent confirmation bias in the scientific analyses. The KiDS shear and photometric redshift catalogues, presented in this paper, are released to the community through http://kids.strw.leidenuniv.nl .

The Kilo-Degree Survey (KiDS) is an optical wide-field imaging survey carried out with the VLT Survey Telescope and the OmegaCAM camera. KiDS will image 1500 square degrees in four filters (ugri), and together with its near-infrared counterpart VIKING will produce deep photometry in nine bands. Designed for weak lensing shape and photometric redshift measurements, the core science driver of the survey is mapping the large-scale matter distribution in the Universe back to a redshift of ~0.5. Secondary science cases are manifold, covering topics such as galaxy evolution, Milky Way structure, and the detection of high-redshift clusters and quasars. KiDS is an ESO Public Survey and dedicated to serving the astronomical community with high-quality data products derived from the survey data, as well as with calibration data. Public data releases will be made on a yearly basis, the first two of which are presented here. For a total of 148 survey tiles (~160 sq.deg.) astrometrically and photometrically calibrated, coadded ugri images have been released, accompanied by weight maps, masks, source lists, and a multi-band source catalog. A dedicated pipeline and data management system based on the Astro-WISE software system, combined with newly developed masking and source classification software, is used for the data production of the data products described here. The achieved data quality and early science projects based on the data products in the first two data releases are reviewed in order to validate the survey data. Early scientific results include the detection of nine high-z QSOs, fifteen candidate strong gravitational lenses, high-quality photometric redshifts and galaxy structural parameters for hundreds of thousands of galaxies. (Abridged)

The Flexible Image Transport System (FITS) standard has been a great boon to astronomy, allowing observatories, scientists and the public to exchange astronomical information easily. The FITS standard, however, is showing its age. Developed in the late 1970s, the FITS authors made a number of implementation choices that, while common at the time, are now seen to limit its utility with modern data. The authors of the FITS standard could not anticipate the challenges which we are facing today in astronomical computing. Difficulties we now face include, but are not limited to, addressing the need to handle an expanded range of specialized data product types (data models), being more conducive to the networked exchange and storage of data, handling very large datasets, and capturing significantly more complex metadata and data relationships. There are members of the community today who find some or all of these limitations unworkable, and have decided to move ahead with storing data in other formats. If this fragmentation continues, we risk abandoning the advantages of broad interoperability, and ready archivability, that the FITS format provides for astronomy. In this paper we detail some selected important problems which exist within the FITS standard today. These problems may provide insight into deeper underlying issues which reside in the format and we provide a discussion of some lessons learned. It is not our intention here to prescribe specific remedies to these issues; rather, it is to call attention of the FITS and greater astronomical computing communities to these problems in the hope that it will spur action to address them.

We report follow-up observations of 477 program Near-Earth Asteroids (NEAs) using nine telescopes of the EURONEAR network having apertures between 0.3 and 4.2 m. Adding these NEAs to our previous results we now count 739 program NEAs followed-up by the EURONEAR network since 2006. The targets were selected using EURONEAR planning tools focusing on high priority objects. Analyzing the resulting orbital improvements suggests astrometric follow-up is most important days to weeks after discovery, with recovery at a new opposition also valuable. Additionally we observed 40 survey fields spanning three nights covering 11 sq. degrees near opposition, using the Wide Field Camera on the 2.5m Isaac Newton Telescope (INT), resulting in 104 discovered main belt asteroids (MBAs) and another 626 unknown one-night objects. These fields, plus program NEA fields from the INT and from the wide field MOSAIC II camera on the Blanco 4m telescope, generated around 12,000 observations of 2,000 minor planets (mostly MBAs) observed in 34 square degrees. We identify Near Earth Object (NEO) candidates among the unknown (single night) objects using three selection criteria. Testing these criteria on the (known) program NEAs shows the best selection methods are our epsilon-miu model which checks solar elongation and sky motion and the MPC's NEO rating tool. Our new data show that on average 0.5 NEO candidates per square degree should be observable in a 2m-class survey (in agreement with past results), while an average of 2.7 NEO candidates per square degree should be observable in a 4m-class survey (although our Blanco statistics were affected by clouds). At opposition just over 100 MBAs (1.6 unknown to every 1 known) per square degree are detectable to R=22 in a 2m survey based on the INT data, while our two best ecliptic Blanco fields away from opposition lead to 135 MBAs (2 unknown to every 1 known) to R=23.