Young, nearby stars are ideal targets to search for planets using the direct imaging technique. The determination of stellar parameters is crucial for the interpretation of imaging survey results particularly since the luminosity of substellar objects has a strong dependence on system age. We have conducted a large program with NaCo at the VLT in order to search for planets and brown dwarfs in wide orbits around 86 stars. A large fraction of the targets observed with NaCo were poorly investigated in the literature. We performed a study to characterize the fundamental properties (age, distance, mass) of the stars in our sample. To improve target age determinations, we compiled and analyzed a complete set of age diagnostics. We measured spectroscopic parameters and age diagnostics using dedicated observations acquired with FEROS and CORALIE spectrographs at La Silla Observatory. We also made extensive use of archival spectroscopic data and results available in the literature. Additionally, we exploited photometric time-series, available in ASAS and Super-WASP archives, to derive rotation period for a large fraction of our program stars. We provided updated characterization of all the targets observed in the VLT NaCo Large program, a survey designed to probe the occurrence of exoplanets and brown dwarfs in wide orbits. The median distance and age of our program stars are 64 pc and 100 Myr, respectively. Nearly all the stars have masses between 0.70 and 1.50sun, with a median value of 1.01 Msun. The typical metallicity is close to solar, with a dispersion that is smaller than that of samples usually observed in radial velocity surveys. Several stars are confirmed or proposed here to be members of nearby young moving groups. Eight spectroscopic binaries are identified.