The luminosity-size and stellar mass-size distributions of galaxies out to z~3 is presented. We use very deep near-infrared images of the Hubble Deep Field South in the J_s, H, and K_s bands, taken as part FIRES at the VLT, to follow the evolution of the optical rest-frame sizes of galaxies. For a total of 168 galaxies with K_{s,AB}<23.5, we find that the rest-frame V-band sizes r_{e,V} of luminous galaxies (<L_V>~2x10^{10}h^{-2}L_sun) at 2<z<3 are 3 times smaller than for equally luminous galaxies today. In contrast, the mass-size relation has evolved relatively little: the size at mass <M_*>~2x10^{10}h^{-2}M_sun, has changed by 20(+-20)% since z~2.5. Both results can be reconciled by the fact that the stellar M/L ratio is lower in the luminous high z galaxies than in nearby ones because they have young stellar populations. The lower incidence of large galaxies at z~3 seems to reflect the rarity of galaxies with high stellar mass.

We present the evolution of the rest-frame optical luminosity density, of the integrated rest-frame optical color, and of the stellar mass density for a sample of Ks-band selected galaxies in the HDF-S. We derived the luminosity density in the rest-frame U, B, and V-bands and found that the luminosity density increases by a factor of 1.9+-0.4, 2.9+-0.6, and 4.9+-1.0 in the V, B, and U rest-frame bands respectively between a redshift of 0.1 and 3.2. We derived the luminosity weighted mean cosmic (U-B)_rest and (B-V)_rest colors as a function of redshift. The colors bluen almost monotonically with increasing redshift; at z=0.1, the (U-B)_rest and (B-V)_rest colors are 0.16 and 0.75 respectively, while at z=2.8 they are -0.39 and 0.29 respectively. We derived the luminosity weighted mean M/LV using the correlation between (U-V)_rest and log_{10} M/LV which exists for a range in smooth SFHs and moderate extinctions. We have shown that the mean of individual M/LV estimates can overpredict the true value by ~70% while our method overpredicts the true values by only ~35%. We find that the universe at z~3 had ~10 times lower stellar mass density than it does today in galaxies with LV>1.4 \times 10^{10} h_{70}^-2 Lsol. 50% of the stellar mass of the universe was formed by $z~1-1.5. The rate of increase in the stellar mass density with decreasing redshift is similar to but above that for independent estimates from the HDF-N, but is slightly less than that predicted by the integral of the SFR(z) curve.

We use very deep near-infrared photometry of the Hubble Deep Field South taken with ISAAC/VLT to identify a population of high redshift galaxies with rest- frame optical colors similar to those of nearby galaxies. The galaxies are chosen by their infrared colors Js-Ks > 2.3, aimed at selecting galaxies with redshifts above 2. When applied to our dataset, we find 14 galaxies with Ks < 22.5, corresponding to a surface density of 3+-0.8 /arcmin**2. The photometric redshifts all lie above 1.9, with a median of 2.6 and a rms of 0.7. The spectral energy distributions of these galaxies show a wide range: one is very blue in the rest-frame UV, and satisfies the normal Lyman-break criteria for high redshift, star-forming galaxies. Others are quite red throughout the observed spectral range, and are extremely faint in the optical, with a median V = 26.6. Hence these galaxies would not be included in photometric samples based on optical ground-based data, and spectroscopic follow-up is difficult. The spectral energy distributions often show a prominent break, identified as the Balmer break or 4000 Ang. break. The median age is 1 Gyr when fit with a constant star formation model with dust, or 0.7 Gyr when fit with a single burst model. Although significantly younger ages cannot be excluded when a larger range of models is allowed, the results indicate that these galaxies are among the oldest at these redshifts. The volume density to Ks=22.5 is half that of Lyman-break galaxies at z = 3. Since the mass-to-light ratios of the red galaxies are likely to be higher, the stellar mass density is inferred to be comparable to that of Lyman-break galaxies. These red galaxies may be the descendants of galaxies which started to form stars at very high redshifts, and they may evolve into the most massive galaxies at low redshift.

We present deep near-infrared (NIR) Js, H, and Ks-band ISAAC imaging of the WFPC2 field of the HDF-S. The 2.5'x 2.5' high Galactic latitude field was observed with the VLT under the best seeing conditions with integration times amounting to 33.6 hours in Js, 32.3 hours in H, and 35.6 hours in Ks. We reach total AB magnitudes for point sources of 26.8, 26.2, and 26.2 respectively (3 sigma), which make it the deepest ground-based NIR observations to date, and the deepest Ks-band data in any field. The effective seeing of the coadded images is ~0.45" in Js, ~0.48" in H, and ~0.46" in Ks. Using published WFPC2 optical data, we constructed a Ks-limited multicolor catalog containing 833 sources down to Ks,tot ~< 26 (AB), of which 624 have seven-band optical-to-NIR photometry. These data allow us to select normal galaxies from their rest-frame optical properties to high redshift (z ~< 4). The observations, data reduction and properties of the final images are discussed, and we address the detection and photometry procedures that were used in making the catalog. In addition, we present deep number counts, color distributions and photometric redshifts of the HDF-S galaxies. We find that our faint Ks-band number counts are flatter than published counts in other deep fields, which might reflect cosmic variations or different analysis techniques. Compared to the HDF-N, we find many galaxies with very red V-H colors at photometric redshifts 1.95 < z < 3.5. These galaxies are bright in Ks with infrared colors redder than Js-Ks > 2.3 (in Johnson magnitudes). Because they are extremely faint in the observed optical, they would be missed by ultraviolet-optical selection techniques, such as the U-dropout method.