$\eta$~Car is one of the most massive stars in the Galaxy. It underwent a massive eruption in the 19th century, which produced the impressive bipolar Homunculus nebula now surrounding it. The central star is an eccentric binary with a period of 5.54\,years. Although the companion has not been detected directly, it causes time-variable ionization and colliding-wind X-ray emission. By characterizing the complex structure and kinematics of the ejecta close to the star, we aim to constrain past and present mass loss of $\eta$~Car. $\eta$~Car is observed with the extreme adaptive optics instrument SPHERE at the Very Large Telescope, using its polarimetric mode in the optical with the ZIMPOL camera. A spatial resolution of 20\,mas was achieved, i.e. very close to the presumed 13 mas apastron separation of the companion star. We detect new structures within the inner arcsecond to the star (2\,300\,au at a 2.3\,kpc distance). We can relate these structures to the eruption near 1890 by tracking their proper motions derived from our new images and historical images over a 30\,years time span. Besides, we find a fan-shaped structure in the inner 200~au to the star in the H$\alpha$ line, that could potentially be associated with the wind collision zone of the two stars.