On the basis of morphological analysis of yearly values of the maximum CME (coronal mass ejection) speed index, the sunspot number and total sunspot area, sunspot magnetic field, and solar flare index, the solar wind speed and interplanetary magnetic field strength, and the geomagnetic Ap and Dst indices, we point out the particularities of solar and geomagnetic activity during the last cycle 23, the long minimum which followed it and the ascending branch of cycle 24. We also analyze temporal offset between the maximum CME speed index and the above-mentioned solar, geomagnetic, and interplanetary indices. It is found that this solar activity index, analyzed jointly with other solar activity, interplanetary parameters, and geomagnetic activity indices, shows a hysteresis phenomenon. It is observed that these parameters follow different paths for the ascending and the descending phases of solar cycle 23. It is noticed that the hysteresis phenomenon represents a clue in the search for physical processes responsible for linking the solar activity to the near-Earth and geomagnetic responses.