Ozone in Earth's atmosphere is known to have a radiative forcing effect on climate. Motivated by geochemical evidence for one or more nearby supernovae about 2.6 million years ago, we have investigated the question of whether a supernova at about 50 pc could cause a change in Earth's climate through its impact on atmospheric ozone concentrations. We used the "Planet Simulator" (PlaSim) intermediate-complexity climate model with prescribed ozone profiles taken from existing atmospheric chemistry modeling. We found that the effect on globally averaged surface temperature is small, but localized changes are larger and differences in atmospheric circulation and precipitation patterns could be significant regionally.