By setting r.Lumen.ScreenProbeGather.Temporal.ClearHistoryEveryFrame to 1 for debugging I found this type of ghosting vanished completely (although my test scene was less detailed).
This means the primary source of the ghosting is the SPG temporal history. This is why you saw some improvement with the previously mentioned settings.
Instead, I propose you should simply reduce the number of frames that are allowed to be accumulated during your accelerated lighting moves, and increase them during slow lighting moves.
Try r.Lumen.ScreenProbeGather.Temporal.MaxFramesAccumulated (default 10)
This can be safely reduced (or even disabled temporarily) proportionately to the lighting update speed needs as to reduce ghosting, although you might in return see more noise. With temporal accumulation it is always going to be a delicate balance between noise and ghosting.
Ray reconstruction and ray regeneration denoisers handle this particular case more gracefully though, so in the near future this will be less of a problem. Ceiling fans were a specific problem Nvidia showcased to demonstrate the improvements of their denoiser.