How do I get rid of this ghosting caused by Lumen GI?

Yes it does. If I turn Lumen of in the project settings or in my post process volume then the issue is gone but the lighting is terrible and there are no shadows.