Sequencer Lagging Shadows

Hi everyone,

I’m rendering through sequencer but I’m getting a lot of weird shadow lag. I’ve uploaded 2 videos below to show the issue.
All the motion is through the camera moving around in a circle. I’ve tried warm up Frame Count and Delay Before Warm Up as I thought that would help the shadows settle before the next frame but no success. If anyone can help me solve this I’ll be super appreciative