Noise in Shadows when camera is closer to the ground

I’m having an issue where I get lots of noise and flickering in shadows in my UE5 game. I’ve noticed that this stops if I raise the camera higher off the ground. I’ve a youtube video showing this (you can see the in the middle left part of the screen)

Unfortunately this isn’t really a solution as I need the camera close to the ground as I’m building a racing game. Does anyone know if there is anything I can do to alleviate the flickering, I’ve raised the Lumen final gather from 1 to 2 but it doesn’t make much of a difference.