First of all, I’m not engine support. I happen to be very active on the Forums in the XR category because I care about ya’ll being able to succeed with your projects, but there’s only so much I can do while making sure that my responsibilties are covered.
On this particular topic, I don’t have an immediate answer, which means that I would have to try and reproduce your issue, which can take me any amount of time, and it might not yield the same results. You’re also using tools that aren’t native to Unreal Engine (DLSS), which is something that Nvidia supports, not us.
Have you tried disabling “everything” and test? Virtual Shadow Maps are in beta and a feature we didn’t have in UE4, have you tried disabling them? They’re not supported w. the Forward Renderer so I wouldn’t be surprised if they don’t work in Deferred/stereo either.
If you think you’ve come across a bug, you should submit a bug report. If you don’t get traction on that, your best case of action is to provide a list of reproducible steps that displays the same issue you’re seeing. Not your full project, but a list on how we can reproduce the issues you’re seeing.