UE5.4 (and 5.4.1) shadows are broken in VR (VR Template, default settings)

One note after testing it. It comes probably with a high performance cost. If you want to see it use stat gpu and turn the shadow setting on/off.