It might be related to this issue: Vr headset tracking lag with packaged version only - #4 by VictorLerp
The fix doesn’t seem to have made it into 5.3.2 from what I can see, so you would need to compile the mainline engine yourself or wait for the next release.