UE4/5 VR Template Controller Jitter

Hello
When spinning up a new VRTemplate project, both in UE4 and 5 the controllers jitter around.

When you turn your whole body and hold your hand in front (turning it too), the controller does not stay in place and lags/jitters awfully despite the performance being great (frametime CPU <4ms, GPU <4ms, no spikes, smooth frametimes)
However, when comparing to the SteamVR menu controller mesh, the SVR mesh doesn’t jitter at all, so no tracking issue.

I am running on the Valve Index at 144Hz

Please help me, thank you very much