HMD Full Body IK Late Update Lag

Hi all,

I am currently working on a full body IK.
One thing I noticed was that the body was not following the HMD well. It is like it is attached to a spring. [See Below Video]

What is the current best way to keep the body rigidly attached to the HMD?

I have tried overriding the camera with
XRCamera->SetupLateUpdate(ParentWorld, this, true);

While that made the body follow more rigidly, the camera view was behaving a little erratically and would cause a bit of motion sickness.