Moving Body With HMD In World Location

I have a VR character BP with a VR camera and skeletal mesh body, I am trying to make it so that If I step forwards In real life say 2 meters.
I pass the world space location to the character BP and move it to the cameras World location.( easy enough )
The issue is that because the camera is part of the Character BP , when it moves it also moves the camera with it - causing double movement.

So how can I subtract / offset the cameras location exactly to the amount I move in any direction Back to the Character BP origin so it all lines up correctly without it being obvious to the player