Linear VR grab movement

Hi all! I have a bit of an issue, I am trying to get an object to move according to a set axis (spline) in VR when grabbed, I followed a tutorial: https://www.youtube.com/watch?v=peQq9f_EtrE

While I did have moderate success with it, I cannot get the same smooth movement and snapping to hand shown in the video. When I grab the object, it automatically jumps out near the first spline point, then moves incredible fast to the next point. I also have the object placed in the world at an angle, while I am still translating the location using relative data, it is of course having issues.

When I do not have it placed at an angle, it gives me a similar issue.

I followed the rotation tutorial and everything works as expected except for the object following the VR hand closely.

Does anyone have any ideas?