Widget interaction lagging when parent is moving

Hi!

I am making a VR vehicle simulation where you are supposed to interact with stuff in the car with the tracked VR hands. This works when the car stands still (or almost still) but as soon as it starts moving, the Widget Interaction components start lagging behind. The faster the vehicle moves, the farther behind the Widget Interaction components lag behind.

Any ideas?