VR Expansion Plugin

Well just turning off late updates should let it work fine as long as you run your IK calculations late enough, the only downside there is that if the object goes out of reach of the IK arm.

The alternative is turning off tracking and movement replication on the motion controllers and manually moving the IK to match the tracking data for the controllers, then just attach the controllers onto the IK hand where you want the grip base and use them just as gripping components.

Either works, regardless though I have to say that I personally do not enjoy late updateless games when holding things, the latency can be very noticeable.