I got the same problem today.
The only workaround I found was to disable the gravity by default on the component you grab.
I also disable gravity when the PhysicsHandle grab the component and enable gravity when it drops the object.
It’s not a clean solution but for me it works. If someone knows how to fix it properly I would appreciate.