Does the object still have collision enabled when you grab it? I find that the collision intersecting with the player capsule causes massive problems. You can also set the collision to something that doesn’t interfere with the capsule.
2 Likes