UE5 Grabbable Object Collision Issues

I’m having an issue with UE5 VR collision physics.

I’ve copied the grabbable cube blueprints, imported another static mesh and given them a simple box collider and ticked “simulate”.

I can grab the objects just fine and drop them if my hand is still, but if I have any momentum when I release the object, it shoots in a random direction with that momentum instead of the direction of my momentum. I also get the objects clipping into or through my scene objects that have complex colliders.

Any help would be appreciated!