Collision with VR hand holding an object + skeletal mesh without simulated physics.

I think what you are trying to do is something like this ? @1:31

If thats the case you need to learn about **physical animation **and how to apply it