Possible to use the physics asset to stop VR hands passing through walls?

I have been working on trying to prevent my vr hands from going through walls and thought rather than adding collision to the hands which also does not seem to stop them going through walls. could we use the skeletal mesh physics asset.?