VR Physic collsion for just the hands for a full body mesh

So i have been trying to get physic collsion for just the hands on a full body mesh for a while now and whatever i do i cant figure it out. I use FARIK so that the skeletal mesh hands are alligned with the motion controllers and do realistic bends when the hand moves but when it comes to making the skeletal mesh hands not to go through objects i always struggle. I manged to kinda make it collide with objects and not clip through it by using physics constraints and connecting the hand bone to an object in the motion controller and it does collide with objects, though its all stretched out and not where the controllers are acutally are, i would sent a video but im new so i cant but hopefully that explains whats wrong. please if anyone knows please tell me.