Tbh I allready founded a workaround for this problem, just forgot add an answer.
All I did is just instead of parenting hands to controller, I connected them with Rope Physics Constraint. So hand just gonna follow the controller, not stuck to it.
1 Like