Mannequin explodes after simulating physics

Hi, I tried to make a ragdoll that is still interactive with other pawns, but if leave collision response with pawns as block it causing weird issues. When simulate starts, the skeletal mesh “explodes” (jumps backward instead of just falling). And if I try to move it with a player character after few tries it shoots me in the air. So is there any way that I can simulate physics on skeletal mesh and still interact with it with other characters by walking into it and moving it?

Video that shows everything: