VR Grab and set bone physics but only to the affected bone and not it's childs

I’m in VR trying to create some kind of puppet. When I grabbed a bone, i used a physics handle to move the bone around but all of it’s child goes limp! I am using “Set All Bodies Below Simulate Physics” when i grabbed the bone.

What I want is to grab the bone and none of the child goes limp, but just continue to follow the grabbed bone as they were.

Anyone have a solution?