Skeletal joint space != world space. I think you should look for a way to apply transformation in world space.