Control Rig: different result between in world and in editor

My control rig works perfectly in the rig editor, but when placing the rig in the world the limbs are in the wrong place.

I am basically getting a different result in the rig editor to the world space.

In the editor the joints work fine, joints are working as intended. I have saved, compiled, restarted…
Placed in world:

In Editor:

I don’t know if I am doing something wrong or is this a bug?

I can set the transform of the bone, but then I get horrible stretching.

Happening with multiple limbs. Looks fine in editor, then is a total crazy broken mess when placed in world.

I’m missing something fundamental here, right?