The reason for this is that the IK control gets built to be world space aligned, which is why it is encouraged that the rig pose be a t-pose (there’s even an auto-rig pose button that pops up during that step).
Even if you rotate the CVs, the control orientation will still be world-aligned.