Instead of manipulating springarms (which is the source of the issues with Control Rotation), (de)activatate cameras instead.
did you try with ‘set target view with blend’ ?
This will not work since OP’s cameras are just components inside a single actor. No need to set another View Target since it does not change.