You don’t (and you shouldn’t) switch game modes for such behavior.
The easiest way is to just keep reference of the two pawns in the controller and switch between them.