ok so the solution is to clear the game mode from a default pawn, spawn and possess the character pawn yourself, by the controller you want.