Can't control player 2 unless I click in the viewport

I set “Game Gets Mouse Control” to true, but didn’t change anything. I can always control player 1, it’s players 2, 3, and 4 that I can’t control until I left-click, or right-click, the mouse. happens both in PIE mode and in a build of the game.