nevermind it appears to be viewport based instead of controller based.
"InputMode is NOT separately set per player. InputMode is set per Viewport. So in this case the GameViewport. So if you have 2 or more local players and you have one of them opening a menu, you CAN’T set the InputMode to “UIOnly”, because that effects the other players, that need Game Input, too.
In this case you need to use “GameAndUI” as InputMode."