Why does the second gamepad input stop working when I hit F11 / Full screen the editor after hitting play?

Try “play as standalone game” instead of the normal “play in editor viewport”.

This combined with the Following after the “Event begin play” note in your local Character, should fix your Problem.