After a bit more digging, I found that enabling the mouse cursor in the player controller caused this problem (and thus, disabling fixed it.)
This problem can be replicated in the base FPS Test application by simply pausing the game state and enabling the mouse cursor on the PlayerController actor.