Are you creating the HUD widget on the player pawn? You could always try placing that logic in the game mode or HUD class.