Your HUD should only be displaying the score. The math, for adding or subtracting from the score, should be done on a separate Blueprint like the Game Mode or Character Blueprint. Then, you simply cast the score from there to the HUD, or whichever Blueprint needs the info.