setting bShouldPerformFullTickWhenPaused = true; in the constructor of the player controller fixed this exact issue for us
bShouldPerformFullTickWhenPaused = true;