Found the issue here after some digging!
Simulate physics is off on the capsule collision of the BP_FirstPersonCharacter, and if turned on it conflicts with the movement.
A solution is proposed in that other post but it makes it so the player is sometimes pushed by the projectiles, which is not ideal.