How Do I Prevent Projectile Pushes AI/Character?

If you select the collision component for the projectile in the projectile BP, scroll down to the bottom of your component properties. There you should find a green button with a white “+” sign on it that will let you add an overlap component.

Be sure to set the collision component to be using overlap only.