Stopping pawns from pushing physics objects that are way heavier than they are?

After adjusting the character movement variables (push factor) double/triple check that every other object/collision in your BP is disabled/set to no collision. In my case there was a small VR sphere enabled with collision which was causing the overpowered movement.