How to Stop Player Pawns From Pushing Each Other?

This is not default behavior. You may be simulating physics on the capsule component or another component that collides physically with the other pawn?