Hi,
seems weird but i remember i was struggling with the same problem.
I just revisited my old Project to check any obvious changes but turning off Physics Interaction stopped my Pawn from pushing and i also use a Collision Box around the Vehicle to Ragdoll any Pawn before hit.
If it still disturbs you hard contact me on Discord thats quicker i guess 
Discord: lmgang