If I remember correctly character did have some separate force value that it applies when it collides with another physics object. I fiddled around in some football game concept and the ball was sent flying everytime it collided with player. Turning the force down solved the problem for me. I’m sorry but I have no editor available at the moment but check out the MovementComponent configurations. If I remember correctly it was controlled from there.
Edit: UCharacterMovementComponent | Unreal Engine Documentation I think it was the InitialPushForceFactor.