Switching UCharacterMovementComponent::DefaultLandMovementMode to from Walking to Navmesh Walking fixes the pushes, however the character that are behind are stuck regardless