You can enable RVO Avoidance in Defaults tab of your Character blueprint (under Avoidance section). If your project is with C++, you can also try enabling Detour Crowds.
With RVO you can set weight (default 0.5) and consideration radius, so play with these values to achieve desired effect.