SimpleMoveToActor doesn't find the closest overlap

I’m using a UNavigationSystem with SimpleMoveToActor but the actor is always moving to one predefined location rather than finding the first closest point to the character it overlaps with. Here’s a GIF. Why is this happening?

137865-bug.gif