AI Move To (large objects?) issue

I’m trying to make some simple moveTo’s with BehaviorTrees and such for my AI’s to go and attack a building, but they always go to the same side, even if I rotate the target, they go to another side/corner if I move the object tho, and also it never is the shortest path:

I’m using the defaults for the Crowd Manager

Could this be an issue with the crowd manager, or is there something I’m missing? I’m using your typical MoveTo an actor with behavior trees