Navigation invokers doesn't work on simple actors

Hello everyone!
I have the problem: I want my character to move on a simple click. To achieve this, I have a dummy actor, which I move into location of the click, attach it to an actor under the cursor and move to it. Also, I have a big map, so I decided to make dynamic navmesh with generation only around invokers.
I’ve registered my characters as invokers and they work properly, but making the same with these dummy actors doesn’t make navmesh being rebuilt near invokers. I even checked that they exist and in the proper position (I draw a sphere on every GetInvokerLocations()). So I really see that my invokers are registered, stand on proper positions, but navigation doesn’t update near them at all.
I guess it might be because of SetActorLocation instead of moving like a Character, but every Update navigation functions are private, so I don’t know how to force navmesh to see them.
The question is how to make simple actors force navmesh to be built near them. I think so because when I just drop this simple actor on the level it works, but moving it doesn’t make navmesh be built near new position.

P.S. Navmesh are generated all over the map and set to dynamic around invokers only.