Rebuilding navmesh on runtime in multiplayer

When you say holes stay in it - you may have objects that are affecting the navigation and blocking it. If so, you need to identify the objects and change that setting.