If you don’t need precise navigation I suggest tweaking navmesh generation parameters to use big voxels and big tiles (there’s a limit to number of tiles and polygons per tile). This should allow you to use a big navmesh bounds and therefore solving your problem 
Cheers,
–mieszko