Unreal Engine 5.1 Preview

Nanite has a new feature in 5.1p called “Preserve Density” in the mesh nanite settings that will resolve this issue. I imagine it comes at a performance cost though.