World partition Landscape won't unload in editor

This can also be affected by LandscapePatch as well.
From what it seems like adding any additional layer brushes of any kind disables unloading streaming proxies, But the reason why is where im lost.