Breaking my head over what is wrong here - clipping/distance glitches

I can’t seem to figure out how to fix this? I’ve trying fiddeling with the terrain settings, with the far and near clip, and nothing seems to help. This is a VR application, so near clip can’t be too distant.
Things seem to appear in front of other parts, even within the same model…
I don’t need things to look super pretty in the distance, but this is unpresentable.
Is there some setting that i’m missing, or do i need to design things differently?