Found out now that it’s the volumetric fog causing it, in combination with the skylight. I tried to switch the volumetric fog values like this:
r.VolumetricFog.GridPixelSize 3
r.VolumetricFog.GridSizeZ 128
but it didn’t improve anything or bring any visible change… really weird.