Foliage has a Shadow noise/grain - How to fix it?

I just discovered that the scale of this “noise” scales with the screensize.