Thanks for that explanation!
I turned it off, but that results in 0 reflections. Maybe I should try to use a SceneCaptureCube. Otherwise I will turn the roughness of the material higher (Which is in my eyes a not very elegant solution). Do you have any advice of how to tackle the problem I have with that (first image, reflections are missing partially)?