This can happen when light has to bounce many times to get to a certain spot or when using emissive surfaces as light. On both cases the amount of rays is limited thus the denoiser can be very visible.
Suggest adding more direct light, bigger windows or secondary light sources to try and hide this.