Could it be due to “Local Exposure Shadow Contrast” in the project settings? (set too high)
Other than that another option might be due to Material Ambient Occlusion.
It gives more granular details in the AO pass.