Black normal map spots

I am using Quixel. I tried lowing the contrast but I lose a lot of the detail…