Another update:
I think it has to do with the light intensity? I changed the intensity of my directional light from 12 to 6 and lightened the brightness, and the weird dots seem to have disappeared.
Another update:
I think it has to do with the light intensity? I changed the intensity of my directional light from 12 to 6 and lightened the brightness, and the weird dots seem to have disappeared.