I HAVE FOUND THE PROBLEM
I can not imagine how annoying this might become for someone that has no clue where to specifically find the controls for these things.
It all has to do with the “Environment Color” variable under the World Settings. By default it is set to a color that is not black and an intensity of 1. In order to solve this issue, and to ensure your lighting information comes only from your placed lights in your scene, either change the “Environment Color” to black, or turn the “Environment Intensity” variable to 0 in you World Settings.
If you have 4.22.1 or above and are struggling with this issue, I hope this finds you well.
