Whenever I bake lights the majority of them lose brightness and color saturation.What am I doing wrong?

I light dynamically and then bake down after I get the look that I am happy with. The problem is that whenever I bake down a large portion of my lights lose their intended brightness and color. I try placing reflection capture spheres in problem areas, but this is very touch and go and seems completely inefficient… Starting to really hold me up at work.