Volumetric lightmap color artifacts

I noticed that the volumetric lightmap produces dark and colored artifacts on white movable/stationary objects. Is there some parameter somewhere to get rid of it or at least reduce it?
First screenshot has volumetric samples at 1000, second at 20cm.