I think you might be seeing the exact same issue i am seeing, only i was using a HDR map for my ambient light source… GI Changes as camera moves (Lumen GI)
I dont have a solution yet, but i dont want to use any post-processing as all that will be done in Nuke after i just need more GI to be more accurate…