Strange light coming out of the floor and ruining my scene

As it only appears on non static objects, can it come from the Volumetric lightmaps that give dynamic objects their GI? Are you using a Lightmass Importance Volume? Can you show the volumetric light samples (viewport → show/visualise/Vomuetric Lightmap), maybe they are going crazy.

Are you using a cubemap?