Strange light coming out of the floor and ruining my scene

Could it be that if you move the cube up he just discards the baked lightmap and switches to real-time lighting? Or have you also baked light for the moved cube?
On the other side, my logic says if you have to move 27k objects up (by the way that sounds insanely much), you maybe just have to move something down. Like a lightmass importance volume or something else… just a guess. Maybe upload the scene?