Well, I tried cranking up the sun intensity and indirect lighting (picture 1) as well as the camera exposure (picture 2). Both gave me terrible lighting where the light seriously flickered on the walls.
Picture 3 is where I took off the roof. That actually worked well, but removing the window or even the walls on that side of the house did nothing significant.
