Ways to keep day / night cycle light out of indoor lighting?

Have a standard environment setup with directional light, skylight, etc. Nothing fancy.

Also have various indoor areas properly blocked with thick walls and their own PostProcessVolumes.

How to mitigate day / night changes from affecting the interiors too much?