If the player is not going to see the other side of the wall place a static cube mesh around the scene as an extra layer and rebuild. This is a temporary and easy fix.
I made an indoor scene, and still need the directional light to come throught some holes in the ceiling. However, it lights up the inside of the scene. as seen on the picture, my brickwall gets a very strong highlight from it. I have a two-sided material on my mesh. It helps, but its still there.
Thanks for the answer. I’ll go with that for now. hope there is another way tho