Strange indoor directional light shadow appearance/disappearance

Hi, all.
I lit a large hall only with a dircetional light (Ultra dynamic sky) and some Spotlights. The roof/ceiling is divided by walls. As you can see in the video those walls receiving shadows the further away the camera is or in other words, they don’t reflect the light. This changes when the camera moves closer.
I could live with it if there was a fade in in the lighting but it changes very quickly.
Any suggestions?