@DamirH, do you think the light layers mentioned at 40:06 in the video would work? https://youtu.be/22jvxFoTHBk?t=2404
You could try having the cave and the outside world being in different lighting channels. Having 3 channels could also allow you to have a separate lighting channel in the middle to handle the transition at the beginning of the cave.