You don’t need to be looking at the sun or bright objects to get lens flares. Light can be reflected from angles you are not looking at.
These are 360 videos, not Occulus/HTCVive roomscale where every element is live & interactive and can react to viewers in real time.