Did you mark the sky material as ‘is sky’?
also unlit
It sounds a bit like your sky sphere is getting used for lighting computations.