Rotate both X and Y in a material (HDR, SkySphere)

Did you mark the sky material as ‘is sky’?

also unlit

It sounds a bit like your sky sphere is getting used for lighting computations.