Scene capture sphere doesn't capture sky color?

Hello! I currently have my Scene Capture Sphere using a specified cubemap as I got that looking the best.
But after realising that it doesn’t really work with a cubemap captured at daytime for my day & night cycle, I wanted to change it to use the captured scene instead.

However, when I do, it will not make use of the sky color and it’s super dark.
I have to increase brightness to 20 (which is on 4 with the specified cubemap), and the sky appears black in reflections, despite it capturing clouds.

Any suggestions on what I can do?