Sky Atmosphere is straight up black and won't change

Make sure you have Lumen enabled in the project settings. Enabling it solved the problem for me.