Exponential height fog looks drastically different on different shadow settings

If I have shadows on high or ultra, the fog looks good.
If I put shadows on medium or low, the fog essentially disappears.

Any idea how to fix this?

High:

Low(hard to see but it’s just dark shadows with no visible fog):