The solution seems to be indirectly related to Ray Tracing as if I disable DX12 it seems to go away.
At least this setting was removed in my DefaultEngine.ini settings
DefaultGraphicsRHI=DefaultGraphicsRHI_DX12
Also the issue is not simply Volumetric Fog by itself bu the interaction of Spotlights and Volumetric Fog.