Found the culprit - disabled Global Illumination (Lumen) in project settings and the ghosting is gone.