Lumen inconsistency when rendering via movie render queue on runtime

When packaging and using movie render queue on runtime there are inconsistencies sometimes, like every 5th image we render, with the lumen scene /surface cache.
It seems it doesn’t get fully loaded in before it starts rendering.
Reflections are black and shadows are too dark, light isn’t calculated correctly.