I asked about the grainy shadow issue on Twitter and Daniel Wright who is working on lumen graphics in UE responded:
try ‘r.Lumen.ScreenProbeGather.StochasticInterpolation 0’
High scalability sets this to 1, which makes Lumen slightly faster but noisier. You can override in your game’s DefaultScalability.ini