What causes these strange shadows using GPU Lightmass?

I get these strange shadow artifacts on certain scenes across the static meshes and I’m not sure what causes them. I also get black patches on static Mesh Foliage actors.

This happens only when I use GPU light mass and not Swarm