Sky Light - Buildings are Pitch Black

I use sky light for my mobile game as the only light source. Cast shadows is disabled. On mobile devices sometimes, not often though, some buildings are pitch black. What is the reason?

Could it be this? Issues with Shadows and MSAA enabled on 5.5 when using distance field indirect shadow. - #3 by Huge9458