Hi Johan,
you are right, the glass is the first issue there. Then also the capturing technique, as I suppose you have the images mostly from the ground. Have you used also laser scan in this project? If so, you can try to set higher priority for the laser scans in the meshing process (How to give more priority to laser scans in reconstrution).