Saving Lighmap UV space by removing hidden Polygons?

Yes, that was my thought as well. But if I have perfectly snapped geometry this should not happen right?