Yeah that lightmap UV is a nightmare.
You want to keep your UV geometry mostly contiguous and with a fair amount of padding, you have neither. Just a pile of rectangles. Which is not surprising, because Blender’s lightmap packer is worthless.
Try just using Smart UV project with the default settings except set the island margin to .05 or .1