It can be Lumen.
Try to make a copy of the map, then try to reduce the strength of your light sources or remove some.
Also are some of your material using Emissive Colors? if some are, reduse the value there.
But it looks all fine on lower lightmap resolutions. Why the sudden change?
I adjusted the lights so they look good for a light bake on a resolution of 1024. Increasing the lightmap resolution shouldn’t have such drastic differences, should it? There’s no such difference when changing from 512 to 1024.
I don’t know, maybe it is a bug.
Try to set your Quality setting to Epic or Cinematic with lightmap resolution 1024.
Tell me if that worked for you or if you need more help