Lightmap resolution was already set a bit on the high side, at least according to the Lightmap Density visualization (which by the way, I have to switch my project to DX11 for that visualization to work, otherwise it crashes the engine). I increased it further so most of it is well in the red, and re-baked. This is what I got:
