Skylight shadows rendering problem

Hello,

Im having this issue with Skylight.

I put it in my scene and it somehow upon baking, it messes up the shadows of only my wall assets, the rest of the assets in the scene seem ok.

Black patches all over basically, as if lightmap resolution got screwed up.

Yet, this does not happen when baking with any other light sources, and all my lightmap resolutions for these sections are either 512 or 1024.

I also put a lightmass importance volume box around my scene, it didnt fix it.

If you have anyone has any ideas with this, it would be of great help !!

Thank you