Hey @vardonir!
The issue here may be more to do with the shadows rater than the light themselves. Here are a few possible solutions to the issue, the first from another forum post, the second from a Non-Epic affiliated video on Lumen:
I would also look into virtual shadow maps as they may also be playing a hand.
I hope the above leads you to the solution you need!