Just found a solution for it on another post I made
I found that cranking up the Dynamic Shadow Distance MovableLight value (found in the Directional Light > Cascaded Shadow Map Settings) past 20,000 – into like 100,000+ solved it.
But the further away you are from the landscape, the more you need to increase it by.