Blocky Dynamic lighting problem

As you can see, I have quite a problem with the blocky shadows. Right now I’m using distance field shadows, however I’m pretty much stumbling on the settings, cause it doesn’t seem to make much of a difference in my case. Any ideeas on how to get rid of the blockiness?