Shadows for small object fades out to early

You can increase resolution and tinker with settings at a great cost of performance and little change to your scene bottom line is this, you cant really fix this issue as it is directly related to some of the limitations that come with realtime shadow maps and cascades and biases. Unless you bake things you will continue to run into these shortcomings.