How to reduce shadow artifacts and fuzziness when using a high source angle with virtual shadow maps?

Im put a source angle of 10 on my sun and i really like the effect it gives but its causing some weird issues. I like this soft shadow effect it gave and im trying to keep that

The issue is on some surfaces,there are now harsh pixel artifacts that move around and are fuzzy/grainy they jitter around a ton and it’s very noticeable.

I am using virtual shadow maps because im using nanite