This thread may help you: How to blur a custom shadow map?. I haven’t done any of this, I just remember reading this thread.
Also, for movable point & spot lights, the shadow maps are automatically cached and reused the next frame using shadow map caching, so you don’t have to worry about those.