That in part depends on what shadowing method you’re using. Traditional shadowmaps, VSMs, DF shadows, screen traces, some combination thereof?
If you’re using VSMs, one of your main priorities needs to be making sure every single object that’s being shadowed is nanite. Non-nanite geo is very expensive for the pipeline and will utterly kill perf.