It’s all about the RAM memory, and the ticking so think it yourself : P, You destroy them no more ticking and no more memory ( I think i may be wrong). Performance it’s an important. try out UDK
My self I don’t really care so much about destroying actors unless it’s a multiplayer game.