I don’t think that the loaded actors are the same as the actors which were spawned before. But they could have the same GUID. So I would expect weird non-deterministic memory related bugs.
Why don’t you just give every actor in the level a unique ID, store the ID’s of the destroyed actors in a save game, load it later and destroy the actors with the same ID’s (it would be better to simply not spawn them rather than spawning them and destroying them right after that)?