Remove Destructible Actor

I’ve been trying to get the destructible meshes to work.
My idea is to make some boxes destroy after some damage, explode, disappear, and after a while, respawn.
The problem is, if i destroy the object, while it’s still interacting with something( e.g. colliding, overlapping, being shot ), the engine crashes. I guess it doesnt really like that I remove while its still doing its work, but then how should i know when to remove them?
Is there a proper way to unload all the physics objects from it, turn off its features entirely, then destroy the actor holding the destructiblemesh?
Im using 4.18 engine