Destructible Environment

I am making a game where you detroy objects by throwing them, one they are destroyed, the actor is destroyed but after I break like 3 objects my game starts lagging majorly. Is there any way I could help the game load and play better?