How to make rubble (with physics)?

Can you explain to me what I’m doing wrong? Here’s an album showing what’s happening: Only once you touch it does it actually go back to the way it was when it was saved, and it's not even 100% the same. - Album on Imgur