Chip off destructible mesh

I am currently playing around with destructible meshes, and I wanted to have a wall that could can take apart with a gun.

I have setup a destructible mesh (a wall) with 150 chunks. The I modified the standard FPS Character, to apply radial damage if it hits a destructible mesh.
The Origin is set to the hit position, and damage causer to self.

The problem here is, that when I hit it, it just collapses.
I want to only chip of some chunks, and have everything else stay.

I already tried to look into it, but apparently for everyone else this just work right out of the box.