Wow, no answers? well I just had the same problem, in the Destructible Mesh settings, there are a few values to play with.
You can check the “Custom Impact Resistance”, and set the Impact Resistance higher.
Then you can also play with the Max Chunk Speed and Fracture Impulse scale.