How can I don't let the destructible mesh break by my character

How about you uncheck “enable impact damage” in destructible mesh options and apply damage manually by bullets and stuff with apply radial damage ?