If the above is the case, I’d try it like so:
Perhaps tone down the Impulse Strength.
I’d disable Impact Damage here.
And if you want the physics to also apply damage via Impacts, lower this a lot (tweak until stuff breaks in a satisfying manner when it falls down but keep around 0.005 or thereabouts)
Otherwise things will shatter when simulating when you breathe on them. This seems OK.