The objects dealing damage to the character is a great idea, but i wld focus on the character component, functionts that affect on our stamina (combat as u said, climb, etc…), im not any expert but i think the combat can link with the objects, for example: object deals damage but you can block them if you have stamina, like the shield function of the combat. i cant explain better D:
Thanks a lot