Weapon simulate physics only

Hi

I was wondering if there was a way to make my weapon, which is an axe to simulate physics on certain objects without the character knocking them around

Basically when i walk up to a door and swing my axe, i want the doors to move and break away. This works perfectly, accept my character only has to touch off the door and they move.

Would there be away to disable physics between the character and certain objects.

I tried making the door a destructable but it doesnt look as good as using physics

Thanks in advance