Depends on the need to be honest, if want it to be physics handled why not, some games have that. Howerver its true that handling a crucial gameplay mechanics just by physics is not a long term good idea.
- What happens when an npc behind door.
- What happens to doors when something explodes nearby.
- Can door be only opened by pawn object.
- What if door needs to be locked after you enter inside immidiately.
- What if 2 npc try to get from door in such a moment of swing and get stuck.
- Can go on and on..
@MostHost_LA is right about the complexity vs need, however I disagree with the " no place being handled by physics". Some games have different types of physics doors and physics simulated but limited, the thing is to be forward thinking about the need and the potential results for the future in a crucial gameplay element that will handle a lot of logic in future.