AI keeps trying to path over an obstacle it can't step over

It seems your navmesh agent radius size is too small. It needs to match (or be bigger than) AI agent’s collision radius. Otherwise (like seen on the video) AI will run into obstacles because navmesh tells them they should be able to fit.

Cheers,

–mieszko