Kelheor,
The key was to have the Navigation Area Class for the box collision set to None, then collisions would properly work. Here are some images / gifs of my setup.

There definitely seems to be some other issues here, so I’ll keep looking into what those could be and why this option seems to avoid the issue.
Thanks,
Jon N.
