How do I associate my character with a Navigation System Agent?

I don’t understand why is it not possible to set on the character which navmesh to use. Because i want to limit access to a character but not based on his size.