How to stop characters from pushing each other

I keep having this problem where my main character can easily push off other characters as if they were a feather. I thought it might be because I had physics enabled or something like that, but nope, they are disabled for all components.
I’ve also tried to disable Physics interaction in the character movement component, but it just doesn’t seem to affect anything.
Could anyone tell me why this happens and how to solve it? I’ve been at it for ages without finding an actual answer.

Thanks in advance.

Can you show an example of exactly what is happening with it? I have them normally collide with each other but haven’t experienced what it sounds like you are having.