I just find out that adding a Custom Collision Profile in the editor settings and applying it to my mesh solved the issue.