On the details panel of the collider you should be able to choose an option. I think “OverlapAll” or “OverlapAllDynamic” will fix your problem, but you can also check how this collider will act with different kinds of object. You’ll be able to choose between “block”, “Overlap” or “Ignore”.