How to change my character's pawn collision so it can have different sizes between X/Y axis?

I want to make possible to fit through crevices by only moving sideways, so my first thought was just to make character collision wider, so you can only move through tight spaces when moving sideways, but it seems that default character capsule component is not able to change X/Y axis size (only both at the same time), and adding another collision doesnt seem to do the trick.

Is it possible, and if yes, how do i do that?