Movement with AddActorLocalOffset near walls

I’ve done player controls using AddActorLocalOffset


Collision settings on player

Collision settings on BlockingVolume are as by default

The problem is, when player moves toward the wall even under very small angle, sweep does not apply offset at all. It looks like this: ue5q - YouTube
How can I fix it? For now, the only solution I can think of is to get a normal from sweep result, substract projection on it from delta location and do a second AddActorLocalOffset, but I doubt its a proper solution