Hi Anti-Wisdom,
What I think is happening here is the Capsule collision getting pinched between the moving wall and that column on the right.
If you stand in the exact middle of where that block is pushing do you still move upwards?
If not - the simplest solution might be to always have an opening just beyond those push blocks. Changing the collision of those columns to something smoother might help. (but I think it would still be possible to pinch) Another thought is to have logic in the push block that locks any upward movement when it touches the player. (In this situation, even if pinched and pushed into the column, physics should pop you out of the column in the most reasonable direction)
Let us know if any of those help!