Do you have some of your code were the character grabs the wall? You will probably need to create a rotation based on the players forward vector and the walls vector (that faces out towards the player).
I’m not sure what axis your player is on, but I assume creating a look at rotation and setting your player Z (Yaw) rotation to that should help.