Passing above the stairs falls down
Not sure how you have things set up, but you could have the default collision response to the pawn set to block, and change it by casting to the ladder when you need to use it (i.e button press)
Thank you. I so imagined it.