Hmm, really strange… When I recreate your scene I can go up the stairs without jumping. The only thing that could solve the problem temporarly is to increase the step height value to a pretty high value 
(increase it step by step).
As I mentioned above check if your steps are really just 20 high 
- how does the collision look like in the ue4?