Hello @Unediense!
Welcomt to UE! Indeed, the default 3rd person camera can become a bit jittery on enclosed spaces. A similar scenario to yours was encountered in the thread below, and was resolvedd by switching the camera to a spring arm component.
There’s a solid guide for this type of setup on the tutorial below, this should give you better control of the camera when cimbing those stairs:
In case the camera is still to close for your liking, an alternative would be to setup fixed angles for the stairs sections, Resident Evil style:
Hope this helps!