You’ll want to look at the APlayerCameraManager class. It contains properties for clamping camera rotation.
See the documentation here.
You’ll want to create a blueprint or C++ class extending APlayerCameraManager and set the clamp values. From there, open your Player controller up and set the PlayerCameraManager variable to your custom player camera manager.