You might have better luck adding relative rotation to the camera instead of adding controller pitch/yaw inputs. Then just clamp the values so it can’t rotate more than you allow it, and make sure the camera is attached to the player’s head.
Probably not the best approach, but hopefully will get the results you’re after.