The camera isn’t zooming, it’s moving along that red line until it has a place it’s not colliding with anything.
The easiest way to get the result you want is by making the CameraBoom (the red line) straight, and rotating the camera instead to get your desired angle:
Result when I’m close to a wall:
