Help with Orthographis Camera jumps

Hello, I have an Orthographis view on my camera and I’m changing the camera location 90° using the q and e key. I made the camera to move smoothly left and right.

The problem I’m have is that sometime the player goes behind a wall and the camera then off center/ Jumps to the left or right, I don’t know why( maybe the camera booom)

How do I stop the jumps?

Any help is appreciated, thank you