Using SetViewTargetWithBlend unbinds my camera from the first person gunand moves the camera down

I have a game mechanic where when you fire the default person gun, I switch the camera to follow the projectile, when the projectile hits an object, I use SetViewTargetWithBlend to go back to the original FPS Camera, but it seems to move the camera down, and it unbinds the gun from the camera view, meaning when I fire again, I have no aim and it only shoots straight forward, what am I doing wrong?