Are you using the standart character movement and thats why you are jumping toward the camera?
If so, why not just keep the camera parallel to the ground (like a side view), Rotate the sprite to look at the camera, and have the background behind the character, facing the camera.