You have a SpringArm there attached to your camera and holding the FirstPerson mesh, and the Camera is attached to another mesh.
Maybe some of the settings of these components are messing with the perspective.
Try deleting the Spring arm, and moving the camera out of the Mesh.

And set the camera with

If that still doesn’t work, you can try adding a ThirdPersonCamera, making the FPCamera visible and see what’s going on there.

Camera Shake shouldn’t affect the direction unless you’re directly rotating the camera manually or through animation, which could happen if the the Mesh it’s attached to has animations.