Hi Paul,
this could be related to the changed GPS (as you turned off the drone, the setup changed slightly, as the drone’s GPS is not so precise and the satellites changed their positions during capturing).
You can try to turn off the camera priors for the second flight’s images and provide the alignment.