Data matching problem

I have many sets of data for the same scene. Each set of data contains dozens of images, with the following relationship: there are dozens of cameras at fixed positions. The dozens of images captured by these cameras at the 1st second form the first set of data, the dozens of images captured by them at the 2nd second form the second set of data, and so on. The positions of these cameras remain fixed throughout this process. I used the aligned images from the first set of data as a reference, exported the XMP file, and then placed it in other sets of data. To match the same scale, I also set control points. However, after processing this data and exporting it in COLMAP format, I found that there are still slight differences in camera intrinsic parameters between different sets, and the camera extrinsic parameters do not match the camera IDs or image names either. I’m a bit confused. Do you know what I should do? Thank you.

Here is the output of the first set of data.


And this is the second.