When you have set the Position you can also set the position accuracy:
If you are 100% sure with the positions set there zeros and in Alignment settings/Camera prior settings set higher Position prior hardness (try to set it to 100)
1 Like