It depends what you mean by that randomness.
Number of sparse points, orientation, precision, position?
Can you share some images of different results you are getting?
As your rig is not perfectly stable, that could be also the reason of your results.
By identical dataset do you mean the same images are used or the dataset captured by the same way?