I was able to get much more consistent results by changing the scale of my constraints. Maya historically doesn’t like extremely small values so scaling everything by 100 gives me a result that works out of the box. I also defined 3 GCPs with coordinates that push the result into Y-up so I have a clean set of cameras in Maya.
Question for Milos is will this affect any noise filtering etc? Are you considering world scale and distances when determining your level of error correction or given it’s float internally is the scale arbitrary with respect to calculation?
As an example:
I have a a calibration distance that is 47.73 mm
I previously set this to 0.04773 in RC to correspond to it’s internal units being meters.
I NOW set this to 47.73 and no NaN or undefined values in Maya.