Hi, I am trying to develop workflow for 3D camera tracking and model generation from Reality Scan to other 3D software. Currently I am doing the following:
- import image sequence
- Select all input images and change the ‘-1’ value by Prior Calibration->Calibration Group and Prior Lens Distortion->Lens Group to 1 (I believe this tells RS that they are all the same camera, so that it creates a single focal length and distortion parameter for all… at least this is the result of doing this)
- Align and texture.
- Select all of the images and export an fbx with the following settings (including the undistorted image sequence):.
- Import fbx into 3D software
At this stage I have the 3D model and cameras created for every frame, and if I set the camera to the same resolution as the image sequence and load an undistorted image into its background display, the undistorted images all seem to line up correctly with the 3D model. I have a python script that then creates a single animated camera through them.
Is all of the above the correct workflow for doing this? I’m concerned I am losing some lens correction cleverness by doing this, ie the lens principal point. But I also don’t think I can let Reality Scan change the camera parameters every frame (focal length and lens distortion) in terms of the 3D rendered content being distorted to match the original footage?
Now the bit I can’t get working at all is the STMAP export to enable distortion of the 3D rendered footage to match the original footage in compositing. If I select the STMAP export in the exports, a lot of time Reality Scan crashes after ten or so seconds before I even click OK. And when I do export, the STMAP images do not seem to be showing a distortion map:
What am I doing wrong here with the STMAP export? The following are my settings for that export:
