I’m trying to export cameras from RC to render matched 3D frames. I can extract video frames, inject GPS data, align and geolocate a model, export the cameras as FBX and combine the separate camera poses into a single animated camera, but when I render the video, the output is shakey… It’s close but not stable enough to use.
Why would cameras imported from FBX to 3D Studio Max not match perfectly with the RealityCapture cameras? Is there a file format or application that would work better?
I am getting an error in 3DS Max when I import the FBX file that might be a clue. I get: “The camera(s) listed below use film offsets or optical center offsets. 3DS Max does not support camera offsets. They will not be imported. Renders may look different.”
When I hit “OK”, it does actually import cameras, but not with the exact names (by image file) in the error message.
Can anyone suggest a way of getting usable cameras from RC to 3DS Max? What are camera offsets?
Hi Donald,
what are your Export Model settings? What do you have set for Undistort principal point? If you had Yes, can you change it to No and vice versa?
Orthan,
Thanks!
I tried exporting again with “Undistort principal point” set to “No” and now it seems to shake less, but it’s still not usable as an animated camera match. (I was able to get a fine match using Syntheyes.)
Also, I’m still getting message on FBX import that 3DS Max does not support camera offsets.
And, I’m noticing that the FOV value changes (a tiny bit) with each image on footage from a fixed FOV (DJI drone).
Does checking “undistort images” also change the fbx camera output?
Has anyone else out there tried to use RC to do match moves?
-Donald
Hi Donald,
can you please share your whole export settings? This could be also related to the Fit and Resolution settings you used.
If you just need to have rendered cameras looking at the model, this is possible to do also in RealityCapture. Then you can make a video from those rendered cameras.
What exactly do you mean by shaky video? Can you show some example here?
I want to be able to use the exported cameras to generate an animation of a 3D model that will be composited into the source video. My hope is that using RC, we’ll be able take a video and obtain a matching camera, undistorted video frames and mesh model that can be used for matting, shadows, reflections, etc.
I can’t share our project renders, but what I’m seeing is a jiggling and bouncing (maybe 3-5 pixels per frame?) in the output where we should be seeing a fairly stable shot.
Thanks so much for your help - it would be great if we can get this to work!
