Hi,
I’ve got a tool that extracts equilateral frames from 360 video and then splits out the images (usually into 8 images) with a user set overlap for processing in RealityScan. However what I see often is frames fail to align due to lack of features (sky etc). This is primarily to do alignment for Gaussian Splat processing.
I’d like to validate if this workflow is viable as so far all I’ve managed to do is crash RealityScan on alignment so I’m at the point of abandoning it. I’m currently writing out XMP files per image. I want to define them as a rigid camera cluster that will align with other camera clusters. So I’m hoping that the images that do align will carry the others with them.
When I import the images I get this
When I align them RealityScan just crashes. These are my alignment settings and I’ve tried many different versions trying to get an alignment.
Here’s two XMP examples of the same frame from different clusters. Perhaps these are wrong?
Frame 1 Row 0 Coloumn 0
<x:xmpmeta xmlns:x=“adobe:ns:meta/”>
<rdf:RDF xmlns:rdf=“http://www.w3.org/1999/02/22-rdf-syntax-ns#”>
<rdf:Description xmlns:xcr=“http://www.capturingreality.com/ns/xcr/1.1#”
xcr:Version=“3”
xcr:Rotation=“-0.707107 0.000000 0.707107 -0.500000 0.707107 -0.500000 -0.500000 -0.707107 -0.500000”
xcr:Position=“0 0 0”
xcr:PosePrior=“initial”
xcr:Rig=“{92546BBE-342C-4AF1-B045-25D9706EEBE7}”
xcr:RigInstance=“{C48739EA-6150-45BC-9C85-DD23E2A6E6B6}”
xcr:RigPoseIndex=“0”
xcr:CalibrationGroup=“1”
xcr:CalibrationPrior=“initial”
xcr:FocalLength35mm=“18.0”/>
</rdf:RDF>
</x:xmpmeta>
Frame 2 Row 0 Column 0
<x:xmpmeta xmlns:x=“adobe:ns:meta/”>
<rdf:RDF xmlns:rdf=“http://www.w3.org/1999/02/22-rdf-syntax-ns#”>
<rdf:Description xmlns:xcr=“http://www.capturingreality.com/ns/xcr/1.1#”
xcr:Version=“3”
xcr:Rotation=“-0.707107 0.000000 0.707107 -0.500000 0.707107 -0.500000 -0.500000 -0.707107 -0.500000”
xcr:Position=“0 0 0”
xcr:PosePrior=“initial”
xcr:Rig=“{92546BBE-342C-4AF1-B045-25D9706EEBE7}”
xcr:RigInstance=“{456273B8-8334-48BF-904F-1D64EA6E6D81}”
xcr:RigPoseIndex=“0”
xcr:CalibrationGroup=“2”
xcr:CalibrationPrior=“initial”
xcr:FocalLength35mm=“18.0”/>
</rdf:RDF>
</x:xmpmeta>
Perhaps it’s not viable and this setup is only for re-using camera rigs between the same exact rig, which makes sense, but I wanted to check if someone thinks there is a way to do it?
Thanks!