iPhone 13 Pro photos - misalignment issues

Development Asset Creation
1

Hi there,

I wanted to report a bug I keep seeing intermittently regarding the misalignment of scans using images from an iPhone 13 Pro using the latest version of RealityCapture (v1.2.0.17385)

One datasets where the captured subject (in this case, a wall or a door) has enough features and the images have enough overlap, the alignment result has a ton of misalignments causing bad geometry.

The images are captured in Apple’s ProRaw format (.DNG) however, the results are the same with .HEIC or .JPEG as well.

 

Here are 2 examples:

Example 1: 1_rothemberg (images + RC project)

Here, I isolated 8 photos from the full image set to showcase the misalignment on segment that shouldn’t have any misalignments (doe to high number of features in the images)

For a quick gif of what the images look like (to judge overlap and features) https://gfycat.com/everlastingwelcomeconey

Here’s the meshed result: 

(seems like the image uploads of this forum aren’t working, so here is the image uploaded to imgur - https://imgur.com/FzhWOXb)

Example 2: 2_berlindoor (images and RC project)

Here, I was able to get a proper alignment on this image set only once, and anytime I processed the same images with the same settings, I kept getting badly aligned results. 

Here’s the difference between the two. 

Imgur album: https://imgur.com/a/1Bqz2Wjj

So clearly, there’s something going on with aligning iPhone 13 Pro images. Whether this has something to do with the Optical Image Stabilization system or some other images processing, I’m not sure. 

2

Hi Azadbal, I tested your data and I’ve got a relatively nicer alignment. What were your alignment settings? 

 

3

Hi 374823146340, thanks for following up on this. 

For example 1, I used

  • Image Downscale 3

  • max features per mpx : 10k

  • max features per mpx : 40k

  • Detector Sensitivity: High

  • Preselector Features: 20k 

 

As for example 2, my imgur album with the screenshots wasn’t linked correctly, so here it is: https://imgur.com/a/1Bqz2Wj

Can you test the dataset for that one as well? As I mentioned, once out of I dont know how many times, it aligned properly, but every other time I try and align, I get horrible results as shown. 

 

4

I would rather use pre set settings, or don’t use image downscale in this case.

Tested your data again, and it looks quite good for me.

I tested it more times and for me the alignment was right. What you can try, is open RealityCapture with pushed SHIFT and there choose Make it like a clean install.

Your                                                                                         Mine

5

Thanks 374823146340, I might try again with a clean install but I’m not excited about losing my Quick Access Toolbar shortcuts

Can you post your full alignment settings as well? 

6

Sure, in most cases I use pre set settings: