Using RC for mesh texturing

Hi,

I would like to evaluate RC’s texturing abilities on my own data, but this data does not come from photogrammetry. Specifically I have

  • a mesh
  • images with camera poses

The trick I found is to create a COLMAP workspace with no 3D points, and import it in RC together with the mesh. Everything is imported well, and RC likes my mesh (which has UV). I can successfully run the “Colorize” tool.

Sadly I have an error when texturing, which appears right after I click on the “Texture” button: “Unexpected program state”.

I tried tweaking the available parameters but it didn’t seem to help. Hence, I was wondering if the texturing pipeline was trying to access the 3D points ? Or maybe I’m doing something wrong and it should work ?

I hope that the question is well-received although it is about tricking the software a little bit :slight_smile:

Thanks for your help, looking forward to benchmarking RC’s textures on my data,
Koda

Hi Koda, can you try the mentioned workaround from your previous post (Weird coordinate transfrom when importing from COLMAP - #2 by OndrejTrhan)?
Import just COLMAP, create the model from the data, export it, align the exported model with your model, change the RCINFO file name to your model’s name, import your model, texture.

Hi otrhan,

Thank you for your answer. Unfortunately - except if I’m missing something -
I think I cannot reproduce that workaround in my case because I cannot reconstruct the scene just from the images (they are taken in a super challenging context, and poses are estimated via visual-inertial SLAM).

The closest from it that I could try: after importing the external mesh model, reexport it, which does give me an rcInfo file, then reimporting it + texturing. I got the same error.

Thanks for your help,

Best
Koda

PS: anecdotical bug report just fyi - after loading my COLMAP handcrafted project having no 3D points, RC crashes if I click on “Create Model/Preview”

Are you able to provide just unwrap on that model?
In your described workflow it should be basically the same model. But it is possible as you are getting such error that it could be corrupted.

Would it be possible to share your data?

As there are no 3D points, it is not possible to create the model. You need to have them (at least for Preview detail reconstruction, where these points are used for model creation).

RC crashes (like, gets instantly killed) when I try to unwrap the mesh with preexisting UV, but can generate UVs for the same mesh when it doesn’t come with UVs. Although it seems like it generates an empty UV map (it manages to texture w.r.t. that map and the result is all blue).

I can share the data. Here is a link: RC texturing issue - Google Drive

PS: yes I initially clicked on “Create Model/Preview” by mistake, my point was that the app was instantly killed, whereas an appropriate error message was displayed when I then tried the two other export qualities out of curiosity.

Thank you for the data.
The images are quite bad for such work, but I am able to texture the model. But the results are not satisfactory. I am not sure, if this is the model’s issue or the app’s.

Thanks for your time. I know the images are bad, there will be additional work on selecting relevant frames and image processing prior to texturing. I just wanted to have a first impression.

Are you implying that you could just load the data and texture directly without doing anything more ?

Yes, it is possible on my side.

Ok, well that’s nice to hear. Again, “Colorize” works for me, “Texture” doesn’t. Always the same message.

I’ll try to figure out what can be wrong…

I’ve created a bug for this. Now our developers will check, what could be the issue there.

1 Like

Hi otrhan,

The issue was that I was allowing RC to fix non-manifold edges when importing the mesh.
If I don’t do that, it can texture.

We probably got the same texturing result: it’s non-sense (it has to be the algorithm, I got decent results with another texturing tool). I’ll try to explore the different texturing algs RC is offering now !

Thanks for your help.

Best
Koda

Edit: none of the algs seem to work. Maybe RC wants 3D points for texturing ? Which would be surprising but idk.

As I wrote, there is something strange with that model and I created a bug for it. There is nothing else to do for now.