High Res export missing details that can be seen in RC: Please help

Development World Creation
,
1

Hi friends,

I export the scan result to either obj or fbx with and without normals but the details are missing in the mesh like the hair curls and stripes, lines on the shirt, carving on the vases, etc. Checking the high poly in Maya confirms the mesh holds no details so I can’t generate normal maps.

 

The resulting high poly from RC is of no use to generate a normal map to capture the markings/grunge/hair curls/shirt strips onto a low poly mesh. How can I get the details engraved on the high res mesh?

Text from Unity’s photogrammetry workflow i’ve used before with RC https://drive.google.com/open?id=1-h7ADV2kKf_UvtrePJb-MfeBNMZ0QTPr

What am I missing, new workflow? I thought the details would be built into the mesh exported from RC and result of the capture but the exported mesh has no such details. The texture generated by RC is albedo right? so I can’t expect mesh details there. I can see these details on the mesh in RC.

 

I can see the result of applying only the resulting RC albedo map, but in rendering in Unity or probably other game engines do not render these the same without a normal map that offers more control (the carvings here are light), I can’t make a cavity map or AO either, I can’t create a shader with the normal map for VFX.

Unity render of RC resulting albedo only map:

Any tips what I’m missing much appreciated please!

Thanks a bunch for your help!

RC 4K render:

This is the mesh before texturing:

RC export settings - i tried different combinations - obj and fbx, true for vertex normals, export 1 texture, export by parts and single, Embedded textures=true:

RC capture as shown in Maya - no detail:

Substance normal rendered on low poly with RC albedo map applied. I get the same normal result with Xnormal, Substance or Maya generated normal map (expected with the rugged mesh exported by RC):

 

2

Hello Sergio,

In RealityCapture check the reconstructed mesh that you want to export in solid mode without the texture, not in vertices mode or sweet mode. Check the details on the mesh in that mode. The details that you are referring to are just baked shadows in the colored texture from what I can see. Also your mesh is noisy (maybe you used a high ISO setting?), post a sample image that was used to reconstruct the mesh. 

To get the details that you want (hair curls, shirt stripes) you need to have sharp high resolution images without noise. Did you use some kind of scanning rig? It looks like it from one of the screenshots.

3

Hello Jakub

Thank you ever so much for your reply.

 

I hadn’t considered RC baked such good details from shadows into the texture and that threw me off. Yes indeed the solid mode mesh without texture is noisy. Knowing this and that ISO was low, I am led to believe possibly reflections killed a good capture (bronze sculpture). I am going to try again with a polarized filter and post back results on the community forum.

 

Yep, what a good eye, it’s a turntable rig our team built :slight_smile:

 

Thanks a bunch for your help,

 

Sergio

4

You are welcome Sergio. You can try using a coating spray. Check this video from my colleague:

http://janebeecr.blogspot.sk/2017/07/how-to-scan-shiny-surfaces.html

When you have a turntable rig you can make one set of photos for the texture and another set of photos with the coating on for mesh reconstruction. Good luck with your project

Jakub