# Feature request: add aligned photos after exporting colmap format dataset format, in order to train 3d gaussian splatting

**URL:** <https://forums.unrealengine.com/t/feature-request-add-aligned-photos-after-exporting-colmap-format-dataset-format-in-order-to-train-3d-gaussian-splatting/1818784>\
**Category:** Feedback & Requests\
**Tags:** question, realityscan\
**Created:** [April 24, 2024, 9:58am UTC](https://forums.unrealengine.com/t/feature-request-add-aligned-photos-after-exporting-colmap-format-dataset-format-in-order-to-train-3d-gaussian-splatting/1818784 "2024-04-24T09:58:27Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![TeacherDu](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@TeacherDu](https://forums.unrealengine.com/u/TeacherDu)\
**Post date:** [April 24, 2024, 9:58am UTC](https://forums.unrealengine.com/t/feature-request-add-aligned-photos-after-exporting-colmap-format-dataset-format-in-order-to-train-3d-gaussian-splatting/1818784/1 "2024-04-24T09:58:27Z")

</div>

Dear esteemed RealityCapture developers and friends on the forum,

Greetings!

I am a passionate enthusiast in photogrammetry and 3D reconstruction, regularly utilizing **RealityCapture** for my projects. The software impresses with its maturity and user-friendliness, and I sincerely appreciate your efforts!

Recently, there has been rapid advancement in **3D Gaussian Splatting (3DGS)** technology, showcasing impressive new perspectives in synthesized results while allowing real-time rendering of high-resolution images. This marks a significant milestone in exploration and research. Beyond the original **3DGS** technique, the ecosystem under **3DGS** , including **3DGS** , **2DGS** , **SuGaR** , among others, is thriving. These techniques rely on photos aligned by **Structure from Motion (SfM)** algorithms and the resulting sparse point clouds. They mostly employ the **Colmap** open-source alignment algorithm to generate **3DGS** or **NeRF** models for training. However, **Colmap** ’s algorithmic capabilities are not on par with **RealityCapture** and **Metashape** , often resulting in issues like slow alignment, poor alignment quality, and numerous outlier points, significantly hindering subsequent technical research.

In this regard, **Metashape** , due to its open **Python API** , allows users to create interactive interfaces within the software by writing **Python** scripts. Users can extract aligned photos, align camera poses, and connect points from the scene, then save them in **Colmap** ’s dataset format. This greatly aids in the technical research within the **3DGS** field.

**RealityCapture** , as the world’s leading 3D reconstruction software, seems absent in this AI research trend. While I understand **RealityCapture** is a commercial software with its own development roadmap and customer demands, considering the trend of AI development, I hope the **RealityCapture** development and innovation departments could consider the following requests:

1. **Add support for exporting Colmap dataset format:** I can provide relevant code and demonstrations. (Benefits: Highlighting **RealityCapture** ’s commercial value and technical capabilities in the AI research field.)

2. **Open Python API:** Allow users to script interfaces within the software, customizing workflows. (Benefits: Users can address their own needs, facilitating diverse software usage.)

3. **An inquiry rather than a request:** Does **RealityCapture** have plans to incorporate machine learning, deep learning, or similar new technologies akin to **3DGS** , on top of traditional 3D reconstruction algorithms?

Thank you very much for considering my feedback. Looking forward to further discussions with you all. (If needed, I’m willing to provide my email for in-depth discussions regarding request 1.)

Below are relevant resources:

[gaussian-splatting-GitHub Pages](https://github.com/graphdeco-inria/gaussian-splatting)  
[Metashape\_Script\_Export For 3DGS- Github Pages](https://github.com/agisoft-llc/metashape-scripts/blob/master/src/export_for_gaussian_splatting.py)  
[colmap-Github](https://github.com/colmap/colmap)

Best regards,  
Teacher Du

---

<div class="post-metadata">

**Author:** ![OndrejTrhan](https://d1ap1mz92jnks1.cloudfront.net/user_avatar/forums.unrealengine.com/ondrejtrhan/32/906565_2.png) [@OndrejTrhan](https://forums.unrealengine.com/u/OndrejTrhan)\
**Post date:** [April 24, 2024, 11:24am UTC](https://forums.unrealengine.com/t/feature-request-add-aligned-photos-after-exporting-colmap-format-dataset-format-in-order-to-train-3d-gaussian-splatting/1818784/2 "2024-04-24T11:24:20Z")

</div>

Hi @TeacherDu,  
thank you for your request.  
Regarding to your first question, the COLMAP export is on our roadmap and we are working on it ([Support Colmap Export](https://forums.unrealengine.com/t/support-colmap-export/1277698)).  
Regarding your second question, I will add this to our feature request database.  
And about third one, this could be also considered as a feature request. I am sorry, but I can’t give you more information about it.

---

<div class="post-metadata">

**Author:** ![TeacherDu](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@TeacherDu](https://forums.unrealengine.com/u/TeacherDu)\
**Post date:** [May 13, 2024, 11:22am UTC](https://forums.unrealengine.com/t/feature-request-add-aligned-photos-after-exporting-colmap-format-dataset-format-in-order-to-train-3d-gaussian-splatting/1818784/3 "2024-05-13T11:22:22Z")

</div>

Thank you, @OndrejTrhan. I found alternative solutions from the post link you shared, I will find time to test it. Thank you for your reply.
