jochemla
(jochemla)
August 30, 2023, 2:16pm
1
Hi there,
It would be great for RC to support the Colmap file format as an Export option. Would be very helpful to play with RC aligned components with NERFs/3d-gaussian-splatting.
This was requested ~1 year ago here but no update since, hence re-opening a feature request ticket.
Best,
Thank you for the idea, I added this to our feature request database.
4 Likes
jochemla
(jochemla)
August 31, 2023, 8:00am
3
Thanks for getting back so quickly.
Out of curiosity, do you plan to open access to some of these feature/bugfixes requests on a public board somewhere?
There is no answer for that question. I informed my colleagues about it and they will decide.
jochemla
(jochemla)
September 5, 2023, 9:08am
5
Workflow described here in the meantime:
# Install Kapture
pip install kapture
# Bundler -> Kapture
py C:\Python310\Scripts\kapture_import_bundler.py -v debug -i dataset-bundler\bundle.out -l dataset-bundler\imagelist-local.lst -im dataset-bundler\images --image_transfer link_absolute -o dataset-kapture --add-reconstruction
# Kapture -> Colmap
py C:\Python310\Scripts\kapture_export_colmap.py -v debug -f -i dataset-kapture -db dataset-colmap\colmap.db --reconstruction dataset-colmap\reconstruction-txt
# Colmap txt to bin conversion
mkdir dataset-colmap\sparse\0
COLMAP.bat model_converter --input_path dataset-colmap\reconstruction-txt --output_path dataset-colmap\sparse\0 --output_type BIN
2 Likes
Bennyman33
(Bennyman33)
October 30, 2023, 9:47pm
6
Hello,
I also vote for this export option. Or may be we could have directly gaussian splatting within RC ?
@Jonathan , thank you for this request and the detailed process.
Thanks
Ben
3 Likes
Bennyman33
(Bennyman33)
October 31, 2023, 8:12pm
7
Hello,
@jochemla . I tried to use your scripts but I get errors (I’m not a python guy…).
I have some questions :
I assume that we need to export the image list from RC too and then rename the file imagelist.lst. Is it correct ?
Should all the images be stored in a subfolder (relative to the out file) called image ?
Should we use index.py in first sept then use the index.sh ?
Thanks for any precisions !
Ben
1 Like
Hi Benny, your vote was added.
mar.lor , your vote was added
mar.lor
(mar.lor)
November 7, 2023, 5:30pm
11
Please take into consideration that a lot of users that have been working with Gaussian Splatting, are switching to Metashape. They listened to their user requests, and provided an export solution in a short amount of time:
# Exports undistorted photos, internal/external camera orientations, tie points in a simple COLMAP format.
# Exported COLMAP project can be used as input for Gaussian Splatting. See how to use it - https://github.com/PolarNick239/gaussian-splatting-Windows#requirements
#
# Usecase: photo alignment was done in Metashape, export for Gaussian Splatting is required.
#
# Usage:
# 1. Align photos
# 1.1. Workflow -> Add Photos...
# 1.1.0. (optional, in case of large cropping)
# Tools -> Camera Calibration... -> select all calibration groups at the left panel -> Fixed parameters: -> Select... -> check "cx, cy"
# 1.2. Workflow -> Align Photos... (check "Adaptive camera model fitting" if you have several small calibration groups)
# 2. Run script
# 2.1. Tools -> Run script... then choose this script, without arguments
# 2.2. Scripts -> Export Colmap project (for Gaussian Splatting)
# 2.3. Click Export
# 2.4. Choose destination folder (for several chunks/frames additional subfolders will be added)
#
# Default parameters for GUI can be changed in ExportSceneParams.__init__
#
# Options:
This file has been truncated. show original
So far we have two problems, if we want to keep on working with Reality Capture:
(-) export camera positions (alignment) into Colmap compatible format
(-) export images as cropped without black bars:
To me it clearly is a RC bug that these black strips are present with Fit: Inner Region parameter during undistortion.
If you want to remove these black strips, you can do so with the below kapture utility - based on a kapture project. (with the kapture library, a bit verbose, but seem to do the job). Please follow the full workflow for first converting bundle to kapture, then kapture to colmap.
2 Likes
mar.lor , forwarded this to my colleagues.
1 Like
seta5
(seta5)
November 24, 2023, 2:57pm
13
“Your creative suggestion has sparked our imagination, and we’re thrilled to add it to our feature request database. Your input is invaluable to us.”
seta5
(seta5)
December 21, 2023, 8:05am
14
I fully endorse adding Colmap export to RC! It’s crucial for NERF/3D-Gaussian-splatting workflows. Please prioritize this feature request.
2 Likes
Your vote was added to the request.
Bennyman33
(Bennyman33)
January 29, 2024, 7:50pm
16
Hello Otrhan,
Any news about this request ?
As gaussian splatting and nerf are getting more interest, do you intend to implement colmap export?
The user community needs feebacks.
Thanks
Ben
1 Like
Relven
(Relven)
March 7, 2024, 3:25pm
19
That would be great feature ! +1
saemranian
(Ahmad Emranian)
March 16, 2024, 4:08am
21
Seeking Colmap Export support in RealityCapture to import image alignment data into Jawset software for splat generation. Any updates on this integration? Thanks!
1 Like