Build a 3D point cloud of a room or outdoor location by photographing it from multiple angles and running DUSt3R.
Use DUSt3R as a camera pose estimation step in a robotics or visual effects pipeline that needs 3D geometry from photos.
Experiment with neural 3D reconstruction through a browser-based interactive demo without writing any code.
| naver/dust3r | jarun/buku | pyqt5/pyqt | |
|---|---|---|---|
| Stars | 7,132 | 7,127 | 7,127 |
| Language | Python | Python | Python |
| Setup difficulty | hard | easy | moderate |
| Complexity | 4/5 | 2/5 | 2/5 |
| Audience | researcher | developer | developer |
Figures from each repo's GitHub metadata at analysis time.
Requires conda, a GPU is strongly recommended, and you must download pre-trained model checkpoints from Hugging Face.
DUSt3R is a Python research tool that reconstructs 3D scenes from regular photographs. You give it a set of images taken from different angles of the same place, and it figures out the 3D geometry, estimating where every visible surface sits in three-dimensional space and how the camera was positioned in each shot. This is useful in robotics, visual effects, mapping, and any application where you need a 3D model built from photos alone. The project comes from Naver Labs Europe and was presented at CVPR 2024. The key idea is that the system does not require you to know anything about the camera in advance, such as focal length or lens distortion parameters. It infers all of that from the images. After pairing the input images and running a neural network on each pair, a global alignment step reconciles all the pair-wise estimates into one consistent 3D point cloud. To get started, you clone the repository, set up a Python environment using conda, install the required packages, and download one of the pre-trained model checkpoints from the project's servers or automatically via Hugging Face. Three checkpoint variants are provided, differing in input resolution and decoder architecture. Once the model is ready, you can run an interactive web demo with a single command, select your images through a browser interface, and view the 3D reconstruction when it finishes. A Docker setup is also provided for those who prefer a container-based workflow with optional GPU support. The code can also be used directly in Python scripts. The README includes a short example showing how to load images, create image pairs, run the model, and then call the global aligner to produce the final point cloud. The project is licensed for non-commercial use only under CC BY-NC-SA 4.0.
A research tool from Naver Labs that reconstructs 3D scenes from a set of ordinary photos by automatically estimating camera positions and surface geometry, no camera calibration needed.
Mainly Python. The stack also includes Python, PyTorch, conda.
Non-commercial use only under CC BY-NC-SA 4.0, you may share and adapt with attribution but cannot use it commercially.
Setup difficulty is rated hard, with roughly 1h+ to a first successful run.
Mainly researcher.
This repo across BitVibe Labs
Verify against the repo before relying on details.