Run pretrained depth models on your own photos, videos, or image folders to generate cleaner 3D reconstructions.
Fine tune the mixture density depth head on top of an existing DA3 or VGGT backbone for your own dataset.
Reproduce the paper's benchmark numbers on standard depth and video depth datasets.
| biansy000/mda | amaravijayalakshmi216-collab/crop-recommendation-system | hermes-labs-ai/zer0dex | |
|---|---|---|---|
| Stars | 52 | 52 | 52 |
| Language | Python | Python | Python |
| Setup difficulty | hard | moderate | hard |
| Complexity | 5/5 | 2/5 | 4/5 |
| Audience | researcher | researcher | developer |
Figures from each repo's GitHub metadata at analysis time.
Requires a CUDA capable GPU, a matching PyTorch build, and downloading multi-gigabyte checkpoints from Hugging Face before the demo runs.
MDA is the official code release for a research paper about estimating depth from images and video, meaning figuring out how far away each part of a scene is from the camera. The paper is called Modeling Depth Ambiguity, and it comes from researchers named Siyuan Bian, Congrong Xu, and Jun Gao. Most depth estimation models predict a single depth value for every pixel in an image. The problem the authors identify is that at the edges of objects, a pixel often covers both the foreground object and the background behind it, so a single depth number cannot describe it well. Averaging the two distances creates what the README calls a flying point, a false surface that appears to float between the real foreground and background and corrupts the resulting shape. Instead of one value per pixel, MDA predicts a small set of possible depth values along with probabilities for each, then chooses the most likely one rather than blending them together. According to the README this largely removes flying points, holds up better when the input image is blurry, adds very little extra computing cost, and can be attached to two existing depth backbones called DA3 and VGGT. The repository includes code to run the trained models on your own images, videos, or folders of photos, with an interactive point cloud viewer that opens automatically after each run. Two pretrained checkpoints are available for download from Hugging Face, one built on the DA3 backbone and one on VGGT. It also includes the training code, built on the Hydra and Lightning frameworks, along with evaluation scripts that reproduce the benchmark results reported in the paper across several depth and video datasets. This is a research codebase aimed at people working on computer vision and 3D reconstruction, not a general consumer tool. Getting it running requires a CUDA capable GPU, a Python environment set up with PyTorch, and for the video demo, ffmpeg installed on the system. The README documents installation, checkpoint downloads, and training and evaluation commands in detail.
Research code that predicts a few possible depth values per pixel instead of one, removing false floating surfaces at object edges in 3D depth maps.
Mainly Python. The stack also includes Python, PyTorch, CUDA.
The README does not state a license.
Setup difficulty is rated hard, with roughly 1h+ to a first successful run.
Mainly researcher.
This repo across BitVibe Labs
Verify against the repo before relying on details.