facebookresearch/vggt-omega — explained in plain English
Analysis updated 2026-05-18
Reconstruct a 3D scene and camera positions from a set of ordinary photos.
Estimate depth maps for every image in a photo or video set.
Run the interactive demo to visualize a point cloud from uploaded images or video.
Use the text aligned checkpoint to connect image predictions with text descriptions.
| facebookresearch/vggt-omega | khrisat/text-humanizer | bytevisionlab/dreamlite | |
|---|---|---|---|
| Stars | 568 | 571 | 562 |
| Language | Python | Python | Python |
| Setup difficulty | hard | — | moderate |
| Complexity | 4/5 | — | 3/5 |
| Audience | researcher | general | researcher |
Figures from each repo's GitHub metadata at analysis time.
Requires a high end NVIDIA GPU and gated Hugging Face checkpoint access approval before you can run inference.
VGGT-Omega is a research project from Meta AI and the University of Oxford's Visual Geometry Group, accepted as an Oral paper at CVPR 2026. It is an AI model that looks at a set of photos, or a video, of a scene and figures out where each camera was positioned when the picture was taken, along with the depth of every point in the images. In plain terms, it turns a handful of ordinary photos into an understanding of 3D space, including camera angles, distances, and a point cloud you can view as a 3D scene. The project ships pretrained model checkpoints, though you need to request access to them on Hugging Face before downloading, and that request goes through an automated approval process rather than a person. Two versions are offered: one that works at 512 pixel resolution, and a smaller 256 pixel version that also aligns its output with text descriptions. To use it, you clone the repository, install the Python dependencies, and load a checkpoint. A short code example shows how to feed in image file paths and get back predictions for depth, camera position, and other internal representations. There is also an interactive Gradio demo you can launch locally, which lets you upload images or a video and see the resulting 3D point cloud and camera positions rendered as a downloadable 3D scene file. The README includes a detailed table of GPU memory requirements, since processing more input frames uses substantially more memory. Running the largest configurations needs a high end GPU such as an NVIDIA A100 with dozens of gigabytes of memory. The README does not spell out the license terms directly, pointing instead to a separate LICENSE file, and it notes the release is meant to support the open source research community rather than serve as a production ready tool. The authors provide an academic citation for anyone referencing this work in a paper.
An AI model that turns a set of photos or a video into 3D camera positions and depth, from Meta AI and Oxford.
Mainly Python. The stack also includes Python, PyTorch, Gradio.
The README does not state license terms directly and points to a separate LICENSE file for details.
Setup difficulty is rated hard, with roughly 1h+ to a first successful run.
Mainly researcher.
This repo across BitVibe Labs
Verify against the repo before relying on details.