whatisgithub

What is vggt-omega?

facebookresearch/vggt-omega — explained in plain English

Analysis updated 2026-05-18

568PythonAudience · researcherComplexity · 4/5Setup · hard

In one sentence

An AI model that turns a set of photos or a video into 3D camera positions and depth, from Meta AI and Oxford.

Mindmap

mindmap
  root((VGGT-Omega))
    What it does
      3D scene reconstruction
      Camera pose estimation
      Depth prediction
      Point cloud output
    Tech stack
      Python
      PyTorch
      Gradio
      CUDA GPU
    Use cases
      Multi image 3D reconstruction
      Video depth estimation
      Interactive scene demo
      Text aligned embeddings
    Audience
      Computer vision researchers
      Academic reproducers
    Requirements
      Gated checkpoint access
      High memory GPU
      A100 class hardware
    Origin
      Meta AI
      Oxford VGG group

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Reconstruct a 3D scene and camera positions from a set of ordinary photos.

USE CASE 2

Estimate depth maps for every image in a photo or video set.

USE CASE 3

Run the interactive demo to visualize a point cloud from uploaded images or video.

USE CASE 4

Use the text aligned checkpoint to connect image predictions with text descriptions.

What is it built with?

PythonPyTorchGradioCUDA

How does it compare?

facebookresearch/vggt-omegakhrisat/text-humanizerbytevisionlab/dreamlite
Stars568571562
LanguagePythonPythonPython
Setup difficultyhardmoderate
Complexity4/53/5
Audienceresearchergeneralresearcher

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · hard Time to first run · 1h+

Requires a high end NVIDIA GPU and gated Hugging Face checkpoint access approval before you can run inference.

The README does not state license terms directly and points to a separate LICENSE file for details.

So what is it?

VGGT-Omega is a research project from Meta AI and the University of Oxford's Visual Geometry Group, accepted as an Oral paper at CVPR 2026. It is an AI model that looks at a set of photos, or a video, of a scene and figures out where each camera was positioned when the picture was taken, along with the depth of every point in the images. In plain terms, it turns a handful of ordinary photos into an understanding of 3D space, including camera angles, distances, and a point cloud you can view as a 3D scene. The project ships pretrained model checkpoints, though you need to request access to them on Hugging Face before downloading, and that request goes through an automated approval process rather than a person. Two versions are offered: one that works at 512 pixel resolution, and a smaller 256 pixel version that also aligns its output with text descriptions. To use it, you clone the repository, install the Python dependencies, and load a checkpoint. A short code example shows how to feed in image file paths and get back predictions for depth, camera position, and other internal representations. There is also an interactive Gradio demo you can launch locally, which lets you upload images or a video and see the resulting 3D point cloud and camera positions rendered as a downloadable 3D scene file. The README includes a detailed table of GPU memory requirements, since processing more input frames uses substantially more memory. Running the largest configurations needs a high end GPU such as an NVIDIA A100 with dozens of gigabytes of memory. The README does not spell out the license terms directly, pointing instead to a separate LICENSE file, and it notes the release is meant to support the open source research community rather than serve as a production ready tool. The authors provide an academic citation for anyone referencing this work in a paper.

Copy-paste prompts

Prompt 1
Help me set up VGGT-Omega and run its interactive Gradio demo on my own photos.
Prompt 2
Explain how to request access to the VGGT-Omega checkpoints on Hugging Face.
Prompt 3
Write a Python script using VGGT-Omega to extract depth and camera pose from a folder of images.
Prompt 4
How much GPU memory do I need to run VGGT-Omega on 100 input frames?
Prompt 5
Compare the VGGT-Omega-1B-512 and text-aligned 256 checkpoints and when to use each.

Frequently asked questions

What is vggt-omega?

An AI model that turns a set of photos or a video into 3D camera positions and depth, from Meta AI and Oxford.

What language is vggt-omega written in?

Mainly Python. The stack also includes Python, PyTorch, Gradio.

What license does vggt-omega use?

The README does not state license terms directly and points to a separate LICENSE file for details.

How hard is vggt-omega to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is vggt-omega for?

Mainly researcher.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.