whatisgithub

What is gamma-world?

nv-tlabs/gamma-world — explained in plain English

Analysis updated 2026-05-18

440Audience · researcherComplexity · 5/5Setup · hard

In one sentence

A research project generating real-time video worlds where multiple independent agents act at once and see a consistent shared scene.

Mindmap

mindmap
  root((gamma-world))
    What it does
      Multi-agent video generation
      Real-time 24fps output
      Consistent shared world
      Order-independent agents
    Tech stack
      Simplex position encoding
      Hub tokens
      Video diffusion research
    Use cases
      Game environment generation
      Robot coordination testing
      Multi-agent simulation research
    Audience
      Researchers
      ML engineers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Study techniques for generating consistent video worlds with multiple independent agents.

USE CASE 2

Reference the simplex-based encoding method for order-independent agent identity.

USE CASE 3

Explore hub tokens as a scalable alternative to pairwise agent interaction.

USE CASE 4

Follow the project for future code and model weight releases.

What is it built with?

Python

How does it compare?

nv-tlabs/gamma-worldstruckstech/zelda-tp-native-portalkih/nightlight-game-launcher
Stars440441443
LanguageTypeScriptC#
Setup difficultyhardeasyeasy
Complexity5/51/51/5
Audienceresearchergeneralgeneral

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · hard Time to first run · 1day+

Code and trained model weights have not been released yet, only the paper and project page are available.

So what is it?

Gamma-World is a research project from NVIDIA and academic collaborators that generates interactive video environments where multiple independent agents, such as game players or robots, can act simultaneously and see a consistent shared world. The paper and project page were released in May 2026, but the code has not been published yet. The core problem it addresses is that most AI video generation systems are designed for a single character or viewpoint. When you have two or more agents each making their own decisions, the AI needs to keep the world consistent for all of them at once. Each agent must be independently controllable, and swapping the order of agents in the input should not change how the model treats them. Gamma-World is designed to handle all of this while staying fast enough to generate video in real time. To solve the agent identity problem without using a fixed ordering, the model places each agent at a vertex of a geometric shape called a regular simplex in a mathematical space used for position encoding. Every pair of agents is equally spaced, so no agent is treated as special or first, but each still has a distinct identity the model can track. For efficiency, the model avoids calculating direct interactions between every possible pair of agents, which would become very expensive as the number of agents grows. Instead, a small set of learnable intermediate tokens called hub tokens collect information from all agents and redistribute it. This keeps the cost growing linearly with the number of agents rather than as a square. The result runs at 24 frames per second. A model trained on two-player scenarios can generalize to four players without additional training, and the system has been tested on both video game environments and real-world robot coordination tasks. As of the repository creation date, the code and trained model weights have not been released. The repository currently contains the paper, example images, and a project overview. The authors have indicated that code and checkpoints are planned for a future release.

Copy-paste prompts

Prompt 1
Explain how Gamma-World keeps agent identity consistent without a fixed ordering.
Prompt 2
Summarize how hub tokens make multi-agent video generation more efficient.
Prompt 3
What is the difference between Gamma-World and single-agent video generation models?
Prompt 4
Has Gamma-World released code or trained weights yet, and what is available now?

Frequently asked questions

What is gamma-world?

A research project generating real-time video worlds where multiple independent agents act at once and see a consistent shared scene.

How hard is gamma-world to set up?

Setup difficulty is rated hard, with roughly 1day+ to a first successful run.

Who is gamma-world for?

Mainly researcher.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.