whatisgithub

What is forgewm?

asdfo123/forgewm — explained in plain English

Analysis updated 2026-05-18

34PythonAudience · researcherComplexity · 5/5LicenseSetup · hard

In one sentence

An open-source framework for training an AI model that generates a playable, interactive Minecraft-like game world in real time.

Mindmap

mindmap
  root((ForgeWM))
    What it does
      Generates game video from AI
      Responds to keyboard and mouse
      Full training pipeline
    Tech stack
      Python
      PyTorch
      GPU training
    Use cases
      Train a world model
      Run real time inference
      Reproduce Matrix-Game 2 results
    Audience
      AI researchers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Train an interactive world model that generates a playable Minecraft-like scene from a starting image and player actions.

USE CASE 2

Run inference on a single GPU to generate real-time game video from a trained checkpoint.

USE CASE 3

Reproduce and compare results against the Matrix-Game 2 model using the same training data and pipeline.

What is it built with?

PythonPyTorch

How does it compare?

asdfo123/forgewmabhisumatk/epstein_files_ragchrishuber1/kustoforge
Stars343434
LanguagePythonPythonPython
Setup difficultyhardmoderateeasy
Complexity5/53/52/5
Audienceresearcherresearcherops devops

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · hard Time to first run · 1day+

Full training requires eight high-end GPUs and about 89 GB of pre-encoded data, inference needs one GPU.

Use freely for any purpose, including commercial use, as long as you keep the copyright notice.

So what is it?

ForgeWM is an open-source Python framework for training an AI model that can generate a playable, interactive Minecraft-like game world in real time. The model watches a starting image of a game scene, accepts keyboard and mouse inputs, and generates video frames that show what the world should look like as you move through it. The goal is to produce convincing, continuous game video at a speed fast enough to feel interactive, responding correctly to your actions. This kind of AI is called a world model. Rather than rendering a game world with traditional 3D graphics, it generates the visuals directly using a trained neural network. ForgeWM brings together three existing research components: a video generation backbone from a project called Matrix-Game 2, open Minecraft gameplay recordings from a dataset called GameFactory, and a training method called Causal Forcing that compresses the model down to only four generation steps so it runs fast enough for real-time use. The README explains why this project exists: Matrix-Game 2 released its trained model but not the training code or data, and other open alternatives focused on camera movement in general videos rather than discrete keyboard and mouse controls in games. ForgeWM fills that gap by providing the complete training pipeline, the data, and the model checkpoints, all publicly on Hugging Face. Training runs across four stages on eight high-end GPUs and takes a total of roughly 22,000 training steps across the stages. Pre-encoded training data is available for download at about 89 GB. Running inference on a trained model requires only a single GPU and a starting image, and you specify which action to simulate. The README includes a comparison table showing ForgeWM produces quality close to Matrix-Game 2 while fixing a specific visual artifact present in the original model. The project is licensed under Apache 2.0.

Copy-paste prompts

Prompt 1
Explain how ForgeWM turns keyboard and mouse inputs into generated video frames.
Prompt 2
Walk me through downloading the pre-encoded training data and running the full training pipeline.
Prompt 3
What is Causal Forcing and how does it compress the model to four generation steps?
Prompt 4
How does ForgeWM fix the underwater texture artifact seen in Matrix-Game 2?

Frequently asked questions

What is forgewm?

An open-source framework for training an AI model that generates a playable, interactive Minecraft-like game world in real time.

What language is forgewm written in?

Mainly Python. The stack also includes Python, PyTorch.

What license does forgewm use?

Use freely for any purpose, including commercial use, as long as you keep the copyright notice.

How hard is forgewm to set up?

Setup difficulty is rated hard, with roughly 1day+ to a first successful run.

Who is forgewm for?

Mainly researcher.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.