whatisgithub

What is worldfoundry?

openenvision/worldfoundry — explained in plain English

Analysis updated 2026-05-18

257PythonAudience · researcherComplexity · 5/5LicenseSetup · hard

In one sentence

An open source toolkit that bundles environment setup, inference, and benchmark scoring for AI world models that generate video, 3D, and simulated environments.

Mindmap

mindmap
  root((WorldFoundry))
    What it does
      Runs world model inference
      Stages checkpoints and datasets
      Scores benchmarks
    Tech stack
      Python
      PyTorch
      CUDA
      Multi GPU support
    Use cases
      Video generation
      3D and 4D scenes
      Robotics action policies
    Audience
      Researchers
      ML engineers
      Benchmark teams

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Run inference on video generation models like HunyuanVideo or Wan through one shared CLI or Studio app.

USE CASE 2

Benchmark a world model against standardized evaluation suites and get a validation scorecard.

USE CASE 3

Prototype robotics action policy models such as OpenVLA or GROOT using a common runner.

USE CASE 4

Stage and manage large model checkpoints and datasets outside of the git repository.

What is it built with?

PythonPyTorchCUDAFlashAttentionConda

How does it compare?

openenvision/worldfoundrypixel-talk/pearfeder-cr/invisible_playwright
Stars257257258
LanguagePythonPythonPython
Setup difficultyhardhardmoderate
Complexity5/55/53/5
Audienceresearcherresearcherdeveloper

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · hard Time to first run · 1day+

Requires GPUs, staged model checkpoints and datasets, and a Conda environment, built for multi-GPU setups like A100 or H100.

Apache 2.0: use freely for any purpose, including commercial use, as long as you keep the copyright and license notices.

So what is it?

WorldFoundry is an open source infrastructure project for working with world models, which are AI systems trained to generate and understand video, 3D and 4D scenes, and simulated environments. It brings together the pieces needed to run these models in one place: environment setup, staging for large model checkpoints and datasets, an inference layer you can drive through a terminal interface, a command line tool, scripts, or a graphical Studio app, and a system for scoring model outputs against benchmarks. The day one workflow the project describes has three steps. First you set up your environment and download the model files and datasets you need, kept separate from the code itself. Second you run inference, meaning you generate outputs such as video clips and inspect them using whichever interface suits you. Third, once your generated files match the expected benchmark layout, you can run evaluation to score how well a model performed, with the project cautioning that any performance claims should be backed by a matching run record and scorecard. Under the hood, WorldFoundry integrates a large number of existing video generation and world model systems, including projects named Wan, HunyuanVideo, LTX2, and Cosmos, along with tools for perception and 3D understanding. It supports several GPU acceleration backends and is built to run efficiently across multiple graphics cards. It also folds in action policy models used in robotics research, and ships with a benchmark catalog covering video generation, 3D and 4D representation, embodied action, and interactive worlds. The project is written in Python, requires versions 3.10 through 3.13, and is released under the Apache 2.0 license, which permits commercial use. It is still under active development, so its exact feature set and documentation are expected to keep changing. It maintains community channels on Discord and WeChat for support and updates. The full README is longer than what was shown.

Copy-paste prompts

Prompt 1
Walk me through the day one workflow for WorldFoundry: environment setup, inference, and evaluation.
Prompt 2
Help me set up a Conda environment and stage model checkpoints for WorldFoundry.
Prompt 3
Explain what the WorldFoundry CLI and Studio interfaces let me do differently.
Prompt 4
Show me how to run a benchmark evaluation in WorldFoundry once my generated video artifacts are ready.

Frequently asked questions

What is worldfoundry?

An open source toolkit that bundles environment setup, inference, and benchmark scoring for AI world models that generate video, 3D, and simulated environments.

What language is worldfoundry written in?

Mainly Python. The stack also includes Python, PyTorch, CUDA.

What license does worldfoundry use?

Apache 2.0: use freely for any purpose, including commercial use, as long as you keep the copyright and license notices.

How hard is worldfoundry to set up?

Setup difficulty is rated hard, with roughly 1day+ to a first successful run.

Who is worldfoundry for?

Mainly researcher.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.