whatisgithub

What is imac?

imac-wm/imac — explained in plain English

Analysis updated 2026-05-18

13PythonAudience · researcherComplexity · 5/5Setup · hard

In one sentence

A research project that predicts what happens when a robot arm moves an object by generating a short video of the outcome instead of running physics simulations.

Mindmap

mindmap
  root((iMaC))
    What it does
      Predicts robot action outcomes
      Generates motion and contact images
      Produces predicted video clips
    Tech stack
      Python
      PyTorch
      CUDA
      Diffusion models
    Use cases
      Evaluate a robot policy without hardware
      Train on CVPR World Model dataset
      Run offline or online evaluation
    Audience
      Robotics researchers
      Embodied AI researchers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Train a world model that predicts robot arm actions using the CVPR 2026 World Model dataset.

USE CASE 2

Evaluate whether a robot policy works correctly by generating predicted video outcomes instead of running the real robot.

USE CASE 3

Run offline tests against pre-recorded episodes or online tests against a live simulator.

What is it built with?

PythonPyTorchCUDADiffusers

How does it compare?

imac-wm/imac1lystore/awaekactashui/sjtu-ppt-template-skill
Stars131313
LanguagePythonPythonPython
Setup difficultyhardmoderatemoderate
Complexity5/52/52/5
Audienceresearchervibe coderresearcher

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · hard Time to first run · 1day+

Requires a compatible GPU, Python 3.11, CUDA-capable PyTorch, and separately downloaded datasets and model weights.

So what is it?

iMaC is a research project from a 2026 academic paper that teaches a computer how to predict what will happen when a robot arm tries to pick up or move an object. The core idea is to translate a robot action command into two kinds of images: one showing how things should move, and one showing where contact with surfaces will occur. Those images then guide a video-generation model that produces a short clip of the predicted outcome. Think of it as a simulator that does not need to run physics calculations in real time. Instead of computing every force and collision, the system generates a video of what the scene should look like after the robot acts. That video can then be used to judge whether a policy (the set of rules telling the robot what to do) is working correctly, without having to run the real robot for every test. The code covers the full research pipeline: preparing training data from a dataset released for the CVPR 2026 World Model competition, training the model in two stages, and running evaluations either offline against pre-recorded episodes or online against a live simulator. Three separate workflows are included: a first training stage using replay images only, a second stage that adds 3D scene information, and a WorldArena track that targets a different benchmark. Setting up the project requires a machine with a compatible GPU, Python 3.11, and a collection of supporting libraries including PyTorch, a diffusion-model toolkit, depth-estimation tools, and robotics utilities. The dataset and pretrained model weights are downloaded separately via provided scripts. Environment variables point the code to your local copies of those files, so no paths are hardcoded. This repository is aimed at robotics researchers working on world models and embodied AI. There is no graphical interface and no built-in visualization beyond the video outputs the inference scripts produce. If you are not already working in this research area, the setup and concepts will require substantial background reading.

Copy-paste prompts

Prompt 1
Help me set up the Python and CUDA environment needed to run iMaC's training pipeline.
Prompt 2
Explain the difference between the RND-mix stage one and stage two training workflows in iMaC.
Prompt 3
Walk me through downloading the pretrained models and dataset for iMaC.
Prompt 4
What environment variables do I need to configure before running iMaC's inference scripts?

Frequently asked questions

What is imac?

A research project that predicts what happens when a robot arm moves an object by generating a short video of the outcome instead of running physics simulations.

What language is imac written in?

Mainly Python. The stack also includes Python, PyTorch, CUDA.

How hard is imac to set up?

Setup difficulty is rated hard, with roughly 1day+ to a first successful run.

Who is imac for?

Mainly researcher.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.