Generate an animated video of a character performing a described pose or motion.
Drive character animation using a 3D pose reference instead of a flat 2D skeleton.
Animate anime, hand drawn, or non-human characters using the model's generalization.
Integrate the model into a ComfyUI visual workflow for video generation.
| zai-org/scail | future-agi/future-agi | django/django-localflavor | |
|---|---|---|---|
| Stars | 955 | 979 | 919 |
| Language | Python | Python | Python |
| Last pushed | — | — | 2026-06-23 |
| Maintenance | — | — | Active |
| Setup difficulty | hard | moderate | easy |
| Complexity | 5/5 | 4/5 | 2/5 |
| Audience | researcher | developer | developer |
Figures from each repo's GitHub metadata at analysis time.
Needs a capable GPU and multi-gigabyte model checkpoints, training code is not yet released.
SCAIL is a research model for animating characters in video. Given a reference image of a character and a description of a pose or motion, it generates a video of that character performing the motion, while keeping the character's identity and appearance consistent throughout. The project is the official code release for a paper accepted at CVPR 2026, a major computer vision research conference. The core technical idea behind SCAIL is what the authors call three dimensional consistent pose representation. Earlier character animation methods often struggled with generalizing to unfamiliar characters and produced awkward or physically implausible motion during complex actions like turning or flipping. Instead of just telling the model what pose to follow, SCAIL shows the model fuller context about depth and motion, which the authors found helps even smaller models learn to generate more believable movement. The technique is described as in context learning, meaning the model learns from examples shown directly in its input rather than through additional fine tuning. SCAIL is built as a fourteen billion parameter diffusion transformer, a type of AI model architecture, and the preview checkpoint is available for download from Hugging Face and ModelScope. Community members have reported it generalizing surprisingly well beyond its training data, including to anime style characters, hand drawn artwork, and even four legged animals, despite very little of that kind of data being in the training set. There is also a ComfyUI integration for people who prefer a visual workflow over writing code. Because this is a research preview rather than a finished product, running it requires downloading multi gigabyte model checkpoints and a GPU capable of handling a fourteen billion parameter model. The project provides inference code only, training code for reproducing the full pipeline was still being prepared for release at the time of writing. The full README is longer than what was shown.
A research AI model that animates a character from a single reference image into a video following a given pose or motion sequence.
Mainly Python. The stack also includes Python, PyTorch, Diffusion Transformer.
Not stated in the README text provided.
Setup difficulty is rated hard, with roughly 1day+ to a first successful run.
Mainly researcher.
This repo across BitVibe Labs
Verify against the repo before relying on details.