facebookresearch/ai4animationpy — explained in plain English
Analysis updated 2026-05-18
Train a neural network on motion capture recordings to generate new realistic character movement.
Research character animation techniques without needing a Unity game engine setup.
Import and convert motion capture files between GLB, FBX, BVH, and the framework's own format.
Prototype inverse kinematics or locomotion controllers for research demos.
| facebookresearch/ai4animationpy | nvidia-nemo/datadesigner | tencent-hunyuan/hy-world-2.0 | |
|---|---|---|---|
| Stars | 1,846 | 1,859 | 1,911 |
| Language | Python | Python | Python |
| Setup difficulty | moderate | moderate | hard |
| Complexity | 4/5 | 3/5 | 5/5 |
| Audience | researcher | developer | researcher |
Figures from each repo's GitHub metadata at analysis time.
Requires Python 3.12, PyTorch, and motion capture data files in a supported format like BVH or FBX.
AI4AnimationPy is a Python framework from Meta's FAIR research group for creating character animation using neural networks. It brings the ideas from an earlier project called AI4Animation, which was built on the Unity game engine, into plain Python, so researchers no longer need Unity to process motion data, train models, or run inference. The framework lets you train neural networks directly on motion capture recordings of people or animals moving, and then use those trained networks to generate new, believable movement for a character. Everything, from training to visualizing the result, runs inside the same Python environment using NumPy and PyTorch, so there is no need to switch between separate tools or export models through extra conversion steps just to see how they behave. It borrows structural ideas from game engines, using an entity component system and an update loop, so the codebase should feel somewhat familiar to anyone who has worked with game development before, even though it is aimed at animation researchers rather than game developers. It can run with its own built in real time renderer for visualization, in a headless mode for training on a server without any graphics, or in a manual mode where the user controls exactly when updates happen. Supported features include inverse kinematics for realistic limb movement, a math library for working with skeletons and joint rotations, and importers for common motion file formats such as GLB, FBX, and BVH, which can be converted into the framework's own internal motion format. A command line tool is included for converting entire folders of motion files at once. The project includes demo videos and a web based demo, along with full documentation covering installation and quick start steps. It is released under a Creative Commons Attribution NonCommercial license, meaning it can be used and shared for non commercial purposes such as research and learning, but not for commercial products without separate permission.
AI4AnimationPy is a Python, NumPy and PyTorch based framework for training neural networks on motion capture data to generate character animation, without needing Unity.
Mainly Python. The stack also includes Python, PyTorch, NumPy.
You can use and share this software for non commercial purposes like research and learning, but you cannot use it in a commercial product without separate permission.
Setup difficulty is rated moderate, with roughly 30min to a first successful run.
Mainly researcher.
This repo across BitVibe Labs
Verify against the repo before relying on details.