Estimate human body pose and joint positions from an image or video.
Separate a person cleanly from the background for photo or video editing.
Predict body surface orientation or 3D pointmaps for avatar and AR applications.
| facebookresearch/sapiens2 | depthfirstdisclosures/nginx-rift | fluxions-ai/vui | |
|---|---|---|---|
| Stars | 675 | 662 | 659 |
| Language | Python | Python | Python |
| Setup difficulty | moderate | moderate | hard |
| Complexity | 4/5 | 4/5 | 4/5 |
| Audience | researcher | developer | developer |
Figures from each repo's GitHub metadata at analysis time.
Requires Python 3.12+, PyTorch 2.7+, and downloading large pretrained checkpoints from a separate model zoo.
Sapiens2 is a family of vision transformer models from Meta's research team, pretrained on one billion images of humans at resolutions up to 1024 by 768 pixels. The paper behind it was accepted at ICLR 2026, and the models are built to handle several human focused computer vision tasks at once: estimating body pose, segmenting different body parts, predicting surface normals, generating pointmaps, and separating a person from the background, a task known as matting. The project ships several model sizes, ranging from about 0.1 billion parameters up to 5 billion parameters, plus a special 1 billion parameter variant trained at a much higher 4096 by 3072 resolution. Each size trades off compute cost against accuracy, so a user can pick a smaller model for speed or a larger one for better results. Using a pretrained model is meant to be simple: you only need PyTorch and the safetensors library to load one of the standalone backbone files and run a forward pass on an image, without needing the rest of the codebase. For the fuller set of tasks, you clone the repository, install it with pip in editable mode, and download the specific checkpoints you need for pose, segmentation, normals, pointmaps, or matting from a separate model zoo document. Each task has its own documentation covering both running inference and training a model from scratch. The project acknowledges building on other Meta research work including DINOv3, as well as the OpenMMLab and Accelerate open source projects. It requires Python 3.12 or newer and PyTorch 2.7 or newer. The README does not describe the license terms in detail, only pointing to a separate Sapiens2 License file, so anyone wanting to use the models for a specific purpose should read that file directly before relying on them.
A family of AI vision models from Meta, pretrained on a billion human images, for tasks like pose detection, segmentation, and matting.
Mainly Python. The stack also includes Python, PyTorch, Safetensors.
Released under a custom Sapiens2 License whose exact terms are not detailed in the README, so usage terms should be checked before relying on the models.
Setup difficulty is rated moderate, with roughly 30min to a first successful run.
Mainly researcher.
This repo across BitVibe Labs
Verify against the repo before relying on details.