whatisgithub

What is sapiens2?

facebookresearch/sapiens2 — explained in plain English

Analysis updated 2026-05-18

675PythonAudience · researcherComplexity · 4/5Setup · moderate

In one sentence

A family of AI vision models from Meta, pretrained on a billion human images, for tasks like pose detection, segmentation, and matting.

Mindmap

mindmap
  root((Sapiens2))
    What it does
      Detects human body pose
      Segments body parts
      Separates person from background
    Tech stack
      Python
      PyTorch
      Vision transformers
    Use cases
      Avatar and animation tools
      Virtual try on
      AR body effects
    Audience
      Researchers
      ML engineers
      Computer vision developers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Estimate human body pose and joint positions from an image or video.

USE CASE 2

Separate a person cleanly from the background for photo or video editing.

USE CASE 3

Predict body surface orientation or 3D pointmaps for avatar and AR applications.

What is it built with?

PythonPyTorchSafetensors

How does it compare?

facebookresearch/sapiens2depthfirstdisclosures/nginx-riftfluxions-ai/vui
Stars675662659
LanguagePythonPythonPython
Setup difficultymoderatemoderatehard
Complexity4/54/54/5
Audienceresearcherdeveloperdeveloper

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · moderate Time to first run · 30min

Requires Python 3.12+, PyTorch 2.7+, and downloading large pretrained checkpoints from a separate model zoo.

Released under a custom Sapiens2 License whose exact terms are not detailed in the README, so usage terms should be checked before relying on the models.

So what is it?

Sapiens2 is a family of vision transformer models from Meta's research team, pretrained on one billion images of humans at resolutions up to 1024 by 768 pixels. The paper behind it was accepted at ICLR 2026, and the models are built to handle several human focused computer vision tasks at once: estimating body pose, segmenting different body parts, predicting surface normals, generating pointmaps, and separating a person from the background, a task known as matting. The project ships several model sizes, ranging from about 0.1 billion parameters up to 5 billion parameters, plus a special 1 billion parameter variant trained at a much higher 4096 by 3072 resolution. Each size trades off compute cost against accuracy, so a user can pick a smaller model for speed or a larger one for better results. Using a pretrained model is meant to be simple: you only need PyTorch and the safetensors library to load one of the standalone backbone files and run a forward pass on an image, without needing the rest of the codebase. For the fuller set of tasks, you clone the repository, install it with pip in editable mode, and download the specific checkpoints you need for pose, segmentation, normals, pointmaps, or matting from a separate model zoo document. Each task has its own documentation covering both running inference and training a model from scratch. The project acknowledges building on other Meta research work including DINOv3, as well as the OpenMMLab and Accelerate open source projects. It requires Python 3.12 or newer and PyTorch 2.7 or newer. The README does not describe the license terms in detail, only pointing to a separate Sapiens2 License file, so anyone wanting to use the models for a specific purpose should read that file directly before relying on them.

Copy-paste prompts

Prompt 1
Explain what the different Sapiens2 model sizes are and how to pick one for my project.
Prompt 2
Walk me through running a standalone Sapiens2 backbone forward pass with PyTorch.
Prompt 3
How do I download the right checkpoint for human matting or pose estimation?
Prompt 4
What tasks can Sapiens2 perform and which documentation should I read for each one?

Frequently asked questions

What is sapiens2?

A family of AI vision models from Meta, pretrained on a billion human images, for tasks like pose detection, segmentation, and matting.

What language is sapiens2 written in?

Mainly Python. The stack also includes Python, PyTorch, Safetensors.

What license does sapiens2 use?

Released under a custom Sapiens2 License whose exact terms are not detailed in the README, so usage terms should be checked before relying on the models.

How hard is sapiens2 to set up?

Setup difficulty is rated moderate, with roughly 30min to a first successful run.

Who is sapiens2 for?

Mainly researcher.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.