whatisgithub

What is minicpm-robot?

openbmb/minicpm-robot — explained in plain English

Analysis updated 2026-05-18

210PythonAudience · researcherComplexity · 5/5Setup · hard

In one sentence

An open-source family of small, on-device AI models that let robots perceive, decide, and act, including one for object manipulation and one for real-time visual target tracking.

Mindmap

mindmap
  root((MiniCPM-Robot))
    What it does
      On device robot AI
      Manipulation model
      Target tracking model
    Tech stack
      Python
      PyTorch
      Vision language model
    Use cases
      Control a robot arm
      Track moving targets
      Research embodied AI
    Audience
      Robotics researchers
      AI engineers
    Setup
      Install dependencies
      Download model weights
      Connect to robot or simulation

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Give a robot arm a single generalist model for picking up and manipulating objects across tasks.

USE CASE 2

Add real-time, camera-only target tracking to a legged robot without a cloud connection.

USE CASE 3

Research or benchmark small on-device vision-language-action models for robotics.

What is it built with?

PythonPyTorchCUDA

How does it compare?

openbmb/minicpm-robotmaxucheng0/grok-auto-registerfacebookresearch/flowdec
Stars210211212
LanguagePythonPythonPython
Last pushed2026-06-22
MaintenanceMaintained
Setup difficultyhardmoderatehard
Complexity5/53/54/5
Audienceresearcherdeveloperresearcher

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · hard Time to first run · 1day+

Requires GPU hardware, model weight downloads, and compatible robot or simulation setup, aimed at robotics researchers, not end users.

So what is it?

MiniCPM-Robot is a family of small AI models built to give robots the ability to see, decide, and act in the physical world, running directly on the robot's own hardware rather than depending on a distant server. It comes from the team behind the MiniCPM line of compact AI models, and this release focuses on giving robots a brain that fits on device. The family currently includes two models. The first, called MiniCPM-RobotManip, is a general purpose model for robot arms and manipulation tasks, meaning picking things up, moving objects, and similar physical actions. A single version of this model can handle many different tasks rather than needing a separate model retrained for each one, and the makers report it performs better on standard tests than some larger, more resource hungry AI models built by others. It is also designed to remember roughly a minute of recent visual history so a robot's actions can take recent context into account, while still responding about as quickly as a version of the model that only looks at the current moment. The second model, MiniCPM-RobotTrack, is built specifically to track a target that a robot is told to follow or watch, described in plain language, using only the robot's camera and no separate cloud service. It handles targets that are still, moving, or even trying to evade tracking, and the makers state it runs fast enough, several frames per second, to work on a real four legged robot in real time. Both models are shared as open source AI models that developers can download and build with themselves rather than access only through a paid service. Getting them running requires technical setup: installing the right software dependencies, downloading the model weights, and connecting them to compatible robot hardware or a simulation environment. This project is aimed at people already building or researching robotics, not a ready made consumer robot product.

Copy-paste prompts

Prompt 1
Explain the difference between MiniCPM-RobotManip and MiniCPM-RobotTrack and which fits my robot project.
Prompt 2
Help me set up MiniCPM-RobotManip for inference on a robot arm or simulator.
Prompt 3
Walk me through installing MiniCPM-RobotTrack and running it on camera input.
Prompt 4
Explain how streaming inference lets MiniCPM-RobotManip remember past observations efficiently.

Frequently asked questions

What is minicpm-robot?

An open-source family of small, on-device AI models that let robots perceive, decide, and act, including one for object manipulation and one for real-time visual target tracking.

What language is minicpm-robot written in?

Mainly Python. The stack also includes Python, PyTorch, CUDA.

How hard is minicpm-robot to set up?

Setup difficulty is rated hard, with roughly 1day+ to a first successful run.

Who is minicpm-robot for?

Mainly researcher.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.