Explore how a multi-agent AI system can plan and repair robot task sequences from an image and a text goal.
Test whether fast language model inference makes real-time plan repair for robots practical.
Benchmark a vision-based robot planner against established robotics simulators like robosuite.
Study a working example of combining perception, symbolic planning, and physics verification.
| yifank/tampire | amureki/sweatbucks | anikchand461/ragbucket | |
|---|---|---|---|
| Stars | 0 | — | 0 |
| Language | HTML | HTML | HTML |
| Last pushed | — | 2025-08-15 | — |
| Maintenance | — | Quiet | — |
| Setup difficulty | — | easy | easy |
| Complexity | 5/5 | 1/5 | 2/5 |
| Audience | researcher | general | developer |
Figures from each repo's GitHub metadata at analysis time.
TAMPire is a hackathon project that teaches robots how to plan and carry out tasks on a tabletop, like moving a block into a bowl, starting from just a photo and a plain-language instruction such as put the red block in the bowl. It was built for a hackathon around the Gemma 4 language model running on Cerebras hardware, and its core idea is that this hardware is fast enough to make a normally slow technique practical in real time. The system works in stages. First it looks at the image and figures out what objects are in the scene and how they relate to each other. Then it turns that understanding into a formal plan made of simple actions, like picking up an object and placing it somewhere. Before the robot acts, a lightweight checker tests whether each step in the plan is physically possible, such as whether an object is blocked by something on top of it. If a step fails that check, a group of AI agents debate the failure and propose a fix, and the plan is repaired and rechecked. The project calls this group a debate council, and it is designed so a human watching a demo can see the plan fail and then watch the agents fix it live. The README describes several levels of testing, ranging from a simple simulated evaluation with no physics, up to a version using a real physics engine called MuJoCo, and further tiers that connect to established robotics benchmarks including robosuite with a real robotic arm design and an NVIDIA benchmark called RoboLab, though the most advanced levels require specific hardware such as an NVIDIA GPU running Linux that is not available on the developer's machine. The project also includes its own multi-agent vision system that estimates the 3D position of objects by combining views from several camera angles, which the README reports as more accurate than judging position from a single image. Overall this is an experimental, code-heavy research prototype rather than a polished tool, aimed at people working in robotics or AI research who want to explore whether fast language model reasoning can make automated task planning and error correction practical for physical robots.
A hackathon robotics prototype where AI agents plan tabletop robot tasks from a photo and instruction, then debate and fix failed plans in real time.
Mainly HTML. The stack also includes Python, Gemma, Cerebras.
Mainly researcher.
This repo across BitVibe Labs
Verify against the repo before relying on details.