manassadashiv/carl-simulation — explained in plain English
Analysis updated 2026-05-18
Study how a simulated brain and body can work together to complete a reach, grasp, and carry task.
Experiment with biologically inspired learning rules like reward modulated spike timing plasticity.
Explore hyperdimensional memory representations for storing spatial and motor experience.
Research embodied cognitive architectures as an alternative to purely text based AI models.
| manassadashiv/carl-simulation | 0xallam/my-recipe | 0xhassaan/nn-from-scratch | |
|---|---|---|---|
| Stars | 0 | — | 0 |
| Language | Python | Python | Python |
| Last pushed | — | 2022-11-22 | — |
| Maintenance | — | Dormant | — |
| Setup difficulty | hard | moderate | moderate |
| Complexity | 5/5 | 2/5 | 4/5 |
| Audience | researcher | general | developer |
Figures from each repo's GitHub metadata at analysis time.
Requires MuJoCo, PyTorch, and understanding of research level robotics concepts to make sense of the output.
Carl Omega is a research project that simulates a virtual primate like robot with 28 moving joints inside MuJoCo, a physics engine used for robotics research. Instead of building a language model that only reads and writes text, this project tries to build something closer to a body and a brain working together. Carl has to deal with gravity, friction, and collisions, balance internal needs like hunger and fatigue, build a map of its surroundings, and control its arms well enough to reach for an object, grab it, and carry it somewhere else. The project describes its design as an eight layer stack, starting from raw physics at the bottom and building up toward more abstract thinking at the top. The lower layers handle the physical body, short term and long term memory, and a simulated set of brain chemicals such as dopamine, norepinephrine, and serotonin that influence how quickly Carl learns and how alert it becomes. Learning between simulated neurons happens through a technique called reward modulated spike timing dependent plasticity, where connections get stronger or weaker depending on the order in which neurons fire relative to a reward. Carl also has a memory system that stores what it experiences as very large vectors, split into separate registers for spatial information, emotional signals, and motor actions. A separate navigation system mimics grid cells and place cells, a type of brain cell involved in how animals map physical space, so Carl can track its own position and figure out safe paths. Arm movements are driven by a recurrent neural network that was first taught through imitation and then further trained using a reinforcement learning method called PPO. The repository is organized into folders for the brain related code, the core simulation environment, documentation, a dashboard for visualizing performance, and tests. To try it, you set up a Python virtual environment, install the listed dependencies, and run a single script that plays out a full search, approach, reach, grasp, lift, carry, and place sequence using the built in cognitive system. The full README is longer than what was shown.
A research simulation of a virtual robot with a body and a biologically inspired brain that learns to see, move, remember, and pick up objects in a physics engine.
Mainly Python. The stack also includes Python, MuJoCo, PyTorch.
Setup difficulty is rated hard, with roughly 1h+ to a first successful run.
Mainly researcher.
This repo across BitVibe Labs
Verify against the repo before relying on details.