whatisgithub

What is chaos-agent?

jasnonaz/chaos-agent — explained in plain English

Analysis updated 2026-05-18

8PythonAudience · developerComplexity · 2/5Setup · easy

In one sentence

A Claude Code skill that randomly plants one subtle bug in about 1 of every 20 AI answers to train people to keep reviewing AI output carefully.

Mindmap

mindmap
  root((repo))
    What it does
      Plants a subtle bug
      Trains attention
      Deterministic hashing
    Tech stack
      Python
      Claude Code skill
      SHA-256 hashing
    Use cases
      Review vigilance training
      Audit past requests
      Spot subtle bugs
    Audience
      Developers
      Claude Code teams

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Train yourself or your team to keep carefully reviewing AI generated code instead of rubber stamping it.

USE CASE 2

Audit whether a past AI request was a deliberate sabotage round using the included oracle script.

USE CASE 3

Practice spotting subtle, realistic bugs like off by one errors or inverted joins in polished looking answers.

What is it built with?

PythonClaude CodeSHA-256

How does it compare?

jasnonaz/chaos-agent100/awesome-machine-learningadam-s/car-diagnosis
Stars888
LanguagePythonPythonPython
Last pushed2024-08-07
MaintenanceStale
Setup difficultyeasyeasymoderate
Complexity2/51/53/5
Audiencedeveloperdeveloperresearcher

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · easy Time to first run · 5min

Only meaningful when opted into by the person or team using it, not installed on someone else's setup.

No license information is included in the material provided.

So what is it?

Chaos Agent is a Claude Code skill that trains people to keep reviewing AI generated answers carefully instead of trusting them automatically. The idea borrows from chaos engineering, where systems are deliberately broken to test resilience, except here what is being tested is human attention. Most of the time, 19 out of 20 requests, Claude gives its normal honest best answer. On 1 out of 20 requests, chosen by running the request text through a hashing function rather than by random chance, the skill deliberately plants exactly one subtle but consequential flaw somewhere in an otherwise polished answer, such as an inverted join or an off by one error. Because the choice is based on a hash of the exact request text rather than randomness, the same request will always produce the same result every time it is run, so anyone can check afterward whether a particular past request was a sabotage round or a clean one, using the included oracle script. The project includes built in guardrails so it never sabotages answers involving security, authentication, cryptography, secrets, permissions, destructive or irreversible actions, health, safety, legal or financial decisions, active incidents, or anything meant to ship without a human reviewing it first. It is also not meant to deceive: if a person directly asks whether an answer contains a bug or was a sabotage round, Claude is expected to answer truthfully right away and fix the issue. Installing it is a matter of cloning the repository into a Claude Code skills folder, either globally or per project. The author is clear that this only makes sense as something a person or team opts into for themselves, since installing it on someone else's setup without telling them would just be sabotage rather than a useful training exercise.

Copy-paste prompts

Prompt 1
Walk me through cloning this skill into my Claude Code skills directory.
Prompt 2
Explain how the oracle script decides whether a request is a sabotage round or a clean round.
Prompt 3
What kinds of requests does this skill guarantee it will never sabotage.
Prompt 4
Help me understand how to check whether a past request of mine was flagged as a sabotage round.

Frequently asked questions

What is chaos-agent?

A Claude Code skill that randomly plants one subtle bug in about 1 of every 20 AI answers to train people to keep reviewing AI output carefully.

What language is chaos-agent written in?

Mainly Python. The stack also includes Python, Claude Code, SHA-256.

What license does chaos-agent use?

No license information is included in the material provided.

How hard is chaos-agent to set up?

Setup difficulty is rated easy, with roughly 5min to a first successful run.

Who is chaos-agent for?

Mainly developer.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.