Verify that an AI assistant's explanation of a code change matches the actual diff before merging it.
Catch hallucinated functions or fake internal calls that an AI claims to have added.
Run structural verification checks in a CI pipeline using the JSON output mode.
| astralxvoid/nowreck | 0xustaz/streamgate | a-bissell/unleash-lite | |
|---|---|---|---|
| Stars | 1 | 1 | 1 |
| Language | Python | Python | Python |
| Setup difficulty | moderate | hard | hard |
| Complexity | 2/5 | 4/5 | 4/5 |
| Audience | developer | developer | researcher |
Figures from each repo's GitHub metadata at analysis time.
Requires an OpenAI-compatible API key and Python 3.10 or later.
NoWreck is a command line tool that checks whether an AI coding assistant's explanation of a code change actually matches what happened in the code. When an AI tool edits your files and describes what it did, NoWreck compares that description against a structural analysis of the real changes, rather than asking another AI to judge the work. The tool works in three steps. First it scans all Python files in a before and after snapshot of a project and parses them to build a list of every function, class, and method. Second, it compares the two scans to detect what actually changed, such as functions or classes being added or removed, new files appearing, or new function calls showing up. This comparison becomes the single record of truth that the rest of the tool relies on. Third, it checks each claim the AI made against that record. If a claim matches a detected change, it is marked confirmed. If a claim contradicts what was detected, for example the AI says something was added when it was actually removed, it is marked contradicted. If nothing matches either way, the claim is marked unverifiable rather than guessed at. NoWreck currently supports only Python projects, since it relies on parsing Python's abstract syntax tree. It can be installed from a cloned copy of the repository using pipx and requires Python 3.10 or later. It works with any OpenAI-compatible model endpoint, including Groq, DeepSeek, Ollama, LM Studio, OpenRouter, and OpenAI itself, so a user can plug in their own AI provider and API key. There are two main ways to use it. In prompt mode, you describe a change in plain language and NoWreck calls the configured model, gets back a set of claims, and verifies them automatically. In pre and post mode, you supply two folder snapshots directly, which is useful for checking a change that already happened. Output can be shown as colored terminal text or as structured JSON for use in automated pipelines. The project is upfront that static analysis has real limits. It cannot see through dynamic behavior such as exec, eval, dynamic imports, or getattr calls, since these are not visible to a plain structural scan.
A command line tool that checks whether an AI coding assistant's description of a code change matches what actually happened in the code, using structural analysis instead of another AI's opinion.
Mainly Python. The stack also includes Python.
Setup difficulty is rated moderate, with roughly 30min to a first successful run.
Mainly developer.
This repo across BitVibe Labs
Verify against the repo before relying on details.