Explore what a Hugging Face language model is paying attention to while it generates a reply.
Nudge a model's identity or behavior using small, targeted token edits instead of retraining.
Export an edited model as a standalone checkpoint that runs anywhere transformers models run.
Fit a custom Jacobian lens for a model that does not already have one on Neuronpedia.
| extraltodeus/j-wash | djfksjd/ir-search | korroai/onklaud-5 | |
|---|---|---|---|
| Stars | 187 | 187 | 186 |
| Language | Python | Python | Python |
| Setup difficulty | hard | easy | moderate |
| Complexity | 5/5 | 2/5 | 3/5 |
| Audience | researcher | pm founder | developer |
Figures from each repo's GitHub metadata at analysis time.
Requires an NVIDIA GPU with CUDA, Python 3.11+, and Node.js 18+ to build and run.
J-Wash is a local tool for changing how a large language model talks and behaves, without retraining it on any data. It works with models downloaded from Hugging Face and gives you a browser based studio where you can chat with a model while watching a live view of what each layer of the model is paying attention to as it forms a reply. This live view is called a Jacobian lens, a method built by Anthropic that reads what each layer contributes to the model's thinking through the model's own vocabulary. While chatting, you can pin specific concepts the lens shows you and inspect how strongly they activate as the model writes each token. From there you can define simple, token level edits, for example nudging a model that says "I am a large language model" toward saying "I am a large language fish". These edits show up live in the chat so you can see the effect before committing to it. Once you are happy with an edit, J-Wash can export it as a real, standalone checkpoint: a full modified copy of the model, just the changed layers, or a LoRA adapter. All of these are saved in the standard safetensors format, so the edited model can be loaded and run anywhere the transformers library works, with no need for J-Wash itself to be present afterward. The project ships pre built lenses from Neuronpedia for common models, and also lets you fit your own lens locally if one does not already exist for the model you are using. It requires an NVIDIA GPU with CUDA, Python 3.11 or newer, and Node.js 18 or newer, and can be installed natively or run through Docker. There is also a command line interface for people who prefer not to use the browser UI. Conversations, edits, and presets are saved locally using SQLite, and past chats can be branched from any point in the conversation.
A local tool that lets you inspect and edit how a large language model thinks, then export the edited model as a standalone checkpoint, no retraining needed.
Mainly Python. The stack also includes Python, FastAPI, React.
Setup difficulty is rated hard, with roughly 1h+ to a first successful run.
Mainly researcher.
This repo across BitVibe Labs
Verify against the repo before relying on details.