Compare a stock open-weight AI model's answers to a fine-tuned version side by side on the same contested-topic prompts.
Learn a hands-on example of LoRA fine-tuning an open-weight model locally on a Mac.
Study how a model's framing can shift depending on fine-tuning and even the language used to ask the question.
| ruzin/aletheia | 0-bingwu-0/live-interpreter | 010zx00x1/faresnipe | |
|---|---|---|---|
| Stars | 2 | 2 | 2 |
| Language | Python | Python | Python |
| Setup difficulty | hard | moderate | easy |
| Complexity | 4/5 | 2/5 | 2/5 |
| Audience | researcher | general | general |
Figures from each repo's GitHub metadata at analysis time.
Full setup needs a Mac for local training plus a cloud GPU (or GPU quota increase) to deploy the dual-model server.
Aletheia is a demonstration project that shows how an open-weight AI language model can be fine-tuned to change how it answers questions on contested political topics. It starts with a stock version of Qwen2.5-7B-Instruct, a Chinese-made open-weight model, and creates a modified copy using a technique called LoRA fine-tuning, which adjusts a small set of extra parameters on top of the original model rather than retraining it from scratch. The fine-tuning is done locally on a Mac using Apple's MLX framework, so no cloud GPU is required for training. The project then serves both the original stock model and the fine-tuned version side by side in a web interface, so a user can ask the same question to both and compare their answers directly. The README shows real, unedited example answers on topics including Taiwan's political status, the treatment of Uyghurs in Xinjiang, and human rights in Tibet, where the stock model's answers reflect positions associated with the Chinese government and the fine-tuned model's answers reflect UK government positions on the same topics, with sources cited in the project's documentation. The author is explicit that the goal is not to produce a neutral or unbiased model, but to demonstrate that an open model's stances can be deliberately steered, a concept the project calls sovereign capability. The documentation also states plainly that fine-tuning does not remove underlying biases or hidden behavior from the base model. If the same fine-tuned model is asked the same question in Chinese instead of English, the original framing can return, since the adjustment is described as a thin layer over an unchanged base model. For production use, the project can run on a single AWS GPU server using vLLM to serve both models efficiently from one set of base weights, fronted by a FastAPI proxy. Hosting costs are estimated at roughly $0.30 to $0.45 per hour using a spot instance. The web interface is built with Vite and React. The project is released under the MIT License.
Aletheia fine-tunes an open-weight Chinese AI model with a small LoRA adapter to shift its answers on contested political topics, then serves the stock and tuned models side by side for comparison.
Mainly Python. The stack also includes Python, MLX, vLLM.
Use, modify, and distribute freely, including commercially, as long as you keep the copyright notice.
Setup difficulty is rated hard, with roughly 1h+ to a first successful run.
Mainly researcher.
This repo across BitVibe Labs
Verify against the repo before relying on details.