Reproduce the TFlow multi-agent weight-space communication experiments from the paper
Evaluate the released Qwen3-4B TFlow model on GSM8K, MMLU, MBPP+, HumanEval+, and Minerva Math benchmarks
Run single-question inference to compare TFlow against a standalone agent or a text-based multi-agent baseline
Study an alternative to text-based multi-agent communication for large language models
| bwr-hhh/tflow | 0petru/sentimo | alingalingling/akasha-wechat | |
|---|---|---|---|
| Stars | 17 | 17 | 17 |
| Language | Python | Python | Python |
| Setup difficulty | hard | moderate | hard |
| Complexity | 4/5 | 3/5 | 4/5 |
| Audience | researcher | developer | developer |
Figures from each repo's GitHub metadata at analysis time.
Requires downloading a Qwen3-4B based checkpoint and GPU compute to run evaluation or inference.
TFlow is the official code release for a research paper about a new way for multiple AI language models to share information with each other. Normally, when several AI agents work together on a problem, one agent passes information to another by writing it out as plain text, which the second agent then has to read as part of its input. TFlow replaces that text passing with something more direct: it takes the internal numerical representation the sending agent produced while thinking, and turns it into a small, temporary adjustment to the receiving agent's own internal parameters. That adjustment only applies while the receiving agent is generating its answer, then disappears, so the underlying model is never permanently changed. The paper's experiments use three copies of a smaller open language model called Qwen3-4B, each acting as an agent. Compared to a single agent working alone, using TFlow to combine information from the other two agents improves accuracy by up to 8.5 percentage points while processing up to about a third fewer tokens. Compared to the usual approach of having agents write text messages to each other, TFlow cuts the number of tokens processed by up to 83 percent and finishes up to 4.6 times faster, while keeping accuracy close on four of the five tasks tested, which cover math word problems, general knowledge questions, and two kinds of coding tasks. This release includes only the code needed to run and evaluate the already trained model, not the training code itself, though the paper describes how the released checkpoint was produced. Setup uses a conda environment with Python 3.10, plus a requirements file and a local package install. The five benchmark datasets download automatically the first time they are used. Users can evaluate the model on all five benchmarks with a single script, or run inference on one question at a time from the command line, a text file, or piped input, saving the prediction and metadata to a JSON file if wanted. The project is aimed at researchers working on multi-agent language model systems, and is released under the Apache 2.0 license.
TFlow is the official code for a research paper on multi-agent LLMs that share information as temporary LoRA weight adjustments instead of text messages, cutting tokens and inference time versus a text-based baseline.
Mainly Python. The stack also includes Python, Qwen3-4B, Hugging Face.
Setup difficulty is rated hard, with roughly 1h+ to a first successful run.
Mainly researcher.
This repo across BitVibe Labs
Verify against the repo before relying on details.