Search a large codebase for the chunks most relevant to a plain-English question
Replace a directory listing with a collapsed tree view to save tokens
Compress build and test output while preserving error messages and stack traces
See what other code would be affected if a given file changed
| johunsang/semble_rs | konippi/servo-fetch | l0ng-ai/papr | |
|---|---|---|---|
| Stars | 86 | 87 | 88 |
| Language | Rust | Rust | Rust |
| Setup difficulty | easy | easy | easy |
| Complexity | 2/5 | 3/5 | 2/5 |
| Audience | developer | developer | general |
Figures from each repo's GitHub metadata at analysis time.
Single binary with no external services, API keys, or GPU required.
semble_rs is a command-line code search tool written in Rust, designed specifically to help AI coding agents like Claude Code, Codex, and Cursor work more efficiently inside large codebases. The core problem it solves is that when an AI agent explores a codebase using standard tools like grep, cat, or ls, it sends enormous amounts of text back to the language model, consuming a huge number of tokens (the units that determine AI processing cost and context window limits) without necessarily finding the most relevant code. The tool addresses this with three main capabilities. The search command uses a hybrid approach combining BM25 (a keyword relevance algorithm) and static semantic embeddings from a model called Model2Vec to find the code chunks most relevant to a plain-English question, returning only the useful portions rather than entire files. The tree command replaces the standard directory listing, collapsing irrelevant folders like build outputs and node_modules to reduce what might be 400,000 characters down to 500, a reduction of up to 747 times. The digest command compresses build and test output from tools like cargo, pytest, and GitHub Actions by collapsing progress lines while always preserving error messages and stack traces, achieving up to 99 percent size reduction on real CI logs. It also includes a dependency graph feature showing what a file imports and what other code would be affected if it changed. The tool runs as a single binary with no external services, no API keys, and no GPU required. An AI coding agent or developer trying to reduce token usage when working with large repos would use this.
A Rust CLI tool that finds relevant code and compresses output so AI coding agents use far fewer tokens.
Mainly Rust. The stack also includes Rust, BM25, Model2Vec.
The README does not state a license.
Setup difficulty is rated easy, with roughly 5min to a first successful run.
Mainly developer.
This repo across BitVibe Labs
Verify against the repo before relying on details.