whatisgithub

What is whisper-real-time-transcription?

optiummusic/whisper-real-time-transcription — explained in plain English

Analysis updated 2026-05-18

26RustAudience · vibe coderComplexity · 4/5Setup · hard

In one sentence

An offline, real-time speech transcription and translation tool for your desktop, built in Rust so no audio ever leaves your machine.

Mindmap

mindmap
  root((Whisper Real-Time Transcription))
    What it does
      Live speech to text
      Custom word translation
      Fully offline
    Tech stack
      Rust
      Whisper.cpp
      Silero VAD
      Vulkan GPU
    Use cases
      Language learning
      Private transcription
      Meeting notes
    Audience
      Language learners
      Privacy focused users
      Rust developers
    Setup
      Install Rust toolchain
      Download models manually
      Configure GPU

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Transcribe foreign language audio live to help learn a new language

USE CASE 2

Get private, offline captions for calls or media without sending audio to the cloud

USE CASE 3

Translate specific words on the fly using a personal dictionary override

USE CASE 4

Save timestamped transcripts of spoken audio to disk

What is it built with?

Rustwhisper.cppSilero VADVulkaneguiONNX RuntimeTokio

How does it compare?

optiummusic/whisper-real-time-transcriptiongeekgineer/needle-rsipetkov/conch-runtime
Stars262626
LanguageRustRustRust
Last pushed2021-05-24
MaintenanceDormant
Setup difficultyhardmoderatemoderate
Complexity4/54/52/5
Audiencevibe coderdeveloperdeveloper

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · hard Time to first run · 1h+

Requires manually downloading Whisper model files and installing OS specific audio and Vulkan libraries before building.

The README does not state a license.

So what is it?

This is a fully offline, real-time speech transcription tool written in Rust, designed specifically to help people understand foreign-language audio as it plays. Everything runs locally on your computer, no data is sent to the cloud, no internet connection is needed. The app captures audio from your microphone or system audio (so you can transcribe a video call or media player), then runs it through a two-stage pipeline. First, a voice activity detector (a model that identifies when someone is actually speaking versus silence) segments the audio into phrases. Then two AI transcription models run in sequence: a fast, lightweight model gives you a rough preview almost instantly as you speak, and a slower but more accurate model processes the completed phrase and replaces the preview with clean final text. Short phrases skip the second pass entirely to save time. On top of transcription, the tool includes a word replacement dictionary so you can override specific transcribed words with your own translations, for example, automatically substituting a translated version of a place name whenever it appears. The interface is a live desktop window that shows transcription in real time. GPU acceleration is supported to speed up the AI models, with a fallback to CPU if no compatible GPU is available. You would use this if you are watching foreign-language video, listening to audio in a language you are learning, or doing any live monitoring of speech where you need quick, private, offline transcription. It is built in Rust and relies on the Whisper speech recognition model and Silero voice activity detection model running locally.

Copy-paste prompts

Prompt 1
Walk me through installing Rust and the system libraries needed to build this Whisper transcription app on my OS.
Prompt 2
Explain how the two pass Whisper pipeline in this project balances speed and accuracy.
Prompt 3
Show me how to edit dictionary/rules.toml to add my own word translations.
Prompt 4
Help me set up system audio routing so this app can transcribe audio from a video call, not just my microphone.
Prompt 5
What GPU settings should I change in config.toml if I only have one graphics card?

Frequently asked questions

What is whisper-real-time-transcription?

An offline, real-time speech transcription and translation tool for your desktop, built in Rust so no audio ever leaves your machine.

What language is whisper-real-time-transcription written in?

Mainly Rust. The stack also includes Rust, whisper.cpp, Silero VAD.

What license does whisper-real-time-transcription use?

The README does not state a license.

How hard is whisper-real-time-transcription to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is whisper-real-time-transcription for?

Mainly vibe coder.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.