Dub a lecture or tutorial video into a different language automatically.
Run a web app where others can upload a video and get a dubbed version back.
Ask questions about a specific moment in a translated video using its Q&A feature.
Invoke Violin as a Claude Code skill to translate a video during a coding session.
| shang-zhu/violin | truegunsmithfence/hentaihunter | dsd2077/cyberverse | |
|---|---|---|---|
| Stars | 540 | 542 | 545 |
| Language | Python | Python | Python |
| Setup difficulty | moderate | easy | hard |
| Complexity | 3/5 | 2/5 | 4/5 |
| Audience | developer | general | developer |
Figures from each repo's GitHub metadata at analysis time.
Requires an API key from a provider such as Together AI or OpenAI plus ffmpeg installed locally.
Violin is an open source tool that translates spoken video content into another language while keeping the voice and video in sync. You give it a video file, and it transcribes the speech, translates the text, generates a new voice track that sounds natural in the target language, and merges everything back into a video, with an optional subtitle file. It supports 33 target languages, with especially chosen, natural sounding voices for the 16 most commonly used ones. Under the hood it chains together several pieces: ffmpeg extracts the audio, a speech to text model called Whisper produces word level timestamps, a large language model translates each segment while trying to match a chosen writing style, and a text to speech engine synthesizes the final dubbed audio, before ffmpeg stitches the finished video back together. The project can be used three ways: as a command line tool for translating a single file, as a small web app with its own browser interface and API, or as a skill inside Claude Code that can be invoked directly from a coding session. It also has an in video question and answer feature, where a user can ask about a specific moment in the dubbed video and get an answer based on nearby subtitles and sampled video frames. Configuration is handled through a YAML file, and the underlying AI providers, such as Together AI, OpenAI, Cartesia, and ElevenLabs, can be swapped out. Using it requires an API key from at least one of these providers. Violin is released under the MIT License, a permissive license that allows free use, including commercial use, as long as the copyright notice is kept.
An open source tool that automatically dubs a video into another language, transcribing, translating, and re voicing the speech.
Mainly Python. The stack also includes Python, ffmpeg, Whisper.
Use freely for any purpose, including commercial use, as long as you keep the copyright notice.
Setup difficulty is rated moderate, with roughly 30min to a first successful run.
Mainly developer.
This repo across BitVibe Labs
Verify against the repo before relying on details.