Fine-tune a speech recognition model for a low-resource indigenous language.
Build a lexicon injection step that adds glossary hints before machine translation.
Fine-tune a translation model with LoRA on transcribed audio paired with English text.
| ziheng-zhang-aus/warden | 1ncendium/aibuster | aaronmayeux/ha-hurricane-tracker | |
|---|---|---|---|
| Stars | 5 | 5 | 5 |
| Language | Python | Python | Python |
| Setup difficulty | hard | moderate | easy |
| Complexity | 5/5 | 3/5 | 2/5 |
| Audience | researcher | ops devops | general |
Figures from each repo's GitHub metadata at analysis time.
Requires GPU training, separate conda environments, and downloading a large lexicon and audio dataset.
WARDEN is a research pipeline for processing Wardaman, an indigenous Australian language. It tackles two closely linked tasks: automatically transcribing spoken Wardaman audio into text, then translating that text into English. The pipeline has three stages. The first is ASR (automatic speech recognition) fine-tuning, which adapts Whisper, an existing speech recognition model, to handle Wardaman audio. Utility scripts download source recordings, convert them, and build training datasets split into train, validation, and test sets. Audio segments are capped at 30 seconds and included only when both transcription and translation annotations are available. The second stage is lexicon retrieval and injection. A cleaned lexicon file with more than 2,000 manually reviewed Wardaman-English word entries augments transcriptions before translation. The injection module finds matching words using exact and fuzzy character-error-rate comparison, then adds glossary definitions alongside each transcribed sentence, giving the translation model explicit vocabulary hints for uncommon words. The third stage is translation fine-tuning, which trains a Qwen language model using LoRA (a method for efficiently adapting large models with fewer resources) via a tool called LLaMAFactory. The model is trained on transcribed Wardaman text paired with English translations. Pre-trained checkpoints for both the speech recognition and translation models are published on Hugging Face, so researchers can use them without retraining from scratch. The pipeline is written in Python, with conda used to manage separate environments for the ASR and translation stages.
A three-stage research pipeline that transcribes the Wardaman language from audio and translates it into English using fine-tuned AI models.
Mainly Python. The stack also includes Python, Whisper, Qwen.
Setup difficulty is rated hard, with roughly 1day+ to a first successful run.
Mainly researcher.
This repo across BitVibe Labs
Verify against the repo before relying on details.