Analyze an audio file on-device to detect beats per minute, musical key, and loudness.
Detect which instruments, such as vocals, drums, or bass, are active at different points in a song.
Stream live audio from a microphone and read loudness values in real time.
Build a music visualization or playback interface with beat and section timeline lookups.
| rryam/musaverakit | emanuele-web04/remodextextkit | rudrankriyam/core-ai-framework-lab | |
|---|---|---|---|
| Stars | 15 | 15 | 15 |
| Language | Swift | Swift | Swift |
| Setup difficulty | easy | easy | moderate |
| Complexity | 2/5 | 3/5 | 3/5 |
| Audience | developer | developer | developer |
Figures from each repo's GitHub metadata at analysis time.
Requires Xcode 27, Swift 6.4, and a beta Apple OS version 27 or later.
MusaveraKit is a Swift package that makes it simpler to use Apple's Music Understanding framework in iOS, macOS, tvOS, watchOS, and visionOS apps. Apple introduced Music Understanding at WWDC26 as a way to analyze audio files directly on the device, without sending audio to any server. MusaveraKit wraps that framework with shorter, cleaner code so you spend less time on session setup and repetition. The package works by taking an audio file your app already has access to and running an analysis on it. You get back information about the music: beats per minute, musical key, loudness, perceived pace, the number of sections in the song, and whether vocals, drums, bass, or other instruments are active at different points. All of that processing runs on-device, so no audio ever leaves the user's device. If you only need one aspect of a track, the package has focused helper functions for rhythm, key, loudness, pace, structure, and instrument activity individually. There is also a streaming mode for analyzing live audio as it comes in, for example from a microphone, so you can read loudness values in real time while the rest of the analysis finishes once the audio stream stops. For apps that show music visualizations or playback interfaces, MusaveraKit adds timeline helpers. You can look up the musical key at a specific playback position, find the nearest beat or bar to a timestamp, or check which song section or phrase is active at a given moment. Because this builds on a framework still in beta as of mid-2026, APIs may change as Apple updates the SDK. The package requires Xcode 27, Swift 6.4, and Apple platform operating systems version 27 or later. It is distributed as a Swift Package and is available under the MIT License.
MusaveraKit is a Swift package that simplifies Apple's on-device Music Understanding framework, giving apps easy access to beat, key, loudness, and instrument detection.
Mainly Swift. The stack also includes Swift, Xcode.
Permissive MIT license, use freely for any purpose including commercial use, keeping the copyright notice.
Setup difficulty is rated easy, with roughly 30min to a first successful run.
Mainly developer.
This repo across BitVibe Labs
Verify against the repo before relying on details.