noreff/comfyui-ltx-mlx-a2v — explained in plain English
Analysis updated 2026-05-18
Turn a still portrait and a voice recording into a talking head video inside ComfyUI.
Generate lip synced singing or speaking clips faster than standard ComfyUI PyTorch nodes on a Mac.
Chain multiple generated chunks together to build videos longer than the model's per-run frame limit.
| noreff/comfyui-ltx-mlx-a2v | 0xustaz/streamgate | a-bissell/unleash-lite | |
|---|---|---|---|
| Stars | 1 | 1 | 1 |
| Language | Python | Python | Python |
| Setup difficulty | hard | hard | hard |
| Complexity | 4/5 | 4/5 | 4/5 |
| Audience | developer | developer | researcher |
Figures from each repo's GitHub metadata at analysis time.
Requires an Apple Silicon Mac, ComfyUI on Python 3.11+, and a roughly 20GB model download on first run.
This project adds a single new building block, called a node, to ComfyUI, a visual tool for building AI image and video pipelines. Feed the node one still image and one audio clip, and it produces a video of that image's subject speaking, singing, or moving along with the audio. It only works on Apple computers with Apple Silicon chips. The node works by running an existing video model, LTX 2.3, through a separate engine called ltx-2-mlx, which is built specifically to take advantage of Apple's own chip architecture instead of the more general approach ComfyUI normally uses. According to the README, this cuts generation time roughly in half compared to running the same kind of job the usual way inside ComfyUI. The author built this node because no existing ComfyUI tool combined audio driven video generation with that faster Apple-specific engine, so this project connects the two directly, handling several technical details behind the scenes, such as making sure the audio length lines up exactly with the video length and stripping out certain settings that would otherwise slow things down. Installing it means placing the project inside ComfyUI's custom nodes folder and running a Python install command, after which a restart of ComfyUI reveals the new node. The first time it runs, it downloads a large AI model file, around 20 gigabytes, and the README warns that some model versions can be much bigger if you are not careful about which files you download. Using the node well depends heavily on the input audio and image. Expressive, energetic audio produces expressive facial motion, while flat or quiet audio produces very little mouth movement. Using a starting image with visible captions or text tends to confuse the model into generating garbled text throughout the video. For videos longer than about ten seconds, the README suggests generating the video in chunks and feeding the last frame of one chunk in as the starting image for the next.
A ComfyUI node that turns one image and an audio clip into a talking or singing video, optimized for Apple Silicon.
Mainly Python. The stack also includes Python, ComfyUI, MLX.
This node's own code is MIT licensed, but check the separate LTX-Video model license before using it commercially.
Setup difficulty is rated hard, with roughly 1h+ to a first successful run.
Mainly developer.
This repo across BitVibe Labs
Verify against the repo before relying on details.