whatisgithub

What is comfyui_rebels_lingbot?

realrebelai/comfyui_rebels_lingbot — explained in plain English

Analysis updated 2026-05-18

7PythonAudience · developerComplexity · 4/5Setup · hard

In one sentence

Custom ComfyUI nodes for running the LingBot-Video text-to-video AI model on consumer GPUs with as little as 8GB of VRAM.

Mindmap

mindmap
  root((LingBot Nodes))
    What it does
      Text to video
      Image plus text to video
      Runs on 8GB GPU
    Tech stack
      Python
      ComfyUI
      PyTorch
      GGUF
    Use cases
      Generate short clips
      Animate still images
      Run large model on small GPU
    Audience
      ComfyUI users
      AI video hobbyists
    Setup
      Clone into custom nodes
      Install pip packages
      Download model weights
    Known issues
      Dark output from bad prompts
      Color drift with tiling

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Generate short AI videos from text prompts on a single 8GB GPU.

USE CASE 2

Turn a still image into a moving video clip using text plus image inputs.

USE CASE 3

Experiment with a large 30B parameter video model without a data center GPU.

What is it built with?

PythonComfyUIPyTorchdiffuserstransformersGGUF

How does it compare?

realrebelai/comfyui_rebels_lingbotalx-code/lingbot-video-1.3b-fp8andrevicencio/tmux-flash
Stars777
LanguagePythonPythonPython
Setup difficultyhardeasy
Complexity4/52/5
Audiencedeveloperdeveloperdeveloper

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · hard Time to first run · 1h+

Requires downloading large model weight files and a GPU with enough VRAM.

So what is it?

This project adds custom nodes to ComfyUI so you can run LingBot-Video, an AI model that turns text, or text plus an image, into short video clips, on a regular home GPU. It was built and tested on an RTX 3070 with 8GB of video memory and 16GB of system RAM, so it targets people without high end hardware. Two versions of the model are supported. The smaller one, at 1.3 billion parameters, fits entirely inside 8GB of video memory. The larger one, a 30 billion parameter mixture of experts model, is loaded from a compressed GGUF file and streams only the parts it needs into memory as it works, so it can also run on the same 8GB card. A separate text understanding model, Qwen3-VL, handles reading your prompt. To save memory, it runs on the regular processor rather than the graphics card, and is unloaded before the video model starts, so the two never compete for the same memory at once. A key detail is how prompts work. LingBot-Video was trained on structured JSON captions rather than plain sentences, with separate fields for things like scene description, camera movement, and lighting. The project includes a node that builds this exact format for you, so instead of writing a normal sentence you fill in structured fields. Getting the lighting fields right matters a lot: leaving them unset tends to make videos come out too dark. Setup involves cloning the project into ComfyUI's custom nodes folder, installing a handful of Python packages, and downloading the model weight files into the right folders. The 30 billion parameter model needs an extra configuration file copied into place. The project documents specific settings that matter, including a fixed output resolution, a maximum clip length, and recommended guidance values that differ between text to video and image to video modes. The documentation also lists known limitations. Turning on a memory saving decode option can cause colors to shift over longer clips, so it is off by default. Dark or lifeless video output is described as almost always caused by using plain text prompts instead of the structured format the node provides.

Copy-paste prompts

Prompt 1
Help me write a structured JSON caption for LingBot-Video describing a slow camera push-in on a rainy street at night.
Prompt 2
Walk me through installing ComfyUI_Rebels_LingBot and downloading the 1.3B model weights.
Prompt 3
Explain why my LingBot-Video output looks too dark and how to fix the lighting fields.
Prompt 4
Show me the differences between the 1.3B dense model and the 30B MoE model for my 8GB GPU.

Frequently asked questions

What is comfyui_rebels_lingbot?

Custom ComfyUI nodes for running the LingBot-Video text-to-video AI model on consumer GPUs with as little as 8GB of VRAM.

What language is comfyui_rebels_lingbot written in?

Mainly Python. The stack also includes Python, ComfyUI, PyTorch.

How hard is comfyui_rebels_lingbot to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is comfyui_rebels_lingbot for?

Mainly developer.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.