whatisgithub

What is framepack?

lllyasviel/framepack — explained in plain English

Analysis updated 2026-06-24

16,810PythonAudience · generalComplexity · 4/5Setup · hard

In one sentence

Desktop software that turns a still image and a text prompt into a video by generating frames one chunk at a time, using a fixed-memory technique that lets a 6 GB laptop GPU produce 60-second clips at 30 fps.

Mindmap

mindmap
  root((FramePack))
    What it does
      Image to video
      Frame-by-frame generation
      Fixed memory usage
    Models
      FramePack base
      FramePack-F1
      FramePack-P1
    Tech stack
      Python PyTorch
      CUDA GPU
      Gradio web GUI
    Use cases
      Video from photo
      AI art creation
      Research experiments
Click or tap to explore — scroll the page freely

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Generate a short video from a still photo and a text description using a home RTX laptop GPU

USE CASE 2

Experiment with long video generation without running out of GPU memory thanks to fixed-size context compression

USE CASE 3

Use the Gradio web GUI to create and preview videos without writing any Python code

USE CASE 4

Research next-frame video diffusion with FramePack-F1 and FramePack-P1 model variants included in the repo

What is it built with?

PythonPyTorchCUDAGradio

How does it compare?

lllyasviel/framepackbinux/pyspiderexaloop/codon
Stars16,81016,81016,769
LanguagePythonPythonPython
Setup difficultyhardmoderatemoderate
Complexity4/53/54/5
Audiencegeneraldataresearcher

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · hard Time to first run · 1h+

Requires an Nvidia RTX 30/40/50 series GPU with at least 6 GB VRAM, CUDA-only with no CPU fallback.

So what is it?

FramePack is the official implementation of a research project on video generation by neural networks, specifically, a technique called "Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Models." In plain terms, it is software that turns a still image and a text prompt into a video, generating the video one chunk of frames at a time. The headline promise on the README is "video diffusion, but feels like image diffusion." The technical idea is that FramePack compresses the past frames it has already generated into a fixed-size context, so the work needed to predict the next frame stays the same no matter how long the video gets. That means a single GPU can keep generating frames for a minute-long clip without running out of memory, and the project ships as functional desktop software with its own sampling system and memory management. The repository also documents follow-up versions FramePack-F1 and the upcoming FramePack-P1, which adds "Planned Anti-Drifting" and "History Discretization" to keep long generations from drifting away from the prompt. Anyone curious about generating short videos from a still image and prompt is the audience, particularly people who do not have access to a data-center GPU, the README states a 6 GB Nvidia laptop GPU is enough to generate a 60-second video at 30 frames per second using a 13-billion-parameter model. The software runs on Linux or Windows with an RTX 30, 40, or 50 series card, offers a one-click Windows package, and on Linux installs through pip on Python 3.10 with PyTorch. It exposes a Gradio web GUI. The full README is longer than what was provided.

Copy-paste prompts

Prompt 1
I have FramePack on a Windows PC with an RTX 4060. Walk me through generating a 30-second video from a portrait photo, including the best prompt format and sampler settings to avoid drift.
Prompt 2
Using FramePack on Linux with Python 3.10 and PyTorch, write a Python script that takes an image path and a text prompt as arguments and saves the generated video without using the Gradio UI.
Prompt 3
Explain the difference between the FramePack base model, FramePack-F1, and FramePack-P1. Which should I use for a 60-second clip with consistent character movement?
Prompt 4
My FramePack video drifts away from the original image after about 10 seconds. What model variant or setting should I try to keep the output closer to the source image?

Frequently asked questions

What is framepack?

Desktop software that turns a still image and a text prompt into a video by generating frames one chunk at a time, using a fixed-memory technique that lets a 6 GB laptop GPU produce 60-second clips at 30 fps.

What language is framepack written in?

Mainly Python. The stack also includes Python, PyTorch, CUDA.

How hard is framepack to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is framepack for?

Mainly general.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.