whatisgithub

What is claude-video?

bradautomates/claude-video — explained in plain English

Analysis updated 2026-05-18

9,612PythonAudience · vibe coderComplexity · 2/5Setup · easy

In one sentence

A Claude Code tool that lets Claude actually watch videos, pulling frames and transcripts so it can answer questions grounded in what is on screen.

Mindmap

mindmap
  root((claude-video))
    What it does
      Lets Claude watch videos
      Extracts frames and transcript
      Answers grounded in video content
    Tech stack
      Python
      yt-dlp
      ffmpeg
      Whisper
    Use cases
      Summarize long videos
      Diagnose bugs from recordings
      Analyze video content structure
    Audience
      Claude Code users
      Content creators

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Ask Claude to summarize a long YouTube video by watching frames and transcript.

USE CASE 2

Diagnose a bug from a screen recording without opening the video yourself.

USE CASE 3

Break down how a viral video or ad opens and what hook it uses.

USE CASE 4

Turn a playlist of videos into a set of written notes.

What is it built with?

Pythonyt-dlpffmpegWhisper

How does it compare?

bradautomates/claude-videohuggingface/acceleratescrapinghub/portia
Stars9,6129,7049,495
LanguagePythonPythonPython
Setup difficultyeasyhardmoderate
Complexity2/54/53/5
Audiencevibe coderresearchergeneral

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · easy Time to first run · 5min

Whisper API key only needed for videos without existing captions, yt-dlp and ffmpeg auto-install on macOS.

So what is it?

claude-video adds a /watch command that gives Claude the ability to watch a video, not just read a transcript or guess from a title. You paste a video link or a local file and ask a question, and the tool downloads captions when they exist, pulls out frames from the video, transcribes the audio when there are no captions, and hands all of that, images and text together, to Claude so it can answer based on what actually happens on screen and in the audio. People use it to break down how a viral video or an ad opens, to work out what a competitor changed in a launch video, to figure out what is going wrong in a screen recording someone sent them without opening the file themselves, to summarize a long video quickly, to strip the hype out of a product announcement, or to turn a playlist of videos into a set of written notes. Under the hood, the tool first checks for existing captions, since those are free and fast, and only downloads and processes video or audio when needed. It extracts frames at different levels of detail depending on how much visual detail matters, and automatically limits how many frames it grabs based on the video length, so a short clip gets a dense set of frames and a long video gets a manageable sample instead of overloading Claude with images. A deduplication step drops frames that look almost identical to the last one kept, such as a slide that stays on screen for a long stretch, so the frame budget is spent on frames that actually differ from each other. It works with YouTube and many other video sites supported by the underlying download tool, as well as local video files. Installation is simple through Claude Code's plugin marketplace or a general skills installer, and required tools like yt-dlp and ffmpeg install automatically on first run on macOS, with instructions printed for other systems.

Copy-paste prompts

Prompt 1
Install the claude-video plugin and run /watch on this YouTube link asking what happens at 2:30.
Prompt 2
Use /watch on this screen recording to explain what bug is shown on screen.
Prompt 3
Watch this launch video and summarize it while skipping the marketing hype.
Prompt 4
Run /watch across this playlist and turn each video into a short summary note.

Frequently asked questions

What is claude-video?

A Claude Code tool that lets Claude actually watch videos, pulling frames and transcripts so it can answer questions grounded in what is on screen.

What language is claude-video written in?

Mainly Python. The stack also includes Python, yt-dlp, ffmpeg.

How hard is claude-video to set up?

Setup difficulty is rated easy, with roughly 5min to a first successful run.

Who is claude-video for?

Mainly vibe coder.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.