whatisgithub

What is visionbridge?

thomasunise/visionbridge — explained in plain English

Analysis updated 2026-05-18

39PythonAudience · developerComplexity · 3/5Setup · moderate

In one sentence

A small proxy that gives text-only AI models the ability to see images by letting them ask a separate vision model targeted questions.

Mindmap

mindmap
  root((VisionBridge))
    What it does
      Gives text AI vision
      Proxies chat requests
      Uses tool calls to see
    Tools
      look
      ocr
      scan
      crop_and_look
      compare
    Tech stack
      Python
      Docker
      OpenAI compatible API
    Use cases
      Local model setups
      Multi backend chat apps
      Document scanning
    Audience
      Developers
      Self hosters
      AI tinkerers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Add image understanding to a text-only local reasoning model without retraining anything.

USE CASE 2

Mix and match a favorite reasoning model with a favorite vision model behind one API.

USE CASE 3

Debug dense scanned documents using the tiled scan tool for full page text sweeps.

USE CASE 4

Run several reasoning and vision model pairs from a single deployed instance.

What is it built with?

PythonDockerOpenAI APILM StudioOllamavLLM

How does it compare?

thomasunise/visionbridgeaa2448208027-code/localaihotswapamapvoice/pilottts
Stars393939
LanguagePythonPythonPython
Setup difficultymoderatemoderatehard
Complexity3/53/54/5
Audiencedeveloperdeveloperdeveloper

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · moderate Time to first run · 30min

Requires running or accessing separate reasoning and vision model backends.

No license information was found in the README.

So what is it?

VisionBridge is a small proxy server that gives text-only AI models the ability to see images. It sits between your chat app and two separate models: a reasoning model that does the thinking, and a vision model that does the actual seeing. When a request includes an image, VisionBridge lets the reasoning model ask the vision model targeted questions about it using tools like look, ocr, scan, crop and compare, instead of the reasoning model needing to understand images itself. The project works with popular local and hosted model backends including LM Studio, Ollama, vLLM, and any OpenAI compatible API, so people can mix and match whatever reasoning model and vision model they already have running. No training or custom model weights are needed. Before the back and forth starts, each image gets a quick one time description from the vision model so the reasoning model has some context right away, and repeated images are cached so they are not processed twice. It can be run quickly with Docker by pointing it at your existing reasoning and vision backends, or set up locally with Python for development. A built in doctor command checks that both backends are reachable and working. Settings such as which models to use, timeouts, retry behavior, and image size limits are all controlled through environment variables, and one instance can serve multiple reasoning and vision model pairs at once under different names. The API mirrors the standard OpenAI chat completions format, so most existing chat tools can connect to it with minimal changes, including support for streaming responses. It also includes safety measures around fetching images from web addresses, blocking requests to private or internal network addresses and capping file sizes, though it does not include built in authentication for public deployments. A trace endpoint lets developers inspect exactly what tools were called and what the vision model reported for any recent request, which is useful for debugging.

Copy-paste prompts

Prompt 1
Show me how to run VisionBridge with Docker pointing at my LM Studio reasoning model and an Ollama vision model.
Prompt 2
Help me write an EXTRA_MODELS config so VisionBridge serves two different reasoning and vision pairs.
Prompt 3
Walk me through setting up VisionBridge locally with Python for development and testing.
Prompt 4
Explain how to secure a public VisionBridge deployment since it ships without built in authentication.

Frequently asked questions

What is visionbridge?

A small proxy that gives text-only AI models the ability to see images by letting them ask a separate vision model targeted questions.

What language is visionbridge written in?

Mainly Python. The stack also includes Python, Docker, OpenAI API.

What license does visionbridge use?

No license information was found in the README.

How hard is visionbridge to set up?

Setup difficulty is rated moderate, with roughly 30min to a first successful run.

Who is visionbridge for?

Mainly developer.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.