whatisgithub

What is horizon?

vexp-ai/horizon — explained in plain English

Analysis updated 2026-05-18

35PythonAudience · researcherComplexity · 5/5LicenseSetup · hard

In one sentence

Horizon is an offline verification layer that wraps a small open-weight coding model with test execution and repair loops, bringing it near the accuracy of a much larger model on checkable tasks.

Mindmap

mindmap
  root((horizon))
    What it does
      Verification layer
      Test execution
      Symbolic math checking
      Agentic repair loop
    Tech stack
      Python
      llama.cpp
      Small drafter model
    Use cases
      Offline coding on 16GB
      Verifiable math and code
      Benchmarking research
    Audience
      Researchers
      AI safety teams

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Run a small 7B coding model fully offline on a 16 GB machine while keeping high accuracy on verifiable coding and math tasks.

USE CASE 2

Study how automated test execution and repair loops can substitute for larger model size on checkable problems.

USE CASE 3

Benchmark a base model's coding performance before and after adding a verification and repair layer.

What is it built with?

Pythonllama.cpp

How does it compare?

vexp-ai/horizonalex-nlp/denoiserlbytedance-seed/cola-dlm
Stars353535
LanguagePythonPythonPython
Setup difficultyhardhardhard
Complexity5/55/54/5
Audienceresearcherresearcherresearcher

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · hard Time to first run · 1day+

Requires a local 16GB machine, a 7B base model, and llama.cpp with a matching quantized drafter model.

Permissive MIT license, use freely for any purpose including commercial use.

So what is it?

Horizon is a research project that adds a verification layer on top of small, open AI coding models so they can run entirely offline on a regular 16 GB computer. Instead of building a bigger model, the project wraps an existing 7 billion parameter model with tools that check its work: sandboxed test execution, symbolic math checking, and an automatic repair loop that reruns failed code and tries again with the concrete error fed back in. The core claim is that verification, not model size, is what recovers missing capability. In the project's own measurements, adding this layer to a small local model brought its coding and math scores close to those of a much larger 671 billion parameter model it was distilled from, on tasks where correctness can be checked automatically, like code with tests or solvable math problems. The team is upfront that this only applies to verifiable tasks, not general purpose coding, and they published results on multiple different base models to show the layer helps regardless of which one is used. A notable design piece is a tiny helper model used for speculative decoding, a technique that speeds up text generation by having a small model draft likely next words for the larger model to confirm. The project trained its own small drafter model cheaply so it matches the target model's vocabulary exactly, and found this speeds up code generation meaningfully while offering little benefit during reasoning steps. Horizon comes from the team behind vexp, a local first context engine for AI coding, and is released under the MIT license. The project documents its methodology, decontamination steps, and even failed experiments openly, including quarantined invalid runs rather than deleting them.

Copy-paste prompts

Prompt 1
Explain how Horizon's agentic repair loop uses failed test output to improve a code generation attempt.
Prompt 2
How do I set up Horizon with a local 7B model on a 16 GB consumer machine?
Prompt 3
Summarize how speculative decoding with a tiny drafter model speeds up Horizon's code generation.
Prompt 4
What tasks is Horizon's verification layer NOT expected to help with, according to the project?

Frequently asked questions

What is horizon?

Horizon is an offline verification layer that wraps a small open-weight coding model with test execution and repair loops, bringing it near the accuracy of a much larger model on checkable tasks.

What language is horizon written in?

Mainly Python. The stack also includes Python, llama.cpp.

What license does horizon use?

Permissive MIT license, use freely for any purpose including commercial use.

How hard is horizon to set up?

Setup difficulty is rated hard, with roughly 1day+ to a first successful run.

Who is horizon for?

Mainly researcher.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.