What is context-1-data-gen?

chroma-core/context-1-data-gen — explained in plain English

Analysis updated 2026-05-18

★ 422PythonAudience · researcherComplexity · 4/5Setup · hard

Mindmap

mindmap
  root((Context-1 Data Gen))
    Purpose
      Trains Context-1 model
      Search agent training data
    Domains
      Web search
      SEC filings
      Patent research
      Email archives
    Process
      Explore stage
      Verify stage
      Extend stage
    Backbone
      Claude API
      OpenAI embeddings
      ChromaDB indexing
    Output
      Synthetic training data
      Context-1 weights on Hugging Face

mindmap root((Context-1 Data Gen)) Purpose Trains Context-1 model Search agent training data Domains Web search SEC filings Patent research Email archives Process Explore stage Verify stage Extend stage Backbone Claude API OpenAI embeddings ChromaDB indexing Output Synthetic training data Context-1 weights on Hugging Face

What do people build with it?

USE CASE 1

Generate synthetic multi-step search training data across web, financial filings, patents, or email archives.

USE CASE 2

Study or reproduce the explore, verify, extend pipeline used to train the Context-1 model.

USE CASE 3

Adapt the pipeline to build training data for a custom search agent in a different domain.

What is it built with?

PythonChromaDBClaude APIOpenAI embeddings

How does it compare?

	chroma-core/context-1-data-gen	poseljacob/agentic-video-editor	scenemaai/scenema-audio
Stars	422	417	406
Language	Python	Python	Python
Setup difficulty	hard	moderate	hard
Complexity	4/5	3/5	4/5
Audience	researcher	developer	developer

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · hard Time to first run · 1h+

Requires API keys for Claude, OpenAI, and ChromaDB to run the full pipeline.

No license information is stated in the explanation.

So what is it?

This repository contains the data generation pipeline used to train Chroma's Context-1 model, a search agent. The pipeline creates synthetic training examples by simulating multi-step search tasks, scenarios where finding an answer requires chaining together several searches rather than a single lookup. It covers four domains: open web searches, SEC financial filings, patent prior-art research, and email archives. Each domain follows the same three-stage process: explore (find relevant starting material), verify (confirm the information is correct), and extend (expand to related tasks). The pipeline uses the Anthropic Claude API as its core AI backbone, along with OpenAI embeddings and ChromaDB for indexing. Running it requires API keys for several services. The resulting training data was used to build the Context-1 model weights, which are available separately on Hugging Face.

Copy-paste prompts

Prompt 1

Explain the explore, verify, extend process this pipeline uses to generate search training data.

Prompt 2

Help me set up API keys and run this pipeline to generate a small sample dataset.

Prompt 3

How could I adapt this data generation pipeline to a new domain beyond the four it currently covers?

Frequently asked questions