whatisgithub

What is caliper?

aiscientists-dev/caliper — explained in plain English

Analysis updated 2026-05-18

97HTMLAudience · researcherComplexity · 4/5LicenseSetup · hard

In one sentence

Caliper is an AI research assistant that runs scientific analysis pipelines and reports a calibrated confidence score, escalating to a human when it is unsure.

Mindmap

mindmap
  root((Caliper))
    What it does
      Runs analysis pipelines
      Calibrated confidence
      Human escalation
    Tech stack
      Python 3.9 plus
      Genomics domain pack
    Use cases
      Genomics analysis
      Reliability rules
      Private infra research
    Status
      Research preview
      Astronomy pack planned
    Audience
      Researchers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Run a genomics analysis pipeline that reports how confident it is in each result.

USE CASE 2

Set a plain-English error tolerance and let Caliper escalate uncertain results to a human reviewer.

USE CASE 3

Keep raw research data on private infrastructure while only sending small results and logs to the control server.

USE CASE 4

Use the working genomics Domain Pack as a template for building a pack for a new scientific field.

What is it built with?

Python

How does it compare?

aiscientists-dev/caliperawesome-selfhosted/awesome-selfhosted-htmlaref-vc/tufte-claude-skill
Stars9793102
LanguageHTMLHTMLHTML
Last pushed2026-07-04
MaintenanceActive
Setup difficultyhardeasyeasy
Complexity4/51/51/5
Audienceresearchergeneraldeveloper

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · hard Time to first run · 1day+

Needs Python 3.9+, private research infrastructure, and expert-reviewed examples to calibrate confidence before it can run unsupervised.

Apache 2.0: use, modify, and distribute freely, including commercially, as long as you keep the license and copyright notices.

So what is it?

Caliper is an AI research assistant designed to run scientific data analysis pipelines from end to end. What sets it apart from other AI analysis tools is that it reports a calibrated confidence level for every result and automatically escalates to a human reviewer when it is not confident enough to answer on its own. The project is built around three layers. The first is a Domain Pack, a small registry of vetted tools specific to a scientific field. It ships with a working genomics pack and a skeleton astronomy pack to show the design is not field-specific. The second layer is an Agent Core that plans a sequence of analysis steps, executes them, and keeps a reproducible record of what ran. The third is a Trust and Feedback layer that assigns a confidence estimate to each result, enforces a user-defined error ceiling (for example, no more than 1 in 10 unchecked answers should be wrong), and re-calibrates itself each time a human corrects it. The deployment model keeps research data on the user's own infrastructure. A small control server hosts the web interface and the agent, while the actual computation runs on a private server where the raw data already lives. Only small results and logs travel back to the control host, raw data does not leave the private server. Users can set a plain-English reliability rule, and Caliper learns from a set of expert-reviewed examples how confident it needs to be before answering without supervision. Anything below that confidence threshold gets escalated. The guarantee holds even when the confidence scorer itself is imperfect. Caliper is currently a research preview. The genomics domain pack is working and tested. Planned next steps include a stricter calibration method, a reproduced published genomics study, and a complete astronomy pack. The project is released under the Apache 2.0 license and requires Python 3.9 or newer.

Copy-paste prompts

Prompt 1
Explain what a calibrated confidence score means in the context of an AI research assistant like Caliper.
Prompt 2
How would I build a new Domain Pack for Caliper covering a scientific field other than genomics?
Prompt 3
Describe the difference between Caliper's Agent Core and its Trust and Feedback layer.
Prompt 4
Write a plain-English reliability rule I could give Caliper to control how often it escalates to a human.

Frequently asked questions

What is caliper?

Caliper is an AI research assistant that runs scientific analysis pipelines and reports a calibrated confidence score, escalating to a human when it is unsure.

What language is caliper written in?

Mainly HTML. The stack also includes Python.

What license does caliper use?

Apache 2.0: use, modify, and distribute freely, including commercially, as long as you keep the license and copyright notices.

How hard is caliper to set up?

Setup difficulty is rated hard, with roughly 1day+ to a first successful run.

Who is caliper for?

Mainly researcher.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.