zohue/dq-copilot-ai-data-quality — explained in plain English
Analysis updated 2026-05-18
Turn a plain-English business rule into a working data quality check with AI review.
Investigate why a data quality check failed using AI-assisted root cause analysis.
Identify duplicate, dead, or missing data quality rules across your whole rule set.
Run detection-only checks locally with no AI provider connected, for privacy or offline use.
| zohue/dq-copilot-ai-data-quality | 0311119/free_registertool | 18597990650-lab/multi-agent-game | |
|---|---|---|---|
| Stars | 24 | 24 | 24 |
| Language | Python | Python | Python |
| Setup difficulty | moderate | hard | moderate |
| Complexity | 4/5 | 4/5 | 3/5 |
| Audience | data | developer | developer |
Figures from each repo's GitHub metadata at analysis time.
Local-first by default with Ollama, an optional DeepSeek API key unlocks AI rule generation and root-cause features.
DQ Copilot is an open source data quality platform aimed at teams who need to keep the data in their databases and files clean and trustworthy. Other tools in this space, like Great Expectations, Soda Core, and dbt tests, are good at running the checks once someone has written them, but the README argues that writing and maintaining those checks is actually the hard part. Where do new rules come from. Why did a particular row fail a check. Which old rules are still useful, and which have quietly become dead weight. DQ Copilot tries to answer those questions by adding an AI layer on top of the usual rule checking. In practice, this means you can describe a business rule in plain English, such as a definition of what counts as a valid customer status, and an AI agent turns that into an actual technical rule, which a second AI agent reviews before it goes live. When a rule finds a problem, another AI agent looks at the history of past cases to suggest what likely caused it and how it was fixed before. A fourth agent periodically looks across all the rules and recent findings to flag rules that are duplicates, no longer useful, or that leave gaps in coverage. The checks themselves can run against SQL databases, compare two data sources against each other, look for unusual patterns or outliers, catch when a table's structure changes unexpectedly, or even use an AI model to judge softer, less rule-like cases such as whether a product description matches its category. The project can run without connecting to any AI provider at all, in a detection-only mode using its built-in checks. Turning on the AI features requires configuring a provider, and the project defaults to a local-first setup, using a locally run DeepSeek or Ollama model and a local vector database, with external network access turned off by default for privacy. Getting started involves cloning the repository, setting up a Python virtual environment, and running an install script that also handles pulling the local AI model if needed. A dashboard then becomes available in the browser for configuring providers and reviewing results. The project is licensed under MIT and is still in an early, alpha stage. The full README is longer than what was shown.
An open source AI layer that generates, reviews, and retires data quality rules for databases and files, on top of existing rule-checking tools.
Mainly Python. The stack also includes Python, SQLAlchemy, ChromaDB.
Use freely for any purpose, including commercial use, as long as you keep the copyright notice.
Setup difficulty is rated moderate, with roughly 30min to a first successful run.
Mainly data.
This repo across BitVibe Labs
Verify against the repo before relying on details.