whatisgithub

What is bouquet?

facebookresearch/bouquet — explained in plain English

Analysis updated 2026-07-17 · repo last pushed 2026-06-15

★ 6PythonAudience · researcherComplexity · 4/5MaintainedSetup · hard

In one sentence

A benchmarking tool that tests machine translation models across 1000+ language pairs and scores their output against a public leaderboard.

Mindmap

mindmap
  root((repo))
    What it does
      Benchmarks translation models
      1000 plus language pairs
      Public leaderboard
    Tech stack
      Python
      vLLM
      GPU
    Use cases
      Evaluate translation model
      Compare to leaderboard
      Score with metrics
    Audience
      ML researchers
      NLP engineers
      Model developers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Benchmark a translation model locally on GPU or via an OpenAI-compatible API endpoint.

USE CASE 2

Score existing translation outputs using ChrF++, MetricX-24, and GlotLID metrics.

USE CASE 3

Submit a model's results to the public BOUQuET leaderboard via pull request.

What is it built with?

PythonvLLMGPU

How does it compare?

facebookresearch/bouquetaclark4life/home-depot-crawlashishdevasia/ha-proton-drive-backup
Stars666
LanguagePythonPythonPython
Last pushed2026-06-152014-08-10—
MaintenanceMaintainedDormant—
Setup difficultyhardmoderatemoderate
Complexity4/52/52/5
Audienceresearcherdeveloperops devops

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · hard Time to first run · 1h+

Requires a GPU for local inference or an API endpoint, plus cluster tooling for parallel runs.

No license information was found in the explanation.

Copy-paste prompts

Prompt 1
Help me run this BOUQuET benchmark against my own translation model using vLLM.
Prompt 2
Explain what ChrF++, MetricX-24, and GlotLID measure and why all three are used together.
Prompt 3
Show me how to plug a custom translation model into this tool's hackable interface.

Frequently asked questions

What is bouquet?

A benchmarking tool that tests machine translation models across 1000+ language pairs and scores their output against a public leaderboard.

What language is bouquet written in?

Mainly Python. The stack also includes Python, vLLM, GPU.

Is bouquet actively maintained?

Maintained — commit in last 6 months (last push 2026-06-15).

What license does bouquet use?

No license information was found in the explanation.

How hard is bouquet to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is bouquet for?

Mainly researcher.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.

What are similar repos?