whatisgithub

What is kafka-stack-docker-compose?

conduktor/kafka-stack-docker-compose — explained in plain English

Analysis updated 2026-05-18

3,622ShellAudience · ops devopsComplexity · 3/5Setup · moderate

In one sentence

Ready-made Docker Compose files that spin up a full local Apache Kafka environment with one command.

Mindmap

mindmap
  root((kafka-stack-docker-compose))
    What it does
      Local Kafka via Docker Compose
      Multiple broker configurations
      Includes management UI
    Tech stack
      Docker Compose
      Apache Kafka
      Zookeeper
      Conduktor Platform
    Use cases
      Test Kafka replication locally
      Prototype Kafka Connect pipelines
      Learn Kafka without cloud setup
    Audience
      Developers
      DevOps engineers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Spin up a full Kafka cluster locally to test an application before deploying to production.

USE CASE 2

Experiment with multi-broker replication and failure handling using the multi-node configurations.

USE CASE 3

Try out Kafka Connect and ksqlDB for streaming data pipelines without cloud infrastructure.

USE CASE 4

Use the bundled Conduktor dashboard to visually inspect topics and messages.

What is it built with?

Docker ComposeApache KafkaZookeeperksqlDB

How does it compare?

conduktor/kafka-stack-docker-composeful1e5/bibata_cursorwsa-community/wsagascript
Stars3,6223,6223,622
LanguageShellShellShell
Setup difficultymoderateeasyhard
Complexity3/51/54/5
Audienceops devopsgeneralops devops

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · moderate Time to first run · 30min

Requires Docker and Docker Compose installed locally, some configurations need port and environment adjustments to expose Kafka externally.

No license information is provided in this repository.

So what is it?

This project provides ready-to-use configuration files that spin up a complete Apache Kafka environment on your local machine using Docker. Kafka is a messaging system used by applications to send and receive large streams of data between services, commonly used in backend infrastructure at companies. Setting it up correctly from scratch involves several moving parts and networking configuration that can be frustrating to get right. This repository solves that by bundling everything into a single command. Several different configurations are offered depending on what you want to test. The simplest option runs one Kafka instance and one coordination service alongside a management dashboard. More advanced options scale up to three Kafka brokers and three coordination nodes, which lets you experiment with how Kafka handles server failures and data replication. There is also a modern configuration that runs Kafka without the coordination service at all, using a newer built-in mode that Kafka introduced more recently. Beyond the messaging layer, the full configuration includes a Schema Registry for enforcing data formats, a REST Proxy for accessing Kafka over HTTP, a Kafka Connect service for linking Kafka to external databases, and a query engine called ksqlDB for running SQL-style queries against streaming data. A visual management tool from Conduktor, the company that sponsors this project, is also included and accessible at a web browser on port 8080. Starting any configuration is a single docker compose command. Stopping it is the same command with down instead of up. The README includes a FAQ covering common questions like reducing disk usage during testing, changing ports, exposing the cluster to machines on the network, and adding database connectors. The project is maintained by Conduktor and has accumulated over 3,600 stars. It targets developers who want a realistic local Kafka setup without manually wiring together configuration files.

Copy-paste prompts

Prompt 1
Explain the difference between the single-broker and multi-broker docker compose files in this repo.
Prompt 2
Walk me through starting the full Kafka stack and connecting to it from my application.
Prompt 3
Help me reduce Kafka's disk usage for local testing using the settings in this README.
Prompt 4
Show me how to add a Kafka Connect connector using this docker compose setup.

Frequently asked questions

What is kafka-stack-docker-compose?

Ready-made Docker Compose files that spin up a full local Apache Kafka environment with one command.

What language is kafka-stack-docker-compose written in?

Mainly Shell. The stack also includes Docker Compose, Apache Kafka, Zookeeper.

What license does kafka-stack-docker-compose use?

No license information is provided in this repository.

How hard is kafka-stack-docker-compose to set up?

Setup difficulty is rated moderate, with roughly 30min to a first successful run.

Who is kafka-stack-docker-compose for?

Mainly ops devops.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.