conduktor/kafka-stack-docker-compose — explained in plain English
Analysis updated 2026-05-18
Spin up a full Kafka cluster locally to test an application before deploying to production.
Experiment with multi-broker replication and failure handling using the multi-node configurations.
Try out Kafka Connect and ksqlDB for streaming data pipelines without cloud infrastructure.
Use the bundled Conduktor dashboard to visually inspect topics and messages.
| conduktor/kafka-stack-docker-compose | ful1e5/bibata_cursor | wsa-community/wsagascript | |
|---|---|---|---|
| Stars | 3,622 | 3,622 | 3,622 |
| Language | Shell | Shell | Shell |
| Setup difficulty | moderate | easy | hard |
| Complexity | 3/5 | 1/5 | 4/5 |
| Audience | ops devops | general | ops devops |
Figures from each repo's GitHub metadata at analysis time.
Requires Docker and Docker Compose installed locally, some configurations need port and environment adjustments to expose Kafka externally.
This project provides ready-to-use configuration files that spin up a complete Apache Kafka environment on your local machine using Docker. Kafka is a messaging system used by applications to send and receive large streams of data between services, commonly used in backend infrastructure at companies. Setting it up correctly from scratch involves several moving parts and networking configuration that can be frustrating to get right. This repository solves that by bundling everything into a single command. Several different configurations are offered depending on what you want to test. The simplest option runs one Kafka instance and one coordination service alongside a management dashboard. More advanced options scale up to three Kafka brokers and three coordination nodes, which lets you experiment with how Kafka handles server failures and data replication. There is also a modern configuration that runs Kafka without the coordination service at all, using a newer built-in mode that Kafka introduced more recently. Beyond the messaging layer, the full configuration includes a Schema Registry for enforcing data formats, a REST Proxy for accessing Kafka over HTTP, a Kafka Connect service for linking Kafka to external databases, and a query engine called ksqlDB for running SQL-style queries against streaming data. A visual management tool from Conduktor, the company that sponsors this project, is also included and accessible at a web browser on port 8080. Starting any configuration is a single docker compose command. Stopping it is the same command with down instead of up. The README includes a FAQ covering common questions like reducing disk usage during testing, changing ports, exposing the cluster to machines on the network, and adding database connectors. The project is maintained by Conduktor and has accumulated over 3,600 stars. It targets developers who want a realistic local Kafka setup without manually wiring together configuration files.
Ready-made Docker Compose files that spin up a full local Apache Kafka environment with one command.
Mainly Shell. The stack also includes Docker Compose, Apache Kafka, Zookeeper.
No license information is provided in this repository.
Setup difficulty is rated moderate, with roughly 30min to a first successful run.
Mainly ops devops.
This repo across BitVibe Labs
Verify against the repo before relying on details.