whatisgithub

What is local-meetups?

gardnervickers/local-meetups — explained in plain English

Analysis updated 2026-07-09 · repo last pushed 2016-02-04

ClojureAudience · developerComplexity · 4/5DormantSetup · hard

In one sentence

A starter template for building distributed data processing pipelines in Clojure using the Onyx framework, with pre-configured development and production setups so you can focus on your workflow logic.

Mindmap

mindmap
  root((repo))
    What it does
      Distributed data processing
      Pipeline of tasks
      Multi-machine cluster support
    Tech stack
      Clojure
      Onyx framework
      ZooKeeper
      Kafka
      MySQL
    Use cases
      Data pipeline prototyping
      Cluster data processing
      Dev to production transition
    Setup
      Dev uses local files
      Prod uses Kafka and MySQL
      One peer per CPU core
    Audience
      Clojure developers
      Distributed systems builders
Click or tap to explore — scroll the page freely

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Prototype a distributed data pipeline in Clojure with local files before deploying to production.

USE CASE 2

Build a cluster-based data processing system that reads from Kafka and writes to MySQL.

USE CASE 3

Use as a reference template for structuring Onyx jobs with separate development and production configurations.

USE CASE 4

Learn tested patterns for Onyx job definition, peer management, and environment lifecycle handling.

What is it built with?

ClojureOnyxZooKeeperKafkaMySQL

How does it compare?

gardnervickers/local-meetupsgardnervickers/untangled-componentsreplikativ/katzen
Stars16
LanguageClojureClojureClojure
Last pushed2016-02-042016-10-19
MaintenanceDormantDormant
Setup difficultyhardmoderateeasy
Complexity4/52/53/5
Audiencedeveloperdeveloperdeveloper

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · hard Time to first run · 1h+

Requires ZooKeeper running for coordination and, in production mode, Kafka and MySQL infrastructure alongside cluster configuration.

No license information is provided in this repository, so you should contact the author before using it.

So what is it?

Local-meetups is a starter template for building distributed data processing applications using a framework called Onyx. Rather than starting from scratch, you get a sample job and a set of helper tools already wired up, so you can focus on building your actual workflow instead of figuring out how to set up the infrastructure. At its core, the project helps you move data through a pipeline of tasks that can run across multiple machines. During development, you work with static files and simple input/output channels on your local machine. A built-in macro handles starting and stopping the processing environment, including cleanup if something fails or you interrupt it. When you're ready for production, you flip a switch that swaps those simple file-based inputs and outputs for real data sources like a Kafka message queue and a MySQL database. This project is aimed at Clojure developers who want to build systems that process data across a cluster of computers. The name suggests it could be used to organize or process data related to local meetups, but the README doesn't go into detail about a specific end product. Instead, it's positioned as a general starting point for anyone building Onyx-based data pipelines who wants tested patterns for development and deployment. One notable design choice is how the project separates development from production. The same job definition works in both contexts, with only a keyword change determining whether it reads from a local file or pulls from a production database. In production, you can run multiple processing peers on a single machine, with a recommendation of one peer per CPU core. The system relies on ZooKeeper to coordinate between machines, which is standard for distributed systems but adds operational complexity to deployment.

Copy-paste prompts

Prompt 1
Help me set up the local-meetups Clojure project. I have ZooKeeper running locally, walk me through getting the sample Onyx job running with the development profile that uses local file input and output.
Prompt 2
I want to modify the local-meetups template to read from a Kafka topic instead of a local file in production. Show me how to change the keyword that switches from dev to prod mode and configure the Kafka peer configuration.
Prompt 3
Using the local-meetups Onyx template as a base, help me design a data processing pipeline that reads events from a Kafka queue, transforms them with a custom Clojure function, and writes results to a MySQL database.
Prompt 4
Explain how the local-meetups project handles starting and stopping the Onyx processing environment, and help me add a new task to the existing job pipeline that filters out invalid records.

Frequently asked questions

What is local-meetups?

A starter template for building distributed data processing pipelines in Clojure using the Onyx framework, with pre-configured development and production setups so you can focus on your workflow logic.

What language is local-meetups written in?

Mainly Clojure. The stack also includes Clojure, Onyx, ZooKeeper.

Is local-meetups actively maintained?

Dormant — no commits in 2+ years (last push 2016-02-04).

What license does local-meetups use?

No license information is provided in this repository, so you should contact the author before using it.

How hard is local-meetups to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is local-meetups for?

Mainly developer.

Open on GitHub → Ask about another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.