What is aws-fluent-plugin-kinesis?

odudek/aws-fluent-plugin-kinesis — explained in plain English

Analysis updated 2026-07-18 · repo last pushed 2021-11-08

RubyAudience · ops devopsComplexity · 3/5DormantSetup · moderate

Mindmap

mindmap
  root((repo))
    What it does
      Fluentd output plugin
      Sends events to Kinesis
      Bridges logs to AWS
    Send modes
      Kinesis Streams
      Kinesis Firehose
      Aggregated streams
    Tech stack
      Ruby gem
      Fluentd config
      AWS SDK
    Use cases
      Log collection
      Real time analytics
      Long term storage
    Audience
      DevOps teams
      AWS server operators
      Container platforms

mindmap root((repo)) What it does Fluentd output plugin Sends events to Kinesis Bridges logs to AWS Send modes Kinesis Streams Kinesis Firehose Aggregated streams Tech stack Ruby gem Fluentd config AWS SDK Use cases Log collection Real time analytics Long term storage Audience DevOps teams AWS server operators Container platforms

What do people build with it?

USE CASE 1

Stream server logs from Fluentd into Kinesis Data Streams for real-time processing.

USE CASE 2

Auto-load event data into S3 or Redshift via Kinesis Firehose.

USE CASE 3

Batch small events together for more efficient delivery to AWS.

USE CASE 4

Feed Lambda functions or analytics pipelines with a continuous log stream.

What is it built with?

RubyFluentdAWS Kinesis

How does it compare?

	odudek/aws-fluent-plugin-kinesis	100rabhg/masterdetailapp	100rabhg/pizzafactroy
Language	Ruby	Ruby	Ruby
Last pushed	2021-11-08	2024-02-20	2025-01-26
Maintenance	Dormant	Dormant	Stale
Setup difficulty	moderate	moderate	moderate
Complexity	3/5	2/5	3/5
Audience	ops devops	developer	pm founder

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · moderate Time to first run · 30min

Requires an AWS account and Kinesis stream already set up, plus valid AWS credentials.

Copy-paste prompts

Prompt 1

Help me configure the aws-fluent-plugin-kinesis gem to send Fluentd logs to a Kinesis Data Stream using an EC2 instance role for authentication.

Prompt 2

Show me how to set up kinesis_firehose output in Fluentd so my events automatically land in S3.

Prompt 3

Walk me through tuning the batching and flush interval settings in this plugin for high-volume log traffic.

Prompt 4

Explain the difference between kinesis_streams, kinesis_firehose, and kinesis_streams_aggregated in this plugin so I can pick the right one for my logging pipeline.

Frequently asked questions