Go Kafka

Open-source Go projects categorized as Kafka

Top 23 Go Kafka Projects

  • sarama

    Sarama is a Go library for Apache Kafka. (by IBM)

  • Project mention: Shopify/sarama is now IBM/sarama | /r/golang | 2023-07-11
  • kubeshark

    The API traffic analyzer for Kubernetes providing real-time K8s protocol-level visibility, capturing and monitoring all traffic and payloads going in, out and across containers, pods, nodes and clusters. Inspired by Wireshark, purposely built for Kubernetes

  • Project mention: Show HN: Alaz: Open-Source, Self-Hosted, eBPF-Based K8s Monitoring | news.ycombinator.com | 2023-09-06

    The one similar product I had come across is Kubeshark (https://github.com/kubeshark/kubeshark). But admittedly the eBPF way seems more performant theoretically (given you can afford to have a modern-enough kernel). I'm really excited to see how this project develops out.

    The eBPF-mode of innovation is pretty exciting, truly a fresh lens to building software. I'm also following Akita Software - the company building an eBPF paradigm of monitoring.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • Benthos

    Fancy stream processing made operationally mundane

  • Project mention: Benthos – Fancy stream processing made operationally mundane | news.ycombinator.com | 2024-05-15
  • kafka-go

    Kafka library in Go

  • Project mention: book about golang and kafka | /r/golang | 2023-06-04

    There are two main libraries that people use to write clients Confluent Kafka and segment io kafka

  • watermill

    Building event-driven applications the easy way in Go.

  • Project mention: Microservices communication | /r/golang | 2023-12-09

    I’ve successfully worked on projects using an asynchronous event-driven way of connecting services. I really like the decoupling of business logic and the events triggering it. I highly recommend https://github.com/ThreeDotsLabs/watermill to be more flexible when it comes to choosing the actual technology driving the async patter. It might be NATS today but requirements might change and you need to change. Watermill prepares you for this.

  • Jocko

    Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native)

  • go-zero-looklook

    🔥基于go-zero(go zero) 微服务全技术栈开发最佳实践项目。Develop best practice projects based on the full technology stack of go zero (go zero) microservices.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • Gizmo

    A Microservice Toolkit from The New York Times

  • console

    Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging. (by redpanda-data)

  • Project mention: What are your favorite tools or components in the Kafka ecosystem? | /r/apachekafka | 2023-05-31
  • goka

    Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go.

  • vanus

    Vanus is a Serverless, event streaming system with processing capabilities. It easily connects SaaS, Cloud Services, and Databases to help users build next-gen Event-driven Applications.

  • plumber

    A swiss army knife CLI tool for interacting with Kafka, RabbitMQ and other messaging systems.

  • Project mention: plumber VS kaf - a user suggested alternative | libhunt.com/r/plumber | 2024-01-12
  • kafka_exporter

    Kafka exporter for Prometheus

  • go-streams

    A lightweight stream processing library for Go

  • peerdb

    Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

  • Project mention: PeerDB Streams – Simple, Native Postgres Change Data Capture | news.ycombinator.com | 2024-05-06
  • eventhorizon

    Event Sourcing for Go!

  • franz-go

    franz-go contains a feature complete, pure Go library for interacting with Kafka from 0.8.0 through 3.6+. Producing, consuming, transacting, administrating, etc.

  • Project mention: Ingesting Data into OpenSearch using Apache Kafka and Go | dev.to | 2023-07-13

    Thankfully, Kafka and OpenSearch provide client libraries for a variety of programming languages which make it possible to write your own integration layer. This is exactly what's covered in this blog! We will make use of a custom Go application to ingest data using Go clients for Kafka and OpenSearch.

  • gnomock

    Test your code without writing mocks with ephemeral Docker containers 📦 Setup popular services with just a couple lines of code ⏱️ No bash, no yaml, only code 💻

  • akvorado

    Flow collector, enricher and visualizer

  • Project mention: Free / OSS Tool for NetFlow Traffic Visualizer | /r/homelab | 2023-12-08
  • vFlow

    Enterprise Network Flow Collector (IPFIX, sFlow, Netflow)

  • go-stash

    go-stash is a high performance, free and open source server-side data processing pipeline that ingests data from Kafka, processes it, and then sends it to ElasticSearch.

  • openmeter

    Cloud Metering for AI, Billing and FinOps. Collect and aggregate millions of usage events in real-time.

  • Project mention: OpenMeter – open-source Realtime Metering | news.ycombinator.com | 2024-02-09
  • goflow

    The high-scalability sFlow/NetFlow/IPFIX collector used internally at Cloudflare.

  • Project mention: Integrating Cisco ASR with Splunk without Splunk Stream. | /r/Splunk | 2023-09-15

    I would greatly appreciate insights and recommendations from those who have experience in this area. Additionally, I'm interested in hearing your opinions on the best tool for this task: nProbe or goflow? Your rationale behind your recommendation would be invaluable.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Go Kafka related posts

  • Publish HTTPS Local Server Using Cloudflare

    1 project | dev.to | 21 May 2024
  • DNS as code

    3 projects | dev.to | 20 May 2024
  • How to tune Dapr bulk publish/subscribe for maximum throughput

    3 projects | dev.to | 14 Feb 2024
  • OpenMeter – open-source Realtime Metering

    1 project | news.ycombinator.com | 9 Feb 2024
  • plumber VS kaf - a user suggested alternative

    2 projects | 12 Jan 2024
  • Performance testing Kafka server using xk6-kafka

    1 project | dev.to | 1 Jan 2024
  • Eliminating additional bandwidth charges for multi-zone sites on Vercel

    1 project | dev.to | 22 Dec 2023
  • A note from our sponsor - SaaSHub
    www.saashub.com | 30 May 2024
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source Kafka projects in Go? This list will help you:

Project Stars
1 sarama 11,096
2 kubeshark 10,635
3 Benthos 7,724
4 kafka-go 7,205
5 watermill 6,818
6 Jocko 4,885
7 go-zero-looklook 4,101
8 Gizmo 3,757
9 console 3,622
10 goka 2,301
11 vanus 2,264
12 plumber 2,052
13 kafka_exporter 2,057
14 go-streams 1,770
15 peerdb 1,850
16 eventhorizon 1,553
17 franz-go 1,541
18 gnomock 1,313
19 akvorado 1,180
20 vFlow 1,066
21 go-stash 1,043
22 openmeter 925
23 goflow 832

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com