Top 17 kafka-consumer Open-Source Projects

• librdkafka

  18 7,274 7.9 C

  The Apache Kafka C/C++ library

  

Project mention: Do you use Rust in your professional career? | /r/rust | 2023-05-09

recent PR: https://github.com/confluentinc/librdkafka/pull/4275

• Karafka

  3 1,967 9.6 Ruby

  Ruby and Rails efficient multithreaded Kafka processing framework

  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• cds

  1 953 0.0 Go

  Data syncing in golang for ClickHouse. (by zeromicro)

  

• parallel-consumer

  7 648 8.5 Java

  Parallel Apache Kafka client wrapper with per message ACK, client side queueing, a simpler consumer/producer API with key concurrency and extendable non-blocking IO processing.

  

• KQ

  1 567 0.0 Python

  Kafka-based Job Queue for Python

• racecar

  1 474 7.2 Ruby

  Racecar: a simple framework for Kafka consumers in Ruby

  

• trubka

  0 331 0.0 Go

  A CLI tool for Kafka

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• decaton

  1 315 6.9 Java

  High throughput asynchronous task processing on Apache Kafka

  

Project mention: RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1) | news.ycombinator.com | 2023-09-19

> You can stream messages into a buffer and process them in parallel, and commit the low watermark offset whenever it changes, as described above. I've implemented this in .NET with Channels and saturate the CPUs with no problem.

And there are libraries that will manage all this for you e.g. https://github.com/line/decaton

• kukulcan

  1 114 0.0 Scala

  A REPL for Apache Kafka

• eo-kafka

  2 26 9.0 Java

  EO Kafka Producers and consumers for working with Apache Kafka message broker

  

Project mention: EO Kafka Producers and consumers for working with Apache Kafka message broker | news.ycombinator.com | 2023-06-09

• Apache-Kafka-Guide

  1 24 3.6

  Apache Kafka Guide

• kafka-java-spring-boot-poc

  2 15 0.0 Java

  Kafka integration with Java Spring-boot with one application serving as a producer and the other consuming the messages

• kafka-example

  1 5 0.0 JavaScript

  Demonstration showing how to consume data from Kafka with Swim and how to turn that data into stateful web agents.

  

• go-generics-with-kafka

  1 2 0.0 Go

  Implement Kafka Topics Joiner With Golang

• TNG

  1 1 0.0 TypeScript

  📝 [Snippets] Typescript - Next.js/Nestjs - GraphQL

• kafkatop

  1 1 9.2 Python

  Monitor kafka consumer lags and event rates

Project mention: Show HN: CLI app to monitor consumption and production rates on Kafka broker | news.ycombinator.com | 2024-02-13

• atelier-spring-kafka

  1 0 5.5 Java

  Projet d'exemple d'utilisation de la lib `org.springframework.kafka:spring-kafka`

  

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

kafka-consumer related posts

• EO Kafka Producers and consumers for working with Apache Kafka message broker
  1 project | news.ycombinator.com | 9 Jun 2023
• JR, quality Random Data from the Command line, part I
  8 projects | dev.to | 7 May 2023
• A Critical Detail about Kafka Partitioners
  1 project | dev.to | 17 Apr 2023
• Optimizing Kafka Producers and Consumers
  1 project | /r/apachekafka | 31 Jan 2023
• Horizontally scaling Kafka consumers with rendezvous hashing
  3 projects | dev.to | 24 Jan 2023
• Events with same key going to different partitions
  1 project | /r/apachekafka | 23 Jan 2023
• Installing node-rdkafka on M1 for use with SASL
  3 projects | dev.to | 14 Oct 2022
• A note from our sponsor - WorkOS
  workos.com | 24 Apr 2024

  The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com