SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 kafka-client Open-Source Projects
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
flogo
Project Flogo is an open source ecosystem of opinionated event-driven capabilities to simplify building efficient & modern serverless functions, microservices & edge apps.
-
franz-go
franz-go contains a feature complete, pure Go library for interacting with Kafka from 0.8.0 through 3.6+. Producing, consuming, transacting, administrating, etc.
-
Reactive-kafka
Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.
-
ksql-udf-deep-learning-mqtt-iot
Deep Learning UDF for KSQL for Streaming Anomaly Detection of MQTT IoT Sensor Data
-
java-specialagent
Automatic instrumentation for 3rd-party libraries in Java applications with OpenTracing.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
There are two main libraries that people use to write clients Confluent Kafka and segment io kafka
There are two main libraries that people use to write clients Confluent Kafka and segment io kafka
Project mention: Show HN: Confluent Kafka support added to FastStream v0.4.0rc0 | news.ycombinator.com | 2024-01-12Responding to popular demand, the latest 0.4.0rc0 version introduces support for Kafka stream processing using Confluent Kafka's Python library - https://github.com/confluentinc/confluent-kafka-python.
I will use the KafkaJS library to achieve it quickly. Let’s just paste the code here.
https://collectd.org/ does the gathering (and writing to RRDTool database, if you so desire) part very well. Many plugins, easy to add more (just return one line of text)
Still need RRD viewere but that's not a huge stack
And it scales all the way to hundreds of hosts, as on top of network send/receive of stats it supports few other write formats aside from just RRD files.
Project mention: Walmart is migrating the remaining F# code into Java | news.ycombinator.com | 2024-03-04- Missing features or those that lag behind: https://github.com/confluentinc/confluent-kafka-dotnet/issue...
Thankfully, Kafka and OpenSearch provide client libraries for a variety of programming languages which make it possible to write your own integration layer. This is exactly what's covered in this blog! We will make use of a custom Go application to ingest data using Go clients for Kafka and OpenSearch.
Project mention: Rust Cpp Interop via Cxx, Autocxx / any best practices out there | /r/rust | 2023-06-19I use this library a lot and it's got some nice touches for how to handle wrapping a C library: https://github.com/fede1024/rust-rdkafka
Project mention: FastStream: Python's framework for Efficient Message Queue Handling | dev.to | 2023-10-16Our journey with FastStream started when we needed to integrate our machine learning models into a customer's Apache Kafka environment. To streamline this process, we created FastKafka using AIOKafka, AsyncAPI, and asyncio. It was our first step in making message queue management easier.
Project mention: Show HN: Kafbat UI for Apache Kafka v1.0 is out | news.ycombinator.com | 2024-03-22
kafka-client related posts
- Franz: Native Kafka Client for macOS, Windows and Linux
- Show HN: Confluent Kafka support added to FastStream v0.4.0rc0
-
confluent-kafka-python VS quix-streams - a user suggested alternative
2 projects | 7 Dec 2023
- Track every PostgreSQL data change using Debezium
- Ingesting Data into OpenSearch using Apache Kafka and Go
- Rust Cpp Interop via Cxx, Autocxx / any best practices out there
- Improving Kafka interfaces
-
A note from our sponsor - SaaSHub
www.saashub.com | 25 Apr 2024
Index
What are some of the best open-source kafka-client projects? This list will help you:
Project | Stars | |
---|---|---|
1 | sarama | 10,975 |
2 | kafka-ui | 8,458 |
3 | kafka-go | 7,104 |
4 | Confluent Kafka Golang Client | 4,426 |
5 | confluent-kafka-python | 3,632 |
6 | kafkajs | 3,585 |
7 | Collectd | 2,982 |
8 | Confluent's .NET Client for Apache KafkaTM | 2,737 |
9 | flogo | 2,365 |
10 | php-rdkafka | 2,034 |
11 | Karafka | 1,972 |
12 | franz-go | 1,481 |
13 | rust-rdkafka | 1,477 |
14 | Reactive-kafka | 1,418 |
15 | ruby-kafka | 1,261 |
16 | aiokafka | 1,043 |
17 | kafkaflow | 575 |
18 | KQ | 567 |
19 | jackdaw | 368 |
20 | kafka-ui | 291 |
21 | fs2-kafka | 286 |
22 | ksql-udf-deep-learning-mqtt-iot | 284 |
23 | java-specialagent | 185 |
Sponsored