What are your favorite tools or components in the Kafka ecosystem?

• kafka-ml

  1 177 5.7 Python

  Kafka-ML: connecting the data stream with ML/AI frameworks (now TensorFlow and PyTorch!)

  

  For example, CLIs, UIs, monitoring tools / integrations, cluster administration, stream processing libraries (Flink, Kafka Streams, smaller / newer libs), etc? Anything in the ML / AI space (e.g. a quick Google search came up with https://github.com/ertis-research/kafka-ml).

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• console

  5 3,884 9.8 TypeScript

  Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging. (by redpanda-data)

  

• materialize

  126 5,856 10.0 Rust

  The Cloud Operational Data Store: use SQL to transform, deliver, and act on fast-changing data. (by MaterializeInc)

  

• bytewax

  19 1,598 9.7 Python

  Python Stream Processing

  

• river

  18 5,162 8.8 Python

  🌊 Online machine learning in Python

  

  River - https://github.com/online-ml/river (Online machine learning, best used with Bytewax for Kafka integration)

• python-fake-data-producer-for-apache-kafka

  36 82 2.7 Python

  The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and push it to an Apache Kafka topic.

  

  Fake data utility - https://github.com/aiven/python-fake-data-producer-for-apache-kafka

• debezium

  83 10,930 9.9 Java

  Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

  

  Debezium: https://debezium.io/ (connector for cdc)

• datagen

  7 154 5.2 TypeScript

  Generate authentic looking mock data based on a SQL, JSON or Avro schema and produce to Kafka in JSON or Avro format.

  

  For fake data, shameless plug for https://github.com/MaterializeInc/datagen/tree/main

• conduktor-poc-kafka-protocol

  2 62 6.6 Java

  POC to demonstrate how to alter incoming/outgoing records in Kafka. It's a toy, don't use it in production.

  

  They also provide an open-source Kafka proxy which can be used to enhance Kafka with 'interceptors'.

• kloadgen

  1 209 2.8 Java

  KLoadGen is kafka load generator plugin for jmeter designed to work with AVRO, JSON and PROTOL-BUFFERS schema Registries. (by sngular)

  

  Sngular kloadgen for fake/synthetic data and load testing is great if you already use java/jmeter

Suggest a related project