What kind of monitoring tools are people using for their Kafka Deployment?

• kafdrop

  14 5,160 8.3 Java

  Kafka Web UI

  

  - https://github.com/prometheus/jmx_exporter - https://github.com/lightbend/kafka-lag-exporter (Export Kafka Topics Lag Metrics) - https://github.com/danielqsj/kafka_exporter (Export Kafka Metrics) - https://github.com/obsidiandynamics/kafdrop (Topic Administration tool - create/edit/delete topics & view messages)

• jmx-monitoring-stacks

  1 236 8.8 Shell

  📊 Monitoring examples for Confluent Cloud and Confluent Platform

  

  A lot of folks use Prometheus. This repo has nice examples for different JMX monitoring stacks: - https://github.com/confluentinc/jmx-monitoring-stacks

• WorkOS

  workos.com

  sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• Telegraf

  111 13,734 9.9 Go

  The plugin-driven server agent for collecting & reporting metrics.

  

  We use Confluent's Control Center. It is great for debugging but sadly not really reliable/stable/performant. We also use https://jolokia.org/ combined with https://github.com/influxdata/telegraf/tree/master/plugins/inputs/jolokia2 and then you can send it anywhere you want (or multiple places). It is great if you have complex use cases or choose metrics selectively (you can filter topic names by regex, for example).

• jmx_exporter

  8 2,889 8.0 Java

  A process for exposing JMX Beans via HTTP for Prometheus consumption

  

  - https://github.com/prometheus/jmx_exporter - https://github.com/lightbend/kafka-lag-exporter (Export Kafka Topics Lag Metrics) - https://github.com/danielqsj/kafka_exporter (Export Kafka Metrics) - https://github.com/obsidiandynamics/kafdrop (Topic Administration tool - create/edit/delete topics & view messages)

• kafka-lag-exporter

  2 633 0.0 Scala

  Discontinued Monitor Kafka Consumer Group Latency with Kafka Lag Exporter

  

  - https://github.com/prometheus/jmx_exporter - https://github.com/lightbend/kafka-lag-exporter (Export Kafka Topics Lag Metrics) - https://github.com/danielqsj/kafka_exporter (Export Kafka Metrics) - https://github.com/obsidiandynamics/kafdrop (Topic Administration tool - create/edit/delete topics & view messages)

• kafka_exporter

  2 2,016 4.9 Go

  Kafka exporter for Prometheus

  - https://github.com/prometheus/jmx_exporter - https://github.com/lightbend/kafka-lag-exporter (Export Kafka Topics Lag Metrics) - https://github.com/danielqsj/kafka_exporter (Export Kafka Metrics) - https://github.com/obsidiandynamics/kafdrop (Topic Administration tool - create/edit/delete topics & view messages)

• kafka-manager

  13 11,662 0.0 Scala

  CMAK is a tool for managing Apache Kafka clusters

  

• InfluxDB

  www.influxdata.com

  sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• akhq

  17 3,177 8.2 Java

  Kafka GUI for Apache Kafka to manage topics, topics data, consumers group, schema registry, connect and more...

Suggest a related project