What kind of monitoring tools are people using for their Kafka Deployment?

• kafdrop

  4 4,374 8.6 Java

  Kafka Web UI

  

  - https://github.com/prometheus/jmx_exporter - https://github.com/lightbend/kafka-lag-exporter (Export Kafka Topics Lag Metrics) - https://github.com/danielqsj/kafka_exporter (Export Kafka Metrics) - https://github.com/obsidiandynamics/kafdrop (Topic Administration tool - create/edit/delete topics & view messages)

• jmx-monitoring-stacks

  0 175 6.1 Python

  

  A lot of folks use Prometheus. This repo has nice examples for different JMX monitoring stacks: - https://github.com/confluentinc/jmx-monitoring-stacks

• Sonar

  www.sonarsource.com

  sponsored

  Write Clean Java Code. Always.. Sonar helps you commit clean code every time. With over 600 unique rules to find Java bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.

  

• Telegraf

  34 12,659 9.9 Go

  The plugin-driven server agent for collecting & reporting metrics.

  

  We use Confluent's Control Center. It is great for debugging but sadly not really reliable/stable/performant. We also use https://jolokia.org/ combined with https://github.com/influxdata/telegraf/tree/master/plugins/inputs/jolokia2 and then you can send it anywhere you want (or multiple places). It is great if you have complex use cases or choose metrics selectively (you can filter topic names by regex, for example).

• jmx_exporter

  1 2,562 4.1 Java

  A process for exposing JMX Beans via HTTP for Prometheus consumption

  

  - https://github.com/prometheus/jmx_exporter - https://github.com/lightbend/kafka-lag-exporter (Export Kafka Topics Lag Metrics) - https://github.com/danielqsj/kafka_exporter (Export Kafka Metrics) - https://github.com/obsidiandynamics/kafdrop (Topic Administration tool - create/edit/delete topics & view messages)

• kafka-lag-exporter

  0 560 6.9 Scala

  Monitor Kafka Consumer Group Latency with Kafka Lag Exporter

  

  - https://github.com/prometheus/jmx_exporter - https://github.com/lightbend/kafka-lag-exporter (Export Kafka Topics Lag Metrics) - https://github.com/danielqsj/kafka_exporter (Export Kafka Metrics) - https://github.com/obsidiandynamics/kafdrop (Topic Administration tool - create/edit/delete topics & view messages)

• kafka_exporter

  0 1,683 8.3 Go

  Kafka exporter for Prometheus

  - https://github.com/prometheus/jmx_exporter - https://github.com/lightbend/kafka-lag-exporter (Export Kafka Topics Lag Metrics) - https://github.com/danielqsj/kafka_exporter (Export Kafka Metrics) - https://github.com/obsidiandynamics/kafdrop (Topic Administration tool - create/edit/delete topics & view messages)

• kafka-manager

  5 11,286 4.1 Scala

  CMAK is a tool for managing Apache Kafka clusters

  

• InfluxDB

  www.influxdata.com

  sponsored

  Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.

  

• akhq

  8 2,844 7.0 Java

  Kafka GUI for Apache Kafka to manage topics, topics data, consumers group, schema registry, connect and more...

Suggest a related project