kafdrop VS sarama

Kafdrop - https://github.com/obsidiandynamics/kafdrop

No mentions, and 1 open issue with a question 2) Kafka Drop https://github.com/obsidiandynamics/kafdrop

- https://github.com/prometheus/jmx_exporter - https://github.com/lightbend/kafka-lag-exporter (Export Kafka Topics Lag Metrics) - https://github.com/danielqsj/kafka_exporter (Export Kafka Metrics) - https://github.com/obsidiandynamics/kafdrop (Topic Administration tool - create/edit/delete topics & view messages)

Kafdrop (https://github.com/obsidiandynamics/kafdrop) is very popular and pretty solid. I'd start there. Kafka itself also comes with some cli tools and you can also extract metrics out of it via JMX/jolokia.

Kafdrop

Good kafka docker setup with enclouded UI is confluent, but it's had huge images size and will download a half of world wide internet to your local pc.🤖 For this reason here as UI client i used kafdrop

Kafdrop from Obsidian Dynamics (GitHub) => http://localhost:8082/

I've used mainly sarama wrapped with a bit of bespoke helper libraries. Never really looked into others, just grabbed one that was actively maintained and went for it.

Well, as someone who reviews a lot of code, I don't like seeing 100s of little files when a handful of logically grouped files would do. For example, this popular go project: https://github.com/Shopify/sarama is currently 256 small .go files, largely following a one class/file rule.

The first example is something we ran into while working on a project. Up until recently, the sarama library (Go library for Apache Kafka) contained the following piece of code (at sarama/version.go):

If you find the kafka input slow, try kafka_franz. It might be a bit faster, since it’s based on https://github.com/twmb/franz-go. The kafka one is based on https://github.com/Shopify/sarama. You can also write a custom input based on https://github.com/confluentinc/confluent-kafka-go, but this library relies on CGo, which can be annoying.

There are a few factors that are stopping me from using kafka-go over Shopify's sarama.

Here are our test results to find the root cause. https://github.com/Shopify/sarama/issues/1894#issuecomment-789427055

I suspect our issue is very much related to rebalancing and the consumer groups to adjust based on that. I followed what is suggested in this issue https://github.com/Shopify/sarama/issues/1685 to re-establish the session whenever it gets closed and it is been working out well for us. There has been little delay sometimes and I am still working on finding the root cause for session closure.

Then I found this Shopify/sarama#1310 which says you get the generation error when you are trying to commit from a closed session.