Our great sponsors
-
sarama
Discontinued Sarama is a Go library for Apache Kafka. [Moved to: https://github.com/IBM/sarama]
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
Unlike the standard scripts, and many binary clients, it's a native, statically-compiled, binary. It uses segmentio/go-kafka internally, which means CGO can be disabled during compilation.
I've used mainly sarama wrapped with a bit of bespoke helper libraries. Never really looked into others, just grabbed one that was actively maintained and went for it.
For consuming/dumping data from kafka I found another Go tool, Benthos to be a really cool swiss-army-knife. It makes it very easy to throw together something that consumes from Kafka, decodes the payload as json, protobuf, avro or a bunch of other supported decoders, maybe does some data-mangling and dumps to stdout or some other kind of sink in some other supported format.