ov VS kafka-go

Many code reviews Upgrade code to respect new conventions. #111 ccoVeille posted on Apr 13, 2024 go.mod refers to 1.17, so we can use os.ReadFile and os.WriteFile instead of ioutil.ReadFile and ioutil.WriteFile that are now deprecated. We should use errors.As since go 1.13 otherwise any wrapped errors won't be caught. View on GitHub Use JSONL format for New Line Delimited JSON #112 ccoVeille posted on Apr 13, 2024 https://en.wikipedia.org/wiki/JSON_streaming View on GitHub receiver cleanup #522 ccoVeille posted on Apr 05, 2024 Refactor to use consistent parserState receiver Clean unused receivers View on GitHub Fix test helpers #523 ccoVeille posted on Apr 05, 2024 Test helpers should use t.Helper() This way if an error occurs it would be reported outside the helper View on GitHub

ov is a terminal pager. It supports only UTF-8.

There are two main libraries that people use to write clients Confluent Kafka and segment io kafka

Unlike the standard scripts, and many binary clients, it's a native, statically-compiled, binary. It uses segmentio/go-kafka internally, which means CGO can be disabled during compilation.

Scaling up our producers/consumers proved to be more cost-effective than adding more CPU/brokers to the Kafka cluster. To accomplish this, we used the segmentio/kafka-go client library which provides an excellent abstraction for interacting with the cluster and will handle data compression completely transparently.

PostgeSQL as event store database Kafka as messages broker gRPC Go implementation of gRPC Jaeger open source, end-to-end distributed tracing Prometheus monitoring and alerting Grafana for to compose observability dashboards with everything from Prometheus MongoDB MongoDB database Elasticsearch Elasticsearch client for Go. Echo web framework Kibana Kibana is data visualization dashboard software for Elasticsearch Migrate for migrations

I want to announce the first release of a kafkagosaur, a new Kafka client. It's built using WebAssembly and binds to the kafka-go library. The first release includes functionality to read and write Kafka messages and SASL support.

Use the Segment Kafka library, not Sarama, it’s much easier to use https://github.com/segmentio/kafka-go

Kafaka - kafka-go, Debezium Outbox

Segment learned quite some time ago that librdkafka-go has problems like these (and doesn’t support Contexts either), so they wrote a pure Go replacement instead. https://github.com/segmentio/kafka-go

In this article let's try to create closer to real world CQRS microservices with tracing and monitoring using: 🚀 Kafka as messages broker gRPC Go implementation of gRPC PostgreSQL as database Jaeger open source, end-to-end distributed tracing Prometheus monitoring and alerting Grafana for to compose observability dashboards with everything from Prometheus MongoDB Web and API based SMTP testing Redis Type-safe Redis client for Golang swag Swagger for Go Echo web framework