kafka-go
Echo
Our great sponsors
kafka-go | Echo | |
---|---|---|
13 | 122 | |
7,104 | 28,466 | |
2.0% | 1.7% | |
7.3 | 8.0 | |
14 days ago | 7 days ago | |
Go | Go | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
kafka-go
-
book about golang and kafka
There are two main libraries that people use to write clients Confluent Kafka and segment io kafka
-
Klient - a native, statically-compiled, command line client for Kafka
Unlike the standard scripts, and many binary clients, it's a native, statically-compiled, binary. It uses segmentio/go-kafka internally, which means CGO can be disabled during compilation.
-
Is Kafka the Key? The Evolution of Highlight's Ingest
Scaling up our producers/consumers proved to be more cost-effective than adding more CPU/brokers to the Kafka cluster. To accomplish this, we used the segmentio/kafka-go client library which provides an excellent abstraction for interacting with the cluster and will handle data compression completely transparently.
-
Go EventSourcing and CQRS with PostgreSQL, Kafka, MongoDB and ElasticSearch πβ¨π«
PostgeSQL as event store database Kafka as messages broker gRPC Go implementation of gRPC Jaeger open source, end-to-end distributed tracing Prometheus monitoring and alerting Grafana for to compose observability dashboards with everything from Prometheus MongoDB MongoDB database Elasticsearch Elasticsearch client for Go. Echo web framework Kibana Kibana is data visualization dashboard software for Elasticsearch Migrate for migrations
-
Kafkagosaur - First release
I want to announce the first release of a kafkagosaur, a new Kafka client. It's built using WebAssembly and binds to the kafka-go library. The first release includes functionality to read and write Kafka messages and SASL support.
-
Switching from Celery and Python to Go
Use the Segment Kafka library, not Sarama, itβs much easier to use https://github.com/segmentio/kafka-go
-
I share my authentication server.
Kafaka - kafka-go, Debezium Outbox
-
Hunting down a C memory leak in a Go program
Segment learned quite some time ago that librdkafka-go has problems like these (and doesnβt support Contexts either), so they wrote a pure Go replacement instead. https://github.com/segmentio/kafka-go
-
Go, Kafka and gRPC clean architecture CQRS microservices with Jaeger tracing ππ§βπ»
In this article let's try to create closer to real world CQRS microservices with tracing and monitoring using: π Kafka as messages broker gRPC Go implementation of gRPC PostgreSQL as database Jaeger open source, end-to-end distributed tracing Prometheus monitoring and alerting Grafana for to compose observability dashboards with everything from Prometheus MongoDB Web and API based SMTP testing Redis Type-safe Redis client for Golang swag Swagger for Go Echo web framework
- confluent-kafka-go or Shopify/sarama
Echo
-
Go + Hypermedia - A Learning Journey (Part 1)
Echo - web framework for Go
-
Error handling in Go web apps shouldn't be so awkward
The three behaviors I've described that we want all depend on two things, the first of which is "idiomatic error handling". We need to be able to simply return err in our handlers. Unfortunately, the standard libray doesn't give us this. But some third-party frameworks do. The most popular one I'm familiar with is labstack echo, whose HandlerFunc looks like this:
-
Creating a Dockerfile for your Go Backend
In this tutorial, I will be using the Echo framework to build the backend. You can learn more about Echo here.
-
Microservices in Go Lang with Postgres (Local, Docker to Render Public hosting)
____ __ / __/___/ / ___ / _// __/ _ \/ _ \ /___/\__/_//_/\___/ v4.11.1 High performance, minimalist Go web framework https://echo.labstack.com ____________________________________O/_______ O\ β¨ http server started on [::]:8080
-
go-ecommerce-microservices: A practical e-commerce microservices, built with cqrs, event sourcing, vertical slice architecture, event-driven architecture.
Some of the features: - β Using Vertical Slice Architecture as a high level architecture - β Using Event Driven Architecture on top of RabbitMQ Message Broker with a custom [Event Bus](pkg/messaging/bus/) - β Using Event Sourcing in Audit Based services like [Orders Service](services/orders/) - β Using CQRS Pattern and Mediator Patternon top of Go-MediatR library - β Using Dependency Injection and Inversion of Controlon top of uber-go/fx library - β Using RESTFul api with Echo framework and using swagger with swaggo/swag library - β Using Postgres and EventStoreDB to write databases with fully supports transactions(ACID) - β Using MongoDB and Elastic Search for read databases (NOSQL) - β Using OpenTelemetry for collection Distributed Tracing with using Jaeger and Zipkin - β Using OpenTelemetry for collection Metrics with using Prometheus and Grafana - β Using Unit Test for testing small units with mocking dependent classes and using Mockery for mocking dependencies - β Using End2End Test and Integration Test for testing features with all of their real dependeinces using docker containers (cleanup tests) and testcontainers-go library
-
go for web backend
If you come from NodeJS background, you may find Echo (https://echo.labstack.com) most similar to express.
- What is the current ideal choice for server-side rendered web frameworks?
-
[OpenSource] I am building high performance Plex alternative in Go for Movies and TV Show
Can I try to rewrite it using the following? I'll just hand you the code I don't care about credit, I just enjoy cleaning things up. - https://github.com/spf13/cobra - https://echo.labstack.com/ - SQLite - and not a bunch of if statements
-
Could I get a code review?
Use a library for HTTP serving, such as Gin, Chi, or Echo. I personally use Chi, as it's just the right level of abstraction for how I like to work. Despite what others say here, don't try to re-implement everything in a modern serving library using the standard library.
-
It's so easy to learn
Here I'm not really sure what you're referring to: * You can set request timeout and it has nothing to do with whether you handled your error or not. * In most cases you either bubble it up the callstack or do something with error in place you o received it i.e. you switch to default value, retry or sth along those lines. In some cases frameworks like echo will translate error into 5XX response for you if you don't do anything with it in top level handler. * Panics are recoverable. Also in case your handler panics it won't crash entire server -> stdlib HTTP server just closes connection, frameworks might even provide panic handler which will return 5XX instead of nothing. * try/catch doesn't really solve anything I mentioned here Β―_(γ)_/Β―. You just hope somebody caught your exception somewhere else.
What are some alternatives?
sarama - Sarama is a Go library for Apache Kafka. [Moved to: https://github.com/IBM/sarama]
Gin - Gin is a HTTP web framework written in Go (Golang). It features a Martini-like API with much better performance -- up to 40 times faster. If you need smashing performance, get yourself some Gin.
Confluent Kafka Golang Client - Confluent's Apache Kafka Golang client
Fiber - β‘οΈ Express inspired web framework written in Go
franz-go - franz-go contains a feature complete, pure Go library for interacting with Kafka from 0.8.0 through 3.6+. Producing, consuming, transacting, administrating, etc.
mux - A powerful HTTP router and URL matcher for building Go web servers with π¦
retry-go - Simple golang library for retry mechanism
chi - lightweight, idiomatic and composable router for building Go HTTP services
kafka-rust - Rust client for Apache Kafka
Iris - The fastest HTTP/2 Go Web Framework. New, modern and easy to learn. Fast development with Code you control. Unbeatable cost-performance ratio :rocket:
cobra - A Commander for modern Go CLI interactions
Beego - beego is an open-source, high-performance web framework for the Go programming language.