Benthos
franz-go
Our great sponsors
Benthos | franz-go | |
---|---|---|
76 | 16 | |
7,367 | 1,445 | |
3.7% | - | |
9.6 | 9.1 | |
5 days ago | about 18 hours ago | |
Go | Go | |
MIT License | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Benthos
- Ask HN: Who is hiring? (December 2023)
- Structured Logging with Slog
-
Any golang library to batch process a queue ?
I’ve used https://www.benthos.dev/ and it’s really easy and well implemented. The author is also very responsive
-
Show HN: Arroyo – Write SQL on streaming data
Looks cool. What is the difference between this tools and benthos (https://www.benthos.dev/)?
-
book about golang and kafka
You might want to gradually replace that one with https://github.com/twmb/franz-go because Shopify is looking to find a new owner for Sarama and, until or if they do, it seems to be falling behind with maintenance: https://github.com/Shopify/sarama/issues/2461 For example, they still haven’t addressed this breaking change https://github.com/Shopify/sarama/issues/2358. franz-go has worked well so far in Benthos https://github.com/benthosdev/benthos/tree/main/internal/impl/kafka and it will likely end up as the only implementation once the Sarama-based one will be deprecated
- Show HN: Open-source Auth0 alternative Ory Kratos v0.13 released – nearing v1.0
-
Seeking Feedback on Siddhi
Hi, I'm building a realtime analysis solution for our domain oriented microservice backend. All domain emit events in kafka. I'm looking for a solution to ingest data in an OLAP database based on processing those events (enrichment, filtering etc.). I found https://siddhi.io/ which looks promising. Since the last release (2019) the product is now part of WSo2 solution. I'm also looking at https://www.benthos.dev/. I'm more interested in a declarative solution than code.
-
Examples of Good Go Repos
Have a look at Benthos: https://github.com/benthosdev/benthos It's a data streaming processor written entirely in Go. /u/jeffail maintains it and he sometimes does code deep dives on his YouTube channel: https://www.youtube.com/c/Jeffail
-
Show HN: Crul –| Query Any Webpage or API
a schema with slightly different values, we are also using the awesome https://www.benthos.dev/!
- I want to participate in a golang open source projects. Have any suggestions or recommendations?
franz-go
-
Ingesting Data into OpenSearch using Apache Kafka and Go
Thankfully, Kafka and OpenSearch provide client libraries for a variety of programming languages which make it possible to write your own integration layer. This is exactly what's covered in this blog! We will make use of a custom Go application to ingest data using Go clients for Kafka and OpenSearch.
-
book about golang and kafka
You might want to gradually replace that one with https://github.com/twmb/franz-go because Shopify is looking to find a new owner for Sarama and, until or if they do, it seems to be falling behind with maintenance: https://github.com/Shopify/sarama/issues/2461 For example, they still haven’t addressed this breaking change https://github.com/Shopify/sarama/issues/2358. franz-go has worked well so far in Benthos https://github.com/benthosdev/benthos/tree/main/internal/impl/kafka and it will likely end up as the only implementation once the Sarama-based one will be deprecated
-
New Winner of Kafka Consumers: Scala to Go Journey
Can you post the code for that? Franz-go itself publishes benchmark samples for all clients here, so easy to run on your own machine and also review/adapt settings as needed: https://github.com/twmb/franz-go/tree/master/examples/bench
-
Use CDK to deploy a complete solution with Kafka, App Runner, EKS and DynamoDB
The MSK producer and consumer app use the franz-go library (it also supports MSK IAM authentication).
-
Getting started with MSK Serverless and AWS Lambda using Go
How to use the franz-go Go Kafka client to connect to MSK Serverless using IAM authentication.
-
Show HN: A native macOS client for Apache Kafka
Franz is a fairly obvious name for a Kafka related tool/library so hopefully it won't get confused with https://github.com/twmb/franz-go
-
Oracle DB support in Benthos
github.com/twmb/franz-go -> also early days but this is looking like a fantastic option for a kafka client library if you fancy being an early adopter. I've done the rounds on many kafka client libraries and they always seem to be a harsh compromise in some form or another, but I feel good about this one
-
Benthos - Fancy stream processing made operationally mundane
If you find the kafka input slow, try kafka_franz. It might be a bit faster, since it’s based on https://github.com/twmb/franz-go. The kafka one is based on https://github.com/Shopify/sarama. You can also write a custom input based on https://github.com/confluentinc/confluent-kafka-go, but this library relies on CGo, which can be annoying.
-
Which library/project do you wish was ported to golang?
Redpanda isn’t implemented in Go, but I second its use over the Apache server. Plenty of clients out there in pure go. https://github.com/twmb/franz-go is a personal favorite
What are some alternatives?
kafka-go - Kafka library in Go
sarama - Sarama is a Go library for Apache Kafka. [Moved to: https://github.com/IBM/sarama]
Confluent Kafka Golang Client - Confluent's Apache Kafka Golang client
appsmith - Platform to build admin panels, internal tools, and dashboards. Integrates with 25+ databases and any API.
watermill - Building event-driven applications the easy way in Go.
grpcui - An interactive web UI for gRPC, along the lines of postman
grpcurl - Like cURL, but for gRPC: Command-line tool for interacting with gRPC servers
salsa - A generic framework for on-demand, incrementalized computation. Inspired by adapton, glimmer, and rustc's query system.
script-server - Web UI for your scripts with execution management
azure-event-hubs-go - Golang client library for Azure Event Hubs https://azure.microsoft.com/services/event-hubs
go-jsonnet