Switching from Celery and Python to Go

• gocelery

  6 2,314 0.0 Go

  Celery Distributed Task Queue in Go

  

What about https://github.com/gocelery/gocelery ?

• kafka-go

  13 7,084 7.3 Go

  Kafka library in Go

  

Use the Segment Kafka library, not Sarama, it’s much easier to use https://github.com/segmentio/kafka-go

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• taskq

  7 1,199 0.0 Go

  Golang asynchronous task/job queue with Redis, SQS, IronMQ, and in-memory backends

• rmq

  3 1,476 5.6 Go

  Message queue system written in Go and backed by Redis

  

• Benthos

  76 7,516 9.6 Go

  Fancy stream processing made operationally mundane

  

You might want to have a look at https://www.benthos.dev/. It has integrations with many brokers (such as RabbitMQ, Kafka, Redis, NATS etc.) and it's stateless. It provides a builtin DSL for structured message transformations called bloblang. It also handles batching and in-process parallelism, but it doesn't come with anything specific for scaling horizontally, so, depending on your use case, you might need to have some scheduler set up which spins up / down instances as needed.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project