Switching from Celery and Python to Go

1. gocelery

   1 6 2,430 0.0 Go

   Celery Distributed Task Queue in Go

   

   What about https://github.com/gocelery/gocelery ?

2. InfluxDB

   www.influxdata.com featured

   InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

   

3. kafka-go

   2 14 8,125 6.1 Go

   Kafka library in Go

   

   Use the Segment Kafka library, not Sarama, it’s much easier to use https://github.com/segmentio/kafka-go

4. taskq

   3 7 1,298 1.2 Go

   Golang asynchronous task/job queue with Redis, SQS, IronMQ, and in-memory backends

   

5. rmq

   4 3 1,597 4.3 Go

   Message queue system written in Go and backed by Redis

   

6. Benthos

   5 77 7,884 9.7 Go

   Discontinued Fancy stream processing made operationally mundane [Moved to: https://github.com/redpanda-data/connect]

   

   You might want to have a look at https://www.benthos.dev/. It has integrations with many brokers (such as RabbitMQ, Kafka, Redis, NATS etc.) and it's stateless. It provides a builtin DSL for structured message transformations called bloblang. It also handles batching and in-process parallelism, but it doesn't come with anything specific for scaling horizontally, so, depending on your use case, you might need to have some scheduler set up which spins up / down instances as needed.

7. Stream

   getstream.io featured

   Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.

   

Suggest a related project