Looking for a mature distributed task queuer/scheduler in go

• machinery

  14 7,292 5.3 Go

  Machinery is an asynchronous task queue/job queue based on distributed message passing.

• curlyq

  1 127 10.0 Go

  Efficient and reliable background processing for Go

I use mcmathja/curlyq and found it pretty reliable. This is the queue I use for Djinn CI an open source CI platform I developed.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• djinn

  20 39 7.1 Go

  Source code for the Djinn CI platform (by djinn-ci)

  

I use mcmathja/curlyq and found it pretty reliable. This is the queue I use for Djinn CI an open source CI platform I developed.

• proposals

  60 63 4.0

  Temporal proposals (by temporalio)

  

Give Temporal a look https://temporal.io/

• temporalite-archived

  6 608 3.3 Go

  Discontinued An experimental distribution of Temporal that runs as a single process

  

If you don't need to scale horizontally, you may be able to get away with https://github.com/temporalio/temporalite and SQLite backed up via Litestream. We leverage Temporalite in our CI tests and for local development, it's an excellent lightweight version.

• watermill

  23 6,729 6.5 Go

  Building event-driven applications the easy way in Go.

  

Checkout https://watermill.io/

• NATS

  106 14,720 9.8 Go

  High-Performance server for NATS.io, the cloud and edge native messaging system.

  

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• delayq

  4 39 1.7 Go

  DelayQ is a Go library that provides a performant, reliable, distributed delay-queue using Redis.

I built https://github.com/spy16/delayq which may or may not be helpful. Mentioning anyway. (It's uses redis, so in terms of durability whatever redise can guarantee applies.)

• gueron

  1 6 7.6 Go

  Cron jobs scheduler and runner backed by github.com/vgarvardt/gue

• avail

  2 3 1.6 Go

  Allows the representation of a time frame using common cron syntax and then efficiently checks whether a given time exists within that time frame. (by clintjedwards)

I've since just used a combination of different cron libraries and goroutinues.

• Asynq

  32 8,615 7.0 Go

  Simple, reliable, and efficient distributed task queue in Go

Suggest a related project