Top 9 Go task-queue Projects

Asynq

12 7,735 0.0 Go

Simple, reliable, and efficient distributed task queue in Go

Project mention: Looking for a language agnostic Go task queue with Redis | /r/golang | 2023-09-12

EDIT : I think the best for my case will be to use the asynq library with a custom js client, it's quite easy to implement (Detailed here)
taskq

1 1,165 0.0 Go

Golang asynchronous task/job queue with Redis, SQS, IronMQ, and in-memory backends

Project mention: What is the best task queue? | /r/golang | 2023-01-15

Hi, I'm starting a new project that involves distributing task on different (and possibly distributed) workers in Golang. So I'm looking for the best task queue library to use; for now the ones I like are the following (in no particular order): - asynq - machinery - taskq
Onboard AI

getonboard.dev
sponsored

Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.
lmstfy

0 729 0.0 Go

A task queue with REST API
tork

4 372 10.0 Go

A distributed workflow engine

Project mention: Show HN: A distributed workflow engine written in Go | news.ycombinator.com | 2023-10-01
neoq

4 197 10.0 Go

Queue-agnostic background job library for Go, with a pleasant API and powerful features.

Project mention: Choose Postgres Queue Technology | news.ycombinator.com | 2023-09-24

I just want to commend OP - if they’re here - for choosing an int64 for job IDs, and MD5 for hashing the payload in Neoq, the job library linked [0] from the article.
Especially given the emphasis on YAGNI, you don’t need a UUID primary key, and all of its problems they bring for B+trees (that thing RDBMS is built on), nor do you need the collision resistance of SHA256 - the odds of you creating a dupe job hash with MD5 are vanishingly small.
As to the actual topic, it’s fine IFF you carefully monitor for accumulating dead tuples, and adjust auto-vacuum for that table as necessary. While not something you’d run into at the start, at a modest scale you may start to see issues. May. You may also opt to switch to Redis or something else before that point anyway.
[0]: https://github.com/acaloiaro/neoq
ratus

0 93 10.0 Go

Ratus is a RESTful asynchronous task queue server. It translated concepts of distributed task queues into a set of resources that conform to REST principles and provides a consistent HTTP API for various backends.
nq

0 90 10.0 Go

Cancellable, Efficient and Reliable Distributed Task Queue in Go (by DumbMachine)
InfluxDB

www.influxdata.com
sponsored

Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
asyncjobs

0 61 5.9 Go

Asynchronous Job Processor
gohive

0 45 0.0 Go

🐝 A Highly Performant and easy to use goroutine pool for Go

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-10-01.