Go task-queue

Open-source Go projects categorized as task-queue

Top 9 Go task-queue Projects

  • Asynq

    Simple, reliable, and efficient distributed task queue in Go

    Project mention: Looking for a language agnostic Go task queue with Redis | /r/golang | 2023-09-12

    EDIT : I think the best for my case will be to use the asynq library with a custom js client, it's quite easy to implement (Detailed here)

  • taskq

    Golang asynchronous task/job queue with Redis, SQS, IronMQ, and in-memory backends

    Project mention: What is the best task queue? | /r/golang | 2023-01-15

    Hi, I'm starting a new project that involves distributing task on different (and possibly distributed) workers in Golang. So I'm looking for the best task queue library to use; for now the ones I like are the following (in no particular order): - asynq - machinery - taskq

  • Onboard AI

    Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.

  • lmstfy

    A task queue with REST API

  • tork

    A distributed workflow engine

    Project mention: Show HN: A distributed workflow engine written in Go | news.ycombinator.com | 2023-10-01
  • neoq

    Queue-agnostic background job library for Go, with a pleasant API and powerful features.

    Project mention: Choose Postgres Queue Technology | news.ycombinator.com | 2023-09-24

    I just want to commend OP - if they’re here - for choosing an int64 for job IDs, and MD5 for hashing the payload in Neoq, the job library linked [0] from the article.

    Especially given the emphasis on YAGNI, you don’t need a UUID primary key, and all of its problems they bring for B+trees (that thing RDBMS is built on), nor do you need the collision resistance of SHA256 - the odds of you creating a dupe job hash with MD5 are vanishingly small.

    As to the actual topic, it’s fine IFF you carefully monitor for accumulating dead tuples, and adjust auto-vacuum for that table as necessary. While not something you’d run into at the start, at a modest scale you may start to see issues. May. You may also opt to switch to Redis or something else before that point anyway.

    [0]: https://github.com/acaloiaro/neoq

  • ratus

    Ratus is a RESTful asynchronous task queue server. It translated concepts of distributed task queues into a set of resources that conform to REST principles and provides a consistent HTTP API for various backends.

  • nq

    Cancellable, Efficient and Reliable Distributed Task Queue in Go (by DumbMachine)

  • InfluxDB

    Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

  • asyncjobs

    Asynchronous Job Processor

  • gohive

    🐝 A Highly Performant and easy to use goroutine pool for Go

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-10-01.

Go task-queue related posts


What are some of the best open-source task-queue projects in Go? This list will help you:

Project Stars
1 Asynq 7,735
2 taskq 1,165
3 lmstfy 729
4 tork 372
5 neoq 197
6 ratus 93
7 nq 90
8 asyncjobs 61
9 gohive 45
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives