Top 14 Go worker-pool Projects

• ants

  3 11,355 0.0 Go

  🐜🐜🐜 ants is a high-performance and low-cost goroutine pool in Go./ ants 是一个高性能且低损耗的 goroutine 池。

  Project mention: Rust vs Go Issue | /r/rust | 2023-04-04

  I remember doing something similar to OP recently. Goroutines also incur a bit of overhead (have to be GC'd and so on), and the same worker pool technique can be applied to them in much the same way, as seen in popular libraries like https://github.com/panjf2000/ants

• Asynq

  13 7,692 0.0 Go

  Simple, reliable, and efficient distributed task queue in Go

  Project mention: Looking for a language agnostic Go task queue with Redis | /r/golang | 2023-09-12

  EDIT : I think the best for my case will be to use the asynq library with a custom js client, it's quite easy to implement (Detailed here)

• InfluxDB

  www.influxdata.com

  sponsored

  Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

  

• workerpool

  1 1,175 0.0 Go

  Concurrency limiting goroutine pool (by gammazero)

  Project mention: GO: How to Write a Worker Pool | dev.to | 2023-06-15

  This article will introduce one implementation approach for a Worker Pool and analyze the source code of a popular Worker Pool library, gammazero/workerpool. Finally, we will implement a similar Worker Pool called VIOLIN to gain a better understanding of Worker Pools.

• pond

  1 1,041 0.0 Go

  🔘 Minimalistic and High-performance goroutine worker pool written in Go

  Project mention: Help! channel vs workerpool | /r/golang | 2023-02-24

  https://github.com/alitto/pond i use this one :3

• neoq

  4 195 10.0 Go

  Queue-agnostic background job library for Go, with a pleasant API and powerful features.

  Project mention: Choose Postgres Queue Technology | news.ycombinator.com | 2023-09-24

  I just want to commend OP - if they’re here - for choosing an int64 for job IDs, and MD5 for hashing the payload in Neoq, the job library linked [0] from the article.

  Especially given the emphasis on YAGNI, you don’t need a UUID primary key, and all of its problems they bring for B+trees (that thing RDBMS is built on), nor do you need the collision resistance of SHA256 - the odds of you creating a dupe job hash with MD5 are vanishingly small.

  As to the actual topic, it’s fine IFF you carefully monitor for accumulating dead tuples, and adjust auto-vacuum for that table as necessary. While not something you’d run into at the start, at a modest scale you may start to see issues. May. You may also opt to switch to Redis or something else before that point anyway.

  [0]: https://github.com/acaloiaro/neoq

• itogami

  0 128 0.0 Go

  Fastest and most efficient goroutine pool (experimental)

• workerpool

  0 87 0.0 Go

  Go simple async worker pool

• Onboard AI

  getonboard.dev

  sponsored

  Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.

  

• gool

  1 69 10.0 Go

  Generic goroutine pool: Submit, Map, Async.

  Project mention: Yet Another Goroutine Pool - Simple Implementation, Generics | /r/golang | 2023-03-09

  GitHub Link: https://github.com/txaty/gool

• asyncjobs

  0 61 6.0 Go

  Asynchronous Job Processor

  

• gowl

  0 59 0.0 Go

  Gowl is a process management and process monitoring tool at once. An infinite worker pool gives you the ability to control the pool and processes and monitor their status.

• workerpool-go

  0 53 0.0 Go

  auto-scaling worker pool (work queue) in Go, using generics

• sworker

  0 6 1.8 Go

  Easy worker setup for your code

• violin

  1 4 10.0 Go

  VIOLIN worker/connection pool (by B1NARY-GR0UP)

  

  Project mention: GO: How to Write a Worker Pool | dev.to | 2023-06-15

  This article will introduce one implementation approach for a Worker Pool and analyze the source code of a popular Worker Pool library, gammazero/workerpool. Finally, we will implement a similar Worker Pool called VIOLIN to gain a better understanding of Worker Pools.

• gowp

  0 4 0.0 Go

  High performance, type safe, concurrency limiting worker pool package for golang! (by akshaybharambe14)

• SaaSHub

  www.saashub.com

  sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Go worker-pool related posts

• GO: How to Write a Worker Pool
  2 projects | dev.to | 15 Jun 2023
• Itogami, the best golang thread-pool till date
  5 projects | /r/golang | 15 Jun 2022
• octopool: A fast, resilient, easy-to-use worker pool for Go.
  1 project | /r/golang | 27 Jul 2021
• octopool: A fast, resilient, easy-to-use worker pool for Go.
  1 project | /r/golang | 27 Jul 2021
• Implementing Worker Pools in Go - Go Concurrency
  4 projects | /r/golang | 9 Jul 2021
• A note from our sponsor - #<SponsorshipServiceOld:0x00007f0fa19b1830>
  www.saashub.com | 30 Nov 2023

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Go projects with our weekly report!