SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 job-queue Open-Source Projects
-
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
-
Resque
Resque is a Redis-backed Ruby library for creating background jobs, placing them on multiple queues, and processing them later.
-
skypilot
SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.
-
-
Enqueue
Message Queue, Job Queue, Broadcasting, WebSockets packages for PHP, Symfony, Laravel, Magento. DEVELOPMENT REPOSITORY - provided by Forma-Pro
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
-
starter
Opinionated SaaS quick-start with pre-built user account and organization system for full-stack application development in React, Node.js, GraphQL and PostgreSQL. Powered by PostGraphile, TypeScript, Apollo Client, Graphile Worker, Graphile Migrate, GraphQL Code Generator, Ant Design and Next.js
-
worker
High performance Node.js/PostgreSQL job queue (also suitable for getting jobs generated by PostgreSQL triggers/functions out into a different work queue)
-
inngest-js
The developer platform for easily building reliable workflows with zero infrastructure for TypeScript & JavaScript
-
-
rqmonitor
Flask based more dynamic and actionable frontend dashboard for monitoring Redis Queue 👩🏿💻 http://python-rq.org
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: Prioritizing Concurrent Requests: Queuing system to handle distributed processes and messages with NodeJS and Bull | dev.to | 2024-03-15To implement the solution with a queue, I used a package called 'Bull' (https://github.com/OptimalBits/bull). It's a library that helps with distributed job control, providing some very useful solutions for this type of work, such as background job processing, queues with priorities (FIFO, LIFO, and others), among other features. 'Bull' uses Redis for queue storage, so if your application crashes for any reason, once it's back online, it will continue executing the processes that are in the queue. In our case, we'll use the FIFO (First in, first out) queue solution, meaning priority based on arrival order.
That's pretty cool. Reckon it would work with existing code that calls Redis over the wire for RQ?
https://python-rq.org
Project mention: Ask HN: Most efficient way to fine-tune an LLM in 2024? | news.ycombinator.com | 2024-04-04
For simple stuff, I tend to use https://github.com/rq/django-rq. Although scheduling tasks there does not work well in my experience. If I need something to run by schedule, than better just plain cron.
Big fan of Graphile Worker to handle this job. https://github.com/graphile/worker
Oban, backed by PostgreSQL or SQLite, also provides a queue-based job processing system. Exq, on the other hand, is backed by Redis. It provides features similar to Flume, but without built-in rate limiting and batch processing capabilities.
Project mention: Show HN: A distributed workflow engine written in Go | news.ycombinator.com | 2023-10-01
Project mention: Show HN: Hatchet – Open-source distributed task queue | news.ycombinator.com | 2024-03-08You might want to look at https://www.inngest.com for that. Disclaimer: I'm a cofounder. We released event-driven step functions about 20 months ago.
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
job-queue related posts
- How to Use Flume in your Elixir Application
- Prioritizing Concurrent Requests: Queuing system to handle distributed processes and messages with NodeJS and Bull
- GitHub - graphile/worker: High performance Node.js/PostgreSQL job queue (also suitable for getting jobs generated by PostgreSQL triggers/functions out into a different work queue)
- High performance Node.js/PostgreSQL job queue
- PGMQ: Simple Message Queues Built on Postgres
- Instrumentation for Event Driven
- Redis master/slave setup on Kubernetes throwing error: BRPOPLPUSH { ReplyError: MOVED 2651
-
A note from our sponsor - SaaSHub
www.saashub.com | 28 Apr 2024
Index
What are some of the best open-source job-queue projects? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | bull | 15,039 |
| 2 | rq | 9,518 |
| 3 | kue | 9,433 |
| 4 | Resque | 9,388 |
| 5 | skypilot | 5,636 |
| 6 | Bee-Queue | 3,619 |
| 7 | Enqueue | 2,151 |
| 8 | django-rq | 1,766 |
| 9 | starter | 1,707 |
| 10 | go-quartz | 1,642 |
| 11 | worker | 1,641 |
| 12 | exq | 1,475 |
| 13 | honeydew | 716 |
| 14 | que | 661 |
| 15 | RedisSMQ | 571 |
| 16 | KQ | 567 |
| 17 | tork | 467 |
| 18 | laravel-job-status | 396 |
| 19 | inngest-js | 348 |
| 20 | minion | 222 |
| 21 | rqmonitor | 185 |
| 22 | kjob | 83 |
| 23 | valet | 54 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com