job-queue

Open-source projects categorized as job-queue
Edit details
Language: + Python + TypeScript + JavaScript + Go + Elixir + PHP + Ruby + Perl + Kotlin
Topics: Queue Redis Job Scheduler background-jobs task-queue
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
Sponsored

Top 23 job-queue Open-Source Projects

  • bull

    Premium Queue package for handling distributed jobs and messages in NodeJS.

    Project mention: Prioritizing Concurrent Requests: Queuing system to handle distributed processes and messages with NodeJS and Bull | dev.to | 2024-03-15

    To implement the solution with a queue, I used a package called 'Bull' (https://github.com/OptimalBits/bull). It's a library that helps with distributed job control, providing some very useful solutions for this type of work, such as background job processing, queues with priorities (FIFO, LIFO, and others), among other features. 'Bull' uses Redis for queue storage, so if your application crashes for any reason, once it's back online, it will continue executing the processes that are in the queue. In our case, we'll use the FIFO (First in, first out) queue solution, meaning priority based on arrival order.

  • rq

    Simple job queues for Python

    Project mention: Redis Re-Implemented with SQLite | news.ycombinator.com | 2024-04-14

    That's pretty cool. Reckon it would work with existing code that calls Redis over the wire for RQ?

      https://python-rq.org

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  • kue

    Kue is a priority job queue backed by redis, built for node.js.

  • Resque

    Resque is a Redis-backed Ruby library for creating background jobs, placing them on multiple queues, and processing them later.

  • skypilot

    SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.

    Project mention: Ask HN: Most efficient way to fine-tune an LLM in 2024? | news.ycombinator.com | 2024-04-04

  • Bee-Queue

    A simple, fast, robust job/task queue for Node.js, backed by Redis.

  • Enqueue

    Message Queue, Job Queue, Broadcasting, WebSockets packages for PHP, Symfony, Laravel, Magento. DEVELOPMENT REPOSITORY - provided by Forma-Pro

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  • django-rq

    A simple app that provides django integration for RQ (Redis Queue)

    Project mention: Background jobs with Django | /r/django | 2023-05-30

    For simple stuff, I tend to use https://github.com/rq/django-rq. Although scheduling tasks there does not work well in my experience. If I need something to run by schedule, than better just plain cron.

  • starter

    Opinionated SaaS quick-start with pre-built user account and organization system for full-stack application development in React, Node.js, GraphQL and PostgreSQL. Powered by PostGraphile, TypeScript, Apollo Client, Graphile Worker, Graphile Migrate, GraphQL Code Generator, Ant Design and Next.js

  • go-quartz

    Minimalist and zero-dependency scheduling library for Go

  • worker

    High performance Node.js/PostgreSQL job queue (also suitable for getting jobs generated by PostgreSQL triggers/functions out into a different work queue)

    Project mention: Postgres as Queue | news.ycombinator.com | 2024-02-09

    Big fan of Graphile Worker to handle this job. https://github.com/graphile/worker

  • exq

    Job processing library for Elixir - compatible with Resque / Sidekiq

  • honeydew

    Job Queue for Elixir. Clustered or Local. Straight BEAM. Optional Ecto. 💪🍈

  • que

    Simple Job Processing in Elixir with Mnesia :zap: (by sheharyarn)

  • RedisSMQ

    A simple high-performance Redis message queue for Node.js.

  • KQ

    Kafka-based Job Queue for Python

  • tork

    A distributed workflow engine

    Project mention: Show HN: A distributed workflow engine written in Go | news.ycombinator.com | 2023-10-01

  • laravel-job-status

    Add ability to track Job progress, status and result dispatched to Queue.

  • inngest-js

    The developer platform for easily building reliable workflows with zero infrastructure for TypeScript & JavaScript

    Project mention: Show HN: Hatchet – Open-source distributed task queue | news.ycombinator.com | 2024-03-08

    You might want to look at https://www.inngest.com for that. Disclaimer: I'm a cofounder. We released event-driven step functions about 20 months ago.

  • minion

    :octopus: Perl high performance job queue

  • rqmonitor

    Flask based more dynamic and actionable frontend dashboard for monitoring Redis Queue 👩🏿‍💻 http://python-rq.org

    Project mention: Idea's for creating tools for using redis! | /r/Database | 2023-06-29

  • kjob

    A lightweight coroutine based persistent job/cron scheduler written in Kotlin

  • valet

    Job queuing service and async task runner. (by svaloumas)

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-04-14.

job-queue related posts

Index

What are some of the best open-source job-queue projects? This list will help you:

Project Stars
1 bull 15,003
2 rq 9,481
3 kue 9,436
4 Resque 9,384
5 skypilot 5,551
6 Bee-Queue 3,602
7 Enqueue 2,148
8 django-rq 1,760
9 starter 1,697
10 go-quartz 1,636
11 worker 1,629
12 exq 1,473
13 honeydew 716
14 que 661
15 RedisSMQ 569
16 KQ 567
17 tork 460
18 laravel-job-status 396
19 inngest-js 346
20 minion 222
21 rqmonitor 184
22 kjob 79
23 valet 53

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com