Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR. Learn more →
Top 14 Python task-queue Projects
-
Project mention: Show HN: PgQueuer – Transform Your PostgreSQL into a Powerful Job Queue | news.ycombinator.com | 2024-08-18
Most of the small python alternatives I've seen use Redis as backend:
- https://github.com/rq/rq
-
CodeRabbit
CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
-
-
-
-
Project mention: Do you need Redis? PostgreSQL does queuing, locking, and pub/sub | news.ycombinator.com | 2024-11-03
-
Project mention: Show HN: Hatchet – Open-source distributed task queue | news.ycombinator.com | 2024-03-08
-
django-q2
A multiprocessing distributed task queue for Django. Django Q2 is a fork of Django Q. Big thanks to Ilan Steemers for starting this project. Unfortunately, development has stalled since June 2021. Django Q2 is the new updated version of Django Q, with dependencies updates, docs updates and several bug fixes. Original repository: https://github.com/Koed00/django-q
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
rqmonitor
Flask based more dynamic and actionable frontend dashboard for monitoring Redis Queue 👩🏿💻 http://python-rq.org
-
-
django-tasks-scheduler
Schedule async tasks using redis protocol. Redis/ValKey/Dragonfly or any broker using the redis protocol can be used.
Project mention: django-rq-scheduler VS django-tasks-scheduler - a user suggested alternative | libhunt.com/r/django-rq-scheduler | 2023-12-15 -
python-task-queue
Asynchronous serverless task queue with timed leasing of tasks. Threaded implementations for SQS and local filesystem.
Project mention: Show HN: Drop-In SQS Replacement Based on SQLite | news.ycombinator.com | 2024-06-30This is very interesting! The self-hosted aspect is something I'll have to consider for certain purposes.
My lab also developed an SQS-esque system based on the filesystem, so no dependencies whatsoever and no need for any operational system other than the OS. It doesn't support all SQS commands (because we haven't needed them), but it also supports commands that SQS doesn't have (like release all messages to visible status).
https://github.com/seung-lab/python-task-queue
-
SmartPipeline
A framework for rapid development of robust data pipelines following a simple design pattern
-
Project mention: Kew – Task Queue That Runs Inside Your FastAPI Process | news.ycombinator.com | 2024-11-04
-
bq
BeanQueue, a lightweight Python task queue framework based on SQLAlchemy, PostgreSQL SKIP LOCKED queries and NOTIFY / LISTEN statements. (by LaunchPlatform)
I came across this GitHub issue discussing PostgreSQL as a potential Celery broker. This led me to discover an interesting alternative task queue called BQ, which is built specifically to use PostgreSQL for task management.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python task-queue discussion
Python task-queue related posts
-
Huey: A little task queue for Python
-
RQ: Simple Job Queues for Python
-
Running Procrastinate from command line throwing exception
-
Background jobs with Django
-
The Many Problems with Celery
-
Keep the Monolith, but Split the Workloads
-
django-rq VS django-q2 - a user suggested alternative
2 projects | 21 Mar 2023 -
A note from our sponsor - CodeRabbit
coderabbit.ai | 9 Dec 2024
Index
What are some of the best open-source task-queue projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | rq | 9,921 |
| 2 | flower | 6,507 |
| 3 | huey | 5,246 |
| 4 | django-rq | 1,847 |
| 5 | procrastinate | 880 |
| 6 | wakaq | 574 |
| 7 | django-q2 | 390 |
| 8 | rqmonitor | 189 |
| 9 | Celery-Kubernetes-Operator | 88 |
| 10 | django-tasks-scheduler | 62 |
| 11 | python-task-queue | 36 |
| 12 | SmartPipeline | 23 |
| 13 | kew | 16 |
| 14 | bq | 4 |
Sponsored
CodeRabbit: AI Code Reviews for Developers
Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
coderabbit.ai