django-pq
procrastinate
| django-pq | procrastinate | |
|---|---|---|
| 1 | 7 | |
| 68 | 739 | |
| - | 2.8% | |
| 10.0 | 9.6 | |
| over 9 years ago | 3 days ago | |
| Python | Python | |
| BSD 2-clause "Simplified" License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
django-pq
-
Grafana releases OnCall open source project
Here's the option I'm familiar with (siblings have others too):
https://github.com/malthe/pq
Doesn't have all the plumbing you'd want, there is a wrapper (https://github.com/bretth/django-pq/) that seems to give you an entrypoint command more like `celery worker ...` but I've not investigated it closely.
procrastinate
-
Running Procrastinate from command line throwing exception
I did find this PR which adds a much more detailed description of what to do, although some of it is a bit outdated.
- Anything can be a message queue if you use it wrongly enough
-
The Many Problems with Celery
What about https://github.com/procrastinate-org/procrastinate (postgresql task queue with transactions & stuff)
-
Keep the Monolith, but Split the Workloads
If you're using PostgreSQL, then
django-postgres-queue: https://github.com/gavinwahl/django-postgres-queue
procrastinate: https://github.com/procrastinate-org/procrastinate/
-
Issues/Experience with Procrastinate library for distributed tasks
We chose the Procrastinate library to run periodic tasks.
- Alchemical Queues: (task) queues on pure SQLAlchemy
- Grafana releases OnCall open source project
What are some alternatives?
pq - A PostgreSQL job queueing system
rq - Simple job queues for Python
goalert - Open source on-call scheduling, automated escalations, and notifications so you never miss a critical alert
KQ - Kafka-based Job Queue for Python
rele - Easy to use Google Pub/Sub
huey - a little task queue for python
kombu - Messaging library for Python.
Streamz - Real-time stream processing for python
mrq - Mr. Queue - A distributed worker task queue in Python using Redis & gevent
qoo - A simple library for interacting with Amazon SQS.
simpleq - A simple, infinitely scalable, SQS based queue.
arq - Fast job queuing and RPC in python with asyncio and redis.