django-postgres-queue
procrastinate
| django-postgres-queue | procrastinate | |
|---|---|---|
| 4 | 7 | |
| 116 | 739 | |
| - | 2.8% | |
| 0.0 | 9.6 | |
| 3 months ago | 8 days ago | |
| Python | Python | |
| BSD 2-clause "Simplified" License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
django-postgres-queue
-
Keep the Monolith, but Split the Workloads
If you're using PostgreSQL, then
django-postgres-queue: https://github.com/gavinwahl/django-postgres-queue
procrastinate: https://github.com/procrastinate-org/procrastinate/
- django-pgpubsub: A distributed task processing framework for Python built on top of the Postgres NOTIFY/LISTEN protocol.
-
Procrastinate: PostgreSQL-Based Task Queue for Python
I ran on Huey for a few years on a python/postgres ecosystem project fronted by Django, and ultimately migrated to django-postgres-queue, which is wonderful. (There has since been a fork that I have not used.) It uses the same underlying primitives as OP, and I would absolutely recommend this to anyone operating in the same ecosystem.
https://github.com/gavinwahl/django-postgres-queue
- Devious SQL: Message Queuing Using Native PostgreSQL
procrastinate
-
Running Procrastinate from command line throwing exception
I did find this PR which adds a much more detailed description of what to do, although some of it is a bit outdated.
- Anything can be a message queue if you use it wrongly enough
-
The Many Problems with Celery
What about https://github.com/procrastinate-org/procrastinate (postgresql task queue with transactions & stuff)
-
Keep the Monolith, but Split the Workloads
If you're using PostgreSQL, then
django-postgres-queue: https://github.com/gavinwahl/django-postgres-queue
procrastinate: https://github.com/procrastinate-org/procrastinate/
-
Issues/Experience with Procrastinate library for distributed tasks
We chose the Procrastinate library to run periodic tasks.
- Alchemical Queues: (task) queues on pure SQLAlchemy
- Grafana releases OnCall open source project
What are some alternatives?
pg-boss - Queueing jobs in Node.js using PostgreSQL like a boss
rq - Simple job queues for Python
redislite - Redis in a python module.
KQ - Kafka-based Job Queue for Python
dramatiq-pg
rele - Easy to use Google Pub/Sub
django-rq - A simple app that provides django integration for RQ (Redis Queue)
huey - a little task queue for python
packwerk - Good things come in small packages.
kombu - Messaging library for Python.
Que - A Ruby job queue that uses PostgreSQL's advisory locks for speed and reliability.
Streamz - Real-time stream processing for python