pq
procrastinate
| pq | procrastinate | |
|---|---|---|
| 2 | 7 | |
| 365 | 739 | |
| - | 2.8% | |
| 4.5 | 9.6 | |
| 3 months ago | 4 days ago | |
| Python | Python | |
| - | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
pq
-
[Poll] Where do you store scraped data?
Local files are great for small projects though I'm a big fan of Postgres - it can do almost anything! I even used it as a scraping queue as you can lock and unlock rows, i.e. see pq
-
Grafana releases OnCall open source project
Here's the option I'm familiar with (siblings have others too):
https://github.com/malthe/pq
Doesn't have all the plumbing you'd want, there is a wrapper (https://github.com/bretth/django-pq/) that seems to give you an entrypoint command more like `celery worker ...` but I've not investigated it closely.
procrastinate
-
Running Procrastinate from command line throwing exception
I did find this PR which adds a much more detailed description of what to do, although some of it is a bit outdated.
- Anything can be a message queue if you use it wrongly enough
-
The Many Problems with Celery
What about https://github.com/procrastinate-org/procrastinate (postgresql task queue with transactions & stuff)
-
Keep the Monolith, but Split the Workloads
If you're using PostgreSQL, then
django-postgres-queue: https://github.com/gavinwahl/django-postgres-queue
procrastinate: https://github.com/procrastinate-org/procrastinate/
-
Issues/Experience with Procrastinate library for distributed tasks
We chose the Procrastinate library to run periodic tasks.
- Alchemical Queues: (task) queues on pure SQLAlchemy
- Grafana releases OnCall open source project
What are some alternatives?
goalert - Open source on-call scheduling, automated escalations, and notifications so you never miss a critical alert
rq - Simple job queues for Python
oncall - Developer-friendly incident response with brilliant Slack integration
KQ - Kafka-based Job Queue for Python
django-pq - [UNMAINTAINED] A task queue based on the elegant python RQ but with a django postgresql backend.
rele - Easy to use Google Pub/Sub
NPushOver - Full fledged, async, .Net Pushover client
huey - a little task queue for python
kombu - Messaging library for Python.
Streamz - Real-time stream processing for python
mrq - Mr. Queue - A distributed worker task queue in Python using Redis & gevent
qoo - A simple library for interacting with Amazon SQS.