arq
saq
Our great sponsors
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
arq
- Future Plan for Arq
- The Many Problems with Celery
-
I made a simple async queueing framework called SAQ! It includes a built in web UI to manage jobs.
I need to process a lot of long running IO heavy jobs with background workers. I've been using ARQ for a while but decided to take a crack at writing my own distributed queue.
-
Boilerplates for integration services when you need to sync API resources or databases
Lately I've been writing asynchronous python code and yes, the resource integration problem has come again. Because now from version 1.4 SQLAlchemy has become asynchronous a new boilerplate was created. Now, as a scheduler, I took a completely asynchronous Arq. Considering the specifics of the service, long I/O operations, it seems that the service turned out to be more optimal in asynchronous execution. I haven't measured the performance yet, but I think I'll write another post about it.
saq
- Litestar – powerful, flexible, and highly performant Python ASGI framework
- The Many Problems with Celery
-
Sidewinder: open source Django starter kit that focuses on good defaults, developer experience, and deployment
Yet another async task queue, it's pretty fast and it's not celery: https://github.com/tobymao/saq
-
Celery in production: Three more years of fixing bugs
I wrote an extremely performant and simple async worker framework called SAQ because I couldn't find any that fit my use case.
https://github.com/tobymao/saq
- I made a simple async queueing framework called SAQ! It includes a built in web UI to manage jobs.
- Show HN: SAQ – Simple Async Queues in Python based on Redis (includes a web UI)
- SAQ (Simple Async Queues) - A distributed async python queuing framework based on Redis with a web UI
What are some alternatives?
celery - Distributed Task Queue (development branch)
rq - Simple job queues for Python
celery-sqlalchemy-boilerplate - Boilerplate for services with Celery, SQLAlchemy, Docker, Alembic and Pytest
huey - a little task queue for python
faust - Python Stream Processing. A Faust fork
blazingmq-sdk-python - Python SDK for BlazingMQ, a modern high-performance open source message queuing system.
Flask-RQ2 - A Flask extension for RQ.
redis-pydict - A python dictionary that uses Redis as in-memory storage backend to facilitate distributed computing applications development.
SQLAlchemy - The Database Toolkit for Python
sdk-python - Temporal Python SDK
think-async - 🌿 Exploring cooperative concurrency primitives in Python
arq-sqlalchemy-boilerplate