Python task-queue

Open-source Python projects categorized as task-queue | Edit details
Related topics: #Redis #Python #background-jobs #job-queue #Queue

Top 5 Python task-queue Projects

  • GitHub repo rq

    Simple job queues for Python

    Project mention: Preventing multiple request for a long running process | reddit.com/r/flask | 2021-10-28

    For Queues, look into RQ Worker.

  • GitHub repo flower

    Real-time monitor and web admin for Celery distributed task queue

    Project mention: Wondering if I should use Celery vs threads for what I want to do | reddit.com/r/flask | 2021-08-12

    From experience i would not use threads for this or any background jobs. I would use Celery or Flask-RQ2 to be your workers, you will also probably end up using them to run other tasks as you encounter the need for other jobs. They both use Redis as a broker and job store and you can use Redis for other things like caching and so many other useful features. I kind of like RQ2 more then Celery because its a little simpler but Celery has a lot more to offer, more features. RQ2 has rq-dashboard for monitoring jobs and Celery has Flower.

  • Scout APM

    Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.

  • GitHub repo huey

    a little task queue for python

    Project mention: What is the best option for a (Python 3) task queue on Windows now that Celery 4 has dropped Windows support? | reddit.com/r/codehunter | 2021-12-11

    huey

  • GitHub repo django-rq

    A simple app that provides django integration for RQ (Redis Queue)

    Project mention: AWS vs Heroku Pricing | reddit.com/r/django | 2021-04-12

    Since you're already using Redis, if you use Django-RQ instead of Celery to queue background tasks you may be able to use your existing worker dyno to process background tasks.

  • GitHub repo Celery-Kubernetes-Operator

    An operator to manage celery clusters on Kubernetes (Work in Progress)

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2021-12-11.

Python task-queue related posts

Index

What are some of the best open-source task-queue projects in Python? This list will help you:

Project Stars
1 rq 8,092
2 flower 5,064
3 huey 3,788
4 django-rq 1,474
5 Celery-Kubernetes-Operator 57
Find remote jobs at our new job board 99remotejobs.com. There are 28 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.

Sponsored
OPS - Build and Run Open Source Unikernels
Quickly and easily build and deploy open source unikernels in tens of seconds. Deploy in any language to any cloud.
github.com/nanovms