think-async
Joblib
Our great sponsors
| think-async | Joblib | |
|---|---|---|
| 4 | 2 | |
| 222 | 3,656 | |
| - | 2.0% | |
| 7.8 | 7.0 | |
| 3 months ago | 10 days ago | |
| Python | Python | |
| MIT License | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
think-async
-
Think Async: Resources for Exploring Different Concurrency Paradigms in Python
Lately, at my workplace, I've been doing a lot of asynchronous I/O programming in Python. In my case, ironically, I picked up Golang faster than Python's async paradigm despite Python being my primary language. Coroutine chauffeured asynchronous programming demanded a substantial shift in the way I used to compose solutions in synchronous Python.
However, after successfully writing two services using asyncio, SQS, DynamoDB, and aiobotocore—I'm convinced that this is actually worth it. Here're a few resources that I've found helpful along the way. Pull requests are very much welcome.
https://github.com/rednafi/think-async
- Think Async in Python
Joblib
-
Celery & Scikit-Learn: Using n_jobs under a Celery task throws joblib/Loky warning
Here's a thread from a few years ago btw on using billiard as a backend for joblib. https://github.com/joblib/joblib/issues/311
What are some alternatives?
aiomultiprocess - Take a modern Python codebase to the next level of performance.
schedule - Python job scheduling for humans.
arq - Fast job queuing and RPC in python with asyncio and redis.
celery - Distributed Task Queue (development branch)
vermin - Concurrently detect the minimum Python versions needed to run code
Prefect - The easiest way to build, run, and monitor data pipelines at scale.
gevent - Coroutine-based concurrency library for Python
doit - task management & automation tool
mnqueues - Monitored Multiprocessing Queues
APScheduler - Task scheduling library for Python
regta - 📅 Production-ready scheduler with async, multithreading and multiprocessing support for Python
django-schedule - A calendaring app for Django. It is now stable, Please feel free to use it now. Active development has been taken over by bartekgorny.