lox
mpire
| lox | mpire | |
|---|---|---|
| 2 | 8 | |
| 87 | 1,910 | |
| - | 1.5% | |
| 0.0 | 7.5 | |
| over 1 year ago | 9 days ago | |
| Python | Python | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
lox
-
Mpire: A Python package for easier and faster multiprocessing
I often use lox for this sort of thing. It can use threads or processes, and has a very ergonomic api.
https://github.com/BrianPugh/lox
- I made autothread: the easiest way to add parallelization to your code
mpire
- GitHub - sybrenjansen/mpire: A Python package for easy multiprocessing, but faster than multiprocessing
- Mpire: A Python package for easier and faster multiprocessing
-
Which not so well known Python packages do you like to use on a regular basis and why?
mpire for multiprocessing.
-
How do you deal with parallelising parts of an ML pipeline especially on Python?
https://github.com/Slimmer-AI/mpire is a nice lib, with better performance than multiprocessing.
-
Dask – a flexible library for parallel computing in Python
Shout out to an alternative to Dask: MPIRE https://github.com/Slimmer-AI/mpire
- Multi-Threading in Python
-
I'd like to introduce MPIRE: MultiProcessing Is Really Easy
After several iterations of feedback and exposure to production environments, it is now the go-to multiprocessing library at Slimmer AI. Recently, we’ve made it publicly available on GitHub (https://github.com/Slimmer-AI/mpire).
What are some alternatives?
building-blocks - A voxel library for real-time applications.
Dask - Parallel computing with task scheduling
futureproof - Bulletproof concurrent.futures
cudf - cuDF - GPU DataFrame Library
landon - A collection of tools, data structures and methods for exporting Blender data (such as meshes and armatures) and preparing it for your rendering pipeline.
distributed - A distributed task scheduler for Dask
autothread - Parallelization in python made easy
pathml - Tools for computational pathology
Voronoi_Image_Manipulation - A system independent tool for interactive image manipulation with Voronoi and Delaunay data structures.
cunumeric - An Aspiring Drop-In Replacement for NumPy at Scale
SimplePipeline - A ridiculously simple multiprocessing pipeline module
legate.pandas - An Aspiring Drop-In Replacement for Pandas at Scale