Solutions like Dependabot or Renovate update but don't merge dependencies. You need to do it manually while it could be fully automated! Add a Merge Queue to your workflow and stop caring about PR management & merging. Try Mergify for free. Learn more →
Top 23 Python Multiprocessing Projects
-
-
-
Mergify
Updating dependencies is time-consuming.. Solutions like Dependabot or Renovate update but don't merge dependencies. You need to do it manually while it could be fully automated! Add a Merge Queue to your workflow and stop caring about PR management & merging. Try Mergify for free.
-
-
-
Plutus
An automated bitcoin wallet collider that brute forces random wallet addresses (by Isaacdelly)
-
crypto-rl
Deep Reinforcement Learning toolkit: record and replay cryptocurrency limit order book data & train a DDQN agent
-
-
Sonar
Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.
-
vermin
Concurrently detect the minimum Python versions needed to run code - Vermin 1.6 will end support for running via Python 2.7. Python 3.x is going to be required but detection of 2.x functionality will remain functional.
-
lithops
A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel applications in the cloud ☁️🚀
Project mention: Lithops: A multi-cloud framework for embarrassingly parallel jobs | news.ycombinator.com | 2023-01-14 -
-
Project mention: I made autothread: the easiest way to add parallelization to your code | /r/Python | 2022-12-22
Oh cool, I missed that one when I did my initial research. I did come across multitasking, which is also similar but doesn't make it easy to return objects from the function.
-
Project mention: Mpire: A Python package for easier and faster multiprocessing | news.ycombinator.com | 2023-08-11
I often use lox for this sort of thing. It can use threads or processes, and has a very ergonomic api.
-
ruck
🧬 Modularised Evolutionary Algorithms For Python with Optional JIT and Multiprocessing (Ray) support. Inspired by PyTorch Lightning
-
I like using NotEnoughAV1Encodes. There's also Av1an, and ab-av1.
-
-
-
regta
📅 Production-ready scheduler with async, multithreading and multiprocessing support for Python
Project mention: [Automation] Scheduling Python Programs: Pushing Notifications, Executing SQLs, etc... | dev.to | 2023-09-24If your automation needs are focused on Python exclusively, Regta emerges as a compelling option, offering a wealth of Python-specific optimizations. Give it a try, and feel free to share your thoughts in the comments 🙌
-
-
-
-
RemoteShell
This is a multi-client to server cross platform remote shell written in Python using threading and multiprocessing.
-
-
Source Code: https://github.com/hariya99/mpxl2csv
-
InfluxDB
Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
The latest post mention was on 2023-09-24.
Python Multiprocessing related posts
- Mpire: A Python package for easier and faster multiprocessing
- I made autothread: the easiest way to add parallelization to your code
- crypto-rl: Retrieve limit order book level data from coinbase pro and bitfinex -> record in [arctic](https://github.com/man-group/arctic) timeseries database then implemented trend following strategies (market orders) and market making (limit orders)
- crypto-rl: Retrieve limit order book level data from coinbase pro and bitfinex -> record in [arctic](https://github.com/man-group/arctic) timeseries database then implemented trend following strategies (market orders) and market making (limit orders)
- crypto-rl: Retrieve limit order book level data from coinbase pro and bitfinex -> record in [arctic](https://github.com/man-group/arctic) timeseries database then implemented trend following strategies (market orders) and market making (limit orders)
- crypto-rl: Retrieve limit order book level data from coinbase pro and bitfinex -> record in [arctic](https://github.com/man-group/arctic) timeseries database then implemented trend following strategies (market orders) and market making (limit orders)
- crypto-rl: Retrieve limit order book level data from coinbase pro and bitfinex -> record in [arctic](https://github.com/man-group/arctic) timeseries database then implemented trend following strategies (market orders) and market making (limit orders)
-
A note from our sponsor - Mergify
blog.mergify.com | 30 Sep 2023
Index
What are some of the best open-source Multiprocessing projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | Joblib | 3,439 |
| 2 | PSpider | 1,785 |
| 3 | aiomultiprocess | 1,601 |
| 4 | imgp | 967 |
| 5 | Plutus | 958 |
| 6 | crypto-rl | 718 |
| 7 | pytorch-A3C | 538 |
| 8 | vermin | 392 |
| 9 | lithops | 280 |
| 10 | think-async | 214 |
| 11 | multitasking | 183 |
| 12 | lox | 87 |
| 13 | ruck | 52 |
| 14 | NotEnoughAV1Encodes-Qt | 32 |
| 15 | google_drive_ocr | 23 |
| 16 | geventmp | 17 |
| 17 | regta | 12 |
| 18 | gibbs | 11 |
| 19 | mnqueues | 5 |
| 20 | treequeues | 4 |
| 21 | RemoteShell | 2 |
| 22 | autowpscan | 2 |
| 23 | mpxl2csv | 1 |
Collect and Analyze Billions of Data Points in Real Time
Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
www.influxdata.com