Solutions like Dependabot or Renovate update but don't merge dependencies. You need to do it manually while it could be fully automated! Add a Merge Queue to your workflow and stop caring about PR management & merging. Try Mergify for free. Learn more →
Top 23 Python Multiprocessing Projects
-
-
-
Mergify
Updating dependencies is time-consuming.. Solutions like Dependabot or Renovate update but don't merge dependencies. You need to do it manually while it could be fully automated! Add a Merge Queue to your workflow and stop caring about PR management & merging. Try Mergify for free.
-
-
-
Plutus
An automated bitcoin wallet collider that brute forces random wallet addresses (by Isaacdelly)
-
crypto-rl
Deep Reinforcement Learning toolkit: record and replay cryptocurrency limit order book data & train a DDQN agent
-
-
Sonar
Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.
-
vermin
Concurrently detect the minimum Python versions needed to run code - Vermin 1.6 will end support for running via Python 2.7. Python 3.x is going to be required but detection of 2.x functionality will remain functional.
-
lithops
A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel applications in the cloud ☁️🚀
Project mention: Lithops: A multi-cloud framework for embarrassingly parallel jobs | news.ycombinator.com | 2023-01-14 -
-
Project mention: I made autothread: the easiest way to add parallelization to your code | /r/Python | 2022-12-22
Oh cool, I missed that one when I did my initial research. I did come across multitasking, which is also similar but doesn't make it easy to return objects from the function.
-
Project mention: Mpire: A Python package for easier and faster multiprocessing | news.ycombinator.com | 2023-08-11
I often use lox for this sort of thing. It can use threads or processes, and has a very ergonomic api.
-
ruck
🧬 Modularised Evolutionary Algorithms For Python with Optional JIT and Multiprocessing (Ray) support. Inspired by PyTorch Lightning
-
I like using NotEnoughAV1Encodes. There's also Av1an, and ab-av1.
-
-
-
regta
📅 Production-ready scheduler with async, multithreading and multiprocessing support for Python
Project mention: [Automation] Scheduling Python Programs: Pushing Notifications, Executing SQLs, etc... | dev.to | 2023-09-24If your automation needs are focused on Python exclusively, Regta emerges as a compelling option, offering a wealth of Python-specific optimizations. Give it a try, and feel free to share your thoughts in the comments 🙌
-
-
-
-
RemoteShell
This is a multi-client to server cross platform remote shell written in Python using threading and multiprocessing.
-
-
Source Code: https://github.com/hariya99/mpxl2csv
-
InfluxDB
Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
Python Multiprocessing related posts
- Mpire: A Python package for easier and faster multiprocessing
- I made autothread: the easiest way to add parallelization to your code
- crypto-rl: Retrieve limit order book level data from coinbase pro and bitfinex -> record in [arctic](https://github.com/man-group/arctic) timeseries database then implemented trend following strategies (market orders) and market making (limit orders)
- crypto-rl: Retrieve limit order book level data from coinbase pro and bitfinex -> record in [arctic](https://github.com/man-group/arctic) timeseries database then implemented trend following strategies (market orders) and market making (limit orders)
- crypto-rl: Retrieve limit order book level data from coinbase pro and bitfinex -> record in [arctic](https://github.com/man-group/arctic) timeseries database then implemented trend following strategies (market orders) and market making (limit orders)
- crypto-rl: Retrieve limit order book level data from coinbase pro and bitfinex -> record in [arctic](https://github.com/man-group/arctic) timeseries database then implemented trend following strategies (market orders) and market making (limit orders)
- crypto-rl: Retrieve limit order book level data from coinbase pro and bitfinex -> record in [arctic](https://github.com/man-group/arctic) timeseries database then implemented trend following strategies (market orders) and market making (limit orders)
-
A note from our sponsor - Mergify
blog.mergify.com | 30 Sep 2023
Index
What are some of the best open-source Multiprocessing projects in Python? This list will help you:
Project | Stars | |
---|---|---|
1 | Joblib | 3,439 |
2 | PSpider | 1,785 |
3 | aiomultiprocess | 1,601 |
4 | imgp | 967 |
5 | Plutus | 958 |
6 | crypto-rl | 718 |
7 | pytorch-A3C | 538 |
8 | vermin | 392 |
9 | lithops | 280 |
10 | think-async | 214 |
11 | multitasking | 183 |
12 | lox | 87 |
13 | ruck | 52 |
14 | NotEnoughAV1Encodes-Qt | 32 |
15 | google_drive_ocr | 23 |
16 | geventmp | 17 |
17 | regta | 12 |
18 | gibbs | 11 |
19 | mnqueues | 5 |
20 | treequeues | 4 |
21 | RemoteShell | 2 |
22 | autowpscan | 2 |
23 | mpxl2csv | 1 |