Python Multiprocessing

Open-source Python projects categorized as Multiprocessing

Top 23 Python Multiprocessing Projects

Multiprocessing
  1. Joblib

    Computing with Python functions.

  2. Judoscale

    Save 47% on cloud hosting with autoscaling that just works. Judoscale integrates with Django, FastAPI, Celery, and RQ to make autoscaling easy and reliable. Save big, and say goodbye to request timeouts and backed-up task queues.

    Judoscale logo
  3. aiomultiprocess

    Take a modern Python codebase to the next level of performance.

  4. PSpider

    简单易用的Python爬虫框架,QQ交流群:597510560

  5. Plutus

    An automated bitcoin wallet collider that brute forces random wallet addresses (by Isaacdelly)

  6. pyper

    Concurrent Python made simple

    Project mention: This Week In Python | dev.to | 2025-01-17

    pyper – Concurrent Python made simple

  7. imgp

    :camera_flash: Fast batch image resizer and rotator

    Project mention: Use imgp on macOS with Docker | dev.to | 2024-10-06

    root@cc0fa40c9237:~# imgp usage: imgp [-h] [-x res] [-o deg] [-a] [-c] [-e] [-f] [-H] [-i] [-k] [-m] [-M res] [-n] [-N] [-O] [-P] [-q N] [-r] [-s byte] [-w] [-d] [PATH ...] Resize, rotate JPEG and PNG images. positional arguments: PATH source file or dir [default: current dir] options: -h, --help show this help message and exit -x res, --res res output resolution in HxV or percentage -o deg, --rotate deg rotate clockwise by angle (in degrees) -a, --adapt adapt to resolution by orientation [default: off] -c, --convert convert PNG to JPG format [default: off] -e, --eraseexif erase exif metadata [default: off] -f, --force force to exact specified resolution [default: off] -H, --hidden include hidden (dot) files [default: off] -i, --includeimgp re-process _IMGP files. * RISKY: refer to docs -k, --keep skip (honors -c or --pr) images matching specified H or V or --res=100 [default: off] -m, --mute operate silently [default: informative] -M res, --minres res min resolution in HxV or percentage of --res to resize -n, --enlarge enlarge smaller images [default: off] -N, --nearest use nearest neighbour interpolation for PNG [default: antialias] -O, --optimize optimize the output images [default: off] -P, --progressive save JPEG images as progressive [default: off] -q N, --quality N quality factor (N=1-95, JPEG only) [default: 75] -r, --recurse process non-symbolic dirs recursively [default: off] -s byte, --size byte minimum size to process an image [default: 1024] -w, --overwrite overwrite source images [default: off] -d, --debug enable debug logs [default: off] Version 2.9 Copyright © 2016-2023 Arun Prakash Jana License: GPLv3 Webpage: https://github.com/jarun/imgp

  8. crypto-rl

    Deep Reinforcement Learning toolkit: record and replay cryptocurrency limit order book data & train a DDQN agent

  9. InfluxDB

    InfluxDB high-performance time series database. Collect, organize, and act on massive volumes of high-resolution data to power real-time intelligent systems.

    InfluxDB logo
  10. pytorch-A3C

    Simple A3C implementation with pytorch + multiprocessing

  11. vermin

    Concurrently detect the minimum Python versions needed to run code

  12. lithops

    A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel applications in the cloud ☁️🚀

    Project mention: Why aren't we all serverless yet? | news.ycombinator.com | 2025-01-09

    Lithops is a great library for abstracting over different cloud vendors so you can interact with a uniform API.

    https://github.com/lithops-cloud/lithops

  13. tractor

    A distributed, structured concurrency runtime for Python (and friends)

  14. DictDataBase

    A python NoSQL dictionary database, with concurrent access and ACID compliance

  15. think-async

    🌿 Exploring cooperative concurrency primitives in Python

  16. multitasking

    Non-blocking Python methods using decorators

  17. LiSA

    LiSA (Native App to stream/read and download Anime & Manga ❤️ ) (by Cosmicoppai)

  18. lox

    Threading and Multiprocessing made easy.

  19. ruck

    🧬 Modularised Evolutionary Algorithms For Python with Optional JIT and Multiprocessing (Ray) support. Inspired by PyTorch Lightning

  20. google_drive_ocr

    Perform OCR using Google's Drive API v3

  21. autothread

    Parallelization in python made easy

  22. NotEnoughAV1Encodes-Qt

    Linux GUI for AV1 Encoders

  23. regta

    📅 Production-ready scheduler with async, multithreading and multiprocessing support for Python

  24. geventmp

    GeventMP - Gevent Multiprocessing Extension

  25. teller_of_tales

    Create narrated video story from book chapter using NLP, OpenAI and StableDiffusion.

  26. CodeRabbit

    CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

    CodeRabbit logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Multiprocessing discussion

Log in or Post with

Python Multiprocessing related posts

  • crypto-rl: Retrieve limit order book level data from coinbase pro and bitfinex -> record in [arctic](https://github.com/man-group/arctic) timeseries database then implemented trend following strategies (market orders) and market making (limit orders)

    1 project | /r/algoprojects | 10 Dec 2023
  • Mpire: A Python package for easier and faster multiprocessing

    4 projects | news.ycombinator.com | 11 Aug 2023
  • I made autothread: the easiest way to add parallelization to your code

    4 projects | /r/Python | 22 Dec 2022
  • crypto-rl: Retrieve limit order book level data from coinbase pro and bitfinex -> record in [arctic](https://github.com/man-group/arctic) timeseries database then implemented trend following strategies (market orders) and market making (limit orders)

    1 project | /r/algoprojects | 16 Jul 2022
  • crypto-rl: Retrieve limit order book level data from coinbase pro and bitfinex -> record in [arctic](https://github.com/man-group/arctic) timeseries database then implemented trend following strategies (market orders) and market making (limit orders)

    1 project | /r/algoprojects | 15 Jul 2022
  • crypto-rl: Retrieve limit order book level data from coinbase pro and bitfinex -> record in [arctic](https://github.com/man-group/arctic) timeseries database then implemented trend following strategies (market orders) and market making (limit orders)

    1 project | /r/algoprojects | 14 Jul 2022
  • crypto-rl: Retrieve limit order book level data from coinbase pro and bitfinex -> record in [arctic](https://github.com/man-group/arctic) timeseries database then implemented trend following strategies (market orders) and market making (limit orders)

    1 project | /r/algoprojects | 13 Jul 2022
  • A note from our sponsor - InfluxDB
    influxdata.com | 21 Apr 2025
    Collect, organize, and act on massive volumes of high-resolution data to power real-time intelligent systems. Learn more →

Index

What are some of the best open-source Multiprocessing projects in Python? This list will help you:

# Project Stars
1 Joblib 4,041
2 aiomultiprocess 1,868
3 PSpider 1,833
4 Plutus 1,232
5 pyper 1,187
6 imgp 1,070
7 crypto-rl 887
8 pytorch-A3C 633
9 vermin 465
10 lithops 330
11 tractor 281
12 DictDataBase 237
13 think-async 233
14 multitasking 206
15 LiSA 153
16 lox 122
17 ruck 53
18 google_drive_ocr 38
19 autothread 35
20 NotEnoughAV1Encodes-Qt 30
21 regta 22
22 geventmp 19
23 teller_of_tales 13

Sponsored
Save 47% on cloud hosting with autoscaling that just works
Judoscale integrates with Django, FastAPI, Celery, and RQ to make autoscaling easy and reliable. Save big, and say goodbye to request timeouts and backed-up task queues.
judoscale.com