Python parallel-computing

Open-source Python projects categorized as parallel-computing

Top 19 Python parallel-computing Projects

  • Joblib

    Computing with Python functions.

  • swifter

    A package which efficiently applies any function to a pandas dataframe or series in the fastest available manner (by jmcarpenter2)

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  • adaptive

    :chart_with_upwards_trend: Adaptive: parallel active learning of mathematical functions

    Project mention: I made a Python package to do adaptive sampling of functions in parallel [OC] | /r/compsci | 2023-04-29

    Yes! Check it out at https://github.com/python-adaptive/adaptive/

  • pyopencl

    OpenCL integration for Python, plus shiny features

  • Hyperactive

    An optimization and data collection toolbox for convenient and fast prototyping of computationally expensive models.

    Project mention: Hyperactive Version 4.5 Released | news.ycombinator.com | 2023-08-27
  • jug

    Parallel programming with Python

  • mpi4jax

    Zero-copy MPI communication of JAX arrays, for turbo-charged HPC applications in Python :zap:

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  • pyhpc-benchmarks

    A suite of benchmarks for CPU and GPU performance of the most popular high-performance libraries for Python :rocket:

  • pqdm

    Comfortable parallel TQDM using concurrent.futures

  • Fast-Poisson-Image-Editing

    A fast poisson image editing implementation that can utilize multi-core CPU or GPU to handle a high-resolution image input.

  • PSyclone

    Domain-specific compiler and code transformation system for Finite Difference/Volume/Element Earth-system models in Fortran

  • mlToolKits

    learningOrchestra is a distributed Machine Learning integration tool that facilitates and streamlines iterative processes in a Data Science project.

  • wrapyfi

    Python Wrapper for Message-Oriented and Robotics Middleware

  • python-performance

    Repository for the book Fast Python - published by Manning

  • b-rabbit

    A thread safe library that aims to provide a simple API for interfacing with RabbitMQ. Built on top of rabbitpy, the library make it very easy to use the RabbitMQ message broker with just few lines of code. It implements all messaging pattern used by message brokers

  • RayEnvWrapper

    OpenAi's gym environment wrapper to vectorize them with Ray

  • lava

    A Highlevel Python Wrapper for Vulkan's Compute API (by osanj)

  • YellowPage-scraper

    A YellowPage scraper is a Python program/script that extracts data from the YellowPages.com website using the Python programming language. The scraper can be used to gather information such as business names, addresses, phone numbers, emails and reviews from the YellowPages website.

    Project mention: Private business directory website | /r/selfhosted | 2023-12-03

    Hi. I am looking to host a private business directory for an community of entrepreneurs, similar to www.yellowpages.com. Private as in protected by a pin or something. Got any suggestions?

  • blazer

    An HPC abstraction over MPI with built-in parallel compute primitives (by radiantone)

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-12-03.

Python parallel-computing related posts

Index

What are some of the best open-source parallel-computing projects in Python? This list will help you:

Project Stars
1 Joblib 3,647
2 swifter 2,456
3 adaptive 1,110
4 pyopencl 1,030
5 Hyperactive 487
6 jug 407
7 mpi4jax 366
8 pyhpc-benchmarks 300
9 pqdm 252
10 Fast-Poisson-Image-Editing 197
11 PSyclone 94
12 mlToolKits 74
13 wrapyfi 70
14 python-performance 48
15 b-rabbit 26
16 RayEnvWrapper 22
17 lava 15
18 YellowPage-scraper 7
19 blazer 7
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com