Python Parallel

Open-source Python projects categorized as Parallel
Edit details
Topics: Python Distributed Machine Learning Python3 Optimization
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
Sponsored

Top 23 Python Parallel Projects

  • Ray

    Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

    • Project mention: Open Source Advent Fun Wraps Up! | dev.to | 2024-01-05

    22. Ray | Github | tutorial

  • tqdm

    :zap: A Fast, Extensible Progress Bar for Python and CLI

    • Project mention: Neat Parallel Output in Python | news.ycombinator.com | 2024-02-25

    yeah my code needs to use multiprocessing, which does not play nice with tqdm. thanks for the tip about positions though, that helped me search more effectively and came up with two promising comments. unmerged / require some workarounds, but might just work:

    https://github.com/tqdm/tqdm/issues/1000#issuecomment-184208...

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • optuna

    A hyperparameter optimization framework

    • Project mention: Optuna – A Hyperparameter Optimization Framework | news.ycombinator.com | 2024-04-06

    I didn’t even know WandB did hyperparameter optimization, I figured it was a neural network visualizer based on 2 minute papers. Didn’t seem like many alternatives out there to Optuna with TPE + persistence in conditional continuous & discrete spaces.

    Anyway, it’s doable to make a multi objective decide_to_prune function with Optuna, here’s an example https://github.com/optuna/optuna/issues/3450#issuecomment-19...

  • Numba

    NumPy aware dynamic Python compiler using LLVM

    • Project mention: Mojo🔥: Head -to-Head with Python and Numba | dev.to | 2023-09-27

    Around the same time, I discovered Numba and was fascinated by how easily it could bring huge performance improvements to Python code.

  • pandarallel

    A simple and efficient tool to parallelize Pandas operations on all available CPUs

  • redo

    Smaller, easier, more powerful, and more reliable than make. An implementation of djb's redo.

  • parallel-ssh

    Asynchronous parallel SSH client library.

    • Project mention: I built a remote file browser and shell connection hub that supports k8s clusters | /r/kubernetes | 2023-06-09

    Okay I have no idea how to interpret this comment, are you talking about https://parallel-ssh.org/? These two things have not really anything in common

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • adaptive

    :chart_with_upwards_trend: Adaptive: parallel active learning of mathematical functions

    • Project mention: I made a Python package to do adaptive sampling of functions in parallel [OC] | /r/compsci | 2023-04-29

    Yes! Check it out at https://github.com/python-adaptive/adaptive/

  • optuna-examples

    Examples for https://github.com/optuna/optuna

  • malib

    A parallel framework for population-based multi-agent reinforcement learning.

  • msrsync

    Multi-stream rsync wrapper

  • lithops

    A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides an universal API for building parallel applications in the cloud ☁️🚀

  • entangle

    A lightweight (serverless) native python parallel processing framework based on simple decorators and call graphs.

  • fast-cma-es

    A Python 3 gradient-free optimization library

  • behavex

    BDD test wrapper on top of Behave for parallel test executions and more!

  • 🚀 IPpy

    :rocket: Ping IP addresses and domains in parallel to find the accessible and inaccessible ones. (by shivammathur)

  • eSCAPE

    Earth Landscape Evolution Model: https://escape-model.github.io/

  • pyfuncol

    Functional collections extension functions for Python

  • fluidml

    FluidML is a lightweight framework for developing machine learning pipelines.

  • pyeventbus

    Python Eventbus

  • git-pull

    Parallelized web scraper for Github

  • raffiot.py

    Robust And Fast Functional IO Toolkit

  • AutoParaSelenium

    A library to make concurrent selenium tests that automatically download and setup webdrivers

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Parallel related posts

Index

What are some of the best open-source Parallel projects in Python? This list will help you:

Project Stars
1 Ray 30,988
2 tqdm 27,405
3 optuna 9,640
4 Numba 9,432
5 pandarallel 3,489
6 redo 1,762
7 parallel-ssh 1,179
8 adaptive 1,112
9 optuna-examples 596
10 malib 460
11 msrsync 452
12 lithops 305
13 entangle 105
14 fast-cma-es 102
15 behavex 75
16 🚀 IPpy 55
17 eSCAPE 36
18 pyfuncol 32
19 fluidml 19
20 pyeventbus 17
21 git-pull 16
22 raffiot.py 15
23 AutoParaSelenium 9

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com