Python Concurrency and Parallelism

Open-source Python projects categorized as Concurrency and Parallelism
Edit details
Topics: Python Concurrency Asyncio Distributed Systems Parallel
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
Sponsored

Top 10 Python Concurrency and Parallelism Projects

  • Ray

    Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

    • Project mention: Open Source Advent Fun Wraps Up! | dev.to | 2024-01-05

    22. Ray | Github | tutorial

  • Faust

    Python Stream Processing

    • Project mention: Faust VS quix-streams - a user suggested alternative | libhunt.com/r/faust | 2023-12-07

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • gevent

    Coroutine-based concurrency library for Python

    • Project mention: Is anyone using PyPy for real work? | news.ycombinator.com | 2023-07-31

    A sub-question for the folks here: is anyone using the combination of gevent and PyPy for a production application? Or, more generally, other libraries that do deep monkey-patching across the Python standard library?

    Things like https://github.com/gevent/gevent/issues/676 and the fix at https://github.com/gevent/gevent/commit/f466ec51ea74755c5bee... indicate to me that there are subtleties on how PyPy's memory management interacts with low-level tweaks like gevent that have relied on often-implicit historical assumptions about memory management timing.

    Not sure if this is limited to gevent, either - other libraries like Sentry, NewRelic, and OpenTelemetry also have low-level monkey-patched hooks, and it's unclear whether they're low-level enough that they might run into similar issues.

    For a stack without any monkey-patching I'd be overjoyed to use PyPy - but between gevent and these monitoring tools, practically every project needs at least some monkey-patching, and I think that there's a lack of clarity on how battle-tested PyPy is with tools like these.

  • deco

  • Tomorrow

    Magic decorator syntax for asynchronous code in Python

  • eventlet

    Concurrent networking library for Python

  • SCOOP (Scalable COncurrent Operations in Python)

    SCOOP (Scalable COncurrent Operations in Python) (by soravux)

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • Thespian Actor Library

    Python Actor concurrency library

  • aiochan

    CSP-style concurrency for Python

    • Project mention: Aiochan: CSP-Style Concurrency for Python | news.ycombinator.com | 2023-10-02

  • pyeventbus

    Python Eventbus

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Concurrency and Parallelism related posts

Index

What are some of the best open-source Concurrency and Parallelism projects in Python? This list will help you:

Project Stars
1 Ray 30,988
2 Faust 6,671
3 gevent 6,160
4 deco 1,571
5 Tomorrow 1,459
6 eventlet 1,226
7 SCOOP (Scalable COncurrent Operations in Python) 616
8 Thespian Actor Library 185
9 aiochan 156
10 pyeventbus 17

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com