Top 12 Concurrency and Parallelism Open-Source Projects

• Ray

  42 31,101 10.0 Python

  Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

  

Project mention: Open Source Advent Fun Wraps Up! | dev.to | 2024-01-05

22. Ray | Github | tutorial

• Faust

  8 6,675 1.4 Python

  Python Stream Processing

  

Project mention: Faust VS quix-streams - a user suggested alternative | libhunt.com/r/faust | 2023-12-07

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• gevent

  5 6,163 8.7 Python

  Coroutine-based concurrency library for Python

  

Project mention: Is anyone using PyPy for real work? | news.ycombinator.com | 2023-07-31

A sub-question for the folks here: is anyone using the combination of gevent and PyPy for a production application? Or, more generally, other libraries that do deep monkey-patching across the Python standard library?

Things like https://github.com/gevent/gevent/issues/676 and the fix at https://github.com/gevent/gevent/commit/f466ec51ea74755c5bee... indicate to me that there are subtleties on how PyPy's memory management interacts with low-level tweaks like gevent that have relied on often-implicit historical assumptions about memory management timing.

Not sure if this is limited to gevent, either - other libraries like Sentry, NewRelic, and OpenTelemetry also have low-level monkey-patched hooks, and it's unclear whether they're low-level enough that they might run into similar issues.

For a stack without any monkey-patching I'd be overjoyed to use PyPy - but between gevent and these monitoring tools, practically every project needs at least some monkey-patching, and I think that there's a lack of clarity on how battle-tested PyPy is with tools like these.

• deco

  1 1,576 0.0 Python

• Wallaroo

  0 1,482 0.0 Pony

  Distributed Stream Processing

  

• Tomorrow

  0 1,459 0.0 Python

  Magic decorator syntax for asynchronous code in Python

• eventlet

  4 1,231 8.7 Python

  Concurrent networking library for Python

  

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• SCOOP (Scalable COncurrent Operations in Python)

  0 616 0.0 Python

  SCOOP (Scalable COncurrent Operations in Python) (by soravux)

• pipelines

  0 372 0.0 Nim

  An experimental programming language for data flow (by calebwin)

• Thespian Actor Library

  1 185 6.0 Python

  Python Actor concurrency library

• aiochan

  1 156 0.0 Python

  CSP-style concurrency for Python

Project mention: Aiochan: CSP-Style Concurrency for Python | news.ycombinator.com | 2023-10-02

• pyeventbus

  0 17 0.0 Python

  Python Eventbus

Concurrency and Parallelism related posts

• Faust VS quix-streams - a user suggested alternative

  2 projects | 7 Dec 2023

• Aiochan: CSP-Style Concurrency for Python

  1 project | news.ycombinator.com | 2 Oct 2023

• Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Models

  1 project | news.ycombinator.com | 11 Aug 2023

• Ray – an open source project for scaling AI workloads

  1 project | news.ycombinator.com | 11 Aug 2023

• Is anyone using PyPy for real work?

  13 projects | news.ycombinator.com | 31 Jul 2023

• Methods to keep agents inside grid world.

  1 project | /r/reinforcementlearning | 30 Jun 2023

• SynchronousOnlyOperation from celery task using gevent execution pool on django orm

  3 projects | /r/django | 31 May 2023
• A note from our sponsor - SaaSHub
  www.saashub.com | 2 May 2024

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com