Mpire: A Python package for easier and faster multiprocessing

• mpire

  8 1,900 7.5 Python

  A Python package for easy multiprocessing, but faster than multiprocessing

  

• SimplePipeline

  1 0 10.0 Python

  A ridiculously simple multiprocessing pipeline module

I've written a very tiny multiprocessing pipeline in Python. It's documented.

I've actually never made use of it but at the time I got a bit obsessed and wanted to write it. It does seem to work as expected.

Is highly hackable as it is only a single file and a couple of classes.

Maybe is useful to someone, here's the link: https://github.com/lliendo/SimplePipeline

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• lox

  2 87 0.0 Python

  Threading and Multiprocessing made easy.

I often use lox for this sort of thing. It can use threads or processes, and has a very ergonomic api.

https://github.com/BrianPugh/lox

• futureproof

  1 50 10.0 Python

  Bulletproof concurrent.futures (by yeraydiazdiaz)

Another good library for concurrency and parallel tasks is futureproof:

https://github.com/yeraydiazdiaz/futureproof

> concurrent.futures is amazing, but it's got some sharp edges that have bit me many times in the past.

> Futureproof is a thin wrapper around it addressing some of these problems and adding some usability features.

Suggest a related project