Parallel streaming in Haskell: Part 1 – Fast, efficient, and fun

• attoparsec-conduit

  3 893 5.3 Haskell

  A streaming data library

  > makes me think that there aren't any conduits that have more data than can fit in memory on a single machine

  Just because you can dedup a conduit doesn't mean you have to. We use conduits for streaming gigabytes-large files while staying within megabytes of memory use – ensuring that is one of the main selling points of libraries like conduit: https://github.com/snoyberg/conduit#readme

• InfluxDB

  www.influxdata.com featured

  Purpose built for real-time analytics at any scale. InfluxDB Platform is powered by columnar analytics, optimized for cost-efficient storage, and built with open data standards.

  

• FS2

  17 2,355 9.3 Scala

  Compositional, streaming I/O library for Scala

  

  Thanks for the explanation!

  So it's pull based and not push based like most other streams lib.

  Does maybe someone know how this compares to FS2 or Iteratees than? (Both are also pull based streaming solutions).

  https://fs2.io/#/

  https://en.wikipedia.org/wiki/Iteratee

  Looks quite similar to me. Is the Scala FS2 lib maybe even a clones of the Haskell solution? Or are they different in important aspects?

Suggest a related project