Question on Stream Processing patterns in Go

• go-bench-stream

  2 2 0.0 Go

  🌊 Go Benchmarks for Stream Processing

Check the diagram if you are interested what I meant on Iterators! (basically transforming Read([]byte) calls into Next() MyType calls https://github.com/nikolaydubina/go-bench-stream

• tabc

  2 1 10.0 Go

  Time-Aware Bytestream Consolidator for Go (by thejerf)

I do have one complicated one at thejerf/tabc, which takes an intermittent series of read events (like from users typing, as opposed to a file reading) and breaks it up by time. (This is technically not a decator, though, as it consumes an io.Reader but presents a different interface.) I have one that I've never written but have been tempted to write that would align incoming io.Reader byte streams on unicode boundaries, so that users of this decorator can assume that they're always receiving a complete Unicode value and take appropriate actions, though that raises a whole world of issues around the definition of "complete Unicode value" you want to use (codepoint, "glyph", etc.).

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• Benthos

  76 7,617 9.7 Go

  Fancy stream processing made operationally mundane

  

Suggest a related project