Show HN: I created a .NET task batching and management library

• BatchPool

  9 181 10.0 C#

  The one-stop generic task batching and management library

• PartitionCache

  1 4 10.0 C#

  Persistent Producer Partition Cache

This is a great little library. Several years ago I wrote this tiny (very flakey) in memory topic producer cache - https://github.com/jeremylcarter/PartitionCache. The purpose was to create something like Event Hubs and/or Kafka but in memory only - just to split up workloads by a producer key. I have since seen how bad my initial implementation was, and I did rewrite it - but haven't pushed the branch up.

Perhaps there is a use case for you to have keyed producers. Whereby the same items from the same producer ID are always processed by the same worker - even if it were just round robin assignment to a "batch".

I have also dabbled in the Qoollo Turbo library which has a nice QueueProcessor which is easy to extend (see QueueAsyncProcessor) - you should check that out too for inspiration.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project