[AskJS] JavaScript for data processing

• pond

  1 204 0.0 TypeScript

  Immutable timeseries data structures built with Typescript (by esnet)

  

We used to use a library called Pond.js, https://github.com/esnet/pond, but the reliance on Immutable.JS caused some performance pitfalls, so we wrote a system from scratch that deals with data in a batched streaming fashion. A lot of the concepts were borrowed from a Rust library called timely-dataflow, https://github.com/TimelyDataflow/timely-dataflow.

• timely-dataflow

  11 3,141 7.2 Rust

  A modular implementation of timely dataflow in Rust

  

We used to use a library called Pond.js, https://github.com/esnet/pond, but the reliance on Immutable.JS caused some performance pitfalls, so we wrote a system from scratch that deals with data in a batched streaming fashion. A lot of the concepts were borrowed from a Rust library called timely-dataflow, https://github.com/TimelyDataflow/timely-dataflow.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• btree-typescript

  2 168 0.0 TypeScript

  A reasonably fast in-memory B+ tree with a powerful API based on the standard Map. Small minified. Well documented.

Separately to the processing, the in-memory database we use is https://github.com/qwertie/btree-typescript, again able to support millions of data points per second.

• COST

  1 230 10.0 Rust

  Single-threaded graph computation in Rust

• blog

  10 1,923 6.9 JavaScript

  Some notes on things I find interesting and important. (by frankmcsherry)

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project