Scala needs a good, dependency-free DataFrame library

• polars

  144 26,043 10.0 Rust

  Dataframes powered by a multithreaded, vectorized query engine, written in Rust

  

I'd be happy to collaborate with someone on this effort if you're interested. I am a dev advocate and am already working with the creators of Polars and DataFusion, two Rust based DataFrame libraries, to help them grow their projects. Interested if the community thinks this is a good idea. I don't have the coding skills to build an Arrow-based Scala DataFrame lib myself, but would be happy to help out with the project evangelism.

• datafusion

  55 5,020 9.9 Rust

  Apache DataFusion SQL Query Engine

  

I'd be happy to collaborate with someone on this effort if you're interested. I am a dev advocate and am already working with the creators of Polars and DataFusion, two Rust based DataFrame libraries, to help them grow their projects. Interested if the community thinks this is a good idea. I don't have the coding skills to build an Arrow-based Scala DataFrame lib myself, but would be happy to help out with the project evangelism.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• Apache Arrow

  75 13,480 10.0 C++

  Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing

  

I assume you mean to use Apache arrow rather than scala Arrow?

Suggest a related project