The Distributed Tensor Algebra Compiler (2022)

• awesome-tensor-compilers

  9 2,171 4.4

  A list of awesome compiler projects and papers for tensor computation and deep learning.

* collection of papers in https://github.com/merrymercy/awesome-tensor-compilers

I also have an interest in the community more widely associated with pandas/dataframes-like languages (e.g. modin/dask/ray/polars/ibis) with substrait/calcite/arrow their choice of IR

• modin

  11 9,476 9.6 Python

  Modin: Scale your Pandas workflows by changing a single line of code

  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• Dask

  32 11,999 9.6 Python

  Parallel computing with task scheduling

  

• taco

  2 1,208 0.0 C++

  The Tensor Algebra Compiler (taco) computes sparse tensor expressions on CPUs and GPUs

  

I agree! Much of this work was done as part of the overarching TACO project (https://github.com/tensor-compiler/taco), in an attempt to distribute sparse tensor computations (https://rohany.github.io/publications/sc2022-spdistal.pdf). MLIR recently (~mid 2022) began implementing the ideas from TACO into a "sparse tensor" dialect, so perhaps some of these ideas could make it into there. I'm working with MLIR these days, and if I could re-do the project now I would probably utilize and targetb the MLIR linalg infrastructure!

Suggest a related project