Blaze: Fast query execution engine for Apache Spark

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com
Science and Data analysis execution-engine arrow-datafusion Big Data Rust

WorkOS
Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
Our great sponsors

  • blaze

    Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core. (by kwai)

  • blaze

    NumPy and Pandas interface to Big Data

    • Unfortunate name overlap with an under-loved PyData project: https://blaze.pydata.org

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • incubator-gluten

    Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.

    • Interesting, looks like it is just DataFusion engine for Spark. There is a similar project: https://github.com/oap-project/gluten - it brings ClickHouse as an engine to Spark.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts