Delta Lake without Databricks?

• delta

  69 6,874 9.8 Scala

  An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs (by delta-io)

  

I believe the team is working on it. Check this PR. It seems that this is a bit more difficult because it was coupled with Spark (I think) so it needs to be changed to make it open source.

• delta-rs

  28 1,810 9.7 Rust

  A native Rust library for Delta Lake, with bindings into Python

  

You don’t need DBX to use Delta Lake. You can use S3 as the backend and just use the Python Delta Lake library. It works great! https://github.com/delta-io/delta-rs

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project