delta-rs

A native Rust library for Delta Lake, with bindings into Python (by delta-io)

Delta-rs Alternatives

Similar projects and alternatives to delta-rs

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better delta-rs alternative or higher similarity.

delta-rs reviews and mentions

Posts with mentions or reviews of delta-rs. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-01-24.
  • Delta without using Spark
    2 projects | reddit.com/r/dataengineering | 24 Jan 2023
  • Spark open source community is awesome
    5 projects | reddit.com/r/apachespark | 29 Dec 2022
    Yea, there are tons of employees from companies that have made massive contributions to the Spark ecosystem. Apple built Delta Lake with Databricks, see this video for more detail. Lots of Spark PMCs are from various companies. delta-rs was initially built by Scribd and is now actively maintained by engineers at Voltron & other companies. It's awesome the community has so many contributors from various sources.
  • Snowpark equivalent on Databricks?
    2 projects | reddit.com/r/dataengineering | 7 Nov 2022
    Have a look at this https://delta-io.github.io/delta-rs/python/
  • Rust is showing a lot of promise in the DataFrame / tabular data space
    9 projects | reddit.com/r/rust | 4 Oct 2022
    I'm working on [delta-rs](https://github.com/delta-io/delta-rs) which brings the power of Delta Lake to the Rust community. CSV / Parquet lakes are limited and Delta Lakes offer a ton of advantages (versioned data, time travel, ACID transactions, schema enforcement, etc). We're working to bring full Polars and DataFusion support to delta-rs, see the roadmap.
  • Tipsy ramblings on Databricks' "Lakehouse"
    2 projects | reddit.com/r/dataengineering | 16 Jan 2022
    Not sure if OP has come across this python library https://github.com/delta-io/delta-rs. With this library you can read delta tables stored in buckets and put them in pandas dataframe without all the Spark hassles.
  • Rust for DE?
    6 projects | reddit.com/r/dataengineering | 11 Mar 2021
    Speaking of Python, Rust has really good library and toolings (pyo03, maturin) to help write native Python modules. For example, we are able to create a Python binding for delta-rs with very little code: https://github.com/delta-io/delta-rs/tree/main/python.
    6 projects | reddit.com/r/dataengineering | 11 Mar 2021
    We recently on boarded two more engineers onto https://github.com/delta-io/delta-rs and https://github.com/delta-io/kafka-delta-ingest. It took them about 1 week of training to be productive with Rust. So I wouldn't be too concerned about hiring. We never explicitly hired for Rust developers, all our Rust developers learned the language on the fly.
    6 projects | reddit.com/r/dataengineering | 11 Mar 2021
  • Delta Lake essential Fundamentals: Part 1 - ACID
    3 projects | dev.to | 21 Feb 2021
    delta-rs - Rust library for binding with Python and Ruby.
  • Databricks Is an RDBMS
    4 projects | news.ycombinator.com | 1 Feb 2021
    > You cannot browse the data structure without an active cluster

    That's one of the reason's I'm interested in delta-rs [1], which has delta lake bindings for Python. Would love to read a delta lake table into a native python object without the need for spark.

    [1] https://github.com/delta-io/delta-rs

  • A note from our sponsor - InfluxDB
    www.influxdata.com | 9 Feb 2023
    InfluxDB is the Time Series Platform where developers build real-time applications for analytics, IoT and cloud-native services. Easy to start, it is available in the cloud or on-premises. Learn more →

Stats

Basic delta-rs repo stats
15
848
8.9
1 day ago
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com