InfluxDB is the Time Series Platform where developers build real-time applications for analytics, IoT and cloud-native services. Easy to start, it is available in the cloud or on-premises. Learn more →
Delta-rs Alternatives
Similar projects and alternatives to delta-rs
-
delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs (by delta-io)
-
materialize
Materialize is a fast, distributed SQL database built on streaming internals. (by MaterializeInc)
-
InfluxDB
Build time-series-based applications quickly and at scale.. InfluxDB is the Time Series Platform where developers build real-time applications for analytics, IoT and cloud-native services. Easy to start, it is available in the cloud or on-premises.
-
roapi
Create full-fledged APIs for slowly moving datasets without writing a single line of code.
-
ballista
Distributed compute platform implemented in Rust, and powered by Apache Arrow.
-
kafka-delta-ingest
A highly efficient daemon for streaming data from Kafka into Delta Lake
-
connectors
This library allows Scala and Java-based projects (including Apache Flink, Apache Hive, Apache Beam, and PrestoDB) to read from and write to Delta Lake.
-
SonarQube
Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.
-
-
-
polars
Fast multi-threaded, hybrid-out-of-core DataFrame library in Rust | Python | Node.js
-
-
Mage
🧙 The modern replacement for Airflow. Mage is an open-source data pipeline tool for transforming and integrating data. https://github.com/mage-ai/mage-ai
-
-
-
os-lib
OS-Lib is a simple, flexible, high-performance Scala interface to common OS filesystem and subprocess APIs
-
-
dbx
🧱 Databricks CLI eXtensions - aka dbx is a CLI tool for development and advanced Databricks workflows management.
-
-
parquet2
Fastest and safest Rust implementation of parquet. `unsafe` free. Integration-tested against pyarrow
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better delta-rs alternative or higher similarity.
delta-rs reviews and mentions
Posts with mentions or reviews of delta-rs.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-01-24.
- Delta without using Spark
-
Spark open source community is awesome
Yea, there are tons of employees from companies that have made massive contributions to the Spark ecosystem. Apple built Delta Lake with Databricks, see this video for more detail. Lots of Spark PMCs are from various companies. delta-rs was initially built by Scribd and is now actively maintained by engineers at Voltron & other companies. It's awesome the community has so many contributors from various sources.
-
Snowpark equivalent on Databricks?
Have a look at this https://delta-io.github.io/delta-rs/python/
-
Rust is showing a lot of promise in the DataFrame / tabular data space
I'm working on [delta-rs](https://github.com/delta-io/delta-rs) which brings the power of Delta Lake to the Rust community. CSV / Parquet lakes are limited and Delta Lakes offer a ton of advantages (versioned data, time travel, ACID transactions, schema enforcement, etc). We're working to bring full Polars and DataFusion support to delta-rs, see the roadmap.
-
Tipsy ramblings on Databricks' "Lakehouse"
Not sure if OP has come across this python library https://github.com/delta-io/delta-rs. With this library you can read delta tables stored in buckets and put them in pandas dataframe without all the Spark hassles.
-
Rust for DE?
Speaking of Python, Rust has really good library and toolings (pyo03, maturin) to help write native Python modules. For example, we are able to create a Python binding for delta-rs with very little code: https://github.com/delta-io/delta-rs/tree/main/python.
We recently on boarded two more engineers onto https://github.com/delta-io/delta-rs and https://github.com/delta-io/kafka-delta-ingest. It took them about 1 week of training to be productive with Rust. So I wouldn't be too concerned about hiring. We never explicitly hired for Rust developers, all our Rust developers learned the language on the fly.
-
Delta Lake essential Fundamentals: Part 1 - ACID
delta-rs - Rust library for binding with Python and Ruby.
-
Databricks Is an RDBMS
> You cannot browse the data structure without an active cluster
That's one of the reason's I'm interested in delta-rs [1], which has delta lake bindings for Python. Would love to read a delta lake table into a native python object without the need for spark.
-
A note from our sponsor - InfluxDB
www.influxdata.com | 9 Feb 2023
Stats
Basic delta-rs repo stats
15
848
8.9
1 day ago
delta-io/delta-rs is an open source project licensed under Apache License 2.0 which is an OSI approved license.
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com