Using rust for DE activities?

1. kafka-delta-ingest

   1 6 397 7.1 Rust

   A highly efficient daemon for streaming data from Kafka into Delta Lake

   

   Rust can offer incredible cost savings when you can use it in place of spark to interact with your delta lake. One such project was kafka-delta-ingest. The developers were able to reduce the cost of running the pipeline by over 90%. However, most of this stuff is still very experimental and not ready for production but you will definitely be seeing more projects like this just based on how much money can be saved.

2. InfluxDB

   www.influxdata.com featured

   InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

   

3. matano

   2 39 1,556 3.5 Rust

   Open source security data lake for threat hunting, detection & response, and cybersecurity analytics at petabyte scale on AWS

   

Suggest a related project