Getting Started with Flink SQL, Apache Iceberg and DynamoDB Catalog

• flink-iceberg-playground

  1 6 5.0 Dockerfile

  minio as local storage and DynamoDB as catalog

• hudi

  20 5,066 9.9 Java

  Upserts, Deletes And Incremental Processing on Big Data.

  

Apache Iceberg is one of the three types of lakehouse, the other two are Apache Hudi and Delta Lake.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• flink-kubernetes-operator

  7 713 9.2 Java

  Apache Flink Kubernetes Operator

  

Due to the technology transformation we want to do recently, we started to investigate Apache Iceberg. In addition, the data processing engine we use in house is Apache Flink, so it's only fair to look for an experimental environment that integrates Flink and Iceberg.

• delta

  69 6,897 9.8 Scala

  An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs (by delta-io)

  

Apache Iceberg is one of the three types of lakehouse, the other two are Apache Hudi and Delta Lake.

Suggest a related project