Pravega
tidb-pravega-quick-start
Pravega | tidb-pravega-quick-start | |
---|---|---|
2 | 1 | |
1,966 | 4 | |
0.1% | - | |
8.3 | 0.0 | |
about 1 month ago | almost 3 years ago | |
Java | ||
Apache License 2.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Pravega
-
Building a Real-Time Data Warehouse with TiDB and Pravega
Open sourced by Dell EMC, Pravega is a stream storage system and a Cloud Native Computing Foundation (CNCF) sandbox project. It is similar to Kafka and Apache Pulsar and provides stream and schema registry. But Pravega offers more functionalities:
- An opinionated map of incremental and streaming systems (2018)
tidb-pravega-quick-start
-
Building a Real-Time Data Warehouse with TiDB and Pravega
In this article, I'll introduce Pravega, a distributed stream storage system, and TiDB, a distributed SQL database. This combination resolves Kafka's data persistence dilemma and provides auto scaling capabilities, improving concurrency, usability, and security for real-time data warehouses. I also provide a docker-compose demo for you to try Pravega and TiDB. I hope you find this article helpful.
What are some alternatives?
kafka-streams-in-action - Source code for the Kafka Streams in Action Book
Alluxio (formerly Tachyon) - Alluxio, data orchestration for analytics and machine learning in the cloud
Seaweed File System - SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. [Moved to: https://github.com/seaweedfs/seaweedfs]
GlusterFS - Gluster Filesystem : Build your distributed storage in minutes
Camlistore - Perkeep (née Camlistore) is your personal storage system for life: a way of storing, syncing, sharing, modelling and backing up content.
Ceph - Ceph is a distributed object, block, and file storage platform
Tahoe-LAFS - The Tahoe-LAFS decentralized secure filesystem.
Go IPFS - IPFS implementation in Go [Moved to: https://github.com/ipfs/kubo]
huststore - High-performance Distributed Storage
MogileFS
OpenAFS - Fork of OpenAFS from git.openafs.org for visualization
LeoFS - The LeoFS Storage System