-
sanoid
These are policy-driven snapshot management and replication tools which use OpenZFS for underlying next-gen storage. (Btrfs support plans are shelved unless and until btrfs becomes reliable.)
-
Seaweed File System
Discontinued SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. [Moved to: https://github.com/seaweedfs/seaweedfs] (by chrislusf)
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
you may want to look into using syncoid that is included in the excelent sanoid repo https://github.com/jimsalterjrs/sanoid
So I will probably use it or try something like SeaweedFS.
Related posts
-
ZFS took full backup (send/receive) without snapshots but now what to prevent another full transfer?
-
Automatic container snapshots? cv4pve or zfs for a small homelab?
-
[QUESTION] Dataset level replication
-
YSK: You can 'zfs send' over SSH to the cloud
-
New to ZFS, what layout to choose for 4x20TB drives?