Our great sponsors
-
garage
(Mirror) S3-compatible object store for small self-hosted geo-distributed deployments. Main repo: https://git.deuxfleurs.fr/Deuxfleurs/garage (by deuxfleurs-org)
-
Seaweed File System
Discontinued SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. [Moved to: https://github.com/seaweedfs/seaweedfs] (by chrislusf)
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
pithos
Discontinued UNMAINTAINED - cassandra-backed object store. Retired backend for Exoscale's Simple Object Storage offering. (by exoscale)
-
MooseFS
MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
It was actually deliberate to present our project through the political lens, today.
You will find a more streamlined presentation of Garage on our landing page at https://garagehq.deuxfleurs.fr/
Technical details are also documented (although it is insufficient and needs an overhaul): https://garagehq.deuxfleurs.fr/documentation/design/
Thank you for your comments!
If you're still talking about SeaweedFS, the answer seems to simply be that it's not a "raft-based object store" as the parent described. That 'proxy' node you mention is a volume server itself, and replicates it's whole volume on another server. Upon replication failures, the data becomes read-only [1]. Raft is not used for the writes.
[1] https://github.com/chrislusf/seaweedfs/wiki/Replication
I've been looking through the available options for this use-case, with the same motivation given in this post, and was surprised to see there wasn't something which could fit this niche (until now!).
Really happy to see this being worked on by a dedicated team. Combined with a tool like https://github.com/slackhq/nebula this could help form the foundation of a fully autonomous, durable, online community.
And you are cordially invited to our chatroom on Matrix, if you want to hack around Garage: https://matrix.to/#/#garage:deuxfleurs.fr
We used to mostly talk French there - until yesterday!
MooseFS is designed for large files and can have a global goal of 1 copy (no replication)
https://moosefs.com/
Related posts
- SeaweedFS fast distributed storage system for blobs, objects, files and datalake
- Looking for recommendations for a image/document serving solution with a web interface for a lot of different users
- Simple self-hosted S3-compatible
- Selfhosted S3 Storage
- An open-source distributed object storage service