cortx
Seaweed File System
Our great sponsors
| cortx | Seaweed File System | |
|---|---|---|
| 2 | 49 | |
| 632 | 14,960 | |
| - | - | |
| 0.0 | 9.9 | |
| 3 months ago | over 1 year ago | |
| Jupyter Notebook | Go | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
cortx
-
How do Commercial Open Source Startups manage GitHub insights > 14 days? Is everyone using a workaround? How are "unique" cloners and viewers kept track of?
This is what we did: https://github.com/Seagate/cortx/tree/main/metrics
-
The Wiretrustee SATA Pi Board Is a True SATA NAS
I keep hoping some day the drives will have their own networking built in. Kioxia, a Toshiba spin off, announced a network-attached NVMe-oF drive last September[1], and I seem to recall one of the major drive players had similar intents a bit back... ah yes, the Seagate Kinetic drives with dual 1Gbit[2] & an object storage OS built in to the drive. These days Seagate seems to be pushing a software platform CORTX[3], which I hope some day perhaps has hardware products too (but right now seems to be for classic linux-based network appliances)
Ideally we start using 5 or 10Gbit ethernet for these cases. We could continue to treat these drives like they are direct attached, even though they are network attached, and either have one computer running RAID, or have Ceph and a bunch of computers running it's distributed system to tap the drives.
Ideally though, we need new clustered file-systems, where any computer can read the drives. That is, I'd guess, a long way off. Legacy devices (home media players) would need to go through some kind of legacy gateway.
[1] https://business.kioxia.com/en-us/news/2020/ssd-20200922-2.h...
[2] https://www.snia.org/sites/default/files/MayurShelty_Seagate...
[3] https://github.com/Seagate/cortx
Seaweed File System
- An open-source distributed object storage service
-
Moving to github.com/seaweedfs/seaweedfs
FYI: Planning to move from github.com/chrislusf/seaweedfs to github.com/seaweedfs/seaweedfs in the coming days. It may cause some problem for package reference, building, documents, and links. Sorry for the change!
-
S3 Isn't Getting Cheaper
Besides storage itself, S3 API access cost can be high if frequently accessed. And latency is unpredicatble.
You can use SeaweedFS Remote Object Store Gateway to cache S3 (or any S3 API compatible vendors) to local servers, and access them at local network speed, and asynchronously sync back to S3.
https://github.com/chrislusf/seaweedfs/wiki/Gateway-to-Remot...
- ### Release 3.12 · chrislusf/seaweedfs
-
Minio in production
If you are looking at MinIO you might find SeaweedFS interesting as well.
- SeaweedFS and YDB
-
Cost effective managed key-value store?
I believe what you want is a horizontally scalable object store with tiered storage. SeaweedFS is free / open source https://github.com/chrislusf/seaweedfs
- A way to store and query large (up to 1GB) user defined objects.
-
Question: does anyone know Storage Provider with S3 as persistence layer?
I don't know if it fits all of your requests, but you can take a look at seaweedfs, which is pretty good
-
Introducing Garage, our self-hosted distributed object storage solution
Seaweedfs deserves a mention here for comparison as well.
What are some alternatives?
contributor_covenant - Pledge your respect and appreciation for contributors of all kinds to your open source project.
minio - The Object Store for AI Data Infrastructure
99-ML-Learning-Projects - A list of 99 machine learning projects for anyone interested to learn from coding and building projects
Ceph - Ceph is a distributed object, block, and file storage platform
QuantumKatas - Tutorials and programming exercises for learning Q# and quantum computing
GlusterFS - Web Content for gluster.org -- Deprecated as of September 2017
codeduel.org - I wish I had heard of this site! - Alexander Hamilton
MooseFS - MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)
Apache Hadoop - Apache Hadoop
seaweedfs - SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
lizardfs - LizardFS is an Open Source Distributed File System licensed under GPLv3.