minikeyvalue
goseaweedfs
minikeyvalue | goseaweedfs | |
---|---|---|
18 | 9 | |
2,873 | 113 | |
- | - | |
0.0 | 0.0 | |
3 months ago | over 1 year ago | |
Go | Go | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
minikeyvalue
- A 4+1 node storage cluster intended for AI ingest datasets. What platform should we use? (ceph, btrfs, OpenZFS, TruNas Scale?
-
File Systems implemented in Go
minikeyvalue - A ~1000 line distributed key value store.
-
Could people put where they are from approximately on their posts because its pointless for some of us to answer questions from people in India.
Sure, you can do something like this in 1000 LOC, but it seems unlikely that a uni student would be writing that type of program.
- minikeyvalue
-
A distributed key value store in under 1000 lines open-sourced by comma.ai
Hrm. How does the distributed part work? I'm somewhat confused there. I've opened an issue to ask about this too.
Handling errors with "ugh"
- A distributed key value store in under 1000 lines
goseaweedfs
-
How data is stored in S3, RDS and DynamiDB.
You can check SeaweedFS https://github.com/chrislusf/seaweedfs
-
Top 200 Kubernetes Tools for DevOps Engineer Like You
ChubaoFS - distributed file system and object storage Longhorn - Cloud-Native distributed block storage built on and for Kubernetes OpenEBS - Kubernetes native - hyperconverged block storage with multiple storage engines Rook - Storage Orchestration for Kubernetes SeaweedFS - Distributed file system supports read-write many volumes TiKV - Distributed transactional key-value database velero - Backup and migrate Kubernetes applications and their persistent volumes Vitess - Vitess is a database clustering system for horizontal scaling of MySQL kaDalu - A lightweight Persistent storage solution for Kubernetes / OpenShift using GlusterFS in background
-
File Systems implemented in Go
seaweedfs - SeaweedFS is a simple and highly scalable distributed file system for small files.
-
File system with permanent public random uuid url
Seaweedfs looks quite promising but its public url uuid is in the form of <32-bit volume, 64-bit file key, 32-bit file cookie>. The volume is probably fixed most of the time, the file key is an incrementing number while the file cookie is random. 32-bit seems too small to prevent guessing.
-
MinIO: A Bare Metal Drop-In for AWS S3
MinIO team care about an issue if you are paid customer, not for people who use the open source. Indeed MinIO is not even fully S3 compatible with many edge cases and close the issues related to it by saying it’s not a priority.
You might want to look at other options as well like SeaweedFS [0] a POSIX compliant S3 compatible distributed file system.
[0] https://github.com/chrislusf/seaweedfs
-
Tools & Info for Sysadmins - MS Mac Downloads, Cabling Tip, CSP Cheatsheet & More
SeaweedFS is a fast, distributed storage system for blobs, objects, files and data that stores/serves billions of files. Can transparently integrate with the cloud with both fast local access and elastic cloud storage capacity. Blob store has O(1) disk seek, local and cloud tiering. Filer supports cross-cluster active-active replication, Kubernetes, POSIX, S3 API, encryption, Erasure Coding for warm storage, FUSE mount, Hadoop and WebDAV. chrislusf finds "it is much faster than the 'high performance' Minio."
-
Finding smaller open source projects
welcome to help with https://github.com/chrislusf/seaweedfs
-
Using a disk-backed Redis alternative to reduce AWS S3 bill
(I work on SeaweedFS) How about using SeaweedFS? https://github.com/chrislusf/seaweedfs
With your dedicated server, the latency is consistent, No API/network cost. Extra data can be tiered to S3.
Basically it is a key-file store.
https://github.com/chrislusf/seaweedfs/wiki/Filer-as-a-Key-L...
https://github.com/chrislusf/seaweedfs/wiki/Cloud-Tier
-
Minio has changed is license - what are the best alternatives? update license change for MinIO · minio/minio@0694325
I am working on SeaweedFS. But seriously, use http://github.com/chrislusf/seaweedfs
What are some alternatives?
LevelDB - LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.
Seaweed File System - SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. [Moved to: https://github.com/seaweedfs/seaweedfs]
tinygrad - You like pytorch? You like micrograd? You love tinygrad! ❤️ [Moved to: https://github.com/tinygrad/tinygrad]
goofys - a high-performance, POSIX-ish Amazon S3 file system written in Go
openpilot - openpilot is an open source driver assistance system. openpilot performs the functions of Automated Lane Centering and Adaptive Cruise Control for 250+ supported car makes and models.
minio - The Object Store for AI Data Infrastructure
mynewt-nimble - Apache mynewt
k8s - How to deploy Portainer inside a Kubernetes environment.
Apache Tomcat - Apache Tomcat
cachenator - Distributed, sharded in-memory cache and proxy for S3
distribkv - Distributed key-value database in Go
fsnotify - Cross-platform file system notifications for Go.