minikeyvalue
gcsfuse
| minikeyvalue | gcsfuse | |
|---|---|---|
| 18 | 31 | |
| 2,873 | 1,981 | |
| - | 0.9% | |
| 0.0 | 9.7 | |
| 3 months ago | about 19 hours ago | |
| Go | Go | |
| MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
minikeyvalue
- A 4+1 node storage cluster intended for AI ingest datasets. What platform should we use? (ceph, btrfs, OpenZFS, TruNas Scale?
-
File Systems implemented in Go
minikeyvalue - A ~1000 line distributed key value store.
-
Could people put where they are from approximately on their posts because its pointless for some of us to answer questions from people in India.
Sure, you can do something like this in 1000 LOC, but it seems unlikely that a uni student would be writing that type of program.
- minikeyvalue
-
A distributed key value store in under 1000 lines open-sourced by comma.ai
Hrm. How does the distributed part work? I'm somewhat confused there. I've opened an issue to ask about this too.
Handling errors with "ugh"
- A distributed key value store in under 1000 lines
gcsfuse
-
Gcsfuse: A user-space file system for interacting with Google Cloud Storage
It uses FUSE and there's three types of Kernel cache you could use with FUSE (although, it seems like gcsfuse is exposing only one):
1. Cache of file attributes in the Kernel (this is controlled by "stat-cache-ttl" value - https://github.com/GoogleCloudPlatform/gcsfuse/blob/7dc5c7ff...)
-
Does Cloud file store have life cycle management feature ?
You're looking at Filestore because your software can only write to a mounted file system? If so, you could mount a Google Cloud Storage bucket with Fuse. I haven't used Fuse myself in production, but it may be worth trying out for your workload.
-
Google Cloud Storage FUSE
Is this the same gcsfuse that's been around for years, only now with official Google support?
https://github.com/GoogleCloudPlatform/gcsfuse
- Suggestions on data transfer between VM instances
-
RANT: MICROSOFT'S INABILITY TO SUPPORT THEIR OWN HARDWARE IS GOING TO KILL ME
I'm pretty sure the storage for a stopped VM vs a disk image will be the same. Cheaper if you can store your data in GCS bucket? Take a look at GCS-Fuse to mount storage buckets into a VM.
-
Ongoing Incident in Google Cloud
Currently being tracked here: https://github.com/GoogleCloudPlatform/gcsfuse/issues/961
What are some alternatives?
LevelDB - LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.
google-drive-ocamlfuse - FUSE filesystem over Google Drive
tinygrad - You like pytorch? You like micrograd? You love tinygrad! ❤️ [Moved to: https://github.com/tinygrad/tinygrad]
goofys - a high-performance, POSIX-ish Amazon S3 file system written in Go
openpilot - openpilot is an open source driver assistance system. openpilot performs the functions of Automated Lane Centering and Adaptive Cruise Control for 250+ supported car makes and models.
juicefs - JuiceFS is a distributed POSIX file system built on top of Redis and S3.
mynewt-nimble - Apache mynewt
afero - A FileSystem Abstraction System for Go
Apache Tomcat - Apache Tomcat
fsnotify - Cross-platform file system notifications for Go.
distribkv - Distributed key-value database in Go
go-systemd - Go bindings to systemd socket activation, journal, D-Bus, and unit files