lizardfs
zfs
Our great sponsors
| lizardfs | zfs | |
|---|---|---|
| 4 | 719 | |
| 944 | 10,114 | |
| 0.2% | 1.2% | |
| 3.3 | 9.6 | |
| 7 months ago | 1 day ago | |
| C++ | C | |
| GNU General Public License v3.0 only | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
lizardfs
- Distributed Network File System
-
cloud storage "merged" on multiple VPSes
Have a look at https://github.com/lizardfs/lizardfs perhaps is what you want
- ZFS fans, rejoice—RAIDz expansion will be a thing very soon
-
Had to add a second sata card and upgrade to a 1600 watt power supply because spinning up 17 drives was too much for my poor 900 watt...
That's a lotta eggs to put in one basket. I started using LizardFS for mass storage and it basically allows me to grow/shrink easily. https://lizardfs.com/
zfs
-
Radxa's SATA HAT makes compact Pi 5 NAS
> The only non-junk PCIe3 option that's even advertised here recently is the overpriced WD Red SN700.
Those WD drives seem to have some real issues, at least with ZFS and btrfs. :(
- OpenZFS: Fix corruption caused by MMAP flushing problems
- ZFS: Some copied files are still corrupted (chunks replaced by zeros)
-
DiskClick: Ever wanted to hear Old Hard drive sounds
IMO the "next fs" is just zfs. They somewhat recently merged RAIDZ expansion feature https://github.com/openzfs/zfs/pull/12225 and make regular improvements. If no file system has what you need today, zfs will probably be the first one to have it "tomorrow," imo.
- OpenZFS bug reports for native encryption
-
A data corruption bug in OpenZFS?
https://github.com/openzfs/zfs/issues/15526#issuecomment-181...
> zpool get all tank | grep bclone
> kc3000 bcloneused 442M
> kc3000 bclonesaved 1.42G
> kc3000 bcloneratio 4.30x
> My understanding is this: If the result is 0 for both bcloneused and bclonesaved then it's safe to say that you don't have silent corruption.
-
Ask HN: What's your "it's not stupid if it works" story?
A couple years ago, I had an idea for convincing a filesystem to go faster using 2 compression steps instead of one. I couldn't see why it wouldn't work, and I also couldn't convince myself it should.
It seems to have worked out. [1]
[1] - https://github.com/openzfs/zfs/commit/f375b23c026aec00cc9527...
-
ZFS Profiling on Arch Linux
https://github.com/openzfs/zfs/issues/7631
This is a long-standing issue with zvols which affects overall system stability, and has no real solution as of yet.
-
Using ZFS on single disks, combining them with mergerfs, and paritizing them with Snapraid
TIL. Thank you! https://github.com/openzfs/zfs/pull/15022
-
Why does primarycache=metadata reduce my un-cached read speeds?
Difference may be significant, yes https://github.com/openzfs/zfs/pull/14243
What are some alternatives?
MooseFS - MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)
zstd - Zstandard - Fast real-time compression algorithm
Ceph - Ceph is a distributed object, block, and file storage platform
7-Zip-zstd - 7-Zip with support for Brotli, Fast-LZMA2, Lizard, LZ4, LZ5 and Zstandard
GlusterFS - Gluster Filesystem : Build your distributed storage in minutes
RocksDB - A library that provides an embeddable, persistent key-value store for fast storage.
Seaweed File System - SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. [Moved to: https://github.com/seaweedfs/seaweedfs]
sanoid - These are policy-driven snapshot management and replication tools which use OpenZFS for underlying next-gen storage. (Btrfs support plans are shelved unless and until btrfs becomes reliable.)
Apache Hadoop - Apache Hadoop
snapper - Manage filesystem snapshots and allow undo of system modifications
rozofs - Scale-out storage using erasure coding
zfsbootmenu - ZFS Bootloader for root-on-ZFS systems with support for snapshots and native full disk encryption