zfs
middleware
Our great sponsors
zfs | middleware | |
---|---|---|
719 | 171 | |
10,114 | 2,200 | |
1.2% | 0.6% | |
9.6 | 9.9 | |
6 days ago | 6 days ago | |
C | Python | |
GNU General Public License v3.0 or later | GNU Lesser General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
zfs
-
Radxa's SATA HAT makes compact Pi 5 NAS
> The only non-junk PCIe3 option that's even advertised here recently is the overpriced WD Red SN700.
Those WD drives seem to have some real issues, at least with ZFS and btrfs. :(
https://github.com/openzfs/zfs/discussions/14793
- OpenZFS: Fix corruption caused by MMAP flushing problems
- ZFS: Some copied files are still corrupted (chunks replaced by zeros)
-
DiskClick: Ever wanted to hear Old Hard drive sounds
IMO the "next fs" is just zfs. They somewhat recently merged RAIDZ expansion feature https://github.com/openzfs/zfs/pull/12225 and make regular improvements. If no file system has what you need today, zfs will probably be the first one to have it "tomorrow," imo.
- OpenZFS bug reports for native encryption
-
A data corruption bug in OpenZFS?
https://github.com/openzfs/zfs/issues/15526#issuecomment-181...
> zpool get all tank | grep bclone
> kc3000 bcloneused 442M
> kc3000 bclonesaved 1.42G
> kc3000 bcloneratio 4.30x
> My understanding is this: If the result is 0 for both bcloneused and bclonesaved then it's safe to say that you don't have silent corruption.
-
Ask HN: What's your "it's not stupid if it works" story?
A couple years ago, I had an idea for convincing a filesystem to go faster using 2 compression steps instead of one. I couldn't see why it wouldn't work, and I also couldn't convince myself it should.
It seems to have worked out. [1]
[1] - https://github.com/openzfs/zfs/commit/f375b23c026aec00cc9527...
-
ZFS Profiling on Arch Linux
https://github.com/openzfs/zfs/issues/7631
This is a long-standing issue with zvols which affects overall system stability, and has no real solution as of yet.
-
Using ZFS on single disks, combining them with mergerfs, and paritizing them with Snapraid
TIL. Thank you! https://github.com/openzfs/zfs/pull/15022
-
Why does primarycache=metadata reduce my un-cached read speeds?
Difference may be significant, yes https://github.com/openzfs/zfs/pull/14243
middleware
-
Titles are hard but collecting your favourite shows shouldn't be
For storage options, most people either purchase a NAS (network attached storage) or re-purpose an older computer using either TrueNAS or unraid. If you're looking to just purchase one, the most popular brand is synology, but their models can be a bit pricey.
-
I want to turn old PC into a NAS
https://www.truenas.com/ if you just want to use it as network storage.
-
NAS Recommendations?
Synology if you need prebuilt. If you want to build DIY NAS, take a case that can hold as many drives as you want, take a consumer-grade mobo and Intel/AMD CPU (really doesn't matter for NAS), purchase 1 x SSD for OS and as many drives as you need, deploy something like TrueNAS (https://www.truenas.com/) or Starwinds SAN and NAS (https://www.starwindsoftware.com/san-and-nas), configure RAID (for redundancy, preferably RAID-6) and share the storage to your NUC as iSCSI/NFS/SMB. The second option will require some effort to accomplish but will be more flexible and deliver more performance.
-
Hardware/Software recommendations
There is no such thing as an ideal OS. Some of the products are better in some of the areas, while other software is better in other areas. For example, Proxmox is the virtualization platform that is targeting virtualization needs. It has support for software RAID, but it doesn't mean that this is the primary feature that is constantly developed. Any NAS OS basically doing the same but targeting storage and sharing things over the virtualization or anything else. So, you need to use whatever is better for the particular use case. Use proxmox on the virtualization host and NAS OS as a storage engine. Or run hypervisor and NAS OS as the VM. As per the alternatives to OMV, you can take a look at Starwinds SAN and NAS (https://www.starwindsoftware.com/san-and-nas), TrueNAS (https://www.truenas.com/), or even pure Debian + Cockpit (https://cockpit-project.org/)
-
New home lab
The second is storage. If you need any of the storage sharing, deploy NAS OS as the VM in proxmox, like Starwinds SAN and NAS (https://www.starwindsoftware.com/san-and-nas) or OMV (https://www.openmediavault.org/), or TrueNAS (https://www.truenas.com/). As you mentioned, you need to cross-flash the perc into IT mode and pass through the controller into VM, but you need a separate from the controller drive for proxmox to be able to PCI-E passthrough the card into VM. Then, configure software RAID and reshare the storage to the proxmox via NFS/iSCSI (that will improve your skills in storage stack and storage protocols).
-
UNRAID or OMV?
You can also go another route with Proxmox and NAS OS as a VM. TrueNAS or Starwinds SAN&NAS can be used. https://www.truenas.com/
-
Critique/advice on proposed home network setup please.
You would need some sort of NAS device to act as a file server (you obviously can't just plug a HDD directly into a switch). Some consumer routers have USB ports where you can plug in an external HDD, though they frequently have speed issues with the USB ports. You could buy something from QNAP, Synology, etc. or build your own TrueNAS.
-
Best NAS other than Synology 920
I run plex on my lab, but if I didn't have that, I would probably buy a cheap server and run TrueNAS. https://www.truenas.com/ I personally have a whole vmware network using it for storage, but as just a plex server with a bunch of storage would be a viable alternative for a single host and have the storage plus the raid benefits of not having to worry about disk failures.
-
Stripe Block Size RAID 5
Take a look at TrueNAS or Starwinds SAN&NAS as a NAS OS options. https://www.truenas.com/
-
Poor storage performance on nested vSphere lab :( - need help interpreting tests and finding root cause
Windows built-in iSCSI server is slow. If you don't mind replacing it, try using TrueNAS, Starwinds SAN&NAS, or even Linux (Ubuntu Server) VM running the iSCSI target server. Either solution should overperform the Windows alternative.
What are some alternatives?
zstd - Zstandard - Fast real-time compression algorithm
filemanager - 📂 Web File Browser
7-Zip-zstd - 7-Zip with support for Brotli, Fast-LZMA2, Lizard, LZ4, LZ5 and Zstandard
vaultwarden - Unofficial Bitwarden compatible server written in Rust, formerly known as bitwarden_rs
sanoid - These are policy-driven snapshot management and replication tools which use OpenZFS for underlying next-gen storage. (Btrfs support plans are shelved unless and until btrfs becomes reliable.)
OpenMediaVault - openmediavault is the next generation network attached storage (NAS) solution based on Debian Linux. Thanks to the modular design of the framework it can be enhanced via plugins. openmediavault is primarily designed to be used in home environments or small home offices.
RocksDB - A library that provides an embeddable, persistent key-value store for fast storage.
democratic-csi - csi storage for container orchestration systems
snapper - Manage filesystem snapshots and allow undo of system modifications
zabbix-nfs - Template for zabbix to check nfs share availability
zfsbootmenu - ZFS Bootloader for root-on-ZFS systems with support for snapshots and native full disk encryption
catalog - This is JUST the catalog, please refer to truecharts/apps for the actuall app code!