zfs
| zfs-to-aws | zfs | |
|---|---|---|
| 4 | 721 | |
| 28 | 10,161 | |
| - | 1.0% | |
| 1.8 | 9.7 | |
| over 2 years ago | 2 days ago | |
| Shell | C | |
| - | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
zfs-to-aws
-
Show HN: Off-site, encrypted backups for $1/TB/month at 99.999999999% durability
I've created similar functionality just using bash that will send the lates version of ZFS datasets to S3/Glacier, including dealing with incremental changes. I have mentioned this previously on HN and got a few useful changes submitted for it, especially making it more platform agnostic.
I have some open tickets asking about restoring. I haven't tried this yet as this has been a backup of last resort for me, but hopefully posting this again will nudge me into looking at that.
https://github.com/agurk/zfs-to-aws/
- ZFS cloud storage
- Agurk/ZFS-to-AWS
-
Welcome Z3 – ZFS to S3 Backup/Restore Tool
For anyone who might be interested in doing this with fewer dependencies/tooling I have written a bash script that pushes ZFS snapshots to S3:
https://github.com/agurk/zfs-to-aws
I have it running in a cronjob on my NAS nightly, and a retention policy on aws to push it straight into glacier.
There's no restore script as this is my last line of backups, so I thought if I was restoring from here I'd want to do it manually. I might get around to writing one now however.
zfs
- OpenZFS 2.2.4 – Linux and FreeBSD – Advanced file system and volume manager
-
Ubuntu 24.04 LTS is so buggy you can't install the OS [video]
Be careful if you use ZFS-on-root, make sure not to snapshot bpool or it will brick your system and require a complete reinstall.
https://github.com/openzfs/zfs/issues/13873
-
Radxa's SATA HAT makes compact Pi 5 NAS
> The only non-junk PCIe3 option that's even advertised here recently is the overpriced WD Red SN700.
Those WD drives seem to have some real issues, at least with ZFS and btrfs. :(
https://github.com/openzfs/zfs/discussions/14793
- OpenZFS: Fix corruption caused by MMAP flushing problems
- ZFS: Some copied files are still corrupted (chunks replaced by zeros)
-
DiskClick: Ever wanted to hear Old Hard drive sounds
IMO the "next fs" is just zfs. They somewhat recently merged RAIDZ expansion feature https://github.com/openzfs/zfs/pull/12225 and make regular improvements. If no file system has what you need today, zfs will probably be the first one to have it "tomorrow," imo.
- OpenZFS bug reports for native encryption
-
A data corruption bug in OpenZFS?
https://github.com/openzfs/zfs/issues/15526#issuecomment-181...
> zpool get all tank | grep bclone
> kc3000 bcloneused 442M
> kc3000 bclonesaved 1.42G
> kc3000 bcloneratio 4.30x
> My understanding is this: If the result is 0 for both bcloneused and bclonesaved then it's safe to say that you don't have silent corruption.
-
Ask HN: What's your "it's not stupid if it works" story?
A couple years ago, I had an idea for convincing a filesystem to go faster using 2 compression steps instead of one. I couldn't see why it wouldn't work, and I also couldn't convince myself it should.
It seems to have worked out. [1]
[1] - https://github.com/openzfs/zfs/commit/f375b23c026aec00cc9527...
-
ZFS Profiling on Arch Linux
https://github.com/openzfs/zfs/issues/7631
This is a long-standing issue with zvols which affects overall system stability, and has no real solution as of yet.
What are some alternatives?
glacier_deep_archive_backup - Extremely low cost, off-site backup/restore using AWS S3 Glacier Deep Archive
zstd - Zstandard - Fast real-time compression algorithm
z3 - Backup your ZFS snapshots to S3.
7-Zip-zstd - 7-Zip with support for Brotli, Fast-LZMA2, Lizard, LZ4, LZ5 and Zstandard
rclone - "rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files
sanoid - These are policy-driven snapshot management and replication tools which use OpenZFS for underlying next-gen storage. (Btrfs support plans are shelved unless and until btrfs becomes reliable.)
ccheck - Simple, easy to use, minimal consistency checker (hasher) for file archives.
RocksDB - A library that provides an embeddable, persistent key-value store for fast storage.
zfs-to-glacier - A tool to sync zfs snapshots to s3-glacier, written in rust.
snapper - Manage filesystem snapshots and allow undo of system modifications
zfs3backup - Backup zfs snapshots to S3.
zfsbootmenu - ZFS Bootloader for root-on-ZFS systems with support for snapshots and native full disk encryption