The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →
Top 23 ZFS Open-Source Projects
-
httm
Interactive, file-level Time Machine-like tool for ZFS/btrfs/nilfs2 (and even actual Time Machine backups!)
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
linstor-server
High Performance Software-Defined Block Storage for container, cloud and virtualisation. Fully integrated with Docker, Kubernetes, Openstack, Proxmox etc.
-
bastille
Bastille is an open-source system for automating deployment and management of containerized applications on FreeBSD.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
zfs_autobackup
ZFS autobackup is used to periodicly backup ZFS filesystems to other locations. Easy to use and very reliable.
-
zfs-localpv
Dynamically provision Stateful Persistent Node-Local Volumes & Filesystems for Kubernetes that is integrated with a backend ZFS data storage stack.
-
zfsbackup-go
Backup ZFS snapshots to cloud storage such as Google, Amazon, Azure, etc. Built with the enterprise in mind.
-
zamba-lxc-toolbox
Zamba LXC Toolbox a script collection to setup LXC containers on Proxmox + ZFS. Zamba is the fusion of ZFS and Samba (standalone, active directory dc or active directory member), preconfigured to access ZFS snapshots by "Previous Versions" to easily recover encrypted by ransomware files, accidently deleted files or just to revert changes.
-
zfs-inplace-rebalancing
Simple bash script to rebalance pool data between all mirrors when adding vdevs to a pool.
-
archuseriso
Toolkit for building bootable disk images of Arch Linux and for installing Arch Linux on USB disk or thumb drive.
-
Hardware
The devices I have, what runs on them, their configurations, issues, solutions, and associated projects
-
zfstools
Various ZFS scripts. Most notably, zfs-auto-snapshot, a ruby clone of OpenSolaris auto snapshotting
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: Titles are hard but collecting your favourite shows shouldn't be | /r/CuratedTumblr | 2023-06-08For storage options, most people either purchase a NAS (network attached storage) or re-purpose an older computer using either TrueNAS or unraid. If you're looking to just purchase one, the most popular brand is synology, but their models can be a bit pricey.
Project mention: Is my open-source project up to date with MIT license compliance and attribution? | /r/opensource | 2023-12-11My projects and many projects include a THIRD-PARTY-LICENSES.html file when I distribute binaries. See: https://github.com/kimono-koans/httm/blob/master/third_party/LICENSES_THIRD_PARTY.html
Project mention: Automatic container snapshots? cv4pve or zfs for a small homelab? | /r/Proxmox | 2023-06-23From my research, I can see two options: - Proxmox specific cv4pve-autosnap - generic zfs-auto-snapshot, available in repos
Project mention: 3 Advantages to Running FreeBSD as Your Server Operating System | news.ycombinator.com | 2023-08-15> FreeBSD jails don't have a one-command way to install a preconfigured jail for a specific service
FreeBSD does have that tool, its BastilleBSD: https://bastillebsd.org/
For example, this is the Bastillefile for running consul: https://gitlab.com/bastillebsd-templates/consul/-/blob/maste...
We use a couple nice home-grown functions in ZFSBootMenu to help debug things. We have a zdebug logging function that's peppered liberally throughout the code base - https://github.com/zbm-dev/zfsbootmenu/blob/master/zfsbootme...
Hitting ctrl-t on our main menu will, when booting with debug logging enabled, show a screen like this: https://imgur.com/Ge75zkP
We also have a flamegraph profiling mechanism that can be enabled with https://github.com/zbm-dev/zfsbootmenu/blob/master/zfsbootme... . That will dump data to a serial port, which when re-assembled, can be used to produce a graph like https://raw.githubusercontent.com/zbm-dev/zfsbootmenu/master...
Bash is suprisingly flexible.
The interface software regarding is not a worry of mine, as democratic-csi does the storage management for me, thus the compatibility it is not limited to the application using the storage per se, as this is handled by Kubernete's CSI drivers, being application-agnostic when utilizing the storage provided.My main worry is not latency, but rather RAM
Project mention: zrepl: A one-stop, integrated solution for ZFS replication | news.ycombinator.com | 2023-08-22I have rather nice experience with ZnapZend https://www.znapzend.org/
Only issue i've found is the fact there is no official Debian repository and i always do forget to recompile it after upgrading Debian :-D
I really like the configuration system integrated in ZFS set/get...
Project mention: Is It Good Practice to Back Up Data Sets Manually on Cold Storage Externals? | /r/truenas | 2023-12-10I recommend you to get familiar with https://github.com/psy0rz/zfs_autobackup/wiki first and then use the configuration you are happy with in my script.
I use it in Kubernetes via https://github.com/openebs/zfs-localpv
The PersistentVolume API is a nice way to divvy up a shared resource across different teams, and using ZFS for that gives us the snapshotting, deduplication, and compression for free. For our workloads, it benchmarked faster than XFS so it was a no-brainer.
I use this and works without issue: https://github.com/bashclub/zamba-lxc-toolbox
Project mention: Is there a recommended way of syncing installed packages and configs? Portable user homes? | /r/archlinux | 2023-09-14see the ArchTitus project from ChrisTitus Tech https://github.com/ChrisTitusTech/ArchTitus . basically a git repo with everything. Just git clone and install. Or use something link archuseriso https://github.com/laurent85v/archuseriso and make your own iso.
Project mention: Help with NAS choice for Backups and Plex with ability to transcode | /r/HomeNetworking | 2023-11-18I've read this guide which has been helpful. I'm familiar with building a pc, but still want to make sure I build something reasonable if that would be more cost effective in the long run for my use.
ZFS related posts
- Bash Debugging
- Is my open-source project up to date with MIT license compliance and attribution?
- Is It Good Practice to Back Up Data Sets Manually on Cold Storage Externals?
- ZFS and Proxmox Questions
- ZFS silent corruption bug found: replaces chunks inside copied files by zeroes
- Are you running Linux with a filesystem capable of block cloning/FICLONE (ZFS >= 2.2, XFS, BTRFS)?
- Help with NAS choice for Backups and Plex with ability to transcode
-
A note from our sponsor - WorkOS
workos.com | 22 Apr 2024
Index
What are some of the best open-source ZFS projects? This list will help you:
Project | Stars | |
---|---|---|
1 | middleware | 2,200 |
2 | httm | 1,194 |
3 | zrepl | 895 |
4 | zfs-auto-snapshot | 822 |
5 | linstor-server | 816 |
6 | bastille | 760 |
7 | zfsbootmenu | 752 |
8 | democratic-csi | 730 |
9 | znapzend | 596 |
10 | zfs_autobackup | 520 |
11 | zfs-localpv | 366 |
12 | FreeNAS-scripts | 319 |
13 | zfsbackup-go | 318 |
14 | zamba-lxc-toolbox | 250 |
15 | freenas-proxmox | 220 |
16 | zfs-inplace-rebalancing | 215 |
17 | archuseriso | 205 |
18 | zectl | 187 |
19 | archiso-zfs | 163 |
20 | Hardware | 161 |
21 | zfs_exporter | 148 |
22 | zfstools | 140 |
23 | vpsadminos | 139 |
Sponsored