bees
snap-sync
bees | snap-sync | |
---|---|---|
21 | 15 | |
589 | 129 | |
- | - | |
4.0 | 0.0 | |
15 days ago | 3 months ago | |
C++ | Shell | |
GNU General Public License v3.0 only | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
bees
-
Converted ext4 to btrfs, tried defrag and ran out of space
Btrfs defrag 'will break up the reflinks of COW data' and 'may cause considerable increase of space usage depending on the broken up reflinks'. To try to fix this, I would run bees to try and deduplicate the now duplicate reflinks. It may be worth doing this from e.g. a livedisk though as out of space errors can cause things to break (so don't upgrade packages till you fix this).
-
Introducing Pins: Permanent Nix Binary Storage
Figuring out which paths are needed outside gcroots'ed closures is pretty complicated. If you're using flakes, the main issue is duplicates, so store optimization and bees may help. With channels, once you update a channel you might as well gc everything else.
-
rule
bees
- Should you remove duplicate files?
-
Poke holes in my git-annex + ZFS offline storage system
I felt more confident with the code/developer/docs. The author knows his stuff regarding btrfs. Like, look at this, it's amazing: https://github.com/Zygo/bees/blob/master/docs/btrfs-kernel.md
-
Anyone running Bees? Or deduping data some other way?
I have some time again and wondering if anyone's got Bees, https://github.com/Zygo/bees, running on their Synology.
-
The goal: Use Fedora 37 with Snapper to get a "riceable" Linux desktop that can be rolled back like a time machine (and some comments on why I don't use Silverblue)
Even if NixOS doesn't support sending deduplicating syscalls to the kernel, you could use the Btrfs deduping daemon called bees to slowly save space over time. There might be an equivalent for ZFS, too.
-
Questions Regarding BTRFS, Suspend, and Data Integrity
This isn't much different than ext4. 0 length files can happen after a crash. You can avoid this by mounting with flushoncommit for the future. See here for details.
-
Compression
Maybe BEES can help you to dedup any blocks, not file.
- Is Bees a after-solution to BTRFS defragmentation breaking reflinks ?
snap-sync
- BorgBackup 1.2.3 released
-
Incremental backup of snapper to external drive
- https://github.com/qubidt/snap-sync
-
Question about snapper
You might be interested in snap-sync. It is a bash script which accomplishes btrfs backups using snapper under the hood. So no need to use btrbk (but you get all the same functionality).
- What's a good way to backup a system running btrfs and snapper?
-
Backup strategy
I've been using snapper and snap-sync for automated snapshots and backups to an external drive. Recently, snap-sync is no longer maintained, and it may not be able to do some more things that I want to do, such as:
-
How to replace snap-sync?
I was actively using snap-sync to back up my files to a local hard drive. Unfortunately, snap-sync will be retired soon.
-
Reinstalled my F35 to BTRFS, looking for your thoughts and opinions for snapshot/backup solutions
I use snapper for snapshots and snap-sync for backing up said snapshots on an external drive.
-
"Install once, update forever"?
Yeah, I use snapshots for backups using snap-sync, which is a convenience script around btrfs send. Personally I use it to back up onto an external HDD, but it can also do remote backups over SSH. I'm just not sure if remote backups are incremental or not.
-
Let's talk about Btrfs.
On my laptop I make extensive use of openSUSE's snapper and the snap-sync script to sync to two external USB drives. Lastly, I wrote a script to clean/expire snapshots on the external volumes.
-
Have some question before moving to Fedora, hoping you guys can help
Snapshots aren't proper backups by themselves; they don't protect you from disk failure or the entire filesystem somehow being corrupted. It is possible to use them as backups; personally I use a command-line script called snap-sync to do this. This has the advantage of retaining the incremental nature of snapshots (though the incrementality will be on your backup media, so the first snapshot of a 100GB filesystem you put on your backup drive will take up 100GB of space), plus it integrates nicely with Snapper which is the snapshot utility I use.
What are some alternatives?
dduper - Fast block-level out-of-band BTRFS deduplication tool.
snapper - Manage filesystem snapshots and allow undo of system modifications
duperemove - Tools for deduping file systems
btrbk - Tool for creating snapshots and remote backups of btrfs subvolumes
grub-btrfs - Include btrfs snapshots at boot options. (Grub menu)
yarn-deduplicate - Deduplication tool for yarn.lock files
zfs - OpenZFS on Linux and FreeBSD
jdupes - A powerful duplicate file finder and an enhanced fork of 'fdupes'.
linux-timemachine - Rsync-based OSX-like time machine for Linux, MacOS and BSD for atomic and resumable local and remote backups
dedupe - :id: A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.
browsh - A fully-modern text-based browser, rendering to TTY and browsers