casync VS bupstash

For arbitrary state changes however, it's better to use something like casync. Note that there are a lot of tunables, implicit and explicit; for package indexing I would particularly think about "how is the index sorted" and "what is the desired chunk size".

If you just want something practical to play with, see casync. Even if it doesn't fit your workflow, or if you think you can do better, chances are you're best off building on top of it or adding patches to it, not starting from scratch.

You probably want casync.

Obligatory link to casync, which implements this better than most alternatives.

(personally, I think more people need to be aware of casync for the update storage/distribution problem. It isn't perfect for every use case, but it's good enough that you're probably better off wrapping/forking it rather than reimplementing it badly from scratch)

Does something like casync (https://github.com/systemd/casync or https://github.com/folbricht/desync) serve any purpose or provide any advantage to propagating rpm changes over rsync?

Software that comes to mind for syncing lots of small files: git (and other source versioning tools), casync (https://github.com/systemd/casync) and a go implementation (https://github.com/folbricht/desync). Not really an answer and I can't think of a way to shoehorn that into your workflow, but maybe it leads you down a useful road.

Casync – A Content-Addressable Data Synchronization Tool\ (15 comments)

bupstash supports it, however I didn't try it out

https://github.com/andrewchambers/bupstash/blob/master/doc/g...

bupstash

I tried a few backup tools and https://github.com/andrewchambers/bupstash is my favorite by far but it's not that well known.

It was pretty fast already and recently got multithread support. It has been the only thing usable for backing up a few TB in a raspberry for performance reasons.

Keep in mind it's relatively new and the author does not yet recommend to use in production as the only backup solution.

bupstash (rust) - https://github.com/andrewchambers/bupstash

The authors bupstash[1] tool looks interesting.

I see there's an issue made for Windows support, how is that with Rust?

Unless it's doing low-level stuff like directory monitoring I assumed Rust would be quite portable?

[1]: https://github.com/andrewchambers/bupstash

Benchmarking my backup tool that was written in rust: https://github.com/andrewchambers/bupstash . Rust did not disappoint when it comes to performance, it seems to beat restic by a factor of 2x-200x depending on the benchmark.