rsync
bita
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
rsync
bita
-
CDC File Transfer
Built this cdc tool for software update of embedded (Linux) systems and have deployed it with good enough performance on a couple of arm CPUs; https://github.com/oll3/bita
Though main goal has been keeping data usage low rather than speed up.
-
rsync, article 3: How does rsync work?
Nice write up. rsync is great as an application but I found it more cumbersome to use when wanting to integrate it into my own application. There's librsync but the documentation is threadbare and it requires an rsync server to run. I found bita/bitar (https://github.com/oll3/bita) which is inspired by rsync & family. It works more like zsync which leverages HTTP Range requests so it doesn't require anything running on the server to get chunks. Works like a treat using s3/b2 storage to serve files and get incremental differential updates on the client side!
-
KySync: A complete modern C++ rewrite of Zsync with 3x-10x+ performance boost
Very cool, thanks for sharing. I did a deep dive in the past into various syncing/binary diff protocols and really liked zsync. It was probably my top choice for the application I was designing but I ended up not using it. The library I did use is called bita: https://github.com/oll3/bita. It is inspired by the same family of projects as zsync. The main advantage I found with bita is that the core logic is encapsulated in a library so that you don’t only have to use the binaries but can integrate it directly into an application. I’d be curious to know if that’s in the plans for KySync.
What are some alternatives?
rsync - An open source utility that provides fast incremental file transfer. It also has useful features for backup and restore operations among many other use cases.
cdc-file-transfer - Tools for synching and streaming files from Windows to Linux
xxHash - Extremely fast non-cryptographic hash algorithm
yaydl - yet another youtube down loader (Git mirror)
imsy - simple incremental pull of immutable large files
humble-cli - 📦 The missing CLI for downloading your Humble Bundle purchases
swupd-client - Software update client
async-subscription-map - Async bookkeeping datastructure for dynamic state subscriptions across tasks
got - Got is like git, but with an 'o'
nazuna - 🐦 Download Twitter videos using your terminal!
ksync - [Moved to: https://github.com/kyotov/kysync]