rsync, article 3: How does rsync work?

1. rsync

   1 1 40 2.5 Python

   rsync algorithm in python (by lloeki)

   

2. InfluxDB

   www.influxdata.com featured

   InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

   

3. rsync

   2 45 3,515 8.5 C

   An open source utility that provides fast incremental file transfer. It also has useful features for backup and restore operations among many other use cases.

   

4. xxHash

   3 30 9,840 9.0 C

   Extremely fast non-cryptographic hash algorithm

   

5. bita

   4 3 280 6.4 Rust

   Differential file synchronization over http

   

   Nice write up. rsync is great as an application but I found it more cumbersome to use when wanting to integrate it into my own application. There's librsync but the documentation is threadbare and it requires an rsync server to run. I found bita/bitar (https://github.com/oll3/bita) which is inspired by rsync & family. It works more like zsync which leverages HTTP Range requests so it doesn't require anything running on the server to get chunks. Works like a treat using s3/b2 storage to serve files and get incremental differential updates on the client side!

Suggest a related project