bita
Differential file synchronization over http (by oll3)
cdc-file-transfer
Tools for synching and streaming files from Windows to Linux (by google)
| bita | cdc-file-transfer | |
|---|---|---|
| 3 | 25 | |
| 259 | 2,958 | |
| - | 0.9% | |
| 6.8 | 0.0 | |
| about 2 months ago | about 1 month ago | |
| Rust | C++ | |
| MIT License | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
bita
Posts with mentions or reviews of bita.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-01-08.
-
CDC File Transfer
Built this cdc tool for software update of embedded (Linux) systems and have deployed it with good enough performance on a couple of arm CPUs; https://github.com/oll3/bita
Though main goal has been keeping data usage low rather than speed up.
-
rsync, article 3: How does rsync work?
Nice write up. rsync is great as an application but I found it more cumbersome to use when wanting to integrate it into my own application. There's librsync but the documentation is threadbare and it requires an rsync server to run. I found bita/bitar (https://github.com/oll3/bita) which is inspired by rsync & family. It works more like zsync which leverages HTTP Range requests so it doesn't require anything running on the server to get chunks. Works like a treat using s3/b2 storage to serve files and get incremental differential updates on the client side!
-
KySync: A complete modern C++ rewrite of Zsync with 3x-10x+ performance boost
Very cool, thanks for sharing. I did a deep dive in the past into various syncing/binary diff protocols and really liked zsync. It was probably my top choice for the application I was designing but I ended up not using it. The library I did use is called bita: https://github.com/oll3/bita. It is inspired by the same family of projects as zsync. The main advantage I found with bita is that the core logic is encapsulated in a library so that you don’t only have to use the binaries but can integrate it directly into an application. I’d be curious to know if that’s in the plans for KySync.
cdc-file-transfer
Posts with mentions or reviews of cdc-file-transfer.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-01-08.
-
Do you have any experience with cdc_rsync?
google/cdc-file-transfer: Tools for synching and streaming files from Windows to Linux (github.com)
-
Is it possible, and if so, is it common, to insert arbitrary bytes in a file?
I have been reading about contend defined chunking. If you look at Google's cdc-transfer and other tools that use content-defined-chunking (e.g. restic, kopia, borg), they talk about how great CDC is for insertions that would otherwise shift the boundaries.
-
Google Says it is Still -Committed to Games as an Industry-
While I am no fan of Google or Stadia, this is wrong. They open sourced the CDC file transfer software they used for syncing files from Windows to Linux.
- CDC File Transfer: "Born from the ashes of Stadia, this repository contains tools for syncing and streaming files from Windows to Linux. They are based on Content Defined Chunking (CDC), in particular FastCDC, to split up files into chunks."
- CDC File Transfer
-
Born from the ashes of Stadia, this repository contains tools for synching and streaming files from Windows to Linux.
The README has pretty good explanation of why it's better than rsync, and the animations help show exactly what the difference is.
- CDC File Transfer (a tool developed for Stadia)
What are some alternatives?
When comparing bita and cdc-file-transfer you can also consider the following projects:
yaydl - yet another youtube down loader (Git mirror)
got - Got is like git, but with an 'o'
imsy - simple incremental pull of immutable large files
humble-cli - 📦 The missing CLI for downloading your Humble Bundle purchases
d2 - D2 is a modern diagram scripting language that turns text to diagrams.
swupd-client - Software update client
Killed by Google - Part guillotine, part graveyard for Google's doomed apps, services, and hardware.
async-subscription-map - Async bookkeeping datastructure for dynamic state subscriptions across tasks
rsync - rsync algorithm in python
nazuna - 🐦 Download Twitter videos using your terminal!