imsy
cdc-file-transfer
Our great sponsors
| imsy | cdc-file-transfer | |
|---|---|---|
| 1 | 23 | |
| 8 | 2,809 | |
| - | 2.3% | |
| 10.0 | 10.0 | |
| 12 months ago | 8 days ago | |
| Go | C++ | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
imsy
-
CDC File Transfer
I did a similar thing a few years ago
It's less sophisticated but it uses the same core idea and the implementation is super simple
cdc-file-transfer
-
Born from the ashes of Stadia, this repository contains tools for synching and streaming files from Windows to Linux.
The README has pretty good explanation of why it's better than rsync, and the animations help show exactly what the difference is.
- Google made a tool like rsync which is 3x faster
-
CDC File Transfer
Slightly OT, but I like the schematic gifs used in the Readme.md (pretty amazing doc overall!) like this one [0]. Does anyone have suggestions what tools they might have used (or might be used in general) to create those?
[0] https://github.com/google/cdc-file-transfer/blob/main/docs/l...
The documentation in the code itself is pretty great as well:
https://github.com/google/cdc-file-transfer/blob/main/fastcd...
The same question was asked here: https://github.com/google/cdc-file-transfer/issues/56
We also ran the experiment with the native Linux rsync, i.e syncing Linux to Linux, to rule out issues with Cygwin. Linux rsync performed on average 35% worse than Cygwin rsync, which can be attributed to CPU differences.
Windows to Windows is being worked on, see https://github.com/google/cdc-file-transfer/compare/main...s....
Linux to Linux is also an option if there is demand, but currently it's Windows to Linux only.
What are some alternatives?
bita - Differential file synchronization over http
d2 - D2 is a modern diagram scripting language that turns text to diagrams.
got - Got is like git, but with an 'o'
tiflow - This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)
Killed by Google - Part guillotine, part graveyard for Google's doomed apps, services, and hardware.
zrepl - One-stop ZFS backup & replication solution
autorestic - Config driven, easy backup cli for restic.
pgcapture - A scalable Netflix DBLog implementation for PostgreSQL