imsy
simple incremental pull of immutable large files (by mkmik)
cdc-file-transfer
Tools for synching and streaming files from Windows to Linux (by google)
| imsy | cdc-file-transfer | |
|---|---|---|
| 1 | 25 | |
| 10 | 2,978 | |
| - | - | |
| 10.0 | 0.0 | |
| about 3 years ago | 10 months ago | |
| Go | C++ | |
| Apache License 2.0 | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
imsy
Posts with mentions or reviews of imsy.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-01-08.
-
CDC File Transfer
I did a similar thing a few years ago
https://github.com/mkmik/imsy
It's less sophisticated but it uses the same core idea and the implementation is super simple
cdc-file-transfer
Posts with mentions or reviews of cdc-file-transfer.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-01-08.
-
Do you have any experience with cdc_rsync?
google/cdc-file-transfer: Tools for synching and streaming files from Windows to Linux (github.com)
-
Is it possible, and if so, is it common, to insert arbitrary bytes in a file?
I have been reading about contend defined chunking. If you look at Google's cdc-transfer and other tools that use content-defined-chunking (e.g. restic, kopia, borg), they talk about how great CDC is for insertions that would otherwise shift the boundaries.
-
Google Says it is Still -Committed to Games as an Industry-
While I am no fan of Google or Stadia, this is wrong. They open sourced the CDC file transfer software they used for syncing files from Windows to Linux.
- CDC File Transfer: "Born from the ashes of Stadia, this repository contains tools for syncing and streaming files from Windows to Linux. They are based on Content Defined Chunking (CDC), in particular FastCDC, to split up files into chunks."
- CDC File Transfer
-
Born from the ashes of Stadia, this repository contains tools for synching and streaming files from Windows to Linux.
The README has pretty good explanation of why it's better than rsync, and the animations help show exactly what the difference is.
- CDC File Transfer (a tool developed for Stadia)
What are some alternatives?
When comparing imsy and cdc-file-transfer you can also consider the following projects:
pgcapture - A scalable Netflix DBLog implementation for PostgreSQL
bita - Differential file synchronization over http
tiflow - This repo maintains DM (a data migration platform) and TiCDC (change data capture for TiDB)
got - Got is like git, but with an 'o'
d2 - D2 is a modern diagram scripting language that turns text to diagrams.