cdc-file-transfer VS d2

The README has pretty good explanation of why it's better than rsync, and the animations help show exactly what the difference is.

https://github.com/google/cdc-file-transfer/compare/main...s...

Slightly OT, but I like the schematic gifs used in the Readme.md (pretty amazing doc overall!) like this one [0]. Does anyone have suggestions what tools they might have used (or might be used in general) to create those?

[0] https://github.com/google/cdc-file-transfer/blob/main/docs/l...

The documentation in the code itself is pretty great as well:

https://github.com/google/cdc-file-transfer/blob/main/fastcd...

The same question was asked here: https://github.com/google/cdc-file-transfer/issues/56

We also ran the experiment with the native Linux rsync, i.e syncing Linux to Linux, to rule out issues with Cygwin. Linux rsync performed on average 35% worse than Cygwin rsync, which can be attributed to CPU differences.

Source: https://github.com/google/cdc-file-transfer

Windows to Windows is being worked on, see https://github.com/google/cdc-file-transfer/compare/main...s....

Linux to Linux is also an option if there is demand, but currently it's Windows to Linux only.

I've been using https://structurizr.com/ to automatically generate C4 diagrams from a model (rather than drawing them by hand). It works well with the approach for written documentation as proposed in https://arc42.org/. It's very easy to embed a C4 diagram into a markdown document.

The result is a set of documents and diagrams under version control that can be rendered using the structurizr documentation server (for interactive diagrams and indexed search).

I also use https://d2lang.com/ for declarative diagrams in addition to C4, e.g., sequence diagrams and https://adr.github.io/ for architectural decision records. These are also well integrated into structurizr.

D2 is a modern declarative language for designing diagrams with text. It supports a variety of different diagram types as well as traditional UML sequence diagrams. D2 is free and open-source under the Mozilla Public License 2.0 license.

The issue I have with a lot of these tools is they work fine when depicting relationships between tables in the same schema (talking mainly about PostgreSQL databases), but few support showing relationships between tables across different schemas.

Also, when the number of tables grows large, few have layouts arranged in an optimal way. I use D2 (https://d2lang.com/) to create ERDs. However, of the free layout engines available in D2, Dagre (https://github.com/dagrejs/dagre) and ELK (https://github.com/eclipse/elk) both don't have optimal placement of layouts for a sufficiently complicated database.

There's always tools like https://d2lang.com/ which convert text to diagrams.

You're welcome in D2! I maintain a Text to diagram language, released a few months ago, 13k+ stars, I'm actively tagging issues that are good first issues, clean well-tested Go, and I'm happy to help you get that first merge in. Feel free to chime in on any issue that looks interesting! https://github.com/terrastruct/d2

but i hear ya. this is a v1, and already issues are being filed to make it easier to work with. will get better in the next release! https://github.com/terrastruct/d2/issues/1164

we do have an open issue for ports though, if you want to take a look and chime in there or let us know if you're looking for something different than what's described: https://github.com/terrastruct/d2/issues/628

Down to try this!

Posted a $220 bounty: https://github.com/terrastruct/d2/issues/921