casync
Duplicati
Our great sponsors
casync | Duplicati | |
---|---|---|
17 | 22 | |
1,461 | 10,150 | |
0.7% | 2.1% | |
2.4 | 8.6 | |
4 months ago | 2 days ago | |
C | C# | |
- | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
casync
-
We reduced conda’s index fetch bandwidth by 99%
For arbitrary state changes however, it's better to use something like casync. Note that there are a lot of tunables, implicit and explicit; for package indexing I would particularly think about "how is the index sorted" and "what is the desired chunk size".
-
Intro to Content Defined Chunking
If you just want something practical to play with, see casync. Even if it doesn't fit your workflow, or if you think you can do better, chances are you're best off building on top of it or adding patches to it, not starting from scratch.
-
Tool to clone file structure without the large files themselves?
You probably want casync.
-
A Nibble of Content-Defined Chunking - How de-duplicated, incremental file transfer works
Obligatory link to casync, which implements this better than most alternatives.
-
LibSQL – a fork of SQLite that is both Open Source, and Open Contributions
(personally, I think more people need to be aware of casync for the update storage/distribution problem. It isn't perfect for every use case, but it's good enough that you're probably better off wrapping/forking it rather than reimplementing it badly from scratch)
-
improving download infra
Does something like casync (https://github.com/systemd/casync or https://github.com/folbricht/desync) serve any purpose or provide any advantage to propagating rpm changes over rsync?
-
Are there any true alternatives to Seafile? (Nextcloud is not an alternative in this context)
Software that comes to mind for syncing lots of small files: git (and other source versioning tools), casync (https://github.com/systemd/casync) and a go implementation (https://github.com/folbricht/desync). Not really an answer and I can't think of a way to shoehorn that into your workflow, but maybe it leads you down a useful road.
- Casync – A Content-Addressable Data Synchronization Tool
-
Hacker News top posts: Apr 23, 2022
Casync – A Content-Addressable Data Synchronization Tool\ (15 comments)
Duplicati
-
C# hakkında görüşleriniz ve ödevim
Petabaytlarca veri emanet edilen şu kodun %85'i C# https://github.com/duplicati/duplicati
-
Is there a non-beta version?
For my parents' computer, I'm using the canary version (which should be the alpha version I think?) of Duplicati since years.
-
Nextcloud noob: How can I auto backup photos & files to AWS/iCloud?
It hasn't had a release in a little while but work is still occurring. https://github.com/duplicati/duplicati/actions.
- Most used selfhosted services in 2022?
- Backup Windows PC to Minio/S3
-
Announcing Duplicati Dashboard
Hey have a read at : https://github.com/duplicati/duplicati/issues/4041
-
A Dummies Guide to Duplicati
I just came across this while looking through their issues to see if anyone else had reported the firefox issue i'm running into. I'm starting to have serious reservations.
- Apparently you cannot have the Kanye interview on Google Drive now
-
Borg vs Duplicacy (not Duplicati or Duplicity)?
I like duplicacy because of the way it keeps the chunks in the file system, without a special database. This makes it scale up really well no matter how many backups you have (you can even have multiple computers saved). It's kind of beyond weird how you select what you want to backup with the symlinks (using the command line version), looks more like what one would make for himself in a weekend (not that I'm complaining about free software!) but it's been without bugs for me and extremely efficient. In contrast duplicati has a perfect interface, it's well maintained and everything but bogs down in any large backup, has stories about people recovering for weeks for a very few local TBs and I've experienced for myself this, granted in the python that is checking the sha256 checksums of the backups but it makes it slower many times (possibly hundreds of times), nobody checked from 2013 to 2021 (or did it on tiny datasets like 1GB or was content to wait for weeks even on something small-ish)?
- C# library for centralized cloud storage syncing?
What are some alternatives?
kopia - Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.
BorgBackup - Deduplicating archiver with compression and authenticated encryption.
tarsnap - Command-line client code for Tarsnap.
UrBackup - UrBackup - Client/Server Open Source Network Backup for Windows, MacOS and Linux
zstd - Zstandard - Fast real-time compression algorithm
restic - Fast, secure, efficient backup program
desync - Alternative casync implementation
Duplicity - Unnoficial fork of Duplicity - Bandwidth Efficient Encrypted Backup
magic-trace - magic-trace collects and displays high-resolution traces of what a process is doing
rclone - "rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files
TimeShift - System restore tool for Linux. Creates filesystem snapshots using rsync+hardlinks, or BTRFS snapshots. Supports scheduled snapshots, multiple backup levels, and exclude filters. Snapshots can be restored while system is running or from Live CD/USB.