others
casync
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
others
-
Backup software
Also see Restic's list of Linux backup software. https://github.com/restic/others
- Restic 0.14.0 released with compression support
-
Restic 0.13.0
There is also https://github.com/restic/others which has some keywords (e.g. is it encrypted, does it do compression) for most FOSS backup solutions. It can be outdated or incomplete for some entries, though.
-
What free and open source backup software do you recommend that works on Windows?
https://github.com/restic/others is a nice collection of free software links too - you can click through those and see if any are Windows supporting. But I'd personally just go with restic.
-
Backblaze for Personal Backup
Backblaze is an awful piece of software when you look at it from “a backup software” point of view. It’s made pretty, simple, native (or is it Electron now?) - yes. But then it stops there. On top of that if you read there ifs, buts, and gotchas you’d want to stay far away from them.
They’ve downright absurd data deletion/retention and versioning rules.
Besides I do not trust any service that promises to give anything “unlimited” for a fixed cost.
As I usually mention in comments on this topic - I’d strongly urge people to use and support backup tools like borgbackup.org (Vorta is an excellent Borg GUI), restic.net (a GUI is glaringly missing), kopia.io (up and coming; promising; comes with a GUI), for smaller datasets there’s very good but more expansive Tarsnap (not FOSS).
And then there are others - https://github.com/restic/others#list-of-backup-software
- Restic: Backups Done Right
- Deduplicating Archiver with Compression and Encryption
casync
-
We reduced conda’s index fetch bandwidth by 99%
For arbitrary state changes however, it's better to use something like casync. Note that there are a lot of tunables, implicit and explicit; for package indexing I would particularly think about "how is the index sorted" and "what is the desired chunk size".
-
Intro to Content Defined Chunking
If you just want something practical to play with, see casync. Even if it doesn't fit your workflow, or if you think you can do better, chances are you're best off building on top of it or adding patches to it, not starting from scratch.
-
Tool to clone file structure without the large files themselves?
You probably want casync.
-
A Nibble of Content-Defined Chunking - How de-duplicated, incremental file transfer works
Obligatory link to casync, which implements this better than most alternatives.
-
LibSQL – a fork of SQLite that is both Open Source, and Open Contributions
(personally, I think more people need to be aware of casync for the update storage/distribution problem. It isn't perfect for every use case, but it's good enough that you're probably better off wrapping/forking it rather than reimplementing it badly from scratch)
-
improving download infra
Does something like casync (https://github.com/systemd/casync or https://github.com/folbricht/desync) serve any purpose or provide any advantage to propagating rpm changes over rsync?
-
Are there any true alternatives to Seafile? (Nextcloud is not an alternative in this context)
Software that comes to mind for syncing lots of small files: git (and other source versioning tools), casync (https://github.com/systemd/casync) and a go implementation (https://github.com/folbricht/desync). Not really an answer and I can't think of a way to shoehorn that into your workflow, but maybe it leads you down a useful road.
- Casync – A Content-Addressable Data Synchronization Tool
-
Hacker News top posts: Apr 23, 2022
Casync – A Content-Addressable Data Synchronization Tool\ (15 comments)
What are some alternatives?
Neo-Backup - backup manager for android
kopia - Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.
bupstash - Easy and efficient encrypted backups.
tarsnap - Command-line client code for Tarsnap.
Rsnapshot - a tool for backing up your data using rsync (if you want to get help, use https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss)
desync - Alternative casync implementation
Duplicati - Store securely encrypted backups in the cloud!
zstd - Zstandard - Fast real-time compression algorithm
BorgBackup - Deduplicating archiver with compression and authenticated encryption.
magic-trace - magic-trace collects and displays high-resolution traces of what a process is doing