casync
restic
casync | restic | |
---|---|---|
17 | 357 | |
1,462 | 23,836 | |
0.4% | 1.7% | |
2.4 | 9.7 | |
4 months ago | 2 days ago | |
C | Go | |
- | BSD 2-clause "Simplified" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
casync
-
We reduced conda’s index fetch bandwidth by 99%
For arbitrary state changes however, it's better to use something like casync. Note that there are a lot of tunables, implicit and explicit; for package indexing I would particularly think about "how is the index sorted" and "what is the desired chunk size".
-
Intro to Content Defined Chunking
If you just want something practical to play with, see casync. Even if it doesn't fit your workflow, or if you think you can do better, chances are you're best off building on top of it or adding patches to it, not starting from scratch.
-
Tool to clone file structure without the large files themselves?
You probably want casync.
-
A Nibble of Content-Defined Chunking - How de-duplicated, incremental file transfer works
Obligatory link to casync, which implements this better than most alternatives.
-
LibSQL – a fork of SQLite that is both Open Source, and Open Contributions
(personally, I think more people need to be aware of casync for the update storage/distribution problem. It isn't perfect for every use case, but it's good enough that you're probably better off wrapping/forking it rather than reimplementing it badly from scratch)
-
improving download infra
Does something like casync (https://github.com/systemd/casync or https://github.com/folbricht/desync) serve any purpose or provide any advantage to propagating rpm changes over rsync?
-
Are there any true alternatives to Seafile? (Nextcloud is not an alternative in this context)
Software that comes to mind for syncing lots of small files: git (and other source versioning tools), casync (https://github.com/systemd/casync) and a go implementation (https://github.com/folbricht/desync). Not really an answer and I can't think of a way to shoehorn that into your workflow, but maybe it leads you down a useful road.
- Casync – A Content-Addressable Data Synchronization Tool
-
Hacker News top posts: Apr 23, 2022
Casync – A Content-Addressable Data Synchronization Tool\ (15 comments)
restic
-
Building a Managed Service Provider Business With Open Source
Restic - GitHub
-
Ask HN: What is your approach for managing personal digital assets?
I religiously use Google contacts. It's the simplest way to keep people contacts up to date on Android.
I archive all important documents in specific folders by subject and date. This is backed up to back blaze with restic. https://restic.net/
I use https://ente.io for pictures. I convinced my wife to use it, and she agreed to auto share her photos so I don't nag her for copies. It had simple import from Facebook and Google.
I also keep extensive journals, which really helps to tie it all together. I can basically grep for hangouts, conversations, etc.
I also separate work journal from personal, and have essentially a journal for each project. https://jodavaho.io/tags/bullet-journal.html for how.
I religiously use Google calendar for all plans, you can easily search it for past events to get dates.
I also use monicahq for some notes about things I should remember about people but the habit never stuck.
- Restic – Backups Done Right
- Data corruption issue in restic 0.16.3 with max compression
- Rclone syncs your files to cloud storage
-
Duplicity
After Borg, I switched to Restic:
https://restic.net/
AFAIK, the only difference is that Restic doesn't require Restic installed on the remote server, so you can efficiently backup to things like S3 or FTP. Other than that, both are fantastic.
- Restic – Simple Backups
-
The Drive Stats of Backblaze Storage Pods
I'm curious, too. I know they've had some issues in the past:
https://github.com/restic/restic/issues/3268#issuecomment-78...
On the other hand, I tested around 15,000 backups last year (multiple hourly backups, daily tests) and they all passed.
- Selfhostate e avete un homelab?
-
best backup for ubuntu ?
I use and recommend restic. I use it for about 60 machines on my LAN, and it's absolutely fantastic.
What are some alternatives?
kopia - Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.
BorgBackup - Deduplicating archiver with compression and authenticated encryption.
tarsnap - Command-line client code for Tarsnap.
Duplicati - Store securely encrypted backups in the cloud!
desync - Alternative casync implementation
Duplicity - Unnoficial fork of Duplicity - Bandwidth Efficient Encrypted Backup
zstd - Zstandard - Fast real-time compression algorithm
magic-trace - magic-trace collects and displays high-resolution traces of what a process is doing
Duplicacy - A new generation cloud backup tool
Rsnapshot - a tool for backing up your data using rsync (if you want to get help, use https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss)