casync
tarsnap
Our great sponsors
casync | tarsnap | |
---|---|---|
17 | 11 | |
1,463 | 844 | |
0.8% | 0.4% | |
2.4 | 8.4 | |
4 months ago | 19 days ago | |
C | C | |
- | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
casync
-
We reduced conda’s index fetch bandwidth by 99%
For arbitrary state changes however, it's better to use something like casync. Note that there are a lot of tunables, implicit and explicit; for package indexing I would particularly think about "how is the index sorted" and "what is the desired chunk size".
-
Intro to Content Defined Chunking
If you just want something practical to play with, see casync. Even if it doesn't fit your workflow, or if you think you can do better, chances are you're best off building on top of it or adding patches to it, not starting from scratch.
-
Tool to clone file structure without the large files themselves?
You probably want casync.
-
A Nibble of Content-Defined Chunking - How de-duplicated, incremental file transfer works
Obligatory link to casync, which implements this better than most alternatives.
-
LibSQL – a fork of SQLite that is both Open Source, and Open Contributions
(personally, I think more people need to be aware of casync for the update storage/distribution problem. It isn't perfect for every use case, but it's good enough that you're probably better off wrapping/forking it rather than reimplementing it badly from scratch)
-
improving download infra
Does something like casync (https://github.com/systemd/casync or https://github.com/folbricht/desync) serve any purpose or provide any advantage to propagating rpm changes over rsync?
-
Are there any true alternatives to Seafile? (Nextcloud is not an alternative in this context)
Software that comes to mind for syncing lots of small files: git (and other source versioning tools), casync (https://github.com/systemd/casync) and a go implementation (https://github.com/folbricht/desync). Not really an answer and I can't think of a way to shoehorn that into your workflow, but maybe it leads you down a useful road.
- Casync – A Content-Addressable Data Synchronization Tool
-
Hacker News top posts: Apr 23, 2022
Casync – A Content-Addressable Data Synchronization Tool\ (15 comments)
tarsnap
-
Where do you store your backups? What Provider if any?
Tarsnap for configs and critical stuff (password database, emails).
-
3,200-Year-Old Egyptian Tablet Records Excuses for Why People Missed Work
Someone does :)
https://tarsnap.com
> Tarsnap uses a prepaid model based on actual usage:
> Storage: 250 picodollars / byte-month of encoded data
-
What is the best private encrypted cloud storage?
Colin Percival's tarsnap
-
Ask HN: Codebases with great, easy to read code?
In past threads, people have mentioned enjoying my Tarsnap (https://github.com/Tarsnap/tarsnap) code. I personally think that the spiped (https://github.com/Tarsnap/spiped) code is even better.
-
I love the idea of tarsnap but a stable release hasn't been released since 2017. Is there a modern alternative, or is tarsnap actually still usable and secure?
I prefer Vorta myself ( https://github.com/borgbase/vorta ) as it also has incremental and encrypted backups, as well as being a fraction of the price, but tarsnap seems to still be in very-slow development: https://github.com/Tarsnap/tarsnap , so I'd say from a quick look it's still trustworthy.
- Restic: Backups Done Right
-
What's your backup strategy?
Each server also upload their configs and « important » data (my mails and git repos) to tarsnap 3. Tarsnap storage is not as cheap as B2, so I try not to upload too much data there, but it's reliable and easy to use. It was also my first backup solution, and barely cost me 10$ a year so I keep it as a secondary backup.
-
FreeBSD SSH Hardening
Not foolish! The Tarsnap client code is open source, but the license file prohibits anyone from using the code: https://github.com/Tarsnap/tarsnap/blob/master/COPYING
> Redistribution and use in source and binary forms, without modification,
- Deduplicating Archiver with Compression and Encryption
-
The Wrong Way to Switch Operating Systems on Your Server
Yes. For the curious,
https://github.com/Tarsnap/tarsnap/graphs/contributors
What are some alternatives?
kopia - Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.
BorgBackup - Deduplicating archiver with compression and authenticated encryption.
desync - Alternative casync implementation
restic - Fast, secure, efficient backup program
zstd - Zstandard - Fast real-time compression algorithm
rclone - "rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files
magic-trace - magic-trace collects and displays high-resolution traces of what a process is doing
bupstash - Easy and efficient encrypted backups.
nixos-infect - [GPLv3+] install nixos over the existing OS in a DigitalOcean droplet (and others with minor modifications)
Duplicacy - A new generation cloud backup tool