dedupfs
tarsnap
dedupfs | tarsnap | |
---|---|---|
1 | 11 | |
123 | 844 | |
- | -0.1% | |
0.0 | 8.3 | |
almost 14 years ago | 26 days ago | |
Python | C | |
GNU General Public License v3.0 or later | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
dedupfs
-
FreeBSD SSH Hardening
Is it possible to use tarsnap's deduplication code on my own server? We're setting up an ML dataset distribution box, and I was hoping to avoid storing e.g. imagenet as a tarball + untar'd (so that nginx can serve each photo individually) + imagenet in TFDS format.
https://github.com/xolox/dedupfs was the closest I found, but it has a lot of downsides.
Has anyone made an interface to tarsnap's tarball dedup code? A python wrapper around the block dedup code would be ideal, but I doubt it exists.
(Sorry for the random question -- I was just hoping for a standalone library along the lines of tarsnap's "filesystem block database" APIs. I thought about emailing this to you instead, but I'm crossing my fingers that some random HN'er might know. I'm sort of surprised that filesystems don't make it effortless. In fact, I delayed posting this for an hour to go research whether ZFS is the actual solution -- apparently "no, not unless you have specific brands of SSDs: https://www.truenas.com/community/resources/my-experiments-i..." which rules out my non-SSD 64TB Hetzner server. But like, dropbox solved this problem a decade ago -- isn't there something similar by now?)
tarsnap
-
Where do you store your backups? What Provider if any?
Tarsnap for configs and critical stuff (password database, emails).
-
3,200-Year-Old Egyptian Tablet Records Excuses for Why People Missed Work
Someone does :)
https://tarsnap.com
> Tarsnap uses a prepaid model based on actual usage:
> Storage: 250 picodollars / byte-month of encoded data
-
What is the best private encrypted cloud storage?
Colin Percival's tarsnap
-
Ask HN: Codebases with great, easy to read code?
In past threads, people have mentioned enjoying my Tarsnap (https://github.com/Tarsnap/tarsnap) code. I personally think that the spiped (https://github.com/Tarsnap/spiped) code is even better.
-
I love the idea of tarsnap but a stable release hasn't been released since 2017. Is there a modern alternative, or is tarsnap actually still usable and secure?
I prefer Vorta myself ( https://github.com/borgbase/vorta ) as it also has incremental and encrypted backups, as well as being a fraction of the price, but tarsnap seems to still be in very-slow development: https://github.com/Tarsnap/tarsnap , so I'd say from a quick look it's still trustworthy.
- Restic: Backups Done Right
-
What's your backup strategy?
Each server also upload their configs and « important » data (my mails and git repos) to tarsnap 3. Tarsnap storage is not as cheap as B2, so I try not to upload too much data there, but it's reliable and easy to use. It was also my first backup solution, and barely cost me 10$ a year so I keep it as a secondary backup.
-
FreeBSD SSH Hardening
Not foolish! The Tarsnap client code is open source, but the license file prohibits anyone from using the code: https://github.com/Tarsnap/tarsnap/blob/master/COPYING
> Redistribution and use in source and binary forms, without modification,
- Deduplicating Archiver with Compression and Encryption
-
The Wrong Way to Switch Operating Systems on Your Server
Yes. For the curious,
https://github.com/Tarsnap/tarsnap/graphs/contributors
What are some alternatives?
mfsbsd - mfsBSD
BorgBackup - Deduplicating archiver with compression and authenticated encryption.