Snebu
Duplicity
Snebu | Duplicity | |
---|---|---|
10 | 7 | |
110 | 50 | |
- | - | |
0.0 | 0.0 | |
over 3 years ago | over 12 years ago | |
C | Python | |
GNU General Public License v3.0 only | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Snebu
-
I'm working on a tar implementation with public key encryption extensions.
As such, I use tar for the serialization of backup data for Snebu (https://www.snebu.com), which has a plugin (tarcrypt) that operates on the data streams. Snebu ingests tar format, and emits tar format, so all you need to backup/restore a host is ssh access (server can pull backups, or client can push backups). So tarcrypt was added as way to do client-side encryption, but still be able to to submit recognizable tar files to Snebu's backend (which indexes, de-duplicates, and snapshots backups).
-
I'm giving out microgrants to open source projects for the third year in a row! Brag about your projects here so I can see them, big or small!
Snebu, on github. Simple Network Encrypting Backup Utility.
- Using Git For Backups
- Restic: Backups Done Right
- Deduplicating Archiver with Compression and Encryption
-
Backup encryption using SSH keys with age anno 2021
Details are at https://www.snebu.com/tarcrypt.html if you want to look it over (and tarcypt is part of the Snebu project https://github.com/derekp7/snebu). I'd love to get another pair of eyes on this to point out any non-obvious security limitations.
-
Interview with CEO of rsync.net: “no firewalls and no routers”
Since I've had a handful of users ask about cloud storage for Snebu, Would you be interested in adding Snebu as a supported protocol? It should be similar to how you currently support Borg. For Snebu, the client runs find and tar, sending results via ssh to the snebu binary on the remote host. And more recently client-side public key encryption support has been added via a client-side filter called "tarcrypt". Ideally, a customer would use Snebu to back up to a local device on their network (for example a Raspberry Pi with a large USB drive attached), and then use Snebu's efficient replication to send deltas to the cloud-hosted server. Client files are stored individually (deduplicated) on the Snebu server, and metadata is in an SQLite DB (advantages over Borg is more open standards for the data storage and public-key encryption, disadvantage is file-level instead of block-level deduplication and a project that isn't as widely used).
If you are interested, I would be more then happy to have an extended discussion with you going over implementation options, and updating the client side script to make it work better with your service. (https://www.snebu.com, https://github.com/derekp7/snebu, and the tarcrypt extensions to tar are described at https://www.snebu.com/tarcrypt.html).
-
Pet Project Thread February 26 2021
Would a mention of my open source backup system, Snebu (or https://github.com/derekp7/snebu) fit in this thread? Elevator pitch -- GPLv3 C code, snapshot-based, compresses, encrypts, deduplicates, can back up clients without installing an agent (just need ssh, bash, tar, and find commands on client for "pull" backups), push backups can have restricted permissions (i.e., give a client permission to push backups only, but not delete backups, or give a user restore-only permissions). Uses tar to collect the data, stores metadata in an SQLite DB on the server, files are stored in LZO format (can be read directly with lzop) (unless client-side encryption is used, but the data can still be decrypted with openssl then decompressed with lzop). Encryption is public-key based instead of needing to keep a shared symmetric key or passphrase laying around on your backup server.
-
What backup method do you use?
I created and use Snebu -- I'm working on getting it submitted to Fedora (waiting on package review now), doing daily snapshots of my fleet to a raspberry pi with external 12 TB WD Easystore drive. Provides push or pull based backups, granular access permissions, client-side public key encryption (RSA + AES-256) with HMAC validation, server-based data catalog housed in SQLite, multiple client support, global (cross client) file-level deduplication and compression. Works great for backing up a large range of OS versions since the client-side doesn't need an agent -- just bash, tar, find, and ssh.
-
Encrypted Backup Shootout
snebu (c) - https://github.com/derekp7/snebu
Duplicity
-
Restic: Backups Done Right
http://duplicity.nongnu.org/ at least can use PGP public keys. I've used it for a long time and not seen any particular reason to change.
-
Encrypt channel.backup?
There are backup tools with built-in encryption like borg backup or duplicity, these should be fine. If you already have a backup process and it's missing encryption then you should be able to use e.g. age or gpg.
-
What is everyone using to backup their multiple TB's of data?
For my family photos (critical, irreplaceable, on plex), I use duplicity which can make use of Amazon Glacier and Deep Archive for really cheap storage (0.00099 /gb /month no joke) with incremental versioning and client side encryption. Long restore time, but perfect for disaster recovery on data that doesn't change much. Want to set up the same for music (which rarely but sometimes changes, e.g. Correcting tags).
-
What do you wish you knew before starting grad school?
And google docs / apple cloud etc. aren't proper backups. They can cancel your account, be inaccessible, or hacked even. There's software like duplicity that can upload encrypted backups to multiple services, which are handy. But in any case, if you're doing cloud backups, do do redundant local backups too. My setup is I've a USB stick tacked onto a Raspberry Pi computer, and use something called borg to do daily backups over SSH.
- [QUESTION] Simple bash script, using 'expect', to download backups off a server, will connect and only dl 10-15mb of the 10gb file before exiting. Help?
-
Happy World Backup Day!
I have had good success using [Duplicity](http://duplicity.nongnu.org/) via [Duply](https://www.duply.net/) for a few years now. The main point for me is that duplicity directly backs up to many cloud-storage endpoints. I'm using google drive specifically, but it supports a ton of options.
- Duplicity: Encrypted bandwidth-efficient backup using the rsync algorithm
What are some alternatives?
UrBackup - UrBackup - Client/Server Open Source Network Backup for Windows, MacOS and Linux
BorgBackup - Deduplicating archiver with compression and authenticated encryption.
Elkarbackup - Open source backup solution for your network
Duplicati - Store securely encrypted backups in the cloud!
restic - Fast, secure, efficient backup program
TimeShift - System restore tool for Linux. Creates filesystem snapshots using rsync+hardlinks, or BTRFS snapshots. Supports scheduled snapshots, multiple backup levels, and exclude filters. Snapshots can be restored while system is running or from Live CD/USB.
Rsnapshot - a tool for backing up your data using rsync (if you want to get help, use https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss)
Rdiff-backup - Reverse differential backup tool, over a network or locally.