fdupes
arq_restore
Our great sponsors
| fdupes | arq_restore | |
|---|---|---|
| 17 | 124 | |
| 2,348 | 648 | |
| - | - | |
| 2.5 | 0.0 | |
| about 1 month ago | almost 2 years ago | |
| C | C | |
| - | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
fdupes
- Fdupes: Identify or Delete Duplicate Files
- fdupes: Identify or Delete Duplicate Files
-
Removing image duplicates
fdupes is simple and easy to use: https://github.com/adrianlopezroche/fdupes
- Backing Up Data: Tips/Advice for Tons of Unorganized Data and Duplicate Files from Multiple Sources
-
File Deduplication
I recently used [fdupes](https://github.com/adrianlopezroche/fdupes) to figure out duplicate files from my amazon cloud drive / photos migration. Took about 2 days to scour through about 1.5TB worth of day.
-
How would I go about copying around 5TB worth of data, from multiple drives to a singular drive/drives (Shared Pools/Raid)?
I would add the content of your current drives with rysnc to the new big drive. I would then run https://github.com/adrianlopezroche/fdupes To remove duplicate files.
- Ask HN: Tool to find identical file subtrees scattered over disks
-
Which tool do you use to find duplicate files?
jdupes, an optimized fork of the popular fdupes. There's 32-bit and 64-bit Win32 packages of jdupes there on Github.
- Mercredi Tech - 2022-05-11
- Suggestions on how to identify & report on old stale data in file shares?
arq_restore
-
Ask HN: Open-source Windows 11 backup solutions
There's also Arq Backup which can backup to OneDrive so if you have less than 1TB to backup you might not need to pay anything.
-
Back Up Storage options
I use Arq Premium backup services They supply the backup software and the cloud storage
-
ThinMachine – A $25 Thin Client macOS Time Machine Appliance
People who want something similar may want to look at Arq [1]. Similar to restic, it provides incremental encrypted backups to most cloud providers (or a machine with SSH). But it is a Mac app, making it easy to configure and maintain. I never had issues with data corruption so far.
Disclaimer: I am not affiliated with them, just a happy user for 9 years.
-
What am I looking for!?
Sending it to the NAS should create a copy automatically to BOTH an online server (I was thinking dropbox, but the space might be too limited. Maybe AWS? I've used https://www.arqbackup.com/ on my computer before so something similar would be great) and a second drive (so I guess I'm looking at a 2-drive NAS that I can setup as master-slave).
-
Guys I’m scared 😭 my life is on my computer and I don’t know how to fix it
For actual off-site backups, using something like https://www.backblaze.com or use https://www.arqbackup.com and your own choice cloud storage provider.
-
Anyone use Veeam Backup for Mac?
Curious too. On the Mac side, I feel like I mostly hear about Backblaze for cloud backups, but I do like Arq for pushing to any of the typical cloud storage options.
-
Cloud backup of TM backups
Have a look at Arq backup https://www.arqbackup.com/ It might meet your requirements
-
Is VeraCrypt 1.25.9 compatible with macOS Ventura?
Take a look at Arq Backup - not identical, but it's E2EE.
-
Could I backup to B2 Cloud with a similar experience as Backblaze Personal?
You could try this: https://www.arqbackup.com/ , it supports B2 I believe.
-
Digital clutter: Learning to let go and stop hoarding terabytes
Regarding Arq backup: if you are worried about using a proprietary (enrypted) and closed-source backup format in case the company were to go under, they have an open source command-line restore tool:
https://github.com/arqbackup/arq_restore
I've been using Arq for years, but I need to look into the "Glacier Deep Archive" format which is about 1/20th the cost of the fastest storage class.
What are some alternatives?
rdfind - find duplicate files utility
restic - Fast, secure, efficient backup program
jdupes - A powerful duplicate file finder and an enhanced fork of 'fdupes'.
icloud_photos_downloader - A command-line tool to download photos from iCloud
rmlint - Extremely fast tool to remove duplicates and other lint from your filesystem
kopia - Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.
czkawka - Multi functional app to find duplicates, empty folders, similar images etc.
rclone - "rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files
go-find-duplicates - Find duplicate files (photos, videos, music, documents) on your computer, portable hard drives etc.
Cryptomator - Multi-platform transparent client-side encryption of your files in the cloud
dupeguru - Find duplicate files
vorta - Desktop Backup Client for Borg Backup