fdupes
arq_restore
fdupes | arq_restore | |
---|---|---|
17 | 124 | |
2,363 | 647 | |
- | - | |
2.3 | 0.0 | |
4 days ago | about 2 years ago | |
C | C | |
- | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
fdupes
- Fdupes: Identify or Delete Duplicate Files
- fdupes: Identify or Delete Duplicate Files
-
Removing image duplicates
fdupes is simple and easy to use: https://github.com/adrianlopezroche/fdupes
- Backing Up Data: Tips/Advice for Tons of Unorganized Data and Duplicate Files from Multiple Sources
-
File Deduplication
I recently used [fdupes](https://github.com/adrianlopezroche/fdupes) to figure out duplicate files from my amazon cloud drive / photos migration. Took about 2 days to scour through about 1.5TB worth of day.
-
How would I go about copying around 5TB worth of data, from multiple drives to a singular drive/drives (Shared Pools/Raid)?
I would add the content of your current drives with rysnc to the new big drive. I would then run https://github.com/adrianlopezroche/fdupes To remove duplicate files.
- Ask HN: Tool to find identical file subtrees scattered over disks
-
Which tool do you use to find duplicate files?
jdupes, an optimized fork of the popular fdupes. There's 32-bit and 64-bit Win32 packages of jdupes there on Github.
- Mercredi Tech - 2022-05-11
- Suggestions on how to identify & report on old stale data in file shares?
arq_restore
-
Ask HN: Open-source Windows 11 backup solutions
There's also Arq Backup which can backup to OneDrive so if you have less than 1TB to backup you might not need to pay anything.
https://www.arqbackup.com/
-
Back Up Storage options
I use Arq Premium backup services They supply the backup software and the cloud storage
-
ThinMachine – A $25 Thin Client macOS Time Machine Appliance
People who want something similar may want to look at Arq [1]. Similar to restic, it provides incremental encrypted backups to most cloud providers (or a machine with SSH). But it is a Mac app, making it easy to configure and maintain. I never had issues with data corruption so far.
Disclaimer: I am not affiliated with them, just a happy user for 9 years.
[1] https://www.arqbackup.com
-
What am I looking for!?
Sending it to the NAS should create a copy automatically to BOTH an online server (I was thinking dropbox, but the space might be too limited. Maybe AWS? I've used https://www.arqbackup.com/ on my computer before so something similar would be great) and a second drive (so I guess I'm looking at a 2-drive NAS that I can setup as master-slave).
-
Guys I’m scared 😭 my life is on my computer and I don’t know how to fix it
For actual off-site backups, using something like https://www.backblaze.com or use https://www.arqbackup.com and your own choice cloud storage provider.
-
Anyone use Veeam Backup for Mac?
Curious too. On the Mac side, I feel like I mostly hear about Backblaze for cloud backups, but I do like Arq for pushing to any of the typical cloud storage options.
-
Cloud backup of TM backups
Have a look at Arq backup https://www.arqbackup.com/ It might meet your requirements
-
Is VeraCrypt 1.25.9 compatible with macOS Ventura?
Take a look at Arq Backup - not identical, but it's E2EE.
-
Could I backup to B2 Cloud with a similar experience as Backblaze Personal?
You could try this: https://www.arqbackup.com/ , it supports B2 I believe.
-
Digital clutter: Learning to let go and stop hoarding terabytes
Regarding Arq backup: if you are worried about using a proprietary (enrypted) and closed-source backup format in case the company were to go under, they have an open source command-line restore tool:
https://github.com/arqbackup/arq_restore
I've been using Arq for years, but I need to look into the "Glacier Deep Archive" format which is about 1/20th the cost of the fastest storage class.
What are some alternatives?
rdfind - find duplicate files utility
restic - Fast, secure, efficient backup program
jdupes - A powerful duplicate file finder and an enhanced fork of 'fdupes'.
icloud_photos_downloader - A command-line tool to download photos from iCloud
rmlint - Extremely fast tool to remove duplicates and other lint from your filesystem
kopia - Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.
czkawka - Multi functional app to find duplicates, empty folders, similar images etc.
rclone - "rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files
go-find-duplicates - Find duplicate files (photos, videos, music, documents) on your computer, portable hard drives etc.
Cryptomator - Multi-platform transparent client-side encryption of your files in the cloud
dupeguru - Find duplicate files
vorta - Desktop Backup Client for Borg Backup