| rdfind | dupeguru | |
|---|---|---|
| 16 | 154 | |
| 875 | 4,809 | |
| - | - | |
| 4.1 | 6.7 | |
| 30 days ago | 2 months ago | |
| C++ | Python | |
| GNU General Public License v3.0 or later | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
rdfind
- Rdfind: A utilty to find duplicate files, delete them or replace with hardlinks
-
Self hosted, web gui, file duplication scanner
I use rdfind for this.
-
Is there a Mac app that will allow me to recursively go through thousands of folders, calculate the total folder size, then compare against all other folder sizes, and if the size is identical, delete the newer one?
rdfind is available for macOS; I've been using it on linux: https://github.com/pauldreik/rdfind
-
Deduplication on EXT4
You can use rdfind to find all duplicates in your experiments dir and replace files with hardlinks. This way files will occupy disk space only once and all inode references will be to the same disk location.
- How do I show non-duplicate files across 2 drives?
-
Pip and cargo are not the same
I use rdfind to deal with this: https://github.com/pauldreik/rdfind
- Backing Up Data: Tips/Advice for Tons of Unorganized Data and Duplicate Files from Multiple Sources
-
This has probably happened to all of us at least once
Yeah, I periodically download the full drives and just deduplicate with rdfind hardlinking identical files.
- AMD/Xilinx Vivado rant
-
recommends for de-duplication?
I use rdfind on my Linux NAS. https://github.com/pauldreik/rdfind
dupeguru
-
How to use onedrive for culling photos
Dupeguru
- Does anyone know any freeware duplicate file checkers without an upsell similar to awesome duplicate photo finder?
-
DupeGuru: Open-source, cross-platform GUI tool to find duplicate files
Posted link appears be misspelled
This appears to be actual link:
https://dupeguru.voltaicideas.net/
-
PhotoPrism: Browse Your Life in Pictures
I used to use DupeGuru which has some photo-specific dupe detection where you can fuzzy match image dupes based on content: https://dupeguru.voltaicideas.net/
But I switched over to czkawka, which has a better interface for comparing files, and seems to be a bit faster: https://github.com/qarmin/czkawka
Unfortunately, neither of these are integrated into Photoprism, so you still have to do some file management outside the database before importing.
I also haven't used Photoprism extensively yet (I think it's running on one of my boxes, but I haven't gotten around to setting it up), but I did find that it wasn't really built for file-based libraries. It's a little more heavyweight, but my research shows that Nextcloud Memories might be a better choice for me (it's not the first-party Nextcloud photos app, but another one put together by the community): https://apps.nextcloud.com/apps/memories
-
App recommendation for finding duplicate images
If your photos are exact duplicates you can also use the freeware dupeGuru app.
-
I'm amazed how I find anything & why I have so many dupes!
If you want a some other GUI options, AllDup or DupeGuru might be of interest. AllDup has a rather weird interface, though, imo.
-
Johnny Decimal
I used DupeGuru (https://dupeguru.voltaicideas.net/) in the past but I'm not sure it's the best solution for you. Try it, it's open-source.
- DupeGuru: Open-Source, cross-platform GUI software to find duplicate files
-
Diff tool for medias
dupeGuru
-
App to find duplicates across multiple external drives (Mac/Unix)
dupeGuru is a graphical application available for macOS that can scan multiple drives and identify duplicate files based on various criteria like name, size, and content https://dupeguru.voltaicideas.net/
What are some alternatives?
fdupes - FDUPES is a program for identifying or deleting duplicate files residing within specified directories.
czkawka - Multi functional app to find duplicates, empty folders, similar images etc.
jdupes - A powerful duplicate file finder and an enhanced fork of 'fdupes'.
rmlint - Extremely fast tool to remove duplicates and other lint from your filesystem
AntiDupl - A program to search similar and defect pictures on the disk
fclones - Efficient Duplicate File Finder
coronavirus-dashboard - Dashboard for tracking Coronavirus (COVID-19) across the UK
kindfs - Index filesystem into a database, then easily make queries e.g. to find duplicates files/dirs, or mount the index with FUSE.
video-simili-duplicate-cleaner
duphard - A simple utility to detect duplicate files and replace them with hard links.
snapraid - A backup program for disk arrays. It stores parity information of your data and it recovers from up to six disk failures