rmlint
dupeguru
rmlint | dupeguru | |
---|---|---|
16 | 154 | |
1,778 | 4,809 | |
- | - | |
5.8 | 6.7 | |
5 months ago | 2 months ago | |
C | Python | |
GNU General Public License v3.0 only | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
rmlint
-
fdupes: Identify or Delete Duplicate Files
My preferred solution is rmlint [https://github.com/sahib/rmlint] mostly because it also looks at duplicate directories. It produces a bash script instead of deleting anything itself, so you can examine it before running the script it made.
-
ZFS 2.2.0 (RC): Block Cloning merged
After I removed duplicates (with help of https://github.com/sahib/rmlint ), I migrated my photos to an ordinary zpool instead.
-
I decluttered 14,000 digital items within a few hours. Here's how I did it.
For the technically savvy among you there is an excellent open source program called ‘rmlint’ (aka. Remove Lint). It is excellent at finding duplicates and saved me terabytes of space.
-
Looking for Powerful Deduplication software
You don’t say if you are on Windows or Unix. I have used rmlint successfully in the past.
-
the very best anti-duplicate app ?
dupeguru or rmlint
-
deleting duplicates programs?
rmlint, my friend, is the last tool you will ever need for this
- script to remove redundant parent directories
- Is there software that scans for duplicates?
- data hoarding software
-
Go Find Duplicates: blazingly-fast simple-to-use tool to find duplicate files
I use and test assorted duplicate finders regularly.
fdupes is the classic (going way way back) but it's really very slow, not worth using anymore.
The four I know are worth trying these days (depending on data set, hardware, file arrangement and other factors, any one of these might be fastest for a specific use case) are https://github.com/jbruchon/jdupes , https://github.com/pauldreik/rdfind , https://github.com/jvirkki/dupd , https://github.com/sahib/rmlint
Had not encountered fclones before, will give it a try.
dupeguru
-
How to use onedrive for culling photos
Dupeguru
- Does anyone know any freeware duplicate file checkers without an upsell similar to awesome duplicate photo finder?
-
DupeGuru: Open-source, cross-platform GUI tool to find duplicate files
Posted link appears be misspelled
This appears to be actual link:
https://dupeguru.voltaicideas.net/
-
PhotoPrism: Browse Your Life in Pictures
I used to use DupeGuru which has some photo-specific dupe detection where you can fuzzy match image dupes based on content: https://dupeguru.voltaicideas.net/
But I switched over to czkawka, which has a better interface for comparing files, and seems to be a bit faster: https://github.com/qarmin/czkawka
Unfortunately, neither of these are integrated into Photoprism, so you still have to do some file management outside the database before importing.
I also haven't used Photoprism extensively yet (I think it's running on one of my boxes, but I haven't gotten around to setting it up), but I did find that it wasn't really built for file-based libraries. It's a little more heavyweight, but my research shows that Nextcloud Memories might be a better choice for me (it's not the first-party Nextcloud photos app, but another one put together by the community): https://apps.nextcloud.com/apps/memories
-
App recommendation for finding duplicate images
If your photos are exact duplicates you can also use the freeware dupeGuru app.
-
I'm amazed how I find anything & why I have so many dupes!
If you want a some other GUI options, AllDup or DupeGuru might be of interest. AllDup has a rather weird interface, though, imo.
-
Johnny Decimal
I used DupeGuru (https://dupeguru.voltaicideas.net/) in the past but I'm not sure it's the best solution for you. Try it, it's open-source.
- DupeGuru: Open-Source, cross-platform GUI software to find duplicate files
-
Diff tool for medias
dupeGuru
-
App to find duplicates across multiple external drives (Mac/Unix)
dupeGuru is a graphical application available for macOS that can scan multiple drives and identify duplicate files based on various criteria like name, size, and content https://dupeguru.voltaicideas.net/
What are some alternatives?
jdupes - A powerful duplicate file finder and an enhanced fork of 'fdupes'.
czkawka - Multi functional app to find duplicates, empty folders, similar images etc.
rdfind - find duplicate files utility
fdupes - FDUPES is a program for identifying or deleting duplicate files residing within specified directories.
AntiDupl - A program to search similar and defect pictures on the disk
fclones - Efficient Duplicate File Finder
coronavirus-dashboard - Dashboard for tracking Coronavirus (COVID-19) across the UK
video-simili-duplicate-cleaner
rsync - An open source utility that provides fast incremental file transfer. It also has useful features for backup and restore operations among many other use cases.
snapraid - A backup program for disk arrays. It stores parity information of your data and it recovers from up to six disk failures