czkawka
AntiDupl
Our great sponsors
czkawka | AntiDupl | |
---|---|---|
361 | 25 | |
17,429 | 1,174 | |
- | - | |
7.9 | 5.1 | |
27 days ago | 6 months ago | |
Rust | C# | |
GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
czkawka
- Is there software to compress large but similar files?
- Merge three separate partial libraries from external USB drives
-
Tools to deduplicate files
https://github.com/qarmin/czkawka by far the best of anything iv tried
-
fdupes: Identify or Delete Duplicate Files
I've used Czkawka (https://github.com/qarmin/czkawka) because it does Lanczos-based image duplicate detection, which makes it more practical for me.
-
AllDup suddenly taking forever to process/delete selections
Maybe it's a setting you made or the files, not sure. You can try another software czkawka to see if you get better results with it.
-
Is there a file duplicate finder that works with animated jpegxl-gif?
For static images i used https://github.com/qarmin/czkawka and it works well enough. I think. But when i used it on a folder with gifs and their jxl conversions, it shows nothing. SURELY this could not be user error, rrrright?
-
PhotoPrism: Browse Your Life in Pictures
I used to use DupeGuru which has some photo-specific dupe detection where you can fuzzy match image dupes based on content: https://dupeguru.voltaicideas.net/
But I switched over to czkawka, which has a better interface for comparing files, and seems to be a bit faster: https://github.com/qarmin/czkawka
Unfortunately, neither of these are integrated into Photoprism, so you still have to do some file management outside the database before importing.
I also haven't used Photoprism extensively yet (I think it's running on one of my boxes, but I haven't gotten around to setting it up), but I did find that it wasn't really built for file-based libraries. It's a little more heavyweight, but my research shows that Nextcloud Memories might be a better choice for me (it's not the first-party Nextcloud photos app, but another one put together by the community): https://apps.nextcloud.com/apps/memories
-
Please don't post like 20 similar images to the art sites?
Czkawka can do this.
-
I'm amazed how I find anything & why I have so many dupes!
There's always the well-respected tool, Czkawka. Or, of the CLI is your thing, jdupes is a good option.
- I saw a post regarding crate to delete similar files
AntiDupl
-
What would be the most effective way to sort through thousands of images and videos?
AntiDupl.NET can list duplicates for you, and you can use easy keybindings to quickly decide which duplicate to keep and which to delete. Along with quality estimates, say, if you had two identical pictures but one was high-quality and one low-quality jpg.
-
Software to find similar audio files on my computer?
I'm looking for software that could look at a collection of MP3 files, and list the ones having very similar audio content. Exactly like AntiDupl does for images.
- Hoarders help: Anti duplicated image & video files.
- Bulk rename photos with image recognition software
-
I have GBs of pictures, with lots of duplicates. What is a good app that can help me remove duplicates and organize my pictures?
If you mean locally, AntiDupl has been fantastic for me.
-
Is there a software that can find visually duplicated photos?
Download it from the source: https://github.com/ermig1979/AntiDupl
-
How do I manage years of data?
Yes, czkawka is pretty good. If /u/AndypandyO is also interested in de-duplicating similar (but not exact) pictures, I recommend AntiDupl.
-
Is there a program that finds duplicates (images) and moves them to choosen folder?
Antidupl won't move them to a folder, but it will display them to you, so that you can compare each pair of duplicates by size/resolution, blockiness etc., so that you can delete the one(s) you don't need. Exact matches can be deleted automatically, if you select this option.
-
I have a folder with ~5500 photos, and many are duplicates. Is there an efficient way to remove the duplicate photos?
AntiDupl.NET program is free and open-source software
-
Please recommend me a fast and effective free duplicate finder
AntiDupl
What are some alternatives?
dupeguru - Find duplicate files
jdupes - A powerful duplicate file finder and an enhanced fork of 'fdupes'.
darktable - darktable is an open source photography workflow application and raw developer
fdupes - FDUPES is a program for identifying or deleting duplicate files residing within specified directories.
k4dirstat - K4DirStat (KDE Directory Statistics) is a small utility program that sums up disk usage for directory trees, very much like the Unix 'du' command. It displays the disk space used up by a directory tree, both numerically and graphically (copied from the Debian package description).
PhotoPrism - AI-Powered Photos App for the Decentralized Web 🌈💎✨
exiftool - ExifTool meta information reader/writer
hashdeep
datacurator-filetree - a standard filetree for /r/datacurator [ and r/datahoarder ]
rmlint - Extremely fast tool to remove duplicates and other lint from your filesystem