hashdeep VS czkawka

Otherwise check out Hashdeep: https://github.com/jessek/hashdeep/

I use hashdeep. You have to install ipkgui on Synology and then md5deep through that which includes hashdeep (or just use md5deep). You can read up on hashdeep/md5deep here in the docs folder: https://github.com/jessek/hashdeep/

Started to be able to bring some order after I discovered hashdeep. Basically I started from a reasonably clean disk with folders to sort files, created lists of hashes using hashdeep, then used it to scan all my existing disks for unknown files. With the correct flags hashdeep can list all files it finds on a disk that it has not in its lists already. That help a lot to figure out what is worth wasting time on. It also is useful because every now and then that makes me realize the copy of some old file I have is broken (probably usually because it was stored on some CDROM that was no longer good).

MD5Deep / HashDeep - Windows and Linux options. For Windows on right under "Releases" v 4.4: https://github.com/jessek/hashdeep/

MD5Deep/HashDeep: https://github.com/jessek/hashdeep/ (download file under "Releases" on right hand side)

md5deep/hashdeep (https://github.com/jessek/hashdeep - see package download on side under "releases") - another command line tool, although a bit more complex but here's one way to do it:

You can download hasheep from here: https://github.com/jessek/hashdeep/releases/tag/v4.4

https://github.com/qarmin/czkawka by far the best of anything iv tried

I've used Czkawka (https://github.com/qarmin/czkawka) because it does Lanczos-based image duplicate detection, which makes it more practical for me.

Maybe it's a setting you made or the files, not sure. You can try another software czkawka to see if you get better results with it.

For static images i used https://github.com/qarmin/czkawka and it works well enough. I think. But when i used it on a folder with gifs and their jxl conversions, it shows nothing. SURELY this could not be user error, rrrright?

I used to use DupeGuru which has some photo-specific dupe detection where you can fuzzy match image dupes based on content: https://dupeguru.voltaicideas.net/

But I switched over to czkawka, which has a better interface for comparing files, and seems to be a bit faster: https://github.com/qarmin/czkawka

Unfortunately, neither of these are integrated into Photoprism, so you still have to do some file management outside the database before importing.

I also haven't used Photoprism extensively yet (I think it's running on one of my boxes, but I haven't gotten around to setting it up), but I did find that it wasn't really built for file-based libraries. It's a little more heavyweight, but my research shows that Nextcloud Memories might be a better choice for me (it's not the first-party Nextcloud photos app, but another one put together by the community): https://apps.nextcloud.com/apps/memories

Czkawka can do this.

There's always the well-respected tool, Czkawka. Or, of the CLI is your thing, jdupes is a good option.