tlsh VS czkawka

Have a look at this: https://github.com/trendmicro/tlsh

It's used in the cybersecurity world for fuzzy file comparison. See https://github.com/trendmicro/tlsh

I've used Czkawka (https://github.com/qarmin/czkawka) because it does Lanczos-based image duplicate detection, which makes it more practical for me.

I used to use DupeGuru which has some photo-specific dupe detection where you can fuzzy match image dupes based on content: https://dupeguru.voltaicideas.net/

But I switched over to czkawka, which has a better interface for comparing files, and seems to be a bit faster: https://github.com/qarmin/czkawka

Unfortunately, neither of these are integrated into Photoprism, so you still have to do some file management outside the database before importing.

I also haven't used Photoprism extensively yet (I think it's running on one of my boxes, but I haven't gotten around to setting it up), but I did find that it wasn't really built for file-based libraries. It's a little more heavyweight, but my research shows that Nextcloud Memories might be a better choice for me (it's not the first-party Nextcloud photos app, but another one put together by the community): https://apps.nextcloud.com/apps/memories

Czkawka can do this.

There's always the well-respected tool, Czkawka. Or, of the CLI is your thing, jdupes is a good option.

It's post-process scheduled deduplication. Also, there's czkawka: https://github.com/qarmin/czkawka

Repository - https://github.com/qarmin/czkawka Files to download - https://github.com/qarmin/czkawka/releases Installation - https://github.com/qarmin/czkawka/blob/master/instructions/Installation.md Instruction - https://github.com/qarmin/czkawka/blob/master/instructions/Instruction.md Translation - https://crowdin.com/project/czkawka

Nice, looks very clean. Are you aware of czkawka? That's a fairly advanced duplicate finder, also written in rust and also using gtk4: https://github.com/qarmin/czkawka

On the topic of file deduplication, the is Czkawka, a program made by a fellow Pole that I have used couple of times. Even if you want to continue with your project, you can get some inspiration on how they did that.