dupd VS fd

I use and test assorted duplicate finders regularly.

fdupes is the classic (going way way back) but it's really very slow, not worth using anymore.

The four I know are worth trying these days (depending on data set, hardware, file arrangement and other factors, any one of these might be fastest for a specific use case) are https://github.com/jbruchon/jdupes , https://github.com/pauldreik/rdfind , https://github.com/jvirkki/dupd , https://github.com/sahib/rmlint

Had not encountered fclones before, will give it a try.

fd GitHub

It's not just the OS itself, where some of the slowness can at least be explained by the silo-ed nature of development and the large amount of moving parts. But even when MS gives a small-ish team free reign and a fresh start, the software is just agonizingly slow and buggy.

Example 1: new PowerToys https://github.com/microsoft/PowerToys/

The FancyZones "window snap" UI takes upwards of half a second to activate when dragging a window and the Zone Editor is at around 5s. All in all it is only very slightly less buggy than 3rd party tiling WMs like komorebic.

The PowerToysRun utility input is extremely variable, takes between 1 and 20(!) seconds. A lot of the plugins shipped with it simply don't work or have no suggestions/hints once you enter their prefix. The search relies on WindowsSearch, which is about 500x slower than https://github.com/sharkdp/fd and has not improved since Win7. Who cares, nobody ever searches for files, right? As a whole, PTRun is simply worse than https://github.com/Flow-Launcher/Flow.Launcher which uses the same UI kit as far as I can see. WTF?

In case people were curious: https://github.com/sharkdp/fd

Life is too short to deal with bad Interfaces, I just use https://github.com/sharkdp/fd instead

find ./ -maxdepth 2 -name 'abc'

becomes

fd abc -d 2 ./

fd

Perhaps interesting (for some) to note that hyperfine is from the same author as at least a few other "ne{w,xt} generation" command line tools (that could maybe be seen as part of "rewrite it in Rust", but I don't want to paint the author with a brush they disagree with!!): fd (find alternative; https://github.com/sharkdp/fd), bat ("supercharged version of the cat command"; https://github.com/sharkdp/bat), and hexyl (hex viewer; https://github.com/sharkdp/hexyl). (And certainly others I've missed!)

Pointing this out because I myself appreciate comments that do this.

For myself, `fd` is the one most incorporated into my own "toolbox" -- used it this morning prior to seeing this thread on hyperfine! So, thanks for all that, sharkdp if you're reading!

Ok, end OT-ness.

However, if it catches too many typos in changelogs/README instead of the actual code, try using the fd command to specify file extensions or exclude directories. For example, the following command searches only for .cr files and excludes the lib directory:

Oh right, we didn't know this, most of the tools install guides have nix-env like fd, lychee, gtrash, etc and others we listed which we just use for installation.

https://github.com/lycheeverse/lychee?tab=readme-ov-file#nix...

https://github.com/sharkdp/fd?tab=readme-ov-file#on-nixos--v...

https://github.com/umlx5h/gtrash?tab=readme-ov-file#nixpkgs-...