dupe-krill
fclones
dupe-krill | fclones | |
---|---|---|
1 | 17 | |
184 | 1,729 | |
- | - | |
3.4 | 6.4 | |
8 months ago | 23 days ago | |
Rust | Rust | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
dupe-krill
-
Fclones – an efficient duplicate file finder and remover
Coincidentally I was looking through the list of apps that do this the other day, I think I looked at all the other ones they list as competitors.
My particular use case involved images that might be very near duplicates (screenshots of the same web page), which some of the tools cover, though it feels like a slightly seperate task from the exact bit duplicates, so not all do it.
One interesting one I found that wasn't listed in the Readme was:
https://github.com/kornelski/dupe-krill
Which had some notes about their use of BTreehashes to progressively compare files. Not sure how much difference it makes in practice but sounded elegant.
fclones
- Fclones: Parallel duplicate files finder in Rust with reflink support
- Fclones: Efficient Duplicate File Finder
- fdupes: Identify or Delete Duplicate Files
-
Deduplication at file level
Install fclones (fdupes modern equivalent)
- A duplicate file finder with GUI written using gtk4-rs and relm4
-
making duplicate files hard links, probably rdfind
I said "fclone" I meant "fclones" (https://github.com/pkolaczk/fclones) -- I missed the "s" at the end
-
Use `dano` to find duplicate media files
While we're recommending stuff, fclones: https://github.com/pkolaczk/fclones
-
Oxidise Your Life
fclones: Efficient Duplicate File Finder.
-
Pip and cargo are not the same
Yes, that would be safer when available (although generally files within library dependencies are not modified I think?). It looks like fclones implements this, is faster and is written in Rust https://github.com/pkolaczk/fclones (the last is the most important point of course /s).
- Caf a rust program which filters out duplicate files
What are some alternatives?
imgui-rs - Rust bindings for Dear ImGui
jdupes - A powerful duplicate file finder and an enhanced fork of 'fdupes'.
rdfind - find duplicate files utility
rmlint - Extremely fast tool to remove duplicates and other lint from your filesystem
czkawka - Multi functional app to find duplicates, empty folders, similar images etc.
CompactGUI - Transparently compress active games and programs using Windows 10/11 APIs
dupd - CLI utility to find duplicate files
CompactGUI - Transparently compress active games and programs using Windows 10/11 APIs [Moved to: https://github.com/IridiumIO/CompactGUI]
fdupes - FDUPES is a program for identifying or deleting duplicate files residing within specified directories.
go-find-duplicates - Find duplicate files (photos, videos, music, documents) on your computer, portable hard drives etc.
mdcat - cat for markdown
tcount - Count your code by tokens and patterns in the syntax tree. A tokei/scc/cloc alternative.