Dedupe Alternatives

Similar projects and alternatives to dedupe

fzf

407 59,739 9.6 Go dedupe VS fzf

:cherry_blossom: A command-line fuzzy finder
ripgrep

348 44,901 9.3 Rust dedupe VS ripgrep

ripgrep recursively searches directories for a regex pattern while respecting your gitignore
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
fd

172 31,581 8.8 Rust dedupe VS fd

A simple, fast and user-friendly alternative to 'find'
xonsh

112 7,986 8.9 Python dedupe VS xonsh

:shell: Python-powered, cross-platform, Unix-gazing shell.
ledger

107 5,121 7.9 C++ dedupe VS ledger

Double-entry accounting system with a command-line reporting interface
ripgrep-all

43 6,177 8.0 Rust dedupe VS ripgrep-all

rga: ripgrep, but also search in PDFs, E-Books, Office documents, zip, tar.gz, etc.
xdotool

38 3,023 3.5 C dedupe VS xdotool

fake keyboard/mouse input, window management, and more
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
smenu

37 2,329 8.2 C dedupe VS smenu

smenu started as a lightweight and flexible terminal menu generator, but quickly evolved into a powerful and versatile CLI selection tool for interactive or scripting use.
notes

17 53 1.5 Vim Script dedupe VS notes

notes on the tools in my Unix/Linux toolbox, dotfiles, etc (by sitaramc)
passphrase2pgp

13 177 2.2 Go dedupe VS passphrase2pgp

Generate a PGP key from a passphrase
file-arranger

3 59 0.0 Perl dedupe VS file-arranger

Simple & capable Directory arranger/cleaner
tawk

3 9 0.0 Tcl dedupe VS tawk

Like awk, but using tcl as the scripting language.
command_help

8 93 0.0 Shell dedupe VS command_help

:information_source: Extract help text from builtin commands and man pages
mpd_what

2 7 0.0 Python dedupe VS mpd_what

An mpd album art and info getter
slimv_box

7 14 3.8 Dockerfile dedupe VS slimv_box

slimv in a container
ffupdate

4 3 0.0 Shell dedupe VS ffupdate

A shellscript to automatically install and update firefox on linux.
hastyhex

3 85 0.0 C dedupe VS hastyhex

A blazing fast hex dumper
dotfiles

5 125 6.5 Shell dedupe VS dotfiles

My personal dotfiles (by skeeto)
note-keeper

5 62 0.0 Shell dedupe VS note-keeper

:notebook: A tiny bash tool for taking and organizing notes.
td-cli

3 183 6.1 Python dedupe VS td-cli

A todo command line todo manager ✔️
SaaSHub

www.saashub.com sponsored

SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better dedupe alternative or higher similarity.

Suggest an alternative to dedupe

dedupe reviews and mentions

Posts with mentions or reviews of dedupe. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-03-17.

fdupes alternatives?
1 project | /r/commandline | 18 Jun 2022

I wrote https://github.com/Gumnos/dedupe which sounds like it might be useful to you. It's faster than several of the alternatives I've found (many run the checksum across the whole of every file, this uses the file-size as a first-line discriminator, and only if the files are the same size does it go to the trouble of checking the checksum of the files). I designed it for creating hard-links in my media collection, but in the --dry-run mode, it should emit the file-names allowing you to pass it to xargs to remove them if it looks copacetic.
File Management via CLI
7 projects | /r/commandline | 17 Mar 2022

You can use my dedupe.py script with the dry-run flag (-n) to find all the duplicates on your drive. If you run it without the dry-run flag, it will attempt to make hard-links so that each file exists only once on the drive with multiple hard-links to the underlying file. It should be pretty fast, only needing to checksum file-content in the event that files have the same size (several other such deduplication methods work by checksumming every file on the drive which can be slow).
What tools / utilities have you written that you use regularly?
42 projects | /r/commandline | 17 Sep 2021

a file-deduplication utility that hard-links duplicate files to save space (our family photo gallery gets pics put in multiple albums for various audiences, so I can cut down on a lot of duplication with this)
A note from our sponsor - SaaSHub
www.saashub.com | 25 Apr 2024

SaaSHub helps you find the best software and product alternatives Learn more →