Deduper
dduper
| Deduper | dduper | |
|---|---|---|
| 1 | 6 | |
| 0 | 162 | |
| - | - | |
| 0.0 | 5.4 | |
| over 1 year ago | 6 months ago | |
| Python | Python | |
| Apache License 2.0 | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Deduper
dduper
-
NIST Retires SHA-1 Cryptographic Algorithm
In some cases deduplication happens at the file system layer transparently without you even realizing it. E.g. there are tools like https://github.com/lakshmipathi/dduper
I agree that image editing workflows are a different use case more suited to perceptual hashes than cryptographic hashes.
-
Can I view the internal hash values for files?
ddupper uses a patched btrfs command to read file hases from the raw disk. It requires root access and is kind of a hack.
- Ask HN: Who Wants to Collaborate?
-
Deduplication experiences with various tools?
There are various tools to use for COW deduplication, such as bees, duperemove, rmlint, jdupes, and dduper
-
DSM 7: Release Candidate released!
Hmm, could we use something like dduper to achieve this, if they don't have it included?
What are some alternatives?
imgdupes - Identifying and removing near-duplicate images using perceptual hashing.
bees - Best-Effort Extent-Same, a btrfs dedupe agent
dupeguru - Find duplicate files
duperemove - Tools for deduping file systems
dedupe - :id: A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.
r8152 - Synology DSM driver for Realtek RTL8152/RTL8153/RTL8156 based adapters
jdupes - A powerful duplicate file finder and an enhanced fork of 'fdupes'.
Typesense - Open Source alternative to Algolia + Pinecone and an Easier-to-Use alternative to ElasticSearch ⚡ 🔍 ✨ Fast, typo tolerant, in-memory fuzzy Search Engine for building delightful search experiences
borgmatic - Simple, configuration-driven backup software for servers and workstations
godbledger - Accounting Software with GRPC endpoints and SQL Backends
concise-encoding - The secure data format for a modern world