datasketch
MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++, LSH Ensemble and HNSW (by ekzhu)
image-ndd-lsh
Near-duplicate image detection using Locality Sensitive Hashing (by mendesk)
datasketch | image-ndd-lsh | |
---|---|---|
1 | 2 | |
2,352 | 64 | |
- | - | |
6.4 | 0.0 | |
about 1 month ago | over 2 years ago | |
Python | Python | |
MIT License | - |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
datasketch
Posts with mentions or reviews of datasketch.
We have used some of these posts to build our list of alternatives
and similar projects.
-
D Efficient Way To Cluster Millions Of Face
A great library that implements all those "big data" algos is https://github.com/ekzhu/datasketch
image-ndd-lsh
Posts with mentions or reviews of image-ndd-lsh.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-03-07.
-
Discussion Thread
You might look into locally sensitive hashing. Here's some software I found with a quick search
-
File consolidation software/strategy for merging and deduplicating photos from multiple TB drives into one place with possible corruptions.
What would be nice is something that used locality-sensitive hashing to bin very similar files together for further examination.
What are some alternatives?
When comparing datasketch and image-ndd-lsh you can also consider the following projects:
LSH - Locality Sensitive Hashing using MinHash in Python/Cython to detect near duplicate text documents
dedup - Find duplicate text files.
videoduplicatefinder - Video Duplicate Finder - Crossplatform
searx - Privacy-respecting metasearch engine [Moved to: https://github.com/searx/searx]
ssim - πΌπ¬ JavaScript Image Comparison
Neural-Scam-Artist - Web Scraping, Document Deduplication & GPT-2 Fine-tuning with a newly created scam dataset.
jina - βοΈ Build multimodal AI applications with cloud-native stack
whoogle-search - A self-hosted, ad-free, privacy-respecting metasearch engine
intertext - Detect and visualize text reuse