datasketch
MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++, LSH Ensemble and HNSW (by ekzhu)
LSH
Locality Sensitive Hashing using MinHash in Python/Cython to detect near duplicate text documents (by mattilyra)
| datasketch | LSH | |
|---|---|---|
| 1 | 1 | |
| 2,352 | 273 | |
| - | - | |
| 6.4 | 2.8 | |
| about 1 month ago | 11 months ago | |
| Python | Python | |
| MIT License | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
datasketch
Posts with mentions or reviews of datasketch.
We have used some of these posts to build our list of alternatives
and similar projects.
-
D Efficient Way To Cluster Millions Of Face
A great library that implements all those "big data" algos is https://github.com/ekzhu/datasketch
LSH
Posts with mentions or reviews of LSH.
We have used some of these posts to build our list of alternatives
and similar projects.
-
D Efficient Way To Cluster Millions Of Face
I'm looking into this, after reading the wikipedia entry of this it sound promissing! I already found a python lib https://github.com/mattilyra/LSH for this, I will get back to you once I tested this!
What are some alternatives?
When comparing datasketch and LSH you can also consider the following projects:
image-ndd-lsh - Near-duplicate image detection using Locality Sensitive Hashing
dedup - Find duplicate text files.
Neural-Scam-Artist - Web Scraping, Document Deduplication & GPT-2 Fine-tuning with a newly created scam dataset.
searx - Privacy-respecting metasearch engine [Moved to: https://github.com/searx/searx]
Cython - The most widely used Python to C compiler
jina - ☁️ Build multimodal AI applications with cloud-native stack
intertext - Detect and visualize text reuse
whoogle-search - A self-hosted, ad-free, privacy-respecting metasearch engine