intertext
neardup
intertext | neardup | |
---|---|---|
1 | 1 | |
110 | 1 | |
0.0% | - | |
0.0 | 10.0 | |
12 months ago | over 4 years ago | |
Python | XSLT | |
- | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
intertext
-
Ask HN: Tool to find text reuse, similar paragraphs, fuzzy/near dupes in folder?
Do you know of any too that I can use to compare my own notes and documents vault in search for copied paragraphs or almost similar phrases? Normal diffing/hashing wouldn't work as we're talking about the contents of slightly modified documents, and the comparison of each file against all others.
I found the following tools that seem related yet not quite there, maybe I'm missing a particular term of art?
https://github.com/YaleDHLab/intertext
neardup
-
Ask HN: Tool to find text reuse, similar paragraphs, fuzzy/near dupes in folder?
Python app. Requires to load and tag a corpus of text, it is used to compare different works in a visual way.
https://github.com/e-orlov/neardup
What are some alternatives?
sourmash - Quickly search, compare, and analyze genomic and metagenomic data sets.
dash-tools - DashTools - Plotly Dash Command Line Tools - Create, Run and Deploy Templated Python Apps from Terminal
LSH - Locality Sensitive Hashing using MinHash in Python/Cython to detect near duplicate text documents
Neural-Scam-Artist - Web Scraping, Document Deduplication & GPT-2 Fine-tuning with a newly created scam dataset.
datasketch - MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++, LSH Ensemble and HNSW
dash - Data Apps & Dashboards for Python. No JavaScript Required.