intertext
Neural-Scam-Artist
| intertext | Neural-Scam-Artist | |
|---|---|---|
| 1 | 2 | |
| 110 | 23 | |
| 0.0% | - | |
| 0.0 | 0.0 | |
| 12 months ago | over 2 years ago | |
| Python | Python | |
| - | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
intertext
-
Ask HN: Tool to find text reuse, similar paragraphs, fuzzy/near dupes in folder?
Do you know of any too that I can use to compare my own notes and documents vault in search for copied paragraphs or almost similar phrases? Normal diffing/hashing wouldn't work as we're talking about the contents of slightly modified documents, and the comparison of each file against all others.
I found the following tools that seem related yet not quite there, maybe I'm missing a particular term of art?
https://github.com/YaleDHLab/intertext
Neural-Scam-Artist
What are some alternatives?
sourmash - Quickly search, compare, and analyze genomic and metagenomic data sets.
datasketch - MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++, LSH Ensemble and HNSW
neardup - Near-duplicate detection
bertviz - BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
dash-tools - DashTools - Plotly Dash Command Line Tools - Create, Run and Deploy Templated Python Apps from Terminal
LSH - Locality Sensitive Hashing using MinHash in Python/Cython to detect near duplicate text documents
transformers - 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Transformers4Rec - Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.