Neural-Scam-Artist
intertext
| Neural-Scam-Artist | intertext | |
|---|---|---|
| 2 | 1 | |
| 23 | 110 | |
| - | 0.0% | |
| 0.0 | 0.0 | |
| over 2 years ago | 12 months ago | |
| Python | Python | |
| MIT License | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Neural-Scam-Artist
intertext
-
Ask HN: Tool to find text reuse, similar paragraphs, fuzzy/near dupes in folder?
Do you know of any too that I can use to compare my own notes and documents vault in search for copied paragraphs or almost similar phrases? Normal diffing/hashing wouldn't work as we're talking about the contents of slightly modified documents, and the comparison of each file against all others.
I found the following tools that seem related yet not quite there, maybe I'm missing a particular term of art?
https://github.com/YaleDHLab/intertext
What are some alternatives?
datasketch - MinHash, LSH, LSH Forest, Weighted MinHash, HyperLogLog, HyperLogLog++, LSH Ensemble and HNSW
sourmash - Quickly search, compare, and analyze genomic and metagenomic data sets.
bertviz - BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
neardup - Near-duplicate detection
LSH - Locality Sensitive Hashing using MinHash in Python/Cython to detect near duplicate text documents
dash-tools - DashTools - Plotly Dash Command Line Tools - Create, Run and Deploy Templated Python Apps from Terminal
transformers - 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Transformers4Rec - Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.
Extracting-Training-Data-from-Large-Langauge-Models - A re-implementation of the "Extracting Training Data from Large Language Models" paper by Carlini et al., 2020
dash - Data Apps & Dashboards for Python. No JavaScript Required.