nimsearch
vector-search
nimsearch | vector-search | |
---|---|---|
2 | 7 | |
10 | 245 | |
- | - | |
2.6 | 3.2 | |
11 months ago | 10 months ago | |
Nim | Jupyter Notebook | |
- | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
nimsearch
-
Self Hosted SaaS Alternatives
You are welcome. Thanks are too rarely offered. :-)
You may also be interested in word stemming ( such as used by snowball stemmer in https://github.com/c-blake/nimsearch ) or other NLP techniques, but I don't know how internationalized/multi-lingual that stuff is, but conceptually you might want "series of stemmed words" to be the content fragments of interest.
Similarity scores have many applications. Weights on graph of cancelled downloads ranked by size might be one. :)
Of course, for your specific "truncation" problem, you might also be able to just do an edit distance against the much smaller filenames and compare data prefixes in files or use a SHA256 of a content-based first slice. ( There are edit distance algos in Nim in https://github.com/c-blake/cligen/blob/master/cligen/textUt.... as well as in https://github.com/c-blake/suggest ).
Or, you could do a little program like ndup/sh/ndup to create a "mirrored file tree" of such content-based slices then you could use any true duplicate-file finder (like https://github.com/c-blake/bu/blob/main/dups.nim) on the little signature system to identify duplicates and go from path suffixes in those clusters back to the main filesystem. Of course, a single KV store within one or two files would be more efficient than thousands of tiny files. There are many possibilities.
-
Ask HN: Books about full text search
It's all in the Nim programming language, but if you prefer reading code or running diffs then you might get a vague sense of (some) low level nuts & bolts from: https://github.com/c-blake/nimsearch
vector-search
-
Evaluate Vector Database / Benchmarks?
i started doing this at http://vectorsearch.dev but it could use some love.
-
It’s the best time to travel with recurring income using A.I. anybody want help?
this isn't keyword search it's vector search. learn more here: https://vectorsearch.dev/
- Show HN: Vector Search Engine 101
-
Ask HN: Books about full text search
series of tutorials and comparisons that aim to teach a foundations about vector search: https://vectorsearch.dev/
-
How do I train a model to score sentences? (i.e. with BERT)
sounds like how vector search engines work, you convert a corpus into embeddings then search and the results are ordered by relevance score. i’m building a series of tutorials here: http://vectorsearch.dev
-
Algolia Acquires Search.io
working on a comparison table: https://github.com/esteininger/vector-search/tree/master/fou...
What are some alternatives?
suggest - An mmap-persistent Wolfe Garbe's SymSpell spell checking algorithm in Nim
relevanceai - Home of the AI workforce - Multi-agent system, AI agents & tools
awesome-selfhosted - A list of Free Software network services and web applications which can be hosted on your own servers
Typesense - Open Source alternative to Algolia + Pinecone and an Easier-to-Use alternative to ElasticSearch ⚡ 🔍 ✨ Fast, typo tolerant, in-memory fuzzy Search Engine for building delightful search experiences
Compose-Examples - Various Docker Compose examples of selfhosted FOSS and proprietary projects.
vector-db-benchmark - Framework for benchmarking vector search engines
ndup - Near-Duplicate File Detection
SearchGar - SearchGar - An actual Search Engine made using Python
home-ops - Wife approved HomeOps driven by Kubernetes and GitOps using Flux
ann-benchmarks - Benchmarks of approximate nearest neighbor libraries in Python
core - OPNsense GUI, API and systems backend
rum - RUM access method - inverted index with additional information in posting lists