magnitude
smlar
Our great sponsors
| magnitude | smlar | |
|---|---|---|
| 5 | 2 | |
| 1,610 | 113 | |
| -0.1% | - | |
| 0.0 | 0.0 | |
| 9 months ago | almost 2 years ago | |
| Python | C | |
| MIT License | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
magnitude
-
Text Classification Library for a Quick Baseline
(3) FastText now supports multiple languages [2].
[1] https://github.com/plasticityai/magnitude#pre-converted-magn...
-
Pgvector – vector similarity search for Postgres
Check out Magnitude, we built it to solve that problem: https://github.com/plasticityai/magnitude
It's still loaded from a file, but heavily uses memory-mapping and caching to be speedy and not overload your RAM immediately. And in production scenarios, multiple worker processes can share that memory due to the memory mapping.
Disclaimer: I'm the author.
-
Build an Embeddings index from a data source
General language models from pymagnitude
-
Tutorial series on txtai
Backed by the pymagnitude library. Pre-trained word vectors can be installed from the referenced link.
smlar
- Creating tfidf or bm25 indexes iin Postgres
-
Pgvector – vector similarity search for Postgres
I have been using Smlar for a while for cosine similarity. Might this project provide a viable alternative? Smlar can be quite slow
https://github.com/jirutka/smlar
What are some alternatives?
flashtext - Extract Keywords from sentence or Replace keywords in sentences.
pgvector - Open-source vector similarity search for Postgres
faiss - A library for efficient similarity search and clustering of dense vectors.
pgANN - Fast Approximate Nearest Neighbor (ANN) searches with a PostgreSQL database.
Milvus - A cloud-native vector database, storage for next generation AI applications
finalfusion-rust - finalfusion embeddings in Rust
pg-costop - Vector Arithmetic and Weighted, Variably Randomized Cosine Similarity Search in Postgres
txtai - 💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
ann-benchmarks - Benchmarks of approximate nearest neighbor libraries in Python