magnitude
pgANN
Our great sponsors
magnitude | pgANN | |
---|---|---|
5 | 2 | |
1,610 | 289 | |
-0.1% | 0.0% | |
0.0 | 0.0 | |
9 months ago | 3 months ago | |
Python | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
magnitude
-
Text Classification Library for a Quick Baseline
(3) FastText now supports multiple languages [2].
[1] https://github.com/plasticityai/magnitude#pre-converted-magn...
-
Pgvector – vector similarity search for Postgres
Check out Magnitude, we built it to solve that problem: https://github.com/plasticityai/magnitude
It's still loaded from a file, but heavily uses memory-mapping and caching to be speedy and not overload your RAM immediately. And in production scenarios, multiple worker processes can share that memory due to the memory mapping.
Disclaimer: I'm the author.
-
Build an Embeddings index from a data source
General language models from pymagnitude
-
Tutorial series on txtai
Backed by the pymagnitude library. Pre-trained word vectors can be installed from the referenced link.
pgANN
-
Pinecone raises $100M Series B
Why do you use pgvector instead of pgANN? My understanding is pgANN is built with FAISS. When I compared pgvector with FAISS, pgvector was 3-5x slower.
https://github.com/netrasys/pgANN
-
Pgvector – vector similarity search for Postgres
Love it! Need better ANNs approaches in databases, using external servers such as Milvus, faiss is a pita
related: https://github.com/netrasys/pgANN
What are some alternatives?
flashtext - Extract Keywords from sentence or Replace keywords in sentences.
ann-benchmarks - Benchmarks of approximate nearest neighbor libraries in Python
faiss - A library for efficient similarity search and clustering of dense vectors.
smlar - PostgreSQL extension for an effective similarity search || mirror of git://sigaev.ru/smlar.git || see https://www.pgcon.org/2012/schedule/track/Hacking/443.en.html
pgvector - Open-source vector similarity search for Postgres
Milvus - A cloud-native vector database, storage for next generation AI applications
finalfusion-rust - finalfusion embeddings in Rust
similarity - TensorFlow Similarity is a python package focused on making similarity learning quick and easy.
txtai - 💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
DiskANN - Graph-structured Indices for Scalable, Fast, Fresh and Filtered Approximate Nearest Neighbor Search