Open-source vector similarity search for Postgres
Apart from search, ANN could be use for recommendations, classification, and other information retrieval problems.
Currently, ES and Solr, both based on Lucene, can't really manage vector representations, as they are mainly based on inverted indexes to n-grams.
ANN potential applications extend to audio, bioinformatics, video, among any modality that can be represented as a vector. All you need is an encoder! How nice.
Faiss is definitely powerful. I have been running experiments using 80 million vectors that map to legal documents, and vectorizing protein-folds (using Alphafold). While it is an interesting technology, at this moment is more a lib or tool than a full-featured product like ES or Solr.
ATM, updating a Faiss index is a non trivial process, with many of the workflow tools you would see in ES missing.
I recently been found with pgvector (postgres + vector support) https://github.com/ankane/pgvector. Perhaps less performant, but easier to work with for teams. With support of migrations, ORM, sharing, and all the postgres goodies.
Weaviate is a cloud-native, modular, real-time vector search engine
OPS - Build and Run Open Source Unikernels. Quickly and easily build and deploy open source unikernels in tens of seconds. Deploy in any language to any cloud.
Vald. A Highly Scalable Distributed Vector Search Engine
An open-source vector database for embedding similarity search and AI applications.
Non-Metric Space Library (NMSLIB): An efficient similarity search library and a toolkit for evaluation of k-NN methods for generic non-metric spaces.
nmslib (https://github.com/nmslib/nmslib) supports sparse vectors for some of its spaces. It has fewer indexing methods than faiss, though.
[P] Embeddinghub: A vector database built for ML embeddings
4 projects | reddit.com/r/MachineLearning | 14 Sep 2021
Vald: A Highly Scalable Distributed Vector Search Engine
7 projects | news.ycombinator.com | 7 Apr 2021
Find anything fast with Google's vector search technology
16 projects | news.ycombinator.com | 14 Dec 2021
Self-supervised learning added to TensorFlow Similarity
1 project | news.ycombinator.com | 10 Jan 2022
A GitHub repository that collects awesome vector search framework/engine, library, cloud service, and research papers
1 project | reddit.com/r/vectordatabase | 27 Dec 2021