Are there more practical tools for KNN searches and storing documents/embeddings?

• nmslib

  4 3,281 0.0 C++

  Non-Metric Space Library (NMSLIB): An efficient similarity search library and a toolkit for evaluation of k-NN methods for generic non-metric spaces.

  

I also needed to build a similar system and I used nmslib, maybe check it out - https://github.com/nmslib/nmslib

• TorchPQ

  3 203 3.5 Cuda

  Approximate nearest neighbor search with product quantization on GPU in pytorch and cuda

If you're using GPU for search, You can give TorchPQ a try, it's an ANN search library implemented with PyTorch and CUDA. with TorchPQ, you can freely add / remove vectors with IDs, you can save/load them just like a regular PyTorch model. TorchPQ is still in development, and I'd love to hear any suggestion or feedback.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project