Vector Dataset benchmark with 1536/768 dim data

• VectorDBBench

  15 396 8.6 Python

  A Benchmark Tool for VectorDB

  

"

the link is: https://github.com/zilliztech/VectorDBBench/issues/200#issue...

• ann-benchmarks

  51 4,588 8.1 Python

  Benchmarks of approximate nearest neighbor libraries in Python

The reason https://ann-benchmarks.com is so good, is that we can see a plot of recall vs latency. I can see you have some latency numbers in the leaderboard at the bottom, but it's very difficult to make a decision.

As a practitioner that works with vector databases every day, just latency is meaningless to me, because I need to know if it's fast AND accurate, and what the tradeoff is! You can't have it both ways. So it would be helpful if you showed plots showing this tradeoff, similar to ann-benchmarks.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project