Will keyword (BM25, TD-IDF) be replaced for search by Neural Search?

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

Scout Monitoring - Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com
featured
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
  • contriever

    Discontinued Contriever: Unsupervised Dense Information Retrieval with Contrastive Learning

  • We, humans, are preconditioned to be linear in our extrapolation (as opposed to exponential) thanks to our hunter ancestors (and FPS games!). It is very clear that the rate of advancement of Large Language Models is super-linear, if not exponential.

    Hence, I indeed predict that keyword search will be completely supplanted in the next 5 years as a mechanism for search.

    Of course we will still need to do lookups for ISBNs and generic ids, but that isn't keyword search, that is index lookup functionality.

    Case in point: take a look at Meta Research's Contriever model (https://github.com/facebookresearch/contriever), which already matches keyword techniques in efficacy without any supervision.

    This is only the beginning, come build the future with us, we see it very clearly :)

  • Scout Monitoring

    Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

    Scout Monitoring logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • GLM-4-9B: open-source model with superior performance to Llama-3-8B

    1 project | news.ycombinator.com | 5 Jun 2024
  • Internet.nl – test tool for modern internet standards

    1 project | news.ycombinator.com | 5 Jun 2024
  • Should I focus on GitHub stars or forks for my open source project?

    1 project | news.ycombinator.com | 5 Jun 2024
  • Show HN: Mesop, open-source Python UI framework used at Google

    5 projects | news.ycombinator.com | 3 Jun 2024
  • Microsoft has gone radio silent on Windows Recall

    1 project | news.ycombinator.com | 5 Jun 2024