New free tool that uses fine-tuned BERT model to surface answers from research papers

• elasticsearch-learning-to-rank

  2 1,459 5.4 Java

  Plugin to integrate Learning to Rank (aka machine learning for better relevance) with Elasticsearch

  

I worked on a learning-to-rank problem at a previous job (which unfortunately never got deployed womp, womp). This was early days, so at the time I was looking at using LambdaMART with solr or elasticsearch for reranking with a Bayesian click model to get pseudo-labels for relevance.

• similarity

  7 994 6.5 Python

  TensorFlow Similarity is a python package focused on making similarity learning quick and easy.

  

Tensorflow Ranking and Tensorflow similarity (maybe relevant/irrelevant contrastive learning?) look like they could be useful.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• ColBERT

  3 2,446 8.6 Python

  ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22, ACL'23, EMNLP'23)

  

ColBERT and successors for retrieval.

• haystack

  54 13,564 9.9 Python

  :mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

  

Some cool tools like HayStack that would be useful in putting some of these together.

• Milvus

  104 26,645 10.0 Go

  A cloud-native vector database, storage for next generation AI applications

  

And of course could do some sort of vector search engine like Milvus with nearest neighbors on embeddings.

• awesome-semantic-search

  3 319 5.7

  A curated list of awesome resources related to Semantic Search🔎 and Semantic Similarity tasks.

Some good papers here.

• qdrant

  139 17,839 9.9 Rust

  Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

  

https://github.com/qdrant/qdrant oh nice, very cool that it's open source and all in Rust. Milvus is I think mostly Go, but it has some parts in C++.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project