Any Suggestions on good open source model for Document QA which we can run on prod ? 13b + models?

This page summarizes the projects mentioned and recommended in the original post on /r/LocalLLaMA

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • faiss

    A library for efficient similarity search and clustering of dense vectors.

  • Not a model, but I would use this Dense Passage Retrieval for Open Domain QA simply fine-tuning two BERT models, one for questions and one for queries, and then fine-tuning using contrastive loss between positive key/value pairs of document embeddings (the [CLS]) token. You can then use a vector database (Like Faiss, Elasticsearch, Vespa or similar) for querying the question.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Not all Graphs are Trees

    1 project | news.ycombinator.com | 1 May 2024
  • Taskwarrior – Command Line Task Management

    1 project | news.ycombinator.com | 1 May 2024
  • Better and Faster Large Language Models via Multi-Token Prediction

    1 project | news.ycombinator.com | 1 May 2024
  • Ask HN: What have you built with ESPHome, ESP8266 or similar hardware

    26 projects | news.ycombinator.com | 27 Apr 2024
  • Deploying Unity Executable as a Windows Service

    1 project | dev.to | 1 May 2024