Tools similar to ChatGPT Retrieval Plugin but for localized LLMs.

This page summarizes the projects mentioned and recommended in the original post on /r/LocalLLaMA

Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
  • gorilla

    Gorilla: An API store for LLMs

  • tart

    Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al. (by facebookresearch)

  • In another thread I posted about Facebook Research Tart: It was specifically designed for targeted retrieval (hence the name, kind of clever too as it relies on google Flan technology): https://github.com/facebookresearch/tart

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • private-gpt

    Interact with your documents using the power of GPT, 100% privately, no data leaks

  • llama_farm

    Use local llama LLM or openai to chat, discuss/summarize your documents, youtube videos, and so on.

  • https://github.com/atisharma/llama_farm has a similar aim.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts