SuperDuperDB - how to use it to talk to your documents locally using llama 7B or Mistral 7B?

• superduperdb

  24 4,372 9.9 Python

  🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.

  

• text-generation-webui

  876 36,552 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

4) https://github.com/oobabooga/text-generation-webui/wiki -- oobabooga, this seems promising. Haven't tried it yet.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• langroid

  15 1,550 9.8 Python

  Harness LLMs with Multi-Agent Programming

  

Thanks, also found Langdroid: https://github.com/langroid/langroid/blob/main/README.md

• llama_index

  75 31,184 10.0 Python

  LlamaIndex is a data framework for your LLM applications

  

• dspy

  22 10,820 9.9 Python

  DSPy: The framework for programming—not prompting—foundation models

  

• rags

  3 5,921 6.2 Python

  Build ChatGPT over your data, all with natural language

  

• ragas

  10 4,668 9.6 Python

  Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines

  

Also, at some point you'll need to get serious about evaluation (trust me, you will). You may be interested in https://github.com/explodinggradients/ragas

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Suggest a related project