Langchain question and answer without openai

• LocalAI

  82 19,593 9.9 C++

  :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

  

• motorhead

  10 822 8.0 Rust

  🧠 Motorhead is a memory and information retrieval server for LLMs.

  

you could run motorhead on docker https://github.com/getmetal/motorhead

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• llama.cpp

  769 55,846 10.0 C++

  LLM inference in C/C++

Maybe llama.cpp is what you might need. It doesn't even need a GPU and can run on mobile device.

• llama.onnx

  2 323 7.3 Python

  LLaMa/RWKV onnx models, quantization and testcase

You also need a LLM to do this. Please check this out to pick one up from the llama family. Other works like llama.onnx, alpaca-native and llama model on hugging face are also worth checking.

Suggest a related project