Langchain question and answer without openai

• LocalAI

  72 11,484 9.6 Go

  :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs ggml, gguf, GPTQ, onnx, TF compatible models: llama, llama2, rwkv, whisper, vicuna, koala, cerebras, falcon, dolly, starcoder, and many others

  

• motorhead

  9 715 8.6 Rust

  🧠 Motorhead is a memory and information retrieval server for LLMs.

  

  you could run motorhead on docker https://github.com/getmetal/motorhead

• InfluxDB

  www.influxdata.com

  sponsored

  Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

  

• llama.cpp

  605 41,451 9.8 C

  Port of Facebook's LLaMA model in C/C++

  Maybe llama.cpp is what you might need. It doesn't even need a GPU and can run on mobile device.

• llama.onnx

  2 259 8.6 Python

  LLaMa/RWKV onnx models, quantization and testcase

  You also need a LLM to do this. Please check this out to pick one up from the llama family. Other works like llama.onnx, alpaca-native and llama model on hugging face are also worth checking.

Suggest a related project