Langchain question and answer without openai

• LocalAI

  87 23,682 9.9 C++

  :robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference

  

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• motorhead

  10 851 6.4 Rust

  🧠 Motorhead is a memory and information retrieval server for LLMs.

  

  you could run motorhead on docker https://github.com/getmetal/motorhead

• llama.cpp

  823 65,845 10.0 C++

  LLM inference in C/C++

  Maybe llama.cpp is what you might need. It doesn't even need a GPU and can run on mobile device.

• llama.onnx

  2 344 7.3 Python

  LLaMa/RWKV onnx models, quantization and testcase

  You also need a LLM to do this. Please check this out to pick one up from the llama family. Other works like llama.onnx, alpaca-native and llama model on hugging face are also worth checking.

Suggest a related project