Llama.onnx Alternatives

Similar projects and alternatives to llama.onnx

• llama.cpp

  1 45,354 9.7 C llama.onnx VS llama.cpp

  Port of Facebook's LLaMA model in C/C++

• AST-1

  - 61 10.0 llama.onnx VS AST-1

  Join the movement led by IZX.ai to create the world's best open-source LLM.

  

• InfluxDB

  www.influxdata.com

  sponsored

  Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

  

• motorhead

  1 766 8.3 Rust llama.onnx VS motorhead

  🧠 Motorhead is a memory and information retrieval server for LLMs.

  

• Chinese-LLaMA-Alpaca

  - 15,486 8.6 Python llama.onnx VS Chinese-LLaMA-Alpaca

  中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

• llama2.openvino

  1 26 6.1 Python llama.onnx VS llama2.openvino

  This sample shows how to implement a llama-based model with OpenVINO runtime

• openvino

  1 5,026 9.5 C++ llama.onnx VS openvino

  OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

  

• fastT5

  - 511 0.0 Python llama.onnx VS fastT5

  ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.

• Onboard AI

  getonboard.dev

  sponsored

  Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.

  

• LocalAI

  1 13,741 9.7 C++ llama.onnx VS LocalAI

  :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs ggml, gguf, GPTQ, onnx, TF compatible models: llama, llama2, rwkv, whisper, vicuna, koala, cerebras, falcon, dolly, starcoder, and many others