Llama.onnx Alternatives

Similar projects and alternatives to llama.onnx

llama.cpp

769 56,891 10.0 C++ llama.onnx VS llama.cpp

LLM inference in C/C++
LocalAI

82 19,593 9.9 C++ llama.onnx VS LocalAI

:robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
openvino

17 5,911 10.0 C++ llama.onnx VS openvino

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
motorhead

10 828 7.7 Rust llama.onnx VS motorhead

🧠 Motorhead is a memory and information retrieval server for LLMs.
Chinese-LLaMA-Alpaca

4 17,251 8.8 Python llama.onnx VS Chinese-LLaMA-Alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
llama2.openvino

3 43 7.9 Python llama.onnx VS llama2.openvino

This sample shows how to implement a llama-based model with OpenVINO runtime
fastT5

5 540 0.0 Python llama.onnx VS fastT5

⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
AST-1

1 61 10.0 llama.onnx VS AST-1

Discontinued Join the movement led by IZX.ai to create the world's best open-source LLM.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better llama.onnx alternative or higher similarity.

Suggest an alternative to llama.onnx

llama.onnx reviews and mentions

Posts with mentions or reviews of llama.onnx. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-06-29.

Qnap TS-264
3 projects | /r/LocalLLaMA | 29 Jun 2023

You can find LLM models in the onnx format here: https://github.com/tpoisonooo/llama.onnx
Langchain question and answer without openai
4 projects | /r/LangChain | 5 May 2023

You also need a LLM to do this. Please check this out to pick one up from the llama family. Other works like llama.onnx, alpaca-native and llama model on hugging face are also worth checking.