llama.onnx VS llama2.openvino

Compare llama.onnx vs llama2.openvino and see what are their differences.

llama.onnx

LLaMa/RWKV onnx models, quantization and testcase (by tpoisonooo)
alpaca llama llm Onnx Onnxruntime quantization Transformer rwkv
Source Code
Suggest alternative
Edit details

llama2.openvino

This sample shows how to implement a llama-based model with OpenVINO runtime (by OpenVINO-dev-contest)
Suggest topics
Source Code
Suggest alternative
Edit details
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
llama.onnx llama2.openvino
2 3
324 43
- -
7.3 7.9
10 months ago 2 months ago
Python Python
GNU General Public License v3.0 only -
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

llama.onnx

Posts with mentions or reviews of llama.onnx. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-06-29.
  • Qnap TS-264
    3 projects | /r/LocalLLaMA | 29 Jun 2023
    You can find LLM models in the onnx format here: https://github.com/tpoisonooo/llama.onnx
  • Langchain question and answer without openai
    4 projects | /r/LangChain | 5 May 2023
    You also need a LLM to do this. Please check this out to pick one up from the llama family. Other works like llama.onnx, alpaca-native and llama model on hugging face are also worth checking.

llama2.openvino

Posts with mentions or reviews of llama2.openvino. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-12-05.

What are some alternatives?

When comparing llama.onnx and llama2.openvino you can also consider the following projects:

llama.cpp - LLM inference in C/C++

openvino - OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

Chinese-LLaMA-Alpaca - 中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

stable_diffusion_arc - Stable Difussion inference on Intel Arc dGPUs

fastT5 - ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.

openvino_notebooks - 📚 Jupyter notebook tutorials for OpenVINO™

motorhead - 🧠 Motorhead is a memory and information retrieval server for LLMs.

tiny_llm_finetuner - LLM finetuning on Intel XPUs - LoRA on intel discrete GPUs

AST-1 - Join the movement led by IZX.ai to create the world's best open-source LLM.

LocalAI - :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

llama.onnx vs llama.cpp llama2.openvino vs openvino llama.onnx vs Chinese-LLaMA-Alpaca llama2.openvino vs stable_diffusion_arc llama.onnx vs fastT5 llama2.openvino vs openvino_notebooks llama.onnx vs motorhead llama2.openvino vs tiny_llm_finetuner llama.onnx vs AST-1 llama.onnx vs openvino llama.onnx vs LocalAI