llama.onnx VS AST-1

Compare llama.onnx vs AST-1 and see what are their differences.

llama.onnx

LLaMa/RWKV onnx models, quantization and testcase (by tpoisonooo)
alpaca llama llm Onnx Onnxruntime quantization Transformer rwkv
Source Code
Suggest alternative
Edit details

AST-1

Join the movement led by IZX.ai to create the world's best open-source LLM. (by izxai)
llm llmops alpaca Foundation llama Model

DISCONTINUED

Suggest alternative
Edit details
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
llama.onnx AST-1
2 1
324 61
- -
7.3 10.0
10 months ago about 1 year ago
Python
GNU General Public License v3.0 only GNU General Public License v3.0 only
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

llama.onnx

Posts with mentions or reviews of llama.onnx. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-06-29.
  • Qnap TS-264
    3 projects | /r/LocalLLaMA | 29 Jun 2023
    You can find LLM models in the onnx format here: https://github.com/tpoisonooo/llama.onnx
  • Langchain question and answer without openai
    4 projects | /r/LangChain | 5 May 2023
    You also need a LLM to do this. Please check this out to pick one up from the llama family. Other works like llama.onnx, alpaca-native and llama model on hugging face are also worth checking.

AST-1

Posts with mentions or reviews of AST-1. We have used some of these posts to build our list of alternatives and similar projects.

What are some alternatives?

When comparing llama.onnx and AST-1 you can also consider the following projects:

llama.cpp - LLM inference in C/C++

text-generation-webui-colab - A colab gradio web UI for running Large Language Models

Chinese-LLaMA-Alpaca - 中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

llama.go - llama.go is like llama.cpp in pure Golang!

fastT5 - ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.

motorhead - 🧠 Motorhead is a memory and information retrieval server for LLMs.

llama2.openvino - This sample shows how to implement a llama-based model with OpenVINO runtime

openvino - OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

LocalAI - :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

llama.onnx vs llama.cpp AST-1 vs text-generation-webui-colab llama.onnx vs Chinese-LLaMA-Alpaca AST-1 vs llama.go llama.onnx vs fastT5 llama.onnx vs motorhead llama.onnx vs llama2.openvino llama.onnx vs openvino llama.onnx vs LocalAI