llama2-high-level-cpp
llamazoo
llama2-high-level-cpp | llamazoo | |
---|---|---|
1 | 2 | |
7 | 57 | |
- | - | |
3.8 | 10.0 | |
3 months ago | 6 months ago | |
C | C | |
MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llama2-high-level-cpp
llamazoo
-
Gotzmann LLM Score
Parameters for all tests (done with llama.cpp thru LLaMAZoo):
-
Have to abandon my (almost) finished LLaMA-API-Inference server. If anybody finds it useful and wants to continue, the repo is yours. :)
Looks like exactly same idea I'm doing right now with LLaMAZoo: https://github.com/gotzmann/llamazoo
What are some alternatives?
PowerInfer - High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
TALIS - Simple and fast server for GPTQ-quantized LLaMA inference
llama-go - Port of Facebook's LLaMA (Large Language Model Meta AI) in Golang with embedded C/C++
llama.py - Python bindings to llama.cpp
accelerate - 🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
xllm - 🦖 X—LLM: Cutting Edge & Easy LLM Finetuning
InternChat - InternGPT / InternChat allows you to interact with ChatGPT by clicking, dragging and drawing using a pointing device. [Moved to: https://github.com/OpenGVLab/InternGPT]
InternGPT - InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)
llama.go - llama.go is like llama.cpp in pure Golang!
text-generation-webui-colab - A colab gradio web UI for running Large Language Models