llamazoo
TALIS
| llamazoo | TALIS | |
|---|---|---|
| 2 | 2 | |
| 57 | 23 | |
| - | - | |
| 10.0 | 8.7 | |
| 5 months ago | 12 months ago | |
| C | Python | |
| GNU General Public License v3.0 or later | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llamazoo
-
Gotzmann LLM Score
Parameters for all tests (done with llama.cpp thru LLaMAZoo):
-
Have to abandon my (almost) finished LLaMA-API-Inference server. If anybody finds it useful and wants to continue, the repo is yours. :)
Looks like exactly same idea I'm doing right now with LLaMAZoo: https://github.com/gotzmann/llamazoo
TALIS
-
Have to abandon my (almost) finished LLaMA-API-Inference server. If anybody finds it useful and wants to continue, the repo is yours. :)
The repo can be found here, the readme is not up-to-date. The code is a bit messy.
-
VRAM limitations
As promised, here is the link: https://github.com/Dhaladom/TALIS
What are some alternatives?
accelerate - 🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
llama.py - Python bindings to llama.cpp
semantra - Multi-tool for semantic search
llama-go - Port of Facebook's LLaMA (Large Language Model Meta AI) in Golang with embedded C/C++
llama.go - llama.go is like llama.cpp in pure Golang!
InternGPT - InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)
InternChat - InternGPT / InternChat allows you to interact with ChatGPT by clicking, dragging and drawing using a pointing device. [Moved to: https://github.com/OpenGVLab/InternGPT]
xllm - 🦖 X—LLM: Cutting Edge & Easy LLM Finetuning
text-generation-webui-colab - A colab gradio web UI for running Large Language Models