Anima
BELLE
Anima | BELLE | |
---|---|---|
3 | 1 | |
2,881 | 7,549 | |
- | 1.4% | |
9.1 | 9.0 | |
13 days ago | about 2 months ago | |
Jupyter Notebook | HTML | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Anima
- AirLLM
- AirLLM enables 8GB MacBook run 70B LLM
-
Fitting 70B models in a 4gb GPU, The whole model, no quants or distil or anything!
Found out about air_llm, https://github.com/lyogavin/Anima/tree/main/air_llm, where it loads one layer at a time, allow each layer to be 1.6GB for a 70b with 80 layers. theres about 30mb for kv cache, and i'm not sure where the rest goes.
BELLE
What are some alternatives?
Local-LLM-Langchain - Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and KoboldAI versions of the langchain notebooks with examples.
Chinese-LLaMA-Alpaca - 中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
FastLoRAChat - Instruct-tune LLaMA on consumer hardware with shareGPT data
LLaMA-LoRA-Tuner - UI tool for fine-tuning and testing your own LoRA models base on LLaMA, GPT-J and more. One-click run on Google Colab. + A Gradio ChatGPT-like Chat UI to demonstrate your language models.
fin-llama - LLAMA specialized on finance
Luotuo-Chinese-LLM - 骆驼(Luotuo): Open Sourced Chinese Language Models. Developed by 陈启源 @ 华中师范大学 & 李鲁鲁 @ 商汤科技 & 冷子昂 @ 商汤科技
multi-lora-fine-tune - Provide Efficient LLM Fine-Tune via Multi-LoRA Optimization
ChatGLM-6B - ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型
lora-air-time - A Calculator that calculate the Time on Air (ToA) of LoRa packet. Based on the formula in Semtech's datasheet.
xTuring - Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
LLaMA-Cult-and-More - Large Language Models for All, 🦙 Cult and More, Stay in touch !