Anima
33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU (by lyogavin)
fin-llama
LLAMA specialized on finance (by Bavest)
| Anima | fin-llama | |
|---|---|---|
| 3 | 4 | |
| 2,881 | 64 | |
| - | - | |
| 9.1 | 4.3 | |
| 13 days ago | 6 months ago | |
| Jupyter Notebook | Jupyter Notebook | |
| Apache License 2.0 | GNU General Public License v3.0 only |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Anima
Posts with mentions or reviews of Anima.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-12-27.
- AirLLM
- AirLLM enables 8GB MacBook run 70B LLM
-
Fitting 70B models in a 4gb GPU, The whole model, no quants or distil or anything!
Found out about air_llm, https://github.com/lyogavin/Anima/tree/main/air_llm, where it loads one layer at a time, allow each layer to be 1.6GB for a 70b with 80 layers. theres about 30mb for kv cache, and i'm not sure where the rest goes.
fin-llama
Posts with mentions or reviews of fin-llama.
We have used some of these posts to build our list of alternatives
and similar projects.
-
Large language models for finance
In short: Link
-
FIN-LLAMA: LLAMA trained on finance data
Github
-
FIN-LLAMA: LLAMA for finance
FIN-LLAMA
- FinLLama: Llama Specialized on Finance
What are some alternatives?
When comparing Anima and fin-llama you can also consider the following projects:
Local-LLM-Langchain - Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and KoboldAI versions of the langchain notebooks with examples.
lida - Automatic Generation of Visualizations and Infographics using Large Language Models
FastLoRAChat - Instruct-tune LLaMA on consumer hardware with shareGPT data
BELLE - BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）
multi-lora-fine-tune - Provide Efficient LLM Fine-Tune via Multi-LoRA Optimization