finetuned-qlora-falcon7b-medical
Anima
finetuned-qlora-falcon7b-medical | Anima | |
---|---|---|
3 | 3 | |
214 | 3,251 | |
- | - | |
6.4 | 9.1 | |
4 months ago | 22 days ago | |
Jupyter Notebook | Jupyter Notebook | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
finetuned-qlora-falcon7b-medical
Anima
- AirLLM
- AirLLM enables 8GB MacBook run 70B LLM
-
Fitting 70B models in a 4gb GPU, The whole model, no quants or distil or anything!
Found out about air_llm, https://github.com/lyogavin/Anima/tree/main/air_llm, where it loads one layer at a time, allow each layer to be 1.6GB for a 70b with 80 layers. theres about 30mb for kv cache, and i'm not sure where the rest goes.
What are some alternatives?
twewy-discord-chatbot - Discord AI Chatbot using DialoGPT, trained on the game transcript of The World Ends With You
Local-LLM-Langchain - Load local LLMs effortlessly in a Jupyter notebook for testing purposes alongside Langchain or other agents. Contains Oobagooga and KoboldAI versions of the langchain notebooks with examples.
gpt2bot - Your new Telegram buddy powered by transformers
FastLoRAChat - Instruct-tune LLaMA on consumer hardware with shareGPT data
Doctor-Dignity - Doctor Dignity is an LLM that can pass the US Medical Licensing Exam. It works offline, it's cross-platform, & your health data stays private.
fin-llama - LLAMA specialized on finance
hands-on-llms - ๐ฆ ๐๐ฒ๐ฎ๐ฟ๐ป about ๐๐๐ ๐, ๐๐๐ ๐ข๐ฝ๐, and ๐๐ฒ๐ฐ๐๐ผ๐ฟ ๐๐๐ for free by designing, training, and deploying a real-time financial advisor LLM system ~ ๐ด๐ฐ๐ถ๐ณ๐ค๐ฆ ๐ค๐ฐ๐ฅ๐ฆ + ๐ท๐ช๐ฅ๐ฆ๐ฐ & ๐ณ๐ฆ๐ข๐ฅ๐ช๐ฏ๐จ ๐ฎ๐ข๐ต๐ฆ๐ณ๐ช๐ข๐ญ๐ด
BELLE - BELLE: Be Everyone's Large Language model Engine๏ผๅผๆบไธญๆๅฏน่ฏๅคงๆจกๅ๏ผ
Building-a-Simple-Chatbot-in-Python-using-NLTK - Building a Simple Chatbot from Scratch in Python (using NLTK)
multi-lora-fine-tune - Provide Efficient LLM Fine-Tune via Multi-LoRA Optimization
autogen - A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap