mpt-lora-patch
lora-instruct
| mpt-lora-patch | lora-instruct | |
|---|---|---|
| 4 | 1 | |
| 58 | 97 | |
| - | - | |
| 5.1 | 7.0 | |
| about 1 year ago | 5 months ago | |
| Python | Python | |
| - | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
mpt-lora-patch
- Anyone here finetune either MPT-7B or Falcon-7B?
-
How big of a jump is 13B Vicuna Uncensored vs 30B Vicuna Uncensored?
To merge a LoRA into an existing model, use this script:
-
Training a LoRA with MPT Models
Yeah it's the link on this post https://github.com/iwalton3/mpt-lora-patch
lora-instruct
-
Training a LoRA with MPT Models
Hi, i have created custom data, same format as alphachas json file. And fine tuned mpt-7b-instruct using this link https://github.com/leehanchung/lora-instruct I have also used your patch, the fine tuning got successfull and also the loss got decreased but when am trying to make prediction using the fine tuned model am not getting correct output even on the trained data, it's generating output with lots of nonsense
What are some alternatives?
LoRA-MPT - A repo for finetuning MPT using LoRA. It is currently configured to work with the Alpaca dataset from Stanford but can easily be adapted to use another.
FastLoRAChat - Instruct-tune LLaMA on consumer hardware with shareGPT data
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
AutoLearn-GPT - ChatGPT learns automatically.
GPTQ-for-LLaMa - 4 bits quantization of LLaMA using GPTQ
LMOps - General technology for enabling AI capabilities w/ LLMs and MLLMs
AGiXT - AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.
Roy - Roy: A lightweight, model-agnostic framework for crafting advanced multi-agent systems using large language models.
punica - Serving multiple LoRA finetuned LLM as one