bitsandbytes-rocm
By broncotc
LoRA_Easy_Training_Scripts
A UI made in Pyside6 to make training LoRA/LoCon and other LoRA type models in sd-scripts easy (by derrian-distro)
bitsandbytes-rocm | LoRA_Easy_Training_Scripts | |
---|---|---|
4 | 14 | |
38 | 957 | |
- | - | |
8.8 | 7.7 | |
about 1 year ago | 13 days ago | |
Python | Python | |
MIT License | GNU General Public License v3.0 only |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
bitsandbytes-rocm
Posts with mentions or reviews of bitsandbytes-rocm.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-06-22.
-
Any methods to train using AMD?
Install dependencies like hipblas-devel hipsparse-devel hipcub-devel git python3.10 make libstdc++-devel accelerate, rocm and hip git clone https://github.com/bmaltais/kohya_ss && cd kohya_ss python3.10 -m venv venv source venv/bin/activate pip3 install torch==1.13.1 torchvision==0.14.1 torchtext==0.14.1 torchaudio==0.13.1 --index-url https://download.pytorch.org/whl/rocm5.2 # problems on 2.0.0 last I tried, but kohya gotten updates since then pip3 install --upgrade -r requirements.txt pip3 uninstall tensorflow && pip3 install tensorflow-rocm pip uninstall bitsandbytes && git clone https://github.com/broncotc/bitsandbytes-rocm # bitsandbytes not required if not using adam8? cd bitesandbytes-rocm && nano Makefile # Replace all 3 instances of 5.3.0 with 5.4.3 make hip python3 setup.py install
-
How to run Pygmalion on 4.5GB of VRAM with full context size.
There are a lot of ROCm versions of bitsandbytes. For example this one: https://github.com/broncotc/bitsandbytes-rocm The problem is compatibility with most of the requirements. Kobold does a better job than ooba in offering a more streamlined approach for AMD users.
- Is it possible to load a model in 8bit precision with an AMD card? (6700xt)
- Have you got running LoRA training on an AMD GPU?
LoRA_Easy_Training_Scripts
Posts with mentions or reviews of LoRA_Easy_Training_Scripts.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-07-02.
-
Could anyone please help with getting these scripts to work in Google Colab or Kaggle?
Hello! I want to run these scripts in Google Colab (https://github.com/derrian-distro/LoRA_Easy_Training_Scripts), but I don't know how. Tried to replace some code in this Colab (https://colab.research.google.com/github/camenduru/kohya_ss-colab/blob/main/kohya_ss_colab.ipynb), but it didn't go anywhere, so that's why I'm asking about it here. Could anyone help with this problem of mine please? I can clone git content, but I don't know how to run needed .bat or .sh file there.
-
need a lora traning guide for linux
conda create -n lora-easy-ui python=3.10.6 conda activate lora-easy-ui git clone https://github.com/derrian-distro/LoRA_Easy_Training_Scripts cd LoRA_Easy_Training_Scripts conda install -c anaconda cudatoolkit git submodule init git submodule update cd sd_scripts python -m venv venv source venv/bin/activate pip3 install torch torchvision torchaudio pip install -r requirements.txt pip install xformers pip install -r ../requirements_ui.txt pip install ../LyCORIS/. accelerate config
-
Has anyone had any luck getting kohya scripts installed and running on Ubuntu (or Linux in genera)?
I use this https://github.com/derrian-distro/LoRA_Easy_Training_Scripts on Kubuntu. It works very well.
- Kohya stopped working closes immediately after opening
-
help to create a lora in stable diffusion
The same thing happened to me, I could never run it well, but thanks to that I met easy lora, it has a very intuitive interface, it installs very clean, and it works impeccable, it doesn't change almost all of the configuration, just choose the model, your photos and the epocs or steps, and it works great https://github.com/derrian-distro/LoRA_Easy_Training_Scripts
-
Can't Get Any LoRA Training Repos To Work
Are there any Repos that actually work? I've attempted https://github.com/derrian-distro/LoRA_Easy_Training_Scripts, as well as a few variations of the kohya_ss ones to no avail.
-
Keep getting failed to match keys when loading newly trained lora.
This is my 3rd one, can someone point me to the right direction? I'm using https://github.com/derrian-distro/LoRA_Easy_Training_Scripts/releases/tag/installers-v5
- keep getting "failed to match keys error when loading my self trained lora"
-
Have you got running LoRA training on an AMD GPU?
Then, git clone https://github.com/derrian-distro/LoRA_Easy_Training_Scripts
-
LoRA training issue
I'm attempting to train a LoRA using Kohya's SD Scripts and one of Derrian's LoRA Easy Training Scripts (the popup version). I've been able to set everything up fine, boot up the venv, run the script, get everything spinning, etc. until:
What are some alternatives?
When comparing bitsandbytes-rocm and LoRA_Easy_Training_Scripts you can also consider the following projects:
sd-scripts
kohya_ss
bitsandbytes - Accessible large language models via k-bit quantization for PyTorch.
LyCORIS - Lora beYond Conventional methods, Other Rank adaptation Implementations for Stable diffusion.
GPTQ-for-LLaMa - 4 bits quantization of LLMs using GPTQ
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
pyenv-virtualenv - a pyenv plugin to manage virtualenv (a.k.a. python-virtualenv)
pyenv - Simple Python version management
bitsandbytes-rocm vs sd-scripts
LoRA_Easy_Training_Scripts vs kohya_ss
bitsandbytes-rocm vs bitsandbytes
LoRA_Easy_Training_Scripts vs LyCORIS
bitsandbytes-rocm vs GPTQ-for-LLaMa
LoRA_Easy_Training_Scripts vs sd-scripts
bitsandbytes-rocm vs text-generation-webui
LoRA_Easy_Training_Scripts vs pyenv-virtualenv
bitsandbytes-rocm vs LyCORIS
LoRA_Easy_Training_Scripts vs pyenv