SaaSHub helps you find the best software and product alternatives Learn more →
Bitsandbytes-rocm Alternatives
Similar projects and alternatives to bitsandbytes-rocm
-
text-generation-webui
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
LoRA_Easy_Training_Scripts
A UI made in Pyside6 to make training LoRA/LoCon and other LoRA type models in sd-scripts easy
-
LyCORIS
Lora beYond Conventional methods, Other Rank adaptation Implementations for Stable diffusion.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better bitsandbytes-rocm alternative or higher similarity.
bitsandbytes-rocm reviews and mentions
Posts with mentions or reviews of bitsandbytes-rocm.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-06-22.
-
Any methods to train using AMD?
Install dependencies like hipblas-devel hipsparse-devel hipcub-devel git python3.10 make libstdc++-devel accelerate, rocm and hip git clone https://github.com/bmaltais/kohya_ss && cd kohya_ss python3.10 -m venv venv source venv/bin/activate pip3 install torch==1.13.1 torchvision==0.14.1 torchtext==0.14.1 torchaudio==0.13.1 --index-url https://download.pytorch.org/whl/rocm5.2 # problems on 2.0.0 last I tried, but kohya gotten updates since then pip3 install --upgrade -r requirements.txt pip3 uninstall tensorflow && pip3 install tensorflow-rocm pip uninstall bitsandbytes && git clone https://github.com/broncotc/bitsandbytes-rocm # bitsandbytes not required if not using adam8? cd bitesandbytes-rocm && nano Makefile # Replace all 3 instances of 5.3.0 with 5.4.3 make hip python3 setup.py install
-
How to run Pygmalion on 4.5GB of VRAM with full context size.
There are a lot of ROCm versions of bitsandbytes. For example this one: https://github.com/broncotc/bitsandbytes-rocm The problem is compatibility with most of the requirements. Kobold does a better job than ooba in offering a more streamlined approach for AMD users.
- Is it possible to load a model in 8bit precision with an AMD card? (6700xt)
- Have you got running LoRA training on an AMD GPU?
-
A note from our sponsor - SaaSHub
www.saashub.com | 2 May 2024
Stats
Basic bitsandbytes-rocm repo stats
4
38
8.8
12 months ago
broncotc/bitsandbytes-rocm is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of bitsandbytes-rocm is Python.
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com