one-click-installers
one-click-installers | bitsandbytes-win-prebuilt | |
---|---|---|
18 | 4 | |
470 | 75 | |
- | - | |
8.9 | 10.0 | |
8 months ago | over 1 year ago | |
Python | ||
GNU Affero General Public License v3.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
one-click-installers
-
amd gpus on windows support?
AMD does not offer installation options for ROCm on Windows. I'm not familiar with the workarounds to make it work; if you find a solution, you can contribute it to https://github.com/oobabooga/one-click-installers/
-
Oobabooga for Windows
Running start_windows.bat should take care of everything.
-
Quant-Cude Error?
Had the same issue, turns out I was using an old 1 click installer / updater, you need to use https://github.com/oobabooga/one-click-installers and reinstall everything from scratch
-
Cant find the "start: file.
Are you sure you're looking at the right folder? start_windows.bat is there. It's listed in the source code: https://github.com/oobabooga/one-click-installers
- Any UI that allows Windows + AMD GPU ?
- WizardLM-30B-Uncensored
-
13b-4bit-128g - Trying to run compressed model without success. ( problem exist only with 13b models for some reason ) No error code has been displayed.
one-click-installers/INSTRUCTIONS.TXT
-
GPT4All: A little helper to get started
https://github.com/oobabooga/one-click-installers/issues/56 they explain it over here.
-
Visual Studio compile errors
I solved this by adding the Individual components 2019 Windows 10 SDK, C++ CMake tools for Windows, and MSVC v142 - VS 2019 C++ build tools. See https://github.com/oobabooga/one-click-installers/issues/56
-
python setup.py bdist_wheel did not run successfully.
It appears one of the extensions isn't pre-compiled on install. I believe you have the same problem as listed here. https://github.com/oobabooga/one-click-installers/issues/56
bitsandbytes-win-prebuilt
-
bitsandbytes now for Windows (8-bit CUDA functions for PyTorch)
So there used to be a compiled version from https://github.com/DeXtmL/bitsandbytes-win-prebuilt but now I see there is a new version (from last week) at https://github.com/acpopescu/bitsandbytes/releases which appears to maybe become the start of Windows support in the official repo?
-
[D] Tutorial: Run LLaMA on 8gb vram on windows (thanks to bitsandbytes 8bit quantization)
put libbitsandbytes_cuda116.dll in C:\Users\xxx\miniconda3\envs\textgen\lib\site-packages\bitsandbytes\
-
Running Pygmalion 6b with 8GB of VRAM
Download these 2 dll files from here. then you move those files into "installer_files\env\lib\site-packages\bitsandbytes\" under your oobabooga root folder (where you've extracted the oneclick installer)
- Has anyone gotten the models to load via 8-bit for windows?!?!?
What are some alternatives?
GPTQ-for-LLaMa - 4 bits quantization of LLaMa using GPTQ
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
gpt4all - gpt4all: run open-source LLMs anywhere
llama-cpu - Fork of Facebooks LLaMa model to run on CPU
gradio - Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
bitsandbytes - 8-bit CUDA functions for PyTorch
KoboldAI
awesome-ml - Curated list of useful LLM / Analytics / Datascience resources
WizardVicunaLM - LLM that combines the principles of wizardLM and vicunaLM
micromamba-releases - Micromamba executables mirrored from conda-forge as Github releases
Llama-X - Open Academic Research on Improving LLaMA to SOTA LLM