one-click-installers
Simplified installers for oobabooga/text-generation-webui. (by oobabooga)
fast_txtgen
By Highlyhotgames
| one-click-installers | fast_txtgen | |
|---|---|---|
| 18 | 10 | |
| 470 | 12 | |
| - | - | |
| 8.9 | 2.8 | |
| 8 months ago | about 1 month ago | |
| Python | Shell | |
| GNU Affero General Public License v3.0 | GNU Affero General Public License v3.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
one-click-installers
Posts with mentions or reviews of one-click-installers.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-06-02.
-
amd gpus on windows support?
AMD does not offer installation options for ROCm on Windows. I'm not familiar with the workarounds to make it work; if you find a solution, you can contribute it to https://github.com/oobabooga/one-click-installers/
-
Oobabooga for Windows
Running start_windows.bat should take care of everything.
-
Quant-Cude Error?
Had the same issue, turns out I was using an old 1 click installer / updater, you need to use https://github.com/oobabooga/one-click-installers and reinstall everything from scratch
-
Cant find the "start: file.
Are you sure you're looking at the right folder? start_windows.bat is there. It's listed in the source code: https://github.com/oobabooga/one-click-installers
- Any UI that allows Windows + AMD GPU ?
- WizardLM-30B-Uncensored
-
13b-4bit-128g - Trying to run compressed model without success. ( problem exist only with 13b models for some reason ) No error code has been displayed.
one-click-installers/INSTRUCTIONS.TXT
-
GPT4All: A little helper to get started
https://github.com/oobabooga/one-click-installers/issues/56 they explain it over here.
-
Visual Studio compile errors
I solved this by adding the Individual components 2019 Windows 10 SDK, C++ CMake tools for Windows, and MSVC v142 - VS 2019 C++ build tools. See https://github.com/oobabooga/one-click-installers/issues/56
-
python setup.py bdist_wheel did not run successfully.
It appears one of the extensions isn't pre-compiled on install. I believe you have the same problem as listed here. https://github.com/oobabooga/one-click-installers/issues/56
fast_txtgen
Posts with mentions or reviews of fast_txtgen.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-04-28.
-
Discuss GPU configs | Why do I get 40 tokens / sec on a rtx 3060!?
I used this installer for Oobabooga on Ubuntu.
-
help please
If u need something simpler you can try my install script. https://github.com/Highlyhotgames/fast_txtgen/
-
Linux (Endeavour) Anyone able to get text-generation-webui working with GPTQ-for-LLaMA ?
If you have a Nvidia card and you are trying this on Ubuntu, I have done this and it works flawlessly, tell me what was your experience: https://github.com/Highlyhotgames/fast_txtgen/tree/Linux
-
Had to reinstall and now I'm getting a new error, even on the commit I was on
Try this: https://github.com/Highlyhotgames/fast_txtgen it has WSL and Ubuntu version too
- Llama model easy & fast installer (r/MachineLearning)
-
[P] Llama model easy & fast installer
No you didn't "clear && export PATH=$PATH:~/fast_txtgen && sudo ln -s ~/fast_txtgen/install /usr/local/bin/ && git clone https://github.com/Highlyhotgames/fast_txtgen.git > /dev/null 2>&1 && cd fast_txtgen && chmod +x requirements && ./requirements" where requirements needs sudo. I'd recommend splitting it after the chmod
-
[P] Llama on Windows (WSL) fast and easy
I did a new project.. https://github.com/Highlyhotgames/fast_txtgen
What are some alternatives?
When comparing one-click-installers and fast_txtgen you can also consider the following projects:
GPTQ-for-LLaMa - 4 bits quantization of LLaMa using GPTQ
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
gpt4all - gpt4all: run open-source LLMs anywhere
GPTQ-for-LLaMa - 4 bits quantization of LLaMA using GPTQ
gradio - Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
KoboldAI
WizardVicunaLM - LLM that combines the principles of wizardLM and vicunaLM
micromamba-releases - Micromamba executables mirrored from conda-forge as Github releases
Llama-X - Open Academic Research on Improving LLaMA to SOTA LLM
awesome-ml - Curated list of useful LLM / Analytics / Datascience resources
llama-mps - Experimental fork of Facebooks LLaMa model which runs it with GPU acceleration on Apple Silicon M1/M2
bitsandbytes-win-prebuilt
one-click-installers vs GPTQ-for-LLaMa
fast_txtgen vs text-generation-webui
one-click-installers vs gpt4all
fast_txtgen vs GPTQ-for-LLaMa
one-click-installers vs gradio
one-click-installers vs KoboldAI
one-click-installers vs WizardVicunaLM
one-click-installers vs micromamba-releases
one-click-installers vs Llama-X
one-click-installers vs awesome-ml
one-click-installers vs llama-mps
one-click-installers vs bitsandbytes-win-prebuilt