one-click-installers
Simplified installers for oobabooga/text-generation-webui. (by oobabooga)
llama-cpu
Fork of Facebooks LLaMa model to run on CPU (by markasoftware)
| one-click-installers | llama-cpu | |
|---|---|---|
| 18 | 9 | |
| 470 | 775 | |
| - | - | |
| 8.9 | 3.1 | |
| 8 months ago | about 1 year ago | |
| Python | Python | |
| GNU Affero General Public License v3.0 | GNU General Public License v3.0 only |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
one-click-installers
Posts with mentions or reviews of one-click-installers.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-06-02.
-
amd gpus on windows support?
AMD does not offer installation options for ROCm on Windows. I'm not familiar with the workarounds to make it work; if you find a solution, you can contribute it to https://github.com/oobabooga/one-click-installers/
-
Oobabooga for Windows
Running start_windows.bat should take care of everything.
-
Quant-Cude Error?
Had the same issue, turns out I was using an old 1 click installer / updater, you need to use https://github.com/oobabooga/one-click-installers and reinstall everything from scratch
-
Cant find the "start: file.
Are you sure you're looking at the right folder? start_windows.bat is there. It's listed in the source code: https://github.com/oobabooga/one-click-installers
- Any UI that allows Windows + AMD GPU ?
- WizardLM-30B-Uncensored
-
13b-4bit-128g - Trying to run compressed model without success. ( problem exist only with 13b models for some reason ) No error code has been displayed.
one-click-installers/INSTRUCTIONS.TXT
-
GPT4All: A little helper to get started
https://github.com/oobabooga/one-click-installers/issues/56 they explain it over here.
-
Visual Studio compile errors
I solved this by adding the Individual components 2019 Windows 10 SDK, C++ CMake tools for Windows, and MSVC v142 - VS 2019 C++ build tools. See https://github.com/oobabooga/one-click-installers/issues/56
-
python setup.py bdist_wheel did not run successfully.
It appears one of the extensions isn't pre-compiled on install. I believe you have the same problem as listed here. https://github.com/oobabooga/one-click-installers/issues/56
llama-cpu
Posts with mentions or reviews of llama-cpu.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-03-08.
-
Why is ChatGPT 3.5 API 10x cheaper than GPT3?
You've probably heard, but LLaMA just released, and its 13B parameter model outperforms GPT-3 on most metrics (because they trained it on a lot more data). Someone's already quantized it to 4 and 3 bits and it performs virtually the same. It also apparently performs well on CPUs (several words per second on a 7900X). Running something equivalent to GPT3.5 on a phone is not out that far out.
- Fork of Facebook’s LLaMa model to run on CPU
- Llama-CPU: Fork of Facebooks LLaMa model to run on CPU
-
[D] Tutorial: Run LLaMA on 8gb vram on windows (thanks to bitsandbytes 8bit quantization)
I tried to port the llama-cpu version to a gpu-accelerated mps version for macs, it runs, but the outputs are not as good as expected and it often gives "-1" tokens. Any help and contributions on fixing it are welcome!
-
Facebook LLAMA is being openly distributed via torrents | Hacker News
You can run it with only a CPU and 32 gigs of RAM: https://github.com/markasoftware/llama-cpu
- [D] Is it possible to run Meta's LLaMA 65B model on consumer-grade hardware?
-
Facebook LLAMA is being openly distributed via torrents
I was able to run 7B on a CPU, inferring several words per second: https://github.com/markasoftware/llama-cpu
What are some alternatives?
When comparing one-click-installers and llama-cpu you can also consider the following projects:
GPTQ-for-LLaMa - 4 bits quantization of LLaMa using GPTQ
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
gpt4all - gpt4all: run open-source LLMs anywhere
llama - Inference code for Llama models
gradio - Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
GPTQ-for-LLaMa - 4 bits quantization of LLaMA using GPTQ
KoboldAI
wrapyfi-examples_llama - Inference code for facebook LLaMA models with Wrapyfi support
WizardVicunaLM - LLM that combines the principles of wizardLM and vicunaLM
bitsandbytes-win-prebuilt
micromamba-releases - Micromamba executables mirrored from conda-forge as Github releases
transformers - 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
one-click-installers vs GPTQ-for-LLaMa
llama-cpu vs text-generation-webui
one-click-installers vs gpt4all
llama-cpu vs llama
one-click-installers vs gradio
llama-cpu vs GPTQ-for-LLaMa
one-click-installers vs KoboldAI
llama-cpu vs wrapyfi-examples_llama
one-click-installers vs WizardVicunaLM
llama-cpu vs bitsandbytes-win-prebuilt
one-click-installers vs micromamba-releases
llama-cpu vs transformers