New Oobabooga Standard, 8bit, and 4bit plus LLaMA conversion instructions, Windows 10 no WSL needed

• SwapCudaVersionWindows

  5 112 3.9

  How to swap/switch CUDA versions on Windows

miniconda link: https://docs.conda.io/en/latest/miniconda.html cuda information link: https://github.com/bycloudai/SwapCudaVersionWindows 8bit modification link: https://www.reddit.com/r/LocalLLaMA/comments/11o6o3f/how_to_install_llama_8bit_and_4bit/

• transformers

  176 125,021 10.0 Python

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  

conda install -c conda-forge cudatoolkit=11.7 conda install -c conda-forge ninja conda install -c conda-forge accelerate conda install -c conda-forge sentencepiece pip install git+https://github.com/huggingface/transformers.git pip install git+https://github.com/huggingface/peft.git

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• peft

  26 13,877 9.7 Python

  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

  

conda install -c conda-forge cudatoolkit=11.7 conda install -c conda-forge ninja conda install -c conda-forge accelerate conda install -c conda-forge sentencepiece pip install git+https://github.com/huggingface/transformers.git pip install git+https://github.com/huggingface/peft.git

• text-generation-webui

  876 36,293 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

git clone https://github.com/oobabooga/text-generation-webui cd text-generation-webui pip install -r requirements.txt

• GPTQ-for-LLaMa

  75 2,913 8.6 Python

  4 bits quantization of LLaMA using GPTQ

cd F:\OoBaboogaMarch17\text-generation-webui conda activate textgen mkdir repositories cd repositories git clone https://github.com/qwopqwop200/GPTQ-for-LLaMa cd GPTQ-for-LLaMa python setup_cuda.py install

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Suggest a related project