LLaMA-8bit-LoRA Alternatives

Similar projects and alternatives to LLaMA-8bit-LoRA

• text-generation-webui

  876 35,583 9.9 Python LLaMA-8bit-LoRA VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• llama.cpp

  766 55,117 9.9 C++ LLaMA-8bit-LoRA VS llama.cpp

  LLM inference in C/C++

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• alpaca-lora

  107 18,137 3.6 Jupyter Notebook LLaMA-8bit-LoRA VS alpaca-lora

  Instruct-tune LLaMA on consumer hardware

• alpaca_lora_4bit

  41 526 8.6 Python LLaMA-8bit-LoRA VS alpaca_lora_4bit

• trl

  13 7,935 9.6 Python LLaMA-8bit-LoRA VS trl

  Train transformer language models with reinforcement learning.

  

• text-generation-webui-testing

  9 21 9.9 Python LLaMA-8bit-LoRA VS text-generation-webui-testing

  A fork of textgen that still supports V1 GPTQ, 4-bit lora and other GPTQ models besides llama.

• sparsegpt-for-LLaMA

  3 65 5.2 Python LLaMA-8bit-LoRA VS sparsegpt-for-LLaMA

  Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• Sparsebit

  1 319 5.9 Python LLaMA-8bit-LoRA VS Sparsebit

  A model compression and acceleration toolbox based on pytorch.