sparsegpt-for-LLaMA Alternatives

Similar projects and alternatives to sparsegpt-for-LLaMA

• text-generation-webui

  876 36,293 9.9 Python sparsegpt-for-LLaMA VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• llama.cpp

  773 56,891 10.0 C++ sparsegpt-for-LLaMA VS llama.cpp

  LLM inference in C/C++

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• alpaca-lora

  107 18,197 3.6 Jupyter Notebook sparsegpt-for-LLaMA VS alpaca-lora

  Instruct-tune LLaMA on consumer hardware

• serge

  40 5,543 9.8 Svelte sparsegpt-for-LLaMA VS serge

  A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

  

• sparsegpt

  16 624 2.4 Python sparsegpt-for-LLaMA VS sparsegpt

  Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".

  

• trl

  13 8,120 9.7 Python sparsegpt-for-LLaMA VS trl

  Train transformer language models with reinforcement learning.

  

• LLaMA-8bit-LoRA

  3 145 5.1 Python sparsegpt-for-LLaMA VS LLaMA-8bit-LoRA

  Repository for Chat LLaMA - training a LoRA for the LLaMA (1 or 2) models on HuggingFace with 8-bit or 4-bit quantization. Research only.

  

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• Sparsebit

  1 320 5.9 Python sparsegpt-for-LLaMA VS Sparsebit

  A model compression and acceleration toolbox based on pytorch.