Sparsebit Alternatives

Similar projects and alternatives to Sparsebit

• text-generation-webui

  876 36,293 9.9 Python Sparsebit VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• llama.cpp

  769 56,891 10.0 C++ Sparsebit VS llama.cpp

  LLM inference in C/C++

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• alpaca-lora

  107 18,167 3.6 Jupyter Notebook Sparsebit VS alpaca-lora

  Instruct-tune LLaMA on consumer hardware

• trl

  13 8,120 9.7 Python Sparsebit VS trl

  Train transformer language models with reinforcement learning.

  

• LLaMA-8bit-LoRA

  3 145 5.1 Python Sparsebit VS LLaMA-8bit-LoRA

  Repository for Chat LLaMA - training a LoRA for the LLaMA (1 or 2) models on HuggingFace with 8-bit or 4-bit quantization. Research only.

  

• sparsegpt-for-LLaMA

  3 65 5.2 Python Sparsebit VS sparsegpt-for-LLaMA

  Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.

• tabmat

  1 102 8.4 Python Sparsebit VS tabmat

  Efficient matrix representations for working with tabular data

  

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• FQ-ViT

  2 263 1.1 Python Sparsebit VS FQ-ViT

  [IJCAI 2022] FQ-ViT: Post-Training Quantization for Fully Quantized Vision Transformer

  

• aimet

  2 1,908 9.6 Python Sparsebit VS aimet

  AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

  

• nncf

  2 777 9.7 Python Sparsebit VS nncf

  Neural Network Compression Framework for enhanced OpenVINO™ inference