SparseGPT: Language Models Can Be Accurately Pruned in One-Shot

• sparsegpt-for-LLaMA

  3 65 5.2 Python

  Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.

https://github.com/AlpinDale/sparsegpt-for-LLaMA

> # Prune to 50\% + 4-bit with SparseGPT -- Currently not working

• sparsegpt

  16 626 2.4 Python

  Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".

  

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• serge

  40 5,543 9.8 Svelte

  A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

  

Is Serge what you are looking for? I've been using it to play around with prompting a few large language models.

https://github.com/nsarrazin/serge

Suggest a related project