AirLLM enables 8GB MacBook run 70B LLM

• Anima

  3 2,881 9.1 Jupyter Notebook

  33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU

• llama.cpp

  769 56,891 10.0 C++

  LLM inference in C/C++

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• text-generation-webui

  876 36,293 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

Suggest a related project