Very simple guide for installing StableLM

• text-generation-webui

  876 36,293 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

A: If you're not already familiar with LLaMA or another local LLM, text generation web UI is currently the best way for running these local models. It has a one-click installer for easy installation and is seeking to be the A1111 of text generation.

• StableLM

  43 15,852 5.0 Jupyter Notebook

  StableLM: Stability AI Language Models

  

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• llama

  184 53,053 8.1 Python

  Inference code for Llama models

  

LLaMA : https://github.com/facebookresearch/llama And Lit version: https://github.com/Lightning-AI/lit-llamaYou can also use GPTQ-style int4 quantization, but this needs conversions of the weights first bringing GPU usage to about 5GB.

• lit-llama

  23 5,803 8.4 Python

  Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

  

LLaMA : https://github.com/facebookresearch/llama And Lit version: https://github.com/Lightning-AI/lit-llamaYou can also use GPTQ-style int4 quantization, but this needs conversions of the weights first bringing GPU usage to about 5GB.

Suggest a related project