[Manual] How to install Large Language Model Vicuna 7B + llama.ccp on Steam Deck (ChatGPT at home)

• llama.cpp

  773 56,891 10.0 C++

  LLM inference in C/C++

For this manual, we will play with a model called Vicuna 7B (an assistant-like chatbot) and inference environment llama.ccp. I don't want to bore you with a long-winded explanation, but if you're ready to hop down the bunny trail, welcome to r/LocalLLaMA

• koboldcpp

  180 3,817 10.0 C++

  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

https://github.com/LostRuins/koboldcpp (I have not tried it yet)

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• sd-webui-lobe-theme

  77 2,163 9.3 TypeScript

  🅰️ Lobe theme - The modern theme for stable diffusion webui, exquisite interface design, highly customizable UI, and efficiency boosting features.

  

• stable-diffusion-webui

  2,808 129,975 9.9 Python

  Stable Diffusion web UI

Suggest a related project