What's the best (and cheap) way to try out all the new LLMs on cloud services.

• runpodctl

  8 216 9.4 Go

  🧰 | RunPod CLI for pod management

  

Many people use sites like runpod for this.

• text-generation-webui

  876 36,827 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

Here's the two major GUIs people use here to run LLMs: https://github.com/oobabooga/text-generation-webui/ https://github.com/LostRuins/koboldcpp/

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• koboldcpp

  180 3,887 10.0 C++

  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

Here's the two major GUIs people use here to run LLMs: https://github.com/oobabooga/text-generation-webui/ https://github.com/LostRuins/koboldcpp/

Suggest a related project