Free LLM api

• text-generation-webui

  877 37,551 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

text-generation-webui has api extension https://github.com/oobabooga/text-generation-webui/blob/main/docs/Extensions.md

• koboldcpp

  180 4,133 10.0 C++

  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

https://horde.koboldai.net/ or build your own with koboldcpp or oobabooga.

• Scout Monitoring

  www.scoutapm.com featured

  Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

  

• dockerLLM

  5 286 7.3 Shell

  TheBloke's Dockerfiles

  

or use TheBloke Local LLMs One-Click UI template on runpod https://github.com/TheBlokeAI/dockerLLM/blob/main/README_Runpod_LocalLLMsUIandAPI.md

Suggest a related project