-
text-generation-webui
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
-
Scout Monitoring
Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
text-generation-webui has api extension https://github.com/oobabooga/text-generation-webui/blob/main/docs/Extensions.md
https://horde.koboldai.net/ or build your own with koboldcpp or oobabooga.
or use TheBloke Local LLMs One-Click UI template on runpod https://github.com/TheBlokeAI/dockerLLM/blob/main/README_Runpod_LocalLLMsUIandAPI.md
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a more popular project.
Related posts
-
MS makes 1984-style monitoring, so how does the Linux community respond?
-
Show HN: AiDAPal – An IDA Pro plugin and fine-tuned LLM for reverse engineering
-
Nvidia-patch: removes restriction simultaneous video encoding sessions
-
A macOS and Windows open source alternative to ChatGPT
-
AIM Weekly for 10 June 2024