-
fuseai
Self-Hosted and Open-Source web app to interact with OpenAI APIs. Currently supports ChatGPT, but DALLE and Whisper support is coming.
-
serge
A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
chatgpt-telegram-bot
🤖 A Telegram bot that integrates with OpenAI's official ChatGPT APIs to provide answers, written in Python (by n3d1117)
-
text-generation-webui
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
-
LocalAI
:robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.
-
text-generation-webui-docker
Docker variants of oobabooga's text-generation-webui, including pre-built images.
-
guidance
Discontinued A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance] (by microsoft)
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
LLaMA-Adapter
Discontinued Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters [Moved to: https://github.com/OpenGVLab/LLaMA-Adapter] (by ZrrSkywalker)
TheBloke_Wizard-Vicuna-30B-Uncensored-GPTQ + https://github.com/oobabooga/text-generation-webui + RTX 3090 24GB
Yep, with https://github.com/go-skynet/LocalAI - it probably has the largest support for ggml-compatible models nowadays (including falcon) https://localai.io/model-compatibility/index.html#model-compatibility-table
Here's the dockerized oogabooga link: https://github.com/Atinoda/text-generation-webui-docker
I haven't tried it yet but this framework from microsoft seems to be a good way to channel LLMs into your target application.