Are you selfhosting a ChatGPT alternative?

• fuseai

  6 289 5.1 TypeScript

  Self-Hosted and Open-Source web app to interact with OpenAI APIs. Currently supports ChatGPT, but DALLE and Whisper support is coming.

  

• Scout Monitoring

  www.scoutapm.com featured

  Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

  

• serge

  40 5,634 9.7 Svelte

  A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

  

• chatgpt-telegram-bot

  3 2,978 7.8 Python

  🤖 A Telegram bot that integrates with OpenAI's official ChatGPT APIs to provide answers, written in Python (by n3d1117)

• text-generation-webui

  881 39,393 9.9 Python

  A Gradio web UI for Large Language Models.

  TheBloke_Wizard-Vicuna-30B-Uncensored-GPTQ + https://github.com/oobabooga/text-generation-webui + RTX 3090 24GB

• LocalAI

  87 23,063 9.9 C++

  :robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed inference

  

  Yep, with https://github.com/go-skynet/LocalAI - it probably has the largest support for ggml-compatible models nowadays (including falcon) https://localai.io/model-compatibility/index.html#model-compatibility-table

• text-generation-webui-docker

  6 380 7.2 Dockerfile

  Docker variants of oobabooga's text-generation-webui, including pre-built images.

  Here's the dockerized oogabooga link: https://github.com/Atinoda/text-generation-webui-docker

• guidance

  89 12,248 9.5 Jupyter Notebook

  Discontinued A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance] (by microsoft)

  

  I haven't tried it yet but this framework from microsoft seems to be a good way to channel LLMs into your target application.

• InfluxDB

  www.influxdata.com featured

  Purpose built for real-time analytics at any scale. InfluxDB Platform is powered by columnar analytics, optimized for cost-efficient storage, and built with open data standards.

  

• LLaMA-Adapter

  16 4,021 9.4 Python

  Discontinued Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters [Moved to: https://github.com/OpenGVLab/LLaMA-Adapter] (by ZrrSkywalker)

  

Suggest a related project