Our great sponsors
-
text-generation-webui
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
-
agnai
AI Agnostic (Multi-user and Multi-bot) Chat with Fictional Characters. Designed with scale in mind.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
In order to interact with oobabooga webui via API, run the script with either: --api (for the oobabooga built in API) Or --extension openai (for an openai drop in replacement API) Get sure to follow instructions to setup requirements for the openai and get sure you're inside the venv or conda env before installing the requirements.
Agnaistic installation (manual or docker) instructions are here