Our great sponsors
-
OpenLLM
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint, locally and in the cloud.
-
FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
text-generation-webui
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
-
basaran
Discontinued Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
-
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
revolt
Repository for miscellaneous repository management and discussions: https://github.com/revoltchat/revolt/discussions
What's the rationale for telemetry tracking?
https://github.com/bentoml/OpenLLM/blob/main/src/openllm/uti...
Cool stuff! How does this compare with Fastchat, which seems like another open source project that helps run LLM models?
At a glance, it seems like it's going for lots of similar goals (run LLMs with interoperable APIs):
https://github.com/lm-sys/FastChat
Looks grate! I'm planning to integrate it into my new project(to-chatgpt: https://github.com/SimFG/to-chatgpt), which will provide users of the ChatGPT applications with a wider range of LLM service options.
There's the OpenedAI-API extension for text-generation-webui: https://github.com/oobabooga/text-generation-webui/tree/main...
plugging the open source and self hostable https://revolt.chat which i've found to have great UX and be very performant compared to discord.