Our great sponsors
-
simpleAI
An easy way to host your own AI API and expose alternative models, while being compatible with "open" AI clients.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
I wanted to share with you SimpleAI, a self-hosted alternative to OpenAI API.
It's compatible with the OpenAI client so you don't have to change much in your existing code (or can use it to easily query your API).
The aim of this project is to replicate the (main) endpoints of OpenAI API, and to let you easily and quickly plug in any new model. It basically allows you to deploy your custom model wherever you want and easily, while minimizing the amount of changes both on server and client sides.
If your goal is to have a slightly more friendly UI for end users, it should be relatively easy to build something custom, using the OpenAI clients (or requests package) and something like Streamlit. Or even a notebook (you can use the OpenAI cookbook as a starting point).
If your goal is to have a slightly more friendly UI for end users, it should be relatively easy to build something custom, using the OpenAI clients (or requests package) and something like Streamlit. Or even a notebook (you can use the OpenAI cookbook as a starting point).