Our great sponsors
-
kobold_assistant
Like ChatGPT's voice conversations with an AI, but entirely offline/private/trade-secret-friendly, using local AI models such as LLama 2 and Whisper
-
guidance
Discontinued A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance] (by microsoft)
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
kobold-assistant uses whisper. https://github.com/lee-b/kobold_assistant
Thinking more about it, it is kinda insane that we can now just tell a model how to use an API. Maybe in the near future, more powerful local models can write their own (simple) scripts so one doesn't have to hardcode the API everytime. Maybe stuff like https://huggingface.co/docs/transformers/transformers_agents can be of some inspiration to you (and ofc others like langchain). Thinking of an idea to use something like https://github.com/microsoft/guidance so that if an LM decides to call an API, it sticks to a template (and then maybe could expand on that)
https://github.com/dkjroot/iris-llm/tree/prototypes use the prototypes branch.