Success with a local voice chat agent

This page summarizes the projects mentioned and recommended in the original post on /r/LocalLLaMA

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • kobold_assistant

    Like ChatGPT's voice conversations with an AI, but entirely offline/private/trade-secret-friendly, using local AI models such as LLama 2 and Whisper

  • kobold-assistant uses whisper. https://github.com/lee-b/kobold_assistant

  • guidance

    Discontinued A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance] (by microsoft)

  • Thinking more about it, it is kinda insane that we can now just tell a model how to use an API. Maybe in the near future, more powerful local models can write their own (simple) scripts so one doesn't have to hardcode the API everytime. Maybe stuff like https://huggingface.co/docs/transformers/transformers_agents can be of some inspiration to you (and ofc others like langchain). Thinking of an idea to use something like https://github.com/microsoft/guidance so that if an LM decides to call an API, it sticks to a template (and then maybe could expand on that)

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • iris-llm

    IRIS: Intelligent Residential Integration System - a mind for your home!

  • https://github.com/dkjroot/iris-llm/tree/prototypes use the prototypes branch.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts