Is anyone doing always-on voice to text with a local llama at home?

• llama_farm

  17 143 6.7 Hy

  Use local llama LLM or openai to chat, discuss/summarize your documents, youtube videos, and so on.

Bark and another one I forgot. See this for example implementation.

• talk

  3 559 8.1 TypeScript

  Let's make sand talk (by yacineMTB)

• Scout Monitoring

  www.scoutapm.com featured

  Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

  

• nerd-dictation

  28 1,185 2.9 Python

  Simple, hackable offline speech to text - using the VOSK-API.

• willow

  38 2,430 9.6 C

  Open source, local, and self-hosted Amazon Echo/Google Home competitive Voice Assistant alternative

  

I have something similar running locally using https://github.com/toverainc/willow and a python script.

• vllm

  31 20,017 9.9 Python

  A high-throughput and memory-efficient inference and serving engine for LLMs

  

I believe this is the api I was referring to https://github.com/vllm-project/vllm

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project