Is anyone doing always-on voice to text with a local llama at home?

• llama_farm

  17 141 7.6 Hy

  Use local llama LLM or openai to chat, discuss/summarize your documents, youtube videos, and so on.

Bark and another one I forgot. See this for example implementation.

• talk

  3 553 8.1 TypeScript

  Let's make sand talk (by yacineMTB)

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• nerd-dictation

  28 1,158 3.6 Python

  Simple, hackable offline speech to text - using the VOSK-API.

• willow

  37 2,361 9.6 C

  Open source, local, and self-hosted Amazon Echo/Google Home competitive Voice Assistant alternative

  

I have something similar running locally using https://github.com/toverainc/willow and a python script.

• vllm

  30 18,041 9.9 Python

  A high-throughput and memory-efficient inference and serving engine for LLMs

  

I believe this is the api I was referring to https://github.com/vllm-project/vllm

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project