Is anyone doing always-on voice to text with a local llama at home?

1. llama_farm

   1 17 153 6.7 Hy

   Discontinued Use local llama LLM or openai to chat, discuss/summarize your documents, youtube videos, and so on.

   Bark and another one I forgot. See this for example implementation.

2. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

3. talk

   2 3 588 8.1 TypeScript

   Let's make sand talk (by yacineMTB)

   

4. nerd-dictation

   3 29 1,864 3.6 Python

   Simple, hackable offline speech to text - using the VOSK-API.

   

5. willow

   4 40 3,051 7.4 C

   Open source, local, and self-hosted Amazon Echo/Google Home competitive Voice Assistant alternative

   

   I have something similar running locally using https://github.com/toverainc/willow and a python script.

6. vllm

   5 92 82,489 10.0 Python

   A high-throughput and memory-efficient inference and serving engine for LLMs

   

   I believe this is the api I was referring to https://github.com/vllm-project/vllm

Suggest a related project