Caster
silero-vad
Caster | silero-vad | |
---|---|---|
7 | 10 | |
329 | 2,866 | |
0.6% | - | |
2.9 | 6.9 | |
about 1 month ago | 12 days ago | |
Python | Python | |
GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Caster
- Ask HN: I'm disabled and out of money. Now what?
- Is there a Foundry VTT module that helps people who have difficulty moving their hands and fingers?
- Dragonfly-Based Voice Programming and Accessibility Toolkit
-
Ask HN: Who Wants to Collaborate?
Unfortunately Dragon development has mostly stalled for the last 5 years (Dragon 15 was a leap forward but that was quite some time ago now).
You can still make use of it via Dragonfly (see also Caster[0]) as mentioned by a sibling comment or by using Talon[1] or Vocola.
Having used a computer 90% hands free for about a year and a half back in 2019, I chose Dragonfly then, but would probably choose Talon nowadays - less futsing about and it has alternative speech engine options.
I also recommend looking into eye tracking: the Tobii gaming products[2] work well for general computer mousing with some software like Talon or Precision Gaze[3] - well enough for me to make a hands free mod[4] for Factorio, for example.
[0]: https://github.com/dictation-toolbox/Caster
- How can I make Mycroft recognize non verbal audio sounds to command it?
- Linux Voice recognition/dictation/voice assistant/ one handed operation?
-
Any programmers using dictation?
so I found this thing called Caster today that miiight save my job. it does allow you to format code with Dragon and navigate VS Code (albeit poorly.) It's also open-source, so you can add features.
silero-vad
-
New models and developer products announced at OpenAI DevDay
>How do you detect speech starting and stopping?
https://github.com/snakers4/silero-vad
-
[Discussion] Video Translation Task
you could look into https://github.com/guillaumekln/faster-whisper especially the VAD section (Voice Activity Detector) using https://github.com/snakers4/silero-vad
-
Using Whisper to transcribe the entire Forensic Files series
I also had the same synchronization issue, so I wrote a WebUI/CLI that uses Silero-VAD that first splits the audio whenever there a silent portion (or every 30 seconds), and I haven't experienced it since:
-
Whisper - A new free AI model from OpenAI that can transcribe Japanese (and many other languages) at up to "human level" accuracy
By the way, I've updated the WebUI to now also support using Silero VAD to break up the audio into distinct sections, and run Whisper on each section and then combine them into one single transcript/SRT file.
-
[P] A more detailed post about Silero VAD on The Gradient
The VAD is always available on Github
- Silero VAD: pre-trained enterprise-grade voice activity detector
-
[P] Silero VAD: One voice detector to rule them all
I also pinned some interesting comments here regarding mobile and IOT usage here - https://github.com/snakers4/silero-vad/issues/37
- One voice detector to rule them all
What are some alternatives?
kaldi-active-grammar - Python Kaldi speech recognition with grammars that can be set active/inactive dynamically at decode-time
whisper - Robust Speech Recognition via Large-Scale Weak Supervision
dragonfly - Speech recognition framework allowing powerful Python-based scripting and extension of Dragon NaturallySpeaking (DNS), Windows Speech Recognition (WSR), Kaldi and CMU Pocket Sphinx
cheetah - On-device streaming speech-to-text engine powered by deep learning
voice_datasets - 🔊 A comprehensive list of open-source datasets for voice and sound computing (95+ datasets).
rhino - Rhino is an open-source implementation of JavaScript written entirely in Java
GassistPi - Google Assistant for Single Board Computers
Common-Voice - Audio Classification with machine learning
mr-robot - A multi-utility discord bot. Playback hilarious voice tracks on-demand, wiki for anything, turn on/off IoT enabled devices, and more!
talk2windows - Add voice commands to control the Windows 10+ desktop.
hollow-knight-voice-commands - A fun little python tool to play Hollow Knight with only voice commands