TTS
vosk-api
Our great sponsors
TTS | vosk-api | |
---|---|---|
230 | 58 | |
28,249 | 6,894 | |
6.9% | 3.4% | |
9.5 | 5.9 | |
14 days ago | 21 days ago | |
Python | Jupyter Notebook | |
Mozilla Public License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
TTS
-
What things are happening in ML that we can't hear oer the din of LLMs?
Not sure how relevant this is but note that Coqui TTS (the realistic TTS) has already shut down
-
Base TTS (Amazon): The largest text-to-speech model to-date
I've used coqui.ai's TTS models[0] and library[1] to great success. I was able to get cloned voice to be rendered in about 80% of the audio clip length, and I believe you can also stream the response. Do note the model license for XTTS, it is one they wrote themselves that has some restrictions.
- FLaNK Stack Weekly 12 February 2024
-
Coqui.ai Is Shutting Down
My only exposure to Coqui was their text to speech software. If I remember correctly the website was a commercialized service with TTS and probably some other related things. I hope the software work continues in the open.
-
Hello guys, any selfhosted alternative to eleven labs?
Coqui.ai TTS (https://github.com/coqui-ai/TTS)
-
Demo of Anagnorisis - completely local recommendation system powered by Llama 2. Radio mode. Work in progress.
"tts_models/multilingual/multi-dataset/xtts_v2" model from https://github.com/coqui-ai/TTS. It gives pretty good results and works with references, so it's pretty easy to change the voice. By the way the source code of the project is open: https://github.com/volotat/Anagnorisis but be ready, the code is pretty raw for now.
-
David Attenborough is now narrating my life
I converted a book to audiobook a couple of months ago using the tts code here: https://github.com/coqui-ai/TTS
Wasn't as good as eleven labs, but it had enough options that I found a voice that I liked to listen to.
-
Open Source Libraries
coqui-ai/TTS
-
How I created a text-adventure game using ChatGPT
For a realistic text to speech the program uses TTS by coqui ai. And I think it is amazing.
vosk-api
- Apollo dev posts backend code to Git to disprove Redditโs claims of scrapping and inefficiency
-
Creating a live transcript bot using Vosk Ai
So I don't know if my issue comes from my lack of knowledge of discord.js/voice or VOSK. so I guess the most important thing I need to see is if I am creating a proper stream for the Vosk API to capture the audio. if I can figure out how to capture an audio stream I can probably import that in to vosk and figure out how to use vosk myself. but right now I can't even get close! Thank you in advance...Sorry if this isn't the right place for this
-
Show HN: Willow โ Open-Source Privacy-Focused Voice Assistant Hardware
first, good initiative! thanks for sharing. i think you gotta be more diligent and careful with the problem statement.
checking the weather in Sofia, Bulgaria requires cloud, current information. it's not "random speech". ESP SR capability issues don't mean that you cannot process it locally.
the comment was on "voice processing" i.e. sending speech to the cloud, not sending a call request to get the weather information.
besides, local intent detection, beyond 400 commands, there are great local STT options, working better than most cloud STTs for "random speech"
-
A new voice assistant that looks promising
The set up script wants to download https://github.com/alphacep/vosk-api/releases/download/v0.3.45/vosk-model-en-v0.3.45.zip, but this resource is not found. AFAICT all releases never contained a model file. Remedy: hardcode one model from https://alphacephei.com/vosk/models. I guessed and picked the one with the closest name, vosk-model-en-us-0.22.zip, just so I could continue.
- Google Assistant alternative - Dicio assistant app for Android
- Mycroft โ open-source voice assistant
-
Some updates to my holographic anime virtual assistant
Vosk (the voice recognition library) is the main factor in terms of RPI model. It seems from their Github that 3B and 3B+ may work well enough for use, but I haven't tested.
-
Alternative to Google voice input
There is an offline speech recognition API (https://github.com/alphacep/vosk-api) which could be used to build a Google Voice alternative.
- Whisper โ open source speech recognition by OpenAI
-
GPodder A simple, open-source podcast client and media Aggregator
I wonder if you could train some machine learning model using the data from sponsorblock and achieve good results on podcasts as well. That way you wouldn't be dependent on a crowdsourced online database for your offline listening. Alternatively, even creating a transscript using something like [1] and scanning for words like "sponsor", "ad" or specific company names might already be a good enough heuristic.
What are some alternatives?
whisper - Robust Speech Recognition via Large-Scale Weak Supervision
Kaldi Speech Recognition Toolkit - kaldi-asr/kaldi is the official location of the Kaldi project.
tortoise-tts - A multi-voice TTS system trained with an emphasis on quality
Real-Time-Voice-Cloning - Clone a voice in 5 seconds to generate arbitrary speech in real-time
silero-models - Silero Models: pre-trained speech-to-text, text-to-speech and text-enhancement models made embarrassingly simple
vosk-server - WebSocket, gRPC and WebRTC speech recognition server based on Vosk and Kaldi libraries
AutoSub - A CLI script to generate subtitle files (SRT/VTT/TXT) for any video using either DeepSpeech or Coqui
DeepSpeech - Install Mozilla DeepSpeech on a Raspberry Pi 4
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
piper - A fast, local neural text to speech system
bark - ๐ Text-Prompted Generative Audio Model
PaddleSpeech - Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.