TTS
silero-models
Our great sponsors
TTS | silero-models | |
---|---|---|
231 | 32 | |
28,959 | 4,517 | |
5.2% | - | |
9.5 | 4.7 | |
about 6 hours ago | 6 months ago | |
Python | Jupyter Notebook | |
Mozilla Public License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
TTS
-
What things are happening in ML that we can't hear oer the din of LLMs?
Not sure how relevant this is but note that Coqui TTS (the realistic TTS) has already shut down
-
Base TTS (Amazon): The largest text-to-speech model to-date
I've used coqui.ai's TTS models[0] and library[1] to great success. I was able to get cloned voice to be rendered in about 80% of the audio clip length, and I believe you can also stream the response. Do note the model license for XTTS, it is one they wrote themselves that has some restrictions.
- FLaNK Stack Weekly 12 February 2024
-
Coqui.ai Is Shutting Down
My only exposure to Coqui was their text to speech software. If I remember correctly the website was a commercialized service with TTS and probably some other related things. I hope the software work continues in the open.
-
Hello guys, any selfhosted alternative to eleven labs?
Coqui.ai TTS (https://github.com/coqui-ai/TTS)
-
Demo of Anagnorisis - completely local recommendation system powered by Llama 2. Radio mode. Work in progress.
"tts_models/multilingual/multi-dataset/xtts_v2" model from https://github.com/coqui-ai/TTS. It gives pretty good results and works with references, so it's pretty easy to change the voice. By the way the source code of the project is open: https://github.com/volotat/Anagnorisis but be ready, the code is pretty raw for now.
-
David Attenborough is now narrating my life
I converted a book to audiobook a couple of months ago using the tts code here: https://github.com/coqui-ai/TTS
Wasn't as good as eleven labs, but it had enough options that I found a voice that I liked to listen to.
-
Open Source Libraries
coqui-ai/TTS
-
How I created a text-adventure game using ChatGPT
For a realistic text to speech the program uses TTS by coqui ai. And I think it is amazing.
silero-models
-
Weird A.I. Yankovic, a cursed deep dive into the world of voice cloning
I doubt it's currently actually "the best open source text to speech", but the answer I came up with when throwing a couple of hours at the problem some months ago was "Silero" [0, 1].
Following the "standalone" guide [2], it was pretty trivial to make the model render my sample text in about 100 English "voices" (many of which were similar to each other, and in varying quality). Sampling those, I got about 10 that were pretty "good". And maybe 6 that were the "best ones" (pretty natural, not annoying to listen to).
IIRC the license was free for noncommercial use only. I'm not sure exactly "how open source" they are, but it was simple to install the dependencies and write the basic Python to try it out; I had to write a for loop to try all the voices like I wanted. I ended using something else for the project for other reasons, but this could still be fairly good backup option for some use cases IMO.
[0] https://github.com/snakers4/silero-models#text-to-speech
- What's the best text-to-speech free non-cloud software?
- Hey can anyone else add the text to speech
-
Messing around with a TTS extension
Glados was the first experiment. I moved on to silero afterwards: https://github.com/snakers4/silero-models
-
Ask HN: Open-source video transcribing software?
Some months ago I tried the Silero Models: https://github.com/snakers4/silero-models
With the audio sources I had, in English, the transcription had many mistakes. The good side is that installing and running the software worked as described in their documentation, so maybe itβs worth giving it a try by yourself.
-
Silero V3: fast high-quality text-to-speech in 20 languages with 173 voices
https://github.com/snakers4/silero-models/tree/941f911858f51...
Looks like it was previously GPL until 2 months ago, you could use the old version
Also also, HN cuts the anchors in ULRs, so here is the full URL
Based on my limited understanding it seems to be possible to use these models using C# and the ONNX runtime without needing any Python or other dependencies installed? https://github.com/snakers4/silero-models#onnx=
Is this correct?
Can you elaborate further? I am not familiar with the field, but their benchmarks here seem to show quality similar to Google: https://github.com/snakers4/silero-models/wiki/Quality-Bench...
The only trick I can see being played is that Google was benchmarked on September 2020, so likely has already improved and they don't want to show that. Is CommonVoice a better standard to use when comparing these tools?
The link (which I also copied below in the comments, b/c it was noticed after publishing) should be:
- https://github.com/snakers4/silero-models#text-to-speech
This link leads to the TTS section, whish contains the full list of all of the speakers and languages.
What are some alternatives?
tortoise-tts - A multi-voice TTS system trained with an emphasis on quality
Real-Time-Voice-Cloning - Clone a voice in 5 seconds to generate arbitrary speech in real-time
vosk-api - Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
piper - A fast, local neural text to speech system
bark - π Text-Prompted Generative Audio Model
PaddleSpeech - Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.
coqui-docker - Docker images for Coqui AI
gTTS - Python library and CLI tool to interface with Google Translate's text-to-speech API
speech-and-text-unity-ios-android - Speed to text in Unity iOS use Native Speech Recognition
DeepSpeech - DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.