tacotron2
Tacotron 2 - PyTorch implementation with faster-than-realtime inference (by NVIDIA)
TTS
🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production (by coqui-ai)
Our great sponsors
| tacotron2 | TTS | |
|---|---|---|
| 28 | 231 | |
| 4,890 | 29,174 | |
| 1.2% | 6.6% | |
| 0.0 | 9.5 | |
| 4 months ago | 12 days ago | |
| Jupyter Notebook | Python | |
| BSD 3-clause "New" or "Revised" License | Mozilla Public License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tacotron2
Posts with mentions or reviews of tacotron2.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-04-13.
- [D] What is the best open source text to speech model?
-
[D] The model used in the AI generated Jay-z vocals
Which might use https://github.com/NVIDIA/tacotron2 in their backend
-
Can anyone reccomend any free voice cloning software/websites even if it provided limited word options
One thing is uberduck.ai but I think it's freemium (it's free but some features are premium). There's also tacotron 2.0 and its pytorch page. Many other softwares on sub but tacotron gave this and this and this.
-
Sauron be spitting bars
Maybe we can use AI to hear this rapped by a famous rapper?
-
Kerfuś
Sadly GothicBot the TTS I knew, doesn't exist anymore, but here is an alternative. It works in polish from what I heard.
-
How far are we from being able to clone a singers voice?
From what I’ve seen, NVIDIA’s Tacotron2 can already be used to create some pretty convincing singing.
-
Is it possible to make compelling synthesized speech with fairly low-quality recordings?
You might want to try something like Tacotron 2 by Nvidia to experiment with your current data.
-
What voice-changing apps are available right now?
We have the TorToiSe repo, the SV2TTS repo, and from here you have the other models like Tacotron 2, FastSpeech 2, and such. A there is a lot that goes into training a baseline for these models on the LJSpeech and LibriTTS datasets. Fine tuning is left up to the user.
- The OG (OC)
-
XQC Falls for dono thinkng its Adept
I had tried tacotron2 + waveglow and it's quite easy to get very good results. The hardest part is collecting clean data.
TTS
Posts with mentions or reviews of TTS.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-03-28.
-
OpenAI deems its voice cloning tool too risky for general release
lol this marketing technique is getting very old. https://github.com/coqui-ai/TTS is already amazing and open source.
-
What things are happening in ML that we can't hear oer the din of LLMs?
Not sure how relevant this is but note that Coqui TTS (the realistic TTS) has already shut down
https://coqui.ai
-
Base TTS (Amazon): The largest text-to-speech model to-date
I've used coqui.ai's TTS models[0] and library[1] to great success. I was able to get cloned voice to be rendered in about 80% of the audio clip length, and I believe you can also stream the response. Do note the model license for XTTS, it is one they wrote themselves that has some restrictions.
[0] https://huggingface.co/coqui/XTTS-v2
[1] https://github.com/coqui-ai/TTS
- FLaNK Stack Weekly 12 February 2024
- Coqui Is Shutting Down
-
Coqui.ai Is Shutting Down
My only exposure to Coqui was their text to speech software. If I remember correctly the website was a commercialized service with TTS and probably some other related things. I hope the software work continues in the open.
https://github.com/coqui-ai/TTS
-
Hello guys, any selfhosted alternative to eleven labs?
Coqui.ai TTS (https://github.com/coqui-ai/TTS)
-
Demo of Anagnorisis - completely local recommendation system powered by Llama 2. Radio mode. Work in progress.
"tts_models/multilingual/multi-dataset/xtts_v2" model from https://github.com/coqui-ai/TTS. It gives pretty good results and works with references, so it's pretty easy to change the voice. By the way the source code of the project is open: https://github.com/volotat/Anagnorisis but be ready, the code is pretty raw for now.
-
XTTS voice cloning with only a seconds of audio
A recent update to their GitHub also has a no-code gradio ui to facilitate fine-tuning and inferencing locally. https://github.com/coqui-ai/TTS/releases/tag/v0.21.3
-
At a loss trying to get coqui_tts extension to load
No API token found for 🐸Coqui Studio voices - https://coqui.ai
What are some alternatives?
When comparing tacotron2 and TTS you can also consider the following projects:
tortoise-tts - A multi-voice TTS system trained with an emphasis on quality
Voice-Cloning-App - A Python/Pytorch app for easily synthesising human voices
Real-Time-Voice-Cloning - Clone a voice in 5 seconds to generate arbitrary speech in real-time
silero-models - Silero Models: pre-trained speech-to-text, text-to-speech and text-enhancement models made embarrassingly simple
NeMo - A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
vosk-api - Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node
waveglow - A Flow-based Generative Network for Speech Synthesis
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
larynx - End to end text to speech system using gruut and onnx
piper - A fast, local neural text to speech system