YourTTS
StarGANv2-VC
YourTTS | StarGANv2-VC | |
---|---|---|
3 | 3 | |
832 | 458 | |
- | - | |
1.6 | 1.3 | |
about 1 year ago | 12 months ago | |
Jupyter Notebook | Python | |
GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
YourTTS
-
[D] What are the best ways to make and run a fast custom TTS?
YourTTS is available in Coqui TTS. It's fast and rather easy to use, but at the cost of quality. It does English, French and Portuguese in the same model.
-
How can i use better text to speech services in linux?
For "natural" output you need a trained model for your language and a software for WaveNNN. YourTTS and coqui.ai are the two best approach for realtime TTS
- Use deep fake tech to say stuff with your favorite characters
StarGANv2-VC
-
[D] What's the best speech to speech deep fake voice project?
So far I've only been able to find StarGANv2. Which one redditor used to create this. Is this the best there is or are there better alternatives?
-
[R] State-of-the-art voice cloning
I used this to make this
-
Use deep fake tech to say stuff with your favorite characters
This looks like it was previously known as Vocodes, made by echelon who is here on HN:
https://news.ycombinator.com/item?id=23965787
The code repos used are listed in their credits section, and it looks like a mixture of (customised?) Tacotron2, Glow-TTS, HifGan, and others. Videos are generated using Wav2Lip.
Text-To-Speech (TTS) has improved greatly over the past several years, but there's still a lot of metallic sounds in "pure" TTS implementations. I've started exploring voice style conversion, otherwise known as "voice cloning", and there are some interesting repos out there with decent results. These work differently from TTS, in that you don't type out the text to be spoken, but rather pass in an audio file of what you want the cloned speaker to say, and the system outputs an audio file with the same sounds (words, intonation) but with a different speaker identity.
This may be easier to get the right cadence and emotion in the generated audio, as text doesn't capture proper emotion and intonation. I suspect game character audio will use more of voice-style conversion instead of pure TTS simply to get the right emotional cadence of the lines being delivered.
Some interesting voice style conversion repos (in no order, just a random selection if anyone is interested in exploring):
https://github.com/yl4579/StarGANv2-VC
What are some alternatives?
voice_conversion
tortoise-tts - A multi-voice TTS system trained with an emphasis on quality
autovc - AutoVC: Zero-Shot Voice Style Transfer with Only Autoencoder Loss
espnet - End-to-End Speech Processing Toolkit
espeak-ng - eSpeak NG is an open source speech synthesizer that supports more than hundred languages and accents.
tt-vae-gan - Timbre transfer with variational autoencoding and cycle-consistent adversarial networks. Able to transfer the timbre of an audio source to that of another.
jukebox - Code for the paper "Jukebox: A Generative Model for Music"
TTS - πΈπ¬ - a deep learning toolkit for Text-to-Speech, battle-tested in research and production