flowtron
DiffSinger
flowtron | DiffSinger | |
---|---|---|
6 | 1 | |
881 | 223 | |
0.3% | - | |
0.0 | 10.0 | |
10 months ago | over 2 years ago | |
Jupyter Notebook | Python | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
flowtron
- [D] What is the best open source text to speech model?
- A thought: we need language and voice synthesis models as free as Stable Diffusion
-
Ask HN: Best FOSS software to read text allowed
If you want free (as open source) software, the NVIDIA research GitHub also has some good tools. For example : https://github.com/NVIDIA/flowtron
-
Visas Marr on the tragedy of Darth Plagueis
Voice in this video was synthesized using a Flowtron trained on Visas' speech patterns.(https://github.com/NVIDIA/flowtron)
-
Bastila Shan reads the Sith and Jedi Codes
The voicelines in this video was created using a Flowtron Text-to-Speech (TTS) model trained on Bastila's voice patterns to read the Sith and Jedi Codes. For more information: https://github.com/NVIDIA/flowtron I created a small tutorial for how to use it on Google Colab: https://www.youtube.com/watch?v=1Bmg1c5U5Bg
-
I created a Text-to-Speech model based on Bastila's voice patterns.
For more information on Flowtron: https://github.com/NVIDIA/flowtron/
DiffSinger
-
[D] What is the best open source text to speech model?
DiffTTS (DiffSinger) submitted: Apr 3, 2021 paper: https://arxiv.org/pdf/2104.01409v1.pdf github: https://github.com/keonlee9420/DiffSinger
What are some alternatives?
TensorFlowTTS - :stuck_out_tongue_closed_eyes: TensorFlowTTS: Real-Time State-of-the-art Speech Synthesis for Tensorflow 2 (supported including English, French, Korean, Chinese, German and Easy to adapt for other languages)
radtts - Provides training, inference and voice conversion recipes for RADTTS and RADTTS++: Flow-based TTS models with Robust Alignment Learning, Diverse Synthesis, and Generative Modeling and Fine-Grained Control over of Low Dimensional (F0 and Energy) Speech Attributes.
tacotron - A TensorFlow implementation of Google's Tacotron speech synthesis with pre-trained model (unofficial)
espnet - End-to-End Speech Processing Toolkit
Speech-Backbones - This is the main repository of open-sourced speech technology by Huawei Noah's Ark Lab.
WaveRNN - WaveRNN Vocoder + TTS
tacotron2 - Tacotron 2 - PyTorch implementation with faster-than-realtime inference
espeak-ng - eSpeak NG is an open source speech synthesizer that supports more than hundred languages and accents.
STYLER - Official repository of STYLER: Style Factor Modeling with Rapidity and Robustness via Speech Decomposition for Expressive and Controllable Neural Text to Speech, INTERSPEECH 2021
NeMo - A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
vits - VITS: Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech