[D] What is the best open source text to speech model?

1. tortoise-tts

   1 148 14,121 6.5 Jupyter Notebook

   A multi-voice TTS system trained with an emphasis on quality

   

   Tortoise TTS is supposed to be good. However inference can take a while if not on GPU's, so might not produce the real-time text-to-speech effect you want.

2. InfluxDB

   www.influxdata.com featured

   InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

   

3. speechbrain

   2 27 9,808 9.7 Python

   A PyTorch-based Speech Toolkit

   

   I don't know if it's the best, but Speechbrain is supposed to be state of the art.

4. tacotron

   3 3 2,972 0.0 Python

   A TensorFlow implementation of Google's Tacotron speech synthesis with pre-trained model (unofficial)

   

   Tacotron submitted: Mar 29, 2017 paper: https://arxiv.org/pdf/1703.10135.pdf github: https://github.com/keithito/tacotron (Not the official implementation but is the once cited the most)

5. tacotron2

   4 29 5,227 0.0 Jupyter Notebook

   Tacotron 2 - PyTorch implementation with faster-than-realtime inference

   

6. flowtron

   5 6 898 0.0 Jupyter Notebook

   Flowtron is an auto-regressive flow-based generative network for text to speech synthesis with control over speech variation and style transfer

   

7. FastSpeech2

   6 4 2,006 0.0 Python

   An implementation of Microsoft's "FastSpeech 2: Fast and High-Quality End-to-End Text to Speech"

   

   FastSpeech2 submitted: Jun 8, 2020 paper: https://arxiv.org/pdf/2006.04558.pdf github: https://github.com/ming024/FastSpeech2 (Not the official implementation but is the once cited the most)

8. NeMo

   7 30 14,217 9.9 Python

   A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

   

9. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

10. waveglow

    8 2 2,328 0.0 Python

    A Flow-based Generative Network for Speech Synthesis

    

11. hifi-gan

    9 5 2,133 0.0 Python

    HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesis

    

12. radtts

    10 1 285 0.0 Roff

    Provides training, inference and voice conversion recipes for RADTTS and RADTTS++: Flow-based TTS models with Robust Alignment Learning, Diverse Synthesis, and Generative Modeling and Fine-Grained Control over of Low Dimensional (F0 and Energy) Speech Attributes.

    

    RadTTS submitted: Aug 18, 2021 (NVIDIA page, not Arxiv) paper: https://openreview.net/pdf?id=0NQwnnwAORi github: https://github.com/NVIDIA/radtts

13. Speech-Backbones

    11 1 574 0.0 Jupyter Notebook

    This is the main repository of open-sourced speech technology by Huawei Noah's Ark Lab.

    

14. vits

    12 6 7,180 0.0 Python

    VITS: Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech

    

15. STYLER

    13 3 159 1.8 Python

    Official repository of STYLER: Style Factor Modeling with Rapidity and Robustness via Speech Decomposition for Expressive and Controllable Neural Text to Speech, INTERSPEECH 2021 (by keonlee9420)

    

16. DiffSinger

    14 1 238 10.0 Python

    PyTorch implementation of DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism (focused on DiffSpeech) (by keonlee9420)

    

    DiffTTS (DiffSinger) submitted: Apr 3, 2021 paper: https://arxiv.org/pdf/2104.01409v1.pdf github: https://github.com/keonlee9420/DiffSinger

17. SaaSHub

    www.saashub.com featured

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    

Suggest a related project