tacotron2
speechbrain
Our great sponsors
| tacotron2 | speechbrain | |
|---|---|---|
| 28 | 26 | |
| 4,890 | 7,869 | |
| 1.2% | 7.1% | |
| 0.0 | 9.8 | |
| 4 months ago | 7 days ago | |
| Jupyter Notebook | Python | |
| BSD 3-clause "New" or "Revised" License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tacotron2
- [D] What is the best open source text to speech model?
-
[D] The model used in the AI generated Jay-z vocals
Which might use https://github.com/NVIDIA/tacotron2 in their backend
-
Can anyone reccomend any free voice cloning software/websites even if it provided limited word options
One thing is uberduck.ai but I think it's freemium (it's free but some features are premium). There's also tacotron 2.0 and its pytorch page. Many other softwares on sub but tacotron gave this and this and this.
-
Sauron be spitting bars
Maybe we can use AI to hear this rapped by a famous rapper?
-
Kerfuś
Sadly GothicBot the TTS I knew, doesn't exist anymore, but here is an alternative. It works in polish from what I heard.
-
How far are we from being able to clone a singers voice?
From what I’ve seen, NVIDIA’s Tacotron2 can already be used to create some pretty convincing singing.
-
Is it possible to make compelling synthesized speech with fairly low-quality recordings?
You might want to try something like Tacotron 2 by Nvidia to experiment with your current data.
-
What voice-changing apps are available right now?
We have the TorToiSe repo, the SV2TTS repo, and from here you have the other models like Tacotron 2, FastSpeech 2, and such. A there is a lot that goes into training a baseline for these models on the LJSpeech and LibriTTS datasets. Fine tuning is left up to the user.
- The OG (OC)
-
XQC Falls for dono thinkng its Adept
I had tried tacotron2 + waveglow and it's quite easy to get very good results. The hardest part is collecting clean data.
speechbrain
- SpeechBrain 1.0: A free and open-source AI toolkit for all things speech
- FLaNK Stack Weekly 22 January 2024
-
[D] Training ASR model using SpeechBrain
You likely have a very broken sample in one of your batches. It looks like your training actually went through a few batches before it horked the error at you. A quick google shows a similar issue in the github repo: https://github.com/speechbrain/speechbrain/issues/649 .
-
Whisper.cpp
https://github.com/ggerganov/whisper.cpp https://speechbrain.github.io/
-
[D] What is the best open source text to speech model?
I don't know if it's the best, but Speechbrain is supposed to be state of the art.
-
[D] What's stopping you from working on speech and voice?
- https://github.com/speechbrain/speechbrain
- Specific Voice recognition
- How to get high-quality, low-cost Speech-to-Text transcription?
- [D] Speech Enhancement SOTA
- Speaker diarization
What are some alternatives?
tortoise-tts - A multi-voice TTS system trained with an emphasis on quality
espnet - End-to-End Speech Processing Toolkit
Voice-Cloning-App - A Python/Pytorch app for easily synthesising human voices
pyannote-audio - Neural building blocks for speaker diarization: speech activity detection, speaker change detection, overlapped speech detection, speaker embedding
Real-Time-Voice-Cloning - Clone a voice in 5 seconds to generate arbitrary speech in real-time
Resemblyzer - A python package to analyze and compare voices with deep learning
TTS - 🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production
ukrainian-onnx-model - An ONNX model for speech recognition of the Ukrainian language
NeMo - A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
SincNet - SincNet is a neural architecture for efficiently processing raw audio samples.
waveglow - A Flow-based Generative Network for Speech Synthesis
speech-to-text-benchmark - speech to text benchmark framework