WhisperSpeech
StyleTTS2
| WhisperSpeech | StyleTTS2 | |
|---|---|---|
| 5 | 7 | |
| 3,417 | 4,092 | |
| 4.7% | - | |
| 9.2 | 8.6 | |
| 7 days ago | 30 days ago | |
| Jupyter Notebook | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
WhisperSpeech
-
OpenVoice: Versatile Instant Voice Cloning
I haven't tried openvoice, but I did try whisperspeech and it will do the same thing. You can optionally pass in a file with a reference voice, and the tts uses it.
https://github.com/collabora/whisperspeech
I found it to be kind of creepy hearing it in my own voice. I also tried a friend of mine who had a french canadian accent and strangely the output didn't have his accent.
-
Show HN: WhisperFusion – Ultra-low latency conversations with an AI chatbot
- WhisperSpeech for the text-to-speech - https://github.com/collabora/WhisperSpeech
and an LLM (phi-2, Mistral, etc.) in between
-
WhisperFusion: Ultra-low latency conversations with an AI chatbot
Hi, I used the [WhisperSpeech](https://github.com/collabora/WhisperSpeech) model for the TTS part after I did some serious torch.compile optimizations to bring the latency down. The Whisper speech recognition and the LLM were optimized through TensorRT-LLM by Marcus and Vineet.
It's not perfect but I am still extremely proud of how it came out. :)
- WhisperSpeech – An Open Source text-to-speech system built by inverting Whisper
-
StyleTTS2 – open-source Eleven Labs quality Text To Speech
I think you’re talking about just using Whisper to annotate audio for a TTS pipeline but someone from Collabora actually created a TTS model directly from Whisper embeddings https://github.com/collabora/WhisperSpeech
StyleTTS2
-
Hello guys, any selfhosted alternative to eleven labs?
Take a look at StyleTTS2
- I've open sourced my Flutter plugin to run on-device LLMs on any platform. TestFlight builds available now.
-
Robot Dad
Love it OP!
Check out https://github.com/yl4579/StyleTTS2
For your local voice cloning needs.
HN discussion here https://news.ycombinator.com/item?id=38335255
Funny I’ve been talking about cloning my dad for a while in this same fashion. Thanks for the inspiration.
- FLaNK Stack Weekly for 20 Nov 2023
-
StyleTTS2 – open-source Eleven Labs quality Text To Speech
To save people some time, this is tested on Ubuntu 22.04 (google is being annoying about the download link, saying too many people have downloaded it in the past 24 hours, but if you wait a bit it should work again):
git clone https://github.com/yl4579/StyleTTS2.git -
Weird A.I. Yankovic, a cursed deep dive into the world of voice cloning
You're in luck, the code dropped 6 hours ago :) https://github.com/yl4579/StyleTTS2
What are some alternatives?
piper - A fast, local neural text to speech system
LoRA - Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
WhisperFusion - WhisperFusion builds upon the capabilities of WhisperLive and WhisperSpeech to provide a seamless conversations with an AI.
whisper-ctranslate2 - Whisper command line client compatible with original OpenAI client based on CTranslate2.
silero-models - Silero Models: pre-trained speech-to-text, text-to-speech and text-enhancement models made embarrassingly simple
monotonic_align - Monotonic Alignment Search
screenshot-to-code - Drop in a screenshot and convert it to clean code (HTML/Tailwind/React/Vue)
VoiceCraft - Zero-Shot Speech Editing and Text-to-Speech in the Wild
FLaNK-EveryTransitSystem - Every transit system
whisper - Robust Speech Recognition via Large-Scale Weak Supervision
bark - 🔊 Text-Prompted Generative Audio Model