WhisperSpeech
tts-generation-webui
| WhisperSpeech | tts-generation-webui | |
|---|---|---|
| 5 | 5 | |
| 3,417 | 1,327 | |
| 4.7% | - | |
| 9.2 | 8.6 | |
| 7 days ago | 6 days ago | |
| Jupyter Notebook | TypeScript | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
WhisperSpeech
-
OpenVoice: Versatile Instant Voice Cloning
I haven't tried openvoice, but I did try whisperspeech and it will do the same thing. You can optionally pass in a file with a reference voice, and the tts uses it.
https://github.com/collabora/whisperspeech
I found it to be kind of creepy hearing it in my own voice. I also tried a friend of mine who had a french canadian accent and strangely the output didn't have his accent.
-
Show HN: WhisperFusion – Ultra-low latency conversations with an AI chatbot
- WhisperSpeech for the text-to-speech - https://github.com/collabora/WhisperSpeech
and an LLM (phi-2, Mistral, etc.) in between
-
WhisperFusion: Ultra-low latency conversations with an AI chatbot
Hi, I used the [WhisperSpeech](https://github.com/collabora/WhisperSpeech) model for the TTS part after I did some serious torch.compile optimizations to bring the latency down. The Whisper speech recognition and the LLM were optimized through TensorRT-LLM by Marcus and Vineet.
It's not perfect but I am still extremely proud of how it came out. :)
- WhisperSpeech – An Open Source text-to-speech system built by inverting Whisper
-
StyleTTS2 – open-source Eleven Labs quality Text To Speech
I think you’re talking about just using Whisper to annotate audio for a TTS pipeline but someone from Collabora actually created a TTS model directly from Whisper embeddings https://github.com/collabora/WhisperSpeech
tts-generation-webui
-
OpenVoice: Versatile Instant Voice Cloning
https://github.com/rsxdalv/tts-generation-webui
-
[D] Open-source SOTA Audio-to-Audio: how do I sound like a famous actor?
I'd use the TTS web UI with RVC. I'll link to the UI. If you are looking for an individual project, you should check in the Readme for RVC. https://github.com/rsxdalv/tts-generation-webui
-
Best and Free Alternative to Elevenlabs?
Ready made ui for both https://github.com/rsxdalv/tts-generation-webui
-
Need Text-2-Speech that doesn't suck for your YouTube videos? Try this one!
This new TTS WebUI is like Automatic1111 for text 2 speech. Sounds completely real! People are already making audio books with it. Check it out! https://github.com/rsxdalv/tts-generation-webui
- I have integrated musicgen into my one-click-installable gradio webui
What are some alternatives?
piper - A fast, local neural text to speech system
Retrieval-based-Voice-Conversion-WebUI - Easily train a good VC model with voice data <= 10 mins!
WhisperFusion - WhisperFusion builds upon the capabilities of WhisperLive and WhisperSpeech to provide a seamless conversations with an AI.
Artificial-Intelligence-Deep-Learning-Machine-Learning-Tutorials - A comprehensive list of Deep Learning / Artificial Intelligence and Machine Learning tutorials - rapidly expanding into areas of AI/Deep Learning / Machine Vision / NLP and industry specific areas such as Climate / Energy, Automotives, Retail, Pharma, Medicine, Healthcare, Policy, Ethics and more.
whisper-ctranslate2 - Whisper command line client compatible with original OpenAI client based on CTranslate2.
diffwave - DiffWave is a fast, high-quality neural vocoder and waveform synthesizer.
monotonic_align - Monotonic Alignment Search
chatGPT-cheatsheet - An ever-evolving introduction to ChatGPT, AI, and machine learning (including prompt examples and Python-built chatbots)
VoiceCraft - Zero-Shot Speech Editing and Text-to-Speech in the Wild
zipslicer - A library for incremental loading of large PyTorch checkpoints
whisper - Robust Speech Recognition via Large-Scale Weak Supervision
audio-diffusion-pytorch - Audio generation using diffusion models, in PyTorch.