EmotiVoice
Real-Time-Voice-Cloning
| EmotiVoice | Real-Time-Voice-Cloning | |
|---|---|---|
| 5 | 96 | |
| 6,369 | 50,878 | |
| - | - | |
| 8.9 | 0.0 | |
| 3 months ago | about 2 months ago | |
| Python | Python | |
| Apache License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
EmotiVoice
- FLaNK Stack Weekly 12 February 2024
-
WhisperSpeech – An Open Source text-to-speech system built by inverting Whisper
Interested to see how it performs for Mandarin Chinese speech synthesis, especially with prosody and emotion. The highest quality open source model I've seen so far is EmotiVoice[0], which I've made a CLI wrapper around to generate audio for flashcards.[1] For EmotiVoice, you can apparently also clone your own voice with a GPU, but I have not tested this.[2]
[0] https://github.com/netease-youdao/EmotiVoice
[1] https://github.com/siraben/emotivoice-cli
[2] https://github.com/netease-youdao/EmotiVoice/wiki/Voice-Clon...
-
Microsoft releases Windows AI studio to run and fine tune models locally
Interesting. I'll have to check to be sure, but I think maybe something is happening automagically if you have reasonably up to date nvidia drivers on the host OS, because I was able to run the EmotiVoice TTS docker (which requires nvidia gpu) from WSL2.
https://github.com/netease-youdao/EmotiVoice
- FLaNK Stack Weekly for 13 November 2023
- EmotiVoice: A Multi-Voice and Prompt-Controlled TTS Engine
Real-Time-Voice-Cloning
- FLaNK Stack Weekly 12 February 2024
- Voice Cloning
- Show HN: Real Time Voice Cloning – Instant DeepFake Audio
- Bu dakikadaki bahsedilen yapay zekayı bulamadım yardımcı olur musunuz?
- Alarming Rise of Voice Cloning Fraud Targeting the Elderly through AI
- Dark Brandon going hard
- Conselho do TRF-4 afasta juiz da Lava Jato
-
What Photoshop Can't Do, DragGAN Can! See How! Paper Explained, Along with Additional Supplementary Video Footage
Oh maybe it is available: https://github.com/CorentinJ/Real-Time-Voice-Cloning
-
Regarding recent posts about AI voice generation
I know this isn't the bulk of your argument, but if the concern is uploading, offline voice cloners have existed for years (albeit not as good as elevenlabs) but will presumably get far better in the years to come now that everyone has seen what's possible and as PC compute power continues to improve. https://github.com/CorentinJ/Real-Time-Voice-Cloning
- 'He Would Still Be Here': Man Dies by Suicide After Talking with AI Chatbot, Widow Says | The incident raises concerns about guardrails around quickly-proliferating conversational AI models.
What are some alternatives?
Cgml - GPU-targeted vendor-agnostic AI library for Windows, and Mistral model implementation.
TTS - 🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production
DeepFaceLab - DeepFaceLab is the leading software for creating deepfakes.
draw-a-ui - Draw a mockup and generate html for it
tortoise-tts - A multi-voice TTS system trained with an emphasis on quality
MockingBird - 🚀AI拟声: 5秒内克隆您的声音并生成任意语音内容 Clone a voice in 5 seconds to generate arbitrary speech in real-time
lhotse - Tools for handling speech data in machine learning projects.
silero-models - Silero Models: pre-trained speech-to-text, text-to-speech and text-enhancement models made embarrassingly simple
voice100 - Voice100 includes neural TTS/ASR models. Inference of Voice100 is low cost as its models are tiny and only depend on CNN without autoregression.
glados-voice-assistant - DIY Voice Assistant based on the GLaDOS character from Portal video game series. Works with home assistant!