silero-models
Real-Time-Voice-Cloning
Our great sponsors
| silero-models | Real-Time-Voice-Cloning | |
|---|---|---|
| 32 | 96 | |
| 4,546 | 50,738 | |
| - | - | |
| 4.7 | 0.0 | |
| 6 months ago | about 1 month ago | |
| Jupyter Notebook | Python | |
| GNU General Public License v3.0 or later | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
silero-models
-
Weird A.I. Yankovic, a cursed deep dive into the world of voice cloning
I doubt it's currently actually "the best open source text to speech", but the answer I came up with when throwing a couple of hours at the problem some months ago was "Silero" [0, 1].
Following the "standalone" guide [2], it was pretty trivial to make the model render my sample text in about 100 English "voices" (many of which were similar to each other, and in varying quality). Sampling those, I got about 10 that were pretty "good". And maybe 6 that were the "best ones" (pretty natural, not annoying to listen to).
IIRC the license was free for noncommercial use only. I'm not sure exactly "how open source" they are, but it was simple to install the dependencies and write the basic Python to try it out; I had to write a for loop to try all the voices like I wanted. I ended using something else for the project for other reasons, but this could still be fairly good backup option for some use cases IMO.
[0] https://github.com/snakers4/silero-models#text-to-speech - What's the best text-to-speech free non-cloud software?
- Hey can anyone else add the text to speech
-
Messing around with a TTS extension
Glados was the first experiment. I moved on to silero afterwards: https://github.com/snakers4/silero-models
-
Ask HN: Open-source video transcribing software?
Some months ago I tried the Silero Models: https://github.com/snakers4/silero-models
With the audio sources I had, in English, the transcription had many mistakes. The good side is that installing and running the software worked as described in their documentation, so maybe it’s worth giving it a try by yourself.
- Silero V3：20种语言的快速高质量文本到语音，有173种声音 (Silero V3: fast high-quality text-to-speech in 20 languages with 173 voices)
-
Hacker News top posts: Jun 20, 2022
Silero V3: fast high-quality text-to-speech in 20 languages with 173 voices\ (56 comments)
- Silero V3: fast high-quality text-to-speech in 20 languages with 173 voices
Real-Time-Voice-Cloning
- FLaNK Stack Weekly 12 February 2024
- Voice Cloning
- Show HN: Real Time Voice Cloning – Instant DeepFake Audio
- Bu dakikadaki bahsedilen yapay zekayı bulamadım yardımcı olur musunuz?
- Alarming Rise of Voice Cloning Fraud Targeting the Elderly through AI
- Dark Brandon going hard
- Conselho do TRF-4 afasta juiz da Lava Jato
-
What Photoshop Can't Do, DragGAN Can! See How! Paper Explained, Along with Additional Supplementary Video Footage
Oh maybe it is available: https://github.com/CorentinJ/Real-Time-Voice-Cloning
-
Regarding recent posts about AI voice generation
I know this isn't the bulk of your argument, but if the concern is uploading, offline voice cloners have existed for years (albeit not as good as elevenlabs) but will presumably get far better in the years to come now that everyone has seen what's possible and as PC compute power continues to improve. https://github.com/CorentinJ/Real-Time-Voice-Cloning
- 'He Would Still Be Here': Man Dies by Suicide After Talking with AI Chatbot, Widow Says | The incident raises concerns about guardrails around quickly-proliferating conversational AI models.
What are some alternatives?
TTS - 🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production
DeepSpeech - DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.
DeepFaceLab - DeepFaceLab is the leading software for creating deepfakes.
piper - A fast, local neural text to speech system
tortoise-tts - A multi-voice TTS system trained with an emphasis on quality
Serpent.AI - Game Agent Framework. Helping you create AIs / Bots that learn to play any game you own!
MockingBird - 🚀AI拟声: 5秒内克隆您的声音并生成任意语音内容 Clone a voice in 5 seconds to generate arbitrary speech in real-time
Porcupine - On-device wake word detection powered by deep learning
glados-voice-assistant - DIY Voice Assistant based on the GLaDOS character from Portal video game series. Works with home assistant!
Pytorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration
NeMo - A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)