Retrieval-based-Voice-Conversion-WebUI
pyannote-audio
Retrieval-based-Voice-Conversion-WebUI | pyannote-audio | |
---|---|---|
56 | 15 | |
19,255 | 5,077 | |
7.0% | 4.3% | |
9.6 | 8.6 | |
3 days ago | 7 days ago | |
Python | Jupyter Notebook | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Retrieval-based-Voice-Conversion-WebUI
-
OpenVoice: Versatile Instant Voice Cloning
RVC does live voice changing with a little latency: https://github.com/RVC-Project/Retrieval-based-Voice-Convers...
The product isn't exactly spectacular, but most of the works seems to have bene done. Just needs someone to go over the UI and make it less unstable, really.
-
I made a theme song for Vito Loses
Retrieval-based-Voice-Conversion-WebUI. Nearly destroyed a hard drive in the process of getting the fucking thing to train on Vito's voice but it came together eventually.
-
Spider-Man: The Animated Series in REAL
Yeah, Man all the AI tools are fun RVC is fun to play with as well.
-
Ask HN: AI Voice Reverse
Would it be possible to reverse a AI generated voice if they spoke themselves[0] instead of using TTS[1]?
Since the AI voice is trained shouldn't a reversing AI also be able to seperate the trained data?
[0] https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI
-
RIAA Reports AI Vocal Cloning Site 'Voicify' to the U.S. Government
Well fortunately most people I see making AI cover they use open source tools to do that (https://github.com/RVC-Project/Retrieval-based-Voice-Convers...)
-
Open Source Libraries
RVC-Project/Retrieval-based-Voice-Conversion-WebUI: Singing Voice Conversion
- RVC WebUI and training on Intel ARC
-
Lyrebird the Linux voice changer now supports PipeWire
At least that's what https://github.com/RVC-Project/Retrieval-based-Voice-Convers... links to
Realtime Voice Conversion Software using RVC : w-okada/voice-changer
-
The next FF record, will have different versions with Burton's vocals...
I don't know how to use it yet, but the program is here. https://github.com/RVC-Project/Retrieval-based-Voice-Conversion-WebUI/blob/main/docs/README.en.md
- Retrieval Based Voice Conversion (WebUI)
pyannote-audio
-
Open Source Libraries
pyannote/pyannote-audio
-
AI Transcribing tool for video with two voices?
Open Source. I've found this to be pretty nice, which is just a wrapper on some hugging face models https://github.com/pyannote/pyannote-audio
-
Show HN: PodText.ai – Search anything said on a podcast, Highlight text to play
(not the creator, but I've built something similar for personal use)
This is a great library for determining which speaker is speaking during each time in an audio file (this is called speaker diarization); I imagine they used it or something like it. Works really well out of the box!
https://github.com/pyannote/pyannote-audio
-
I wanted to use OpenAI's Whisper speech-to-text on my Mac without installing stuff in the Terminal so I made MacWhisper, a free Mac app to transcribe audio and video files for easy transcription and subtitle generation. Would love to hear some feedback on it!
Do you think pyannote could be implemented in the Pro version of the app to support diarization?
- I won several speaker diarization challenges with pyannote.audio
-
I made a free transcription service powered by Whisper AI
Free startup idea: Use Whisper with pyannote-audio[0]’s speaker diarization. Upload a recording, get back a multi-speaker annotated transcription.
Make a JSON API and I’ll be your first customer.
[0] https://github.com/pyannote/pyannote-audio
-
Can Whisper differentiate between different voices?
Whisper can’t, but pyannote-audio can. I’ve seen a couple of prototypes out there which link the two together.
-
[D] Is there a way to distinguish different human voices from 1 audio file ?
You can use pyannote python library. It will identify different speakers from audio and will create small audio files with those speakers.
- Post-Game Analysis: Destiny & Alex VS Andrew & Zen Shapiro
-
A quick and dirty tool for automatically analyzing speaking time in online debates (Effortpost)
This Colab notebook is basically a standard template (with small changes) provided by pyannote-audio, the library implementing the speaker diarization functionality we need. (template)
What are some alternatives?
RVC-GUI - Just a fork of RVC for easy audio file voice conversion locally
NeMo - A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
Mangio-RVC-Fork - *CREPE+HYBRID TRAINING* A very experimental fork of the Retrieval-based-Voice-Conversion-WebUI repo that incorporates a variety of other f0 methods, along with a hybrid f0 nanmedian method.
speechbrain - A PyTorch-based Speech Toolkit
bark - 🔊 Text-Prompted Generative Audio Model
Resemblyzer - A python package to analyze and compare voices with deep learning
ultimatevocalremovergui - GUI for a Vocal Remover that uses Deep Neural Networks.
Kaldi Speech Recognition Toolkit - kaldi-asr/kaldi is the official location of the Kaldi project.
voice-changer - リアルタイムボイスチェンジャー Realtime Voice Changer
inaSpeechSegmenter - CNN-based audio segmentation toolkit. Allows to detect speech, music, noise and speaker gender. Has been designed for large scale gender equality studies based on speech time per gender.
so-vits-svc-fork - so-vits-svc fork with realtime support, improved interface and more features. [Moved to: https://github.com/voicepaw/so-vits-svc-fork]
uis-rnn - This is the library for the Unbounded Interleaved-State Recurrent Neural Network (UIS-RNN) algorithm, corresponding to the paper Fully Supervised Speaker Diarization.