ubisoft-laforge-daft-exprt
vits
ubisoft-laforge-daft-exprt | vits | |
---|---|---|
3 | 6 | |
114 | 6,294 | |
0.0% | - | |
0.0 | 0.0 | |
about 1 year ago | 5 months ago | |
Python | Python | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ubisoft-laforge-daft-exprt
-
Using deepfake voice programms for devolopement - Possible/practical?
Ubisoft has their Daft-Exprt stuff on github that does a tolerable job of prosody/tone transfer, which is pretty much necessary to naturalize shit if you're going to be doing a cloning pipeline that isn't using a service's packaged voices. Without this I wouldn't even consider an ai speech pipeline due to how hardly constrained the range of tone is even with something like replicant studios actor shit.
-
Using A.I voices or Sound Fonts (i.e. Undertale or Animal Crossing)
Ubisoft has some stuff that works to naturalize pretty well via prosody transfer https://github.com/ubisoft/ubisoft-laforge-daft-exprt
-
Anyone have experience with AI voices?
Prosody transfer (I use https://github.com/ubisoft/ubisoft-laforge-daft-exprt), use an example speech segment to change the timing, intonation, and other properties of a different segment of speech. Such as taking evenly paced ML generated speech, and turning it into Captain Kirk iambic pentameter.
vits
-
[D] TTS systems to download & run offline
And the voice encapsulation system VITS https://github.com/jaywalnut310/vits
- [D] What is the best open source text to speech model?
- githubで公開されている音声自動生成AI、日本のアニメキャラ2890名分の音声を学習素材に超速度で進化中
- 日本語英語中国語を読み上げできる音声自動生成AIがgithubで公開され話題に
- Adversarial Learning for End-to-End Text-to-Speech
- [R] Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speech
What are some alternatives?
TTS - 🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production
tortoise-tts - A multi-voice TTS system trained with an emphasis on quality
hifi-gan - HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesis
tortoise-tts-fast - Fast TorToiSe inference (5x or your money back!)
STYLER - Official repository of STYLER: Style Factor Modeling with Rapidity and Robustness via Speech Decomposition for Expressive and Controllable Neural Text to Speech, INTERSPEECH 2021
tacotron2 - Tacotron 2 - PyTorch implementation with faster-than-realtime inference
Parallel-Tacotron2 - PyTorch Implementation of Google's Parallel Tacotron 2: A Non-Autoregressive Neural TTS Model with Differentiable Duration Modeling
EmotiVoice - EmotiVoice 😊: a Multi-Voice and Prompt-Controlled TTS Engine
vall-e - An unofficial PyTorch implementation of the audio LM VALL-E
tacotron - A TensorFlow implementation of Google's Tacotron speech synthesis with pre-trained model (unofficial)
glow-tts - A Generative Flow for Text-to-Speech via Monotonic Alignment Search