xVA-Synth VS bark

xvasynth https://github.com/DanRuta/xVA-Synth

Try to get this project running and see if it what you want https://github.com/DanRuta/xVA-Synth

This is a source-available project, not an open source project. https://github.com/DanRuta/xVA-Synth/issues/7 pointed out in January of 2021 that the project has no license, implying that the creator reserves all rights except those they must waive to comply with GitHub’s terms of service. The project still has no license today.

Also, it’s not as easy to download the project binaries as the README makes it sound. The README links to https://github.com/DanRuta/xVA-Synth/releases, but no releases have been published. The README also says to “download the app from the Nexus websites”, but that doesn’t seem possible either. For one thing, the README mentions “the nexus.com website” further down, but https://nexus.com/ is unrelated – they actually mean https://www.nexusmods.com/. Even on Nexus Mods, searching for “xva synth” brings up results like “xVASynth 2 - SKVA Synth”, which sound like specific voice models, not the app itself. The one place I was able to find the app for download was on Steam as a free app: https://store.steampowered.com/app/1765720/xVASynth_v2/.

Second, this was made by a new tool for bethesda games modding called xVA-Synth a tool that lets you synthesize the voices of many bethesda game characters. Unlike 15.ai, this tool allows for way more customizability in voice clips, allowing you adjust the pitch and lengh of individual letters, and adjust the tonation of each segment. I've only just started playin with the tool myself, and I'm super impressed. I'm really excited to see what comes of this, both for mods and shitposting.

!pip install git+https://github.com/suno-ai/bark.git

To my knowledge, the model being used for this is "chirp" which is 'based on' bark[1], an AI text to speech model.

The github page for bark links to a page about chirp, which returns a 404 page for me [2]. that the model for suno.ai's song generator isn't too much different than the text to speech model.

My hunch is that it was something like a coincidence that the bark model was capable of producing music, and that was spun off into this product. Unfortunately, there seems to still be issues with bark when generating long (like book length) spoken audio. Which is too bad, as someone who's worked jobs that require lots of driving, it would be awesome to be able to have any text read to me in a natural sounding voice.

[1]https://github.com/suno-ai/bark

Stable-audio and MusicGen sounds better than Jukebox.

But the best so far is Suno.ai ( https://app.suno.ai ) especially with their V3 model they have very impressive results, the fidelity is not studio quality but they're getting very close.

It's very likely based on their TTS model they have released before Bark, but trained on more data and with higher resolution.

https://github.com/suno-ai/bark

https://github.com/suno-ai/bark

> Bark was developed for research purposes. It is not a conventional text-to-speech model but instead a fully generative text-to-audio model, which can deviate in unexpected ways from provided prompts. Suno does not take responsibility for any output generated. Use at your own risk, and please act responsibly.

I've generated probably >200 songs now with Suno, of which perhaps 10 have been any good, and I can't detect any pattern in terms of the outputs.

Here's another one which is pretty good. I accidentally copied and pasted the prompt and lyrics, and it's amazing to me how 'musically' it renders the prompt:

hahah wow! cool :-)

PS: OT, I am reading this Bark thing(https://github.com/suno-ai/bark). Can I run it locally on a Macbook 2015 with 8GB RAM?

I have it locally. The model is on huggingface. It runs with about 8GB VRAM.

suno-ai/bark