Story2Hallucination VS Voice-Cloning-App

(Added Feb. 5, 2021) Story2Hallucination.ipynb - Colaboratory by bonkerfield. Uses BigGAN to generate images/videos. GitHub.

Third which is pretty new to me is the Story2Hallucination. Which takes text, (say your story) and uses Google Deep Sleep to create a visual using AI to generate images for what the story is describing. And example can be found here.

I ran some Lovecraft through Story2Hallucination[1] which uses Big Sleep to make videos from text.

The results were quite something - https://m.imgur.com/tfWLsSR

[1] https://github.com/lots-of-things/Story2Hallucination

Using Story2Hallucination: https://boredhumans.com/music_videos/Story2Hallucination_withwords.mp4 (made with https://github.com/lots-of-things/Story2Hallucination). The problem with it was that I had no easy way to match the timing of the lyrics on the screen with the real singing. So I then made a new version at https://boredhumans.com/music_videos/Story2Hallucination_nowords.mp4 where I edited the code so it did not show the words at all. But it is somewhat boring to watch.

Here you go: https://github.com/lots-of-things/Story2Hallucination/

This is basic attempt at that: https://github.com/lots-of-things/Story2Hallucination . It turns the text you write into a dream-like series of images converted into an animated GIF. It does not look real, but it is a start.

Story2Hallucination github by u/bonkerfield : GITHUB LINK

I've added a slightly simpler notebook to Story2Hallucination that can render GIFs on Google Colab. Note that the story text has to be fairly short or it will make a gigantic unrenderable GIF.

Credit to https://github.com/lots-of-things/Story2Hallucination/ and onwards - I converted the script to run in regular python, and on windows through WSL+CUDA (Though, the windows tweaks seem to have caused other issues, Will probably have to roll back and dualboot on this device to do more)

I then feed the audio and transcriptions into this tool which handles assembling the dataset, and training s voice from that dataset.

This Voice CLoning App is much easier to use then others, maybe you can give it a try?

Although I had to fix some errors before I got it to work (mainly due to my data containing characters that do not appear in the alphabet), I achieved exceptional results with https://github.com/BenAAndrew/Voice-Cloning-App. It uses Tacotron2 and has a useful web GUI.

Nice to see this here - Silero is also the engine that powers the "dataset builder" for Voice-Cloning-App (https://github.com/BenAAndrew/Voice-Cloning-App), a GUI TTS system that modifies Tacotron2 slightly.

Just sharing the links in case others are new to the space and keen to tinker on some solid open-source offerings.

If you have an Nvidia card you can try this one

Voice cloning app github:https://github.com/BenAAndrew/Voice-Cloning-App