waifu-diffusion VS chaiNNer

It's slander to say that the WD team is milking donations in the same way UD is. They already have a public working model which they are continuing to train. The WD team has also implemented features like aspect ratio bucketing into their custom trainer. If they were really milking the project for donations they would have just used the base compvis trainer it was forked from.

Use one of the original SD repos, or the code for Waifu Diffusion, or the Smirkingface refactor.

My model is based off waifu-diffusion.

waifu diffusion (free) and NovelAI (paid afaik) is what I know

This is the one I use: https://github.com/harubaru/waifu-diffusion

This is called textual inversion which use many images and a small group of promtps to describe a single element, and there are two methods: with frozen model and with unfrozen model. The first one just creates a new “word” to “guide” the model, in other words, a word that means the same as a chunk of a prompt. The resulting data is a tiny file. The second one (better known dreamboth training) adds new data to de model, so it can copy the character’s characteristics and artist style more effecively resulting in a new model file (cpkt) There are not a single tutorial, so you can find many info on r/StableDiffusion. Also, there is a third method which is based on the original training (many images and its own description) Instruction are here: Training guide I don’t know if this guide is finished though

The model is a tweaked version of waifu-diffusion using textual inversion. Still not perfect but the AI can create pretty plausible images.

It is like Comfy UI Jr. but much easier to navigate. Huge amount of useful features, and you can connect it to the WebUI. I highly recommend checking it out: https://github.com/chaiNNer-org/chaiNNer

For the video it turned out a bit too "hairy" compared to many of the still images (I believe because of the long landscape aspect ratio), but I ran out of time to fiddle. I used the Seed Travel extension for the animation and ChaiNNer with the 4x-Valar upscaler.

While at it, check out ChaiNNer -> https://github.com/chaiNNer-org/chaiNNer

If you want to do more, there's chaiNNer and CupScale. You need to download an AI model to use those. There are a lot of anime/cartoon models out, so pick one that you like from here. (Note: Upscaly doesn't support these custom models.)

For local there's cupscale and chainner