clip-interrogator VS stable-diffusion-artists

It's image -> words, the inverse of stable diffusion.

see: https://github.com/pharmapsychotic/clip-interrogator

I have been using this on a CPU https://github.com/pharmapsychotic/clip-interrogator, I tried a lot of pre-trained models combinations, all are slow.

I'm addition to controlnet, try the clip interrogator to see how clip would describe the image and then use that language in your prompt. You can try the whole image or cropped portions. There is a colab available if you don't want to run it locally.

In my current process, I use CLIP Interrogator to produce a high level caption and wd14 tagger for more granular booru tags. Typically in that order, because you can append the results from the latter to the former. Both tools perform with greater accuracy than the standard interrogators in img2img and give you more flexibility and features as well. You still have to do some manual adjustments, but I generally prefer this process over starting from scratch.

If you are interested in this, definitely see if you can get some of the OSS models running and get a feel for how to interrogate them. Maybe see if you can get some mileage out of the CLIP-Interrogator

Next, I used the lists of artists, flavors, mediums, movements, and negatives that are used for the clip-interrogator and pasted these in the chat and told the bot to categorize them accordingly. As you can only paste up to certain characters in single message (4-5K in 3.5 and 6-8K in 4).

Here’s the specific one I’m using (runs in browser)

I really enjoy using the CLIP Interrogator on huggingspaces, but it is often super slow and sometimes straight up breaks. Now it is possible to locally install it, https://github.com/pharmapsychotic/clip-interrogator but I don't know if its viable to run on a laptop with 6gb videocard anyway.

It wouldn't have "tags" (is that the right term?) for the names of present day artists who's work isn't public domain, so you wouldn't be able to prompt with the names of living artists (like this)

Idea1: try "microbe bacteria", "microbe virus", "microbe water bear" Idea2: prefix prompt with "cute" Idea3: Different artists will give significantly different results, you can find a good list to experiment with here https://github.com/kaikalii/stable-diffusion-artists Idea4: add "vivid colors"

I know NAI was trained on Danbooru, but that dataset is huge, so it can't possibly have been trained on the entirety of it. I am wondering if there is something like an artist list for NovelAI similar to the one for Stable Diffusion.

I started working on this site a little over a month ago having just started fiddling with Stable Diffusion on my vastly underpowered gaming PC. My curiosity of what artists the model "understood" led me to track down a github repo by kaikalii. kaikalii's process for processing and documenting identified artists was excellent and I submitted a few I found to the repo. I found that I wanted a few additional features, though: proper tags, a random artist lookup, searching, and some real world application of the artist prompts. I built out the site, which took about a week, and went about generating metadata and curated prompts, which took a reaaaaaally long time (especially my very snarky comments on the particularly bad prompts ). In the end, between kaikalii's list and my own research, I ended up with 93 artists and a little over 1.8K images at time of "launch". I have a fairly large backlog of other prompts to try out, but wanted to get this out in the wild before I continued my research. Here's a little sampling: