stable-diffusion-webui-tokenizer
An extension for stable-diffusion-webui that adds a tab that lets you preview how CLIP model would tokenize your text. (by AUTOMATIC1111)
test_my_prompt
This script is to test your prompts with the AUTOMATIC1111 webui (by Extraltodeus)
stable-diffusion-webui-tokenizer | test_my_prompt | |
---|---|---|
5 | 13 | |
128 | 177 | |
- | - | |
10.0 | 1.2 | |
over 1 year ago | 7 days ago | |
Python | Python | |
- | - |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
stable-diffusion-webui-tokenizer
Posts with mentions or reviews of stable-diffusion-webui-tokenizer.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-01-11.
-
How are prompt words tokenized in Stable Diffusion?
This: https://github.com/AUTOMATIC1111/stable-diffusion-webui-tokenizer seems to realize that, but I don't know how trustworthy this actually is. I wish to know to be able to have more fine control on what words I may train a model without having unforseen consequences on other parts of the same model.
-
It would be even more interesting if we had numbers of users for each
Tokens are how the AI "reads" text, so that it can convert it to a numerical representation. You can think of them as individual words, but the relation isn't one-to-one. There's actually an extension for AUTOMATIC1111's WebUI for token viewing, and if you look at the example image, you can see that most words are represented by one token, but the word "nimbus" is represented by two. So a "short term" memory of 2000 tokens in KoboldAI means that the AI will base its generations on the last 2000 tokens and "forget" whatever is written before that. You can also define a "long term" memory via the Author's Notes and World Information, and the AI will prefix these before generating when appropriate, so that it "remembers" them better.
- Automatic1111 prompt simplifier plugin
-
The difference between DreamBooth models, and Textual inversion embeddings, and why we should start pushing toward training embeddings instead of models.
Your prompts are converted into numbered tokens. https://github.com/AUTOMATIC1111/stable-diffusion-webui-tokenizer I also saw an extension that let you change the weights of the numbered tokens in a textual inversion embedding. And textual inversion lets you specify how many tokens to use up.
-
Has somebody dumped the ~50k 'text' tokens in SD 1.5.ckpt yet? If so, where? I'll share some examples I've found to illustrate:
By using the awesome Tokenizer extension for Automatic1111, I've been able to hunt around for uni-tokens in SD- words which are represented by just one token instead of being broken down into multiple ones. I put in a number, hit the Tokenize button, and it tells me what word or set of characters (or emji, etc) that represents. Like this.
test_my_prompt
Posts with mentions or reviews of test_my_prompt.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-01-01.
- Popular film + cameras by decade for era-specific prompts
-
Automatic1111 prompt simplifier plugin
It was https://github.com/Extraltodeus/test_my_prompt
-
Forgot name of auto1111 script: This script sequentially deletes a part of a prompt, then plots the creations.
Test My Prompt
- This image was generated with over 1000 prompt modifiers!
- How do you optimize your prompts?
- Vintage Cars
-
Turned the Mona Lisa into a photo through img2img
There shouldn't be any html tags in the python script file, so I don't know where that error is coming from. maybe try downloading the script file by downloading the zipped archive of the git project at https://github.com/Extraltodeus/test_my_prompt
-
Created some utility scripts for stable-diffusion-webui! First ones are Prompt reducer and Prompt puncher!
This looks a lot like the "Test my Prompt" script, which is my favorite script. I'll give yours a try too!
- Redhead Ranger
- Test my prompt. Auto1111
What are some alternatives?
When comparing stable-diffusion-webui-tokenizer and test_my_prompt you can also consider the following projects:
awesome-generative-ai - A curated list of modern Generative Artificial Intelligence projects and services
stable-diffusion-webui - Stable Diffusion web UI
shift-attention - In stable diffusion, generate a sequence of images shifting attention in the prompt.
stable-diffusion-webui-prompt-utilities - A set of utilities for the stable-diffusion-webui
generative-ai-dashboard
stable-diffusion-webui-tokenizer vs awesome-generative-ai
test_my_prompt vs stable-diffusion-webui
stable-diffusion-webui-tokenizer vs shift-attention
test_my_prompt vs stable-diffusion-webui-prompt-utilities
stable-diffusion-webui-tokenizer vs stable-diffusion-webui-prompt-utilities
test_my_prompt vs shift-attention
stable-diffusion-webui-tokenizer vs generative-ai-dashboard
stable-diffusion-webui-tokenizer vs stable-diffusion-webui