stable-diffusion-webui-dataset-tag-editor
Extension to edit dataset captions for SD web UI by AUTOMATIC1111 (by toshiaki1729)
sd-scripts
By kohya-ss
stable-diffusion-webui-dataset-tag-editor | sd-scripts | |
---|---|---|
7 | 64 | |
628 | 4,253 | |
- | - | |
6.5 | 9.7 | |
8 days ago | 2 days ago | |
Python | Python | |
MIT License | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
stable-diffusion-webui-dataset-tag-editor
Posts with mentions or reviews of stable-diffusion-webui-dataset-tag-editor.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-05-05.
-
Using hydrus for managing tags of training data
There are few tools for mass tagging data. Each with their own problems. * stable-diffusion-webui-dataset-tag-editor has good features. But it also has bugs that make it nearly unusable. It is also resource heavy as it runs in the webUI with stable diffusion, and stable diffusion always has models loaded. * BooruDatasetTagManager lacks many useful features.
-
What program to use for mass editing tags for training images?
I tried stable-diffusion-webui-dataset-tag-editor but it has a bug where it would get confused and sometimes swap tags from one image to another ruining everything.
-
Experiment AI Anime w/ C-Net 1.1 + GroundingDINO + SAM + MFR (workflow)
Use WD 1.4 tagger (https://github.com/toriato/stable-diffusion-webui-wd14-tagger) to extract prompt words from each frame (threshold 0.65), then use the dataset tag editor (https://github.com/toshiaki1729/stable-diffusion-webui-dataset-tag-editor) for batch editing, mainly:
-
Civitai should enforce a replicability check
If you haven't come across them yet, these two guides: this and this are good reads, and this one for info about learning rates. Beyond what those guides give info on, there are two points in which I noticed a large increase in my Lora quality- better captioning, and when I resized all the images to have about the same amount of pixels as was being trained. For captioning I have a text file with types of tags I know I'll have to hit- subject (solo, 1girl, 1boy, those early tags), what kind of perspective- portrait, closeup, full body, etc, where the character is looking (looking up, looking to the side, looking at viewer, etc), what the perspective of the viewer is (from above, from below, pov, etc), and I write down common clothing tags for the character. So I have that off to the side, and then I load up this extension for webui. It has a bit of learning curve, but I point it at what pictures I've gotten and get it to interrogate with all the models it offers except blip, and set the confidence threshold to 0.10 so it's spitting out lots of tags. After it interrogates all the pictures, I use the database feature to remove the duplicate tags, and then I save the database so it creates all the text files. Then I go to the "edit caption of selected image" select an image to caption from the left. At that point on the right the top box should be full of tags, and the bottom one should be empty. I look at my checklist from my textfile and start hitting all the areas I need to, which doesn't take long. Then I look up at the top box and read from left to right, top to bottom, one tag a time, and if it's a relevant tag, I type it in the bottom box.
-
embed txt tags
I have been using this: https://github.com/toshiaki1729/stable-diffusion-webui-dataset-tag-editor to get tags on some random images (not for a dataset, just for ease of browsing personal photos and such) unfortunately, this exports as a txt file and doesnt know how to do xmp or tag embedding. does anyone know of a way to emb the exported txt file into the image keywords/categories/whatever it supports (based on format) or a quick way to convert it to an xmp sidecar file? not necessarily related to ai generation, but it is related to ai usage. hopefully someone knows the answer or can point me where to find it.
-
Automatic1111 extensions. What're your must-haves?
Dataset Tag Editor is perfect for editing large datasets and their caption files. It's been around for a couple months and I only found out about it the other day. I could have saved so much time manually editing hundreds of caption files....
-
Questions About Improving Embeddings/Hypernetwork Results
There is one extension I use however: https://github.com/toshiaki1729/stable-diffusion-webui-dataset-tag-editor
sd-scripts
Posts with mentions or reviews of sd-scripts.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-11-16.
- Everything you know about loss is a lie
- Evidence that LoRA extraction in Kohya is broken?
- Stable Diffusion XL (SDXL) DreamBooth training with EMA (Exponential Moving Average) on the way
-
Installing kohya_ss GUI on AWS
This repository mostly provides a Windows-focused Gradio GUI for Kohya's Stable Diffusion trainers... but support for Linux OS is also provided through community contributions.
- Question on SD Finetuning
-
Trying to put up a simple dreambooth for sdxl, but an errors pops up
Leaving this here because i'm very tired, so this is the file of the ipynb that uses the sdxl_train.py from the https://github.com/kohya-ss/sd-scripts/tree/sdxl repo, if anybody find out why when getting to the training i get this very empty error : " [00:09:11] WARNING The following values were not passed to "
-
Finally SDXL coming to the Automatic1111 Web UI
You can try and test training LoRAs now https://github.com/kohya-ss/sd-scripts/tree/sdxl
-
Help with LORA Training - Kohya_ss Regularization
This might help.
-
need a lora traning guide for linux
Kohya_ss sd-scripts Seems to be the standard for lora training. The linked page has an English translation, but doesn't really have system specific tips. Someone else has a popular gui for it, but it's designed with windows in mind. There's another, simpler gui, but its still in development and the dev doesn't do any testing on Linux. With any of these, I run into dependency conflicts like crazy.
-
SDXL 0.9 is wild but trying to imagine where we go from here is breaking my brain.
"Direct training" is already feasible with masking in kohya-ss: https://github.com/kohya-ss/sd-scripts/pull/589
What are some alternatives?
When comparing stable-diffusion-webui-dataset-tag-editor and sd-scripts you can also consider the following projects:
BooruDatasetTagManager
kohya_ss
sd-webui-additional-networks
sd_dreambooth_extension
stable-diffusion-webui-wd14-tagger - Labeling extension for Automatic1111's Web UI
ComfyUI - The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface.
kohya-trainer - Adapted from https://note.com/kohya_ss/n/nbf7ce8d80f29 for easier cloning
bitsandbytes-rocm
stable-diffusion-webui-depthmap-script - High Resolution Depth Maps for Stable Diffusion WebUI
lora - Using Low-rank adaptation to quickly fine-tune diffusion models.
stable-diffusion-webui - Stable Diffusion web UI
stable-diffusion-webui-dataset-tag-editor vs BooruDatasetTagManager
sd-scripts vs kohya_ss
stable-diffusion-webui-dataset-tag-editor vs sd-webui-additional-networks
sd-scripts vs sd_dreambooth_extension
stable-diffusion-webui-dataset-tag-editor vs stable-diffusion-webui-wd14-tagger
sd-scripts vs ComfyUI
stable-diffusion-webui-dataset-tag-editor vs kohya-trainer
sd-scripts vs bitsandbytes-rocm
stable-diffusion-webui-dataset-tag-editor vs stable-diffusion-webui-depthmap-script
sd-scripts vs lora
stable-diffusion-webui-dataset-tag-editor vs stable-diffusion-webui
sd-scripts vs kohya-trainer