txt2mask
clipseg
txt2mask | clipseg | |
---|---|---|
24 | 7 | |
507 | 1,014 | |
- | - | |
2.6 | 3.8 | |
over 1 year ago | 4 months ago | |
Python | Python | |
- | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
txt2mask
-
Unpromted text2mask
Honestly I'd suggest just downloading the script instead, it's much easier to use and gives you boxes for the prompts rather than having to use all this stuff --> [txt2mask background[/txt2mask] It's up to you of course, but for me the extension conflicts with my favorite extension Dynamic Prompts anyway, so it had to go :( The stand-alone script still works mint tho haha.
-
Another Instruct Pix2Pix on video experiment: "Make it a bronze sculpture"
Can pix2pix be used with the txt2mask extension to easily isolate the dancer?
-
Any random hair colour function for automatic1111?
That looks similar to Unprompted, which is the successor to txt2mask which is probably much easier to use than the others (at least after a quick glance at the documentation).
-
In-painting Mask generation via API
automatic1111's webui now has a txt2mask script for inpainting. see here. Works great.
-
Will models have to be retrained for when this feature is eventually added into SD?
Separating colours into masks then rendering one at a time would just take a plugin, not a model update. It would be like this plugin only a lot easier as the objects are coming pre-masked by the colour instead of having to run recognition on them from the description https://github.com/ThereforeGames/txt2mask
-
[Inpainting] [Q] Want to remove a person/ group of people from an image.
It's pretty awesome but the developer recently said he's wrapping it into another extension of his and will not be updating the standalone script anymore. I'm sad about that because it works differently in the new extension and I find it a lot less convenient now, altho it's possible it will be changed again so I'm not giving up hope yet lol. Here's a link to the original version if you want to try it https://github.com/ThereforeGames/txt2mask
-
InstructPix2Pix - Stable Diffusion Combined With GPT-3 to "make it so"
There's a version of this idea already in the Automatic1111 distro, a script called 'txt2mask' that's on github here: https://github.com/ThereforeGames/txt2mask
-
Is it possible to replace object in image with object from another image
txt2mask
- Stable Diffusion links from around September 17, 2022 that I collected for further processing
-
Inpainting every frame using AE + SD
Perhaps you could txt2mask (https://github.com/ThereforeGames/txt2mask) to automate - i.e. you just need to have the text "fire hydrant" as your mask.
clipseg
-
How to blend a logo or clip art to a design
Following the comments to this old post, I tried to use in-painting with manual mask selection. I didn't get beautiful results but I'm sure with some tweaking, I could make it better. The main problem I had was having to manually select the area where I wanted to place the logo and trying to resize my logo mask to the fit the segment. I tried some automatic segmentation tools (Clipseg and Segment Anything). I couldn't tell the segmentation models to find a good area to for logo placement (i.e. some small flat surface). Given the complexity of what I was dealing with, I think there could be a better way (XY problem).
-
New Feature: "ZOOM ENHANCE" for the A111 WebUI. Automatically fix small details like faces and hands!
The addon utilizes clipseg for region masking, which was trained on "an extended version of the PhraseCut dataset" (many thousands of images.)
-
Txt2mask just received a big update!! 🎅
You'll also need to make sure to update your clipseg repo. The script won't do this for you. Namely you just need to update this models/clipseg.py file to ensure your clipseg has support for the new model.
-
[P] Image search with localization and open-vocabulary reranking.
For localisation at search time I ended up using OWL-ViT. This worked really well. I did not try Detic or CLIPseg but would be interested to hear if anyone else has tried these?
-
Who needs prompt2prompt anyway? SD 1.5 inpainting model with clipseg prompt for "hair" and various prompts for different hair colors
clipseg is an image segmentation method used to find a mask for an image from a prompt. I implemented it as an executor for dalle-flow and added it to my bot yasd-discord-bot.
-
txt2mask working in imaginAIry python library
Automated Replacement (txt2mask) by clipseg
- txt2mask was just released! We don't have to use the brush tool for inpainting anymore!
What are some alternatives?
sd-dynamic-prompts - A custom script for AUTOMATIC1111/stable-diffusion-webui to implement a tiny template language for random prompt generation
stable-diffusion - Latent Text-to-Image Diffusion
stable-diffusion-prompt-inpainting - This project helps you do prompt-based inpainting without having to paint the mask - using Stable Diffusion and Clipseg
Detic - Code release for "Detecting Twenty-thousand Classes using Image-level Supervision".
ECCV2022-RIFE - ECCV2022 - Real-Time Intermediate Flow Estimation for Video Frame Interpolation
LAVIS - LAVIS - A One-stop Library for Language-Vision Intelligence
gif2gif - Automatic1111 Animated Image (input/output) Extension
imaginAIry - Pythonic AI generation of images and videos
stable-diffusion-webui - Stable Diffusion web UI
dalle-flow - 🌊 A Human-in-the-Loop workflow for creating HD images from text
sdcompare - A-B voting tool for images
unprompted - Templating language written for Stable Diffusion workflows. Available as an extension for the Automatic1111 WebUI.