txt2mask
Automatically create masks for Stable Diffusion inpainting using natural language. (by ThereforeGames)
stable-diffusion-prompt-inpainting
This project helps you do prompt-based inpainting without having to paint the mask - using Stable Diffusion and Clipseg (by amrrs)
| txt2mask | stable-diffusion-prompt-inpainting | |
|---|---|---|
| 24 | 4 | |
| 507 | 365 | |
| - | - | |
| 2.6 | 10.0 | |
| over 1 year ago | over 1 year ago | |
| Python | Jupyter Notebook | |
| - | - |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
txt2mask
Posts with mentions or reviews of txt2mask.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-05-12.
-
Unpromted text2mask
Honestly I'd suggest just downloading the script instead, it's much easier to use and gives you boxes for the prompts rather than having to use all this stuff --> [txt2mask background[/txt2mask] It's up to you of course, but for me the extension conflicts with my favorite extension Dynamic Prompts anyway, so it had to go :( The stand-alone script still works mint tho haha.
-
Another Instruct Pix2Pix on video experiment: "Make it a bronze sculpture"
Can pix2pix be used with the txt2mask extension to easily isolate the dancer?
-
Any random hair colour function for automatic1111?
That looks similar to Unprompted, which is the successor to txt2mask which is probably much easier to use than the others (at least after a quick glance at the documentation).
-
In-painting Mask generation via API
automatic1111's webui now has a txt2mask script for inpainting. see here. Works great.
-
Will models have to be retrained for when this feature is eventually added into SD?
Separating colours into masks then rendering one at a time would just take a plugin, not a model update. It would be like this plugin only a lot easier as the objects are coming pre-masked by the colour instead of having to run recognition on them from the description https://github.com/ThereforeGames/txt2mask
-
[Inpainting] [Q] Want to remove a person/ group of people from an image.
It's pretty awesome but the developer recently said he's wrapping it into another extension of his and will not be updating the standalone script anymore. I'm sad about that because it works differently in the new extension and I find it a lot less convenient now, altho it's possible it will be changed again so I'm not giving up hope yet lol. Here's a link to the original version if you want to try it https://github.com/ThereforeGames/txt2mask
-
InstructPix2Pix - Stable Diffusion Combined With GPT-3 to "make it so"
There's a version of this idea already in the Automatic1111 distro, a script called 'txt2mask' that's on github here: https://github.com/ThereforeGames/txt2mask
-
Is it possible to replace object in image with object from another image
txt2mask
- Stable Diffusion links from around September 17, 2022 that I collected for further processing
-
Inpainting every frame using AE + SD
Perhaps you could txt2mask (https://github.com/ThereforeGames/txt2mask) to automate - i.e. you just need to have the text "fire hydrant" as your mask.
stable-diffusion-prompt-inpainting
Posts with mentions or reviews of stable-diffusion-prompt-inpainting.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-09-19.
-
Avyn now with free text to mask in-painting. Type what you want to change. Ridiculously addictive!
Sure! Here's the Colab that my version is based on: https://github.com/amrrs/stable-diffusion-prompt-inpainting/blob/main/Prompt_based_Image_In_Painting_powered_by_ClipSeg_GRADIO_WEB_UI.ipynb
- Stable Diffusion Text-Prompt-Based Inpainting – Replace Hair, Fashion
- Prompt-based inpainting without having to paint the mask - using Stable Diffusion and Clipseg
What are some alternatives?
When comparing txt2mask and stable-diffusion-prompt-inpainting you can also consider the following projects:
sd-dynamic-prompts - A custom script for AUTOMATIC1111/stable-diffusion-webui to implement a tiny template language for random prompt generation
imaginAIry - Pythonic AI generation of images and videos
ECCV2022-RIFE - ECCV2022 - Real-Time Intermediate Flow Estimation for Video Frame Interpolation
gif2gif - Automatic1111 Animated Image (input/output) Extension
stable-diffusion-webui - Stable Diffusion web UI
clipseg - This repository contains the code of the CVPR 2022 paper "Image Segmentation Using Text and Image Prompts".
sdcompare - A-B voting tool for images
unprompted - Templating language written for Stable Diffusion workflows. Available as an extension for the Automatic1111 WebUI.
paint-with-words-sd - Implementation of Paint-with-words with Stable Diffusion : method from eDiff-I that let you generate image from text-labeled segmentation map.
lama - 🦙 LaMa Image Inpainting, Resolution-robust Large Mask Inpainting with Fourier Convolutions, WACV 2022