I figured out a way to apply different prompts to different sections of the image with regular Stable Diffusion models and it works pretty well.

• ComfyUI

  125 33,914 9.9 Python

  The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface.

This is how the workflow looks like in my GUI:

• paint-with-words-sd

  13 618 5.2 Jupyter Notebook

  Implementation of Paint-with-words with Stable Diffusion : method from eDiff-I that let you generate image from text-labeled segmentation map.

Does it work better than changing the attention map? (like for example https://github.com/cloneofsimo/paint-with-words-sd) Taking a quick glance at your code it seems it needs to run the model for each section instead of just once like in the linked one.

• SurveyJS

  surveyjs.io featured

  Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

  

• openOutpaint

  26 486 8.0 JavaScript

  local offline javascript and html canvas outpainting gizmo for stable diffusion webUI API 🐠

• openOutpaint-webUI-extension

  12 387 5.8 JavaScript

  direct A1111 webUI extension for openOutpaint

There is an extension version of it that integrates it with the rest of the webui, allowing to send things back and forth. It still has its quirks, but it works pretty well https://github.com/zero01101/openOutpaint-webUI-extension

Suggest a related project