sd-webui-controlnet
ComfyUI
Our great sponsors
sd-webui-controlnet | ComfyUI | |
---|---|---|
247 | 125 | |
15,859 | 32,480 | |
- | - | |
9.7 | 9.9 | |
4 days ago | 6 days ago | |
Python | Python | |
GNU General Public License v3.0 only | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sd-webui-controlnet
-
OpenPose ControlNet: A Beginner's Guide
A crucial step for achieving stable diffusion controlnet settings is the installation of the controlnet extension in Google Colab. Whether on a Windows PC or Mac, installing controlnet is vital for stable diffusion of human pose details. Additionally, updating the controlnet extension is necessary to maintain stability and achieve the desired results in OpenPose model. To install the v1.1 controlnet extension, go to the “extensions” tab and install it from this URL: https://github.com/Mikubill/sd-webui-controlnet. If you already have v1 controlnets installed, delete the folder from stable-diffusion-webui/extensions/. Install the v1.
-
StyleAligned node for ComfyUI
1.1.420 Image-wise ControlNet and StyleAlign
-
PATCHFUSION is really impressive. High resolution depth maps in 16bit. I've been waiting for this. https://github.com/zhyever/PatchFusion
I opened a request thread on ControlNet GitHub you can give a support : https://github.com/Mikubill/sd-webui-controlnet/issues/2319
- Going to lose my mind at this point with this problem
- Samples of style-aligned
-
Is it possible to outpaint with SD or SDXL as easy as with photoshop? (no prompts)
It has been possible for 7 months now
- Reference Only Broken (Can someone with a working Reference Only CN upload there extension folder)
-
Web app prototype to create controlnet segmentation maps for Stable Diffusion
I sometimes use a very similar technique in Cinema4d (here is a link to a c4d file with preset materials referencing proper colors for Semantic Segmentation if any other c4d user wants to try it), but yours is a much more accessible solution as it's free and it's accessible online.
-
Dalle-3 Examples
There are models available that give you more control - in some senses, at least.
For example, you can use Stable Diffusion with 'ControlNet' [1] where for example, you can input an 'openpose' to choose the pose of people in the scene.
There's also a 'Regional Prompter' [2] which lets you use different prompts for different areas of the image, giving you some control over the composition.
You can also use 'inpainting' to regenerate select parts of your image if, for example, you don't like the shape of the clouds.
Of course this stuff isn't perfect - for example, you'll get hands with the wrong number of fingers sometimes, no matter what you specify :)
[1] https://github.com/Mikubill/sd-webui-controlnet
- ControlNet SDXL for Automatic1111-WebUI official release: sd-webui-controlnet 1.1.400
ComfyUI
-
ComflowySpace: An open-source version of better ComfyUI
The non standard licensing puts me off in contributing or using this. It is frustrating how the phrase opensource has been diluted in the AI/ML community. ComfyUI has a GPL license [1] while this project uses this [2]. I honestly don't know where I stand since this is a legal document using non-standard phrasing to describe how the rights around the source code.
This is a project that uses a custom license with less rights provided than the ComfyUI project it self-describes as improving. Am not sure the title is reflective of the project.
[1] - https://github.com/comfyanonymous/ComfyUI/blob/master/LICENS...
-
Show HN: I made an app to use local AI as daily driver
* LLaVA model: I'll add more documentation. You are right Llava could not generate images. For image generation I don't have immediate plans, but checkout these projects for local image generation.
- https://diffusionbee.com/
- https://github.com/comfyanonymous/ComfyUI
- https://github.com/AUTOMATIC1111/stable-diffusion-webui
-
Show HN: ML Blocks – Deploy multimodal AI workflows without code
Check out ComfyUI for a much more advanced and open source version of this.
https://github.com/comfyanonymous/ComfyUI
-
Stable Code 3B: Coding on the Edge
I use Stable Diffusion family models for innovative art products.
On a small scale, you have to professionalize ComfyUI’s development. My PR to make it installable and to make a plugin ecosystem that makes sense should not be sitting unmerged (https://github.com/comfyanonymous/ComfyUI/pull/298).
On a medium scale, CLIP is holding you back. I would eagerly buy a 48GB card to accommodate a batch size 1, gradient checkpointed LoRA-trainable model with T5 for conditioning. I want PixArt-a or DeepFloyd/IF with the SDXL dataset and training. I get I can achieve so much with SDXL on 24GB, including just barely a fine tuning, I understand the engineering decisions here, but it’s too weak on prompts.
On a large scale, I’m willing to spend a little money up front. In those conditions you can be far more innovative, you don’t have to make everything for $0. Shane Carruth didn’t make Primer for $0. I’m sure you’ve seen this movie, you get how astoundingly good it is. But he still spent something. He spent only slightly more than an RTX 6000 Ada.
Innovators have budgets. It’s still worth releasing the most powerful possible model for expensive hardware, this is why everyone is talking about Mixtral, but it’s especially true of visual art.
-
Show HN: Comflowy – A ComfyUI Tutorial for Beginners
It's litegraph.js [1] and seems to be the only lib they include in /web [2] :
[1] https://github.com/jagenjo/litegraph.js
[2] https://github.com/comfyanonymous/ComfyUI/tree/master/web/li...
-
ComfyUI on Windows 7?
It's possibly you might get a later version of Comfy working, but I had no success with this method and the 1st Sept version of Comfy. The older versions are here under Assets... https://github.com/comfyanonymous/ComfyUI/releases
-
Seeking out an experienced and empathetic coding buddy.
That said, please do learn coding and don't get discouraged when somebody says to learn PyTorch or recommends using a Jupiter notebook with no further information on how to translate the skill into images. I would highly recommend some short term goals. Get your feet wet by taking apart the UIs. The comfy API documentation is here and the A1111 API documentation is here. There is a difference in completeness, welcome to programming. Writing nodes or plugins is also a good way to jump into this world. Custom wildcard logic might be very attractive to you if you aren't the type that want to deal with a nested file structure to simulate logic.
-
Need help installating ComfyUI
For example ComfyUI can simply be downloaded and run using the portable version (https://github.com/comfyanonymous/ComfyUI/releases/download/latest/ComfyUI_windows_portable_nvidia_cu121_or_cpu.7z) if your not comfortable using GIT etc.
-
Installing cumfyui manager on MacBook
https://github.com/comfyanonymous/ComfyUI scroll down to "Install"
- SAG (Self-Attention Guidance) for ComfyUI is here!
What are some alternatives?
openpose-editor - Openpose Editor for AUTOMATIC1111's stable-diffusion-webui
stable-diffusion-webui - Stable Diffusion web UI
T2I-Adapter - T2I-Adapter
stable-diffusion-ui - Easiest 1-click way to install and use Stable Diffusion on your computer. Provides a browser UI for generating images from text prompts and images. Just enter your text prompt, and see the generated image. [Moved to: https://github.com/easydiffusion/easydiffusion]
ControlNet - Let us control diffusion models!
InvokeAI - InvokeAI is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, supports terminal use through a CLI, and serves as the foundation for multiple commercial products.
stable-diffusion-webui-colab - stable diffusion webui colab
openOutpaint - local offline javascript and html canvas outpainting gizmo for stable diffusion webUI API 🐠
a1111-nevysha-comfy-ui - A collection of tweak to improve Auto1111 UI//UX [Moved to: https://github.com/Nevysha/Cozy-Nest]
stable-diffusion-webui-directml - Stable Diffusion web UI
sd-dynamic-prompts - A custom script for AUTOMATIC1111/stable-diffusion-webui to implement a tiny template language for random prompt generation