CrossAttentionControl
Unofficial implementation of "Prompt-to-Prompt Image Editing with Cross Attention Control" with Stable Diffusion (by bloc97)
MultiDiffusion
Official Pytorch Implementation for "MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generation" presenting "MultiDiffusion" (ICML 2023) (by omerbt)
| CrossAttentionControl | MultiDiffusion | |
|---|---|---|
| 11 | 13 | |
| 1,237 | 911 | |
| - | - | |
| 10.0 | 4.8 | |
| over 1 year ago | 8 months ago | |
| Jupyter Notebook | Jupyter Notebook | |
| MIT License | - |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
CrossAttentionControl
Posts with mentions or reviews of CrossAttentionControl.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-11-20.
- "How can I do X?" for image generation.
- The Stable Horde now supports img2img as well as multiple models available at the same time. And we just added SD 1.5
- Is there any way to make Automatic1111 change an image into a different pose/style while keeping the subject of the image in tact?
- Cross Attention Control with Stable Diffusion
-
First round of results from the new Cross-Attention paper
Stable Diffusion implementation of Cross Attention Github page (Legend!): https://github.com/bloc97/CrossAttentionControl
- Prompt-to-Prompt Image Editing with Cross Attention Control
- Reproducing the method in 'Prompt-to-Prompt Image Editing with Cross Attention Control' with Stable Diffusion
- Prompt-to-Prompt Image Editing with Cross Attention Control in Stable Diffusion
MultiDiffusion
Posts with mentions or reviews of MultiDiffusion.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-08-15.
-
Opendream: A Non-Destructive UI for Stable Diffusion
For composing this approach works pretty well
https://multidiffusion.github.io/
-
Messing with the denoising loop can allow you to reach new places in latent space. Over 8+ different research papers/Auto1111 extension ideas in a single pipe. Load once and do lots of different things (SD 2.1 or 1.5)
So I've continued to experiment with how many papers I can fit into a single pipe and have them play nicely together. The images below were created by combining the panorama code from omerbt/MultiDiffusion with the ideas from albarji/mixture-of-diffusers. Also turns out nateraw/stable-diffusion-videos can be seen as a special case of a panorama (in latent space rather than prompt space).
- MultiDiffusion Region Control, a prompt on each mask webui extension is out.
-
Hubble Diffusion with MultiDiffusion
Essentially, I fine-tuned Stable Diffusion 2.1 base (the 512x512) model on the ESA Hubble Deep Space Images & Captions dataset I collected from public Hubble images & captions. After around 33,000 training steps, I saved the model and was really impressed by the results. But I really wanted to be able to generate wallpaper-level quality space images, so I stumbled upon MultiDiffusion: a new project for generating massive panorama images using stable diffusion models. I then used hubble-diffusion-2 along with MultiDiffusion to generate each one of these amazing 2560x1536 images. Each image took a little over an hour to generate on a Google Colab T4 GPU. I used the following prompts for each of these images:
- MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generation
-
What is the maximum size a 3090 24gb can produce?
If you need generated and not upscaled 4k for some reason, try something like https://github.com/omerbt/MultiDiffusion
-
[R] [N] "MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generation" enables controllable image generation without any further training or finetuning of diffusion models.
Project: https://multidiffusion.github.io/ Paper: https://arxiv.org/abs/2302.08113 GitHub: https://github.com/omerbt/MultiDiffusion
-
Meet MultiDiffusion: A Unified AI Framework That Enables Versatile And Controllable Image Generation Using A Pre-Trained Text-to-Image Diffusion Model
Quick Read: https://www.marktechpost.com/2023/02/24/meet-multidiffusion-a-unified-ai-framework-that-enables-versatile-and-controllable-image-generation-using-a-pre-trained-text-to-image-diffusion-model/ Paper: https://arxiv.org/abs/2302.08113 Github: https://github.com/omerbt/MultiDiffusion Project: https://multidiffusion.github.io/
-
You to can create Panorama images 512x10240+ (not a typo) using less then 6GB VRAM (Vertorama works too). A modification of the MultiDiffusion code to pass the image through the VAE in slices then reassemble. Potato computers of the world rejoice.
So I haven't made many images with Stable Diffusion despite using it heavily. The reason is I've been messing with the internals of the diffusion pipe, to interfere with the diffusion process in different ways. Todays fun result is based on omerbt/MultiDiffusion for making panoramas.
-
First version of Stable Diffusion was released on August 22, 2022
If we combine Mixture of Diffusers + MultiDiffusion+ Composer+ cross-domain-compositing and probably some more I'm not thinking of.
What are some alternatives?
When comparing CrossAttentionControl and MultiDiffusion you can also consider the following projects:
stable-diffusion-webui - Stable Diffusion web UI
stable-diffusion-webui-two-shot - Latent Couple extension (two shot diffusion port)
stable-diffusion
sd-webui-controlnet - WebUI extension for ControlNet
stable-diffusion-webui - Stable Diffusion web UI [Moved to: https://github.com/Sygil-Dev/sygil-webui]
mixture-of-diffusers - Mixture of Diffusers for scene composition and high resolution image generation
Magic123 - [ICLR24] Official PyTorch Implementation of Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors
Diffusion-Models-Papers-Survey-Taxonomy - Diffusion model papers, survey, and taxonomy
nataili - Nataili is a Python library that provides tools for building multimodal AI applications. With its modular design, Nataili makes it easy to use only the tools you need to build custom AI solutions.
stable-diffusion-videos - Create 🔥 videos with Stable Diffusion by exploring the latent space and morphing between text prompts
anima - Turn text into video using Stable Diffusion and Google FILM
openpose-editor - Openpose Editor for AUTOMATIC1111's stable-diffusion-webui
CrossAttentionControl vs stable-diffusion-webui
MultiDiffusion vs stable-diffusion-webui-two-shot
CrossAttentionControl vs stable-diffusion
MultiDiffusion vs sd-webui-controlnet
CrossAttentionControl vs stable-diffusion-webui
MultiDiffusion vs mixture-of-diffusers
CrossAttentionControl vs Magic123
MultiDiffusion vs Diffusion-Models-Papers-Survey-Taxonomy
CrossAttentionControl vs nataili
MultiDiffusion vs stable-diffusion-videos
CrossAttentionControl vs anima
MultiDiffusion vs openpose-editor