xformers
Dreambooth-Stable-Diffusion
xformers | Dreambooth-Stable-Diffusion | |
---|---|---|
48 | 47 | |
8,946 | 7,618 | |
1.2% | - | |
9.3 | 0.0 | |
7 days ago | about 2 years ago | |
Python | Jupyter Notebook | |
GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
xformers
-
Practical Experience: Integrating Over 50 Neural Networks Into One Open-Source Project
Check xformers Compatibility Visit the xformers GitHub repo to ensure compatibility with your torch and CUDA versions. Support for older versions can be dropped, so staying updated is vital, especially if you're running CUDA 11.8 and want to leverage xformers for limited VRAM.
- An Interview with AMD CEO Lisa Su About Solving Hard Problems
- Animediff error
-
Colab | Errors when installing x-formers
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. fastai 2.7.12 requires torch<2.1,>=1.7, but you have torch 2.1.0+cu118 which is incompatible. torchaudio 2.0.2+cu118 requires torch==2.0.1, but you have torch 2.1.0+cu118 which is incompatible. torchdata 0.6.1 requires torch==2.0.1, but you have torch 2.1.0+cu118 which is incompatible. torchtext 0.15.2 requires torch==2.0.1, but you have torch 2.1.0+cu118 which is incompatible. torchvision 0.15.2+cu118 requires torch==2.0.1, but you have torch 2.1.0+cu118 which is incompatible. WARNING[XFORMERS]: xFormers can't load C++/CUDA extensions. xFormers was built for: PyTorch 2.1.0+cu121 with CUDA 1201 (you have 2.1.0+cu118) Python 3.10.13 (you have 3.10.12) Please reinstall xformers (see https://github.com/facebookresearch/xformers#installing-xformers) Memory-efficient attention, SwiGLU, sparse and more won't be available. Set XFORMERS_MORE_DETAILS=1 for more details xformers version: 0.0.22.post3
-
FlashAttention-2, 2x faster than FlashAttention
This enables V1. V2 is still yet to be integrated into xformers. The team replied saying it should happen this week.
See the relevant Github issue here: https://github.com/facebookresearch/xformers/issues/795
-
Xformers issue
My Xformers doesnt work, any help see code. info ( Exception training model: 'Refer to https://github.com/facebookresearch/xformers for more information on how to install xformers'. ) or
-
Having xformer troubles
ModuleNotFoundError: Refer to https://github.com/facebookresearch/xformers for more
-
Question: these 4 crappy picture have been generated with the same seed and settings. Why they keep coming mildly different?
Xformers is a module that that can be used with Stable Diffusion. It decreases the memory required to generate an image as well as speeding things up. It works very well but there are two problems with Xformers:
-
Stuck trying to update xformers
WARNING[XFORMERS]: xFormers can't load C++/CUDA extensions. xFormers was built for: PyTorch 1.13.1+cu117 with CUDA 1107 (you have 2.0.1+cu118) Python 3.10.9 (you have 3.10.7) Please reinstall xformers (see https://github.com/facebookresearch/xformers#installing-xformers) Memory-efficient attention, SwiGLU, sparse and more won't be available. Set XFORMERS_MORE_DETAILS=1 for more details ================================================================================= You are running xformers 0.0.16rc425. The program is tested to work with xformers 0.0.17. To reinstall the desired version, run with commandline flag --reinstall-xformers. Use --skip-version-check commandline argument to disable this check. =================================================================================
-
Question about updating Xformers for A1111
# Your version of xformers is 0.0.16rc425. # xformers >= 0.0.17.dev is required to be available on the Dreambooth tab. # Torch 1 wheels of xformers >= 0.0.17.dev are no longer available on PyPI, # but you can manually download them by going to: https://github.com/facebookresearch/xformers/actions # Click on the most recent action tagged with a release (middle column). # Select a download based on your environment. # Unzip your download # Activate your venv and install the wheel: (from A1111 project root) cd venv/Scripts activate pip install {REPLACE WITH PATH TO YOUR UNZIPPED .whl file} # Then restart your project.
Dreambooth-Stable-Diffusion
- Where can I train my own LoRA?
-
I am having an error with ControlNet (RuntimeError: CUDA error: CUBLAS_STATUS_ALLOC_FAILED when calling `cublasCreate(handle)`)
I did search online for an answer, but I am a PC noob, I didn't know what to do when I found this solution in this link: https://github.com/XavierXiao/Dreambooth-Stable-Diffusion/issues/113
- True to life photorealism v2
-
How can to create a custom image generation model?
Do you know some projects or guided tutorials that could help me? How many drawings with the desired style I should then have to give to train the AI model? I found Dreambooth on Stable Diffusion but it seams to be for another use case.
-
How to Make Your Own Anime (Linux/Mac Tutorial follow along)
This seems to be an issue with the code and or the environment itself. There is an open bug for this where some suggestions are p provided by others on how to fix. https://github.com/XavierXiao/Dreambooth-Stable-Diffusion/issues/47
-
AI generated portraits of Myself as different classes: Looking for opinion!
Could you provide some more detail on how this works? Did you just use this GitHub repository or did you put together your own implementation?
- Looking for an AI model to transform a video of me (full body) into an animated avatar. Does something like this exist?
-
Ray Liotta as Tommy Vercetti from GTA Vice City
I think the best way to do this would be to train Dreambooth on a number of photos of Ray Liotta first, and use Stable Diffusion instead. https://github.com/XavierXiao/Dreambooth-Stable-Diffusion
-
Luddites don't have a issue with AI, just that it "steals" from them (it doesn't). But they also have a issue with using your own child's drawings as a reference.
Dreambooth. There are other ways, but that is the gold standard. It takes even more Vram than regular stable diffusion, so if you don't have a very beefy card (e.g. 4090 with 25 GB VRAM) various websites let you do it onlin for a small fee. You then download a new model that has all the old stuff (e.g.the 4 gigabyte SD 1.5 file) plus your new images. Like I said, there are other ways that are easier, but when people show great results they are usually talking about Dreambooth.
-
Bunch of misinformation being spread in this thread
THE CODE (unofficial implementation, for the exact wording stating how little images you need read the paper) is designed with extremely little data in mind. I don't know how else to phrase it dude, do you think the training is a magic black box that runs with snail neurons? If you train a dreambooth model the jupyter ide makes calls to python files, those are the files. That is the code
What are some alternatives?
flash-attention - Fast and memory-efficient exact attention
SHARK-Studio - SHARK Studio -- Web UI for SHARK+IREE High Performance Machine Learning Distribution
stable-diffusion - Optimized Stable Diffusion modified to run on lower GPU VRAM
stable-diffusion-webui - Stable Diffusion web UI
StableTuner - Finetuning SD in style.
InvokeAI - Invoke is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, and serves as the foundation for multiple commercial products.
stablediffusion - High-Resolution Image Synthesis with Latent Diffusion Models
diffusers - 🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch
sd-enable-textual-inversion - Copy these files to your stable-diffusion to enable text-inversion
Dreambooth-Stable-Diffusion - Implementation of Dreambooth (https://arxiv.org/abs/2208.12242) by way of Textual Inversion (https://arxiv.org/abs/2208.01618) for Stable Diffusion (https://arxiv.org/abs/2112.10752). Tweaks focused on training faces, objects, and styles.