Optimal Installation of Pytorch (2.0?) --xformers or --opt-sdp-attention, with a RTX 4090 build for Automatic1111 that is current (not 1mo+ old)?

• automatic

  185 4,745 9.9 Python

  SD.Next: Advanced Implementation of Stable Diffusion and other Diffusion-based generative image models

I chalange you: take a look at VLADs code vladmandic/automatic: Opinionated fork/implementation of Stable Diffusion (github.com) and show us the "malware" or "crypto miner"...

• sd-extension-system-info

  51 258 9.3 Python

  System and platform info and standardized benchmarking extension for SD.Next and WebUI

If you check out the scores, ignore the top three right now which I made yesterday when I hit 64 it/s with the new token merging functionality added a few days ago. I had it ramped up to the max throughput possible, well beyond what would be usable in practice just because I enjoy the big numbers :P. My score in the fourth spot is probably more or less the maximum that's realistic for practical use at the moment (at least with Pytorch 2.0+ and a single GPU, I haven’t tried out multi GPU setups or other libraries like TensorRT), and you can look further down the list to get a sense of the averages at the moment for different GPUs. https://vladmandic.github.io/sd-extension-system-info/pages/benchmark.html

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• stable-diffusion-webui

  2,808 130,470 9.9 Python

  Stable Diffusion web UI

Some initial arguments and discussion: Future of this repo - I found promising fork · AUTOMATIC1111/stable-diffusion-webui · Discussion #9505 (github.com)

• AITemplate

  37 4,457 8.7 Python

  AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.

  

Which of these two solutions should I go with? which will give the most performance and also allow me to use a different build? (Vladmandic instead of Automatic1111 if I decide to do so): 1. https://followfoxai.substack.com/p/may-2023-latest-automatic1111-installation?r=1tutw0&utm_medium=ios&utm_campaign=post 2, https://voltaml.github.io/voltaML-fast-stable-diffusion/getting-started/introduction#main-features (using AITemplate)

Suggest a related project