How does ComfyUI load SDXL 1.0 so VRAM-efficiently? How do I do the same in vanilla python code?

This page summarizes the projects mentioned and recommended in the original post on /r/StableDiffusion

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • generative-models

    Generative Models by Stability AI

  • However, when using the example code from HuggingFace or setting up stuff from the StabilityAI/generative-models repo in a jupyter notebook, I end up using 21 GB of VRAM just for running the default pipeline (with no base model output). If I try to run the extra `base.vae.decode(base_latents)` after generation to get unrefined outputs, I get a CUDA out of memory error as it blows past the 24GB of my NVIDIA RTX 3090.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Viking 7B: open LLM for the Nordic languages trained on AMD GPUs

    1 project | news.ycombinator.com | 15 May 2024
  • Show HN: Tarsier – vision for text-only LLM web agents that beats GPT-4o

    3 projects | news.ycombinator.com | 15 May 2024
  • Building a Tic-Tac-Toe Game in Python: A Step-by-Step Guide

    1 project | dev.to | 15 May 2024
  • Show HN: Julep: A platform to manage memories, knowledge and tools for LLM apps

    2 projects | news.ycombinator.com | 14 May 2024
  • GPT-4o's Memory Breakthrough (Needle in a Needlestack)

    3 projects | news.ycombinator.com | 14 May 2024