Our great sponsors
-
TensorRT
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
It uses the nvidia demo code from: https://github.com/NVIDIA/TensorRT/tree/main/demo/Diffusion
-
If you just want an accelerated ui, you can check https://github.com/ddPn08/Lsmith/ or https://github.com/VoltaML/voltaML-fast-stable-diffusion which also use the same origina nvidia code. These projects don't do img2img though, you can check in my repo for the img2img pipeline if you need. You need to compile the tensorrt engines for the models first. There are a few steps you can check in their script: export onnx, optimize onnx, compile engine for optimized onnx. I streamlined that a bit and I normally just run my compile.py in docker to build engines.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
If you just want an accelerated ui, you can check https://github.com/ddPn08/Lsmith/ or https://github.com/VoltaML/voltaML-fast-stable-diffusion which also use the same origina nvidia code. These projects don't do img2img though, you can check in my repo for the img2img pipeline if you need. You need to compile the tensorrt engines for the models first. There are a few steps you can check in their script: export onnx, optimize onnx, compile engine for optimized onnx. I streamlined that a bit and I normally just run my compile.py in docker to build engines.
Related posts
- AMD MI300X 30% higher performance than Nvidia H100, even with optimized stack
- Getting SDXL-turbo running with tensorRT
- With the recent developments, It looks like AI art is finally beginning to evolve in the right direction
- Show HN: Ollama for Linux – Run LLMs on Linux with GPU Acceleration
- Train Your AI Model Once and Deploy on Any Cloud