ibm-generative-ai
Olive
| ibm-generative-ai | Olive | |
|---|---|---|
| 1 | 14 | |
| 227 | 1,304 | |
| 2.2% | 6.1% | |
| 9.3 | 9.7 | |
| 12 days ago | 4 days ago | |
| Python | Python | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ibm-generative-ai
Olive
- FLaNK Stack Weekly for 12 June 2023
-
Unpaint: a compact, fully C++ implementation of Stable Diffusion with no dependency on python
I use Microsoft Olive to optimize my networks. It works rather well as I did make my inference speed like 2-3 times faster, the models smaller and VRAM usage was reduced as well, though this needs the latest nvidia drivers to happen.
-
A1111 vs Olive vs AITemplate.
First update drivers, then follow the instruction here: Olive/README.md at main · microsoft/Olive · GitHub I try SD1.5 and DreamShaper model, both hit 30it/s
- I have created Olive model. But what is the next step? Who knows?
-
AMD support for Microsoft® DirectML optimization of Stable Diffusion
Microsoft has provided a path in DirectML for vendors like AMD to enable optimizations called ‘metacommands’. In the case of Stable Diffusion with the Olive pipeline, AMD is building driver support for a metacommand implementation intended to improve performance and reduce the time it takes to generate output from the model. This feature will be validated on AMD RDNA™ 3 devices including AMD Radeon™ RX 7900 Series graphics cards and AMD Ryzen™ 7040 Series Mobile processors with Radeon™ graphics.
-
Nvidia:"2x performance improvement for Stable Diffusion coming in tomorrow's Game Ready Driver"
Olive is an easy-to-use hardware-aware model optimization tool that composes industry-leading techniques across model compression, optimization, and compilation. Given a model and targeted hardware, Olive composes the best suitable optimization techniques to output the most efficient model(s) for inferencing on cloud or edge, while taking a set of constraints such as accuracy and latency into consideration.
-
NVIDIA and Microsoft Drive Innovation for Windows PCs in New Era of Generative AI
Repository: https://github.com/microsoft/Olive
- Nvidia: "2x performance improvement for Stable Diffusion coming in tomorrow's Game Ready Driver"
What are some alternatives?
documenso - The Open Source DocuSign Alternative.
chatdocs - Chat with your documents offline using AI.
chatgpt-refusals - Datasets and code from our paper, where we use machine learning to predict if ChatGPT will refuse a given prompt.
StableDiffusionUI - Stable Diffusion UI: Diffusers (CUDA/ONNX)
lance - Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, with more integrations coming..
speeduino - Speeduino - Arduino based engine management
SDAtom-WebUi-us - Queue system for AUTOMATIC1111's webui
qdrant - Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
unpaint - A simple Windows / Xbox app for generating AI images with Stable Diffusion.
diesel-json-form - Dynamically generate FORMs based on JSON Schema
stable-diffusion-webui-amdgpu - Stable Diffusion web UI