Top 3 Python performance-optimization Projects

onediff

2 1,194 9.7 Python

OneDiff: An out-of-the-box acceleration library for diffusion models.

Project mention: Accelerating Stable Video Diffusion 3x Faster with OneDiff DeepCache and Int8 | news.ycombinator.com | 2024-01-29

--output-video path/to/output_image.mp4
Run with ComfyUI
Run with OneDiff workflow: https://github.com/siliconflow/onediff/blob/main/onediff_com...
Run with OneDiff + DeepCache workflow: https://github.com/siliconflow/onediff/blob/main/onediff_com...
The use of Int8 can be referenced in the workflow: https://github.com/siliconflow/onediff/blob/main/onediff_com...

dj-tracker

7 73 6.6 Python

A Django app that tracks your queries to help optimize them. Demo: https://dj-tracker-bakerydemo.herokuapp.com/dj-tracker/
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
batch-inference

1 64 6.4 Python

Dynamic batching library for Deep Learning inference. Tutorials for LLM, GPT scenarios.

Project mention: Tutorial to improve GPT throughput 16 times with dynamic batching | /r/deeplearning | 2023-05-18

I wrote a tutorial to improve GPT completion throughput with dynamic batching https://microsoft.github.io/batch-inference/examples/gpt_completion.html. And I can achieve 16 times throughput on V100 comparing to baseline. We built a python dynamic batching library so you can apply it on your own models easily https://github.com/microsoft/batch-inference.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).