Top 6 auto-tuning Open-Source Projects

neural-compressor

3 1,950 9.8 Python

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
awesome-machine-learning-in-compilers

5 1,327 5.9

Must read research papers and links to tools and datasets that are related to using machine learning for compilers and systems optimisation

Project mention: Awesome research papers on ML in Compilers | /r/hypeurls | 2023-06-21

InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
bpftune

1 630 8.8 C

bpftune uses BPF to auto-tune Linux systems (by oracle)

Project mention: Bpftune: Auto-tune Linux systems using BPF | news.ycombinator.com | 2023-10-19

kernel_tuner

4 243 9.1 Python

Kernel Tuner

Project mention: Ask HN: What apps have you created for your own use? | news.ycombinator.com | 2023-12-12

I've created Kernel Tuner (https://github.com/KernelTuner/kernel_tuner) as a small software development tool, because I was writing a lot of CUDA and OpenCL kernels at the time. I didn't want to manually figure out what best thread block dimensions and work division among threads were on every GPU over and over again.
The tool evolved quite a bit since the first versions. I'm also using it for testing GPU code, teaching, and it has become one of the main drivers behind a lot of the research that I do.

kernel-ml

1 212 2.6 C

Machine Learning Framework for Operating Systems - Brings ML to Linux kernel
phoebe

1 85 0.0 C

Phoebe (by SUSE)

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).