C quantization

Open-source C projects categorized as quantization
Edit details
C LLM Inference Simd inference-engine
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
sponsored

Top 10 C quantization Projects

C logo
quantization

  1. pngquant

    Lossy PNG compressor — pngquant command based on libimagequant library

    Project mention: Lazy Loading, Code Splitting, and Image Optimization for SaaS Applications | dev.to | 2026-04-28

    Optimize images at every step: Compress with mozjpeg/ pngquant, resize to actual display dimensions, serve progressive JPEGs, and use CDNs with on-the-fly optimization (Cloudinary, imgix).

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  3. kimi-k3-in-c

    A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

    Project mention: How a 176 KB C Binary Runs a 2.78-Trillion-Parameter Model on One CPU with 8 GB of RAM | dev.to | 2026-08-05

  4. picolm

    Run a 1-billion parameter LLM on a $10 board with 256MB RAM

    Project mention: PicoLM: Run a 1B parameter LLM on a $10 board | news.ycombinator.com | 2026-02-18

  5. tinyengine

    [NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning; [NeurIPS 2022] MCUNetV3: On-Device Training Under 256KB Memory (by mit-han-lab)

  6. BitNetMCU

    Neural Networks with low bit weights on low end 32 bit microcontrollers such as the CH32V003 RISC-V Microcontroller and others

  7. hicolor

    🎨 Convert images to 15/16-bit RGB color with dithering

  8. patolette

    off the charts color quantization 🎨

  9. faster-enhancer.c

    Pure C implementation of FastEnhancer. 3.3x faster than the ONNX Runtime graph, same quality.

    Project mention: Show HN: Faster-enhancer.c – FastEnhancer speech enhancement, 3.3x faster in C | news.ycombinator.com | 2026-07-28

  10. MLPico

    Static-allocation MLP inference in ANSI C using 2-slot circular buffer with fixed stride indexing. An easy to use, minimal MLP alternative to GiorgosXou/NeuralNetworks enhanced with PROGMEM, int-quantization etc.

    Project mention: Show HN: MLP inference in ANSI C using a 2-slot ring buffer | news.ycombinator.com | 2026-06-11

  11. geistlib

    Tiny dependency-free C23 inference engine for small LLMs — ternary BitNet, CPU-first, runs on a Raspberry Pi

    Project mention: I wrote a C inference engine that runs BitNet 2B at 15–18 tok/s on a Pi 5 | news.ycombinator.com | 2026-08-11

    curl -L -o geist-bitnet https://github.com/geisten/geistlib/releases/latest/download...

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

C quantization discussion

Log in or Post with

C quantization related posts

  • Construindo um assistente pessoal 100% local com Ollama, LangChain e voz — e as armadilhas que ninguém conta

    5 projects | dev.to | 17 Jul 2026

  • Eagle 7B: Soaring past Transformers

    2 projects | news.ycombinator.com | 28 Jan 2024

  • keeping collection size down (for ankiweb) when needing lots of image cards/notes

    1 project | /r/Anki | 21 May 2023

  • rwkv.cpp: FP16 & INT4 inference on CPU for RWKV language model (r/MachineLearning)

    1 project | /r/datascienceproject | 2 Apr 2023

Index

What are some of the best open-source quantization projects in C? This list will help you:

# Project Stars
1 pngquant 5,739
2 kimi-k3-in-c 4,794
3 picolm 1,906
4 tinyengine 945
5 BitNetMCU 336
6 hicolor 209
7 patolette 155
8 faster-enhancer.c 18
9 MLPico 2
10 geistlib 1

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
Loading...