Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 3 C++ quantization Projects
-
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
Project mention: Creando Subtítulos Automáticos para Vídeos con Python, Faster-Whisper, FFmpeg, Streamlit, Pillow | dev.to | 2024-04-29
There's https://github.com/saharNooby/rwkv.cpp, which related-ish[0] to ggml/llama.cpp
[0]: https://github.com/ggerganov/llama.cpp/issues/846
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
C++ quantization related posts
-
StreamingLLM: Efficient streaming technique enable infinite sequence lengths
-
Explore large language models on any computer with 512MB of RAM
-
CTranslate2: An efficient inference engine for Transformer models
-
[D] Faster Flan-T5 inference
-
[P] CTranslate2: an efficient inference engine for Transformer models
-
Model/Tool to use on Jetson for efficient Quantization/Pruning
-
A note from our sponsor - InfluxDB
www.influxdata.com | 2 May 2024
Index
What are some of the best open-source quantization projects in C++? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | CTranslate2 | 2,799 |
| 2 | rwkv.cpp | 1,100 |
| 3 | minigpt4.cpp | 545 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com