Worth it on my AMD based laptop?

• ggml

  69 9,642 9.8 C

  Tensor library for machine learning

However, GGML, a C++ ML inference library, re-implemented all the required operators from the ground up with some low level optimizations, porting models like Whisper and LLaMA to it.

• whisper.cpp

  187 30,942 9.8 C

  Port of OpenAI's Whisper model in C/C++

However, GGML, a C++ ML inference library, re-implemented all the required operators from the ground up with some low level optimizations, porting models like Whisper and LLaMA to it.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• llama.cpp

  769 55,846 10.0 C++

  LLM inference in C/C++

However, GGML, a C++ ML inference library, re-implemented all the required operators from the ground up with some low level optimizations, porting models like Whisper and LLaMA to it.

Suggest a related project