Cformers 🚀 - "Transformers with a C-backend for lightning-fast CPU inference". | Nolano

• cformers

  4 313 6.7 C

  SoTA Transformers with C-backend for fast inference on your CPU.

  

• llama.cpp

  768 55,846 10.0 C++

  LLM inference in C/C++

How does the inference speed compare to GGML based approaches like llama.cpp? Repo link: https://github.com/ggerganov/llama.cpp

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project