Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Cformers Alternatives
Similar projects and alternatives to cformers
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
RWKV-LM
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
-
CodeGen
CodeGen is a family of open-source model for program synthesis. Trained on TPU-v4. Competitive with OpenAI Codex.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
cformers reviews and mentions
-
[P] rwkv.cpp: FP16 & INT4 inference on CPU for RWKV language model
it's a combination of things, and removing python from the loop isn't essential to achieving most of these performance gains. the main trick is quantizing the weights and compiling the model. concrete example that builds on top of ggml with python APIs: https://github.com/NolanoOrg/cformers
- Cformers 🚀 - "Transformers with a C-backend for lightning-fast CPU inference". | Nolano
-
FauxPilot – an open-source GitHub Copilot server
We will add quantized CodeGen for fast inference on CPUs up on cformers (https://github.com/NolanoOrg/cformers/) by later today.
-
A note from our sponsor - InfluxDB
www.influxdata.com | 3 May 2024
Stats
NolanoOrg/cformers is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of cformers is C.
Sponsored