Geistlib Alternatives
Similar projects and alternatives to geistlib based on common topics and language
-
kimi-k3-in-c
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
-
ternative
Inference engine for ternary-weight LLMs with runtime LoRA - the llama.cpp of BitNet models
-
needle-rs
258 KB WASM runtime for Needle a 26M-parameter tool-calling transformer. Runs in browser, Cloudflare Workers, and Node.js. No backend required.
-
LLMKube
Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
-
mbolt
Profile-guided layout optimization for llama.cpp GGUF MoE models — BOLT/PGO for LLM weights. Trace expert routing, rewrite the file so co-activated experts sit together, prefetch as merged reads.
-
LLMKube
Discontinued Kubernetes operator for GPU-accelerated LLM inference - air-gapped, edge-native, production-ready [Moved to: https://github.com/defilantech/LLMKube] (by Defilan)
geistlib discussion
geistlib reviews and mentions
-
I wrote a C inference engine that runs BitNet 2B at 15–18 tok/s on a Pi 5
curl -L -o geist-bitnet https://github.com/geisten/geistlib/releases/latest/download...
- Microsoft's BitNet 2B on a 4 GB Raspberry Pi 5, in one 1.2 GB file
Stats
geisten/geistlib is an open source project licensed under Apache License 2.0 which is an OSI approved license.
The primary programming language of geistlib is C.
Sponsored