Ollama-benchmark Alternatives
Similar projects and alternatives to ollama-benchmark
-
ollama
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language models.
-
InfluxDB
InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
-
distributed-llama
Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
-
ollama-benchmark discussion
ollama-benchmark reviews and mentions
-
Radxa Orion O6 brings Arm to the midrange PC (with caveats)
> If you're just doing AI stuff or GPU compute, this board might actually be a decent option, all things considered.
Looking at the benchmark [0]
When I first saw the board I thought this might be the RPi of the "AI age" since it is IMHO the most affordable option with 64Gb of RAM.
But I am always cautious if we can really make the most of the so called "30 TOPS NPU"
- [0] https://github.com/geerlingguy/ollama-benchmark/issues/13
-
Deepseek R1 Distill 8B Q40 on 4 x Raspberry Pi 5, 6.43 tok/s (eval 11.68 tok/s)
Or attach a 12 or 16 GB GPU to a single Pi 5 directly, and get 20+ tokens/s on an even larger model :D
https://github.com/geerlingguy/ollama-benchmark?tab=readme-o...
Stats
geerlingguy/ollama-benchmark is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of ollama-benchmark is Shell.
Popular Comparisons
Sponsored