Kargo automates promotion across dev, staging, and prod with approval gates and verification. Open source, built by the team behind Argo CD. Download now. Learn more →
Vllm-mlx Alternatives
Similar projects and alternatives to vllm-mlx
-
ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
-
AppSignal
Monitoring that respects your time & budget. APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.
-
n8n
n8n is a workflow automation platform for building AI-powered workflows and agents, connecting any AI model to any business system with full control over data, security, and deployment. Build visually or in code while n8n handles infrastructure from prototype to production with fully auditable executions.
-
-
-
llama.cpp
Discontinued LLM inference in C/C++ [Moved to: https://github.com/ggml-org/llama.cpp] (by ggerganov)
-
claude-code-router
One local control plane for every AI agent: route across models, fuse new capabilities, orchestrate tools, and stay fully in control.
-
crewAI
Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
-
Kargo
Stop Scripting Promotions. Start Shipping with Kargo. Kargo automates promotion across dev, staging, and prod with approval gates and verification. Open source, built by the team behind Argo CD. Download now.
-
qmd
mini cli search engine for your docs, knowledge bases, meeting notes, whatever. Tracking current sota approaches while being all local
-
-
-
security-ops-platform
Discontinued Open-source security detection & response platform: 50+ tool integrations, an on-prem LLM investigation-agent fleet with MCP, self-healing Webex/Teams bots, and 80+ Flask SOC web apps. [GET https://api.github.com/repos/vinayvobbili/security-ops-platform: 404 - Not Found // See: https://docs.github.com/rest/repos/repos#get-a-repository]
-
langchain-failover
Primary/secondary failover wrapper for LangChain chat models, with tool-calling preserved across failover.
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better vllm-mlx alternative or higher similarity.
vllm-mlx discussion
vllm-mlx reviews and mentions
Posts with mentions or reviews of vllm-mlx.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2026-06-06.
-
Why Self-Hosted Claude Code Was 15 Slower Than It Should Be
vllm-mlx PR #277 found the billing-header issue independently for the /v1/messages endpoint. If you're using vllm-mlx's native Anthropic adapter rather than your own shim, that's the right upstream fix. The SimpleEngine prefix-cache patch landed in vllm-mlx PR #523 — thanks to the maintainers for the review, which improved the patch in two specific ways (closure-local capture against a TOCTOU on the snapshot pointer, and a sliding-window guard for RotatingKVCache).
-
SOC-in-a-Box: One LLM, Eight Hats, A Production-Bar AI SOC on a Single GPU
We run one local LLM — GLM-4.7-Flash 8-bit on a Mac M1 (64 GB) via vllm-mlx — and every role calls it with a different system prompt and a different tool whitelist. The resilience comes from a FailoverChatModel (first described in an earlier post) that transparently falls back to a Qwen3 backup on a studio1 box if the m1 dies, and flips back the moment the primary recovers.
-
Apple Silicon LLM Inference Optimization: The Complete Guide to Maximum Performance
vllm-mlx — vLLM serving on Apple Silicon via MLX
- vLLM-MLX – Run LLMs on Mac at 464 tok/s
-
Trying VLLM Ideas on Apple Silicon with MLX (WIP)
Hey HN!
I’ve been experimenting with MLX (and mlx-lm / mlx-vlm — great work by others) and started a small WIP project to see how vLLM-style ideas could work on Apple Silicon.
It’s super early, just me tweaking things and learning, but if you’re into MLX or running LLMs/VLMs on a Mac, I’d love feedback or contributors.
Repo: https://github.com/waybarrios/vllm-mlx
-
A note from our sponsor - Kargo
akuity.io | 12 Sep 2026
Stats
Basic vllm-mlx repo stats
6
1,566
9.7
6 days ago
waybarrios/vllm-mlx is an open source project licensed under Apache License 2.0 which is an OSI approved license.
The primary programming language of vllm-mlx is Python.
Sponsored
Monitoring that respects your time & budget
APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.
www.appsignal.com