mlx-serve

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling. (by ddalcu)
Review Agent anthropic-api apple-silicon claude-code Inference LLM local-llm MacOS macos-app mlx openai-api tool-calling Zig deepseek-v4 diffusion image-generation video-generation voice-agent voice-cloning gguf
Source Code
mlxserve.com
Suggest alternative
Edit details
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
sponsored

Mlx-serve Alternatives

Similar projects and alternatives to mlx-serve based on common topics and language

ddalcu
mlx-serve

  1. mlxstudio

    1 mlx-serve VS mlxstudio

    MLX Studio - Home of JANG_Q - Image Gen/Edit + Chat/Code All in one - + OpenClaw (Anthropic API)

  2. Kargo

    Stop Scripting Promotions. Start Shipping with Kargo. Kargo automates promotion across dev, staging, and prod with approval gates and verification. Open source, built by the team behind Argo CD. Download now.

    Kargo logo

  3. xyntetik-runner

    1 mlx-serve VS xyntetik-runner

    Single-binary GGUF model runtime in C — CPU/CUDA/Metal, OpenAI-compatible. Serves, scores, and trains LoRA directly through the quantized weights it deploys, with byte-reproducible adapters. Tool calls survive the token limit; sparse MoE and schema-constrained decoding included.

  4. fitllm-engine

    1 mlx-serve VS fitllm-engine

    Accurate LLM memory & speed calculator — models sliding-window/linear/MoE attention where naive VRAM/RAM calculators are 4–11× off. Apple Silicon + NVIDIA RTX · GGUF · one MIT file. Powers fitllm.run.

  5. anubis-oss

    3 mlx-serve VS anubis-oss

    Local LLM Testing & Benchmarking for Apple Silicon

  6. openfelix

    1 mlx-serve VS openfelix

    😼 OpenFelix — Voice-first AI agent for macOS. Runs local LLMs on Apple Silicon via MLX. Supports all OpenClaw skills. Claude, GPT, or fully offline.

  7. Chaty

    1 mlx-serve VS Chaty

    Private, on-device AI desktop app — GGUF (llama.cpp) & MLX, running Muse-Glimmer and Qwen3.8 with their native reasoning-effort ladders wired in as real controls. Local coding agent, RAG knowledge base, Deep Research, vision and voice. 100% offline, no account, no telemetry. Windows & macOS. (by Fangyuan025)

  8. omlx

    25 mlx-serve VS omlx

    LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

  9. AppSignal

    AppSignal knows why the f*#k it crashed. Stop vibe-debugging. Every exception, every backtrace, grouped so you see patterns, not noise.

    AppSignal logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better mlx-serve alternative or higher similarity.
Suggest an alternative to mlx-serve

mlx-serve discussion

Log in or Post with

mlx-serve reviews and mentions

Posts with mentions or reviews of mlx-serve. We have used some of these posts to build our list of alternatives and similar projects.

Stats

Basic mlx-serve repo stats
1
1,127
9.5
3 days ago

ddalcu/mlx-serve is an open source project licensed under GNU General Public License v3.0 or later which is an OSI approved license.

The primary programming language of mlx-serve is Zig.


Sponsored
Stop Scripting Promotions. Start Shipping with Kargo
Kargo automates promotion across dev, staging, and prod with approval gates and verification. Open source, built by the team behind Argo CD. Download now.
akuity.io

Did you know that Zig is
the 17th most popular programming language
based on number of references?

Loading...