ds4

DeepSeek 4 Flash local inference engine for Metal (by antirez)

Ds4 Alternatives

Similar projects and alternatives to ds4

  1. llama.cpp

    1,123 ds4 VS llama.cpp

    LLM inference in C/C++

  2. AppSignal

    Monitoring that respects your time & budget. APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.

    AppSignal logo
  3. Redis

    439 ds4 VS Redis

    For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.

  4. zed

    314 ds4 VS zed

    Code at the speed of thought – Zed is a high-performance, multiplayer code editor from the creators of Atom and Tree-sitter.

  5. opencode

    151 ds4 VS opencode

    The open source coding agent.

  6. hermes-agent

    125 ds4 VS hermes-agent

    The agent that grows with you

  7. kvrocks

    32 ds4 VS kvrocks

    Apache Kvrocks is a distributed key value NoSQL database that uses RocksDB as storage engine and is compatible with Redis protocol.

  8. omlx

    26 ds4 VS omlx

    LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

  9. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  10. humanizer

    22 ds4 VS humanizer

    Agent skill that removes signs of AI-generated writing from text

  11. colibri

    12 ds4 VS colibri

    Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦

  12. Strata

    11 ds4 VS Strata

    Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input. (by Niko1221)

  13. LocalCodingLLM

    Configs, scripts and docs for using local coding LLMs

  14. leaf

    Terminal Markdown previewer — GUI-like experience. (by RivoLink)

  15. ds4-go

    Golang wrapper for DwarfStar4 (ds4)

  16. flash-moe

    7 ds4 VS flash-moe

    Running a big model on a small laptop

  17. club-3090

    7 ds4 VS club-3090

    Community recipes for serving LLMs on RTX 3090. Multi-engine (vLLM, llama.cpp, SGLang) and model-agnostic. Currently shipping Qwen3.6-27B configs for 1× and 2× cards.

  18. ds4-m5

    DeepSeek 4 Flash local inference engine for Metal and CUDA with M5 optimizations.

  19. obsidian-releases

    1,757 ds4 VS obsidian-releases

    Community plugins list, theme list, and releases of Obsidian.

  20. turbo-fieldfare

    5 ds4 VS turbo-fieldfare

    Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

  21. kilocode

    24 ds4 VS kilocode

    Kilo is the all-in-one agentic engineering platform. Build, ship, and iterate faster with the most popular open source coding agent.

  22. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better ds4 alternative or higher similarity.

ds4 discussion

Log in or Post with

ds4 reviews and mentions

Posts with mentions or reviews of ds4. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2026-10-04.
  • Run Qwen 3.8 Flash Next (125B) on consumer hardware (RTX 4090) at 100T/s
    8 projects | news.ycombinator.com | 4 Oct 2026
    Dwarfstar already supports this, curious how it compares, but I use the q4 quant daily and it works really well.

    https://github.com/antirez/ds4/blob/main/docs/MODELS.md#qwen...

  • Run DeepSeek V4 on Your Own Hardware With DwarfStar, the Redis Creator's New Inference Engine
    1 project | dev.to | 3 Oct 2026
    git clone https://github.com/antirez/ds4.git cd ds4 make # Metal on Apple Silicon ./download_model.sh ds4f-q2
  • The Redis Guy Wrote a Local LLM Engine That Refuses to Be General. That's Why It Works.
    1 project | dev.to | 3 Oct 2026
    git clone https://github.com/antirez/ds4 cd ds4 && ./download_model.sh ds4f-q2 make # macOS / Metal # make cuda-spark # Linux / DGX Spark ./ds4 # interactive CLI ./ds4-server --ctx 100000 # OpenAI + Anthropic style API
  • From the creator of Redis; run LLM locally with ds4
    9 projects | news.ycombinator.com | 2 Oct 2026
  • Directional steering is a runtime activation edit for DS4
    1 project | news.ycombinator.com | 20 Sep 2026
  • Pirate Face Rescues LLM Models from Deletion
    3 projects | news.ycombinator.com | 20 Sep 2026
    Speaking to the "uncensored model" angle: there's little reason to distribute abliterated weights anyway. Instead of orthogonalising the weights that write back to the residual stream, you can just orthogonalise the activations themselves. It's equivalent.

    Orthogonalising activations at runtime is computationally cheap. Just distribute the refusal vectors (few thousand floats per layer), then run against the stock weights. Antirez's DS4 already supports this: https://github.com/antirez/ds4/blob/8db1d1d155cb0400a86a86b9...

    Abliterated weights are just a bad habit we've gotten into. It's also deeply suboptimal from a precision point of view to take a model that's already been QATed and distributed in pre-quantised form (DeepSeek V4, Kimi K2.5 or K3...), modify its weights, and re-quantise it.

  • Dwarf Star Support for Qwen3.8 Flash Next
    1 project | news.ycombinator.com | 16 Sep 2026
  • Dwarf Star Support for DeepSeek 4.1 Flash on MBPro 128GB
    1 project | news.ycombinator.com | 12 Sep 2026
    Antirez just landed a commit[1] to the github repo for DwarfStar that adds support for his heavily quantized variant of DeepSeek V4.1 Flash.

    He claims it runs with SSD streaming on a macbook pro M5-Max 128 GB laptop. The code was just checked in literally hours ago, so take YMMV quite literally.

    [1] https://github.com/antirez/ds4/commit/bd66c402070042bf0a79ad6ece8242de4c93680c

  • How accurate have Ed Zitron's AI skeptic predictions been?
    1 project | news.ycombinator.com | 2 Sep 2026
    Something Cherny said in early December last year is clearly not relevant anymore.

    By late December he said: "100% of my contributions to Claude Code were written by Claude Code"[1]. That's production software shipping to millions of people.

    Antirez's Dwarfstar is also mostly AI written:

    > This software is developed with strong assistance from GPT 5.5, 5.6, Claude Fable and with humans leading the ideas, testing, and debugging. We say this openly because it shaped how the project was built. If you are not happy with AI-developed code, this software is not for you. [2]

    I'm actually pretty shocked anyone would claim otherwise. In January 2026, sure, but the world has changed since then. Many, many places are doing 100% AI code now, and yes for production code. https://www.businessinsider.com/ai-writing-all-startup-code-...

    [1] https://x.com/bcherny/status/2004897269674639461

    [2] https://github.com/antirez/ds4

  • Apple Caught Off Guard by AI Demand for Mac Mini and Mac Studio
    6 projects | news.ycombinator.com | 31 Aug 2026
    I agree about getting the Ultra if you're interested in AI (LLM) inference speed. I'm a little perplexed as to why there isn't a RAM option in between 96GB and 256GB, though. For instance, I believe Deepseek v4 flash runs a lot faster on (https://github.com/antirez/ds4) with 128GB than 96. I assume the higher SKUs have low enough sales that Apple doesn't want to be manufacturing too many different RAM configs as that would eat into their margins. (I say this as someone interested in AI hardware in general, even the 96GB is out of my price range).
  • A note from our sponsor - SaaSHub
    www.saashub.com | 6 Oct 2026
    SaaSHub helps you find the best software and product alternatives Learn more →

Stats

Basic ds4 repo stats
48
53
-
5 months ago

antirez/ds4 is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of ds4 is C.


Sponsored
Monitoring that respects your time & budget
APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.
www.appsignal.com