mistral.rs

Fast, flexible LLM inference (by EricLBuehler)

Mistral.rs Alternatives

Similar projects and alternatives to mistral.rs

  1. llama.cpp

    LLM inference in C/C++

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  3. moshi

    9 mistral.rs VS moshi

    Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audio codec. (by kyutai-labs)

  4. swiftide

    Fast, streaming indexing, query, and agentic LLM applications in Rust

  5. EdgeChains

    15 mistral.rs VS EdgeChains

    EdgeChains.js is Full-Stack GenAI library. Front-end, backend, apis, prompt management, distributed computing. All core prompts & chains are managed declaratively in jsonnet (and not hidden in classes)

  6. LLaMA-Omni

    LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.

  7. Starmoon

    3 mistral.rs VS Starmoon

    A conversational, AI device + software framework for companionship, entertainment, education, healthcare, IoT applications, and DIY robotics. Built with Python, NextJS, Arduino, ESP32, LLMs (GPT-4o), Deepgram STT and Azure TTS 🤖

  8. mini-omni

    open-source multimodal large language model that can hear, talk while thinking. Featuring real-time end-to-end speech input and streaming audio output conversational capabilities.

  9. voxtral.c

    Pure C inference of Mistral Voxtral Realtime 4B speech to text model

  10. sundry

    Sundry is an intelligent context provider API designed specifically for Large Language Models.

  11. RawRAG

    1 mistral.rs VS RawRAG

    Let's RAG it RAW without fancy frameworks

  12. pantry

    Actor based multi-llm registry + runner. (by JuliaMerz)

  13. voxtral-mini-realtime-rs

    Voxtral ASR & TTS running natively and in the browser. A Rust implementation of Mistral's Voxtral mini realtime ASR / TTS using the Burn ML framework

  14. voxtral.c

    Pure C inference of Mistral Voxtral Realtime 4B speech to text model (by HorizonXP)

  15. quiet-crab

    Run Whisper Models In Native Rust

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better mistral.rs alternative or higher similarity.

mistral.rs discussion

Log in or Post with

mistral.rs reviews and mentions

Posts with mentions or reviews of mistral.rs. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2026-02-09.

Stats

Basic mistral.rs repo stats
10
7,579
9.6
16 days ago

EricLBuehler/mistral.rs is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of mistral.rs is Rust.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com