SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 Python mistral Projects
-
unsloth
Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.
Project mention: I Trained an LLM on 75K of My Own Messages So It Would Stop Writing Like a Chatbot | dev.to | 2026-05-08Training: unsloth + trl (SFTTrainer). Unsloth handles the 4-bit quantization and gradient checkpointing; trl handles the training loop.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
Project mention: Your 2025 Roadmap to Becoming an AI Engineer for Free for Vue.js Developers | dev.to | 2025-08-06REST APIs to connect AI models to Vue.js apps (example 1, example 2).
-
-
inference
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
-
local-deep-research
~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.
Project mention: Local Deep Research: Run Your Own AI Research Assistant, Fully Private | dev.to | 2026-05-06Local Deep Research is a self-hosted AI research assistant. You give it a question. It searches across multiple sources — web, arXiv, PubMed, Wikipedia, GitHub, your own local documents — iterates on what it finds, and produces a structured report with citations.
-
-
agentops
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI
Project mention: Tune self-correct SQL agent with RL: AgentLightning+verl+vLLM+AgentOps+LangGraph | news.ycombinator.com | 2025-08-11- AgentOps for collecting training data (telemetry): https://github.com/AgentOps-AI/agentops
-
-
xTuring
Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
-
elia
A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.
-
Project mention: Agent Factory Recap: Reinforcement Learning and Fine-Tuning on TPUs | dev.to | 2026-03-31
-
airunner
Offline inference engine for art, real-time voice conversations, LLM powered chatbots and automated workflows
-
-
-
Automodel
🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support (by NVIDIA-NeMo)
-
KVQuant
[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
-
-
-
-
-
local-LLM-with-RAG
Running local Language Language Models (LLM) to perform Retrieval-Augmented Generation (RAG)
More of a proof of concept to test out ideas, but here's my approach for local RAG, https://github.com/amscotti/local-LLM-with-RAG
Using Ollama for the embeddings with “nomic-embed-text”, with LanceDB for the vector database. Recently updated it to use “agentic” RAG, but probably not fully needed for a small project.
-
-
airgapped-offfline-rag
Secure, locally-run Retrieval-Augmented Generation system for document-based question-answering, utilizing Llama 3, Mistral, and Gemini models with a user-friendly Streamlit interface.
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python mistral discussion
Python mistral related posts
-
I Trained an LLM on 75K of My Own Messages So It Would Stop Writing Like a Chatbot
-
How to Fine-Tune Llama 3.1 8B for Under $5 Using QLoRA in 2026 – A Practical Guide
-
Show HN: Unsloth Studio
-
An Experiment in Voice: What Happens When AI Learns to Write Like You
-
I Built an Automated SLM Fine-Tuning Engine with Python and Unsloth 🚀
-
When OpenCode tries to build Go packages using a Chinese proxy
-
Show HN: MemX – Shared memory for LLM agents
-
A note from our sponsor - SaaSHub
www.saashub.com | 13 Jun 2026
Index
What are some of the best open-source mistral projects in Python? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | unsloth | 66,397 |
| 2 | OpenLLM | 12,352 |
| 3 | ludwig | 11,716 |
| 4 | inference | 9,348 |
| 5 | local-deep-research | 8,457 |
| 6 | Liger-Kernel | 6,430 |
| 7 | agentops | 5,628 |
| 8 | json_repair | 4,967 |
| 9 | xTuring | 2,667 |
| 10 | elia | 2,437 |
| 11 | maxtext | 2,319 |
| 12 | airunner | 1,315 |
| 13 | MixtralKit | 771 |
| 14 | Owl | 645 |
| 15 | Automodel | 576 |
| 16 | KVQuant | 421 |
| 17 | xllm | 408 |
| 18 | LLaMa2lang | 313 |
| 19 | picollm | 312 |
| 20 | nanodl | 302 |
| 21 | local-LLM-with-RAG | 284 |
| 22 | machinascript-for-robots | 196 |
| 23 | airgapped-offfline-rag | 85 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com