SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 Python llm Projects
-
Project mention: Quick and easy local AI RAG setup with JetBrains IDE integration and browser UI | dev.to | 2026-06-02
To get a local web UI (that is very similar to CharGPT) that supports Retrieval Augmented Generation (RAG), workflows and many other features, we'll use Open WebUI (https://github.com/open-webui/open-webui). Although it can be setup using locally installed Python, I've decided to try out their Docker image instead. Since I have an Nvidia card, I've used their Nvidia GPU supported docker image.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
Explore the repository and contribute to the future of AI: https://github.com/Shubhamsaboo/awesome-llm-apps
-
unsloth
Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.
Project mention: I Trained an LLM on 75K of My Own Messages So It Would Stop Writing Like a Chatbot | dev.to | 2026-05-08Training: unsloth + trl (SFTTrainer). Unsloth handles the 4-bit quantization and gradient checkpointing; trl handles the training loop.
-
-
crewAI
Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
CrewAI: https://github.com/crewAIInc/crewAI
-
Project mention: BettaFish – Public Opinion Sentiment Analysis Model | news.ycombinator.com | 2025-11-03
-
Project mention: Graph RAG Isn't a One-Shot Anymore — The Case for Agentic Graph RAG MCPs | dev.to | 2026-05-07
The most well-known implementation right now is Microsoft's GraphRAG, released in 2024. The papers are well-written and I have a lot of respect for it. But the design philosophy is squarely from the one-shot retrieval era.
-
I spent a weekend studying GPT-Researcher, an open-source project with 24,000+ GitHub stars. It builds an autonomous research agent that generates comprehensive reports with citations. The architecture is elegant: multiple specialized agents coordinate through LangGraph, parallel execution speeds up research, and quality gates ensure reliable output.
-
Graphiti by Zep is the temporal knowledge graph. Its core insight: knowing the current state isn't enough. You need to know when things changed and what was true before.
-
-
-
adk-python
An open-source, code-first Python toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.
Project mention: Google ADK CLI: The Fastest Way to Build and Ship AI Agents in 2026 [Guide] | dev.to | 2026-06-11First, ADK is genuinely multi-model. It supports Gemini, Gemma, Claude (via Vertex), Ollama, vLLM, LiteLLM, and LiteRT-LM. You're not locked into Gemini. You can route different agent tasks to different models based on cost, latency, or capability. This matters in production, where your summarization agent absolutely doesn't need the same model as your code generation agent.
-
Project mention: The Chomsky Objection the AI Industry Has Been Quietly Working Around | dev.to | 2026-06-09
The Python library Outlines, maintained by .txt, is the most widely-used implementation. The minimal usage is short:
-
Project mention: Lightning.ai – an enterprise managed inference platform for AI | news.ycombinator.com | 2025-10-09
After making model training simpler with PyTorch Lightning, Lightning.AI is now tackling the next bottleneck — inference. Their new managed service targets enterprises deploying LLMs and deep learning models at scale, emphasizing performance, cost-efficiency, and developer-friendly tooling.
Platform: https://lightning.ai/
-
My exploration of LLM-based tools for code understanding started with DeepWiki, which I have been using since its early release. As my interest shifted toward analyzing private repositories and experimenting more deeply with the underlying mechanics, I began looking for open-source alternatives. This led me to deepwiki-rs and later OpenDeepWiki. After starring OpenDeepWiki on GitHub, one of the authors of Davia reached out, which introduced me to a different, more collaborative approach to AI-assisted documentation. I later encountered PocketFlow Tutorial Codebase Knowledge through a technical report, and finally Google Code Wiki when it was publicly announced, which I followed closely given its enterprise positioning.
-
-
Project mention: I benchmarked Python AI-app security scanners. Here's what each catches. | dev.to | 2026-06-05
We ran all three (working) tools against simonw/llm, Simon Willison's clean CLI for LLMs, 48 Python files.
-
cleanlab
Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
-
Phoenix by Arize: An open-source observability tool for ML and LLM apps that consumes OpenInference (and thus OpenTelemetry) traces.
-
ART
Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more!
Huh?
I thought the latest advance in computing (spring 2025) is self-play / reinforcement learning. Like we've ran out of training data a few years ago.
https://github.com/OpenPipe/ART
Reinforcement learning having the large language model devise puzzles that they solve via llm-as-judge.
The definition of llm-as-judge is your llm generate 8-12 trajectories and a different llm judges the result. I'd use an oracle like windows or linux operating system execution for the problem of ISA-assembly creation.
The winning entries are used to train the large language model.
-
-
oumi
Easily fine-tune, evaluate and deploy Gemma 4, Qwen3.5, Qwen3.6, gpt-oss, DeepSeek-R1, or any open source LLM / VLM!
Project mention: Open source x 3: GRPO training with OpenEnv, vLLM, and Oumi | news.ycombinator.com | 2025-11-12 -
Project mention: Show HN: MCP-C – cloud platform for running MCP agents and apps | news.ycombinator.com | 2025-10-28
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python llms discussion
Python llms related posts
-
The Chomsky Objection the AI Industry Has Been Quietly Working Around
-
Run CrewAI With 50% Lower LLM Cost Using Lynkr
-
Fixing JSON Output from GPT: A Pattern That Actually Works
-
I benchmarked Python AI-app security scanners. Here's what each catches.
-
My Trading Bot Tried to Execute the Same Trade Twice. That Became SafeAgent.
-
Revisiting Benchmarking- Building a Rust A2A Agent
-
Miro Fish: Predicting Anything
-
A note from our sponsor - SaaSHub
www.saashub.com | 12 Jun 2026
Index
What are some of the best open-source llm projects in Python? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | open-webui | 140,988 |
| 2 | awesome-llm-apps | 114,288 |
| 3 | unsloth | 65,904 |
| 4 | MiroFish | 65,685 |
| 5 | crewAI | 53,305 |
| 6 | BettaFish | 41,344 |
| 7 | graphrag | 33,674 |
| 8 | gpt-researcher | 27,645 |
| 9 | graphiti | 27,343 |
| 10 | fastmcp | 25,579 |
| 11 | kotaemon | 25,457 |
| 12 | adk-python | 20,085 |
| 13 | outlines | 13,948 |
| 14 | litgpt | 13,408 |
| 15 | PocketFlow-Tutorial-Codebase-Knowledge | 12,377 |
| 16 | LLMSurvey | 12,171 |
| 17 | llm | 12,031 |
| 18 | cleanlab | 11,500 |
| 19 | phoenix | 10,100 |
| 20 | ART | 9,966 |
| 21 | open-swe | 9,921 |
| 22 | oumi | 9,315 |
| 23 | mcp-agent | 8,370 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com