SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 Python LLM Projects
-
AutoGPT
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
AutoGPT (agpt.co): Open-source autonomous agent framework, released in 2023. Pioneering example of general-purpose agent architecture; known for demonstrating both promise and limitations of autonomous systems.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
Project mention: The $100 ChatGPT: Why Karpathy's nanochat Represnts the Next Big Thing | dev.to | 2026-05-04Hugging Face Transformers: 500,000+ lines
-
Project mention: Quick and easy local AI RAG setup with JetBrains IDE integration and browser UI | dev.to | 2026-06-02
To get a local web UI (that is very similar to CharGPT) that supports Retrieval Augmented Generation (RAG), workflows and many other features, we'll use Open WebUI (https://github.com/open-webui/open-webui). Although it can be setup using locally installed Python, I've decided to try out their Docker image instead. Since I have an Nvidia card, I've used their Nvidia GPU supported docker image.
-
Project mention: Scarab Diagnostic Suite Field Test #011: LangChain Structured Output Streaming Boundary | dev.to | 2026-06-04
-
browser-use
Open-source browser automation framework for AI agents. Browser Use lets AI agents control real browser sessions to complete multi-step web workflows.
browser-use: https://github.com/browser-use/browser-use
-
ragflow
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
Project mention: I Scanned 5 Popular Open-Source AI Projects for EU AI Act Compliance. Here's What I Found. | dev.to | 2026-03-31I ran AIR Blackbox (the scanner itself), Browser Use (79K+ stars), RAGFlow (76K+ stars), LiteLLM (23K+ stars), and Superlinked (15K+ stars) through the same compliance checks.
-
Project mention: Speculative decoding: when and why it actually speeds up inference | dev.to | 2026-06-04
Here's a real, runnable config that uses EAGLE for offline batched generation. It's straight from the vLLM repo's eagle.md example:
-
OpenHands AGENTS.md
-
Project mention: Llama-Factory: Unified, Efficient Fine-Tuning for 100 Open LLMs | news.ycombinator.com | 2025-09-18
-
deer-flow
An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.
Project mention: DeerFlow 2.0 – Deep Exploration and Efficient Research Flow | news.ycombinator.com | 2026-05-17 -
MetaGPT
🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming
Project mention: Backlog.md – CLI that auto-generates task files (took my Claude success to 95 %) | news.ycombinator.com | 2025-07-06 -
unsloth
Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.
Project mention: I Trained an LLM on 75K of My Own Messages So It Would Stop Writing Like a Chatbot | dev.to | 2026-05-08Training: unsloth + trl (SFTTrainer). Unsloth handles the 4-bit quantization and gradient checkpointing; trl handles the training loop.
-
-
Project mention: Give Your AI Persistent Memory: OpenCode + MemPalace in 10 Minute | dev.to | 2026-05-15
MemPalace: https://github.com/MemPalace/mempalace
-
Open-source alternative: The DIY pattern is a LlamaIndex RAG pipeline over your CRM + filings + news. Real, but takes a quarter to ship and 18 months to make trust-grade.
-
litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
— Getting Started
-
CowAgent
Open-source super AI assistant & Agent Harness. Plans tasks, runs tools and skills, autonomously grows with memory and knowledge. Multi-model, multi-channel. Lightweight, extensible, one-line install. (formerly chatgpt-on-wechat)
-
Ray
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Project mention: GSoC 2026 Predictions: 30 NEW AI/ML/Security Organizations You Should Start Contributing to NOW! | dev.to | 2026-02-06Main: https://github.com/ray-project/ray ⭐ 34k+
-
-
quivr
Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products with customisation! Any LLM: GPT4, Groq, Llama. Any Vectorstore: PGVector, Faiss. Any Files. Anyway you want.
-
langextract
A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.
langextract: A tool for extracting language information. View on GitHub
-
Project mention: Show HN: Query years of Ask HN and Show HN discussions as local knowledge graph | news.ycombinator.com | 2026-05-10
I built lightrag-snkv, Basically it uses lightRAG https://github.com/HKUDS/LightRAG ,this requires various storage databases like key value store, graph database, vector database, I built single embedded file based database which covers all these requirements: https://github.com/hash-anu/snkv.
-
khoj
Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python LLM discussion
Python LLM related posts
-
What Is browser-use? And How to Run It Through Lynkr
-
Async hierarchical memory middleware for LLM agents
-
mem0 alternatives - MemClaw and Statewave
3 projects | 3 Jun 2026 -
Speculative decoding: when and why it actually speeds up inference
-
Scarab Diagnostic Suite Field Test #011: LangChain Structured Output Streaming Boundary
-
Open-source AI toolkit for e-commerce
-
AI gateways: why and how
-
A note from our sponsor - SaaSHub
www.saashub.com | 7 Jun 2026
Index
What are some of the best open-source LLM projects in Python? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | AutoGPT | 184,738 |
| 2 | transformers | 161,343 |
| 3 | open-webui | 139,852 |
| 4 | langchain | 138,635 |
| 5 | browser-use | 97,236 |
| 6 | ragflow | 81,919 |
| 7 | vllm | 81,898 |
| 8 | OpenHands | 75,905 |
| 9 | LlamaFactory | 71,870 |
| 10 | deer-flow | 70,440 |
| 11 | MetaGPT | 68,492 |
| 12 | unsloth | 65,904 |
| 13 | mem0 | 57,631 |
| 14 | mempalace | 53,515 |
| 15 | llama_index | 49,924 |
| 16 | litellm | 49,432 |
| 17 | CowAgent | 45,060 |
| 18 | Ray | 42,791 |
| 19 | ChatTTS | 39,392 |
| 20 | quivr | 39,171 |
| 21 | langextract | 36,808 |
| 22 | LightRAG | 36,193 |
| 23 | khoj | 34,892 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com