Top 23 Python ollama Projects

ollama

• Add a project

1. open-webui

   1 67 151,481 10.0 Python

   User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

   

   Project mention: Mastering Free Autonomous Agents: Self-Hosting Hermes with OpenRouter | dev.to | 2026-09-07

   An agent constrained to a local terminal is limited in scope. By enabling the OpenAI-compatible API server, you can integrate Hermes Agent with external interfaces like Open WebUI. To expose your agent to the internet securely, use Pinggy, which allows you to create a secure tunnel to your local endpoint without complex network configuration:

2. AppSignal

   www.appsignal.com sponsored

   AppSignal knows why the f*#k it crashed. Stop vibe-debugging. Every exception, every backtrace, grouped so you see patterns, not noise.

   

3. kirara-ai

   2 2 18,824 9.6 Python

   🤖 可 DIY 的 多模态 AI 聊天机器人 | 🚀 快速接入 微信、 QQ、Telegram、等聊天平台 | 🦈支持DeepSeek、Grok、Claude、Ollama、Gemini、OpenAI | 工作流系统、网页搜索、AI画图、人设调教、虚拟女仆、语音对话 |

   

4. deepwiki-open

   3 9 17,883 8.1 Python

   Open Source DeepWiki: AI-Powered Wiki Generator for GitHub/Gitlab/Bitbucket Repositories. Join the discord: https://discord.gg/gMwThUMeme

   

   Project mention: Open Source DeepWiki: AI-Powered Wiki Generator for GitHub/Gitlab Repos | news.ycombinator.com | 2025-10-01

5. LangBot

   4 6 17,695 9.8 Python

   ChatGPT chat bot for Tencent QQ, based on mirai and OpenAI API.

   

   Project mention: Kimi K3 Shouldn’t Live in One App—Deploy It to Discord, Slack, Telegram & LINE with LangBot | dev.to | 2026-08-26

   git clone https://github.com/langbot-app/LangBot cd LangBot/docker && docker compose up -d

6. ChuanhuChatGPT

   5 1 15,275 3.3 Python

   GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI.

   

7. LEANN

   6 4 12,890 9.1 Python

   [MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

   

8. shell_gpt

   7 46 12,272 5.9 Python

   A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.

   

9. Kargo

   akuity.io sponsored

   Stop Scripting Promotions. Start Shipping with Kargo. Kargo automates promotion across dev, staging, and prod with approval gates and verification. Open source, built by the team behind Argo CD. Download now.

   

10. ollama-python

    8 14 10,491 4.7 Python

    Ollama Python library

    

    Project mention: Running a Local LLM on an Older Computer: A Simple Home Lab Guide | dev.to | 2026-09-03

    ollama-python

11. local-deep-research

    9 6 9,044 10.0 Python

    ~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.

    

    Project mention: Local Deep Research: Run Your Own AI Research Assistant, Fully Private | dev.to | 2026-05-06

    Local Deep Research is a self-hosted AI research assistant. You give it a question. It searches across multiple sources — web, arXiv, PubMed, Wikipedia, GitHub, your own local documents — iterates on what it finds, and produces a structured report with citations.

12. Open-LLM-VTuber

    10 2 8,296 - Python

    Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D taking face running locally across platforms

    

    Project mention: Open-LLM-VTuber Review: Offline AI Companion with Live2D | dev.to | 2026-06-08

    # 1. Install uv (Astral's Python package manager — Open-LLM-VTuber requires it) curl -LsSf https://astral.sh/uv/install.sh | sh # 2. Clone git clone https://github.com/Open-LLM-VTuber/Open-LLM-VTuber.git cd Open-LLM-VTuber # 3. Install Python deps (uv resolves everything via pyproject.toml) uv sync # 4. Install ffmpeg (TTS post-processing + audio resampling) brew install ffmpeg # macOS # sudo apt install ffmpeg # Debian/Ubuntu # 5. Pull an LLM ollama pull qwen2.5:7b # 6. Run uv run run_server.py

13. whichllm

    11 5 6,564 9.3 Python

    Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

    

    Project mention: Local LLM Benchmarking & Agent Tools for Self-Hosted AI | dev.to | 2026-06-08

    Source: https://github.com/Andyyyy64/whichllm

14. agentops

    12 4 5,808 6.4 Python

    Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

    

15. Soup

    13 3 5,759 9.9 Python

    Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU. (by MakazhanAlpamys)

    

    Project mention: Show HN: Fine-tune an 8B model on a 4 GB laptop GPU | news.ycombinator.com | 2026-08-04

    There are some samples of training data in this folder - https://github.com/MakazhanAlpamys/Soup/tree/main/examples/d...

    They're all very short though. Anyone got a good rule for how much data of this nature is needed to successfully fine-tune a model of this size?

16. Kiln

    14 17 5,046 9.9 Python

    Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

    

    Project mention: Kiln – a free app and open-source library to build better AI products | news.ycombinator.com | 2026-05-12

17. cascadeflow

    15 17 3,965 9.5 Python

    Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop.

    

    Project mention: "Smart Model Routing: Why Your AI Agent Shouldn't Use the Same Model for Everything" | dev.to | 2026-06-27

    cascadeflow: https://github.com/lemony-ai/cascadeflow

18. pipeshub-ai

    16 2 3,721 9.9 Python

    PipesHub is an open-source platform for securely connecting enterprise knowledge to AI. Give AI agents trusted context and your team permission-aware search with verified citations across your business systems.

    

    Project mention: Why Your RAG Pipeline is Lying to You | dev.to | 2026-07-29

    At PipesHub , we spent months figuring out why RAG breaks in production. The answer was better document architecture.

19. Devon

    17 2 3,452 8.5 Python

    Devon: An open-source pair programmer

    

20. AudioMuse-AI

    18 5 2,552 9.9 Python

    AudioMuse-AI uses sonic analysis to rediscover forgotten songs, uncover hidden connections in your music library, and generate intelligent playlists for Navidrome, Jellyfin, LMS, Lyrion, Emby and Plex: no metadata or external services required.

    

    Project mention: AudioMuse-AI: Local Sonic Analysis for Auto-Playlists on Jellyfin and Navidrome | news.ycombinator.com | 2025-12-14

21. elia

    19 3 2,474 9.3 Python

    A snappy, keyboard-centric terminal user interface for interacting with large language models. Chat with ChatGPT, Claude, Llama 3, Phi 3, Mistral, Gemma and more.

    

22. oterm

    20 2 2,427 9.2 Python

    the terminal client for LLMs

    

23. comfyui_LLM_party

    21 1 2,348 5.8 Python

    LLM Agent Framework in ComfyUI includes MCP sever, Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai / aisuite interfaces, such as o1,ollama, gemini, grok, qwen, GLM, deepseek, kimi,doubao. Adapted to local llms, vlm, gguf such as llama-3.3 Janus-Pro, Linkage graphRAG

    

24. openai-edge-tts

    22 1 1,958 7.4 Python

    Free, high-quality text-to-speech API endpoint to replace OpenAI, Azure, or ElevenLabs

    

25. Alpaca

    23 1 1,635 9.3 Python

    🦙 Local and online AI hub (by Jeffser)

    

26. SaaSHub

    www.saashub.com sponsored

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    

Python ollama related posts

• I Audited My Own CLI

  1 project | dev.to | 5 Sep 2026

• Show HN: Clippy Vision – local AI that remembers your screen across apps

  1 project | news.ycombinator.com | 31 Aug 2026

• Nine ways to talk to a local model

  7 projects | dev.to | 11 Aug 2026

• I gave Claude Desktop a tax-free MCP memory layer

  1 project | dev.to | 10 Aug 2026

• Open-Source AI Platform Orbit

  1 project | news.ycombinator.com | 1 Aug 2026

• Pressure-testing Ota on Open WebUI: proof cleanup ownership, bootstrap truth, and native vs Compose runtime boundaries

  2 projects | dev.to | 20 Jul 2026

• I Built a $0 Local AI Automation Stack: Agentic Coding + Market Data Over MCP

  3 projects | dev.to | 11 Jul 2026
• A note from our sponsor - Kargo
  akuity.io | 10 Sep 2026

  Kargo automates promotion across dev, staging, and prod with approval gates and verification. Open source, built by the team behind Argo CD. Download now. Learn more →

Index

Sponsored

AppSignal knows why the f*#k it crashed.

Stop vibe-debugging. Every exception, every backtrace, grouped so you see patterns, not noise.

www.appsignal.com

Do not miss the trending Python projects with our weekly report!