Top 23 Python Mlops Projects

Mlops

• Add a project

1. vllm

   1 91 82,489 10.0 Python

   A high-throughput and memory-efficient inference and serving engine for LLMs

   

   Project mention: Speculative decoding: when and why it actually speeds up inference | dev.to | 2026-06-04

   Here's a real, runnable config that uses EAGLE for offline batched generation. It's straight from the vLLM repo's eagle.md example:

2. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

3. Airflow

   2 205 45,795 10.0 Python

   Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

   

   Project mention: From Zero to Job Data Visualization vs Power BI: Which Wins? | dev.to | 2026-05-07

   For senior engineers building custom job data visualization pipelines, the single biggest latency gain comes from pre-aggregating frequently accessed metrics instead of running joins at query time. In our benchmarks, querying raw job_postings tables with 1M rows took 210ms average, while pre-aggregated tables (updated hourly via PostgreSQL materialized views) reduced query time to 12ms. Use tools like Apache Airflow 2.7.3 to schedule materialized view refreshes during off-peak hours. For example, a materialized view for average salary by company can be defined as:

4. MLflow

   3 83 26,420 10.0 Python

   The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

   

   Project mention: MLOps Lifecycle: Stages, Workflow, and Best Practices | dev.to | 2026-06-02

   For example, this can be done using MLflow in Python:

5. serve

   4 126 21,854 8.8 Python

   ☁️ Build multimodal AI applications with cloud-native stack

   

6. Taipy

   5 24 19,237 9.0 Python

   Turns Data and AI algorithms into production-ready web applications in no time.

   

7. ml-engineering

   6 12 18,080 8.8 Python

   Machine Learning Engineering Open Book

   

   Project mention: Real-time Nvidia GPU dashboard | news.ycombinator.com | 2025-10-06

   For kernel-level performance tuning you can use the occupancy calculator as pointed out by jplusqualt or you can profile your kernel with Nsight compute which will give you a ton of info.

   But for model-wide performance, you basically have to come up with your own calculation to estimate the FLOPs required by your model and based on that figure out how well your model is maxing out the GPU capabilities (MFU/HFU).

   Here is a more in-depth example on how you might do this: https://github.com/stas00/ml-engineering/tree/master/trainin...

8. agent-lightning

   7 3 17,301 9.4 Python

   The absolute trainer to light up AI agents.

   

   Project mention: Daily Artificial Intelligence Digest - Oct 26, 2025 | dev.to | 2025-10-25

   Microsoft's agent-lightning project offers a comprehensive toolkit aimed at accelerating the process of building, testing, and deploying AI Agents. This open-source initiative highlights the industry's commitment to enabling faster development and implementation of advanced AI capabilities, providing developers with robust resources to streamline AI agent creation.

9. dagster

   8 62 15,661 10.0 Python

   An orchestration platform for the development, production, and observation of data assets.

   

   Project mention: Ten years late to the dbt party (DuckDB edition) | dev.to | 2026-02-23

   I used Dagster, which integrates with dbt nicely (see the point above about how it automagically pulls in documentation). It understands the models and dependencies, and orchestrates everything nicely. It tracks executions and shows you runtimes.

10. OpenLLM

    9 29 12,352 5.3 Python

    Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

    

    Project mention: Your 2025 Roadmap to Becoming an AI Engineer for Free for Vue.js Developers | dev.to | 2025-08-06

    REST APIs to connect AI models to Vue.js apps (example 1, example 2).

11. great_expectations

    10 16 11,546 9.8 Python

    Always know what to expect from your data.

    

    Project mention: validatelite VS great_expectations - a user suggested alternative | libhunt.com/r/validatelite | 2025-08-08

    Great Expectations is a popular open-source data validation framework with rich features and integrations, but it has a steeper learning curve and heavier setup. ValidateLite offers a lightweight, zero-config CLI alternative for quick checks and automation.

12. wandb

    11 28 11,116 9.9 Python

    The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.

    

    Project mention: The $100 ChatGPT: Why Karpathy's nanochat Represnts the Next Big Thing | dev.to | 2026-05-04

    Each stage is comprehensible. Each stage is hackable. You can literally watch it get smarter in real-time through the wandb plots.

13. Kedro

    12 35 10,885 9.5 Python

    Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

    

    Project mention: Don't Know These 6 Tools? No Wonder Your Python Development Is So Slow | dev.to | 2025-07-10

    👉 https://kedro.org/

14. metaflow

    13 30 10,129 9.5 Python

    Build, Manage and Deploy AI/ML Systems

    

    Project mention: Metaflow: Build, Manage and Deploy AI/ML Systems | news.ycombinator.com | 2025-07-16

    Stay tuned! We have some cool new features coming soon to support agentic workloads (teaser: https://github.com/Netflix/metaflow/pull/2473)

    If you are curious, join the Metaflow Slack at http://slack.outerbounds.co and start a thread on #ask-metaflow

15. BentoML

    14 18 8,672 9.2 Python

    The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

    

16. feast

    15 14 7,089 9.7 Python

    The Open Source Feature Store for AI/ML

    

17. clearml

    16 20 6,728 8.2 Python

    ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

    

18. agent-starter-pack

    17 8 6,465 9.8 Python

    Ship AI Agents to Google Cloud in minutes, not months. Production-ready templates with built-in CI/CD, evaluation, and observability.

    

    Project mention: Building "Sweets Vault" - a multimodal Gemini Agent with physical hardware integration | dev.to | 2026-05-15

    To kick-start the agent development, I leveraged the agent-starter-pack templates. It provides a production-ready foundation with FastAPI, frontend UI integration, and built-in observability.

19. courses

    18 7 6,435 5.4 Python

    This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI) (by SkalskiP)

    

20. aim

    19 71 6,153 3.2 Python

    Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

    

21. zenml

    20 35 5,440 9.9 Python

    ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

    

22. giskard-oss

    21 9 5,426 9.6 Python

    🐢 Open-Source Evaluation & Testing library for LLM Agents

    

    Project mention: 10 Open Source AI Tools Every Developer Should Know | dev.to | 2025-07-28

    Giskard is like unit testing but for AI models. It helps you identify and fix issues like bias, hallucinations, or incorrect outputs before your AI reaches users. This tool is essential for quality control in production AI applications.

23. superduper

    22 25 5,289 9.6 Python

    Superduper: End-to-end framework for building custom AI applications and agents.

    

24. lightning-hydra-template

    23 9 5,284 0.9 Python

    PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. ⚡🔥⚡

    

Python Mlops related posts

• Speculative decoding: when and why it actually speeds up inference

  2 projects | dev.to | 4 Jun 2026

• Inside vLLM's CPU backend: a new contributor's notes

  1 project | dev.to | 14 May 2026

• We Upgraded Airflow 2.8 to 3.1 on Kubernetes. Here Is What Actually Changed

  2 projects | dev.to | 6 May 2026

• RotorQuant: Faster Than TurboQuant

  2 projects | news.ycombinator.com | 19 Apr 2026

• Best ChatGPT Alternatives in 2026: Evaluated on Automation, Persistence, and Data Ownership

  5 projects | dev.to | 7 Apr 2026

• vLLM IR: A Functional Intermediate Representation for vLLM

  1 project | news.ycombinator.com | 7 Apr 2026

• vLLM introduces memory optimizations for long-context inference

  1 project | news.ycombinator.com | 4 Apr 2026
• A note from our sponsor - SaaSHub
  www.saashub.com | 13 Jun 2026

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Python projects with our weekly report!