Kargo automates promotion across dev, staging, and prod with approval gates and verification. Open source, built by the team behind Argo CD. Download now. Learn more →
Top 23 Python cost-optimization Projects
-
skypilot
The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.
Project mention: Skypilot: Run, manage, and scale AI workloads on any AI infrastructure | news.ycombinator.com | 2026-01-30 -
Kargo
Stop Scripting Promotions. Start Shipping with Kargo. Kargo automates promotion across dev, staging, and prod with approval gates and verification. Open source, built by the team behind Argo CD. Download now.
-
-
cascadeflow
Cascading runtime for AI agents. Optimize cost, latency, quality, and policy decisions inside the agent loop.
Project mention: "Smart Model Routing: Why Your AI Agent Shouldn't Use the Same Model for Everything" | dev.to | 2026-06-27cascadeflow: https://github.com/lemony-ai/cascadeflow
-
optscale
FinOps and cloud cost optimization tool. Supports AWS, Azure, GCP, Alibaba Cloud and Kubernetes.
-
service-screener-v2
A tool for customers to evaluate their AWS service configurations based on AWS and community best practices and receive recommendations on potential improvements.
-
kubeledger
System of Record for Kubernetes cost accounting: per-namespace CPU, memory and GPU usage, with the 30% non-allocatable overhead made visible. Connects to AI assistants via MCP (Claude, Gemini, Mistral, Cursor) for plain-language analysis. Formerly Kube-Opex-Analytics.
-
-
AppSignal
Monitoring that respects your time & budget. APM, error tracking, and dashboards for modern web apps. Ten-minute setup, transparent flat pricing, and support from engineers who actually use the product.
-
Project mention: Claude Fable 5 vs. Kimi K3 vs. GPT 5.6 Sol [video] | news.ycombinator.com | 2026-07-17
Re: "Show HN: Frugon – Find which LLM calls a cheaper model could handle (local, MIT)" https://github.com/Rodiun/frugon and cost to converge:
-
ec2-spot-converter
A tool to convert AWS EC2 instances back and forth between On-Demand and Spot billing models.
-
llm-router
Universal LLM router for AI coding tools. Works with Claude Code, Cursor, Codex, Gemini CLI, Copilot and more. Free-first fallback chain cuts costs 35-80%. (by ypollak2)
Project mention: LLM Router – MCP server that routes Claude Code tasks to cheaper models | news.ycombinator.com | 2026-04-05 -
credit-optimizer-v5
Save 47% on Manus AI credits automatically. Zero downsides. Pays for itself in ~27 prompts. Free MCP Server (PyPI) + $12 Manus Skill bundle with Fast Navigation (115x speed boost).
Project mention: How I Built a Credit Optimizer That Saves 30-75% on AI Agent Costs (Open Architecture) | dev.to | 2026-05-25The Credit Optimizer is available at creditopt.ai — it includes:
-
SpecJudge
Local-first CLI that reads your Spec-Driven Development artifacts and recommends the best value-for-money AI model to implement them. Powered by Ollama — your specs never leave your machine.
Project mention: Specjudge, tells you which model you should use for each task | news.ycombinator.com | 2026-08-06 -
-
Project mention: Show HN: GreenKube – Open-source K8s cost and CO2 optimization engine | news.ycombinator.com | 2026-06-03
-
localharness
An open-source, model-agnostic agent harness for local LLMs. Define agents in YAML (tools, memory, deny-first permissions) and run them against any OpenAI-compatible endpoint: vLLM, Ollama, LM Studio, or llama.cpp.
Project mention: LocalHarness – an agent harness for local LLMs (open-source) | news.ycombinator.com | 2026-06-15 -
permafrost
Freeze Claude Code's prompt prefix so DeepSeek's automatic cache always hits — alignment proxy + coalescing + keepalive, installable as a CC plugin. Measured 64% cheaper on real Claude Code traffic. (by jianzhichun)
Project mention: Permafrost – freeze Claude Code's prompt prefix, cut your DeepSeek bill 64% | news.ycombinator.com | 2026-06-09 -
Project mention: Show HN: Wattage – finds the tokens your Claude Code sessions wasted | news.ycombinator.com | 2026-08-26
-
-
finopsmcp
The headless FinOps intelligence layer: API-first, agent-first cost control for cloud + AI. Connect your cloud stack in Claude, Cursor, or the terminal, and gate what agents do to your infra before they act. Propose-only. Open source, local-first. (by getnable)
Project mention: Show HN: Nable – Local-first cost intelligence tool for cloud and AI | news.ycombinator.com | 2026-07-15 -
SCAPO
🧘 Reddit-powered AI optimization tips | Save your time and credits | can cover 380+ services | Real tips from real users
-
Baar-Core
Budget-Aware Agentic Routing (BAAR) — Intelligent LLM model selection with a zero-call financial kill-switch. Save 90% on costs without losing accuracy.
Most of the annoying parts here are already solved. baar-core is an open-source Python library that wraps this into a decorator around your LLM client: pip install baar-core, set a cap, and it raises a 402 before the provider is ever contacted rather than after the tokens are billed. Atomic reservation is the piece I'd have gotten wrong on my own, and it's the piece that stops concurrent calls from jointly clearing a limit that neither one individually exceeded. noburn.dev is what we built on top of it for teams: the same pre-flight enforcement blocking the API call before it fires when a user is over budget, plus per-user caps and the ledger view.
-
llmslim
Shrink LLM prompts by 40-70% while preserving meaning, semantic chunking + extractive summarization
Project mention: Building LLMSlim: Architecture Deep-Dive into Deterministic Prompt Compression | dev.to | 2026-07-18GitHub with reproducible benchmarks: https://github.com/Thanatos9404/llmslim
-
arch-compiler
An architecture-level AI harness that compiles constraints and NFRs into explicit, reviewable architecture decisions. Combines a deterministic compiler, curated pattern registry, and agent workflow skills to drive approval, re-approval, and implementation against an architectural contract.
Architecture Compiler: https://github.com/inetgas/arch-compiler
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python cost-optimization discussion
Python cost-optimization related posts
-
Show HN: Wattage – finds the tokens your Claude Code sessions wasted
-
Catching the AI Agent Failure Mode Your Loop Guard Can't See
-
Beyond Rule-Based Gateways: Implementing a Layer 5 Homeostatic Radar for Fintech Ingestion via Python
-
Show HN: Tokentoll, a CI gate for LLM API cost regressions
-
How I Built a Credit Optimizer That Saves 30-75% on AI Agent Costs (Open Architecture)
-
My Manus AI Credit Usage After 30 Days — The Data
-
The Hidden Cost of AI Agents: How I Built an MCP Server That Saves 47% on Manus Credits
-
A note from our sponsor - Kargo
akuity.io | 11 Sep 2026
Index
What are some of the best open-source cost-optimization projects in Python? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | skypilot | 10,568 |
| 2 | metaflow | 10,255 |
| 3 | cascadeflow | 3,965 |
| 4 | optscale | 2,181 |
| 5 | service-screener-v2 | 570 |
| 6 | kubeledger | 485 |
| 7 | koku | 312 |
| 8 | frugon | 212 |
| 9 | ec2-spot-converter | 199 |
| 10 | llm-router | 78 |
| 11 | credit-optimizer-v5 | 50 |
| 12 | SpecJudge | 47 |
| 13 | justllms | 43 |
| 14 | GreenKube | 32 |
| 15 | localharness | 31 |
| 16 | permafrost | 22 |
| 17 | wattage | 22 |
| 18 | botanu-sdk-python | 18 |
| 19 | finopsmcp | 17 |
| 20 | SCAPO | 17 |
| 21 | Baar-Core | 16 |
| 22 | llmslim | 15 |
| 23 | arch-compiler | 10 |
Sponsored
Stop Scripting Promotions. Start Shipping with Kargo
Kargo automates promotion across dev, staging, and prod with approval gates and verification. Open source, built by the team behind Argo CD. Download now.
akuity.io