infercost

Kubernetes-native cost intelligence for on-premises AI inference. Computes true cost-per-token from GPU amortization, electricity, and real power draw. (by defilantech)

Infercost Alternatives

Similar projects and alternatives to infercost based on common topics and language

  1. LLMKube

    Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  3. tensor-fusion

    Tensor Fusion is a state-of-the-art GPU virtualization and pooling solution designed to optimize GPU cluster utilization to its fullest potential.

  4. aikit

    🏗️ Fine-tune, build, and deploy open-source LLMs easily!

  5. opencost

    Cost monitoring for Kubernetes workloads and cloud costs

  6. LLMKube

    Discontinued Kubernetes operator for GPU-accelerated LLM inference - air-gapped, edge-native, production-ready [Moved to: https://github.com/defilantech/LLMKube] (by Defilan)

  7. llmariner

    Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better infercost alternative or higher similarity.

infercost discussion

Log in or Post with

infercost reviews and mentions

Posts with mentions or reviews of infercost. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2026-03-23.

Stats

Basic infercost repo stats
1
6
8.1
29 days ago

defilantech/infercost is an open source project licensed under Apache License 2.0 which is an OSI approved license.

The primary programming language of infercost is Go.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com

Did you know that Go is
the 4th most popular programming language
based on number of references?