Python Observability

Open-source Python projects categorized as Observability
Edit details
Python Monitoring Metrics Tracing Opentelemetry
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com
featured

Top 23 Python Observability Projects

Observability

  1. Prefect

    The easiest way to build, run, and monitor data pipelines at scale.

    Project mention: Show HN: Flow – A Dynamic Task Engine for AI Agents Without DAG | news.ycombinator.com | 2024-12-02

    - https://github.com/PrefectHQ/prefect

  2. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo

  3. openllmetry

    Open-source observability for your LLM application, based on OpenTelemetry

    Project mention: Top Open Source Tools for LLM Observability in 2025 | dev.to | 2025-05-01

    Traceloop is also an open-source project that provides end-to-end tracing for LLM applications. It uses OpenTelemetry standards to offer visibility into the request flow through code, especially in agent-based and multi-step workflows. Traceloop focuses exclusively on tracing and requires an existing OpenTelemetry setup to unlock its full potential.

  4. logfire

    Uncomplicated Observability for Python and beyond! 🪵🔥

    Project mention: Pydantic Logfire Switches from Timescale to Datafusion | news.ycombinator.com | 2024-08-29

  5. robusta

    Better Prometheus alerts for Kubernetes - smart grouping, AI enrichment, and automatic remediation

    Project mention: AIOps : Déboguer son cluster Kubernetes en utilisant l’intelligence artificielle générative via… | dev.to | 2024-12-28

    apiVersion: v1 kind: Pod metadata: name: inventory-management-api spec: containers: - name: nginx image: nginx ports: - containerPort: 80 command: - wge - "-O" - "/work-dir/index.html" - https://home.robusta.dev (base) root@k8sgpt:~# kubectl apply -f https://raw.githubusercontent.com/robusta-dev/kubernetes-demos/refs/heads/main/crashloop_backoff/create_crashloop_backoff.yaml pod/inventory-management-api created (base) root@k8sgpt:~# kubectl get po NAME READY STATUS RESTARTS AGE inventory-management-api 0/1 ContainerCreating 0 5s (base) root@k8sgpt:~# kubectl get po NAME READY STATUS RESTARTS AGE inventory-management-api 0/1 RunContainerError 1 (1s ago) 10s

  6. tokencost

    Easy token price estimates for 400+ LLMs. TokenOps.

    Project mention: API for calculating OpenAI and other LLM costs | dev.to | 2024-09-25

    There are a few existing libraries that allow calculating the cost of different models (e.g. tokencost), but the associated datasets tend to go out of date quickly. Meanwhile, we needed something that we ourselves could rely on to calculate as accurate costs as possible. So we decided to build our own API and make it available to everyone.

  7. openlit

    Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.

    Project mention: Top Open Source Tools for LLM Observability in 2025 | dev.to | 2025-05-01

    OpenLIT is an OpenTelemetry-native observability tool built for AI Engineering and LLM applications. It focuses on easy, vendor-neutral instrumentation for LLMs, vector databases, and other AI stack components. OpenLIT is ideal for teams already heavily invested in OpenTelemetry and GPU monitoring but offers fewer features for LLM prompt evaluation and experimentation.

  8. runhouse

    Distribute and run AI workloads magically in Python, like PyTorch for ML infra.

    Project mention: Show HN: RAG app example with self-hosted embedding and LLM services | news.ycombinator.com | 2024-08-13

  9. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  10. holmesgpt

    Your 24/7 On-Call AI Agent - Solve Alerts Faster with Automatic Correlations, Investigations, and More

    Project mention: AI with Kubernetes: Operations for Developers 🤖 | dev.to | 2025-03-30

    HolmesGPT, from Robusta, is a tool that simplifies Kubernetes troubleshooting. It investigates issues automatically, requiring no prior expertise. Use it via the Robusta SaaS platform or CLI with queries like holmes ask "what pods are unhealthy and why?".

  11. dd-trace-py

    Datadog Python APM Client

  12. PlayBooks

    Runbook automation platform with deep observability integrations for SRE & On-Call Teams (by DrDroidLab)

    Project mention: Show HN: PlayBooks – Convert on-call documents into executable notebooks | news.ycombinator.com | 2024-06-04

  13. monosi

    Open source data observability platform

  14. graphsignal-python

    Graphsignal Tracer for Python

  15. whitebox

    [Not Actively Maintained] Whitebox is an open source E2E ML monitoring platform with edge capabilities that plays nicely with kubernetes (by squaredev-io)

  16. grafana-ansible-collection

    grafana.grafana Ansible collection provides modules and roles for managing various resources on Grafana Cloud and roles to manage and deploy Grafana Agent and Grafana

  17. observability-with-amazon-opensearch

    This repository contains a microservice-based Sample App demonstrating observability capabilities in the Amazon OpenSearch Service.

  18. swiple

    Swiple enables you to easily observe, understand, validate and improve the quality of your data

  19. radicalbit-ai-monitoring

    A comprehensive solution for monitoring your AI models in production

    Project mention: Radicalbit AI Monitoring hits version 1.0.0 | dev.to | 2024-08-08

    To learn more about the latest updates, install the platform, and take part in the project visit our GitHub repository.

  20. hiq

    HiQ - Observability And Optimization In Modern AI Era (by oracle)

  21. grafana-observability-primer

    Grafana Observability Primer

  22. langtrace-python-sdk

    Langtrace SDK for Python Applications

    Project mention: Observability for LLM apps with structlog and DuckDB | news.ycombinator.com | 2024-06-06

    1. You do not need 2 databases if you are only looking to export the traces to your grafana stack. If you are using prometheus as the TSDB, you can directly send the traces there without needing any of the databases to be setup locally.

    2. Also, you do not need the API key. You only need to install the python or typescript sdk and use the custom exporter option - https://github.com/Scale3-Labs/langtrace-python-sdk?tab=read... .

  23. sense-collector

    Sense Collector provides a way of collecting real-time data from the Sense Energy Monitor. Includes Grafana dashboards for visualizations of detected devices and smart plugs and their wattage, voltage, and amp utilization.

  24. monocle

    Monocle is a framework for tracing GenAI app code. This repo contains implementation of Monocle for GenAI apps written in Python. (by monocle2ai)

    Project mention: AIM Weekly for 04Nov2024 | dev.to | 2024-11-04

    🌐 Composed Image Retrieval 📎 Intro to Multimodal LLama 3.2 🛠️ Multi Agent Concierge 💻 RAG with Langchain Granite, Milvus 🫶 Download content ✅ Transformer Replacement? 🤖 vLLM for runing models 🌐 Amphion 📝 Autogluon 🚙 Notebook LLama like Google's Notebook LLM 🫶 Monocle2ai for tracing GenAI app code LFA&D Project 🤖 Bee Agent Framework ✅ LLama RFP Response ▶️ GenAI Script 👽 Simular AI Agent S 🦾 DrawDB with AI ✨ Ollama with LLama 3.2 Vision!!!! Preview 🚕 Powerful RAG Checker 📊 SQL Generator 💻 Role of LLMs 🐍 Document Extraction 🕶️ Open Source Vector DB Reddit 🍔 The Practical Guide to Self Hosting LLM 🦾 Stagehand Controller 🕶️ Understanding HNSWLIB 🐍 Best practices in RAG 💻 Enigma Agent 📝 Langchain, Ollama, Phi3 for Function Calling 🔋 Compass Judger 📝 Princeton NLP SimPO 🍔 Princeton NLP ProLong 🔋 Princeton NLP HELMET 🧐 Ollama Cheatsheet 🚕 Princeton NLP CopyCat 📊 Princeton NLP Shp 🕶️ Can LLM Solve Hard Github Issues 📝 Enabling Large Language Models to Generate Text with Citations 🔋 Princeton NLP CharXiv 📊 Awesome AI Agents List 🦾 Nomic’s Matryoshka text embedding model

  25. bakalog

    A command-line tool that detects, extracts log templates, and structuring logs to in-process database, leveraging template patterns generated by GPT-4.

  26. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Observability discussion

Log in or Post with

Python Observability related posts

Index

What are some of the best open-source Observability projects in Python? This list will help you:

# Project Stars
1 Prefect 19,241
2 openllmetry 5,782
3 logfire 3,099
4 robusta 2,754
5 tokencost 1,655
6 openlit 1,531
7 runhouse 1,031
8 holmesgpt 870
9 dd-trace-py 575
10 PlayBooks 436
11 monosi 322
12 graphsignal-python 203
13 whitebox 183
14 grafana-ansible-collection 179
15 observability-with-amazon-opensearch 83
16 swiple 82
17 radicalbit-ai-monitoring 81
18 hiq 73
19 grafana-observability-primer 40
20 langtrace-python-sdk 34
21 sense-collector 27
22 monocle 25
23 bakalog 21

Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com

Did you know that Python is
the 2nd most popular programming language
based on number of references?

Loading...