InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now. Learn more →
Top 23 Python Metric Projects
-
-
InfluxDB
InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
-
Traceloop is also an open-source project that provides end-to-end tracing for LLM applications. It uses OpenTelemetry standards to offer visibility into the request flow through code, especially in agent-based and multi-step workflows. Traceloop focuses exclusively on tracing and requires an existing OpenTelemetry setup to unlock its full potential.
-
ignite
High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently. (by pytorch)
-
-
The installation is pretty straight-forward. You can install the binary directly from their releases. To install the CLI, depending upon your operating system, you can install the KRR cli and use it for optimising the resources. You can use brew for installing on mac:
-
Project mention: Pydantic Logfire Switches from Timescale to Datafusion | news.ycombinator.com | 2024-08-29
-
CSrankings
A web app for ranking computer science departments according to their research output in selective venues, and for finding active faculty across a wide range of areas.
Project mention: Reversing the Fossilization of Computer Science Conferences | news.ycombinator.com | 2025-04-28A big part of the problem here is that Universities have increasingly begun attaching prestige to specific “top” conference publications for both ranking and faculty promotions. A good example of the phenomenon can be seen in [1] (sorry for the noun-citation!) which only gives credit for approximately three conferences in each field. Combine this with a flood of new researchers entering the field, you have a recipe for “top” conferences getting flooded
Fortunately every field has a fourth or fifth-tier conference that isn’t on this list (or a specialized topic conference that the rankings folks don’t care about), and those still serve the purposes that conferences were made for. You just might not be able to convince a ranking-obsessed administrator that your work has any value if you publish there.
[1] https://csrankings.org/
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
-
uncertainty-toolbox
Uncertainty Toolbox: a Python toolbox for predictive uncertainty quantification, calibration, metrics, and visualization
-
-
-
openlit
Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with 50+ LLM Providers, VectorDBs, Agent Frameworks and GPUs.
OpenLIT is an OpenTelemetry-native observability tool built for AI Engineering and LLM applications. It focuses on easy, vendor-neutral instrumentation for LLMs, vector databases, and other AI stack components. OpenLIT is ideal for teams already heavily invested in OpenTelemetry and GPU monitoring but offers fewer features for LLM prompt evaluation and experimentation.
-
-
-
-
review_object_detection_metrics
Object Detection Metrics. 14 object detection metrics: mean Average Precision (mAP), Average Recall (AR), Spatio-Temporal Tube Average Precision (STT-AP). This project supports different bounding box formats as in COCO, PASCAL, Imagenet, etc.
-
-
-
-
image-similarity-measures
:chart_with_upwards_trend: Implementation of eight evaluation metrics to access the similarity between two images. The eight metrics are as follows: RMSE, PSNR, SSIM, ISSM, FSIM, SRE, SAM, and UIQ.
-
long-form-factuality
Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".
-
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Python Metrics discussion
Python Metrics related posts
-
Reversing the Fossilization of Computer Science Conferences
-
Northeastern's redesign of the Khoury curriculum abandons the fundamentals of CS
-
Understanding the MLOps Lifecycle
-
How to Do DORA Metrics Right
-
LangGraph Engineer
-
SDMetrics: Library for evaluating synthetic data quality
-
🦊 GitLab: A Python Script Calculating DORA Metrics
-
A note from our sponsor - InfluxDB
www.influxdata.com | 16 May 2025
Index
What are some of the best open-source Metric projects in Python? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | supervision | 26,605 |
| 2 | openllmetry | 5,813 |
| 3 | ignite | 4,657 |
| 4 | client_python | 4,136 |
| 5 | krr | 3,705 |
| 6 | logfire | 3,099 |
| 7 | CSrankings | 2,857 |
| 8 | opentelemetry-python | 2,003 |
| 9 | uncertainty-toolbox | 1,890 |
| 10 | avalanche | 1,886 |
| 11 | django-prometheus | 1,549 |
| 12 | openlit | 1,531 |
| 13 | py-motmetrics | 1,435 |
| 14 | metricflow | 1,211 |
| 15 | prometheus-fastapi-instrumentator | 1,126 |
| 16 | review_object_detection_metrics | 1,097 |
| 17 | torch-fidelity | 1,068 |
| 18 | chromium-dashboard | 671 |
| 19 | prometheus_flask_exporter | 667 |
| 20 | image-similarity-measures | 615 |
| 21 | long-form-factuality | 607 |
| 22 | docker-graphite-statsd | 488 |
| 23 | query-exporter | 482 |
Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com