Top 23 Python Metric Projects

• supervision

  15 13,984 9.9 Python

  We write your reusable computer vision tools. 💜

  

Project mention: Supervision: Reusable Computer Vision | news.ycombinator.com | 2024-03-24

You can always slice the images into smaller ones, run detection on each tile, and combine results. Supervision has a utility for this - https://supervision.roboflow.com/latest/detection/tools/infe..., but it only works with detections. You can get a much more accurate result this way. Here is some side-by-side comparison: https://github.com/roboflow/supervision/releases/tag/0.14.0.

• ignite

  3 4,455 8.7 Python

  High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently. (by pytorch)

  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• client_python

  15 3,771 7.3 Python

  Prometheus instrumentation library for Python applications

  

Project mention: Show HN: Hatchet – Open-source distributed task queue | news.ycombinator.com | 2024-03-08

Here you go: https://stackoverflow.com/questions/75652326/celery-spawn-si...

Plus some adjacent discussion on GitHub: https://github.com/prometheus/client_python/issues/902

Hope that helps!

• CSrankings

  121 2,586 9.7 Python

  A web app for ranking computer science departments according to their research output in selective venues, and for finding active faculty across a wide range of areas.

Project mention: 🏫 I need help choosing between Virginia Tech and George Mason for the CS program. | /r/csMajors | 2023-12-07

If you look at csrankings.org, another site used to rank computer science programs, Virginia Tech is actually 51st and George Mason is 32st. While their methodology is also questionable if trying to determine the quality of an undergraduate program, it still demonstrates that ranking lists are not always fantastic at capturing how good an program is. Now, onto my own experiences.

• krr

  5 2,169 9.3 Python

  Prometheus-based Kubernetes Resource Recommendations

  

Project mention: What is the role of QoS for Pods? | /r/kubernetes | 2023-07-12

Thanks buddy. I have seen a tool recently by robusta but not sure if helpful or not. Haven't tried it yet. https://github.com/robusta-dev/krr

• uncertainty-toolbox

  1 1,711 10.0 Python

  Uncertainty Toolbox: a Python toolbox for predictive uncertainty quantification, calibration, metrics, and visualization

  

• avalanche

  1 1,660 9.5 Python

  Avalanche: an End-to-End Library for Continual Learning based on PyTorch.

  

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• opentelemetry-python

  6 1,593 9.2 Python

  OpenTelemetry Python API and SDK

  

Project mention: OpenTelemetry Journey #01 - Important concepts | dev.to | 2024-03-24

Python

• django-prometheus

  5 1,370 7.0 Python

  Export Django monitoring metrics for Prometheus.io

Project mention: Question: Django Graphene / GQL Monitoring via Prometheus? | /r/graphene | 2023-08-17

We have a Django Graphene app working, and are gather Prometheus telemetry to monitor our end points. We are leveraging the Django Prometheus Middle Ware and are able to get telemetry and view it via Grafana. This all works and is awesome.

• py-motmetrics

  1 1,322 4.9 Python

  :bar_chart: Benchmark multiple object trackers (MOT) in Python

• openllmetry

  1 1,224 9.8 Python

  Open-source observability for your LLM application, based on OpenTelemetry

  

Project mention: Show HN: You don't need to adopt new tools for LLM observability | news.ycombinator.com | 2024-02-14

So why should it be different when the app you're building happened to be using LLMs?

So today we're open-sourcing OpenLLMetry-JS. It's an open protocol and SDK, based on OpenTelemetry, that provides traces and metrics for LLM JS/TS applications and can be connected to any of the 15+ tools that already support OpenTelemetry. Here's the repo: https://github.com/traceloop/openllmetry-js

A few months ago we launched the python flavor here (https://news.ycombinator.com/item?id=37843907) and we've now built a compatible one for Node.js.

Would love to hear your thoughts and opinions!

Check it out -

Docs: https://www.traceloop.com/docs/openllmetry/getting-started-t...

Github:

• metricflow

  4 1,073 9.8 Python

  MetricFlow allows you to define, build, and maintain metrics in code.

  

• review_object_detection_metrics

  2 1,004 0.0 Python

  Object Detection Metrics. 14 object detection metrics: mean Average Precision (mAP), Average Recall (AR), Spatio-Temporal Tube Average Precision (STT-AP). This project supports different bounding box formats as in COCO, PASCAL, Imagenet, etc.

• torch-fidelity

  3 870 8.1 Python

  High-fidelity performance metrics for generative models in PyTorch

• prometheus-fastapi-instrumentator

  1 806 7.0 Python

  Instrument your FastAPI with Prometheus metrics.

Project mention: Is Prometheus the right tool for my use case here? | /r/PrometheusMonitoring | 2023-09-19

There's client libraries in most languages that make this possible and are reasonably straight forward. If you're using a particular framework it's quite possible there's a prometheus instrumentor for that framework, e.g fastapi has the prometheus-fastapi-instrumentor. There's also open source frameworks that can help you do this in a variety of languages, my personal favourite is autometrics.

• chromium-dashboard

  1 625 9.7 Python

  Chrome Status Dashboard

  

• prometheus_flask_exporter

  2 622 5.1 Python

  Prometheus exporter for Flask applications

• image-similarity-measures

  3 515 4.4 Python

  :chart_with_upwards_trend: Implementation of eight evaluation metrics to access the similarity between two images. The eight metrics are as follows: RMSE, PSNR, SSIM, ISSM, FSIM, SRE, SAM, and UIQ.

  

Project mention: Using VAE for image compression | /r/StableDiffusion | 2023-05-04

Speaking of math, using this library -- https://github.com/up42/image-similarity-measures -- I computed the following for these images vs the original image:

• docker-graphite-statsd

  1 463 4.2 Python

  Official Docker image for Graphite

  

• long-form-factuality

  2 435 5.9 Python

  Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".

  

Project mention: An Open Source Tool for Multimodal Fact Verification | news.ycombinator.com | 2024-04-06

Isn't this similar to the Deepmind paper on long form factuality posted a few days ago?

https://arxiv.org/abs/2403.18802

https://github.com/google-deepmind/long-form-factuality/tree...

• query-exporter

  1 409 7.7 Python

  Export Prometheus metrics from SQL queries

• piqa

  4 378 5.7 Python

  PyTorch Image Quality Assessement package

• celery-exporter

  12 355 7.4 Python

  A Prometheus exporter for Celery metrics

Project mention: Celery-exporter: A Prometheus exporter for Celery metrics | news.ycombinator.com | 2023-08-27

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Python Metrics related posts

• SDMetrics: Library for evaluating synthetic data quality
  1 project | news.ycombinator.com | 12 Apr 2024
• 🦊 GitLab: A Python Script Calculating DORA Metrics
  1 project | dev.to | 5 Apr 2024
• 4 facets of API monitoring you should implement
  3 projects | dev.to | 2 Mar 2024
• Open source anomaly detection for metrics
  1 project | news.ycombinator.com | 18 Dec 2023
• Good metrics exporter (current)?
  2 projects | /r/Starlink | 9 Dec 2023
• 🏫 I need help choosing between Virginia Tech and George Mason for the CS program.
  1 project | /r/csMajors | 7 Dec 2023
• Quant Research of the Week (5th Edition)
  6 projects | /r/quant | 7 Dec 2023
• A note from our sponsor - InfluxDB
  www.influxdata.com | 25 Apr 2024

  Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Python projects with our weekly report!