Python Metrics

Open-source Python projects categorized as Metrics

Top 23 Python Metric Projects

  • supervision

    We write your reusable computer vision tools. 💜

    Project mention: Supervision: Reusable Computer Vision | news.ycombinator.com | 2024-03-24

    You can always slice the images into smaller ones, run detection on each tile, and combine results. Supervision has a utility for this - https://supervision.roboflow.com/latest/detection/tools/infe..., but it only works with detections. You can get a much more accurate result this way. Here is some side-by-side comparison: https://github.com/roboflow/supervision/releases/tag/0.14.0.

  • ignite

    High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently. (by pytorch)

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  • client_python

    Prometheus instrumentation library for Python applications

    Project mention: Show HN: Hatchet – Open-source distributed task queue | news.ycombinator.com | 2024-03-08

    Here you go: https://stackoverflow.com/questions/75652326/celery-spawn-si...

    Plus some adjacent discussion on GitHub: https://github.com/prometheus/client_python/issues/902

    Hope that helps!

  • CSrankings

    A web app for ranking computer science departments according to their research output in selective venues, and for finding active faculty across a wide range of areas.

    Project mention: 🏫 I need help choosing between Virginia Tech and George Mason for the CS program. | /r/csMajors | 2023-12-07

    If you look at csrankings.org, another site used to rank computer science programs, Virginia Tech is actually 51st and George Mason is 32st. While their methodology is also questionable if trying to determine the quality of an undergraduate program, it still demonstrates that ranking lists are not always fantastic at capturing how good an program is. Now, onto my own experiences.

  • krr

    Prometheus-based Kubernetes Resource Recommendations

    Project mention: What is the role of QoS for Pods? | /r/kubernetes | 2023-07-12

    Thanks buddy. I have seen a tool recently by robusta but not sure if helpful or not. Haven't tried it yet. https://github.com/robusta-dev/krr

  • uncertainty-toolbox

    Uncertainty Toolbox: a Python toolbox for predictive uncertainty quantification, calibration, metrics, and visualization

  • avalanche

    Avalanche: an End-to-End Library for Continual Learning based on PyTorch.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  • opentelemetry-python

    OpenTelemetry Python API and SDK

    Project mention: OpenTelemetry Journey #01 - Important concepts | dev.to | 2024-03-24

    Python

  • django-prometheus

    Export Django monitoring metrics for Prometheus.io

    Project mention: Question: Django Graphene / GQL Monitoring via Prometheus? | /r/graphene | 2023-08-17

    We have a Django Graphene app working, and are gather Prometheus telemetry to monitor our end points. We are leveraging the Django Prometheus Middle Ware and are able to get telemetry and view it via Grafana. This all works and is awesome.

  • py-motmetrics

    :bar_chart: Benchmark multiple object trackers (MOT) in Python

  • openllmetry

    Open-source observability for your LLM application, based on OpenTelemetry

    Project mention: Show HN: You don't need to adopt new tools for LLM observability | news.ycombinator.com | 2024-02-14

    So why should it be different when the app you're building happened to be using LLMs?

    So today we're open-sourcing OpenLLMetry-JS. It's an open protocol and SDK, based on OpenTelemetry, that provides traces and metrics for LLM JS/TS applications and can be connected to any of the 15+ tools that already support OpenTelemetry. Here's the repo: https://github.com/traceloop/openllmetry-js

    A few months ago we launched the python flavor here (https://news.ycombinator.com/item?id=37843907) and we've now built a compatible one for Node.js.

    Would love to hear your thoughts and opinions!

    Check it out -

    Docs: https://www.traceloop.com/docs/openllmetry/getting-started-t...

    Github:

  • metricflow

    MetricFlow allows you to define, build, and maintain metrics in code.

  • review_object_detection_metrics

    Object Detection Metrics. 14 object detection metrics: mean Average Precision (mAP), Average Recall (AR), Spatio-Temporal Tube Average Precision (STT-AP). This project supports different bounding box formats as in COCO, PASCAL, Imagenet, etc.

  • torch-fidelity

    High-fidelity performance metrics for generative models in PyTorch

  • prometheus-fastapi-instrumentator

    Instrument your FastAPI with Prometheus metrics.

    Project mention: Is Prometheus the right tool for my use case here? | /r/PrometheusMonitoring | 2023-09-19

    There's client libraries in most languages that make this possible and are reasonably straight forward. If you're using a particular framework it's quite possible there's a prometheus instrumentor for that framework, e.g fastapi has the prometheus-fastapi-instrumentor. There's also open source frameworks that can help you do this in a variety of languages, my personal favourite is autometrics.

  • chromium-dashboard

    Chrome Status Dashboard

  • prometheus_flask_exporter

    Prometheus exporter for Flask applications

  • image-similarity-measures

    :chart_with_upwards_trend: Implementation of eight evaluation metrics to access the similarity between two images. The eight metrics are as follows: RMSE, PSNR, SSIM, ISSM, FSIM, SRE, SAM, and UIQ.

    Project mention: Using VAE for image compression | /r/StableDiffusion | 2023-05-04

    Speaking of math, using this library -- https://github.com/up42/image-similarity-measures -- I computed the following for these images vs the original image:

  • docker-graphite-statsd

    Official Docker image for Graphite

  • query-exporter

    Export Prometheus metrics from SQL queries

  • long-form-factuality

    Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".

    Project mention: An Open Source Tool for Multimodal Fact Verification | news.ycombinator.com | 2024-04-06

    Isn't this similar to the Deepmind paper on long form factuality posted a few days ago?

    https://arxiv.org/abs/2403.18802

    https://github.com/google-deepmind/long-form-factuality/tree...

  • piqa

    PyTorch Image Quality Assessement package

  • celery-exporter

    A Prometheus exporter for Celery metrics

    Project mention: Celery-exporter: A Prometheus exporter for Celery metrics | news.ycombinator.com | 2023-08-27
  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-04-06.

Python Metrics related posts

Index

What are some of the best open-source Metric projects in Python? This list will help you:

Project Stars
1 supervision 13,740
2 ignite 4,448
3 client_python 3,755
4 CSrankings 2,578
5 krr 2,099
6 uncertainty-toolbox 1,711
7 avalanche 1,654
8 opentelemetry-python 1,586
9 django-prometheus 1,366
10 py-motmetrics 1,321
11 openllmetry 1,160
12 metricflow 1,064
13 review_object_detection_metrics 1,000
14 torch-fidelity 865
15 prometheus-fastapi-instrumentator 791
16 chromium-dashboard 623
17 prometheus_flask_exporter 620
18 image-similarity-measures 511
19 docker-graphite-statsd 460
20 query-exporter 409
21 long-form-factuality 394
22 piqa 374
23 celery-exporter 354
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com