Top 8 data-drift Open-Source Projects

evidently

10 4,591 9.5 Jupyter Notebook

Evaluate and monitor ML models from validation to production. Join our Discord: https://discord.com/invite/xZjKRaNp8b

Project mention: [P] Free open-source ML observability course: starts October 16 🚀 | /r/MachineLearning | 2023-10-15

Hi everyone, I’m one of the creators of Evidently, an open-source (Apache 2.0) tool for production ML monitoring. We’ve just launched a free open course on ML observability that I wanted to share with the community.
deepchecks

15 3,323 8.6 Python

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.

Project mention: Detect, Defend, Prevail: Payments Fraud Detection using ML & Deepchecks | dev.to | 2024-01-13

Also if you have any confusion related to it. You can directly go to their discussion section in github :
InfluxDB

www.influxdata.com
sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
alibi-detect

9 2,074 7.6 Python

Algorithms for outlier, adversarial and drift detection

Project mention: Exploring Open-Source Alternatives to Landing AI for Robust MLOps | dev.to | 2023-12-13

Numerous tools exist for detecting anomalies in time series data, but Alibi Detect stood out to me, particularly for its capabilities and its compatibility with both TensorFlow and PyTorch backends.
nannyml

7 1,746 8.8 Python

nannyml: post-deployment data science in python

Project mention: Introduction to NannyML: Model Evaluation without labels | dev.to | 2023-12-15

In order to try to solve this issue, NannyML was created. NannyML is an open-source Python library designed in order to make it easy to monitor drift in the distributions of our model input variables and estimate our model performance (even without labels!) thanks to the Confidence-Based Performance Estimation algorithm they developed. But first of all, why do models need to be monitored and why their performance might vary over time?
awesome-open-data-centric-ai

1 674 5.8

Curated list of open source tooling for data-centric AI on unstructured data.
eurybia

3 201 5.2 Jupyter Notebook

⚓ Eurybia monitors model drift over time and securizes model deployment with data validation
frouros

5 158 9.4 Python

Frouros: an open-source Python library for drift detection in machine learning systems.

Project mention: Frouros: An open-source Python library for drift detection in machine learning | news.ycombinator.com | 2024-04-06
WorkOS

workos.com
sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
cyclops

3 65 9.3 Python

Toolkit for health AI implementation (by VectorInstitute)

Project mention: Call for open source devs to build the future of healthcare! | /r/github | 2023-06-30

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-04-06.