Our great sponsors
-
seldon-core
An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
it should have a dashboard for test data quality monitoring - ideally with alarms from the great_expectations framework https://github.com/great-expectations/great_expectations
Seldon ticks most of those boxes if you already have some experience with kubernetes. You can set up a/b tests, do payload logging to elastic and then do monitoring on top of that, and it has drift detection and model explainer modules too. Idk about great expectations integration, but you could probably do something with a custom transformer module as part of the inference graph.