Top 5 Python model-monitoring Projects
-
evidently
Evaluate and monitor ML models from validation to production. Join our Discord: https://discord.com/invite/xZjKRaNp8b
Thank you for your answer. I'm trying it today and the the other libraries mentioned + https://github.com/evidentlyai/evidently
-
nannyml
Detecting silent model failure. NannyML estimates performance with an algorithm called Confidence-based Performance estimation (CBPE), developed by core contributors. It is the only open-source algorithm capable of fully capturing the impact of data drift on performance.
Project mention: [HIRING][Full Time, Part Time, Temporary, Internship, Freelance] Data Science Intern (Remote) | reddit.com/r/jobbit | 2022-05-20Description NannyML - creators of an Open Source Python library, are looking for multiple Data Science interns to help across research, prototyping, and product. Github: https://github.com/NannyML/nannyml About Us NannyML is an Open Source Python lib …
-
SonarQube
Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.
-
Project mention: [D] Maintaining documentation with live results from experiments | reddit.com/r/MachineLearning | 2022-05-29
In the case of neptune.ai we don't have this feature but you can query and retrieve the metadata you logged programmatically using the Python Client and use it to create a custom report/dashboard using tools like notion, streamlit, gradio, dash and etc. You also can have a cron-job that updates the report periodically or when there is a new experiment logged to Neptune.
-
Project mention: [P] InferenceDB - Makes it easy to store predictions of real-time ML models in S3 | reddit.com/r/MachineLearning | 2022-06-11
-
docker-compose
Python model-monitoring related posts
- [P] InferenceDB - Makes it easy to store predictions of real-time ML models in S3
- InferenceDB: Stream inferences of real-time ML models to S3 using Kafka
- InferenceDB: Stream inferences of real-time ML models in production to any data lake 🚀
- InferenceDB – Stream ML inferences to S3 or any data lake with CRDs
- InferenceDB – Stream predictions from KServe to S3 or any data lakes
- InferenceDB – Stream predictions of real-time ML models to data lakes
- InferenceDB – Stream predictions of real-time ML models to data lakes
Index
What are some of the best open-source model-monitoring projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | evidently | 2,587 |
| 2 | nannyml | 1,057 |
| 3 | neptune-client | 318 |
| 4 | inferencedb | 67 |
| 5 | reco-model-monitoring | 0 |
Are you hiring? Post a new remote job listing for free.
