shapash
CARLA
Our great sponsors
shapash | CARLA | |
---|---|---|
8 | 2 | |
2,642 | 263 | |
1.3% | 0.4% | |
8.6 | 0.0 | |
about 1 month ago | 7 months ago | |
Jupyter Notebook | Python | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
shapash
- GitHub - MAIF/shapash: Shapash: User-friendly Explainability and Interpretability to Develop Reliable and Transparent Machine Learning Models
- [D] DL Practitioners, Do You Use Layer Visualization Tools s.a GradCam in Your Process?
-
This A.I.-generated artwork, Théâtre D'opéra Spatial, won first place at an art competition, and the art community isn't happy about it
There's work being done in that regard (like this python module), but as far as I know it's very clearly statistical guesstimates, and though it "works", the mathematical foundations are still somewhat shaky. There are heuristics in there we can't get rid of for now. But it's still better than nothing. Waaaaaay better than nothing.
-
Hacker News top posts: Jun 14, 2022
Shapash – Python library to make machine learning interpretable\ (4 comments)
- Shapash – Python library to make machine learning interpretable
-
State of the Art data drift libraries on Python?
Try out eurybia, from the author of shapash which is a brilliant library as well.
-
[P] It Is Now Possible To Generate a Model Audit Report with Shapash
With the new version of Shapash that is now available, you can document each model you release into production. Within a few lines of code, you can include in an HTML report all the information about your model (and its associated performance), the data it uses, its learning strategy, … this report is designed to be easily shared with a Data Protection Officer, an internal audit department, a risk control department, a compliance department, or anyone who wants to understand his work.
- [D] Has anyone ever used the SHAP and LIME models in machine learning?
CARLA
-
[R] CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithms
Abstract: Counterfactual explanations provide means for prescriptive model explanations by suggesting actionable feature changes (e.g., increase income) that allow individuals to achieve favourable outcomes in the future (e.g., insurance approval). Choosing an appropriate method is a crucial aspect for meaningful counterfactual explanations. As documented in recent reviews, there exists a quickly growing literature with available methods. Yet, in the absence of widely available open–source implementations, the decision in favour of certain models is primarily based on what is readily available. Going forward – to guarantee meaningful comparisons across explanation methods – we present CARLA (Counterfactual And Recourse Library), a python library for benchmarking counterfactual explanation methods across both different data sets and different machine learning models. In summary, our work provides the following contributions: (i) an extensive benchmark of 11 popular counterfactual explanation methods, (ii) a benchmarking framework for research on future counterfactual explanation methods, and (iii) a standardized set of integrated evaluation measures and data sets for transparent and extensive comparisons of these methods. We have open sourced CARLA and our experimental results on GitHub, making them available as competitive baselines. We welcome contributions from other research groups and practitioners.
-
University of Tübingen Researchers Open-Source ‘CARLA’, A Python Library for Benchmarking Counterfactual Explanation Methods Across Data Sets and Machine Learning Models
4 Min Read| Paper | Github
What are some alternatives?
shap - A game theoretic approach to explain the output of any machine learning model.
carla - Open-source simulator for autonomous driving research.
interpret - Fit interpretable models. Explain blackbox machine learning.
rliable - [NeurIPS'21 Outstanding Paper] Library for reliable evaluation on RL and ML benchmarks, even with only a handful of seeds.
LIME - Tutorial notebooks on explainable Machine Learning with LIME (Original work: https://arxiv.org/abs/1602.04938)
alibi - Algorithms for explaining machine learning models
GlassCode - This plugin allows you to make JetBrains IDEs to be fully transparent while keeping the code sharp and bright.
pytorch-lightning - Build high-performance AI models with PyTorch Lightning (organized PyTorch). Deploy models with Lightning Apps (organized Python to build end-to-end ML systems). [Moved to: https://github.com/Lightning-AI/lightning]
trulens - Evaluation and Tracking for LLM Experiments
DiCE - Generate Diverse Counterfactual Explanations for any machine learning model.
eurybia - âš“ Eurybia monitors model drift over time and securizes model deployment with data validation
sagemaker-explaining-credit-decisions - Amazon SageMaker Solution for explaining credit decisions.