responsible-ai-toolbox
Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions. (by microsoft)
CARLA
CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithms (by carla-recourse)
Our great sponsors
responsible-ai-toolbox | CARLA | |
---|---|---|
2 | 2 | |
1,208 | 263 | |
6.1% | 0.4% | |
9.6 | 0.0 | |
11 days ago | 7 months ago | |
TypeScript | Python | |
MIT License | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
responsible-ai-toolbox
Posts with mentions or reviews of responsible-ai-toolbox.
We have used some of these posts to build our list of alternatives
and similar projects.
-
Debugging Machine Learning "[N]"
http://erroranalysis.ai/ is a new open-source tool for in-depth understanding and diagnosis of Machine Learning Errors. The tool is available as a highly interactive jupyter widget and brings in several visualization primitives all centered around debugging activities in ML (main repo: https://github.com/microsoft/responsible-ai-widgets).
-
[N] Visualize Your Model Errors! Microsoft Toolkit Identifies and Diagnoses ML Failures
The toolkit is on the project GitHub. Additional information is available on the Error Analysis website.
CARLA
Posts with mentions or reviews of CARLA.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2021-09-29.
-
[R] CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithms
Abstract: Counterfactual explanations provide means for prescriptive model explanations by suggesting actionable feature changes (e.g., increase income) that allow individuals to achieve favourable outcomes in the future (e.g., insurance approval). Choosing an appropriate method is a crucial aspect for meaningful counterfactual explanations. As documented in recent reviews, there exists a quickly growing literature with available methods. Yet, in the absence of widely available open–source implementations, the decision in favour of certain models is primarily based on what is readily available. Going forward – to guarantee meaningful comparisons across explanation methods – we present CARLA (Counterfactual And Recourse Library), a python library for benchmarking counterfactual explanation methods across both different data sets and different machine learning models. In summary, our work provides the following contributions: (i) an extensive benchmark of 11 popular counterfactual explanation methods, (ii) a benchmarking framework for research on future counterfactual explanation methods, and (iii) a standardized set of integrated evaluation measures and data sets for transparent and extensive comparisons of these methods. We have open sourced CARLA and our experimental results on GitHub, making them available as competitive baselines. We welcome contributions from other research groups and practitioners.
-
University of Tübingen Researchers Open-Source ‘CARLA’, A Python Library for Benchmarking Counterfactual Explanation Methods Across Data Sets and Machine Learning Models
4 Min Read| Paper | Github
What are some alternatives?
When comparing responsible-ai-toolbox and CARLA you can also consider the following projects:
DALEX - moDel Agnostic Language for Exploration and eXplanation
carla - Open-source simulator for autonomous driving research.