Python explainable-ai

Open-source Python projects categorized as explainable-ai

Top 20 Python explainable-ai Projects

  • MindsDB

    MindsDB connects AI models to databases.

    Project mention: AI-Powered Selection of Asset Management Companies using MindsDB and LlamaIndex | | 2023-09-18

    MindsDB is an AI Automation platform for building AI/ML powered features and applications. It works by connecting any data source with any AI/ML model or framework and automating how real-time data flows between them. MindsDB is integrated with LlamaIndex, which makes use of its data framework for connecting custom data sources to large language models. LlamaIndex data ingestion allows you to connect to data sources like PDF’s, webpages, etc., provides data indexing and a query interface that takes input prompts from your data and provides knowledge-augmented responses, thus making it easy to Q&A over documents and webpages.

  • pytorch-grad-cam

    Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Image similarity and more.

  • Onboard AI

    Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at

  • sahi

    Framework agnostic sliced/tiled inference + interactive ui + error analysis plots

    Project mention: Small-Object Detection using YOLOv8 | /r/computervision | 2023-08-15

    Hi All, I am trying to detect defects in the images using YOLOv8where some of the classes (defectType1, defectType2) have very small bounding boxes and some of them have large bounding boxes associated with the, (defectType3, defectType4). Also, real-time operation is desired (at least 5Hz on Jetson Xavier) What I have done till now: I am primarily trying to use the SAHI technique (Slicing Aided Hyper Inference)

  • AIX360

    Interpretability and explainability of data and machine learning models

    Project mention: [D] DL Practitioners, Do You Use Layer Visualization Tools s.a GradCam in Your Process? | /r/MachineLearning | 2022-10-28
  • giskard

    🐢 The testing framework for ML models, from tabular to LLMs

    Project mention: The testing framework dedicated to ML models, from tabular to LLMs | | 2023-06-22

    moDel Agnostic Language for Exploration and eXplanation

  • DiCE

    Generate Diverse Counterfactual Explanations for any machine learning model.

    Project mention: [D] Have researchers given up on traditional machine learning methods? | /r/MachineLearning | 2023-01-31

    - all domains requiring high interpretability absolutely ignore deep learning at all, and put all their research into traditional ML; see e.g. counterfactual examples, important interpretability methods in finance, or rule-based learning, important in medical or law applications

  • InfluxDB

    Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

  • vit-explain

    Explainability for Vision Transformers

    Project mention: [D] Off-the-shelf image saliency scoring models? | /r/MachineLearning | 2023-04-17
  • FastTreeSHAP

    Fast SHAP value computation for interpreting tree-based models

  • tf-keras-vis

    Neural network visualization toolkit for tf.keras


    CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithms (by carla-recourse)

  • explainable-cnn

    📦 PyTorch based visualization package for generating layer-wise explanations for CNNs.

  • shapley

    The official implementation of "The Shapley Value of Classifiers in Ensemble Games" (CIKM 2021).

  • inseq

    Interpretability for sequence generation models 🐛 🔍

    Project mention: [R] [P] Inseq: An Interpretability Toolkit for Sequence Generation Models | /r/MachineLearning | 2023-03-02

    Found relevant code at + all code implementations here

  • sagemaker-explaining-credit-decisions

    Amazon SageMaker Solution for explaining credit decisions.

  • neuro-symbolic-sudoku-solver

    ⚙️ Solving sudoku using Deep Reinforcement learning in combination with powerful symbolic representations.

  • TorchPRISM

    Principal Image Sections Mapping. Convolutional Neural Network Visualisation and Explanation Framework

    Project mention: TorchPRISM: Convolutional Neural Network Visualisation and Explanation Framework | /r/deeplearning | 2022-12-04
  • sdk-python

    Python library for Modzy Machine Learning Operations (MLOps) Platform (by modzy)

  • XAI

    Genetic programming method for explaining complex black-box models

  • xi-method

    Xi method

    Project mention: [P] I created a package implementing a SOTA technique for XAI ( Explainable AI) | /r/MachineLearning | 2023-09-03
  • Sonar

    Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-09-18.

Python explainable-ai related posts


What are some of the best open-source explainable-ai projects in Python? This list will help you:

Project Stars
1 MindsDB 17,980
2 pytorch-grad-cam 8,151
3 sahi 3,065
4 AIX360 1,402
5 giskard 1,243
6 DALEX 1,243
7 DiCE 1,154
8 vit-explain 590
9 FastTreeSHAP 465
10 tf-keras-vis 286
11 CARLA 255
12 explainable-cnn 204
13 shapley 202
14 inseq 202
15 sagemaker-explaining-credit-decisions 94
16 neuro-symbolic-sudoku-solver 64
17 TorchPRISM 45
18 sdk-python 23
19 XAI 16
20 xi-method 5
Free Global Payroll designed for tech teams
Building a great tech team takes more than a paycheck. Zero payroll costs, get AI-driven insights to retain best talent, and delight them with amazing local benefits. 100% free and compliant.