Top 17 Python Interpretability Projects

• pytorch-grad-cam

  5 9,410 5.4 Python

  Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Image similarity and more.

Project mention: Exploring GradCam and More with FiftyOne | dev.to | 2024-02-13

For the two examples we will be looking at, we will be using pytorch_grad_cam, an incredible open source package that makes working with GradCam very easy. There are excellent other tutorials to check out on the repo as well.

• captum

  11 4,568 8.6 Python

  Model interpretability and understanding for PyTorch

  

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• alibi

  4 2,288 7.7 Python

  Algorithms for explaining machine learning models

  

Project mention: Alibi: Open-source Python lib for ML model inspection and interpretation | news.ycombinator.com | 2023-06-02

• DALEX

  2 1,318 5.5 Python

  moDel Agnostic Language for Exploration and eXplanation

  

• tf-explain

  1 1,007 0.0 Python

  Interpretability Methods for tf.keras models with Tensorflow 2.x

  

• decision-forests

  1 650 8.3 Python

  A collection of state-of-the-art algorithms for the training, serving and interpretation of Decision Forest models in Keras.

  

• xplique

  1 569 8.4 Python

  👋 Xplique is a Neural Networks Explainability Toolbox

  

Project mention: Xplique Is a Neural Networks Explainability Toolbox | news.ycombinator.com | 2024-02-02

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• pyreft

  1 562 9.5 Python

  ReFT: Representation Finetuning for Language Models

  

Project mention: LoReFT and pyreft for surgical fine-tuning | dev.to | 2024-04-07

https://arxiv.org/abs/2404.03592 https://github.com/stanfordnlp/pyreft

• FastTreeSHAP

  7 492 4.4 Python

  Fast SHAP value computation for interpreting tree-based models

  

• pyvene

  1 455 9.6 Python

  Stanford NLP Python Library for Understanding and Improving PyTorch Models via Interventions

  

Project mention: FLaNK AI Weekly 18 March 2024 | dev.to | 2024-03-18

• inseq

  4 295 8.5 Python

  Interpretability for sequence generation models 🐛 🔍

  

• ferret

  2 203 8.6 Python

  A python package for benchmarking interpretability techniques on Transformers. (by g8a9)

• WarpedGANSpace

  6 107 1.6 Python

  [ICCV 2021] Authors official PyTorch implementation of the "WarpedGANSpace: Finding non-linear RBF paths in GAN latent space".

• TalkToModel

  1 102 2.9 Python

  TalkToModel gives anyone with the powers of XAI through natural language conversations 💬!

• autoprognosis

  2 87 5.0 Python

  A system for automating the design of predictive modeling pipelines tailored for clinical prognosis.

  

• penzai

  3 1,334 5.4 Python

  A JAX research toolkit for building, editing, and visualizing neural networks.

  

Project mention: FLaNK AI-April 22, 2024 | dev.to | 2024-04-22

• EPU-CNN

  1 5 7.3 Python

  Official Implementation of "E pluribus unum interpretable convolutional neural networks"

  

Project mention: EPU-CNN: Introducing Generalized Additive Models in CNNs for Interpretable Image Classification | /r/computervision | 2023-12-05

The code is also made available on Github here along with all the datasets used in the original research. Your feedback and contributions are highly welcome!

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Python Interpretability related posts

• penzai: JAX research toolkit for building, editing, and visualizing neural nets
  4 projects | news.ycombinator.com | 21 Apr 2024
• Exploring GradCam and More with FiftyOne
  2 projects | dev.to | 13 Feb 2024
• Alibi: Open-source Python lib for ML model inspection and interpretation
  1 project | news.ycombinator.com | 2 Jun 2023
• [D] [R] Research Problem about Weakly Supervised Learning for CT Image Semantic Segmentation
  1 project | /r/MachineLearning | 24 Apr 2023
• [R] Introducing ferret, a new Python package to streamline interpretability on Transformers
  1 project | /r/MachineLearning | 19 Apr 2023
• [D] Off-the-shelf image saliency scoring models?
  2 projects | /r/MachineLearning | 17 Apr 2023
• [R] [P] Inseq: An Interpretability Toolkit for Sequence Generation Models
  1 project | /r/MachineLearning | 2 Mar 2023
• A note from our sponsor - WorkOS
  workos.com | 27 Apr 2024

  The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Python projects with our weekly report!