Transformer-Explainability
tf-metal-experiments
Transformer-Explainability | tf-metal-experiments | |
---|---|---|
1 | 5 | |
1,664 | 259 | |
- | - | |
0.0 | 0.0 | |
3 months ago | about 2 years ago | |
Jupyter Notebook | Jupyter Notebook | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Transformer-Explainability
-
[Project] Recent Class Activation Map Methods for CNNs and Vision Transformers
Not exactly the same but since you mentioned using ViT's attention outputs as a 2D feature map for the CAM you can consider this paper (Transformer Interpretability Beyond Attention Visualization) where they study the question of how to choose/mix the attention scores in a way that can be visualized (so similar to the CAMs). Maybe it can lead to better results. https://arxiv.org/abs/2012.09838 https://github.com/hila-chefer/Transformer-Explainability
tf-metal-experiments
- Launch HN: Metal (YC W23) – Embeddings as a Service
-
M2 Pro or M2 Max for AI?
My take on Apple M series SOCs: I don’t think any of them can hold a candle to Nvidia GPUs. The M2 Pro is like 1/8th of a 3090 and the M2 Max is 1/5th. https://github.com/tlkh/tf-metal-experiments
- TensorFlow Metal Back End on Apple Silicon Experiments (Just for Fun)
- [N] AMD launches MI200 AI accelerators (2.5x Nvidia A100 FP32 performance)
-
[D] How does tensorflow perform on M1 Pro/Max?
Some initial tests going on here: https://github.com/tlkh/tf-metal-experiments
What are some alternatives?
pytorch-grad-cam - Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Image similarity and more.
MetalPetal - A GPU accelerated image and video processing framework built on Metal.
shap - A game theoretic approach to explain the output of any machine learning model.
HugsVision - HugsVision is a easy to use huggingface wrapper for state-of-the-art computer vision
T2T-ViT - ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet
adanet - Fast and flexible AutoML with learning guarantees.
multi-label-sentiment-classifier - How to build a multi-label sentiment classifiers with Tez and PyTorch
ML-Workspace - 🛠 All-in-one web-based IDE specialized for machine learning and data science.