Our great sponsors
-
pytorch-grad-cam
Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Image similarity and more.
-
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
For the two examples we will be looking at, we will be using pytorch_grad_cam, an incredible open source package that makes working with GradCam very easy. There are excellent other tutorials to check out on the repo as well.
We can now apply the transform and try ourselves with a vision transformer. We will use DeiT from the FiftyOne model zoo. It can be loaded with a pre and postprocessor like the following:
Related posts
- Which layers are doing image segmentation on AutoEncoders/U-NET?
- [D] Algorithm for view prediction?
- [P] Adapting Class Activation Maps for Object Detection and Semantic Segmentation
- [R] VISION DIFFMASK: Faithful Interpretation of Vision Transformers with Differentiable Patch Masking
- [Project] Recent Class Activation Map Methods for CNNs and Vision Transformers