Swin-Transformer-Object-Detection VS Mask_RCNN

I'm currently trying to transfer learn a set of custom classes of fish, for instance segmentation. I have found the official implementation of Swin Transformer as a backbone for instance segmentation using MRCNN: https://github.com/SwinTransformer/Swin-Transformer-Object-Detection.

Hi, So my project is to do with object detection on trash in the wild on this fairly obscure dataset: http://tacodataset.org/ and I was thinking of applying vision transformers to it for feature extraction. I was thinking of taking the YOLOX implementation and swapping out the backbone with swin transformers and perform bunch of comparisons/experiments for the write up. Sort of like how they applied swin transformers to mask R-CNN here but I am struggling to understand where to begin.

Yes, have a look at this paper.

Object detection on COCO: https://github.com/SwinTransformer/Swin-Transformer-Object-Detection

The most widely used algorithms for classical feature detection today are "whatever opencv implements"

In terms of tech that's advancing at the moment? https://co-tracker.github.io/ if you want to track individual points, https://github.com/matterport/Mask_RCNN and its descendents if you want to detect, say, the cover of a book.

Mask R-CNN

Click to Learn more...

- Mask RCNN https://github.com/matterport/Mask_RCNN (open source, so also not Palantir's)

pip install git+https://github.com/matterport/Mask_RCNN

It is important to realize that to do its masking procedures, Hent-AI uses the Mask RCNN (MRCNN) package from Matterport. The problem with this version of MRCNN is that it is not compatible with Tensorflow 2.X versions, essentially limiting Hent-AI compatibility to strict Tensorflow 1.X versions. Since Tensorflow 1.15 is the last of the Tensorflow 1.X versions and uses CUDA 10.0, which supports a maximum compute capability of 7.5, this means that the last NVIDIA GPU series that is compatible with the original Hent-AI implementation is the RTX 2000 series. This is, of course, not optimal since it means that RTX 3000 series and later GPUs cannot be used despite their significant computing power and high VRAM.

I read that it could bethe problem with scipy version (https://github.com/matterport/Mask_RCNN/issues/2122) so I downgraded it, I also tried to modify shift = np.array([0, 0, 1., 1.]) in utils.py but nothing helped.

I am assuming you did a pip install of this github repository, or did you run pip install mrcnn. The mrcnn package on pypi is just an example package and doesn't have any useful functionality. In addition, where did you get the code from that you are trying to run, from someone else or did you write it yourself? Reason I am asking is because the import error is to be expected since there indeed is no InferenceConfig class defined in mrcnn.visualize.

Hello AI learners, check out my own development of Mask-RCNN supporting Tensorflow2.7.0 and Keras2.8.0. This is an edit of MRCNN which supports Tensoflow1.0, only.