Detic VS detectron2

Some of the foundation/base models include: * GroundedSAM (Segment Anything Model) * DETIC * GroundingDINO

For localisation at search time I ended up using OWL-ViT. This worked really well. I did not try Detic or CLIPseg but would be interested to hear if anyone else has tried these?

git clone https://github.com/facebookresearch/Detic cd Detic pip install -r requirements python demo.py --config-file configs/Detic_LCOCOI21k_CLIP_SwinB_896b32_4x_ft4x_max-size.yaml --input desk.jpg --output out.jpg --vocabulary lvis --opts MODEL.WEIGHTS models/Detic_LCOCOI21k_CLIP_SwinB_896b32_4x_ft4x_max-size.pth

You might want to take a look at DETIC : https://github.com/facebookresearch/Detic (Open Vocabulary Object Detection, trained on thousands of classes)

Are there any open-label segmentation model included in this repo, like Detic or LSeg?

We made this using pretty recent advances in web-data pretrained models like Detic and LSeg for detection, CLIP for visual queries, and Sentence BERT for semantic queries. Our "database" is really a neural field (Instant NGP) that maps from 3D coordinates to a high dimensional embedding vector in the same representation space as CLIP and SBERT.

Is it similar to the open vocabulary detic?

Code for https://arxiv.org/abs/2201.02605 found: https://github.com/facebookresearch/Detic

github: https://github.com/facebookresearch/Detic

I don’t do AI professionally but as a hobby, so this may not be the best way. But the way you described, it seems the user maybe taking the picture a bit further away and there may be other objects in the frame. So you may want to look into some sort of segmentation or have bounding box. This could help the user make sure they are looking at documents for the correct machine.

I think something like detectron2 [1] could help. It is Apache2 license, so commercial friendly. That said the pre-trained weights may not be used for commercial purposes, so you’ll want to check on that.

[1] https://github.com/facebookresearch/detectron2

And not enough true positives either. Add more augmentations in the config. Also make sure the config is set correctly, so that Detectron2 isn't skipping background images: https://github.com/facebookresearch/detectron2/issues/80

I followed the setup of https://github.com/facebookresearch/detectron2/tree/main/projects/TensorMask. But still I can not import it. As I can with from detectron2.projects import point_rend easily from PointRend projects

I have to use this config file with the dataloader which is in https://github.com/facebookresearch/detectron2/blob/main/projects/MViTv2/configs/common/coco_loader.py. I figured that i can use cfg.dataloader.train.dataset.names = "my_dataset_train" for this.

I want to use this config file https://github.com/facebookresearch/detectron2/blob/main/projects/MViTv2/configs/mask_rcnn_mvitv2_t_3x.py like the beneath typical way I use a yaml config file. But giving so many errors one after another that, I even failed to count at this point.

Which is built on https://github.com/facebookresearch/detectron2

Click to Learn more...

Detectron2 (GitHub: https://github.com/facebookresearch/detectron2) is a Facebook AI Research library with state-of-the-art object detection and segmentation algorithms in PyTorch.