mmpose
mmdetection
Our great sponsors
mmpose | mmdetection | |
---|---|---|
31 | 23 | |
5,002 | 27,833 | |
4.8% | 2.3% | |
8.0 | 8.4 | |
4 days ago | 3 days ago | |
Python | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
mmpose
-
RTMPose: The All-In-One Real-time Pose Estimation Solution for R&D
RTMPose-m achieves 75.8% AP on COCO with 90+ FPS on an Intel i7-11700 CPU and 430+ FPS on an NVIDIA GTX 1660 Ti GPU, and RTMPose-l achieves 67.0% AP on COCO-WholeBody with 130+ FPS.
-
MMDeploy: Deploy All the Algorithms of OpenMMLab
MMPose: OpenMMLab pose estimation toolbox and benchmark.
-
Model conversion from Pytorch to Tf using Onnx.
I downloaded pytorch2onnx.py from mmPose tools. It's big, but the top half is imports and input arguments. Line 125, I hard-coded my (image) input size. I ran it on my .pth model file, and out pop'd an onnx file.
-
Finetuning Openpose for custom dataset
They have a specific repo called mmpose: https://github.com/open-mmlab/mmpose
-
State of the art 2D body pose estimation [Discussion]
I would start with mmpose. It's basically a curated list of the best models ready to go.
-
[P] Object detection framework : Detectron2 VS MMDetection
The [MMLab key point detection](https://github.com/open-mmlab/mmpose) is in a separate repo from detection.
-
[D] Searching for open source pose estimation solution similar to open pose ?
One option is mmPose. They have a bunch of 2D/3D models implemented and support different skeleton structures.
-
Human Pose Estimation Recommendation
This library is pretty good. It has implementations for a number of pose estimators. I think Darkpose is the best one from memory
-
Human pose classification problem.
Check out https://github.com/open-mmlab/mmpose I think they have guides for new datasets
mmdetection
-
Semantic segementation
When I look for benchmarks I always start here https://paperswithcode.com/task/instance-segmentation/codeless it has the lists of datasets to measure models accross lots o papers. Many are very specific models with low support or community but it gives you a good idea of ββthe state of the art. It also lists repositories related to good community. https://github.com/open-mmlab/mmdetection seems very active and the one that is being used the most, you could use the models that it has integrated in its model zoo, within the same repository. It has the benchmarks to compare those same models and some of them are from 2022
-
How to Convert Model Mask into Polygon and save JSON?
MODEL: https://github.com/open-mmlab/mmdetection
-
Object Detection Model for Custom Dataset Training?
Would it make sense to work with OpenMMLab (https://github.com/open-mmlab/mmdetection) or Pytorch-image-models (https://github.com/rwightman/pytorch-image-models#models) since they offer a variety of models?
-
[P] Image search with localization and open-vocabulary reranking.
I wanted to have a few choices getting localization into image search (index and search time). I immediately thought of using a region proposal network (rpn) from mask-rcnn to create patches that can also be indexed and searched (and add the localisation). I figured it might be somewhat agnostic to classes. I did not want to use mmdetection or detectron2 due to their dependencies and just getting the rpn was not worth it. I was encouraged by the PyTorch native implementations of detection/segmentation models but ended up finding yolox the best.
-
MMDeploy: Deploy All the Algorithms of OpenMMLab
MMDetection: OpenMMLab detection toolbox and benchmark.
-
Removing the bounding box generated by OnnxRuntime segmentation
I have a semantic segmentation model trained using the mmdetection repo. Then it is converted to the ONNX format using the mmdeploy repo.
-
Keras vs Tensorflow vs Pytorch for a Final year Project
E.g. If you consider it an object detection problem it is: detect and localise all the pedestrians in a frame, and classify them by their (intended) action. IMO the easiest way to do this would be with mmdetection, which is built on top of pytorch. Just label your dataset, build a config, and boom you have a model. Inference with that model in only a few lines of code, you won't really need to learn too much to get started.
-
DeepSort with PyTorch(support yolo series)
MMDetection
-
[D] Pre-trained networks and batch normalization
For example, in mmdetection, they expose options in their config & implementation to freeze batch norm layers in backbones and in this config, norm_eval is set to True meaning to freeze tracking of batch norm stats, while the ResNet backbone is frozen up to the 1st stage. Example of their backbone implementation can be found here.
-
Config files in plain Python
MMDetection uses config Python scripting. It's easier to define nn.Module objects other than writing class name in a json config file
What are some alternatives?
openpose - OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation
detectron2 - Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.
openpifpaf - Official implementation of "OpenPifPaf: Composite Fields for Semantic Keypoint Detection and Spatio-Temporal Association" in PyTorch.
yolov5 - YOLOv5 π in PyTorch > ONNX > CoreML > TFLite
AlphaPose - Real-Time and Accurate Full-Body Multi-Person Pose Estimation&Tracking System
pytorch-lightning - Build high-performance AI models with PyTorch Lightning (organized PyTorch). Deploy models with Lightning Apps (organized Python to build end-to-end ML systems). [Moved to: https://github.com/Lightning-AI/lightning]
mmaction2 - OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark
PaddleDetection - Object Detection toolkit based on PaddlePaddle. It supports object detection, instance segmentation, multiple object tracking and real-time multi-person keypoint detection.
deep-high-resolution-net.pytorch - The project is an official implementation of our CVPR2019 paper "Deep High-Resolution Representation Learning for Human Pose Estimation"
mmdetection3d - OpenMMLab's next-generation platform for general 3D object detection.
AdelaiDet - AdelaiDet is an open source toolbox for multiple instance-level detection and recognition tasks.
sahi - Framework agnostic sliced/tiled inference + interactive ui + error analysis plots