mmdeploy
OpenMMLab Model Deployment Framework (by open-mmlab)
openvino
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference (by openvinotoolkit)
mmdeploy | openvino | |
---|---|---|
4 | 22 | |
3,023 | 8,764 | |
1.0% | 1.2% | |
4.7 | 10.0 | |
11 months ago | 4 days ago | |
Python | C++ | |
Apache License 2.0 | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
mmdeploy
Posts with mentions or reviews of mmdeploy.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-06-28.
- [D] Object detection models that can be easily converted to CoreML
-
Orange Pi 5 Plus Koboldcpp Demo (MPT, Falcon, Mini-Orca, Openllama)
The RK3588 also has a NPU for accelerating neural networks. The bad news is the API is not supported by any of the inference engines (afaik), but the NPU can run models directly that have been converted to the RKNN format. It is a long shot, but you can find details here.
-
MMDeploy: Deploy All the Algorithms of OpenMMLab
BibTeX @misc{=mmdeploy, title={OpenMMLab's Model Deployment Toolbox.}, author={MMDeploy Contributors}, howpublished = {\url{https://github.com/open-mmlab/mmdeploy}}, year={2021} }
-
Removing the bounding box generated by OnnxRuntime segmentation
I have a semantic segmentation model trained using the mmdetection repo. Then it is converted to the ONNX format using the mmdeploy repo.
openvino
Posts with mentions or reviews of openvino.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-12-28.
-
Court is in session: Top 10 most notorious C and C++ errors in 2024
V766 An item with the same key '"SoftPlus"' has already been added. cpu_types.cpp 198
-
OpenVINO's AI Success: Brilliance or Cracks Beneath the Surface?
Ever wonder how some AI projects manage to deliver breakthroughs in record time? OpenVINO, an open-source toolkit designed for optimizing and deploying AI models, is one such standout. With C++ at its core, this repository has consistently delivered on its promises. But what really sets it apart?
-
Fixing bugs in your AI: let's analyze bugs in OpenVINO
In fact, the analyzer didn't find that many errors. All the interesting and important errors fit into just a couple of articles. The code is quite beautiful and secure. The commit I was using to build and test the project is still the same: 2d8ac08.
-
12 moments of typos and copy-paste, or why AI hallucinates: checking OpenVINO
The commit I built the project on for checking it: 2d8ac08.
- Intel releases OpenVINO 2024.2 with broader LLM and quantization support
- FLaNK Stack 05 Feb 2024
- QUIK is a method for quantizing LLM post-training weights to 4 bit precision
- Intel OpenVINO 2023.1.0 released
- Intel OpenVINO 2023.1.0 released, open-source toolkit for optimizing and deploying AI inference
- OpenVINO 2023.1.0 released
What are some alternatives?
When comparing mmdeploy and openvino you can also consider the following projects:
FastDeploy - High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
TensorRT - NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
mmfewshot - OpenMMLab FewShot Learning Toolbox and Benchmark
deepsparse - Sparsity-aware deep learning inference runtime for CPUs
mmselfsup - OpenMMLab Self-Supervised Learning Toolbox and Benchmark
oneDNN - oneAPI Deep Neural Network Library (oneDNN)