Nebullvm, an open-source library to accelerate AI inference by 5-20x in a few lines of code

• yolov5

  129 47,202 8.8 Python

  YOLOv5 🚀 in PyTorch > ONNX > CoreML > TFLite

  

[YOLOv5](https://github.com/ultralytics/yolov5) 🚀 also provides native [exports](https://github.com/ultralytics/yolov5/issues/251) and [benchmarks](https://github.com/ultralytics/yolov5/pull/6963) in all formats: ### Usage ```python git clone https://github.com/ultralytics/yolov5 -b update/bench_gpu # clone cd yolov5 pip install -qr requirements.txt # install python utils/benchmarks.py --weights yolov5s.pt --img 640 --device 0 ``` ### GPU Results: Colab+ V100 ``` benchmarks: weights=/content/yolov5/yolov5s.pt, imgsz=640, batch_size=1, data=/content/yolov5/data/coco128.yaml, device=0, half=False YOLOv5 🚀 v6.1-48-g0c1025f torch 1.10.0+cu111 CUDA:0 (Tesla V100-SXM2-16GB, 16160MiB) Setup complete ✅ (8 CPUs, 51.0 GB RAM, 46.1/166.8 GB disk) Benchmarks complete (433.63s) Format [email protected]:0.95 Inference time (ms) 0 PyTorch 0.462296 9.159939 1 TorchScript 0.462296 6.607546 2 ONNX 0.462296 12.698026 3 OpenVINO NaN NaN 4 TensorRT 0.462280 1.725197 5 CoreML NaN NaN 6 TensorFlow SavedModel 0.462296 20.273019 7 TensorFlow GraphDef 0.462296 20.212173 8 TensorFlow Lite NaN NaN 9 TensorFlow Edge TPU NaN NaN 10 TensorFlow.js NaN NaN ``` ### CPU Results: EPYC Milan AMD ``` benchmarks: weights=/usr/src/app/yolov5s.pt, imgsz=640, batch_size=1, data=/usr/src/app/data/coco128.yaml YOLOv5 🚀 2022-3-11 torch 1.11.0+cpu CPU Setup complete ✅ (96 CPUs, 1007.7 GB RAM, 885.4/3519.3 GB disk) Benchmarks complete (334.78s) Format [email protected]:0.95 Inference time (ms) 0 PyTorch 0.462296 59.022402 1 TorchScript 0.462296 81.963500 2 ONNX 0.462296 66.349735 3 OpenVINO 0.462296 28.817065 4 TensorRT NaN NaN 5 CoreML NaN NaN 6 TensorFlow SavedModel 0.462296 91.322277 7 TensorFlow GraphDef 0.462296 96.317230 8 TensorFlow Lite 0.462334 160.701267 9 TensorFlow Edge TPU NaN NaN 10 TensorFlow.js NaN NaN ```

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project