transformer-deploy VS onnxruntime

Compare transformer-deploy vs onnxruntime and see what are their differences.

transformer-deploy

Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀 (by ELS-RD)

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator (by microsoft)
Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
transformer-deploy onnxruntime
8 51
1,609 12,386
1.4% 5.4%
6.8 10.0
5 months ago 3 days ago
Python C++
Apache License 2.0 MIT License
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

transformer-deploy

Posts with mentions or reviews of transformer-deploy. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-10-28.

onnxruntime

Posts with mentions or reviews of onnxruntime. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-02-05.

What are some alternatives?

When comparing transformer-deploy and onnxruntime you can also consider the following projects:

onnx - Open standard for machine learning interoperability

onnx-tensorrt - ONNX-TensorRT: TensorRT backend for ONNX

onnx-simplifier - Simplify your onnx model

ONNX-YOLOv7-Object-Detection - Python scripts performing object detection using the YOLOv7 model in ONNX.

onnx-tensorflow - Tensorflow Backend for ONNX

MLflow - Open source platform for the machine learning lifecycle

TensorRT - PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT

FasterTransformer - Transformer related optimization, including BERT, GPT

tensorflow-directml - Fork of TensorFlow accelerated by DirectML

TensorRT - NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

spark-nlp - State of the Art Natural Language Processing