OnnxStream VS FastDeploy

Compare OnnxStream vs FastDeploy and see what are their differences.

OnnxStream

Lightweight inference library for ONNX files, written in C++. It can run SDXL on a RPI Zero 2 but also Mistral 7B on desktops and servers. (by vitoplantamura)

FastDeploy

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support. (by PaddlePaddle)
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
OnnxStream FastDeploy
9 5
1,754 2,742
- 3.2%
7.4 7.5
30 days ago about 1 month ago
C++ C++
GNU General Public License v3.0 or later Apache License 2.0
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

OnnxStream

Posts with mentions or reviews of OnnxStream. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-07-20.

FastDeploy

Posts with mentions or reviews of FastDeploy. We have used some of these posts to build our list of alternatives and similar projects.

What are some alternatives?

When comparing OnnxStream and FastDeploy you can also consider the following projects:

gemm-benchmark - Simple [sd]gemm benchmark, similar to ACES dgemm

mmdeploy - OpenMMLab Model Deployment Framework

onnxruntime - ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

TNN - TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.

DOOM - DOOM Open Source Release

tensorRT_Pro - C++ library based on tensorrt integration

deepC - vendor independent TinyML deep learning library, compiler and inference framework microcomputers and micro-controllers

deepdetect - Deep Learning API and Server in C++14 support for Caffe, PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE

jetson-inference - Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

maps-core - The lightweight and modern Map SDK for Android and iOS

useful-transformers - Efficient Inference of Transformer models

rkflashtool - Tools for flashing Rockchip devices