Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure. Learn more →
Drogon-torch-serve Alternatives
Similar projects and alternatives to Drogon-torch-serve
-
AECforWebAssembly
A port of ArithmeticExpressionCompiler from x86 to WebAssembly, so that the programs written in the language can run in a browser. The compiler has been rewritten from JavaScript into C++.
-
InfluxDB
InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
-
-
-
-
SegmentationCpp
A c++ trainable semantic segmentation library based on libtorch (pytorch c++). Backbone: VGG, ResNet, ResNext. Architecture: FPN, U-Net, PAN, LinkNet, PSPNet, DeepLab-V3, DeepLab-V3+ by now.
-
RESTinio
Cross-platform, efficient, customizable, and robust asynchronous HTTP(S)/WebSocket server C++ library with the right balance between performance and ease of use
-
Stream
Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.
-
-
TheBookDB-API
TheBookDB is a powerful API built using C++ and the Drogon framework. It provides information about over 11,000 books, sourced from a Kaggle CSV file.
-
Drogon-torch-serve discussion
Drogon-torch-serve reviews and mentions
-
Neural nets in production systems
https://github.com/SABER-labs/Drogon-torch-serve example for serving torchscript model using Drogon C++ server, can be modified to serve ONNX instead.
-
What projects are you currently working on?
Working on https://github.com/SABER-labs/Drogon-torch-serve, a libtorch + Drogon model server, currently 12x faster than fastapi + pytorch, learning c++20 co-routines, multi-threaded communication, batch inference etc while doing the project.
- Serve Torch models using Drogon for higher throughput / lower latency
- Show HN: Serve Torch Models Using Drogon
- GitHub - SABER-labs/Drogon-torch-serve: Serve torch models using Drogon
-
A note from our sponsor - Stream
getstream.io | 18 Jul 2025
Stats
SABER-labs/Drogon-torch-serve is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of Drogon-torch-serve is C++.
Popular Comparisons
- Drogon-torch-serve VS AECforWebAssembly
- Drogon-torch-serve VS geodesic_raytracing
- Drogon-torch-serve VS ceras
- Drogon-torch-serve VS torchRL
- Drogon-torch-serve VS LibtorchTutorials
- Drogon-torch-serve VS SegmentationCpp
- Drogon-torch-serve VS RESTinio
- Drogon-torch-serve VS muzero-cpp
- Drogon-torch-serve VS TheBookDB-API
- Drogon-torch-serve VS torchlambda