Drogon-torch-serve
SegmentationCpp
| Drogon-torch-serve | SegmentationCpp | |
|---|---|---|
| 6 | 3 | |
| 26 | 402 | |
| - | - | |
| 0.0 | 3.4 | |
| over 1 year ago | 5 months ago | |
| C++ | C++ | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Drogon-torch-serve
-
Neural nets in production systems
https://github.com/SABER-labs/Drogon-torch-serve example for serving torchscript model using Drogon C++ server, can be modified to serve ONNX instead.
-
What projects are you currently working on?
Working on https://github.com/SABER-labs/Drogon-torch-serve, a libtorch + Drogon model server, currently 12x faster than fastapi + pytorch, learning c++20 co-routines, multi-threaded communication, batch inference etc while doing the project.
- Serve Torch models using Drogon for higher throughput / lower latency
- Show HN: Serve Torch Models Using Drogon
- GitHub - SABER-labs/Drogon-torch-serve: Serve torch models using Drogon
SegmentationCpp
- Show HN: A C++ Trainable DCNN Library for Semantic Segmentation
-
Libtorch (C++ Front end for PyTorch)
Well, I just wrote a libtorch open source project here. In my experience, libtorch CUDA could be 2x or more faster than pytorch CUDA.
-
C++ trainable semantic segmentation models
@misc{Chunyu:2021, Author = {Chunyu Dong}, Title = {Libtorch Segment}, Year = {2021}, Publisher = {GitHub}, Journal = {GitHub repository}, Howpublished = {\url{https://github.com/AllentDan/SegmentationCpp}} }
What are some alternatives?
LibtorchTutorials - This is a code repository for pytorch c++ (or libtorch) tutorial.
segmentation_models.pytorch - Segmentation models with pretrained backbones. PyTorch.
AECforWebAssembly - A port of ArithmeticExpressionCompiler from x86 to WebAssembly, so that the programs written in the language can run in a browser. The compiler has been rewritten from JavaScript into C++.
torchRL - TorchRL is a C++ reinforcement library using PyTorch C++ backend LibTorch
tensorrtx - Implementation of popular deep learning networks with TensorRT network definition API
geodesic_raytracing
segmentation_models - Segmentation models with pretrained backbones. Keras and TensorFlow Keras.
RESTinio - Cross-platform, efficient, customizable, and robust asynchronous HTTP(S)/WebSocket server C++ library with the right balance between performance and ease of use
Pytorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration
muzero-cpp - A C++ pytorch implementation of MuZero