Drogon-torch-serve
muzero-cpp
Drogon-torch-serve | muzero-cpp | |
---|---|---|
6 | 2 | |
26 | 28 | |
- | - | |
0.0 | 0.0 | |
over 1 year ago | almost 2 years ago | |
C++ | C++ | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Drogon-torch-serve
-
Neural nets in production systems
https://github.com/SABER-labs/Drogon-torch-serve example for serving torchscript model using Drogon C++ server, can be modified to serve ONNX instead.
-
What projects are you currently working on?
Working on https://github.com/SABER-labs/Drogon-torch-serve, a libtorch + Drogon model server, currently 12x faster than fastapi + pytorch, learning c++20 co-routines, multi-threaded communication, batch inference etc while doing the project.
- Serve Torch models using Drogon for higher throughput / lower latency
- Show HN: Serve Torch Models Using Drogon
- GitHub - SABER-labs/Drogon-torch-serve: Serve torch models using Drogon
muzero-cpp
-
Developing a C++ Library based on Torch
I also have a C++ implementation of MuZero, which has checkpointing/tensorboard support. If you have questions about design or functionality, let me know.
-
C++ Show and Tell - April 2022
MuZero-CPP The first and only (AFAIK) full C++ implementation of MuZero.
What are some alternatives?
LibtorchTutorials - This is a code repository for pytorch c++ (or libtorch) tutorial.
seer - Seer - a gui frontend to gdb
AECforWebAssembly - A port of ArithmeticExpressionCompiler from x86 to WebAssembly, so that the programs written in the language can run in a browser. The compiler has been rewritten from JavaScript into C++.
entt - Gaming meets modern C++ - a fast and reliable entity component system (ECS) and much more
SegmentationCpp - A c++ trainable semantic segmentation library based on libtorch (pytorch c++). Backbone: VGG, ResNet, ResNext. Architecture: FPN, U-Net, PAN, LinkNet, PSPNet, DeepLab-V3, DeepLab-V3+ by now.
csound_pd - Csound for Pure Data
torchRL - TorchRL is a C++ reinforcement library using PyTorch C++ backend LibTorch
Heady - A utility for creating amalgamated single-header C++ libraries
geodesic_raytracing
rvscript - Fast RISC-V-based scripting backend for game engines
RESTinio - Cross-platform, efficient, customizable, and robust asynchronous HTTP(S)/WebSocket server C++ library with the right balance between performance and ease of use
EasyOCR-cpp - Custom C++ implementation of deep learning based OCR