Drogon-torch-serve
RESTinio
| Drogon-torch-serve | RESTinio | |
|---|---|---|
| 6 | 14 | |
| 26 | 1,110 | |
| - | 1.0% | |
| 0.0 | 8.9 | |
| over 1 year ago | about 2 months ago | |
| C++ | C++ | |
| MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Drogon-torch-serve
-
Neural nets in production systems
https://github.com/SABER-labs/Drogon-torch-serve example for serving torchscript model using Drogon C++ server, can be modified to serve ONNX instead.
-
What projects are you currently working on?
Working on https://github.com/SABER-labs/Drogon-torch-serve, a libtorch + Drogon model server, currently 12x faster than fastapi + pytorch, learning c++20 co-routines, multi-threaded communication, batch inference etc while doing the project.
- Serve Torch models using Drogon for higher throughput / lower latency
- Show HN: Serve Torch Models Using Drogon
- GitHub - SABER-labs/Drogon-torch-serve: Serve torch models using Drogon
RESTinio
-
What is the industry standard today in C++ to deploy REST microservices in Kubernetes?
In my past job, we used https://github.com/Stiffstream/restinio and absolutely loved it. It's not as active but it honestly didn't need much.
-
What are some fun project ideas with C++?
Here's a C++ REST framework for you to use too: https://github.com/Stiffstream/restinio
- What code/project you saw was both inspiring and maintainable?
-
What are some cool modern libraries you enjoy using?
I had a good experience using restinio for a small ASIO HTTP server recently.
-
Can I use C++ in the backend ?? Any frameworks there ??
It uses restinio https://github.com/Stiffstream/restinio with great success ;)
- Modern C++ Web API (Back-End Development)
-
Confused about beginning application development using c++. Pls help.
For networking, pick a networking library. Restinio is a fair choice for HTTP. But, again, feel free to pick others.
-
NodeJS vs Go for low memory usage
You may find this worthwhile: https://github.com/Stiffstream/restinio/issues/101 FWIW, I used Restbed successfully for 3.5 years before switching personal projects to Restino. I've left the job that used Restbed, but I think they are still using it.
-
What does modern (good) API development look like and what are the best tools to use?
Contrary to the direction most people go, I've been writing REST APIs as C++ servers using two different fairly full featured C++ REST frameworks: first using https://github.com/Corvusoft/restbed and more lately using https://github.com/Stiffstream/restinio. These can be peers with any other server, while living on embedded and/or high compute devices for video encode/decode/analysis, deployed ML models, encryption for and remote process communications, model data collection and similar expensive or in-field processing. In both high compute and in-field-no-internet situations creating REST APIs in C++ enables speed and system controls not present in the majority of the mainstream REST frameworks. It's a big world, and here comes ubiquitous high compute...
-
cpprestsdk in maintenance mode
If you need an embedded C++ HTTP server then there are plenty of libraries/frameworks (in random order): Crow, RESTinio, Boost.Beast, cpp-httplib, http_backend, Pistache, RestBed, served, proxygen, Simple-Web-Server, drogon, oat++.
What are some alternatives?
LibtorchTutorials - This is a code repository for pytorch c++ (or libtorch) tutorial.
Boost.Beast - HTTP and WebSocket built on Boost.Asio in C++11
AECforWebAssembly - A port of ArithmeticExpressionCompiler from x86 to WebAssembly, so that the programs written in the language can run in a browser. The compiler has been rewritten from JavaScript into C++.
Restbed - Corvusoft's Restbed framework brings asynchronous RESTful functionality to C++14 applications.
SegmentationCpp - A c++ trainable semantic segmentation library based on libtorch (pytorch c++). Backbone: VGG, ResNet, ResNext. Architecture: FPN, U-Net, PAN, LinkNet, PSPNet, DeepLab-V3, DeepLab-V3+ by now.
C++ REST SDK - The C++ REST SDK is a Microsoft project for cloud-based client-server communication in native code using a modern asynchronous C++ API design. This project aims to help C++ developers connect to and interact with services.
torchRL - TorchRL is a C++ reinforcement library using PyTorch C++ backend LibTorch
Crow - A Fast and Easy to use microframework for the web.
geodesic_raytracing
µWebSockets - Simple, secure & standards compliant web server for the most demanding of applications
muzero-cpp - A C++ pytorch implementation of MuZero
Oat++ - 🌱Light and powerful C++ web framework for highly scalable and resource-efficient web application. It's zero-dependency and easy-portable.