tensorrtx
LibtorchTutorials
tensorrtx | LibtorchTutorials | |
---|---|---|
3 | 1 | |
6,584 | 667 | |
- | - | |
8.4 | 0.0 | |
6 days ago | over 2 years ago | |
C++ | C++ | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tensorrtx
-
A Three-pronged Approach to Bringing ML Models Into Production
In terms of the latter, this is quite common when employing non-standard SOTA models. You may discover a variety of TensorRT implementations on the web if you want to use popular models—for example, in the project where we needed to train an object-detection algorithm on Rutorch and deploy it on Triton, we used many cases of PyTorch -> TensorRT -> Triton. The implementation of the model on TensoRT was taken from here. You may also be interested in this repository, as it contains many current implementations supported by developers.
-
Dall-E 2
I'll try them out. I have an RTX 2070, which apparently supports fp16. But it only has 8GB RAM.
I used the instructions here to check: https://github.com/wang-xinyu/tensorrtx/blob/master/tutorial...
-
Increasing usb cam FPS with Yolov5 on a Jetson Xavier NX?
Optimize your model using TensorRT. There is a good implementation here: https://github.com/wang-xinyu/tensorrtx/tree/master/yolov5
LibtorchTutorials
-
C++ trainable semantic segmentation models
Visit Libtorch Tutorials Project if you want to know more about Libtorch Segment library.
What are some alternatives?
TensorRT - NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
SegmentationCpp - A c++ trainable semantic segmentation library based on libtorch (pytorch c++). Backbone: VGG, ResNet, ResNext. Architecture: FPN, U-Net, PAN, LinkNet, PSPNet, DeepLab-V3, DeepLab-V3+ by now.
tensorflow-yolov4-tflite - YOLOv4, YOLOv4-tiny, YOLOv3, YOLOv3-tiny Implemented in Tensorflow 2.0, Android. Convert YOLO v4 .weights tensorflow, tensorrt and tflite
yolo-tensorrt - TensorRT8.Support Yolov5n,s,m,l,x .darknet -> tensorrt. Yolov4 Yolov3 use raw darknet *.weights and *.cfg fils. If the wrapper is useful to you,please Star it.
v-diffusion-pytorch - v objective diffusion inference code for PyTorch.
Drogon-torch-serve - Serve pytorch / torch models using Drogon
dalle-mini - DALL·E Mini - Generate images from a text prompt
torchRL - TorchRL is a C++ reinforcement library using PyTorch C++ backend LibTorch
dalle-2-preview
muzero-cpp - A C++ pytorch implementation of MuZero
Pytorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration