tensorrtx
SegmentationCpp
Our great sponsors
| tensorrtx | SegmentationCpp | |
|---|---|---|
| 3 | 3 | |
| 6,584 | 402 | |
| - | - | |
| 8.4 | 3.4 | |
| 5 days ago | 5 months ago | |
| C++ | C++ | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tensorrtx
-
A Three-pronged Approach to Bringing ML Models Into Production
In terms of the latter, this is quite common when employing non-standard SOTA models. You may discover a variety of TensorRT implementations on the web if you want to use popular models—for example, in the project where we needed to train an object-detection algorithm on Rutorch and deploy it on Triton, we used many cases of PyTorch -> TensorRT -> Triton. The implementation of the model on TensoRT was taken from here. You may also be interested in this repository, as it contains many current implementations supported by developers.
-
Dall-E 2
I'll try them out. I have an RTX 2070, which apparently supports fp16. But it only has 8GB RAM.
I used the instructions here to check: https://github.com/wang-xinyu/tensorrtx/blob/master/tutorial...
-
Increasing usb cam FPS with Yolov5 on a Jetson Xavier NX?
Optimize your model using TensorRT. There is a good implementation here: https://github.com/wang-xinyu/tensorrtx/tree/master/yolov5
SegmentationCpp
- Show HN: A C++ Trainable DCNN Library for Semantic Segmentation
-
Libtorch (C++ Front end for PyTorch)
Well, I just wrote a libtorch open source project here. In my experience, libtorch CUDA could be 2x or more faster than pytorch CUDA.
-
C++ trainable semantic segmentation models
@misc{Chunyu:2021, Author = {Chunyu Dong}, Title = {Libtorch Segment}, Year = {2021}, Publisher = {GitHub}, Journal = {GitHub repository}, Howpublished = {\url{https://github.com/AllentDan/SegmentationCpp}} }
What are some alternatives?
TensorRT - NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
segmentation_models.pytorch - Segmentation models with pretrained backbones. PyTorch.
tensorflow-yolov4-tflite - YOLOv4, YOLOv4-tiny, YOLOv3, YOLOv3-tiny Implemented in Tensorflow 2.0, Android. Convert YOLO v4 .weights tensorflow, tensorrt and tflite
LibtorchTutorials - This is a code repository for pytorch c++ (or libtorch) tutorial.
v-diffusion-pytorch - v objective diffusion inference code for PyTorch.
segmentation_models - Segmentation models with pretrained backbones. Keras and TensorFlow Keras.
dalle-mini - DALL·E Mini - Generate images from a text prompt
Pytorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration
dalle-2-preview
Drogon-torch-serve - Serve pytorch / torch models using Drogon
gpt-2 - Code for the paper "Language Models are Unsupervised Multitask Learners"
torchRL - TorchRL is a C++ reinforcement library using PyTorch C++ backend LibTorch