deepdetect
jetson-inference
Our great sponsors
deepdetect | jetson-inference | |
---|---|---|
4 | 11 | |
2,493 | 7,323 | |
0.2% | - | |
7.0 | 8.5 | |
about 1 month ago | 5 days ago | |
C++ | C++ | |
GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
deepdetect
-
Exploring Open-Source Alternatives to Landing AI for Robust MLOps
For those seeking a lightweight solution for setting up deep learning REST APIs across platforms without the complexity of Kubernetes, Deepdetect is worth considering.
-
[D] Deep Learning Framework for C++.
But you need to have good reasons to do it. Ours is that we have a multi-backend framework, and that we don't want any step in between dev & run. C++ allows for this since the same code can run on training server and edge device as needed. It also allows for building full AI applicatioms with great performances (e g. real time) We dev & use https://github.com/jolibrain/deepdetect for these purposes and it serves us very well, but it's not the faint of heart !
-
[P] Real-time AR for jewelry virtual try on that looks real, done with joliGAN, based on a few 2D videos and no 3D model
- Real-time is achieved through our full C++ Open Source backend DeepDetect, https://github.com/jolibrain/deepdetect. We use CUDA along with OpenCV and TensorRT to chain multiple models (ring detection and generator mostly), and we make sure the data remain within CUDA memory at all time. This allows us to reach ~60 FPS on 1080Ti and 20% more on average on an RTX3090.
-
[P] Benchmarking OpenBLAS on an Apple MacBook M1
Interesting, thanks. Recently benchmarked inference with Vulkan/MoltenVK/NCNN, M1 GPU is roughly 30% faster than M1 CPU, https://github.com/jolibrain/deepdetect/pull/1105 for single batch inference (NCNN does not really support batch size > 1).
jetson-inference
-
Can this NVIDIA Jetson Nano handle advanced machine learning tasks?
Jetson Nano’s are obsolete and no longer supported; but to answer your question, this might be a good place to start.
- help with project involving object detection and tracking with camera
-
Jetson Nano 2GB Issues During Training (Out Of Memory / Process Killed) & Other Questions!
I’m trying to do the tutorial, where they retrain the neural network to detect fruits (jetson-inference/pytorch-ssd.md at master · dusty-nv/jetson-inference · GitHub 1)
-
Jetson Nano
Jetson-Inference is another amazing resource to get started on. This will allow you to try out a number of neural networks (classification, detection, and segmentation) all with your own data or with sample images included in the repo.
-
Pretrained image classification model for nuts and bolts (or similar)
Hello! I'm looking for some pre trained image classification models to use on a Jetson Nano. I already know about the model zoo and the pre trained models included in the https://github.com/dusty-nv/jetson-inference repo. For demonstration purposes, however, I need a model trained on small objects from the context of production, ideally nuts, bolts, and similar small objects. Does anyone happen to know a source for this? Thanks a lot!
-
PyTorch 1.8 release with AMD ROCm support
> They provide some SSD-Mobilenet-v2 here: https://github.com/dusty-nv/jetson-inference
I was aware of that repository but from taking a cursory look at it I had thought dusty was just converting models from PyTorch to TensorRT, like here[0, 1]. Am I missing something?
> I get 140 fps on a Xavier NX
That really is impressive. Holy shit.
[0]: https://github.com/dusty-nv/jetson-inference/blob/master/doc...
[1]: https://github.com/dusty-nv/jetson-inference/issues/896#issu...
- NVIDIA DLSS released as a plugin for Unreal Engine 4
-
Help getting started
If you have a screen and keyboard and mouse plugged into the Nano, I would recommend starting with Hello AI World on https://github.com/dusty-nv/jetson-inference#hello-ai-world
-
I'm tired of this anti-Wayland horseshit
Well, don't get me wrong. I do like my Jetson Nano. For a hobbyist who likes to tinker with machine learning in their spare time it's definitely a product cool and there are quite a few repositories on Github[0, 1] with sample code.
Unfortunately… that's about it. There is little documentation about
- how to build a custom OS image (necessary if you're thinking about using Jetson as part of your own product, i.e. a large-scale deployment). What proprietary drivers and libraries do I need to install? Nvidia basically says, here's a Ubuntu image with the usual GUI, complete driver stack and everything – take it or leave it. Unfortunately, the GUI alone is eating up a lot of the precious CPU and GPU resources, so using that OS image is no option.
- how deployment works on production modules (as opposed to the non-production module in the Developer Kit)
- what production modules are available in the first place ("Please refer to our partners")
- what wifi dongles are compatible (the most recent Jetson Nano comes w/o wifi)
- how to convert your custom models to TensorRT, what you need to pay attention to etc. (The official docs basically say: Have a look at the following nondescript sample code. Good luck.)
- … (I'm sure I'm forgetting many other things that I've struggled with over the past months)
Anyway. It's not that this information isn't out there somewhere in some blog post, some Github repo or some thread on the Nvidia forums[2]. (Though I have yet to find a reliably working wifi dongle…) But it usually takes you days orweeks to find it. From a product which is supposed to be industry-grade I would have expected more.
[0]: https://github.com/dusty-nv/jetson-inference
-
Basic Teaching
https://github.com/dusty-nv/jetson-inference#system-setup
What are some alternatives?
ncnn - ncnn is a high-performance neural network inference framework optimized for the mobile platform
openpose - OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation
netron - Visualizer for neural network, deep learning and machine learning models
onnx-tensorrt - ONNX-TensorRT: TensorRT backend for ONNX
tensorflow-wheels - Tensorflow Wheels
tensorflow - An Open Source Machine Learning Framework for Everyone
YoloV7-ncnn-Jetson-Nano - YoloV7 for a Jetson Nano using ncnn.
yolov5-deepsort-tensorrt - A c++ implementation of yolov5 and deepsort
mdspan - Reference implementation of mdspan targeting C++23
TensorRT - NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
marian - Fast Neural Machine Translation in C++
obs-studio - OBS Studio - Free and open source software for live streaming and screen recording