Managing outdated pull requests is time-consuming. Mergify's Merge Queue automates your pull request management & merging. It's fully integrated to GitHub & coordinated with any CI. Start focusing on code. Try Mergify for free. Learn more →
Top 23 C++ Nvidium Projects
-
TensorRT
NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for inference applications.
Project mention: Nvidia Introduces TensorRT-LLM for Accelerating LLM Inference on H100/A100 GPUs | news.ycombinator.com | 2023-09-08https://github.com/NVIDIA/TensorRT/issues/982
Maybe? Looks like tensorRT does work, but I couldn't find much.
-
jetson-inference
Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.
Project mention: Can this NVIDIA Jetson Nano handle advanced machine learning tasks? | /r/NvidiaJetson | 2023-03-18Jetson Nano’s are obsolete and no longer supported; but to answer your question, this might be a good place to start.
-
Mergify
Tired of breaking your main and manually rebasing outdated pull requests?. Managing outdated pull requests is time-consuming. Mergify's Merge Queue automates your pull request management & merging. It's fully integrated to GitHub & coordinated with any CI. Start focusing on code. Try Mergify for free.
-
-
-
obs-StreamFX
StreamFX is a plugin for OBS® Studio which adds many new effects, filters, sources, transitions and encoders! Be it 3D Transform, Blur, complex Masking, or even custom shaders, you'll find it all here.
Project mention: OBS telling me I need to update or remove plugins but I can’t find these two plugins in my plugins folder in my C-Drive. What do I do? | /r/obs | 2023-07-01 -
sklearn can't, bit take a look at cuML (https://github.com/rapidsai/cuml ). It uses the same API as sklearn but executes on GPU.
-
Project mention: Optimization Techniques for GPU Programming [pdf] | news.ycombinator.com | 2023-08-09
I would recommend the course from Oxford (https://people.maths.ox.ac.uk/gilesm/cuda/). Also explore the tutorial section of cutlass (https://github.com/NVIDIA/cutlass/blob/main/media/docs/cute/...) if you want to learn more about high performance gemm.
-
InfluxDB
Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
-
Project mention: Introducing Cellulose - an ONNX model visualizer with hardware runtime support annotations | /r/tensorflow | 2023-05-23
[1] - We use onnx-tensorrt for this TensorRT compatibility checks.
-
-
CV-CUDA
CV-CUDA™ is an open-source, GPU accelerated library for cloud-scale image processing and computer vision.
Project mention: Microsoft, Tencent, Baidu Adopting Nvidia CV-CUDA for Computer Vision AI | news.ycombinator.com | 2023-03-21I'm not familiar with CV-CUDA but it looks interesting.The github may be made useful than the press release: https://github.com/CVCUDA/CV-CUDA
-
-
cuda-api-wrappers
Thin C++-flavored header-only wrappers for core CUDA APIs: Runtime, Driver, NVRTC, NVTX.
1. This implements the clunky C-ish API; there's also the Modern-C++ API wrappers, with automatic error checking, RAII resource control etc.; see: https://github.com/eyalroz/cuda-api-wrappers (due disclosure: I'm the author)
2. Implementing the _runtime_ API is not the right choice; it's important to implement the _driver_ API, otherwise you can't isolate contexts, dynamically add newly-compiled JIT kernels via modules etc.
3. This is less than 3000 lines of code. Wrapping all of the core CUDA APIs (driver, runtime, NVTX, JIT compilation of CUDA-C++ and of PTX) took me > 14,000 LoC.
-
-
-
-
If you just want a low level graphics api, and you don’t care about some of the abstractions Vulkan offers, you might consider checking out Deko 3D. It’s a stripped down version of Vulkan for the NVidia Tegra X1
-
Project mention: Can't install League using Lutris in OpenSUSE Tumbleweed | /r/leagueoflinux | 2023-06-03
For example download dxvk-nvapi compress file from https://github.com/jp7677/dxvk-nvapi/releases/tag/v0.6.3 and extract the files into $HOME/.local/share/lutris/runtime/dxvk_nvapi/
-
-
-
-
vibrantLinux
A tool to automate managing your screen's saturation depending on what programs are running
-
-
ParallelReductionsBenchmark
Thrust, CUB, TBB, AVX2, CUDA, OpenCL, OpenMP, SyCL - all it takes to sum a lot of numbers fast!
-
SonarCloud
Analyze your C and C++ projects with just one click.. SonarCloud, a cloud-based static analysis tool for your CI/CD workflows, offers a one-click automatic analysis of C and C++ projects hosted on GitHub. Zero configuration and free for open-source projects! Analyze free.
C++ Nvidia related posts
- Nvidia Introduces TensorRT-LLM for Accelerating LLM Inference on H100/A100 GPUs
- Train Your AI Model Once and Deploy on Any Cloud
- Shield Pro - Change resolution in Moonlight
- Home Network Steamlink issues
- VUDA: A Vulkan Implementation of CUDA
- Gamesteaming from desktop to the ally changed everything for me... (at least at home!)
- How do I get an RDP server running on KDE Wayland?
-
A note from our sponsor - Mergify
blog.mergify.com | 23 Sep 2023
Index
What are some of the best open-source Nvidium projects in C++? This list will help you:
Project | Stars | |
---|---|---|
1 | TensorRT | 7,846 |
2 | jetson-inference | 6,764 |
3 | moonlight-qt | 6,214 |
4 | Thrust | 4,761 |
5 | obs-StreamFX | 3,618 |
6 | cuml | 3,529 |
7 | cutlass | 3,306 |
8 | onnx-tensorrt | 2,549 |
9 | libcudacxx | 2,287 |
10 | CV-CUDA | 1,841 |
11 | gdrcopy | 677 |
12 | cuda-api-wrappers | 650 |
13 | Moonlight-Switch | 464 |
14 | relion | 374 |
15 | yolov5-deepsort-tensorrt | 339 |
16 | deko3d | 278 |
17 | dxvk-nvapi | 269 |
18 | optimus-manager-qt | 212 |
19 | nvidia-system-monitor-qt | 142 |
20 | gl_cadscene_rendertechniques | 138 |
21 | vibrantLinux | 107 |
22 | isaac_ros_apriltag | 65 |
23 | ParallelReductionsBenchmark | 58 |