Nvidia

Open-source projects categorized as Nvidia
Edit details
Language: + C++ + Python + C + C# + Shell + Cuda + Dockerfile
Topics: GPU Amd Cuda Intel Linux
The modern identity platform for B2B SaaS
The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
workos.com
Sponsored

Top 23 Nvidium Open-Source Projects

  • TensorRT

    NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

    • Project mention: AMD MI300X 30% higher performance than Nvidia H100, even with optimized stack | news.ycombinator.com | 2023-12-17

    > It's not rocket science to implement matrix multiplication in any GPU.

    You're right, it's harder. Saying this as someone who's done more work on the former than the latter. (I have, with a team, built a rocket engine. And not your school or backyard project size, but nozzle bigger than your face kind. I've also written CUDA kernels and boy is there a big learning curve to the latter that you gotta fundamentally rethink how you view a problem. It's unquestionable why CUDA devs are paid so much. Really it's only questionable why they aren't paid more)

    I know it is easy to think this problem is easy, it really looks that way. But there's an incredible amount of optimization that goes into all of this and that's what's really hard. You aren't going to get away with just N for loops for a tensor rank N. You got to chop the data up, be intelligent about it, manage memory, how you load memory, handle many data types, take into consideration different results for different FMA operations, and a whole lot more. There's a whole lot of non-obvious things that result in high optimization (maybe obvious __after__ the fact, but that's not truthfully "obvious"). The thing is, the space is so well researched and implemented that you can't get away with naive implementations, you have to be on the bleeding edge.

    Then you have to do that and make it reasonably usable for the programmer too, abstracting away all of that. Cuda also has a huge head start and momentum is not a force to be reckoned with (pun intended).

    Look at TensorRT[0]. The software isn't even complete and it still isn't going to cover all neural networks on all GPUs. I've had stuff work on a V100 and H100 but not an A100, then later get fixed. They even have the "Apple Advantage" in that they have control of the hardware. I'm not certain AMD will have the same advantage. We talk a lot about the difficulties of being first mover, but I think we can also recognize that momentum is an advantage of being first mover. And it isn't one to scoff at.

    [0] https://github.com/NVIDIA/TensorRT

  • moonlight-qt

    GameStream client for PCs (Windows, Mac, Linux, and Steam Link)

    • Project mention: Sunshine: HEVC not supported (even though it should) | /r/cloudygamer | 2023-12-07

    I found this https://github.com/moonlight-stream/moonlight-qt/issues/967

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • nvtop

    GPU & Accelerator process monitoring for AMD, Apple, Huawei, Intel, NVIDIA and Qualcomm

    • Project mention: Nvtop: Linux Task Monitor for Nvidia, AMD and Intel GPUs | news.ycombinator.com | 2024-03-12

  • jetson-inference

    Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

  • g-helper

    Lightweight Armoury Crate alternative for Asus laptops and ROG Ally. Control tool for ROG Zephyrus G14, G15, G16, M16, Flow X13, Flow X16, TUF, Strix, Scar and other models

    • Project mention: Asus tuf f15 fan noise. | /r/ASUS | 2023-12-11

    Uninstall Armoury Create and install G-Helper. G-Helper

  • cutlass

    CUDA Templates for Linear Algebra Subroutines

    • Project mention: Optimization Techniques for GPU Programming [pdf] | news.ycombinator.com | 2023-08-09

    I would recommend the course from Oxford (https://people.maths.ox.ac.uk/gilesm/cuda/). Also explore the tutorial section of cutlass (https://github.com/NVIDIA/cutlass/blob/main/media/docs/cute/...) if you want to learn more about high performance gemm.

  • nvitop

    An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

    • Project mention: Nvtop: Linux Task Monitor for Nvidia, AMD and Intel GPUs | news.ycombinator.com | 2024-03-12

    That's why the authors recommend pipx for installing nvitop. I am not a sysadmin, but I prefer pipx over relying on the (often outdated) distro sources.

    https://github.com/XuehaiPan/nvitop?tab=readme-ov-file#insta...

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • cuml

    cuML - RAPIDS Machine Learning Library

    • Project mention: FLaNK Stack Weekly for 13 November 2023 | dev.to | 2023-11-13

  • obs-StreamFX

    StreamFX is a plugin for OBS® Studio which adds many new effects, filters, sources, transitions and encoders! Be it 3D Transform, Blur, complex Masking, or even custom shaders, you'll find it all here.

    • Project mention: OBS telling me I need to update or remove plugins but I can’t find these two plugins in my plugins folder in my C-Drive. What do I do? | /r/obs | 2023-07-01

  • NBMiner

    GPU Miner for ETH, RVN, BEAM, CFX, ZIL, AE, ERGO

  • awesome-vulkan

    Awesome Vulkan ecosystem

  • moonlight-android

    GameStream client for Android

    • Project mention: Has anyone been able to stream this game using Moonlight or Steam Link? | /r/vtmb | 2023-10-05

    I could however play it through Moonlight Deskstop Stream using the mstmc.exe. This way I could just open Steam in Big Picture Mode then launch the game as always. However, once ing game, it has some weird visual glitch when walking in the streets of the city causing some stroboscopic effect in the textures which switch to a whitish washed-off color, and then back to normal darker colors, and then half a second later back to whitish colors, etc.

  • waifu2x-ncnn-vulkan

    waifu2x converter ncnn version, runs fast on intel / amd / nvidia / apple-silicon GPU with vulkan

    • Project mention: Koji projekat na Githubu vas je odusevio u zadnje vreme? | /r/CroIT | 2023-06-19

  • onnx-tensorrt

    ONNX-TensorRT: TensorRT backend for ONNX

    • Project mention: Introducing Cellulose - an ONNX model visualizer with hardware runtime support annotations | /r/tensorflow | 2023-05-23

    [1] - We use onnx-tensorrt for this TensorRT compatibility checks.

  • TensorRT

    PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT (by pytorch)

  • CV-CUDA

    CV-CUDA™ is an open-source, GPU accelerated library for cloud-scale image processing and computer vision.

  • jetson_stats

    📊 Simple package for monitoring and control your NVIDIA Jetson [Orin, Xavier, Nano, TX] series

  • QualityScaler

    QualityScaler - image/video deeplearning upscaling for any GPU

    • Project mention: How do I change the learning hub video resolution? | /r/ANSYS | 2023-12-10

  • Autodesk-Fusion-360-for-Linux

    This is a project, where I give you a way to use Autodesk Fusion 360 on Linux!

    • Project mention: how do i get fusion 360? | /r/linuxquestions | 2023-10-23

    i found a script someone made (here) but it just isnt working, when i use bottle i get an error that it failed to login, and when i use the script wget just times out. i manually downloaded the script, but the script has wget in it anyway. i tried adding -4 to wget, which didnt help.

  • jetson-containers

    Machine Learning Containers for NVIDIA Jetson and JetPack-L4T

    • Project mention: Install ros 2 humble on jetson orin | /r/ROS | 2023-06-25

    https://github.com/dusty-nv/jetson-containers This one might be helpful

  • cugraph

    cuGraph - RAPIDS Graph Analytics Library

    • Project mention: CuGraph – GPU-accelerated graph analytics | news.ycombinator.com | 2023-10-16

  • SHARK

    SHARK - High Performance Machine Learning Distribution

    • Project mention: Llama 2 on ONNX runs locally | news.ycombinator.com | 2023-08-10

  • ffmpeg

    Docker build for FFmpeg on Ubuntu / Alpine / Centos / Scratch / nvidia / vaapi (by jrottenberg)

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Nvidia related posts

Index

What are some of the best open-source Nvidium projects? This list will help you:

Project Stars
1 TensorRT 9,065
2 moonlight-qt 8,272
3 nvtop 7,401
4 jetson-inference 7,323
5 g-helper 4,570
6 cutlass 4,522
7 nvitop 3,934
8 cuml 3,894
9 obs-StreamFX 3,820
10 NBMiner 3,163
11 awesome-vulkan 3,141
12 moonlight-android 3,070
13 waifu2x-ncnn-vulkan 2,874
14 onnx-tensorrt 2,749
15 TensorRT 2,328
16 CV-CUDA 2,190
17 jetson_stats 2,023
18 QualityScaler 1,719
19 Autodesk-Fusion-360-for-Linux 1,702
20 jetson-containers 1,624
21 cugraph 1,567
22 SHARK 1,382
23 ffmpeg 1,344

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com