nvidia-container-runtime
NVIDIA container runtime (by NVIDIA)
nvidia-docker
Build and run Docker containers leveraging NVIDIA GPUs (by NVIDIA)
nvidia-container-runtime | nvidia-docker | |
---|---|---|
3 | 53 | |
1,089 | 16,998 | |
- | - | |
0.0 | 0.0 | |
over 1 year ago | about 1 year ago | |
Makefile | Makefile | |
Apache License 2.0 | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
nvidia-container-runtime
Posts with mentions or reviews of nvidia-container-runtime.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-10-29.
-
Comparing 3 Docker container runtimes - Runc, gVisor and Kata Containers
Now you can even choose a runtime which creates a virtual machine or a container with a more secure isolation. Once there was a runtime for using an NVIDIA GPU called nvidia-container-runtime. That project is now deprecated and Docker has the "--gpus" option instead. Talking about GPUs is not the scope of this blogpost, but it is a good example of a special runtime that gave additional capabilities to containers.
-
Can you add CUDA to a docker container?
Yes, you can, actually already exist images with Cuda installed https://hub.docker.com/r/nvidia/cuda . To be able to use the GPU device within the docker container you need to install `nvidia-container-runtime` https://github.com/NVIDIA/nvidia-container-runtime.
- "Unknown runtime specified nvidia" trying to configure Plex Docker container with GPU passthrough
nvidia-docker
Posts with mentions or reviews of nvidia-docker.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-06-08.
-
What are the best AI tools you've ACTUALLY used?
Nvidia Docker on GitHub
-
Plex setup through Docker + Nvidia card, but hardware acceleration stops working after some time
Here's where I found discussion regarding this https://github.com/NVIDIA/nvidia-docker/issues/1671
-
Seeking Guidance on Leveraging Local Models and Optimizing GPU Utilization in containerized packages
I found the Faq, looks like Windows isn't supported which might indicate why I had this problem earlier. I might need to dual boot my machine if it won't work with WSL which I don't see mentioned in either page. WSL Cuda instructions found this I'll give it a try.
-
Which GPU for HW transcoding in PMS: Intel Arc or Nvidia?
Arc has linux kernel support from 6.0, been using an A770 with tdarr for a few months. Super solid and no issues like the nvidia docker toolkit just losing the GPU. The workaround doesn't hold for long - https://github.com/NVIDIA/nvidia-docker/issues/1730 It is one of the reasons I went with Intel over waiting for a low end 40 series. The other was I that basically stole it for $199. So far Plex is the only thing that doesn't work with Arc and all the HW transcoding falls on the iGPU. Knowing how they prioritize things nobody wants, Arc support and AV1 transcoding will be added when 16th gen Intel CPUs are released.
- [D] Would a Tesla M40 provide cheap inference acceleration for self-hosted LLMs?
- Help! Accelerated-GPU with Cuda and CuPy
-
Plex Transcode (VC1 (HW) 1080p H264 (HW) 1080p) on Pixel 7 Pro
Im trying to determine how to troubleshoot & resolve the HW transcoding, but based on my testing Im assuming its some change to the NVIDIA toolkit https://github.com/NVIDIA/nvidia-docker
- jelyfin with nvidia acceleration stopped working
-
Dockerize CUDA-Accelerated Applications
NVIDIA Container Toolkit
-
Setting up a new unraid server with vgpu and plex docker transcodes
So I am in the initial planning stages of setting up a new unraid server. Looking at picking up an SC846 24bay 4u chassis. I've got a Gigabyte Aorus mb with an AMD 5950x, 32gb of ddr4 (adding more as needed) and an nvidia 3070ti. I plan on getting an LSI 8i for the drives and leaves room for expansion server plans. My goal is to have plex setup via docker and utilize the gpu transcoding to offload the cpu work. I also want to setup vms or a vm server to essentially also have a "gaming server" mainly for me and the kids. This means down the road I would be adding another GPU to split up with other users. Im trying to allow for a max of 4 people while also still allowing plex to transcode as needed. Now I know there's other ways to do this but I dont feel like splitting this up into multiple systems unless I have to. So really just trying to see if this might be possible. My worry is that in order to make the gpu available to the plex docker I have to setup an nvidia container. https://github.com/NVIDIA/nvidia-docker
What are some alternatives?
When comparing nvidia-container-runtime and nvidia-docker you can also consider the following projects:
container-images
Entware - Ultimate repo for embedded devices
CommunityGrid - VCC Community Grid at Dallas Makerspace
docker-languagetool - Dockerfile for LanguageTool server - configurable
docker-languagetool - Dockerfile for LanguageTool
docker-to-linux - Make bootable Linux disk image (ab)using Docker
python-ismrmrd-server - Example client/server example for the streaming ISMRM Raw Data protocol
Whisparr
babyagi-ui - BabyAGI UI is designed to make it easier to run and develop with babyagi in a web app, like a ChatGPT.
AgentGPT - 🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.
Pytorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration
nvidia-container-runtime vs container-images
nvidia-docker vs Entware
nvidia-docker vs container-images
nvidia-docker vs CommunityGrid
nvidia-docker vs docker-languagetool
nvidia-docker vs docker-languagetool
nvidia-docker vs docker-to-linux
nvidia-docker vs python-ismrmrd-server
nvidia-docker vs Whisparr
nvidia-docker vs babyagi-ui
nvidia-docker vs AgentGPT
nvidia-docker vs Pytorch