nvidia-docker VS AgentGPT

Nvidia Docker on GitHub

Here's where I found discussion regarding this https://github.com/NVIDIA/nvidia-docker/issues/1671

I found the Faq, looks like Windows isn't supported which might indicate why I had this problem earlier. I might need to dual boot my machine if it won't work with WSL which I don't see mentioned in either page. WSL Cuda instructions found this I'll give it a try.

Arc has linux kernel support from 6.0, been using an A770 with tdarr for a few months. Super solid and no issues like the nvidia docker toolkit just losing the GPU. The workaround doesn't hold for long - https://github.com/NVIDIA/nvidia-docker/issues/1730 It is one of the reasons I went with Intel over waiting for a low end 40 series. The other was I that basically stole it for $199. So far Plex is the only thing that doesn't work with Arc and all the HW transcoding falls on the iGPU. Knowing how they prioritize things nobody wants, Arc support and AV1 transcoding will be added when 16th gen Intel CPUs are released.

Im trying to determine how to troubleshoot & resolve the HW transcoding, but based on my testing Im assuming its some change to the NVIDIA toolkit https://github.com/NVIDIA/nvidia-docker

NVIDIA Container Toolkit

So I am in the initial planning stages of setting up a new unraid server. Looking at picking up an SC846 24bay 4u chassis. I've got a Gigabyte Aorus mb with an AMD 5950x, 32gb of ddr4 (adding more as needed) and an nvidia 3070ti. I plan on getting an LSI 8i for the drives and leaves room for expansion server plans. My goal is to have plex setup via docker and utilize the gpu transcoding to offload the cpu work. I also want to setup vms or a vm server to essentially also have a "gaming server" mainly for me and the kids. This means down the road I would be adding another GPU to split up with other users. Im trying to allow for a max of 4 people while also still allowing plex to transcode as needed. Now I know there's other ways to do this but I dont feel like splitting this up into multiple systems unless I have to. So really just trying to see if this might be possible. My worry is that in order to make the gpu available to the plex docker I have to setup an nvidia container. https://github.com/NVIDIA/nvidia-docker

Their PR descriptions aren't much better https://github.com/reworkd/AgentGPT/pull/1372#issue-19887599...

AgentGPT was an early agent framework designed to create, configure, and deploy autonomous AI agents. It mostly relies on looping OpenAI's GPT models like GPT-3.5 and GPT-4. AgentGPT allows users to set a goal for the AI, which autonomously plans, executes, and refines strategies to achieve it. This platform allows for both web browser access and local operation via Docker, or server deployment.

There's a few tools out there like AgentGPT (https://github.com/reworkd/AgentGPT, although it's a more conversational interface), and (https://github.com/logspace-ai/langflow) and others. I think most developers definitely prefer a code-first interface though like a library but haven't found one that's great yet. We've used them in the past but didn't have the best experience so would love to hear if anyone has worked with a library they found really flexible.

17. AgentGPT

I saw a post earlier this week saying that they feel the outputs from ChatGPT have been declining, and a lot of people agreed. There are a good amount of quality AI chat alternatives out there besides ChatGPT and some even offer GPT-4 for free! Here's a list of alternative chatbots to try out (I've tried all of these not some bs list): Perplexity: "The first conversational search engine" (GPT-3.5 Free / GPT-4 Paid $20 a month) Bing: Microsoft's Chatbot with multimodal capabilities. (GPT-4 Free) Poe: Quora's AI app with multiple models (GPT-3.5 Free / GPT-4 free with 'limited access') AgentGPT: "Autonomous AI agent" Give one prompt and it will run continuously until finished. (GPT 3.5 Free / GPT-4 API access required) sign up for GPT-4 API waitlist here HuggingFace: Largest open source AI community find thousands of different open source projects (Free site) Ora: Access community LLM's or build your own (GPT-3.5 Free / GPT-4 Free) Direct link to free GPT-4 Inflection Pi: A personal AI chatbot (not meant for research purposes) (Free site) ... unsure what model I have seen conflicting information I believe it's GPT-3.5 Nat.dev: Use GPT-4 in playground and compare to other models (GPT-4 $5 credit fee) Merlin: Access GPT-4 chatbot in any browser (GPT-4 limited free plan / GPT-4 unlimited starting at $19 a month) These are all credible chatbots that have been running for months the majority do require email signups however. Hope this helps! **P.S.** If this was helpful and you want to keep ahead in the AI game, consider joining my free daily newsletter! Sent out every weekday at 9 a.m. sharp, it will keep you up-to-date on the ins and outs of generative AI technology, all over your morning cup of ☕️.

AgentGPT: "Autonomous AI agent" Give one prompt and it will run continuously until finished. (GPT 3.5 Free / GPT-4 API access required) sign up for GPT-4 API waitlist here