SaaSHub helps you find the best software and product alternatives Learn more →
RyzenAI-SW Alternatives
Similar projects and alternatives to RyzenAI-SW
-
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better RyzenAI-SW alternative or higher similarity.
RyzenAI-SW reviews and mentions
Posts with mentions or reviews of RyzenAI-SW.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-04-16.
-
AMD unveils Ryzen Pro 8000-series processors
In the benchmark you have linked, you clearly see that the performance of the CPU only implementation and the NPU implementation are identical.
https://github.com/amd/RyzenAI-SW/blob/main/example/transfor...
What this should tell you is that "15 TOPs" is an irrelevant number in this benchmark. There are exactly two FLOPs per parameter. Loading the parameters takes more time than processing them.
There are people with less than 8GB of VRAM and they can't load these models into their GPU and end up with the exact same performance as on CPU. The 12tflops of the 3060 Ti 8GB are "no good" for LLMs, because the bottleneck for token generation is memory bandwidth.
My Ryzen 2700 gets 7 tokens per second at 50 GFLOPs. What does this tell you? The NPU can saturate the memory bandwidth of the system.
Now here is the gotcha: Have you tried inputting very large prompts? Because that is where the speedup is going to be extremely noticeable. Instead of waiting minutes on a 2000 token prompt, it will be just as fast as on GPUs, because the initial prompt processing is compute bound.
Also, before calling something subpar, you're going to have to tell me how you are going to put larger models like Goliath 70b or 120b models on your GPU.
-
AMD Unveils Ryzen 8000G Series Processors: Zen 4 APUs for Desktop with Ryzen AI
Unfortunately, Ryzen AI, while neat, remains Windows-exclusive
https://github.com/amd/RyzenAI-SW/issues/2
- AMD announces Ryzen 8045HS, 8040HS and 8040U "Hawk Point" series powered by Zen4, RDNA3 and XDNA - VideoCardz.com
- AMD Wants To Know If You'd Like Ryzen AI Support On Linux - Please upvote here to have a AMD AI Linux driver
- AMD wants to know if you would like Ryzen AI support for Linux
-
AMD Wants to Know If You'd Like Ryzen AI Support on Linux
I mean, it barely even exists or seems to be acknowledged in Windows either. Somehow, they made it into a feature that OEMs can decide to disable , even with compatible CPUs. This issue (and the complete lack of info, save from the input of a very helpful employee) to me shows the state of ryzenai:
https://github.com/amd/RyzenAI-SW/issues/5#issuecomment-1726...
-
Ryzen AI in 7940HS
Searching around showed other users with same issue and I found in the Ryzen AI footnote that this feature depends on OEM to be enabled. Github Issue
-
PCWorld: "Why AMD thinks Ryzen AI will be just as vital as CPUs and GPUs"
I noticed AMD just posted this github: https://github.com/amd/RyzenAI-cloud-to-client-demo
-
A note from our sponsor - SaaSHub
www.saashub.com | 13 May 2024
Stats
Basic RyzenAI-SW repo stats
10
227
6.4
13 days ago
amd/RyzenAI-SW is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of RyzenAI-SW is C++.
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com