plaidml
rust-gpu
Our great sponsors
plaidml | rust-gpu | |
---|---|---|
14 | 82 | |
4,575 | 6,952 | |
0.1% | 2.2% | |
5.4 | 7.7 | |
9 months ago | 12 days ago | |
C++ | Rust | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
plaidml
-
We’re Brian Retford, Jason Morton, and Ryan Cao, various researchers and developers in the ZKML (zero knowledge machine learning) space and we’ve been asked by r/privacy mods to help explain and answer questions about ZKML and why it’s important for the future of data privacy! AMA
basically agree with all of this, however I do want to highlight that there is no 'ZKML protocol plan' - the panel here are all involved in quite different projects and interested in ZKML for a variety of reasons. As one of the authors of https://github.com/plaidml/plaidml I'm not expecting any kind of standard protocol to evolve for several years; the group behind the AMA though is optimistic about the potential of ZKML and this AMA is part of the start of developing useful protocols.
-
Whisper – open source speech recognition by OpenAI
It understands my Swedish attempts at English really well with the medium.en model. (Although, it gives me a funny warning: `UserWarning: medium.en is an English-only model but receipted 'English'; using English instead.`. I guess it doesn't want to be told to use English when that's all it can do.)
However, it runs very slowly. It uses the CPU on my macbook, presumably because it hasn't got a NVidia card.
Googling about that I found [plaidML](https://github.com/plaidml/plaidml) which is a project promising to run ML on many different gpu architectures. Does anyone know whether it is possible to plug them together somehow? I am not an ML researcher, and don't quite understand anything about the technical details of the domain, but I can understand and write python code in domains that I do understand, so I could do some glue work if required.
-
Cloud Based training for my model?
Have you tried PlaidML https://github.com/plaidml/plaidml
-
GPU computing on Apple Silicon
This doesn't answer your question, but it would be cool if we had something based on MLIR for GPU compute. From what I've read, it closes the gap between NVIDIA and other GPU vendors a lot more than pure compute shaders. e.g. ONNX-MLIR, PlaidML, and IREE.
-
Image processing library? Also GUI development recommendations?
There is a library called PlaidML which is supposed to support Keras on a wide variety of GPUs, including the Iris. But it doesn't. I get the issue reported as Issue #168, which was first reported in 2018 and is still open. That's what I mean by not well supported.
- Question about the viability of AMD GPUs
- Ask HN: Will there ever be a cross platform GPU interface?
-
[P] DLPrimitives - wondering about best development direction
Not really: https://github.com/plaidml/plaidml/commits/plaidml-v1
-
Adventures in homelab AI: Putting the torch to an R710
There are reports on github of plaidML conking out on older CPUs with a similar "illegal instruction err.
- Machine learning on a new amd radeon gpu?
rust-gpu
-
Vcc – The Vulkan Clang Compiler
Sounds cool, but this requires yet another language to learn[0]. As someone who only has limited knowledge in this space, could someone tell me how comparable is the compute functionality of rust-gpu[1], where I can just write rust?
[0] https://github.com/Hugobros3/shady#language-syntax
[1] https://github.com/EmbarkStudios/rust-gpu
-
Candle: Torch Replacement in Rust
I don't do anything related to data science, but I feel like doing it in Rust would be nice.
You get operator overloading, so you can have ergonomic matrix operations that are typed also. Processing data on the CPU is fast, and crates like https://github.com/EmbarkStudios/rust-gpu make it very ergonomic to leverage the GPU.
I like this library for creating typed coordinate spaces for graphics programming (https://github.com/servo/euclid), I imagine something similar could be done to create refined types for matrices so you don't do matrix multiplication matrices of invalid sizes
-
What's the coolest Rust project you've seen that made you go, 'Wow, I didn't know Rust could do that!'?
Do you mean rust-gpu?
-
How a Nerdsnipe Led to a Fast Implementation of Game of Life
And https://github.com/EmbarkStudios/rust-gpu/tree/main/examples with the wgpu runner (here it runs the compute shader)
-
What is Rust's potential in game development?
I don't know how major they are considered, but Embark Studios is doing quite a bit of Rust in the open source space, most notably (IMO) rust-gpu and kajiya
-
[rust-gpu] How do I run/build my own shaders locally?
The examples in the rust-gpu repository are a good place to start
-
Posh: Type-Safe Graphics Programming in Rust
There's another project that's similar that's being used by an actual game company: https://github.com/EmbarkStudios/rust-gpu
They see specific advantages here that would outweigh that negative. It's not my space (I play games, but know next to nothing about graphics programming), but there's at least one argument in the other direction.
-
Introducing posh: Type-Safe Graphics Programming in Rust
Could this approach work for compute shaders (GPGPU) as well? So far, I think https://github.com/EmbarkStudios/rust-gpu is the state of the art in that area, but it adds a specific Rust compiler backend for generating SPIR-V rather than leaving that up to the driver. That seems more complicated than it needs to be... but maybe it has advantages too? Thoughts?
-
Looking for high level GPU computing crate
https://github.com/embarkstudios/rust-gpu Allows you to create shaders (kernals) in Rust.
-
With what languages are video games like League of Legends (most likely) programmed?
Also Embark Studios (formers DICE people) is doing a lot of work with Rust, all open source like Rust GPU https://github.com/EmbarkStudios/rust-gpu
What are some alternatives?
tensorflow-opencl - OpenCL support for TensorFlow
llama.cpp - LLM inference in C/C++
ROCm - AMD ROCm™ Software - GitHub Home [Moved to: https://github.com/ROCm/ROCm]
wgpu - Cross-platform, safe, pure-rust graphics api.
Pytorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration
Rust-CUDA - Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.
pytorch-coriander - OpenCL build of pytorch - (in-progress, not useable)
onnxruntime-rs - Rust wrapper for Microsoft's ONNX Runtime (version 1.8)
onnx-mlir - Representation and Reference Lowering of ONNX Models in MLIR Compiler Infrastructure
kompute - General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). Blazing fast, mobile-enabled, asynchronous and optimized for advanced GPU data processing usecases. Backed by the Linux Foundation.
dlprimitives - Deep Learning Primitives and Mini-Framework for OpenCL
DiligentEngine - A modern cross-platform low-level graphics library and rendering framework