rust-gpu
onnxruntime-rs
Our great sponsors
rust-gpu | onnxruntime-rs | |
---|---|---|
82 | 2 | |
6,876 | 256 | |
2.7% | - | |
8.2 | 0.0 | |
8 days ago | 22 days ago | |
Rust | Rust | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
rust-gpu
-
Vcc โ The Vulkan Clang Compiler
Sounds cool, but this requires yet another language to learn[0]. As someone who only has limited knowledge in this space, could someone tell me how comparable is the compute functionality of rust-gpu[1], where I can just write rust?
-
Candle: Torch Replacement in Rust
I don't do anything related to data science, but I feel like doing it in Rust would be nice.
You get operator overloading, so you can have ergonomic matrix operations that are typed also. Processing data on the CPU is fast, and crates like https://github.com/EmbarkStudios/rust-gpu make it very ergonomic to leverage the GPU.
I like this library for creating typed coordinate spaces for graphics programming (https://github.com/servo/euclid), I imagine something similar could be done to create refined types for matrices so you don't do matrix multiplication matrices of invalid sizes
-
What's the coolest Rust project you've seen that made you go, 'Wow, I didn't know Rust could do that!'?
Do you mean rust-gpu?
-
How a Nerdsnipe Led to a Fast Implementation of Game of Life
And https://github.com/EmbarkStudios/rust-gpu/tree/main/examples with the wgpu runner (here it runs the compute shader)
-
What is Rust's potential in game development?
I don't know how major they are considered, but Embark Studios is doing quite a bit of Rust in the open source space, most notably (IMO) rust-gpu and kajiya
-
[rust-gpu] How do I run/build my own shaders locally?
Long story short, I watched this video about shader programs, and got inspired to try writing shader programs in Rust. I came across rust-gpu which seems to fit the bill. My problem is that I don't really understand its documentation for this particular part.
The examples in the rust-gpu repository are a good place to start
-
Introducing posh: Type-Safe Graphics Programming in Rust
Could this approach work for compute shaders (GPGPU) as well? So far, I think https://github.com/EmbarkStudios/rust-gpu is the state of the art in that area, but it adds a specific Rust compiler backend for generating SPIR-V rather than leaving that up to the driver. That seems more complicated than it needs to be... but maybe it has advantages too? Thoughts?
-
Looking for high level GPU computing crate
https://github.com/embarkstudios/rust-gpu Allows you to create shaders (kernals) in Rust.
-
Whatโs everyone working on this week (19/2023)?
My focus this week has been on planning and assisting with architecture changes that help us fully integrate the node graph compositing engine we built over the past year. Upcoming tech we're working towards includes full utilization of the node graph to power all our layers; adopting WebGPU (now out in Chrome) into our editor using WGPU and rust-gpu; setting up a Tauri build and deployment; and building a backend web service to handle user accounts for document storage, hosting rustc to compile custom graphics effect nodes written by users in Rust, and Stable Diffusion image generation on AWS EC2 GPU instances.
onnxruntime-rs
-
Interesting results comparing TF and Rust
I have used the https://github.com/nbigaouette/onnxruntime-rs ONNX C++ wrapper on a Pytorch model, and did not see any difference in compute time between ONNX Python and ONNX Rust for GPU.
What are some alternatives?
llama.cpp - LLM inference in C/C++
wgpu - Cross-platform, safe, pure-rust graphics api.
Rust-CUDA - Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.
tract - Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference
kompute - General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). Blazing fast, mobile-enabled, asynchronous and optimized for advanced GPU data processing usecases. Backed by the Linux Foundation.
DiligentEngine - A modern cross-platform low-level graphics library and rendering framework
compute-shader-101 - Sample code for compute shader 101 training
bevy - A refreshingly simple data-driven game engine built in Rust
hash-shader - SHA256 WebGPU Compute Shader (Kernel) Written in Rust
makepad - Makepad is a creative software development platform for Rust that compiles to wasm/webGL, osx/metal, windows/dx11 linux/opengl
are-we-learning-yet - How ready is Rust for Machine Learning?
wgpu-rs - Rust bindings to wgpu native library