cuda-api-wrappers
web
Our great sponsors
cuda-api-wrappers | web | |
---|---|---|
10 | 157 | |
726 | 1,762 | |
- | 0.6% | |
8.8 | 6.4 | |
2 days ago | 9 months ago | |
C++ | JavaScript | |
BSD 3-clause "New" or "Revised" License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
cuda-api-wrappers
-
VUDA: A Vulkan Implementation of CUDA
1. This implements the clunky C-ish API; there's also the Modern-C++ API wrappers, with automatic error checking, RAII resource control etc.; see: https://github.com/eyalroz/cuda-api-wrappers (due disclosure: I'm the author)
2. Implementing the _runtime_ API is not the right choice; it's important to implement the _driver_ API, otherwise you can't isolate contexts, dynamically add newly-compiled JIT kernels via modules etc.
3. This is less than 3000 lines of code. Wrapping all of the core CUDA APIs (driver, runtime, NVTX, JIT compilation of CUDA-C++ and of PTX) took me > 14,000 LoC.
-
WezTerm is a GPU-accelerated cross-platform terminal emulator
> since the underlying API's are still C/C++,
If the use of GPUs is via CUDA, there are my https://github.com/eyalroz/cuda-api-wrappers/ which are RAII/CADRe, and therefore less unsafe. And on the Rust side - don't you need a bunch of unsafe code in the library enabling GPU support?
-
GNU Octave
Given your criteria, you might want to consider (modern) C++.
* Fast - in many cases faster than Rust, although the difference is inconsequential relative to Python-to-Rust improvement I guess.
* _Really_ utilize CUDA, OpenCL, Vulcan etc. Specifically, Rust GPU is limited in its supported features, see: https://github.com/Rust-GPU/Rust-CUDA/blob/master/guide/src/... ...
* Host-side use of CUDA is at least as nice, and probably nicer, than what you'll get with Rust. That is, provided you use my own Modern C++ wrappers for the CUDA APIs: https://github.com/eyalroz/cuda-api-wrappers/ :-) ... sorry for the shameless self-plug.
* ... which brings me to another point: Richer offering of libraries for various needs than Rust, for you to possibly utilize.
* Easier to share than Rust. A target system is less likely to have an appropriate version of Rust and the surrounding ecosystem.
There are downsides, of course, but I was just applying your criteria.
-
How CUDA Programming Works
https://github.com/eyalroz/cuda-api-wrappers
I try to address these and some other issues.
We should also remember that NVIDIA artificially prevents its profiling tools from supporting OpenCL kernels - with no good reason.
-
are there communities for cuda devs so we can talk and grow together?
On the host side however - the API you use to orchestrate execution of kernels on GPUs, data transfers etc. - the official API is very C'ish, annoying and confusing. I have written C++'ish wrappers for it which many enjoy but are of course not officially supported or endorsed: https://github.com/eyalroz/cuda-api-wrappers
- Thin C++-Flavored Wrappers for the CUDA APIs: Runtime, Driver, Nvrtc and NVTX
- Integrating the CUDA APIs (Driver, Runtime, JIT) in pleasant modern-C++ wrappers
-
Cybercriminals who breached Nvidia issue one of the most unusual demands ever
Oh, I really wish those hackers would release the sources rather than pursue their dumbass crypto-mining demands... "We decided to help mining and gaming community" - hurting the gaming community, helping the get-rich-quick "community".
My own C++ wrappers for the CUDA APIs (shameless self-plug: https://github.com/eyalroz/cuda-api-wrappers/) would really benefit a lot from behind-the-curtains access to the driver; and even if I just know how the internal logic of the driver and the runtime works, without actually being able to hook into that logic - I would already be able to leverage this somewhat in my design considerations.
-
AMD’s Lisa Su Breaks Through the Silicon Ceiling
As a person making a living from being the "GPU guy" - I definitely agree.
The ecosystem around AMD GPUs is quite small - and now that they seem to have abandoned OpenCL (possibly not their own fault though) - even that is put into question.
But things are bad even on the NVIDIA side. Example of how bad: I had to write my own C++ bindings for the CUDA runtime API (https://github.com/eyalroz/cuda-api-wrappers/). You'd think they would have that after 13 years of CUDA being available, right? Wrong. I repeatedly tried to pitch this to them, but they seem to suffer from the "Not Invented Here" syndrome (https://learnosity.com/not-invented-here-syndrome-explained/). This despite me having a lot of respect for people like Mark Harris, Bryce Lelbach, Duane Merrill et alia, and their work.
You're also rights about the "two kinds of brains" - or rather, it's not clear to me that the brains creating the silicon and the brains creating the software are in close enough cooperation.
By the way - it is possible to extract a pretty distribution of CUDA to justify run 20 lines of GPGPU code, from their installer. But they won't be bothered to package this nicely for you.
-
How do I use gpus (c++)
Try Vulcan, or OpenCL. There are tons of wrappers for CUDA to make coding simpler ie https://github.com/eyalroz/cuda-api-wrappers
web
-
Octant is donating 1M in ETH to 10 public goods projects, and you can help decide how to allocate.
Here's the list of projects you can support: Clr.fund - https://clr.fund/ DAO Drops - https://daodrops.io/ Drips - https://www.drips.network/ Ethereum Cat Herders - https://www.ethereumcatherders.com ETHStaker - https://ethstaker.cc Giveth - https://giveth.io/ Gitcoin - https://gitcoin.co Kernel - https://www.kernel.community/en/ Protocol Guild - https://protocol-guild.readthedocs.io Supermodular - https://supermodular.xyz/
-
Daily General Discussion - April 12, 2023
The Gitcoin website has some of the worst information architecture, I have no idea what their team is doing. I can't imagine how many people visited gitcoin.co to donate and couldn't figure out how.
- Thoughts on building an ETH dominated portolio?
-
Best Websites For Coders
GitCoin : Gitcoin is the easiest way to monetize or incentivize work in Open Source Software.
-
Do you as a socialist consider blockchain tech as a path towards a worker-owned means of production? It’s the primary goal of many crypto projects.
Also, check out Gitcoin: https://gitcoin.co/ (which coincidentally does have a token) but has funneled over $65m directly to open source software developers. They’ve also recently formed a foundation that is governed by the token holders.
-
How can i work online for crypto?
Check out https://gitcoin.co/!
-
The Importance of Cryptocurrency to Web 3 and the Future of Decentralization
If you want to get involved then I suggest going to https://gitcoin.co/
-
Reminder for people interested in Bisq to get involved in discussing proposals on GitHub
There's other projects that have tried implementing something similar though.
-
Nano bounty program
Check out https://gitcoin.co. They provide a platform for web3 projects to provide bounties to people creating for projects.
-
Making money with ethdev projects?
gitcoin.co has bounties and hackathons with prizes.
What are some alternatives?
imgui - Dear ImGui: Bloat-free Graphical User interface for C++ with minimal dependencies
opensea-js - TypeScript SDK for the OpenSea marketplace
Duilib
rotki - A portfolio tracking, analytics, accounting and management application that protects your privacy
ILGPU - ILGPU JIT Compiler for high-performance .Net GPU programs
openzeppelin-contracts - OpenZeppelin Contracts is a library for secure smart contract development.
AdaptiveCpp - Implementation of SYCL and C++ standard parallelism for CPUs and GPUs from all vendors: The independent, community-driven compiler for C++-based heterogeneous programming models. Lets applications adapt themselves to all the hardware in the system - even at runtime!
hevm - Dapp, Seth, Hevm, and more
nana - a modern C++ GUI library
Gravitational Teleport - Protect access to all of your infrastructure
FTXUI - Features: - Functional style. Inspired by [1] and React - Simple and elegant syntax (in my opinion). - Support for UTF8 and fullwidth chars (→ 测试). - No dependencies. - Cross platform. Linux/mac (main target), Windows (experimental thanks to contributors), - WebAssembly. - Keyboard & mouse navigation. Operating systems: - linux emscripten - linux gcc - linux clang - windows msvc - mac clang
quadratic-funding - This is an open source implementation of quadratic funding, a design for philanthropic and publicly-funded seeding, which allows for optimal provisioning of funds to an ecosystem of public goods.