GPU-Puzzles
owl
Our great sponsors
| GPU-Puzzles | owl | |
|---|---|---|
| 12 | 5 | |
| 5,022 | 1,178 | |
| - | 2.0% | |
| 3.4 | 8.2 | |
| 4 months ago | 19 days ago | |
| Jupyter Notebook | OCaml | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
GPU-Puzzles
- Solve Puzzles. Learn CUDA
- GPU Puzzles
- Understanding Automatic Differentiation in 30 lines of Python
-
FlashAttention-2, 2x faster than FlashAttention
I found it helpful to start with CUDA on numba since it lets you write GPU kernels in python. Assuming you're like most ML engineers and you're more familiar with python than C++, this allows you to separately learn CUDA concepts from also learning C++ at the same time. There's also a set of GPU puzzles for beginners [1] using to get started with numba CUDA.
[1] https://github.com/srush/GPU-Puzzles
- [Computer Science] srush/GPU-Puzzles: Solve puzzles. Learn CUDA.
-
Build on AWS Weekly - S1 E2 - Breaking Blocks with Terraform
Are you having fun with Machine Learning? Go and teach yourself beginner GPU programming with this wonderful notebook: GitHub repo
- GPU-Puzzles: Solve Puzzles. Learn CUDA
-
[D] What are some good resources to learn CUDA programming?
Practice puzzles: https://github.com/srush/GPU-Puzzles
- Learn GPU programming in interactive fashion
owl
- Owl project (OCaml scientific computing) formally concluded
- Understanding Automatic Differentiation in 30 lines of Python
- I Wrote an Activitypub Server in OCaml: Lessons Learnt, Weekends Lost
-
Julia 1.6 addresses latency issues
> after some consideration of OCaml, but unfortunately the multi-core story still isn't there yet
It is supposed to land in the release after 4.13, which is the next one.
Regarding the scientific computations library there is Owl[1][2] which now has an almost finished book[3].
[1] https://ocaml.xyz/
[2] https://github.com/owlbarn/owl
[3] https://ocaml.xyz/book/
-
A Comparison of Futhark and Dex
The Owl lib for OCaml is pretty interesting
https://github.com/owlbarn/owl
What are some alternatives?
vscode-infracost - See cost estimates for Terraform right in your editor💰📉
Octavian.jl - Multi-threaded BLAS-like library that provides pure Julia matrix multiplication
triton - Development repository for the Triton language and compiler
Arraymancer - A fast, ergonomic and portable tensor library in Nim with a deep learning focus for CPU, GPU and embedded devices via OpenMP, Cuda and OpenCL backends
cutlass - CUDA Templates for Linear Algebra Subroutines
Peroxide - Rust numeric library with R, MATLAB & Python syntax
carbon-lang - Carbon Language's main repository: documents, design, implementation, and related tools. (NOTE: Carbon Language is experimental; see README)
symengine.rs - (Unofficial) Rust wrappers to the C++ library SymEngine, a fast C++ symbolic manipulation library.
terraform-minecraft - A Terraform Script that can deploy Minecraft Servers
db-benchmark - reproducible benchmark of database-like ops
Tensor-Puzzles - Solve puzzles. Improve your pytorch.
micrograd - A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API