Top 5 Python Rocm Projects

tvm

15 11,130 9.9 Python

Open deep learning compiler stack for cpu, gpu and specialized accelerators

Project mention: Making AMD GPUs competitive for LLM inference | news.ycombinator.com | 2023-08-09

Yes, this is coming! Myself and others at OctoML and in the TVM community are actively working on multi-gpu support in the compiler and runtime. Here are some of the merged and active PRs on the multi-GPU (multi-device) roadmap:
Support in TVM’s graph IR (Relax) - https://github.com/apache/tvm/pull/15447

cupy

21 7,753 9.9 Python

NumPy & SciPy for GPU

Project mention: CuPy: NumPy and SciPy for GPU | news.ycombinator.com | 2023-11-28

WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
pytorch

4 214 0.0 Python

Tensors and Dynamic neural networks in Python with strong GPU acceleration (by ROCm)

Project mention: AMD Funded a Drop-In CUDA Implementation Built on ROCm: It's Open-Source | news.ycombinator.com | 2024-02-12

https://github.com/ROCm/pytorch/blob/main/Dockerfile
The ublue-os (and so also bazzite) OCI host image Containerfile has Sunshine installed; which is a 4k HDR 120fps remote desktop solution for gaming.
ublue-os/config//Containerfile:

vllm-rocm

1 71 9.6 Python

ROCm-enabled vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs

Project mention: Experimental Mixtral MoE on vLLM! | /r/LocalLLaMA | 2023-12-10

hat

1 6 4.2 Python

TOML-annotated C header file format for packaging binary files, from Microsoft Research (by microsoft)
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-02-12.