Python GPU

Open-source Python projects categorized as GPU

Top 23 Python GPU Projects

  • Pytorch

    Tensors and Dynamic neural networks in Python with strong GPU acceleration

    Project mention: Why can't stable diffusion use normal RAM or disc space when dealing with insufficient VRAM? | /r/StableDiffusion | 2023-06-03

    If you doesn't like how it work, go complain in

  • DeepSpeed

    DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

    Project mention: April 2023 | /r/dailyainews | 2023-06-02

    DeepSpeed Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales (

  • Sonar

    Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.

  • ivy

    The Unified Machine Learning Framework

    Project mention: Ask for help: what is the best way to have code both support torch and numpy? | /r/pytorch | 2023-02-22

    Check Ivy.

  • tvm

    Open deep learning compiler stack for cpu, gpu and specialized accelerators

    Project mention: MLC LLM - "MLC LLM is a universal solution that allows any language model to be deployed natively on a diverse set of hardware backends and native applications, plus a productive framework for everyone to further optimize model performance for their own use cases." | /r/LocalLLM | 2023-04-30

    I have tried the iPhone app. It's fast. They're using Apache TVM which should allow better use of native accelerators on different devices. Like using metal on Apple and Vulcan or CUDA or whatever instead of just running the thing on the CPU like llama.cpp.

  • nebuly

    The next-generation platform to monitor and optimize your AI costs in one place 🚀

    Project mention: What are you building with LLMs? I'm writing an article about what people are building with LLMs | /r/programming | 2023-03-27

    Hi everyone. I’m the creator of ChatLLaMA, an opensource framework to train LLMs with limited resources and create There’s been amazing usage of LLMs in these days, from chatbots to retrieve about company’s product information, to cooking assistants for traditional dishes, and much more. And you? What you building or would love to build with LLMs? Let me know and I’ll share the article about your stories soon. Cheers

  • ImageAI

    A python library built to empower developers to build applications and systems with self-contained Computer Vision capabilities

    Project mention: Is it possible to use ML to identify a certain pattern in videos by training with videos? | /r/learnmachinelearning | 2023-04-17

    From ImageAI?

  • catboost

    A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

    Project mention: Boosting Algorithms | | 2022-07-05
  • InfluxDB

    Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.

  • AlphaPose

    Real-Time and Accurate Full-Body Multi-Person Pose Estimation&Tracking System

  • cupy

    NumPy & SciPy for GPU

    Project mention: Speed Up Your Physics Simulations (250x Faster Than NumPy) Using PyTorch. Episode 1: The Boltzmann Distribution | /r/Physics | 2023-04-13

    I'd also recommend checking out CuPy which aims to fully re-implement the Numpy api for CUDA GPUs, while taking advantage of Nvidia's specialized libraries like cuBLAS, cuRAND, cuSOLVER etc. The tradeoff being that it only works with Nvidia GPUs.

  • chainer

    A flexible framework of neural networks for deep learning

    Project mention: Protip: the upscaler matters a lot | /r/StableDiffusion | 2023-01-13

    Sorry maybe someone could chime in and help but I use chainer to upscale.

  • server

    The Triton Inference Server provides an optimized cloud and edge inferencing solution. (by triton-inference-server)

    Project mention: Single RTX 3080 or two RTX 3060s for deep learning inference? | /r/computervision | 2023-04-12

    For inference of CNNs, memory should really not be an issue. If it is a software engineering problem, not a hardware issue. FP16 or Int8 for weights is fine and weight size won’t increase due to the high resolution. And during inference memory used for hidden layer tensors can be reused as soon as the last consumer layer has been processed. You likely using something that is designed for training for inference and that blows up the memory requirement, or if you are using TensorRT or something like that, you need to be careful to avoid that every tasks loads their own copy of the library code into the GPU. Maybe look at

  • tf-quant-finance

    High-performance TensorFlow library for quantitative finance.

    Project mention: tf-quant-finance: NEW Derivatives and Hedging - star count:3911.0 | /r/algoprojects | 2023-06-05
  • gpustat

    📊 A simple command-line utility for querying and monitoring GPU status

    Project mention: CUDA out of memory Error | /r/StableDiffusion | 2022-10-26

    Do you have steam or other gaming platforms installed? There may be another service using ram. You could also check the ram with a cli tool

  • pytorch-forecasting

    Time series forecasting with PyTorch

    Project mention: Pytorch Lstm | /r/pytorch | 2023-04-05

    Source: Conversation with Bing, 4/5/2023 (1) jdb78/pytorch-forecasting: Time series forecasting with PyTorch - GitHub. (2) Time Series Prediction with LSTM Using PyTorch - Colaboratory. (3) time-series-classification · GitHub Topics · GitHub. (4) PyTorch: Dataloader for time series task - Stack Overflow.

  • jittor

    Jittor is a high-performance deep learning framework based on JIT compiling and meta-operators.

    Project mention: Jittor: High-performance deep learning framework based on JIT and meta-operators | | 2023-04-02
  • skypilot

    SkyPilot is a framework for easily running machine learning workloads on any cloud through a unified interface.

    Project mention: Show HN: Cloud Agnostic AI Platform | | 2023-05-29

    Interesting, happy to chat and provide feedback as I have been working in this field for the last few years. Did you get inspiration by any chance from the following paper : and their recent implementation ?

  • nvitop

    An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

    Project mention: Why does stable diffusion hold onto my vram even when it’s doing nothing. It works great for a few images and then it racks up so much vram usage it just won’t do anything anymore and errors out. Is there a way to free up VRAM every so often? RX 6700XT 12GB VRAM | /r/StableDiffusion | 2023-03-25

    Hey, thanks for that. I think I found what you mentioned:

  • pygraphistry

    PyGraphistry is a Python library to quickly load, shape, embed, and explore big graphs with the GPU-accelerated Graphistry visual graph analyzer

  • jetson_stats

    📊 Simple package for monitoring and control your NVIDIA Jetson [Orin, Xavier, Nano, TX] series

    Project mention: Setting up Object Detection Inference Server with Jetson Nano | /r/JetsonNano | 2023-02-26
  • asitop

    Perf monitoring CLI tool for Apple Silicon

    Project mention: What's the Powermetrics code for this? I want to track my wattage when charging. | /r/MacOS | 2023-02-22

    oh dear, my bad, look into ASITOP , i am apparently very confused today for some reason, as i tried to install that apple-silicon-only tool on an intel imac this morning before being basically called an idiot by said terminal 😂

  • PyCUDA

    CUDA integration for Python, plus shiny features

  • torchrec

    Pytorch domain library for recommendation systems

  • pyopencl

    OpenCL integration for Python, plus shiny features

    Project mention: An example for OpenCL 3.0? | /r/OpenCL | 2023-03-11

    Please note that OpenCL consists of two parts: host API and a separate language which is used to write kernels (code which is going to be offloaded to devices). OpenCL specification describes host APIs as C-style APIs and that is what implementors has to provide. However, there are number of various libraries which provides bindings for other languages: - C++ - Python - Go - Rust

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-06-05.

Python GPU related posts


What are some of the best open-source GPU projects in Python? This list will help you:

Project Stars
1 Pytorch 67,537
2 DeepSpeed 25,390
3 ivy 10,980
4 tvm 9,801
5 nebuly 8,152
6 ImageAI 7,793
7 catboost 7,160
8 AlphaPose 7,069
9 cupy 6,924
10 chainer 5,802
11 server 5,418
12 tf-quant-finance 3,912
13 gpustat 3,400
14 pytorch-forecasting 2,873
15 jittor 2,811
16 skypilot 2,635
17 nvitop 1,977
18 pygraphistry 1,851
19 jetson_stats 1,701
20 asitop 1,554
21 PyCUDA 1,547
22 torchrec 1,446
23 pyopencl 974
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives