Top 7 Python tpu Projects

skypilot

33 5,602 9.8 Python

SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.

Project mention: Ask HN: Most efficient way to fine-tune an LLM in 2024? | news.ycombinator.com | 2024-04-04

tpu-starter

1 452 5.1 Python

Everything you want to know about Google Cloud TPU

Project mention: A user-built manual on using TPUs for AI and LLMs on Google Cloud | news.ycombinator.com | 2023-08-04

WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
JAXFLUIDS

1 245 4.1 Python

Differentiable Fluid Dynamics Package

Project mention: Show HN: Elodin – A better framework for physics simulation | news.ycombinator.com | 2024-03-06

You are completely correct; right now it is just mechanics that we have built out. But, there isn't any theoretical reason you couldn't use this framework for other types of simulation. In particular, the Monte Carlo runner is super flexible. Since we are based on JAX you can utilize a ton of the tooling that others have built in the physics space like https://github.com/tumaer/JAXFLUIDS or https://github.com/DifferentiableUniverseInitiative/jax_cosm... . The goal right now though is pretty firmly focused on controls engineers and their needs, but we envision this becoming broadly used.

DECIMER-Image_Transformer

1 160 8.0 Python

DECIMER: Deep Learning for Chemical Image Recognition using Efficient-Net V2 + Transformer

Project mention: Drawing structure from PDF🔗⛓️ | /r/bioinformatics | 2023-04-28

stylegan2-flax-tpu

10 130 0.0 Python

🖼 Training StyleGAN2 on TPUs in JAX

Project mention: AI Real-Time Human Full-Body Photo Generator | news.ycombinator.com | 2023-08-23

I’ll take this opportunity to mention our research scaling StyleGAN 2 to larger datasets (using LAION) on food images, leveraging free TPU compute through the TRC program.
We trained for 36 days on a v4-8 on 558k images.
https://nyx-ai.github.io/stylegan2-flax-tpu/
We were hopeful GANs would beat diffusion models when trained on specific domains. But we’ve now switched to Stable Diffusion and Dreambooth training which has proven more much efficient for this purpose.
I still have hopes for GANs! I miss their insane inference speed.

evopose2d

1 82 0.0 Python

EvoPose2D is a two-stage human pose estimation model that was designed using neuroevolution. It achieves state-of-the-art accuracy on COCO.
xpk

1 52 8.6 Python

xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerators such as TPUs and GPUs on GKE.

Project mention: Gemma: New Open Models | news.ycombinator.com | 2024-02-21

There is a lot of work to make the actual infrastructure and lower level management of lots and lots of GPUs/TPUs open as well - my team focuses on making the infrastructure bit at least a bit more approachable on GKE and Kubernetes.
https://github.com/GoogleCloudPlatform/ai-on-gke/tree/main
and
https://github.com/google/xpk (a bit more focused on HPC, but includes AI)
and
https://github.com/stas00/ml-engineering (not associated with GKE, but describes training with SLURM)
The actual training is still a bit of a small pool of very experienced people, but it's getting better. And every day serving models gets that much faster - you can often simply draft on Triton and TensorRT-LLM or vLLM and see significant wins month to month.

InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).